Information processing method, information processing device, information processing program, and information processing system

Abstract

To provide a technology that enables a real space to be reproduced in a virtual space in a form closer to reality than before. [Solution] The information processing method disclosed herein includes an acquisition step in which a computer acquires spatial basic data that indicates a real space, the spatial basic data including object data related to objects that exist in the real space; a generation step in which a computer acquires attribute information that indicates the attributes of an object identified by the object data included in the acquired spatial basic data, assigns functional information to the object data that corresponds to the attribute of the object indicated by the acquired attribute information and that is for realizing a function related to the operation of the object, and generates virtual space data that indicates a virtual space that virtually represents the real space based on the spatial basic data that includes the object data to which the functional information has been assigned; and an output step in which the computer outputs the generated virtual space data.

Description

[Technical Field]

[0001] The present disclosure relates to an information processing method, an information processing device, an information processing program, and an information processing system. [Background technology]

[0002] Virtual reality technology allows people to experience a virtual world constructed on a computer as if it were real. This virtual world is made up of various virtual objects (hereinafter simply referred to as "objects") and is called a virtual reality space or virtual space. Real people (hereinafter referred to as "participants") can participate in the virtual space using avatars. An avatar is, for example, an object used as an avatar by a participant when participating in the virtual space.

[0003] In relation to the generation of virtual spaces, there is a conventional technology in which information indicating objects such as construction vehicles is associated with a virtual space in which a construction site is reproduced, and the information is displayed on a display unit (for example, Patent Document 1). This technology uses three-dimensional information including coordinate information as information for reproducing the construction site in the virtual space and displaying it three-dimensionally on the display unit. This coordinate information is data generated, for example, by a technique called BIM (Building Information Modeling). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2023-146532 Summary of the Invention [Problem to be solved by the invention]

[0005] The technology disclosed in Patent Document 1 displays a virtual space after associating information indicating the object with it, making it possible to accurately grasp the position of the object on the construction site. However, as mentioned above, participants may participate in the virtual space using avatars, and they may attempt to perform some action on the object via the avatar with the intention of simulating it in the virtual space. In such cases, it is required that the virtual space be able to reproduce events that may occur in the real world in a manner that is closer to reality. However, Patent Document 1 does not specifically mention this issue.

[0006] The disclosed technology is intended to solve the above-mentioned problems, and provides a technology that makes it possible to reproduce real space in a virtual space in a form that is closer to reality than ever before. [Means for solving the problem]

[0007] An information processing method according to the present disclosure is an information processing method by a computer, the information processing method including: an acquisition step in which the computer acquires spatial basic data indicating a real space, the spatial basic data including object data related to objects existing in the real space; an attribute determination step of determining attributes of an object identified by object data included in the acquired spatial basic data; death Tao The method executes a generation step of acquiring attribute information indicating the attributes of an object, assigning functional information to object data that corresponds to the attributes of the object indicated by the acquired attribute information and that is for realizing a function related to the operation of the object, and generating virtual space data that indicates a virtual space that virtually represents real space based on spatial basic data including the object data to which the functional information has been assigned, and an output step of outputting the generated virtual space data. [Effects of the Invention]

[0008] The information processing method according to the disclosed technology has the above-described technical features and can reproduce real space in a virtual space in a form closer to reality than conventional methods. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram showing a configuration of an information processing system according to a first embodiment. [Figure 2] 1 is a block diagram showing a hardware configuration for realizing the functions of an information processing device according to a first embodiment. [Figure 3] 4 is a flowchart showing an example of the operation of the information processing device according to the first embodiment. [Figure 4] 4A, 4B, and 4C are diagrams illustrating examples of operations of an object specified by object data to which function information is added in the first embodiment. [Figure 5] 5A, 5B, and 5C are diagrams for explaining an overview of the collider in the first embodiment. [Figure 6] 6A and 6B are diagrams for explaining an outline of material information according to the first embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Embodiment 1 Fig. 1 is a block diagram showing the configuration of an information processing system 1 according to the first embodiment. In Fig. 1, the information processing system 1 is a system in which an information processing device 2, a service providing server 3, and a participating terminal 4 are connected via a network 5. An existing telecommunications line can be used as the network 5. The network 5 is, for example, the Internet. The information processing device 2, the service providing server 3, and the participating terminal 4 can communicate with each other via the network 5.

[0011] (Information processing device 2) The information processing device 2 acquires space basic data that indicates a real space and includes object data related to objects existing in the real space, and acquires attribute information that indicates attributes of objects identified by the object data included in the acquired space basic data. The information processing device 2 assigns, to the object data, function information that corresponds to the attributes of the object indicated by the acquired attribute information and is used to realize a function related to the operation of the object. The information processing device 2 generates virtual space data that indicates a virtual space that virtually represents the real space, based on the space basic data that includes the object data to which the function information has been assigned, and outputs the generated virtual space data.

[0012] In the information processing system 1, some or all of the functions of the information processing device 2 may be provided by the service providing server 3 or by the participating terminal 4. In addition, in the information processing system 1, some or all of the functions of the information processing device 2 may be provided in a redundant manner by the service providing server 3 and the participating terminal 4.

[0013] In the following, unless otherwise specified, it is assumed that all of the functions of the information processing device 2 are provided by a single server having a physical configuration independent of the service providing server 3 and the participating terminals 4. However, all of the functions of the information processing device 2 may be realized by a single server or by multiple servers. In this case, the server may provide the functions through SaaS (Software as a Service), or may be installed and operated in a facility managed by the administrator of the server (on-premise). Details of the information processing device 2 will be described later.

[0014] In the present disclosure, the computer refers to an information processing device 2 or an information processing system 1 including the information processing device 2.

[0015] (Service provider server 3) The service providing server 3 provides services related to the virtual space represented by the virtual space data to users, such as participants in the virtual space, via the network 5. For example, a person wishing to use the service can register as a user of the service by accessing the service providing server 3 from their own terminal and completing a predetermined procedure. The predetermined procedure may include, for example, registering the user's desired name (real name or handle name) as a name for identifying the user. The service providing server 3 assigns a unique ID (hereinafter referred to as the "user ID") to the registered user and manages the user by linking the user ID with information about the user, such as the user's name. The service is provided to the user, for example, through a service app installed on the user's terminal, such as the participant terminal 4.

[0016] The service providing server 3 manages virtual space data, which is three-dimensional data of a virtual space. The service providing server 3 can manage multiple different virtual space data. The service providing server 3 assigns a unique ID as metadata to each of the multiple virtual space data and manages the virtual space data.

[0017] 1, the information processing system 1 has only one service providing server 3. However, the information processing system 1 may have one or more service providing servers 3. When the information processing system 1 has multiple service providing servers 3, the service providing servers 3 may, for example, manage different virtual space data from each other, or when one service providing server 3 manages certain virtual space data, another service providing server 3 may manage replicated virtual space data that is a replicate of that virtual space data.

[0018] In the following description, it is assumed that the information processing system 1 has one service providing server 3, similar to that shown in FIG.

[0019] (Participating terminal 4) The participation terminal 4 is a terminal used by a participant when participating in a virtual space. The participant uses the participation terminal 4 to access the service providing server 3 and download the desired virtual space data to the participation terminal 4. The participant uses the participation terminal 4 to participate in the virtual space represented by the virtual space data as an avatar. The participant can also participate in the virtual space by simply browsing the virtual space without using an avatar.

[0020] When a participant participates in the virtual space as an avatar, the participant can change the state of the avatar or other objects by operating the participant terminal 4, such as by moving the avatar within the virtual space, changing the avatar's posture, or moving the avatar to move or use other objects.

[0021] The participating terminal 4 is, for example, a smartphone, a tablet terminal, or a PC (Personal Computer). Alternatively, the participating terminal 4 may be a head-mounted display with a communication function that is used together with a controller.

[0022] For example, a participant wearing a head-mounted display on their head and holding a controller in their hand can operate the virtual space displayed on the head-mounted display by moving their head or hand or by operating buttons on the controller. That is, the participating terminal 4 may be any device that can display a virtual space and allow operations to be performed on the virtual space.

[0023] (Sharing spatial data) When a participant uses a participation terminal 4 to participate in a virtual space as an avatar and operates the participation terminal 4 to change the state of the avatar or other objects, the participation terminal 4 modifies the downloaded virtual space data based on information indicating the operation (hereinafter referred to as "operation information"), and changes the state of the avatar or other objects in the virtual space. The participation terminal 4 also transmits the operation information to the service providing server 3. The service providing server 3 modifies the virtual space data it manages for the virtual space in which the above-mentioned avatar is participating, based on the operation information acquired from the participation terminal 4, and changes the state of the avatar or other objects in that virtual space.

[0024] In this way, the participating terminals 4 and the service providing server 3 can share the states of avatars and objects in a single virtual space in almost real time. In other words, the participating terminals 4 and the service providing server 3 can share virtual space data for a single virtual space in almost real time.

[0025] 1 shows only one participant terminal 4. However, the information processing system 1 normally has a plurality of participant terminals 4.

[0026] For example, if multiple participants are participating in the same virtual space as avatars from their own participating terminals 4, when the service providing server 3 receives operation information from one participating terminal 4, it also transmits that operation information to all other participating terminals 4. When all other participating terminals 4 receive the above-mentioned operation information from the service providing server 3, they modify the downloaded virtual space data and change the states of their avatars or other objects in the virtual space.

[0027] In this way, the states of avatars and objects in a single virtual space can be shared in almost real time among multiple participating terminals 4 and the service providing server 3. In other words, the virtual space data of a single virtual space can be shared in almost real time among multiple participating terminals 4 and the service providing server 3.

[0028] (Details of information processing device 2) The following describes in detail the information processing device 2. As shown in FIG.

[0029] The communication unit 21 communicates with the service providing server 3 and the participating terminals 4 via the network 5. For example, the communication unit 21 is a communication device capable of mobile communication using a communication method such as LTE, 3G, 4G, or 5G, and communicates with other devices such as the service providing server 3 and the participating terminals 4 connected to the network 5. For example, as described above, if the participating terminal 4 is a head-mounted display, the communication unit 21 connects to the head-mounted display and communicates with it. The communication unit 21 may also be equipped with a short-range wireless communication means such as Bluetooth (registered trademark).

[0030] The calculation unit 22 controls the overall operation of the information processing device 2. The calculation unit 22 includes a space basic data acquisition unit 221, an attribute determination unit 222, a virtual space data generation unit 223, and an output unit 224. When the calculation unit 22 executes an information processing application, the calculation unit 22 realizes the functions of the space basic data acquisition unit 221, the attribute determination unit 222, the virtual space data generation unit 223, and the output unit 224.

[0031] The storage unit 23 stores, for example, an information processing application and information used in the arithmetic processing of the arithmetic unit 22. The storage unit 23 is a storage device provided in a computer functioning as the information processing device 2, and includes storage such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), or the memory 103 of FIG. 2. Note that the storage unit 23 may be provided outside the information processing device 2 as long as it is accessible by the information processing device 2.

[0032] 2 is a block diagram showing a hardware configuration that realizes the functions of the information processing device 2. For example, the information processing device 2 has, as its hardware configuration, a communication interface 100, an input / output interface 101, a processor 102, and a memory 103. The functions of the information processing device 2, namely, a space basic data acquisition unit 221, an attribute determination unit 222, a virtual space data generation unit 223, and an output unit 224, are realized by executing an information processing application in this hardware configuration.

[0033] The communication interface 100 outputs data received from the service providing server 3, participating terminals 4, etc. via the network 5 to the processor 102, and transmits data generated by the processor 102 to the service providing server 3, participating terminals 4, etc. via the network 5. The processor 102 reads and writes data from the memory unit 23 in FIG. 1 via the input / output interface 101.

[0034] The programs constituting the information processing application for realizing each function of the space basic data acquisition unit 221, the attribute determination unit 222, the virtual space data generation unit 223, and the output unit 224 provided in the information processing device 2 are stored in the memory unit 23.

[0035] The processor 102 reads out a program stored in the storage unit 23 via the input / output interface 101, loads it into the memory 103, and executes the program loaded into the memory 103. In this way, the processor 102 realizes the functions of a space basic data acquisition unit 221, an attribute determination unit 222, a virtual space data generation unit 223, and an output unit 224. The memory 103 is, for example, a RAM (Random Access Memory).

[0036] (Spatial Basic Data Acquisition Unit 221) The space basic data acquisition unit 221 acquires space basic data that indicates the real space. The space basic data is data that includes object data related to objects that exist in the real space. The object data includes coordinate information that can identify each point (each vertex) of the object that exists in the real space.

[0037] There are no particular limitations on the method for acquiring the spatial basic data by the spatial basic data acquisition unit 221. For example, when a participant operates a participant terminal 4 to transmit (upload) spatial basic data to the information processing device 2, the spatial basic data acquisition unit 221 may acquire the spatial basic data transmitted from the participant terminal 4.

[0038] In this case, the participant can operate the participant terminal 4 to access the information processing device 2 and display a screen for uploading the spatial basic data on a display (not shown) of the participant terminal 4. This screen is displayed on a browser, for example. For example, a data specification window can be displayed on this screen.

[0039] A participant can operate the participant terminal 4 to input information specifying the spatial basic data to be uploaded (such as the path name of the participant terminal 4) into this data specification window. When a participant inputs information specifying the spatial basic data into the data specification window, the participant terminal 4 transmits the spatial basic data specified by the user to the information processing device 2.

[0040] Alternatively, if the administrator of the information processing device 2 (hereinafter simply referred to as the "administrator") holds the spatial basic data, the administrator may directly input the spatial basic data into the information processing device 2. In this case, the spatial basic data acquisition unit 221 may acquire the spatial basic data input into the information processing device 2 by the administrator.

[0041] Examples of data that can be considered spatial basic data include data generated using a CAD (Computer-Aided Design) system, data generated using a BIM (Building Information Modeling) system, data generated by PLATEAU, an open data platform for 3D city models promoted by the Ministry of Land, Infrastructure, Transport and Tourism, and point cloud scan data, which records a collection of points (coordinate information) in three-dimensional space. Of these, point cloud scan data is data obtained when measuring an object or space using a 3D scanner or LiDAR, and includes the X, Y, and Z coordinate information of each point in three-dimensional space.

[0042] In addition to the above, the spatial basic data may be three-dimensional data generated from multiple pieces of image data. For example, a technique called 3D Gaussian Splatting can be used to generate three-dimensional data by stereoscopically converting multiple pieces of image data. The spatial basic data acquisition unit 221 may acquire, as spatial basic data, three-dimensional data generated in advance by a participant or administrator using a technique called 3D Gaussian Splatting. Alternatively, the spatial basic data acquisition unit 221 may acquire multiple pieces of image data from the participant terminal 4 and generate three-dimensional data from the acquired image data using 3D Gaussian Splatting. Alternatively, if an administrator holds multiple pieces of image data and directly inputs the image data into the information processing device 2, the spatial basic data acquisition unit 221 may generate three-dimensional data using 3D Gaussian Splatting from the image data input into the information processing device 2 by the administrator.

[0043] The spatial basic data acquisition unit 221 outputs the spatial basic data acquired as described above to the attribute determination unit 222.

[0044] (Attribute determination unit 222) The attribute determination unit 222 acquires space basic data from the space basic data acquisition unit 221. When the attribute determination unit 222 acquires space basic data from the space basic data acquisition unit 221, it determines the attribute of an object specified by the object data included in the acquired space basic data. Furthermore, when the attribute determination unit 222 determines the attribute of the object, it generates information indicating the determined attribute (hereinafter referred to as "attribute information") and assigns the generated attribute information to the object data.

[0045] Attribute information is basically information that indicates the type of object, such as a door, staircase, wall, ceiling, building, road, vehicle, or airplane, which can exist in real space.

[0046] The attribute determination unit 222 can select an attribute determination method depending on whether or not the object data indicating the object includes information for identifying the object (hereinafter referred to as "object identification information"). Specific attribute determination methods will be described later. The attribute determination unit 222 outputs the object data to which the attribute information has been assigned to the virtual space data generation unit 223.

[0047] (Virtual space data generation unit 223) The virtual space data generation unit 223 acquires object data to which attribute information has been assigned from the attribute determination unit 222. When the virtual space data generation unit 223 acquires object data to which attribute information has been assigned from the attribute determination unit 222, the virtual space data generation unit 223 assigns, to the object data, function information according to the attribute indicated by the attribute information assigned to the acquired object data.

[0048] Furthermore, when the virtual space data generation unit 223 assigns the functional information to the object data, it generates virtual space data indicating a virtual space that virtually represents real space, based on the space basic data including the object data to which the functional information has been assigned. The virtual space data generation unit 223 outputs the generated virtual space data to the output unit 224.

[0049] Function information is information for realizing a function related to the operation of an object. Function information includes information indicating a script (hereinafter simply referred to as "script") for realizing a function related to a specific operation of an object, as well as supplementary information related to the function.

[0050] For example, if the attribute of an object is "door," the function related to the operation of this object is a function related to "opening and closing the door." In this case, the function information attached to this object data includes a script for realizing the opening and closing operation of the door in virtual space, and supplementary information related to the function.

[0051] The supplemental information includes information that identifies a portion (area) of the object to which a function related to the operation of the object is associated. For example, if the attribute of the object is "door," the information that identifies the portion of the object on which the opening and closing function is performed is information that identifies which portion of the door serves as the pivot for opening and closing, and which part of the door opens and closes. A specific method for assigning function information by the virtual space data generation unit 223 will be described later.

[0052] (output unit 224) The output unit 224 acquires virtual space data from the virtual space data generation unit 223. When the output unit 224 acquires virtual space data from the virtual space data generation unit 223, it outputs the acquired virtual space data. For example, the output unit 224 outputs the virtual space data to the service providing server 3 or the participant terminal 4. When the output unit 224 outputs the virtual space data to the service providing server 3, the service providing server 3 acquires the virtual space data output from the output unit 224, manages it on its own device, and outputs the virtual space data to the participant terminal 4 that has requested a download. When the output unit 224 outputs the virtual space data to the participant terminal 4, the participant terminal 4, in response to an instruction from the participant, launches, for example, a service app installed on its own device, and displays the virtual space identified by the acquired virtual space data.

[0053] (Example of operation) Next, an example of the operation of the information processing device 2 will be described with reference to the flowchart shown in Fig. 3. Note that, here, an example will be described in which the spatial basic data acquisition unit 221 acquires spatial basic data from a participating terminal 4, and the output unit 224 outputs virtual space data generated based on the spatial basic data to the same participating terminal 4 that acquired the spatial basic data. That is, in this example, it is assumed that the provider who provides the spatial basic data to the information processing device 2 and the participant who uses the participating terminal 4 to participate in the virtual space based on the virtual space data generated based on the provided spatial basic data are the same person.

[0054] First, the space basic data acquisition unit 221 acquires space basic data indicating the real space (step ST1). Here, a participant operates the participation terminal 4 to transmit (upload) the space basic data to the information processing device 2, and the space basic data acquisition unit 221 acquires the space basic data transmitted from the participation terminal 4. The spatial basic data acquisition unit 221 outputs the acquired spatial basic data to the attribute determination unit 222.

[0055] Next, the attribute determination unit 222 acquires space basic data from the space basic data acquisition unit 221. Upon acquiring the space basic data from the space basic data acquisition unit 221, the attribute determination unit 222 determines the attribute of an object identified by the object data included in the acquired space basic data (step ST2). Furthermore, upon determining the attribute of the object, the attribute determination unit 222 generates information (attribute information) indicating the determined attribute, and assigns the generated attribute information to the object data.

[0056] The attribute determination unit 222 can select an attribute determination method depending on whether or not information for identifying an object (object identification information) is included in the object data indicating the object.

[0057] Object identification information may include various information for identifying an object, such as information indicating the name of the object (hereinafter referred to as "object name information"), information indicating the product number (product ID) of the object, or information indicating the name and type of the manufacturer of the object.

[0058] Here, to make the explanation more concrete, we will take the example of the case where the object identification information is object name information, and explain a method for determining attributes depending on whether or not the object data indicating the object contains information indicating the name of the object (object name information).

[0059] (1) When object name information is included in the object data When object name information is included in the object data indicating the object, the attribute determination unit 222 determines the attribute of the object using the first machine learning model.

[0060] For example, if the spatial basic data is data generated using the BIM system described above, the attribute information for each object data contained in the data often contains object name information. In such cases, the attributes of the object can be determined as follows:

[0061] For example, if object data indicating an object includes, as object name information, information indicating the name of the object, "Door No. 1," the attribute determination unit 222 inputs the object name information to a first machine learning model and causes the first machine learning model to infer the attributes of the object. The first machine learning model infers the attributes of the object based on the input object name information and outputs attribute information indicating the attribute "door" as an inference result. The attribute determination unit 222 acquires the attribute information of the object output as an inference result from the first machine learning model. The attribute determination unit 222 determines the attributes of the object based on the acquired attribute information.

[0062] The first machine learning model is a model that has been trained to infer and output attribute information of an object in response to input of object name information, and is generated in advance by an administrator, for example.

[0063] The first machine learning model may be, for example, an artificial neural network, and there may be multiple first machine learning models. In addition, if there are multiple first machine learning models, the first machine learning models may include a large language model (LLM).

[0064] The first machine learning model including the large-scale language model may be provided in an external server or in the information processing device 2.

[0065] Furthermore, the large-scale language model may be, for example, an existing large-scale language model provided as a service by an external server. In this case, the information processing device 2 can input a prompt to the large-scale language model and obtain a response to the input from the large-scale language model through API (Application Programming Interface) cooperation.

[0066] The prompt input to the first machine learning model includes, for example, an instruction to infer an attribute of an object based on object name information and output the attribute information. This prompt may be generated by, for example, an administrator creating a template of the prompt in advance and storing it in the storage unit 230. When determining an attribute, the attribute determination unit 222 may read the template from the storage unit 230, perform appropriate processing such as embedding the above-described object name information in the read template, and generate a prompt, and input the generated prompt to the first machine learning model.

[0067] Note that, here, we have used an example in which the object identification information is object name information, but if information other than object name information is used as object identification information, the first machine learning model only needs to be trained to infer and output attribute information in response to input information used as object identification information.

[0068] (2) When the object data does not contain object name information If object name information is not included in the object data indicating the object, the attribute determination unit 222 determines the attribute of the object using the second machine learning model.

[0069] In this case, the attribute determination unit 222 generates information about the shape of the object (hereinafter referred to as "object shape information") that can be identified from the coordinate information of each point of the object included in the object data. The shape of the object is, for example, a rectangular parallelepiped if the object is a building, the shape of the house if the object is a detached house, or the shape of the vehicle if the object is a car. The object shape information is, for example, three-dimensional information such as a point cloud or a mesh, image information from which the shape of the object can be identified, or a depth map.

[0070] The attribute determination unit 222 inputs the generated object shape information to a second machine learning model, and causes the second machine learning model to infer the attributes of the object. The second machine learning model infers the attributes of the object based on the input object shape information, and outputs attribute information indicating the attributes of the object as an inference result. The attribute determination unit 222 acquires the attribute information of the object output as an inference result from the second machine learning model. The attribute determination unit 222 determines the attributes of the object based on the acquired attribute information.

[0071] The second machine learning model is a model that has been trained to infer and output attribute information of an object in response to input of object shape information, and is generated in advance by an administrator, for example.

[0072] The second machine learning model may be, for example, an artificial neural network, and there may be multiple second machine learning models. If there are multiple second machine learning models, the second machine learning models may include a large-scale language model. The second machine learning model may be the same model as the first machine learning model described above, or may include the same large-scale language model as the large-scale language model included in the first machine learning model.

[0073] The second machine learning model including the large-scale language model may be provided in an external server or in the information processing device 2.

[0074] Furthermore, the large-scale language model may be, for example, an existing large-scale language model provided as a service by an external server. In this case, the information processing device 2 can input a prompt to the large-scale language model through API linkage and obtain a response to the input from the large-scale language model.

[0075] The prompt input to the second machine learning model includes, for example, an instruction to infer the attributes of an object based on object shape information and output the attribute information. This prompt may be generated by, for example, an administrator creating a template for the prompt in advance and storing it in the storage unit 230. When determining an attribute, the attribute determination unit 222 may read the template from the storage unit 230, perform appropriate processing such as embedding the above-described object shape information in the read template, and generate a prompt, and input the generated prompt to the second machine learning model.

[0076] It is also possible that an object identified from a single piece of object data includes multiple objects, but the single piece of object data itself is not divided into multiple pieces of object data. In this case, the attribute determination unit 222 generates object shape information indicating the overall shape of the object identified from the single piece of object data, and inputs the generated object shape information into the second machine learning model to determine the attribute.

[0077] For example, if a building is composed of multiple doors or staircases, but the object data representing the building is not divided into object data representing multiple doors or object data representing multiple staircases, the attribute determination unit 222 generates object shape information representing the overall shape of the building, inputs the generated object shape information into a second machine learning model, and has the second machine learning model infer the attributes of the object (in this case, the building).

[0078] After determining the attribute of the object as described above, the attribute determination unit 222 generates information indicating the determined attribute (attribute information) and assigns the generated attribute information to the object data. The attribute determination unit 222 outputs the object data to which the attribute information has been assigned to the virtual space data generation unit 223.

[0079] In the above description, it is assumed that the object data included in the space basic data may already include attribute information of the object. However, even if the object data included in the space basic data acquired from the space basic data acquisition unit 221 includes attribute information of the object, the attribute determination unit 222 may perform the attribute determination of the object and assign the attribute information to the object data as described above. For example, even if object attribute information is included in the object data included in the space basic data acquired from the space basic data acquisition unit 221, the attributes indicated by the attribute information may not necessarily have the same definition as the attributes associated with the functional information when the virtual space data generation unit 223 assigns functional information to the object data in step ST3 described below. Therefore, even if object attribute information is included in the object data included in the space basic data acquired from the space basic data acquisition unit 221, the attribute determination unit 222 may perform the attribute determination of the object and assign attribute information to the object data as described above in order to match the attribute information included in the object data with attribute information indicating the attributes associated with the functional information described below, that is, to standardize the attribute information. In addition, if it is clear that the attribute determination of the object as described above is unnecessary, such as when the object data included in the spatial basic data already includes attribute information of the object and the attributes indicated by the attribute information clearly match in definition with the attributes linked to the functional information, the processing of attribute determination by the attribute determination unit 222 in step ST2 may be omitted.

[0080] Next, the virtual space data generation unit 223 acquires the object data to which attribute information has been assigned from the attribute determination unit 222. When the virtual space data generation unit 223 acquires the object data to which attribute information has been assigned from the attribute determination unit 222, the virtual space data generation unit 223 assigns, to the object data, function information according to the attribute indicated by the attribute information assigned to the acquired object data (step ST3).

[0081] The function information is information for realizing a function related to the operation of an object. The function information includes a script for realizing a function related to a specific operation of the object, as well as supplementary information related to the function.

[0082] For example, if the attribute of an object is "door," the function related to the operation of this object is a function related to "opening and closing the door." In this case, the function information attached to this object data includes a script for realizing the opening and closing operation of the door in virtual space, and supplementary information related to the function.

[0083] The supplemental information includes information that identifies a part (area) of the object to which a function related to the operation of the object is associated. For example, if the attribute of the object is "door," the information that identifies the part of the door on which the opening and closing function is executed, such as which part of the door pivots to open and close, or which part of the door opens and closes.

[0084] In addition, the supplemental information may include a wide range of information about how the object's function is realized, such as the direction and range (angle) of the object's movement, and information indicating the conditions for the object to move (activation conditions). For example, if the attribute of an object is "door," the supplemental information may include information indicating that the avatar can grasp (hold) the door handle, that the door opens in a specific direction when the avatar grasps the door handle, and that the door opens to the right (or left).

[0085] For example, if the attribute of an object is "airplane," the function related to the object's operation is a function related to "riding" or "flying." In this case, the supplemental information includes, for example, information indicating that the avatar can ride in the cockpit of the airplane, and that when the avatar rides in the cockpit of the airplane, the avatar and the airplane can fly together.

[0086] Next, a specific method for adding functional information will be described. First, the virtual space data generation unit 223 acquires attribute information assigned to the object data acquired from the attribute determination unit 222. Upon acquiring the attribute information, the virtual space data generation unit 223 assigns functional information to the object data mainly by (1) a method using a template or (2) an automatic generation method using a machine learning model.

[0087] (1) Using a template The virtual space data generation unit 223 identifies functional information corresponding to the attributes based on information that previously associates the attributes of an object with functional information to be assigned to the object with the attributes, and assigns the identified functional information to the object data.

[0088] Specifically, functional information to be assigned to an object is prepared in advance as a template for each attribute of the object. In this case, the correspondence between functional information and attributes is generated by the administrator as, for example, a table and stored in the storage unit 23. Furthermore, functional information for each attribute is also generated in advance by the administrator and stored in the storage unit 23.

[0089] When the virtual space data generation unit 223 acquires attribute information from object data, it refers to the table and acquires function information corresponding to the attribute indicated by the acquired attribute information from the storage unit 23. The virtual space data generation unit 223 assigns the acquired function information to the object data.

[0090] (2) Automatic generation method using machine learning models The virtual space data generation unit 223 uses a machine learning model to automatically generate functional information to be assigned to object data, and assigns the generated functional information to the object data. For example, depending on the attribute, there may be cases where corresponding functional information does not exist in the table. In such cases, the present method is used.

[0091] First, the virtual space data generation unit 223 draws the shape of the object as an image based on the object data to which functional information is to be assigned, and generates image information indicating the image of the drawn shape. The virtual space data generation unit 223 inputs the generated image information, attribute information of the object, and a predetermined prompt into a third machine learning model, and causes the third machine learning model to infer the function to be assigned to the object and the above-mentioned supplemental information. The third machine learning model infers the function to be assigned to the object and the above-mentioned supplemental information based on the input image information, attribute information of the object, and the predetermined prompt, and outputs information indicating the function to be assigned to the object and the supplemental information as inference results. The virtual space data generation unit 223 acquires the information indicating the function to be assigned to the object and the supplemental information output as inference results from the third machine learning model.

[0092] The third machine learning model is a model trained to infer and output information indicating a function to be assigned to an object and supplementary information in response to input of image information indicating the shape of an object and attribute information of the object, and is generated in advance by, for example, an administrator. Hereinafter, the third machine learning model will also be referred to as a "function inference model."

[0093] The third machine learning model may be, for example, an artificial neural network, and there may be multiple third machine learning models. Furthermore, if there are multiple third machine learning models, the third machine learning models may include a large-scale language model. Furthermore, the third machine learning model may be the same as the first machine learning model described above, or may include the same large-scale language model as the large-scale language model included in the first machine learning model.

[0094] The third machine learning model including the large-scale language model may be provided in an external server or in the information processing device 2.

[0095] Furthermore, the large-scale language model may be, for example, an existing large-scale language model provided as a service by an external server. In this case, the information processing device 2 can input a prompt to the large-scale language model through API linkage and obtain a response to the input from the large-scale language model.

[0096] The prompt input to the third machine learning model includes, for example, an instruction to infer information indicating a function to be assigned to an object and supplemental information based on image information indicating the shape of the object and attribute information of the object, and to output these. This prompt may be generated by, for example, an administrator creating a template of the prompt and storing it in the storage unit 230. When using the third machine learning model, the virtual space data generation unit 223 may read the template from the storage unit 230, perform appropriate processing such as embedding the attribute information of the object into the read template, and generate a prompt, and input the generated prompt to the third machine learning model.

[0097] In the above description, the virtual space data generation unit 223 inputs image information indicating the shape of an object, attribute information of the object, and a predetermined prompt as input to the third machine learning model. However, if the third machine learning model is a model that can process three-dimensional information such as a point cloud or mesh that can recognize the shape of an object, or depth map information, for example, the virtual space data generation unit 223 may input three-dimensional information such as a point cloud or mesh that can recognize the shape of an object, or depth map information, instead of image information indicating the shape of the object, to the third machine learning model, thereby inferring information indicating a function to be assigned to the object and supplemental information.

[0098] Next, the virtual space data generation unit 223 inputs the information indicating the function to be imparted to the object, the supplemental information, and the predetermined prompt acquired from the third machine learning model into a fourth machine learning model, and causes the fourth machine learning model to generate a script for realizing the function to be imparted to the object. The fourth machine learning model generates a script for realizing the function to be imparted to the object based on the input information indicating the function to be imparted to the object, the supplemental information, and the predetermined prompt, and outputs the generated script.

[0099] The fourth machine learning model is a model trained to generate and output a script for realizing the function to be assigned to an object in response to input of information indicating the function to be assigned to the object and supplemental information, and is generated in advance by, for example, an administrator. Hereinafter, the fourth machine learning model will also be referred to as a "script generation model."

[0100] The fourth machine learning model may be, for example, an artificial neural network, and there may be multiple fourth machine learning models. Furthermore, if there are multiple fourth machine learning models, the fourth machine learning models may include a large-scale language model. Furthermore, the fourth machine learning model may be the same model as the first machine learning model described above, or may include the same large-scale language model as the large-scale language model included in the first machine learning model.

[0101] The fourth machine learning model including the large-scale language model may be provided in an external server or in the information processing device 2.

[0102] Furthermore, the large-scale language model may be, for example, an existing large-scale language model provided as a service by an external server. In this case, the information processing device 2 can input a prompt to the large-scale language model through API linkage and obtain a response to the input from the large-scale language model.

[0103] The prompt input to the fourth machine learning model includes, for example, an instruction to generate and output a script for realizing the function to be imparted to the object based on information indicating the function to be imparted to the object and supplemental information. This prompt may be generated by, for example, an administrator generating a template of the prompt in advance and storing it in the storage unit 230. When using the fourth machine learning model, the virtual space data generation unit 223 may read the template from the storage unit 230, perform appropriate processing such as embedding information indicating the function to be imparted to the object and supplemental information in the read template, thereby generating a prompt, and input the generated prompt to the fourth machine learning model.

[0104] The script generated by the fourth machine learning model is, for example, a script for realizing the above-mentioned function of "opening and closing the door" when the attribute of the object is "door," and a script for realizing the above-mentioned function of "riding" or "flying" when the attribute of the object is "airplane."

[0105] The virtual space data generation unit 223 acquires the script output from the fourth machine learning model as described above. Upon acquiring the script output from the fourth machine learning model, the virtual space data generation unit 223 uses the acquired script and the supplemental information acquired from the third machine learning model to generate functional information including the script and the supplemental information, and assigns the generated functional information to the object data.

[0106] An example of the behavior of an object identified by object data to which function information has been added is shown in Figure 4. Figure 4 shows an example of the behavior when the object attribute is "door." In the example of Figure 4, the supplemental information included in the function information includes information indicating that the avatar can grasp the door handle, and that by grasping the handle, the door will open to the right.

[0107] In this case, for example, as shown in FIG. 4A, avatar A approaches door D1, and as shown in FIG. 4B, grabs handle D2 of door D1, causing door D1 to open to the right, as shown in FIG. 4C. In this way, door D1 is not simply set up in the virtual space, but can actually be opened by participants via avatar A. In this respect, participants can more realistically simulate in the virtual space the actual movement of door D1 in real space.

[0108] Here, we have explained the case where the condition (activation condition) for door D1 to open is for avatar A to grab the handle portion D2 of door D1, but the condition for door D1 to open is not limited to this and may be, for example, for avatar A to enter within a specified range in front of door D1.

[0109] Furthermore, some objects may move automatically at predetermined time intervals without any special action from the avatar. In this case, the activation condition may be, for example, information indicating that the object will move at predetermined time intervals.

[0110] Furthermore, in the case of attributes that are not supposed to move in the first place, it may be necessary to assign functional information to object data. In such cases, the virtual space data generation unit 223 does not need to assign functional information to the object data. The virtual space data generation unit 223 may determine which attributes should have functional information assigned by referring to a table that is generated in advance by an administrator and defines attributes that should have functional information assigned, or may use a large-scale language model that is widely available to the public.

[0111] So far, we have explained the specific method by which the virtual space data generation unit 223 assigns function information to object data. The virtual space data generation unit 223 may further assign at least one of a collider and material information to the object data. The collider and material information will be explained below.

[0112] (Collider) A collider is a component for adding a physical collision detection function to an object specified by object data. The virtual space data generation unit 223 may add a collider, which is the component, to object data to which function information has been added.

[0113] For example, the virtual space data generation unit 223 identifies a collider according to the attribute of an object based on information that pre-associates attributes of the object that can be assigned a collider with the collider to be assigned to object data representing an object with that attribute, and assigns the identified collider to object data representing an object with an attribute that corresponds to the collider.

[0114] Specifically, colliders to be assigned to object data are prepared in advance as templates for each attribute of the object. In this case, the correspondence between colliders and attributes is generated by the administrator as, for example, a table and stored in the storage unit 23. Colliders for each attribute are also generated in advance by the administrator and stored in the storage unit 23.

[0115] The virtual space data generation unit 223 refers to the table and acquires a collider corresponding to the attribute indicated by the attribute information assigned to the object data from the storage unit 23. The virtual space data generation unit 223 assigns the acquired collider to the object data.

[0116] 5 is a diagram for explaining an overview of colliders. For example, if a collider is assigned to object data representing a wall W1 and object data representing a ball B as shown in FIG. 5A, ball B approaching wall W1 will collide with wall W1 and bounce off, as shown in FIGS. 5B and 5C. By assigning colliders to both sets of object data, the virtual space data generation unit 223 can generate virtual space data that can realize such behavior regarding collisions between objects in a virtual space.

[0117] In addition to the correspondence between colliders and attributes, the table may also define the range of objects to which the colliders should be assigned. The virtual space data generation unit 223 may assign colliders to the range of objects defined in the table.

[0118] Colliders are attached to object data that indicate moving objects as well as to object data that indicate stationary objects. On the other hand, function information is attached to object data that indicate moving objects. In this respect, it can be said that colliders can be attached to more object data than function information.

[0119] Note that, although an example of assigning a collider after assigning functional information has been described here, the virtual space data generation unit 223 may treat a collider as a type of functional information and assign functional information and a collider in parallel.

[0120] (Material information) The material information is data for expressing the visual characteristics of the surface of the object specified by the object data. The virtual space data generation unit 223 may add the material information to the object data to which the function information has been added.

[0121] For example, the virtual space data generation unit 223 identifies material information corresponding to the attributes of an object based on information that pre-associates attributes of the object to which material information can be assigned with material information to be assigned to object data representing an object with those attributes, and assigns the identified material information to object data representing an object with attributes that correspond to the material information.

[0122] Specifically, material information to be assigned to object data is prepared in advance as a template for each attribute of the object. In this case, the correspondence between material information and attributes is generated by the administrator as, for example, a table and stored in the storage unit 23. Furthermore, material information for each attribute is also generated in advance by the administrator and stored in the storage unit 23.

[0123] The virtual space data generation unit 223 refers to the table and acquires material information corresponding to the attribute indicated by the attribute information assigned to the object data from the storage unit 23. The virtual space data generation unit 223 assigns the acquired material information to the object data.

[0124] Fig. 6 is a diagram for explaining an overview of material information. For example, when material information is added to object data showing a board W2 as shown in Fig. 6A, the board W2 is displayed so that it is clear that its material is wood, as shown in Fig. 6B. By adding material information to the object data, the virtual space data generation unit 223 can generate virtual space data that can represent the visual characteristics of the surface of such an object in a virtual space.

[0125] The material information may include information indicating the color of the material. In this case, the virtual space data generation unit 223 can process (color) the color of the object by adding the material information to the object data.

[0126] Next, the virtual space data generating unit 223 generates virtual space data indicating a virtual space that virtually represents a real space, based on the space basic data including the object data to which the functional information has been added (step ST4).

[0127] In step ST3, the virtual space data generation unit 223 assigns function information to the object data included in the space basic data, and assigns collider or material information to the object data as needed. Then, the virtual space data generation unit 223 generates virtual space data based on the space basic data including the object data. At this time, the virtual space data generation unit 223 may execute known rendering load reduction processing, such as occlusion culling bake or batching type setting, on the virtual space data generated based on the space basic data, or in the process of generating virtual space data from the space basic data. The virtual space data generation unit 223 outputs the generated virtual space data to the output unit 224.

[0128] Next, the output unit 224 acquires the virtual space data from the virtual space data generation unit 223. Upon acquiring the virtual space data from the virtual space data generation unit 223, the output unit 224 outputs the acquired virtual space data (step ST5). Here, the output unit 224 outputs the virtual space data to the participating terminal 4.

[0129] The participant terminal 4 acquires the virtual space data from the output unit 224. Upon acquiring the virtual space data from the output unit 224, the participant terminal 4 starts, for example, a service app installed on its own device in response to an instruction from the participant, and displays the virtual space specified by the acquired virtual space data. At this time, if the rendering load reduction process has been executed on the virtual space data in step ST4 described above, the load on the display of the virtual space on the participant terminal 4 is reduced. By operating the participant terminal 4, the participant participates in the virtual space as an avatar and performs processes such as moving within the virtual space.

[0130] (Effects of the First Embodiment) As described above, in the first embodiment, object data relating to an object existing in a virtual space is provided with functional information for realizing a function relating to the movement of the object. Therefore, by appropriately operating an avatar in the virtual space, participants can not only actually move the object, but also actually confirm the movement of the object in the virtual space. In other words, participants can simulate the actual movement of an object in real space in the virtual space more realistically than ever before. In other words, from the viewpoint of the information processing device 2, the information processing device 2 can provide participants with a virtual space that can reproduce the real space more realistically and in a form closer to reality. This allows the information processing device 2 to not only reproduce the real space visually, but also reproduce the movement of objects, thereby improving the added value of the spatial basic data compared to conventional methods.

[0131] Furthermore, if colliders or material data are attached to the object data, participants can simulate the actual movement or visual characteristics of the object in real space even more realistically in the virtual space.

[0132] Furthermore, as described above, when the space basic data acquisition unit 221 acquires space basic data from a participating terminal 4 and the output unit 224 outputs virtual space data to the same participating terminal 4, the information processing device 2 can directly send and receive data to the participating terminal 4, and can quickly provide the virtual space data to the participating terminal 4. Furthermore, because participants do not need to download the virtual space data from the service providing server 3, they can easily and quickly participate in the virtual space generated from the space basic data they have provided.

[0133] Although an example in which the output unit 224 outputs virtual space data to the participating terminal 4 has been described here, the output unit 224 is not limited to this, and the output unit 224 may output the virtual space data to the service providing server 3. In this case, the service providing server 3 can manage the virtual space data acquired from the output unit 224 and provide it to the participating terminal 4.

[0134] (Application example) The technology for generating virtual space data using the information processing device 2 can be applied to, for example, situations in which a construction site is recreated in a virtual space and participants using avatars simulate the movement of objects and the like at the construction site, situations in which participants using avatars conduct evacuation drills in a virtual space, situations in which a crowded real space is recreated in a virtual space and participants using avatars learn how to avoid danger, or situations in which a building such as a model house or a renovated factory is recreated in a virtual space and participants using avatars view the interior of the building in the virtual space.

[0135] For example, in a scene where a construction site is reproduced in a virtual space, the space basic data acquisition unit 221 may acquire data representing the construction site generated using, for example, a BIM system or a CAD system as space basic data. In this case, the information processing device 2 functions as a generator of virtual space data that virtually represents the construction site.

[0136] Furthermore, when recreating an evacuation drill in a virtual space, the space basic data acquisition unit 221 may acquire, as space basic data, data indicating the building or space where the drill will be conducted, which data has been generated using, for example, a BIM system or a CAD system. In this case, the information processing device 2 functions as a device for generating virtual space data for conducting a virtual evacuation drill.

[0137] In addition, the virtual space data generation technology by the information processing device 2 can be widely applied to situations such as virtually recreating a real space in which moving objects actually exist as a virtual space, and allowing participants using avatars to have various simulated experiences in the virtual space.

[0138] The information processing device 2 is only required to have the functions of a spatial basic data acquisition unit 221 that acquires spatial basic data that indicates a real space, the spatial basic data including object data related to objects that exist in the real space; a virtual space data generation unit 223 that acquires information indicating the attributes of an object identified by the object data included in the acquired spatial basic data, assigns functional information to the object data that corresponds to the attributes of the object indicated by the acquired information and is used to realize functions related to the operation of the object, and generates virtual space data that indicates a virtual space that virtually represents the real space based on the spatial basic data including the object data to which the functional information has been assigned; and an output unit 224 that outputs the generated virtual space data, and the attribute determination unit 222 is a function that can be added at will.

[0139] Furthermore, in the explanation up to this point, it has been assumed that all of the functions of the information processing device 2 are provided in a single server having a physical configuration independent of the service providing server 3 and the participating terminal 4. However, as described above, in the information processing system 1, some or all of the functions of the information processing device 2 may be provided in the service providing server 3 or in the participating terminal 4. Furthermore, in the information processing system 1, some or all of the functions of the information processing device 2 may be provided in a duplicated manner in the service providing server 3 and the participating terminal 4.

[0140] For example, the space basic data acquisition unit 221, the attribute determination unit 222, the virtual space data generation unit 223, and the output unit 224 may be provided in the service providing server 3, rather than in the information processing device 2. In that case, the output unit 224 may output the virtual space data to the participating terminal 4.

[0141] Alternatively, the space basic data acquisition unit 221, the attribute determination unit 222, the virtual space data generation unit 223, and the output unit 224 may be provided in the participating terminal 4, rather than in the information processing device 2. In this case, the output unit 224 may output the virtual space data to the service providing server 3.

[0142] As described above, the information processing method according to embodiment 1 is an information processing method by a computer, and the computer executes an acquisition step ST1 in which it acquires spatial basic data that indicates a real space, the spatial basic data including object data related to objects that exist in the real space; generation steps ST3 and ST4 in which it acquires attribute information that indicates the attributes of an object identified by the object data included in the acquired spatial basic data, assigns functional information to the object data that corresponds to the attributes of the object indicated by the acquired attribute information and that is for realizing a function related to the operation of the object, and generates virtual space data that indicates a virtual space that virtually represents the real space based on the spatial basic data including the object data to which the functional information has been assigned; and an output step ST5 in which it outputs the generated virtual space data. As a result, the information processing method according to the first embodiment can reproduce the real space in the virtual space in a form closer to reality than conventional methods. Also, participants can simulate the actual movement of objects in the real space in the virtual space.

[0143] The computer also executes an attribute determination step ST2 in which it determines the attributes of the object identified by the object data included in the spatial basic data acquired in the acquisition step, and in the generation step, it acquires attribute information indicating the attributes of the object determined in the attribute determination step, and assigns functional information to the object data according to the attributes of the object indicated by the acquired attribute information. As a result, the information processing method according to the first embodiment can appropriately determine the attributes of an object, and can impart appropriate function information according to the attributes of the object to the object data. Furthermore, participants can confirm accurate operations according to the attributes of the object.

[0144] In the attribute determination step, the computer determines the attribute of the object based on identification information for identifying the object, which is included in the object data. As a result, the information processing method according to the first embodiment can appropriately determine the attribute of an object from the identification information of the object, and the participants can confirm accurate actions according to the attribute of the object.

[0145] In the attribute determining step, the computer determines the attribute of the object based on shape information relating to the shape of the object, which is included in the object data. As a result, the information processing method according to the first embodiment can appropriately determine the attributes of an object from the shape information of the object, and the participants can confirm accurate actions according to the attributes of the object.

[0146] The function information also includes information indicating a script for realizing a function related to the operation of the object. As a result, the information processing method according to the first embodiment can generate virtual space data that can accurately realize functions related to the movement of objects in the virtual space, and participants can confirm the accurate movement of objects in the virtual space.

[0147] The function information also includes information that identifies the part of the object to which the function relating to the operation of the object is associated. As a result, the information processing method according to the first embodiment can associate a function related to the object's movement with an appropriate part of the object, and can generate virtual space data that can accurately reproduce the object's movement. Also, participants can confirm the accurate movement of the object in the virtual space.

[0148] In addition, in the generation step, the computer identifies functional information corresponding to the attribute of the object identified by the attribute information based on information that previously associates the attribute of the object with functional information to be assigned to the object with that attribute, and assigns the identified functional information to the object data. As a result, the information processing method according to the first embodiment can accurately identify functional information according to the attributes of an object and assign it to the object data, and participants can confirm the accurate operation of the object in the virtual space.

[0149] In addition, in the generation step, the computer inputs attribute information indicating the attributes of the object determined in the attribute determination step and shape information regarding the shape of the object contained in the object data into a machine learning model, obtains information indicating a script output from the machine learning model, which is information indicating a script for realizing a function related to the operation of the object, and assigns function information including information indicating the obtained script to the object data. As a result, the information processing method according to the first embodiment can easily and accurately acquire functional information to be assigned to object data based on attribute information and shape information of the object. Also, participants can confirm the accurate operation of the object in the virtual space.

[0150] The machine learning model also includes a function inference model that infers and outputs information indicating a function to be imparted to an object and supplementary information regarding the implementation form of the function in response to input of attribute information and shape information, and a script generation model that generates and outputs information indicating a script for realizing a function related to the operation of the object in response to input of information indicating a function to be imparted to an object and supplementary information regarding the implementation form of the function, output from the function inference model. As a result, the information processing method according to the first embodiment can easily and accurately generate information indicating a script included in the function information to be assigned to object data, and participants can confirm the accurate operation of the object in the virtual space.

[0151] In addition, in the generation step, the computer identifies a collider corresponding to the attribute of the object based on information that pre-associates attributes to which a collider, which is a component for adding physical collision detection functionality to an object, can be assigned with a collider to object data representing an object with that attribute, and assigns the identified collider to object data representing an object with an attribute corresponding to that collider. As a result, the information processing method according to the first embodiment can generate virtual space data that can realize behaviors regarding collisions between objects in the virtual space. Also, participants can check the behaviors regarding collisions between objects in the virtual space.

[0152] In addition, in the generation step, the computer identifies material information corresponding to the attributes of the object based on information that pre-associates attributes to which material information, which is information for expressing the visual characteristics of the surface of an object, can be assigned and the material information to be assigned to object data representing an object with those attributes, and assigns the identified material information to object data representing an object with attributes that correspond to the material information. As a result, the information processing method according to the first embodiment can generate virtual space data that can represent the visual characteristics of the surface of an object in the virtual space, and the participants can check the visual characteristics of the object in the virtual space.

[0153] Furthermore, the computer acquires the space basic data from the participant terminals 4 used by the participants in the acquisition step, and outputs the virtual space data to the participant terminals 4 in the output step. As a result, the information processing method according to the first embodiment can quickly provide virtual space data to the participant terminals 4. Furthermore, participants can easily and quickly participate in the virtual space generated from the space basic data they themselves have provided.

[0154] Furthermore, the information processing method according to embodiment 1 is an information processing method by the information processing system 1, in which the information processing device 2 executes the steps of acquiring spatial basic data indicating a real space, the spatial basic data including object data relating to objects existing in the real space; acquiring attribute information indicating the attributes of an object identified by the object data included in the acquired spatial basic data, assigning functional information to the object data, the functional information corresponding to the attributes of the object indicated by the acquired attribute information, for realizing a function relating to the operation of the object, and generating virtual space data indicating a virtual space that virtually represents the real space based on the spatial basic data including the object data to which the functional information has been assigned; outputting the generated virtual space data to the participating terminal 4; and displaying the virtual space based on the output virtual space data by the participating terminal 4. As a result, the information processing method according to the first embodiment can reproduce the real space in the virtual space in a form closer to reality than conventional methods. Also, participants can simulate the actual movement of objects in the real space in the virtual space.

[0155] Furthermore, the information processing device 2 according to embodiment 1 is configured to include: a spatial basic data acquisition unit 221 that acquires spatial basic data that indicates a real space, the spatial basic data including object data related to objects that exist in the real space; a virtual space data generation unit 223 that acquires attribute information that indicates the attributes of an object identified by the object data included in the acquired spatial basic data, assigns functional information to the object data that corresponds to the attribute of the object indicated by the acquired attribute information and is for realizing a function related to the operation of the object, and generates virtual space data that indicates a virtual space that virtually represents the real space, based on the spatial basic data including the object data to which the functional information has been assigned; and an output unit 224 that outputs the generated virtual space data. As a result, the information processing device 2 according to the first embodiment can reproduce the real space in the virtual space in a form closer to reality than conventional methods. Also, participants can simulate the actual movement of objects in the real space in the virtual space.

[0156] Furthermore, the information processing program according to the first embodiment causes a computer to execute the following steps: acquiring spatial basic data that indicates a real space, the spatial basic data including object data related to objects existing in the real space; acquiring attribute information that indicates attributes of an object identified by the object data included in the acquired spatial basic data; assigning functional information to the object data that corresponds to the attribute of the object indicated by the acquired attribute information and that is for realizing a function related to the operation of the object; generating virtual space data that indicates a virtual space that virtually represents the real space based on the spatial basic data that includes the object data to which the functional information has been assigned; and outputting the generated virtual space data. When executed by a computer, the information processing program according to the first embodiment can reproduce a real space in a virtual space in a more realistic manner than conventional methods. Also, participants can simulate the actual movement of objects in the real space in the virtual space.

[0157] Furthermore, the information processing system 1 according to embodiment 1 is configured to include: a spatial basic data acquisition unit 221 that acquires spatial basic data that indicates a real space, the spatial basic data including object data related to objects that exist in the real space; a virtual space data generation unit 223 that acquires attribute information that indicates the attributes of an object identified by the object data included in the acquired spatial basic data, assigns functional information to the object data that corresponds to the attributes of the object indicated by the acquired attribute information and is used to realize a function related to the operation of the object, and generates virtual space data that indicates a virtual space that virtually represents the real space based on the spatial basic data including the object data to which the functional information has been assigned; an output unit 224 that outputs the generated virtual space data; and a participating terminal 4 that displays a virtual space based on the output virtual space data. As a result, the information processing system 1 according to the first embodiment can reproduce the real space in the virtual space in a form closer to reality than conventional methods. Also, participants can simulate the actual movement of objects in the real space in the virtual space.

[0158] Although the preferred embodiments have been described in detail above, the present invention is not limited to the above-described embodiments, and various modifications and substitutions can be made to the above-described embodiments without departing from the scope of the claims.

[0159] Furthermore, in the present disclosure, any component of the embodiments may be modified or any component of the embodiments may be omitted. [Industrial Applicability]

[0160] The present disclosure makes it possible to reproduce real space in a virtual space in a form closer to reality than before, and is suitable for use in an information processing method, an information processing device, an information processing program, and an information processing system. [Explanation of symbols]

[0161] 1 Information processing system, 2 Information processing device, 3 Service providing server, 4 Participating terminal, 5 Network, 21 Communication unit, 22 Calculation unit, 23 Memory unit, 100 Communication interface, 101 Input / output interface, 102 Processor, 103 Memory, 221 Space basic data acquisition unit, 222 Attribute determination unit, 223 Virtual space data generation unit, 224 Output unit, A Avatar, B Ball, D1 Door, D2 Handle part, W1 Wall, W2 Board.

Claims

1. An information processing method by a computer, comprising: The computer an acquiring step of acquiring space basic data indicating a real space, the space basic data including object data relating to objects existing in the real space; an attribute determination step of determining attributes of an object identified by object data included in the acquired spatial basic data; a generation step of acquiring attribute information indicating attributes of the determined object, assigning functional information to the object data, the functional information being in accordance with the attribute of the object indicated by the acquired attribute information, and realizing a function related to the operation of the object, and generating virtual space data indicating a virtual space that virtually represents the real space, based on space basic data including the object data to which the functional information has been assigned; an output step of outputting the generated virtual space data; An information processing method that performs the above.

2. The computer In the attribute determination step, The attribute of the object is determined based on identification information for identifying the object, which is included in the object data. The information processing method according to claim 1.

3. The computer In the attribute determination step, The attribute of the object is determined based on shape information relating to the shape of the object included in the object data. The information processing method according to claim 1.

4. The functional information includes: Contains information indicating a script for realizing a function related to the operation of the object The information processing method according to any one of claims 1 to 3.

5. The functional information includes: and information identifying the part of the object to which the function relating to the operation of the object is associated. The information processing method according to any one of claims 1 to 3.

6. The computer In the generating step, Based on information in which the attributes of the object are previously associated with functional information to be assigned to the object of the attribute, functional information corresponding to the attribute of the object specified by the attribute information is specified, and the specified functional information is assigned to the object data. The information processing method according to any one of claims 1 to 3.

7. The computer In the generating step, inputting attribute information indicating the attribute of the object determined in the attribute determination step and shape information regarding the shape of the object included in the object data into a machine learning model; Acquire information indicating a script output from the machine learning model, the script being for realizing a function related to the operation of the object, and assign function information including the acquired information indicating the script to the object data. The information processing method according to any one of claims 1 to 3.

8. The machine learning model is a function inference model that infers and outputs information indicating a function to be assigned to an object and supplemental information regarding a form of realization of the function in response to input of the attribute information and the shape information; and a script generation model that generates and outputs information indicating a script for realizing a function related to the operation of the object in response to input of information indicating a function to be assigned to the object output from the function inference model and supplemental information regarding the implementation form of the function.

8. The information processing method according to claim 7.

9. A computer-based information processing method, comprising: The computer an acquiring step of acquiring space basic data indicating a real space, the space basic data including object data relating to objects existing in the real space; a generation step of acquiring attribute information indicating attributes of an object specified by object data included in the acquired space basic data, assigning functional information to the object data according to the attribute of the object indicated by the acquired attribute information, the functional information being for realizing a function related to the operation of the object, and generating virtual space data indicating a virtual space that virtually represents the real space based on the space basic data including the object data to which the functional information has been assigned; an output step of outputting the generated virtual space data; Run In the generating step, An information processing method that identifies a collider corresponding to the attribute of an object based on information that previously associates attributes to which a collider, which is a component for adding a physical collision detection function to the object, can be assigned with colliders that are assigned to object data that represent objects with those attributes, and assigns the identified collider to object data that represent objects with attributes that correspond to the collider.

10. A computer-based information processing method, comprising: The computer an acquiring step of acquiring space basic data indicating a real space, the space basic data including object data relating to objects existing in the real space; a generation step of acquiring attribute information indicating attributes of an object specified by object data included in the acquired space basic data, assigning functional information to the object data according to the attribute of the object indicated by the acquired attribute information, the functional information being for realizing a function related to the operation of the object, and generating virtual space data indicating a virtual space that virtually represents the real space based on the space basic data including the object data to which the functional information has been assigned; an output step of outputting the generated virtual space data; Run In the generating step, An information processing method that identifies material information corresponding to the attributes of an object based on information that previously associates attributes to which material information, which is information for expressing the visual characteristics of the surface of the object, can be assigned with material information to be assigned to object data representing an object with the attributes, and assigns the identified material information to object data representing an object with attributes corresponding to the material information.

11. The computer In the acquiring step, the spatial basic data is acquired from a terminal used by a participant; In the output step, the virtual space data is output to the terminal. The information processing method according to any one of claims 1 to 3.

12. An information processing method by an information processing system, The information processing device an acquiring step of acquiring space basic data indicating a real space, the space basic data including object data relating to objects existing in the real space; an attribute determination step of determining attributes of an object identified by object data included in the acquired spatial basic data; a generation step of acquiring attribute information indicating attributes of the determined object, assigning functional information to the object data, the functional information being in accordance with the attribute of the object indicated by the acquired attribute information, and realizing a function related to the operation of the object, and generating virtual space data indicating a virtual space that virtually represents the real space, based on space basic data including the object data to which the functional information has been assigned; an output step of outputting the generated virtual space data to a terminal; An information processing method in which the terminal executes a display step of displaying a virtual space based on the output virtual space data.

13. an acquisition unit that acquires basic space data indicating a real space, the basic space data including object data relating to objects existing in the real space; an attribute determination unit that determines attributes of an object identified by object data included in the acquired spatial basic data; a generation unit that acquires attribute information indicating attributes of the determined object, assigns functional information to the object data according to the attribute of the object indicated by the acquired attribute information, the functional information being for realizing a function related to the operation of the object, and generates virtual space data indicating a virtual space that virtually represents the real space, based on space basic data including the object data to which the functional information has been assigned; an output unit that outputs the generated virtual space data; An information processing device comprising:

14. an acquiring step of acquiring space basic data indicating a real space, the space basic data including object data relating to objects existing in the real space; an attribute determination step of determining attributes of an object identified by object data included in the acquired spatial basic data; a generation step of acquiring attribute information indicating attributes of the determined object, assigning functional information to the object data, the functional information being in accordance with the attribute of the object indicated by the acquired attribute information, and realizing a function related to the operation of the object, and generating virtual space data indicating a virtual space that virtually represents the real space, based on space basic data including the object data to which the functional information has been assigned; an output step of outputting the generated virtual space data; An information processing program that causes a computer to execute the above.

15. an acquisition unit that acquires basic space data indicating a real space, the basic space data including object data relating to objects existing in the real space; an attribute determination unit that determines attributes of an object identified by object data included in the acquired spatial basic data; a generation unit that acquires attribute information indicating attributes of the determined object, assigns functional information to the object data according to the attribute of the object indicated by the acquired attribute information, the functional information being for realizing a function related to the operation of the object, and generates virtual space data indicating a virtual space that virtually represents the real space, based on space basic data including the object data to which the functional information has been assigned; an output unit that outputs the generated virtual space data; a terminal that displays a virtual space based on the output virtual space data; and An information processing system comprising:

Images