Information processing system and program

Abstract

An information processing system and a program are provided that generate spatial layout data used for radio wave propagation estimation based on spatial feature data within a building. [Solution] In an information processing system 10, a program causes an information processing device 100, which is a computer, to function as an acquisition unit that acquires spatial feature data indicating the characteristics of the space within a building, and as a layout data generation unit that generates spatial layout data of the space used for radio wave propagation estimation based on the spatial feature data.

Description

[Technical field]

[0001] The present invention relates to an information processing system and a program. [Background technology]

[0002] Patent Document 1 describes a technology for estimating propagation characteristics that takes into account the surface shape of a reflecting object. [Prior art document] [Patent documents] [Patent Document 1] JP 2023-162916 A Summary of the Invention [Means for solving the problem]

[0003] According to an embodiment of the present invention, there is provided an information processing system. The information processing system may include an acquisition unit that acquires spatial feature data indicating features of a space within a building. The information processing system may include a layout data generation unit that generates spatial layout data of the space to be used for radio wave propagation estimation based on the spatial feature data.

[0004] In the information processing system, the acquisition unit may acquire the spatial feature data including floor plan data of the space and spatial imaging data of the space, and when a missing area where no spatial imaging data exists in the space, the layout data generation unit may generate the spatial layout data of the space by generating spatial layout data of the missing area based on the floor plan data and the spatial imaging data included in the spatial feature data.

[0005] In any of the information processing systems, the acquisition unit may acquire the spatial feature data of a space that is one space of the building having a plurality of independent spaces, and the layout data generation unit may generate spatial layout data of the other space to be used for radio wave propagation estimation by applying the generated spatial layout data of the one space to another space in the building that is different from the one space.

[0006] In any of the information processing systems, the layout data generation unit may generate spatial layout data of another space to be used for radio wave propagation estimation by applying the spatial layout data of the space to another space in another building constructed by a construction contractor of the building.

[0007] In any of the information processing systems, the acquisition unit may acquire the spatial feature data including floor plan data of the space and spatial imaging data of the space, and the layout data generation unit may generate the spatial layout data of the space including material identification data that identifies the material of the objects by estimating materials of objects in the space based on the floor plan data and the spatial imaging data included in the spatial feature data.

[0008] In any of the information processing systems, the acquisition unit may acquire the spatial feature data including floor plan data of the space and spatial image data obtained by imaging the space, and the layout data generation unit may generate the spatial layout data of the space from the floor plan data and the spatial image data included in the spatial feature data, using a spatial layout data generation model that generates spatial layout data of the space from the floor plan data of a space within a building and the spatial image data obtained by imaging the space.

[0009] Any of the information processing systems may further include a radio wave propagation estimation unit that estimates radio wave propagation within the space using the spatial layout data of the space.

[0010] In any of the information processing systems, the acquisition unit may further acquire exterior feature data indicating features of the exterior of the building corresponding to the space within the building, and the layout data generation unit may further generate exterior layout data of the exterior to be used for radio wave propagation estimation based on the exterior feature data.

[0011] In any of the information processing systems, the layout data generation unit may generate integrated layout data used for radio wave propagation estimation and including the spatial layout data of the space and the exterior layout data of the exterior surface by aligning the spatial layout data of the space and the exterior layout data of the exterior surface.

[0012] In any of the information processing systems, the acquisition unit may acquire the exterior feature data including exterior imaging data of the exterior, and may further acquire imaging position identification data that identifies an imaging position where the exterior imaging data was captured and building position identification data that identifies a position of the building, and the layout data generation unit may generate the integrated layout data by estimating an orientation of the space based on the exterior imaging data, the imaging position data, and the building position identification data.

[0013] Any of the information processing systems may further include a radio wave propagation estimation unit that estimates propagation of radio waves from outside the building to within the space using the integrated layout data.

[0014] Any of the information processing systems may further include a learning data storage unit that stores spatial learning data including previously generated spatial layout data, floor plan data of a space within a building that is the subject of the spatial layout data, and spatial image data capturing an image of the space, and a model generation unit that uses the plurality of spatial learning data stored in the learning data storage unit as teacher data to generate a spatial layout data generation model by machine learning to generate spatial layout data of the space from the floor plan data of the space within a building and the spatial image data capturing an image of the space, wherein the acquisition unit may acquire the spatial feature data including the floor plan data of the space and the spatial image data capturing an image of the space, and the layout data generation unit may generate the spatial layout data of the space from the floor plan data and the spatial image data included in the spatial feature data, using the spatial layout data generation model generated by the model generation unit.

[0015] According to one embodiment of the present invention, there is provided a program for causing a computer to function as an acquisition unit that acquires spatial feature data indicative of features of a space within a building, and a layout data generation unit that generates spatial layout data of the space to be used for radio wave propagation estimation based on the spatial feature data.

[0016] The above summary of the invention does not list all of the necessary features of the present invention. Also, subcombinations of these features may also be inventions. [Brief description of the drawings]

[0017] [Figure 1] An example of a system 10 is shown diagrammatically. [Diagram 2] FIG. 11 is an explanatory diagram for explaining an example of generating spatial layout data. [Diagram 3] FIG. 11 is an explanatory diagram for explaining another example of generating spatial layout data. [Figure 4] FIG. 11 is an explanatory diagram for explaining another example of generating spatial layout data. [Diagram 5] FIG. 11 is an explanatory diagram for explaining an example of generating integrated layout data; [Figure 6] 2 illustrates an example of a functional configuration of an information processing device 100. [Figure 7] 2 is an explanatory diagram illustrating an example of a processing flow of the information processing device 100. FIG. [Figure 8] 1 shows an example of a functional configuration of a model generating device 400. [Figure 9] 5 illustrates an example of a functional configuration of a radio wave propagation estimating device 500. [Figure 10] FIG. 2 is an explanatory diagram for explaining an example of a processing flow of the system 10. [Figure 11] An example of a hardware configuration of a computer 1200 functioning as the information processing device 100, the model generating device 400, or the radio wave propagation estimating device 500 is shown roughly. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] Radio wave propagation in an indoor environment such as a house needs to take into account radio wave shields inside the house. Therefore, in order to accurately estimate radio wave propagation in an indoor environment, layout data of the indoor environment is indispensable. Currently, layout data of an indoor environment is generated based on data acquired by workers actually visiting the indoor environment and performing work. However, it is unrealistic for workers to visit all indoor environments and perform work, and the fact that workers must visit indoor environments and perform work is a bottleneck in accurately estimating radio wave propagation in an indoor environment. The system according to this embodiment employs a mechanism for automatically generating layout data of an indoor environment based on preview video data and floor plan data of an indoor environment published by a real estate company or the like, or photographed video data of an indoor environment provided by a customer, using, for example, generation AI (Artificial Intelligence). This allows layout data of an indoor environment to be generated without workers performing work in the indoor environment.

[0019] The present invention will be described below through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention.

[0020] FIG. 1 illustrates an example of a system 10. The system 10 may include an information processing device 100. The system 10 may include a building management device 200. The system 10 may include a map management device 300. The system 10 may include a model generating device 400. The system 10 may include a radio wave propagation estimating device 500. The system 10 may be an example of an information processing system.

[0021] The system 10 provides, for example, a radio wave propagation estimation service that estimates radio wave propagation, and a layout data generation service that generates layout data used in the radio wave propagation estimation.

[0022] The layout data includes, for example, spatial layout data of a space within a building. The layout data includes, for example, exterior layout data of an exterior of a building corresponding to the space. The layout data includes integrated layout data including the spatial layout data of the space and the exterior layout data of the exterior. The layout data may be three-dimensional (3D) data.

[0023] The layout data includes, for example, object data of objects constituting the layout of a space within a building. The object data includes, for example, object identification data that identifies the objects. The objects are windows, doors, interior walls, ceilings, floors, stairs, pillars, verandas, exterior walls, partitions, roofs, etc. The object data includes, for example, arrangement identification data that identifies the arrangement of the objects in the layout data. The arrangement of the objects includes the position at which the objects are arranged and the orientation at which the objects are arranged. The object data includes, for example, shape identification data that identifies the shape of the objects. The object data includes, for example, size identification data that identifies the size of the objects. The object data includes, for example, material identification data that identifies the material of the objects. The materials of the objects are glass, metal, concrete, wood, paper, rush grass, bricks, plasterboard, etc.

[0024] The information processing device 100 executes various information processing operations. For example, the information processing device 100 executes a layout data generation process for generating layout data used for radio wave propagation estimation.

[0025] The information processing device 100 generates, for example, spatial layout data of a space within a building. The information processing device 100 generates, for example, exterior surface layout data of the exterior surface of the building corresponding to the space. The information processing device 100 generates, for example, integrated layout data including the spatial layout data of the space and the exterior surface layout data of the exterior surface.

[0026] A building, for example, has one independent space within the building. A building, for example, has multiple independent spaces within the building.

[0027] The building management device 200 manages building-related data related to a building. The building-related data includes, for example, building identification data for identifying a building. The owner of the building management device 200 may be a management company that manages the building, such as a real estate company.

[0028] The building identification data includes, for example, building type identification data that identifies the type of building. The building type includes, for example, a residence. The residence includes, for example, a condominium, an apartment, a housing complex, and other collective housing. The residence includes, for example, a row house, such as a terrace house or a townhouse. The residence may include a single-family home, such as a prefabricated house or a detached house. The building type includes, for example, a store, such as a convenience store or a chain store. Furthermore, the building type includes, for example, any building with an interior space (including a basement), such as a factory, a warehouse, a school facility such as a university, a research facility, a hospital, or a shopping center.

[0029] The building identification data includes, for example, building structure identification data for identifying the structure of the building, which includes RC (Reinforced Concrete) construction, SC (Steel Concrete) construction, SRC (Steel Reinforced Concrete) construction, wood construction, and the like.

[0030] The building identification data includes, for example, building age identification data for identifying the age of the building.The building identification data includes, for example, building floor identification data for identifying the number of floors of the building.The building identification data includes, for example, building position identification data for identifying the position of the building.The building identification data includes, for example, contractor identification data for identifying the contractor who constructed the building.

[0031] The building-related data includes, for example, spatial feature data indicating the features of the spaces in the building. For example, if the building has one independent space, the spatial feature data indicates the features of all the spaces in the building. For example, if the building has multiple independent spaces, the spatial feature data indicates the features of one of the multiple independent spaces.

[0032] For example, if the building is a house, the spatial feature data indicates the spatial features within the house. For example, if the building is a store, the spatial feature data indicates the spatial features within the store. For example, if the building is a factory, the spatial feature data indicates the spatial features within the factory.

[0033] If the building includes hallways, the spatial feature data may also indicate spatial features corresponding to hallways within the building. If the building includes elevators, the spatial feature data may also indicate spatial features corresponding to elevators within the building. If the building includes an atrium, the spatial feature data may also indicate spatial features corresponding to the atrium.

[0034] The spatial feature data includes, for example, floor plan data of a space within a building. The floor plan data includes, for example, space type identification data that identifies the type of the space. The type of the space is, for example, a space within a corner room. The type of the space is, for example, a space within a middle room. The floor plan data includes, for example, orientation identification data that identifies the orientation of the space. The floor plan data includes, for example, style identification data that identifies the style of the space. The style of the space is, for example, a Western-style room, a Japanese-style room, etc. The floor plan data includes object data of objects that make up the floor plan of the space. The spatial feature data includes, for example, spatial image data that captures an image of a space within a building.

[0035] The building-related data includes, for example, exterior feature data indicating exterior features of a building corresponding to a space within the building. For example, if the building is a residence, the exterior feature data indicates exterior features of the residence. For example, if the building has multiple independent residences and the space within the building is a space within one of the multiple independent residences, the exterior feature data indicates exterior features of the one residence. For example, if the building is a store, the exterior feature data indicates exterior features of the store. If the building is a factory, the exterior feature data indicates exterior features of the factory.

[0036] The exterior surface feature data includes, for example, exterior surface imaging data obtained by imaging the exterior surface of the building corresponding to the space inside the building. The exterior surface imaging data may further include metadata of the exterior surface imaging data in addition to image data. The metadata includes, for example, imaging position identification data for identifying an imaging position where the exterior surface imaging data was captured. The metadata includes, for example, imaging direction identification data for identifying an imaging direction where the exterior surface imaging data was captured.

[0037] The imaging data is, for example, a moving image, but may be a still image.

[0038] The building management device 200 provides, for example, building-related data to the information processing device 100. The building management device 200 provides the building-related data to the information processing device 100 by, for example, transmitting the building-related data to the information processing device 100 via the network 20.

[0039] The network 20 includes, for example, the Internet. The network 20 may include a core network provided by a telecommunications carrier. The core network may be compliant with any mobile communication system, such as a 3G (3rd Generation) communication system, an LTE (Long Term Evolution) communication system, a 5G (5th Generation) communication system, and a 6G (6th Generation) communication system or later. The network 20 may include a wired communication network.

[0040] For example, the building management device 200 provides the information processing device 100 with building-related data within the scope of public data. The building management device 200 provides the information processing device 100 with spatial imaging data that captures an image of a space within a building for a customer to view, as spatial feature data included in the building-related data, for example. On the other hand, if a service provider that operates the service provided by the system 10 has a business partnership with the management company of the building management device 200, or if the service provider and the management company of the building management device 200 are the same company, the building management device 200 may provide the information processing device 100 with building-related data including non-public data.

[0041] A right holder, such as a building owner or a resident of a building, who is different from the owner of the building management device 200 and has the authority to provide building-related data to a third party, may provide the building-related data to the information processing device 100. The right holder may provide the building-related data to the information processing device 100, for example, by transmitting the building-related data to the information processing device 100 via the network 20 using a communication terminal owned by the right holder. The right holder may provide the information processing device 100 with spatial imaging data obtained by imaging a space within a building using an imaging device owned by the right holder, as spatial feature data included in the building-related data, for example.

[0042] The information processing device 100 generates layout data based on, for example, spatial feature data included in the building-related data. The information processing device 100 generates layout data based on, for example, exterior feature data included in the building-related data. The information processing device 100 may generate layout data further based on building identification data included in the building-related data.

[0043] The map management device 300 manages map data, for example, 3D map data.

[0044] The 3D map data is generated based on, for example, imaging data acquired using an imaging device. The 3D map data may be generated based on scan data acquired using Lidar.

[0045] The map management device 300 provides, for example, map data covering the positions of buildings for which layout data is to be generated to the information processing device 100. The map management device 300 provides the map data to the information processing device 100 by, for example, transmitting the map data to the information processing device 100 via the network 20. The information processing device 100 may generate layout data further based on the map data.

[0046] The model generating device 400 generates a layout data generation model for generating layout data. The model generating device 400 generates the layout data generation model based on building-related data received from the building management device 200 via the network 20, for example.

[0047] The model generating device 400 provides, for example, a layout data generation model to the information processing device 100. The model generating device 400 provides the layout data generation model to the information processing device 100 by, for example, transmitting the layout data generation model to the information processing device 100 via the network 20. The information processing device 100 may generate layout data by using the layout data generation model.

[0048] 1 shows an example in which the information processing device 100 and the model generating device 400 are different devices. The information processing device 100 and the model generating device 400 may be the same device. That is, the information processing device 100 may have a function of generating a layout data generation model.

[0049] The information processing device 100 provides, for example, the generated layout data to the radio wave propagation estimating device 500. The information processing device 100 provides the layout data to the radio wave propagation estimating device 500 by, for example, transmitting the layout data to the radio wave propagation estimating device 500 via the network 20.

[0050] The radio wave propagation estimation device 500 estimates radio wave propagation. The radio wave propagation estimation device 500 estimates radio wave propagation based on layout data provided by the information processing device 100, for example.

[0051] The radio wave propagation estimation device 500 estimates, for example, the propagation of radio waves in a space inside a building. The radio wave propagation estimation device 500 estimates, for example, the propagation of radio waves arriving at the outer surface of the building corresponding to the space. The radio wave propagation estimation device 500 estimates, for example, the propagation of radio waves from the outside of the building to the space inside the building.

[0052] 1 shows an example in which the information processing device 100 and the radio wave propagation estimation device 500 are different devices. The information processing device 100 and the radio wave propagation estimation device 500 may be the same device. That is, the information processing device 100 may have a function of estimating radio wave propagation.

[0053] Conventionally, radio wave propagation estimation has been mainly performed in outdoor environments to perform station placement design in mobile communications. Radio wave propagation estimation in outdoor environments can be performed using map data and existing area construction tools. On the other hand, in recent years, the frequency band of radio waves used in mobile communications has become higher, and the trend of higher frequency bands of radio waves used in mobile communications is expected to continue in the future. As the frequency band of radio waves used in mobile communications becomes higher, it becomes important to consider the influence of radio wave shielding objects present in indoor environments in order to perform station placement design more appropriately. Therefore, it is necessary to perform radio wave propagation estimation not only in outdoor environments but also in indoor environments.

[0054] Currently, layout data of an indoor environment required for accurately performing radio wave propagation estimation in an indoor environment is generated based on data acquired by a worker actually visiting the indoor environment and capturing an image of the indoor environment with a camera or scanning the indoor environment using a laser pointer or Lidar (Light Detection And Ranging). Therefore, in order to more appropriately perform station placement design in mobile communications using high-frequency band radio waves and accurately perform radio wave propagation estimation in an indoor environment, the worker must visit many indoor environments. This means that the costs, such as human costs and economic costs, for generating layout data of the indoor environment are large. In particular, in urban areas, which are areas where the need for mobile communications using high-frequency band radio waves is high, the number of buildings is greater than in other areas, and the number of indoor environments that workers must visit is enormous, so the cost of generating layout data of the indoor environment becomes even higher. Furthermore, when the indoor environment is a space within a house, residents are not necessarily cooperative with workers performing work in the space within the house from the viewpoint of privacy. Therefore, a situation may occur in which layout data of the indoor environment cannot be generated. Therefore, it is desirable to be able to suppress the cost of generating layout data of the indoor environment while taking into consideration the privacy of the residents of the building, etc.

[0055] In contrast, according to the system 10 according to the present embodiment, the information processing device 100 acquires spatial feature data of a space in a building, and generates spatial layout data of the space to be used for radio wave propagation estimation based on the acquired spatial feature data. The spatial feature data is provided to the information processing device 100 by the building management device 200 or the right holder of the spatial feature data. Therefore, the information processing device 100 can generate layout data of an indoor environment required for accurately performing radio wave propagation estimation in an indoor environment without a worker actually visiting the building and entering the space in the building. As a result, the system 10 according to the present embodiment can reduce the cost of generating layout data of an indoor environment while taking into consideration the privacy of the building residents and the like. As a result, the system 10 according to the present embodiment can contribute to the realization of more appropriate implementation of station placement design in mobile communications using radio waves in a high frequency band by accurately performing radio wave propagation estimation in an indoor environment.

[0056] 2 is an explanatory diagram for explaining an example of generating spatial layout data, in which a building 800 for which spatial layout data is to be generated is assumed to be an apartment building.

[0057] 2 illustrates an example of a building 800. Here, it is assumed that the information processing device 100 generates spatial layout data of a space within a house 850 that is one of a plurality of independent houses in the building 800.

[0058] The information processing device 100 receives, for example, building-related data of the building 800 including spatial feature data of the space within the house 850 from the building management device 200. Here, it is assumed that the spatial feature data of the space within the house 850 includes floor plan data of the house 850 and spatial imaging data of an image of the space within the house 850.

[0059] The middle diagram in Fig. 2 roughly illustrates an example of floor plan data 870 of a house 850. According to the floor plan data 870 illustrated in the middle diagram in Fig. 2, a veranda 858 is located on the south side, and therefore the orientation of the space within the house 850 is south.

[0060] The lower diagram of Fig. 2 shows an example of spatial imaging data 880 obtained by imaging the space inside a house 850. Here, it is assumed that the spatial imaging data 880 was obtained by imaging a position inside the house 850 corresponding to point P shown in the middle diagram of Fig. 2, with an imaging device facing in the direction of the arrow shown in the middle diagram of Fig. 2.

[0061] The spatial imaging data 880 is imaging data obtained by imaging a window 852 and a window 854 of the house 850. The information processing device 100 generates spatial layout data of the space within the house 850 based on the floor plan data 870 and the spatial imaging data 880. For example, the information processing device 100 generates the spatial layout data of the space within the house 850 by generating object data of the window 852 and object data of the window 854 constituting the spatial layout data of the space within the house 850. For example, the information processing device 100 generates the spatial layout data of the space within the house 850 including material identification data of the window 852 and material identification data of the window 854 by estimating materials of the window 852 and the window 854 based on the spatial imaging data 880.

[0062] Fig. 3 is an explanatory diagram for explaining another example of generating spatial layout data. As shown in floor plan data 870 of a house 850 in Fig. 3, the space within the house 850 is classified into two areas, an area 872 and an area 874. The area 872 is an area where no spatial imaging data exists. The area 874 is an area where spatial imaging data exists. An area where no spatial imaging data exists may be referred to as a missing area, and an area where spatial imaging data exists may be referred to as a satisfied area.

[0063] The information processing device 100 generates spatial layout data of the space in the house 850 by generating spatial layout data of the area 872 based on floor plan data 870 and spatial imaging data of the area 874 included in the spatial feature data of the space in the house 850. For example, the information processing device 100 uses the floor plan data 870 to determine that a window 856 through which a balcony 858 can be accessed constitutes the floor plan of the area 872. Next, the information processing device 100 generates object data of a window 854 through which a balcony 858 can be accessed that constitutes the floor plan of the area 874, based on the floor plan data 870 and the spatial imaging data of the area 874. After that, the information processing device 100 applies the object data of the window 854 to the object data of the window 856. As a result, the information processing device 100 generates spatial layout data of the area 872.

[0064] The spatial imaging data may be imaging data that captures only a part of the space within a building for which spatial layout data is to be generated. In particular, when the building for which spatial layout data is to be generated is a residence, the spatial imaging data may be personal information, so the spatial imaging data is often imaging data that captures only a part of the space within the residence.

[0065] On the other hand, when a missing area exists in a space in a building for which spatial layout data is to be generated, the information processing device 100 generates spatial layout data of the missing area based on the floor plan data of the space and the spatial imaging data of the filled area of ​​the space. In this way, the information processing device 100 can generate layout data of a space even if a missing area exists in the space in a building.

[0066] 4 is an explanatory diagram for explaining another example of generating spatial layout data. Here, it is assumed that the information processing device 100 generates spatial layout data of the space inside a house 850 in advance.

[0067] 4 is a schematic diagram of an example of a building 800. Here, it is assumed that the information processing device 100 generates spatial layout data of a space within a house 840, which is one of a plurality of independent houses in the building 800 and is a house on a floor below a house 850.

[0068] For example, when the information processing device 100 is unable to acquire spatial feature data of the space within the house 840, it generates spatial layout data of the space within the house 840 by applying the spatial layout data of the space within the house 850 to the space within the house 840. When the information processing device 100 is able to acquire spatial feature data of the space within the house 840, it may generate spatial layout data of the space within the house 840 based on the spatial feature data of the space within the house 840.

[0069] When a building for which spatial layout data is to be generated has multiple independent spaces, if a sales contract or rental contract has already been concluded for one of the multiple independent spaces, the information processing device 100 may not be able to acquire spatial feature data for the one space. On the other hand, the layout of the one space tends to be similar to the layout of another space different from the one space among the multiple independent spaces. In particular, when the relationship between the one space and the other space differs only in the number of floors, such as the relationship between the residence in room 201 and the residence in room 301, the layout of the one space tends to be more similar to the layout of the other space.

[0070] On the other hand, when the information processing device 100 cannot acquire the spatial feature data of the one space, if there is another space for which spatial layout data has already been generated, the information processing device 100 generates spatial layout data of the one space by applying the spatial layout data of the other space to the one space. Thus, when a building for which spatial layout data is to be generated has multiple independent spaces, and the information processing device 100 cannot acquire the spatial feature data of one of the multiple independent spaces, if spatial layout data of another space different from the one space of the multiple independent spaces exists, the information processing device 100 can generate layout data of the one space.

[0071] The lower diagram of Fig. 4 shows an example of a building 800 and a building 900. Here, it is assumed that the spatial layout data is generated for the building 900, which is an apartment building, and that the construction company that constructed the building 800 and the construction company that constructed the building 900 are the same construction company.

[0072] The information processing device 100 generates, for example, spatial layout data of a space within a house 950 that is one of a plurality of independent houses in the building 900. For example, when the information processing device 100 is unable to acquire spatial feature data of the space within the house 950, the information processing device 100 generates spatial layout data of the space within the house 950 by applying the spatial layout data of the space within the house 850 to the space within the house 950. When the information processing device 100 is able to acquire spatial feature data of the space within the house 950, the information processing device 100 may generate spatial layout data of the space within the house 950 based on the spatial feature data of the space within the house 950.

[0073] As described above, the information processing device 100 may not be able to acquire spatial feature data of the space in the one house. On the other hand, if the construction company that constructed the one building and the construction company that constructed the other building different from the one building are the same construction company, the layout of the space in the one building tends to be similar to the layout of the space in the other building. In particular, if the building identification data of the one building is similar to the building identification data of the other building, the layout of the space in the one building tends to be more similar to the layout of the space in the other building.

[0074] On the other hand, when the information processing device 100 cannot acquire spatial feature data of the space in the one building, if there is a space in the other building for which spatial layout data has already been generated, the information processing device 100 generates spatial layout data of the space in the one building by applying the spatial layout data of the space in the other building to the space in the one building. Thus, when the construction contractor who constructed the one building and the construction contractor who constructed the other building different from the one building are the same construction contractor, when the information processing device 100 cannot acquire spatial feature data of the space in the one building, if spatial layout data of the space in the other building exists, the information processing device 100 can generate layout data of the space in the one building.

[0075] 5 is an explanatory diagram for explaining an example of generating integrated layout data. Here, it is assumed that the information processing device 100 generates integrated layout data of a house 850. It is assumed that the information processing device 100 has generated spatial layout data of the space within the house 850 in advance.

[0076] 5 shows another example of floor plan data 870 of the spaces in the house 850. The floor plan data 870 shown in the upper diagram of FIG.

[0077] 5 is a schematic diagram showing an example of exterior imaging data 890 obtained by imaging the exterior of a house 850. The exterior imaging data 890 is imaging data obtained by imaging an exterior wall 802, a partition board 804, a window 854, a window 856, and a balcony 858. The information processing device 100 may generate exterior layout data of the exterior of the house 850 based on the exterior imaging data 890.

[0078] The information processing device 100 generates integrated layout data including, for example, spatial layout data of the space within the house 850 and exterior layout data of the exterior of the house 850. The information processing device 100 generates the integrated layout data by, for example, aligning the spatial layout data of the space within the house 850 and the exterior layout data of the exterior of the house 850. For example, the information processing device 100 generates the integrated layout data by aligning the object data of the window 852 and the object data of the window 854 constituting the spatial layout data of the space within the house 850 with the object data of the window 852 and the object data of the window 854 constituting the exterior layout data of the exterior of the house 850.

[0079] The information processing device 100 generates integrated layout data, for example, further based on the metadata of the external surface imaging data 890. The metadata of the external surface imaging data 890 shown in the center diagram of Fig. 5 indicates that the imaging position at which the external surface imaging data 890 was captured is "latitude: △△.△△" and "longitude: □□□.□□", and that the imaging direction at which the external surface imaging data 890 was captured is "north direction".

[0080] The lower diagram of Fig. 5 shows an example of map data covering the position of the building 800. For example, the information processing device 100 determines the positional relationship between the imaging position at which the exterior imaging data 890 was captured and the position of the building 800 based on the metadata of the exterior imaging data 890 and building position identification data included in the building-related data. Here, it is assumed that the exterior imaging data 890 was captured at a position corresponding to point Q shown in the lower diagram of Fig. 5, with the imaging device facing the direction of the arrow shown in the lower diagram of Fig. 5.

[0081] The information processing device 100 estimates the orientation of the space within the house 850 based on, for example, the exterior imaging data 890, the metadata of the exterior imaging data 890, and the building position identification data. In the exterior imaging data 890 shown in Fig. 5, the balcony 858 faces forward and the exterior imaging data 890 is captured facing north, so the information processing device 100 estimates that the orientation of the space within the house 850 is south.

[0082] In order to more appropriately carry out station placement design in mobile communications using radio waves in a high frequency band, it is important to consider not only the influence of radio wave shields present in an indoor environment, but also the penetration state of radio waves from an outdoor environment to an indoor environment. In response to this, the information processing device 100 generates spatial layout data of a space in a building and external surface layout data of an external surface of the building corresponding to the space, and further generates integrated layout data including the spatial layout data of the space and the external surface layout data of the external surface. As a result, the radio wave propagation estimation device 500 can estimate the propagation of radio waves from the outside of the building to the space inside the building using the integrated layout data, so the information processing device 100 can contribute to the realization of more appropriate implementation of station placement design in mobile communications using radio waves in a high frequency band. In addition, since the integrated layout data includes both the spatial layout data of the space and the external surface layout data of the external surface, the radio wave propagation estimation device 500 can estimate not only the propagation of radio waves from the outside of the building to the space inside the building, but also the propagation of radio waves within the space and the propagation of radio waves arriving at the external surface using the integrated layout data. This means that the integrated layout data generated by the information processing device 100 is layout data capable of estimating radio wave propagation comprehensively from outdoor environments to indoor environments. Therefore, by generating the integrated layout data, the information processing device 100 can contribute to realizing efficient radio wave propagation estimation for more appropriate implementation of station placement design in mobile communications using radio waves of a frequency band. Furthermore, the information processing device 100 can generate the integrated layout data by estimating the orientation of the space within the building based on the exterior imaging data, metadata of the exterior imaging data, and building position identification data. This allows the information processing device 100 to generate integrated layout data with higher accuracy.

[0083] 6 illustrates an example of a functional configuration of the information processing device 100. The information processing device 100 includes an acquisition unit 102, a building-related data storage unit 104, a layout data generation unit 106, a layout data storage unit 108, a learning data storage unit 112, a model generation unit 114, a model storage unit 116, a transmission unit 118, and a radio wave propagation estimation unit 120. It is not essential that the information processing device 100 includes all of these components.

[0084] The acquisition unit 102 acquires various data. For example, the acquisition unit 102 acquires various data by receiving the various data via the network 20. For example, the acquisition unit 102 may acquire various data by an input unit included in the information processing device 100 accepting input of the various data.

[0085] The acquisition unit 102 acquires, for example, building-related data. The acquisition unit 102 acquires the building-related data from, for example, the building management device 200. The acquisition unit 102 may acquire the building-related data from a communication terminal owned by a right holder who is different from the owner of the building management device 200 and has the authority to provide the building-related data to a third party. The acquisition unit 102 may store the acquired building-related data in the building-related data storage unit 104.

[0086] The layout data generating unit 106 generates various layout data used for radio wave propagation estimation. For example, the layout data generating unit 106 generates various layout data based on the building-related data stored in the building-related data storage unit 104. The layout data generating unit 106 may store the generated various layout data in the layout data storage unit 108.

[0087] The layout data generating unit 106 generates, for example, spatial layout data of a space in a building. The layout data generating unit 106 generates, for example, spatial layout data of the space based on spatial feature data of the space included in the building-related data. The layout data generating unit 106 generates, for example, spatial image data of the space included in the spatial feature data of the space. The layout data generating unit 106 generates, for example, spatial layout data of the space based on floor plan data of the space and spatial image data of the space included in the spatial feature data of the space.

[0088] For example, the layout data generation unit 106 generates object data of objects constituting the floor plan of the space by performing image analysis on the spatial imaging data of the space. The layout data generation unit 106 determines the arrangement of objects in the spatial layout data by using the spatial imaging data of the space and the floor plan data of the space. In this way, the layout data generation unit 106 generates spatial layout data of the space.

[0089] For example, when a missing area where no spatial imaging data exists exists in the space, the layout data generating unit 106 generates spatial layout data of the space by generating spatial layout data of the missing area based on the floor plan data of the space and the spatial imaging data of the full area of ​​the space. For example, the layout data generating unit 106 determines an object constituting the floor plan of the missing area using the floor plan data of the space. Note that the object constituting the floor plan of the missing area may be described as a missing object. Next, the layout data generating unit 106 generates object data of an object constituting the floor plan of the full area and corresponding to the missing object based on the floor plan data 870 and the spatial imaging data of the full area. Note that the object constituting the floor plan of the full area and corresponding to the missing object may be described as a corresponding object. After that, the layout data generating unit 106 applies the object data of the corresponding object to the object data of the missing object. In this way, the layout data generating unit 106 generates spatial layout data of the missing area.

[0090] The layout data generating unit 106 may generate the corresponding object based on external surface image data of the external surface of the building corresponding to the space, the external surface image data being included in the external surface feature data of the external surface of the building. The acquiring unit 102 may acquire the external surface feature data of the external surface included in the building-related data, for example. The acquiring unit 102 may acquire 3D map data from the map management device 300, and acquire the external surface feature data of the external surface from the acquired 3D map data.

[0091] The layout data generating unit 106 selects a corresponding object based on, for example, object data included in the floor plan data. For example, the layout data generating unit 106 selects an object that is the same as the missing object as the corresponding object.

[0092] The layout data generating unit 106 selects the corresponding object based on, for example, the style identification data included in the floor plan data. For example, the layout data generating unit 106 selects, as the corresponding object, an object that configures a floor plan of the same style as the missing area among the floor plans of the satisfied area and is the same as the missing object.

[0093] The layout data generating unit 106 may estimate the material of the object in the space based on the floor plan data of the space and the spatial imaging data of the space. In this case, the layout data generating unit 106 may generate spatial layout data of the space including material identification data of the object.

[0094] For example, when a building for which layout data is to be generated has a plurality of independent spaces, the layout data generating unit 106 generates layout data for each of the plurality of independent spaces. For example, when the acquiring unit 102 acquires spatial feature data for one of the plurality of independent spaces, the layout data generating unit 106 generates spatial layout data for the one space.

[0095] The layout data generation unit 106 generates, for example, spatial layout data of another space in the building that is different from the one space. For example, when the acquisition unit 102 cannot acquire spatial feature data of the other space, the layout data generation unit 106 generates spatial layout data of the other space based on the spatial layout data of the one space. For example, the layout data generation unit 106 generates spatial layout data of the other space by applying the spatial layout data of the one space to the other space. On the other hand, when the acquisition unit 102 can acquire spatial feature data of the other space, the layout data generation unit 106 generates spatial layout data of the other space based on the spatial feature data of the other space.

[0096] When the layout data generating unit 106 generates the spatial layout data of the other space based on the spatial layout data of the one space, the layout data generating unit 106 may generate the spatial layout data of the other space based on the floor plan data of the one space and the exterior feature data of the other space included in the spatial feature data of the one space. For example, the layout data generating unit 106 identifies the type of the other space by performing image analysis on exterior image data of the exterior of the building corresponding to the other space included in the exterior feature data of the other space. Next, the layout data generating unit 106 determines whether the type of the one space identified by the space type identification data included in the floor plan data of the one space and the type of the other space match. For example, when the layout data generating unit 106 determines that the type of the one space and the type of the other space match, the layout data generating unit 106 applies the spatial layout data of the one space to the other space. On the other hand, when the layout data generating unit 106 determines that the type of the one space and the type of the other space do not match, it modifies the spatial layout data of the one space based on exterior image data of the exterior of the building corresponding to the other space, and applies the modified spatial layout data of the one space to the other space. For example, when the type of the one space is a space in a middle room and the type of the other space is a space in a corner room, the layout data generating unit 106 executes a modification to add window object data to the spatial layout data of the one space.

[0097] For example, when there are multiple buildings for which layout data is to be generated, the layout data generating unit 106 generates layout data for the space in each of the multiple buildings. For example, when the acquiring unit 102 acquires spatial feature data for a space in one of the multiple buildings, the layout data generating unit 106 generates spatial layout data for the space in the one building.

[0098] The layout data generating unit 106 generates, for example, spatial layout data of another space in another building constructed by a construction company of the one building. For example, when the acquisition unit 102 cannot acquire spatial feature data of the other space in the other building, the layout data generating unit 106 generates spatial layout data of the other space in the other building based on the spatial layout data of the space in the one building. The layout data generating unit 106 generates spatial layout data of the other space in the other building by applying, for example, the spatial layout data of the space in the one building to the other space in the other building. On the other hand, when the acquisition unit 102 can acquire spatial feature data of the other space in the other building, the layout data generating unit 106 generates spatial layout data of the other space in the other building based on the spatial feature data of the other space in the other building.

[0099] When the layout data generating unit 106 generates spatial layout data of the other space in the other building based on the spatial layout data of the space in the one building, the layout data generating unit 106 generates the spatial layout data of the other space in the other building based on the floor plan data of the space in the one building and the exterior feature data of the other space in the other building included in the spatial feature data of the space in the one building. The layout data generating unit 106 determines whether the type of the space in the one building and the type of the other space in the other building match. For example, when the layout data generating unit 106 determines that the type of the space in the one building and the type of the other space in the other building match, the layout data generating unit 106 applies the spatial layout data of the space in the one building to the other space in the other building. On the other hand, if the layout data generation unit 106 determines that the type of the space in the one building and the type of the other space in the other building do not match, it modifies the spatial layout data of the space in the one building based on exterior image data capturing an image of the exterior of the other building that corresponds to the other space in the other building, and applies the modified spatial layout data of the space in the one building to the other space in the other building.

[0100] The layout data generating unit 106 determines whether or not to generate spatial layout data of the other space in the other building based on the spatial layout data of the space in the one building, for example, based on building identification data included in the building-related data of the one building and building identification data included in the building-related data of the other building. A specific example of the information processing device 100 determining whether or not to generate spatial layout data of the other space in the other building based on the spatial layout data of the space in the one building is as follows.

[0101] For example, when the type of the one building indicated by the building type identification data included in the building identification data of the one building matches the type of the other building indicated by the building type identification data included in the building identification data of the other building, the layout data generation unit 106 determines to generate spatial layout data of the other space in the other building based on the spatial layout data of the space in the one building. On the other hand, when the type of the one building does not match the type of the other building, the layout data generation unit 106 determines not to generate spatial layout data of the other space in the other building based on the spatial layout data of the space in the one building.

[0102] For example, when the structure of the one building indicated by the building structure identification data included in the building identification data of the one building matches the structure of the other building indicated by the building structure identification data included in the building identification data of the other building, the layout data generation unit 106 determines to generate spatial layout data of the other space in the other building based on the spatial layout data of the space in the one building. On the other hand, when the structure of the one building does not match the structure of the other building, the layout data generation unit 106 determines not to generate spatial layout data of the other space in the other building based on the spatial layout data of the space in the one building.

[0103] For example, when the difference in age between the one building indicated by the age identification data included in the building identification data of the one building and the other building indicated by the age identification data included in the building identification data of the other building is shorter than a predetermined age difference threshold, the layout data generating unit 106 determines to generate spatial layout data of the other space in the other building based on the spatial layout data of the space in the one building.On the other hand, when the difference in age is longer than the age difference threshold, the layout data generating unit 106 determines not to generate spatial layout data of the other space in the other building based on the spatial layout data of the space in the one building.

[0104] For example, when the floor difference between the floor of the one building indicated by the building floor identification data included in the building identification data of the one building and the floor of the other building indicated by the building floor identification data included in the building identification data of the other building is shorter than a predetermined floor difference threshold, the layout data generation unit 106 determines to generate spatial layout data of the other space in the other building based on the spatial layout data of the space in the one building.On the other hand, when the floor difference is longer than the floor difference threshold, the layout data generation unit 106 determines not to generate spatial layout data of the other space in the other building based on the spatial layout data of the space in the one building.

[0105] For example, when the distance between the position of the one building indicated by the building position identification data included in the building identification data of the one building and the position of the other building indicated by the building position identification data included in the building identification data of the other building is shorter than a predetermined distance threshold, the layout data generation unit 106 determines to generate spatial layout data of the other space in the other building based on the spatial layout data of the space in the one building.On the other hand, when the distance between the position of the one building and the position of the other building is longer than the distance threshold, the layout data generation unit 106 determines not to generate spatial layout data of the other space in the other building based on the spatial layout data of the space in the one building.

[0106] The layout data generating unit 106 generates exterior layout data of the exterior, for example, based on exterior feature data indicating features of the exterior of the building corresponding to a space within the building. For example, the layout data generating unit 106 generates object data of objects constituting the exterior by performing image analysis on exterior image data of the exterior, which is included in the exterior feature data. The layout data generating unit 106 determines the arrangement of objects in the exterior layout data using the exterior image data of the exterior. In this way, the layout data generating unit 106 generates exterior layout data of the exterior. The layout data generating unit 106 may generate the exterior layout data of the exterior further based on floor plan data of the space.

[0107] The layout data generating unit 106 generates integrated layout data including, for example, spatial layout data of a space within a building and exterior surface layout data of the exterior surface of the building corresponding to the space. The layout data generating unit 106 generates the integrated layout data by, for example, aligning the spatial layout data of the space and the exterior surface layout data of the exterior surface.

[0108] For example, the layout data generation unit 106 determines object data that exists in both the spatial layout data of the space and the external layout data of the external surface. Next, the layout data generation unit 106 aligns the spatial layout data of the space with the external layout data of the external surface so that the positions of the object data that exists in both the spatial layout data of the space and the external layout data of the external surface more closely match. At that time, the layout data generation unit 106 may adjust the size and shape of the object data that constitutes the integrated layout data so that the positions of the object data that exists in both the spatial layout data of the space and the external layout data of the external surface more closely match. In this way, the layout data generation unit 106 generates the integrated layout data.

[0109] The layout data generating unit 106 generates integrated layout data by estimating the orientation of the space based on, for example, exterior surface imaging data of the exterior surface, imaging position identification data of the exterior surface imaging data, and building position identification data included in the building-related data. For example, the layout data generating unit 106 determines the imaging direction in which the exterior surface imaging data was captured from the imaging position identified by the imaging position identification data at which the exterior surface imaging data was captured and the position of the building identified by the building position identification data. The layout data generating unit 106 estimates the orientation of the space based on the determined imaging direction and the direction of an object captured by the exterior surface imaging data from which the orientation of the space can be estimated. The object from which the orientation of the space can be estimated is a balcony, a window, etc.

[0110] The acquiring unit 102 acquires various learning data for generating various layout data generation models for generating layout data used in radio wave propagation estimation, for example. The acquiring unit 102 may store the acquired various learning data in the learning data storage unit 112.

[0111] The acquisition unit 102 acquires, for example, spatial learning data for generating a spatial layout data generation model that generates spatial layout data of a space from floor plan data of the space in a building and spatial imaging data obtained by imaging the space. The spatial learning data includes, for example, spatial layout data generated in the past, floor plan data of the space in the building that is the subject of the spatial layout data, and spatial imaging data obtained by imaging the space. The spatial learning data may further include building identification data of the building.

[0112] The acquisition unit 102 acquires exterior learning data for generating an exterior layout data generation model for generating exterior layout data for an exterior surface from, for example, exterior image data of an exterior surface of a building corresponding to a space within the building and floor plan data of the space. The exterior learning data includes, for example, exterior layout data generated in the past, exterior image data of an exterior surface of a building that is the subject of the exterior layout data, and floor plan data of a space within the building that corresponds to the exterior surface. The exterior learning data may further include building identification data of the building.

[0113] The acquisition unit 102 acquires integrated learning data for generating an integrated layout data generation model that generates integrated layout data including spatial layout data of a space and exterior layout data of the exterior from, for example, floor plan data of a space in a building, spatial imaging data obtained by imaging the space, and exterior imaging data obtained by imaging the exterior of a building corresponding to the space. The integrated learning data includes, for example, integrated layout data generated in the past, floor plan data of a space in a building that is the target of the spatial layout data included in the integrated layout data, spatial imaging data obtained by imaging the space, and exterior imaging data obtained by imaging the exterior of the building that corresponds to the space that is the target of the exterior layout data included in the integrated layout data. The integrated learning data may further include building identification data of the building.

[0114] The model generation unit 114 generates various layout data generation models for generating layout data used in radio wave propagation estimation. The model generation unit 114 generates various layout data generation models based on various learning data stored in the learning data storage unit 112, for example. The model generation unit 114 may store the generated various layout data generation models in the model storage unit 116.

[0115] The model generation unit 114 generates a spatial layout data generation model by machine learning, for example, using a plurality of spatial learning data stored in the learning data storage unit 112 as teacher data. The model generation unit 114 generates an exterior layout data generation model by machine learning, for example, using a plurality of exterior learning data stored in the learning data storage unit 112 as teacher data. The model generation unit 114 generates an integrated layout data generation model by machine learning, for example, using a plurality of integrated learning data stored in the learning data storage unit 112 as teacher data.

[0116] The acquiring unit 102 may acquire various layout data generation models for generating layout data used in radio wave propagation estimation. The acquiring unit 102 acquires the various layout data generation models from the model generating device 400, for example.

[0117] The acquiring unit 102 acquires, for example, a spatial layout data generation model. The acquiring unit 102 acquires, for example, an exterior surface layout data generation model. The acquiring unit 102 acquires, for example, an integrated layout data generation model.

[0118] The layout data generation unit 106 generates spatial layout data of a space from floor plan data of the space included in the spatial feature data of the space inside the building acquired by the acquisition unit 102 and spatial image data of the space, using, for example, a spatial layout data generation model stored in the model storage unit 116. The layout data generation unit 106 generates exterior layout data of the space from exterior image data of the exterior of the building corresponding to the space inside the building acquired by the acquisition unit 102 and floor plan data of the space included in the spatial feature data of the space acquired by the acquisition unit 102, using, for example, an exterior layout data generation model stored in the model storage unit 116. The layout data generation unit 106 uses, for example, an integrated layout data generation model stored in the model storage unit 116 to generate integrated layout data including spatial layout data of the space and exterior layout data of the exterior from floor plan data of the space and spatial imaging data of the space contained in the spatial feature data of the space within the building acquired by the acquisition unit 102, and exterior imaging data of the exterior of the building corresponding to the space acquired by the acquisition unit 102.

[0119] The transmission unit 118 transmits the various layout data generated by the layout data generation unit 106. The transmission unit 118 transmits, for example, the various layout data to the radio wave propagation estimation apparatus 500. The transmission unit 118 transmits, for example, the various layout data to the radio wave propagation estimation apparatus 500 via the network 20.

[0120] The transmitting unit 118 transmits, for example, spatial layout data. The transmitting unit 118 transmits, for example, exterior surface layout data. The transmitting unit 118 transmits, for example, integrated layout data.

[0121] The radio wave propagation estimation unit 120 estimates radio wave propagation. For example, the radio wave propagation estimation unit 120 estimates radio wave propagation using various layout data stored in the layout data storage unit 108. For example, the radio wave propagation estimation unit 120 arranges various layout data on 3D map data, and estimates radio wave propagation using the 3D map data on which the various layout data are arranged. For example, the radio wave propagation estimation unit 120 arranges various layout data on the 3D map data based on the position of a building identified by building position identification data included in building identification data of a building for which various layout data is to be generated, acquired by the acquisition unit 102.

[0122] The radio wave propagation estimation unit 120 estimates radio wave propagation in a space, for example, inside a building. The radio wave propagation estimation unit 120 estimates radio wave propagation in the space, for example, by using spatial layout data of the space. The radio wave propagation estimation unit 120 may estimate radio wave propagation in the space by using integrated layout data including the spatial layout data of the space.

[0123] The radio wave propagation estimation unit 120 estimates, for example, the propagation of radio waves arriving at an exterior surface of a building corresponding to a space inside the building. The radio wave propagation estimation unit 120 estimates the propagation of radio waves arriving at the exterior surface, for example, by using exterior surface layout data of the exterior surface. The radio wave propagation estimation unit 120 may estimate the propagation of radio waves arriving at the exterior surface, by using integrated layout data including the exterior surface layout data of the exterior surface.

[0124] The radio wave propagation estimation unit 120 estimates, for example, the propagation of radio waves from outside a building to a space inside the building. The radio wave propagation estimation unit 120 estimates the propagation of radio waves from outside the building to inside the space, for example, by using integrated layout data including spatial layout data of the space and exterior layout data of the exterior of the building corresponding to the space.

[0125] 7 is an explanatory diagram for explaining an example of a processing flow of the information processing device 100. Here, an example of a processing flow of the information processing device 100 when the information processing device 100 generates spatial layout data will be described.

[0126] In step (sometimes abbreviated to S) 102, the layout data generation unit 106 determines whether the acquisition unit 102 can acquire spatial feature data of the space within the building for which spatial layout data is to be generated. If the layout data generation unit 106 determines that the acquisition unit 102 can acquire spatial feature data of the space within the building, the process proceeds to S108. If the layout data generation unit 106 determines that the acquisition unit 102 cannot acquire spatial feature data of the space within the building, the process proceeds to S104.

[0127] In S104, the layout data generation unit 106 determines whether or not spatial layout data of other spaces in the building is stored in the layout data storage unit 108. If the layout data generation unit 106 determines that spatial layout data of other spaces in the building is stored in the layout data storage unit 108, the process proceeds to S110. If the layout data generation unit 106 determines that spatial layout data of other spaces in the building is not stored in the layout data storage unit 108, the process proceeds to S106.

[0128] In S106, the layout data generation unit 106 determines whether or not spatial layout data of other spaces in other buildings by the same construction company as the building in question is stored in the layout data storage unit 108. If the layout data generation unit 106 determines that spatial layout data of other spaces in other buildings by the same construction company as the building in question is stored in the layout data storage unit 108, the process proceeds to S112. If the layout data generation unit 106 determines that spatial layout data of other spaces in other buildings by the same construction company as the building in question is not stored in the layout data storage unit 108, the process proceeds to S114.

[0129] In S108, the layout data generating unit 106 generates spatial layout data of the space within the building based on the spatial feature data of the space within the building. After that, the process of generating spatial layout data by the information processing device 100 ends.

[0130] In S110, the layout data generating unit 106 generates spatial layout data of the space in the building based on the spatial feature data of the other spaces in the building. After that, the process of generating spatial layout data by the information processing device 100 ends.

[0131] In S112, the layout data generating unit 106 generates spatial layout data of a space in the building based on spatial layout data of another space in another building of the same construction company as the building. After that, the process of generating spatial layout data by the information processing device 100 ends.

[0132] In S114, the notification unit included in the information processing device 100 issues a generation impossible notification indicating that spatial layout data of the space in the building cannot be generated. The notification unit issues the generation impossible notification, for example, by transmitting the generation impossible notification to a communication terminal owned by the user of the information processing device 100. The notification unit may issue the generation impossible notification by causing an output unit included in the information processing device 100 to output the generation impossible notification. The output unit, for example, displays and outputs the generation impossible notification. The output unit may output the generation impossible notification as sound. Thereafter, the process of generating spatial layout data by the information processing device 100 ends.

[0133] 8 illustrates an example of a functional configuration of the model generating device 400. The model generating device 400 includes an acquiring unit 402, a training data storage unit 404, a model generating unit 406, and a transmitting unit 408. Note that it is not essential that the model generating device 400 includes all of these components.

[0134] The acquiring unit 402 acquires various learning data for generating various layout data generation models for generating layout data used in radio wave propagation estimation, for example. The acquiring unit 402 may store the acquired various learning data in the learning data storage unit 404.

[0135] The acquiring unit 402 acquires, for example, spatial learning data. The acquiring unit 402 acquires, for example, exterior learning data. The acquiring unit 402 acquires, for example, integrated learning data.

[0136] The model generation unit 406 generates various layout data generation models for generating layout data used in radio wave propagation estimation. The model generation unit 406 generates various layout data generation models based on various learning data stored in the learning data storage unit 404, for example.

[0137] The model generation unit 406 generates a spatial layout data generation model by machine learning, for example, using a plurality of spatial learning data stored in the learning data storage unit 404 as teacher data. The model generation unit 406 generates an exterior layout data generation model by machine learning, for example, using a plurality of exterior learning data stored in the learning data storage unit 404 as teacher data. The model generation unit 406 generates an integrated layout data generation model by machine learning, for example, using a plurality of integrated learning data stored in the learning data storage unit 404 as teacher data.

[0138] The transmission unit 408 transmits the various layout data generation models generated by the model generation unit 406. For example, the transmission unit 408 transmits the various layout data generation models to the information processing device 100. For example, the transmission unit 408 transmits the various layout data generation models to the information processing device 100 via the network 20.

[0139] The transmitting unit 408 transmits, for example, spatial training data. The transmitting unit 408 transmits, for example, exterior training data. The transmitting unit 408 transmits, for example, integrated training data.

[0140] 9 illustrates an example of a functional configuration of a radio wave propagation estimating apparatus 500. The radio wave propagation estimating apparatus 500 includes an acquiring unit 502, a layout data storage unit 504, and a radio wave propagation estimating unit 508. It is not essential that the radio wave propagation estimating apparatus 500 includes all of these components.

[0141] The acquiring unit 502 acquires various layout data used for radio wave propagation estimation. The acquiring unit 502 may store the acquired various layout data in the layout data storage unit 504.

[0142] The acquiring unit 502 acquires, for example, various layout data from the information processing device 100. The acquiring unit 502 acquires, for example, various layout data from the information processing device 100 by receiving various layout data from the information processing device 100 via the network 20.

[0143] The acquiring unit 502 acquires, for example, spatial layout data. The acquiring unit 502 acquires, for example, exterior surface layout data. The acquiring unit 502 acquires, for example, integrated layout data.

[0144] The radio wave propagation estimating unit 508 estimates radio wave propagation. For example, the radio wave propagation estimating unit 508 estimates radio wave propagation using various layout data stored in the layout data storage unit 504. For example, the radio wave propagation estimating unit 508 arranges various layout data on 3D map data, and estimates radio wave propagation using the 3D map data on which the various layout data are arranged.

[0145] The radio wave propagation estimation unit 508 estimates, for example, radio wave propagation in a space inside a building. The radio wave propagation estimation unit 508 estimates radio wave propagation in the space by using, for example, spatial layout data of the space. The radio wave propagation estimation unit 508 may estimate radio wave propagation in the space by using integrated layout data including the spatial layout data of the space.

[0146] The radio wave propagation estimation unit 508 estimates, for example, the propagation of radio waves arriving at an exterior surface of a building corresponding to a space inside the building. The radio wave propagation estimation unit 508 estimates the propagation of radio waves arriving at the exterior surface, for example, by using exterior surface layout data of the exterior surface. The radio wave propagation estimation unit 508 may estimate the propagation of radio waves arriving at the exterior surface, by using integrated layout data including the exterior surface layout data of the exterior surface.

[0147] The radio wave propagation estimation unit 508 estimates, for example, the propagation of radio waves from outside a building to a space inside the building. The radio wave propagation estimation unit 508 estimates the propagation of radio waves from outside the building to inside the space, for example, by using integrated layout data including spatial layout data of the space and exterior layout data of the exterior of the building corresponding to the space.

[0148] 10 is an explanatory diagram for explaining an example of the flow of processing of the system 10. Here, the description will be given assuming that the starting state is a state in which an integrated layout data generation model has not been generated.

[0149] In S202, the acquisition unit 402 acquires a plurality of integrated learning data. In S204, the model generation unit 406 generates an integrated layout data generation model by machine learning using the plurality of integrated learning data acquired by the acquisition unit 402 in S204 as teacher data.

[0150] In S206, the transmission unit 408 transmits the integrated layout data generation model generated by the model generation unit 406 in S204 to the information processing device 100. The acquisition unit 102 receives the integrated layout data generation model from the model generation device 400.

[0151] In S208, the acquisition unit 102 acquires space feature data of the space inside the building. In S210, the acquisition unit 102 acquires exterior surface feature data of the exterior surface of the building corresponding to the space.

[0152] In S212, the layout data generation unit 106 uses the integrated layout data generation model acquired by the acquisition unit 102 in S206 to generate integrated layout data including the spatial layout data of the space and the exterior layout data of the exterior from the floor plan data of the space and the spatial imaging data of the space included in the spatial feature data of the space acquired by the acquisition unit 102 in S208, and the exterior imaging data of the exterior included in the exterior feature data of the exterior acquired by the acquisition unit 102 in S210.

[0153] In S214, the transmission unit 118 transmits the integrated layout data generated by the layout data generation unit 106 in S212 to the radio wave propagation estimation apparatus 500. The acquisition unit 502 receives the integrated layout data from the information processing apparatus 100.

[0154] In S216, the radio wave propagation estimating unit 508 estimates radio wave propagation using the integrated layout data acquired in S214 by the acquiring unit 502. Thereafter, the processing of the system 10 starts.

[0155] 11 is a schematic diagram showing an example of a hardware configuration of a computer 1200 functioning as the information processing device 100, the model generating device 400, or the radio wave propagation estimation device 500. A program installed in the computer 1200 can cause the computer 1200 to function as one or more "parts" of the device according to the present embodiment, or cause the computer 1200 to execute operations associated with the device according to the present embodiment or one or more "parts", and / or cause the computer 1200 to execute a process according to the present embodiment or steps of the process. Such a program may be executed by the CPU 1212 to cause the computer 1200 to execute specific operations associated with some or all of the blocks of the flowcharts and block diagrams described herein.

[0156] The computer 1200 according to this embodiment includes a CPU 1212, a RAM 1214, and a graphics controller 1216, which are connected to each other by a host controller 1210. The computer 1200 also includes input / output units such as a communication interface 1222, a storage device 1224, a DVD drive 1226, and an IC card drive, which are connected to the host controller 1210 via an input / output controller 1220. The DVD drive 1226 may be a DVD-ROM drive, a DVD-RAM drive, or the like. The storage device 1224 may be a hard disk drive, a solid state drive, or the like. The computer 1200 also includes a legacy input / output unit such as a ROM 1230 and a keyboard, which are connected to the input / output controller 1220 via an input / output chip 1240.

[0157] The CPU 1212 operates according to a program stored in the ROM 1230 and the RAM 1214, thereby controlling each unit. The graphic controller 1216 acquires image data generated by the CPU 1212 into a frame buffer or the like provided in the RAM 1214 or into itself, and causes the image data to be displayed on the display device 1218.

[0158] The communication interface 1222 communicates with other electronic devices via a network. The storage device 1224 stores programs and data used by the CPU 1212 in the computer 1200. The DVD drive 1226 reads programs or data from a DVD-ROM 1227 or the like and provides the programs or data to the storage device 1224. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.

[0159] The ROM 1230 stores therein a boot program or the like that is executed by the computer 1200 upon activation, and / or a program that depends on the hardware of the computer 1200. The input / output chip 1240 may also connect various input / output units to the input / output controller 1220 via a USB port, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

[0160] The programs are provided by a computer-readable storage medium such as a DVD-ROM 1227 or an IC card. The programs are read from the computer-readable storage medium, installed in the storage device 1224, the RAM 1214, or the ROM 1230, which are also examples of computer-readable storage media, and executed by the CPU 1212. Information processing described in these programs is read by the computer 1200, and brings about cooperation between the programs and the various types of hardware resources described above. An apparatus or method may be constructed by implementing operations or processing of information according to the use of the computer 1200.

[0161] For example, when communication is performed between the computer 1200 and an external device, the CPU 1212 may execute a communication program loaded in the RAM 1214 and instruct the communication interface 1222 to perform communication processing based on the processing described in the communication program. Under the control of the CPU 1212, the communication interface 1222 reads transmission data stored in a transmission buffer area provided in the RAM 1214, the storage device 1224, the DVD-ROM 1227, or a recording medium such as an IC card, and transmits the read transmission data to a network, or writes reception data received from the network to a reception buffer area or the like provided on the recording medium.

[0162] Furthermore, the CPU 1212 may cause all or a necessary portion of a file or database stored in an external recording medium such as the storage device 1224, the DVD drive 1226 (DVD-ROM 1227), an IC card, etc. to be read into the RAM 1214, and perform various types of processing on the data on the RAM 1214. The CPU 1212 may then write back the processed data to the external recording medium.

[0163] Various types of information, such as various types of programs, data, tables, and databases, may be stored in the recording medium and undergo information processing. The CPU 1212 may perform various types of processing on the data read from the RAM 1214, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search / replacement, etc., as described throughout this disclosure and specified by the instruction sequence of the program, and write back the results to the RAM 1214. The CPU 1212 may also search for information in a file, database, etc. in the recording medium. For example, when a plurality of entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 1212 may search for an entry whose attribute value of the first attribute matches a specified condition from among the plurality of entries, read the attribute value of the second attribute stored in the entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.

[0164] The above-described programs or software modules may be stored in a computer-readable storage medium on the computer 1200 or in the vicinity of the computer 1200. In addition, a recording medium such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, thereby providing the programs to the computer 1200 via the network.

[0165] The blocks in the flowcharts and block diagrams in the present embodiment may represent stages of a process in which an operation is performed or "parts" of an apparatus responsible for performing the operation. Particular stages and "parts" may be implemented by dedicated circuitry, programmable circuitry provided with computer-readable instructions stored on a computer-readable storage medium, and / or a processor provided with computer-readable instructions stored on a computer-readable storage medium. The dedicated circuitry may include digital and / or analog hardware circuits, and may include integrated circuits (ICs) and / or discrete circuits. The programmable circuitry may include reconfigurable hardware circuits, such as, for example, field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), and the like, including AND, OR, XOR, NAND, NOR, and other logical operations, flip-flops, registers, and memory elements.

[0166] A computer readable medium may include any tangible device capable of storing instructions that are executed by a suitable device, such that a computer readable medium having instructions stored thereon comprises an article of manufacture that includes instructions that can be executed to create means for performing the operations specified in the flowchart or block diagram. Examples of computer readable media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, etc. More specific examples of computer readable media may include floppy disks, diskettes, hard disks, random access memories (RAMs), read-only memories (ROMs), erasable programmable read-only memories (EPROMs or flash memories), electrically erasable programmable read-only memories (EEPROMs), static random access memories (SRAMs), compact disk read-only memories (CD-ROMs), digital versatile disks (DVDs), Blu-ray disks, memory sticks, integrated circuit cards, etc.

[0167] The computer readable instructions may include either assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk®, JAVA®, C++, etc., and conventional procedural programming languages ​​such as the “C” programming language or similar programming languages.

[0168] The computer-readable instructions may be provided to a processor or programmable circuit of a programmable data processing device such as a computer, either locally or over a wide area network (WAN) such as a local area network (LAN), the Internet, etc., to execute the computer-readable instructions to create a means for performing the operations specified in the flowchart or block diagram. Here, the computer may be a PC (personal computer), a tablet computer, a smartphone, a workstation, a server computer, a general-purpose computer, a special-purpose computer, etc., and may be a computer system in which multiple computers are connected. Such a computer system in which multiple computers are connected is also called a distributed computing system, and is a computer in the broad sense. In a distributed computing system, each of the multiple computers executes a part of a program, and the multiple computers collectively execute a program by transferring data during program execution between the computers as necessary.

[0169] Examples of processors include computer processors, central processing units (CPUs), processing units, microprocessors, digital signal processors, controllers, microcontrollers, etc. A computer may include one processor or multiple processors. In a multiprocessor system including multiple processors, each processor executes a part of a program, and the multiple processors execute a program collectively by passing data during program execution between the processors as necessary. For example, in executing multitasks, each of the multiple processors may execute a part of each task in small chunks by switching tasks for each time slice. In this case, which part of a program each processor executes changes dynamically. Which part of a program each of the multiple processors executes may be statically determined by programming that takes the multiprocessor into consideration.

[0170] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is clear to those skilled in the art that various modifications and improvements can be made to the above embodiments. It is clear from the description of the claims that such modifications and improvements can also be included in the technical scope of the present invention.

[0171] It should be noted that the order of execution of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before" or "prior to," and that the process may be performed in any order unless the output of a previous process is used in a later process. Even if the operational flow in the claims, specifications, and drawings is described using "first," "next," etc. for convenience, it does not mean that the process must be performed in this order. [Explanation of symbols]

[0172] 10 system, 20 network, 100 information processing device, 102 acquisition unit, 104 building-related data storage unit, 106 layout data generation unit, 108 layout data storage unit, 112 learning data storage unit, 114 model generation unit, 116 model storage unit, 118 transmission unit, 120 radio wave propagation estimation unit, 200 building management device, 300 map management device, 400 model generation device, 402 acquisition unit, 404 learning data storage unit, 406 model generation unit, 408 transmission unit, 500 radio wave propagation estimation device, 502 acquisition unit, 504 layout data storage unit, 508 radio wave propagation estimation unit, 800 building, 802 exterior wall, 804 partition, 840 house, 850 house, 852 window, 854 window, 856 window, 858 balcony, 870 Floor plan data, 872 area, 874 area, 880 spatial imaging data, 890 exterior imaging data, 900 building, 950 house, 1200 computer, 1210 host controller, 1212 CPU, 1214 RAM, 1216 graphic controller, 1218 display device, 1220 input / output controller, 1222 communication interface, 1224 storage device, 1226 DVD drive, 1227 DVD-ROM, 1230 ROM, 1240 input / output chip

Claims

1. An acquisition unit that acquires spatial feature data indicating features of a space within a building; a layout data generating unit that generates spatial layout data of the space to be used for radio wave propagation estimation based on the spatial feature data; Equipped with The acquisition unit acquires the space feature data including floor plan data of the space and space image data obtained by imaging the space, the layout data generation unit applies the spatial layout data of the space to another space in the other building that is constructed by a construction company of the building and for which the spatial imaging data does not exist, thereby generating spatial layout data of the other space to be used for radio wave propagation estimation. Information processing system.

2. The information processing system described in claim 1, wherein when a missing area for which no spatial imaging data exists in the space, the layout data generation unit generates the spatial layout data of the space by generating spatial layout data of the missing area based on the floor plan data and the spatial imaging data contained in the spatial feature data.

3. An information processing system as described in claim 1 or 2, wherein the layout data generation unit generates the spatial layout data of the space including material identification data that identifies the material of the objects by estimating the material of the objects in the space based on the floor plan data and the spatial imaging data contained in the spatial feature data.

4. The layout data generation unit generates the spatial layout data of the space from the floor plan data and the spatial imaging data included in the spatial feature data, using a spatial layout data generation model that generates spatial layout data of the space from floor plan data of the space in a building and spatial imaging data obtained by imaging the space.

3. The information processing system according to claim 1 or 2.

5. a radio wave propagation estimation unit that estimates radio wave propagation in the space by using the spatial layout data of the space; The information processing system according to claim 1 , further comprising:

6. An acquisition unit that acquires spatial feature data indicating the characteristics of a space within a building, exterior feature data indicating the characteristics of the exterior including exterior image data obtained by imaging the exterior of the building corresponding to the space within the building, imaging position identification data that identifies the imaging position at which the exterior image data was captured, and building position identification data that identifies the position of the building; a layout data generation unit that generates spatial layout data of the space to be used for radio wave propagation estimation based on the spatial feature data, and further generates exterior surface layout data of the exterior surface to be used for radio wave propagation estimation based on the exterior surface feature data; Equipped with the layout data generation unit generates integrated layout data used for radio wave propagation estimation and including the spatial layout data of the space and the exterior layout data of the exterior surface by aligning the spatial layout data of the space and the exterior layout data of the exterior surface; the layout data generating unit determines an imaging direction in which the exterior image data was captured from the imaging position identified by the imaging position identification data, where the exterior image data was captured, and the position of the building identified by the building position identification data, and generates the integrated layout data by estimating an orientation of the space based on the determined imaging direction and a direction of an object from which an orientation of the space can be estimated, which is captured by the exterior image data. Information processing system.

7. a radio wave propagation estimation unit that estimates radio wave propagation within a space within the building using the integrated layout data, estimates propagation of radio waves arriving at an outer surface of the building corresponding to a space within the building, estimates propagation of radio waves from the outside of the building to a space within the building, and estimates propagation of radio waves from the outside of the building to the space within the building using the integrated layout data, which is necessary for station placement design in mobile communications using radio waves in a high-frequency band. The information processing system according to claim 6 , further comprising:

8. A program for causing a computer to function as the information processing system described in claim 1 or 6.

Images