Information processing device and information processing program

Abstract

To provide an information processing device that can further improve efficiency in making information about the interior of a building (e.g., the interior of a house) (information for viewing / inspection), the exterior of a building (information for viewing / inspection), and the exterior of a building (e.g., gardens, balconies, etc. surrounding a house) (information for viewing / inspection) accessible to a third party. [Solution] The present invention provides an information processing device comprising: a 3D model data acquisition unit that acquires 3D model data of a building; a 3D model data storage unit that stores the 3D model data of the building acquired by the 3D model data acquisition unit on the cloud; and an automatic conversion unit for viewing content that automatically converts the 3D model data of the building stored by the 3D model data storage unit into content for viewing the building.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus and an information processing program.

Background Art

[0002] There is known a technique for digitizing a three-dimensional model (3D model) of a building in order to allow a third party to obtain information inside the building such as the interior of the building (information obtained by internal viewing / inspection) (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the technique proposed in Patent Document 1, there is a risk that further efficiency cannot be achieved in allowing a third party to obtain information inside the building (for example, the interior of a house), information on the appearance (outer shape) of the building (for internal viewing / inspection), and information on the outside of the building (for example, a garden, balcony, etc. arranged around the house) (for internal viewing / inspection).

[0005] The present invention has been made in view of such a situation, and the main object thereof is to provide an information processing apparatus and an information processing program capable of further improving the efficiency of allowing a third party to obtain information inside the building (for example, the interior of a house), information on the appearance (outer shape) of the building (for internal viewing / inspection), and information on the outside of the building (for example, a garden, balcony, etc. arranged around the house) (for internal viewing / inspection).

Means for Solving the Problems

[0006] As a result of diligent research to solve the above-mentioned objectives, the inventors have succeeded in developing an information processing device and an information processing program that can further improve the efficiency of making information about the interior of a building (e.g., the interior of a house, etc.) (information for viewing / inspection), information about the exterior (outer shape) of a building (information for viewing / inspection), and information about the exterior of a building (e.g., gardens, balconies, etc. surrounding the outside of a house) (information for viewing / inspection) available to third parties, and have completed the present invention.

[0007] In other words, in the present invention, as a first aspect, A 3D model data acquisition unit that acquires 3D model data of buildings, A 3D model data storage unit stores the 3D model data of the building acquired by the 3D model data acquisition unit on the cloud, The present invention provides an information processing device comprising: an automatic conversion unit for viewing content that automatically converts 3D model data of a building stored in the 3D model data storage unit into content for viewing the building.

[0008] The first aspect of the information processing apparatus according to the present invention is: The system may further include a preview content playback unit that plays back the preview content automatically converted by the preview content automatic conversion unit.

[0009] In the information processing apparatus according to the first aspect of the present invention, The aforementioned automatic content conversion unit for viewing may include an automatic lighting processing unit that automatically processes the lighting of the building.

[0010] In the information processing apparatus according to the first aspect of the present invention, The aforementioned automatic content conversion unit for viewing may also include an automatic floor plan generation unit that automatically generates a floor plan of the building.

[0011] In the information processing apparatus according to the first aspect of the present invention, The aforementioned automatic content conversion unit for viewing may include an automatic movement point setting unit that automatically sets movement points within the building.

[0012] In the information processing apparatus according to the first aspect of the present invention, The aforementioned automatic content conversion unit for viewing may include a thumbnail image generation unit that generates thumbnail images displaying the movement points that have been automatically set by the automatic movement point setting unit.

[0013] In the information processing apparatus according to the first aspect of the present invention, The aforementioned automatic content conversion unit for viewing may include an area discrimination unit that distinguishes between collision areas and non-collision areas within the building.

[0014] In the information processing apparatus according to the first aspect of the present invention, The aforementioned automatic content conversion unit for viewing may include an automatic 3D model data optimization processing unit that automatically optimizes the 3D model data of the building by integrating multiple substantially identical materials in the building into one to create a single mesh.

[0015] Furthermore, in the present invention, as a second aspect, Computers, A means for acquiring 3D model data of a building, A 3D model data storage means that stores the 3D model data of the building acquired by the 3D model data acquisition means on the cloud, The present invention provides an information processing program that functions as an automatic conversion means for viewing content, which automatically converts 3D model data of a building stored in the 3D model data storage means into content for viewing the building. [Effects of the Invention]

[0016] According to the present invention, further efficiency can be achieved in making information on the interior of a building (e.g., the interior of a house, etc.), information on the exterior appearance (outer shape) of the building, and information on the exterior of the building (e.g., a garden, balcony, etc. arranged around the house) known to a third party. Note that the effects described here are not necessarily limited and may be any of the effects described in this specification.

Brief Description of Drawings

[0017] [Figure 1] FIG. 1 is a diagram showing a configuration example of an information processing system using an information processing apparatus according to the present invention. [Figure 2] FIG. 2 is a block diagram showing a functional configuration example of an information processing apparatus according to the present invention. [Figure 3] FIG. 3 is a block diagram showing a functional configuration example of an in-house viewing content automatic conversion unit provided in an information processing apparatus according to the present invention. [Figure 4] FIG. 4 is a block diagram showing an electrical configuration example of an information processing apparatus according to the present invention. [Figure 5] FIG. 5 is a diagram showing an example of a 3D model of a building. [Figure 6] FIG. 6 is a diagram showing an example of in-house viewing content of a building by the application of an information processing apparatus according to the present invention. [Figure 7] FIG. 7 is a diagram for explaining automatic writing processing by the application of an information processing apparatus according to the first embodiment of the present invention. [Figure 8] FIG. 8 is a diagram for explaining automatic creation of a floor plan by the application of an information processing apparatus according to the second embodiment of the present invention. [Figure 9] FIG. 9 is a diagram for explaining automatic creation of a floor plan by the application of an information processing apparatus according to the second embodiment of the present invention. [Figure 10] FIG. 10 is a diagram for explaining automatic creation of a floor plan by the application of an information processing apparatus according to the second embodiment of the present invention. [Figure 11]Figure 11 is a diagram illustrating the automatic setting of a travel point by applying the information processing device of the third embodiment of the present invention. [Figure 12] Figure 12 is a diagram illustrating automatic collision detection using an information processing device according to the fourth embodiment of the present invention. [Figure 13] Figure 13 is a diagram illustrating automatic collision detection using an information processing device according to the fourth embodiment of the present invention. [Figure 14] Figure 14 is a diagram illustrating the automatic weight reduction process by applying the information processing device of the fifth embodiment according to the present invention. [Figure 15] Figure 15 is a block diagram showing an example of the functional configuration of an information processing program according to the present invention. [Figure 16] Figure 16 is a block diagram showing an example of the functional configuration of an automatic content conversion module for virtual tours included in the information processing program according to the present invention. [Modes for carrying out the invention]

[0018] The following describes preferred embodiments for carrying out the present invention. The embodiments described below are examples of typical embodiments of the present invention and should not be interpreted as narrowing the scope of the present invention.

[0019] Unless otherwise specified, in drawings, "up" means the upper direction or upper side in the drawing, "down" means the lower direction or lower side in the drawing, "left" means the left direction or left side in the drawing, and "right" means the right direction or right side in the drawing. In addition, identical or equivalent elements or components are denoted by the same reference numeral in the drawings, and redundant explanations are omitted.

[0020] The explanation will be given in the following order. 1. Outline of the present invention 2. First Embodiment (Example 1 of Information Processing Device) 3. Second Embodiment (Example 2 of Information Processing Device) 4. Third Embodiment (Example 3 of Information Processing Device) 5. Fourth Embodiment (Example 4 of Information Processing Device) 6. Fifth Embodiment (Example 5 of Information Processing Device) 7. Sixth Embodiment (Example 6 of Information Processing Device)

[0021] <1. Overview of the Invention> First, I will explain the outline of the present invention.

[0022] This will be explained using Figure 1. Figure 1 is a diagram showing an example configuration of an information processing system using the information processing device according to the present invention.

[0023] As shown in Figure 1, the information processing system 4 comprises an information processing device 1 and a 3D model data generation device 2. The information processing device 1 and the 3D model data generation device 2 are connected to each other via a network 3 (communication network), such as the Internet or a telephone network.

[0024] In Figure 1, only one information processing device 1 is shown, but this is for convenience only; there may be multiple information processing devices 1. Similarly, in Figure 1, only one 3D model data generation device 2 is shown, but this is also for convenience only; there may be multiple 3D model data generation devices 2.

[0025] The information processing device will be explained using Figures 2 to 4.

[0026] Figure 2 is a block diagram showing a functional configuration example of the information processing device according to the present invention, Figure 3 is a block diagram showing a functional configuration example of the automatic content conversion unit for viewing provided in the information processing device according to the present invention, and Figure 4 is a block diagram showing an electrical configuration example of the information processing device according to the present invention.

[0027] As shown in Figure 2, the information processing device 1 comprises a 3D model data acquisition unit 10, a 3D model data storage unit 20, an automatic content conversion unit 30 for viewing, and a content playback unit 40 for viewing. However, the information processing device 1 may include the 3D model data acquisition unit 10, the 3D model data storage unit 20, and the automatic content conversion unit 30, but may not include the content playback unit 40 for viewing.

[0028] The 3D model data acquisition unit 10 acquires 3D model data of the building. The 3D model data storage unit 20 stores the 3D model data of the building acquired by the 3D model data acquisition unit 10 in the cloud. The automatic conversion unit 30 for viewing content automatically converts the 3D model data of the building stored by the 3D model data storage unit 20 into content for viewing the building. The viewing content playback unit 40 plays the viewing content that has been automatically converted by the automatic conversion unit 30 for viewing content.

[0029] Here, "content for viewing" in this specification is a concept that includes information about the interior of a building for viewing (e.g., the interior of a house), information about the exterior of a building for viewing (the building's shape), and information about the exterior of a building for viewing (e.g., gardens, balconies, etc. surrounding the house).

[0030] As shown in Figure 3, the automatic content conversion unit 30 for viewing includes an automatic lighting processing unit 31, an automatic floor plan generation unit 32, an automatic movement point setting unit 33, a thumbnail image generation unit 34, an area discrimination unit 35, and an automatic 3D model data optimization processing unit 36. The automatic content conversion unit 30 for viewing may also include at least one of the automatic lighting processing unit 31, the automatic floor plan generation unit 32, the automatic movement point setting unit 33, the thumbnail image generation unit 34, the area discrimination unit 35, and the automatic 3D model data optimization processing unit 36.

[0031] As shown in Figure 4, the information processing device 1 is configured as a computer (server) that performs information processing. The information processing device 1 includes a CPU (Central Processing Unit) 210, which is the main control unit that manages the operation of the entire information processing device 1; a ROM (Read Only Memory) 220 in which various programs and data are pre-stored; a RAM (Random Access Memory) 230 used as a work area when the CPU 210 executes various programs; and an HDD (Hard Disk Drive) 240 and an SSD (Solid State Drive) 241 as storage means for storing various programs and data. The information processing device 1 may also include either an HDD (Hard Disk Drive) 240 or an SSD (Solid State Drive) 241 as a storage device (storage unit).

[0032] Furthermore, the information processing device 1 includes an input unit 250 consisting of a keyboard and mouse, etc., which accepts input for various operations; a display unit 260, such as a liquid crystal display device, which displays various images; and a communication unit 270 connected to the 3D model data generation device 2 via the network 3, which transmits and receives various data with the 3D model data generation device 2.

[0033] In the information processing device 1, the CPU 210, ROM 220, RAM 230, HDD 240, SSD 241, input unit 250, display unit 260, and communication unit 270 are electrically connected to each other via the system bus 209. Therefore, in the information processing device 1, the CPU 210 can access the ROM 220, RAM 230, and HDD 240, understand the operation status of the input unit 250, display images on the display unit 260, and send and receive various types of data with the 3D model data generation device 2 via the communication unit 270.

[0034] The information processing device 1 performs predetermined processing by, for example, loading programs stored in the ROM 220, HDD 240, and / or SSD 241 into the RAM 230, and executing the programs loaded into the RAM 230 using the CPU 210. Specifically, the information processing device 1 performs information processing by loading information processing programs stored in the ROM 220, HDD 240, and / or SSD 241 into the RAM 230, and executing the information processing programs loaded into the RAM 230 using the CPU 210, thereby realizing the functions of the 3D model data acquisition unit 10, the 3D model data storage unit 20, the automatic conversion unit for viewing content 30, and the playback unit for viewing content 40. Furthermore, the functions of the automatic lighting processing unit 31, the automatic plan view generation unit 32, the automatic movement point setting unit 33, the thumbnail image generation unit 34, the area determination unit 35, and the automatic 3D model data optimization processing unit 36 ​​are also realized.

[0035] Next, we will explain the information processing program using Figures 15 and 16.

[0036] Figure 15 is a block diagram showing an example of the functional configuration of an information processing program according to the present invention, and Figure 16 is an information processing program according to the present invention This block diagram shows a functional configuration example of the automatic content conversion module for virtual tours that Ram provides.

[0037] As shown in Figure 15, the information processing program 1P comprises a main module 1500M, a 3D model data acquisition module 10M, a 3D model data storage module 20M, an automatic content conversion module for viewing 30M, and a content playback module for viewing 40M. However, the information processing program 1P may also comprise the main module 1500M, the 3D model data acquisition module 10M, the 3D model data storage module 20M, and the automatic content conversion module 30M, without including the content playback module 40M.

[0038] When the main module 1500M is executed, the server (for example, the information processing device 100) can be centrally controlled. Then, when the 3D model data acquisition module 10M is executed, the function of the 3D model data acquisition means is realized, when the 3D model data storage module 20M is executed, the function of the 3D model data storage means is realized, when the automatic conversion module 30M for viewing content is executed, the function of the automatic conversion module for viewing content is realized, and when the viewing content playback module 40M is executed, the function of the viewing content playback means is realized.

[0039] As shown in Figure 16, the automatic content conversion module 30M for viewing includes an automatic lighting processing module 31M, an automatic floor plan generation module 32M, an automatic movement point setting module 33M, a thumbnail image generation module 34M, an area discrimination module 35M, and an automatic 3D model data optimization processing module 36M. The automatic content conversion module 30M for viewing may also include at least one of the automatic lighting processing module 31M, the automatic floor plan generation module 32M, the automatic movement point setting module 33M, the thumbnail image generation module 34M, the area discrimination module 35M, and the automatic 3D model data optimization processing module 36M.

[0040] As described above, the function of the automatic content conversion means for viewing is realized when the automatic content conversion module 30M for viewing is executed. Specifically, the function of the automatic lighting processing means is realized when the automatic lighting processing module 31M is executed, the function of the automatic floor plan generation means is realized when the automatic floor plan generation module 32M is executed, the function of the automatic movement point setting means is realized when the automatic movement point setting module 33M is executed, the function of the thumbnail image generation means is realized when the thumbnail image generation module 34M is executed, the function of the area discrimination means is realized when the area discrimination module 35M is executed, and the function of the automatic 3D model data optimization processing means is realized when the automatic 3D model data optimization processing module 36M is executed.

[0041] The outline of the present invention will be explained in more detail.

[0042] This will be explained using Figures 5 and 6. Figure 5 is a diagram showing an example of a 3D model of a building, and Figure 6 is a diagram showing an example of content for viewing the interior of a building using the information processing device according to the present invention.

[0043] The 3D model 51 of the building (house) shown on screen 50 in Figure 5 has not undergone any automated processing and has simply been imported. The 3D model 51 is a collection of material information including its shape (including size) and color, as well as surface texture images, and the 3D model 51 can be viewed from any direction (rotating around). For example, viewers that allow you to import and view 3D model data files such as FBX format exported from 3DCAD software using cloud web applications or installed software have existed for a long time. From icon 51-1 shown on screen 50-1, you can upload the 3D model 51 of the building (house) and view the interior of the 3D model 51 of the building (inside the house) using mouse operations and zoom in-out.

[0044] The virtual tour content (or virtual viewing content; the same applies hereinafter) shown in Figure 6 was created by applying the present invention and automatically processing it as a web application.

[0045] As indicated by reference numeral 61, an automatic lighting processing unit 31, which automatically processes the lighting of a building (house), can be used to illuminate the entire interior of the building (house) and to represent shadows. As indicated by reference numeral 62, a floor plan can be created using an automatic floor plan generation unit 32, which automatically generates a floor plan of the building.

[0046] As indicated by reference numerals 63 and 64, a movement point automatic setting unit 33 that automatically sets movement points in a building, and a thumbnail image generation unit 34 that generates thumbnail images of the movement points automatically set by the movement point automatic setting unit 33, can be used to display thumbnail images corresponding to movement points at the bottom of the screen 60 of the interior viewing content.

[0047] The embodiments of the present invention will be described below in a specific and detailed manner.

[0048] <2. First Embodiment (Example 1 of Information Processing Device)> An information processing device of the first embodiment (Example 1 of the information processing device) according to the present invention will be described with reference to Figure 7.

[0049] Figure 7 is a diagram illustrating the automatic writing process using the information processing apparatus of the first embodiment (Example 1 of the information processing apparatus) according to the present invention.

[0050] (Explanation from the perspective of the necessity (purpose) of automated writing processing) Typical viewers lack shadows, resulting in an unrealistic appearance. Furthermore, there are times when you want to brighten the surface of specific objects that make up the overall model (for example, a cluster of desks). This solution involves appropriately placing light sources within a room to create a realistic representation of the interior.

[0051] (Explanation from a technical standpoint regarding automated writing processing) A light source (e.g., sunlight) is placed far outside, and areas where light enters without obstructing walls or other obstacles are illuminated. In addition, the brightness inside the house (70) is quantified at eye level (e.g., the pillars indicated by reference numeral 72 in Figure 7), and light sources (71) are automatically and appropriately placed above areas with low brightness. The brightness is then quantitatively calculated, and the placement of light sources (71) is repeated until the entire area has natural lighting, and shadows are also calculated. With this method, strictly speaking, it is not necessary to place light sources (71) where there are existing lighting fixtures; image recognition can be used to place light sources (71) where there are existing lights. From the perspective of computation time, the former approach can primarily visualize naturally bright interiors and shadows.

[0052] Within a building (for example, the interior of a house 70), the height of a column (for example, the column indicated by reference numeral 72 in Figure 7) that calculates the brightness state at regular intervals visualizes the amount of light. Low-light areas are identified, and a virtual light source 71 is placed in a natural location. Note that the taller the column (for example, the column indicated by reference numeral 72 in Figure 7), the greater the amount of light in the room.

[0053] The contents described above regarding the first embodiment of the present invention (Example 1 of the information processing device) can be applied to the second to sixth embodiments of the present invention described later, unless there are any particular technical inconsistencies.

[0054] <3. Second Embodiment (Example 2 of Information Processing Device)> A second embodiment of the present invention (Example 2 of the information processing device) will be described using Figures 8 to 10.

[0055] Figures 8 to 10 are diagrams illustrating the automatic creation of plan views by applying the information processing device of the second embodiment (Example 2 of the information processing device) according to the present invention.

[0056] (Explanation from the perspective of the necessity (purpose) of automatic floor plan generation) By creating floor plans (the floor plan indicated by reference numeral 900 in Figure 9 and the floor plan indicated by reference numeral 1000 in Figure 10), the layout and the current location during the viewing can be clearly shown, making for an easy-to-understand viewing experience. Furthermore, a comfortable viewing experience is possible by specifying the location to move to (or want to move to) from the floor plan (the floor plan indicated by reference numeral 900 in Figure 9 and the floor plan indicated by reference numeral 1000 in Figure 10) (specified by the movement point 1001 and viewpoint 1002 at the movement point shown in Figure 10). Displaying movement point 1001 allows for a viewing experience of the building from viewpoint 1002.

[0057] (Explanation from a technical standpoint regarding automatic floor plan generation) Within the residential model 90, light is virtually projected around from the eye level of a person standing at eye level using a light source 91, and collisions are confirmed to determine the enclosed space of the building (residential model 90), i.e., a room. The area within that room is arranged in a grid on a plane (grid arrangement shown by reference numeral 80 in Figure 8) to detect the area between the room and the building. The area outside the building will not be shown in the floor plan. The floor surface can also be grasped in a similar manner, and the floor level (1F, 2F, etc.) is identified, and the surface visible from near the ceiling of the floor down to the floor height is cut out as a floor plan. This allows the floor surface and furniture above it to be represented in the floor plan. Alternatively, from what can be seen from a certain point, walls and floors can be identified from images using artificial intelligence processing by the AI ​​processing unit to grasp rooms, etc., and thereby improve accuracy. The AI ​​processing unit may be provided in the automatic content conversion unit for virtual tours.

[0058] The contents described above regarding the second embodiment of the present invention (Example 2 of the information processing device) can be applied to the first embodiment of the present invention described above and the third to sixth embodiments of the present invention described later, unless there are any particular technical inconsistencies.

[0059] <4. Third Embodiment (Example 3 of Information Processing Device)> A third embodiment of the present invention (Example 3 of the information processing device) will be described with reference to Figure 11.

[0060] Figure 11 is a diagram illustrating the automatic setting of a moving point by applying the information processing device of the third embodiment (Example 3 of the information processing device) according to the present invention.

[0061] (Explanation from the perspective of the necessity (purpose) of automatically setting movement points) Automatic setting of movement points is a crucial element for easily navigating between rooms in a building (e.g., a house). It is necessary to enable movement to specific locations based on their representation on the floor plan, their appearance from that point, or the scene name.

[0062] (Explanation from a technical standpoint regarding the automatic setting of movement points) As shown in floor plan 1000 in Figure 10, once a room in a building has been identified, several lines (for example, lines indicated by reference numerals 1104, 1107, and 1111) can be drawn from the wall on a horizontal plane within that room (the room (interior) of the building indicated by reference numeral 1100), and the intersections of these lines can be set as candidate movement points. Line 1104 (horizontal line of the interior 1100 of the building) is the line connecting the end point 1102 near the door and the end point 1103 at the back of the interior 1100 of the building from the door; Line 1107 (horizontal line of the interior 1100 of the building) is the line connecting the end point 1105 near the door and the end point 1106 at the back of the interior 1100 of the building from the door; and Line 1111 (vertical line of the interior 1100 of the building) is the line connecting the end point 1109 near the door and the end point 1110 at the back of the interior 1100 of the building from the door.

[0063] As shown in Figure 11, for example, a movement point 1108 is placed near a door on line 1107, which is longer than the length of line 1104. Similarly, for example, a movement point 1112 is placed near a door on line 1111, which is longer than the length of line 1104. Movement points 1108 and 1112 each set movement points that make the interior 1100 of the building appear wider. In the case of a large room, a distant intersection (for example, the intersection of line 1107 and line 1111) may also be selected as a movement point. Movement can be performed by moving from one movement point to the other, but smooth walk-through movement is also possible.

[0064] The contents described above regarding the third embodiment of the present invention (Example 3 of the information processing device) can be applied to the first and second embodiments of the present invention described above and the fourth to sixth embodiments of the present invention described later, unless there are any particular technical inconsistencies.

[0065] <5. Fourth Embodiment (Example 4 of Information Processing Device)> A fourth embodiment of the present invention (Example 4 of the information processing apparatus) will be described using Figures 12 to 13.

[0066] Figures 12 and 13 illustrate automatic collision detection using the information processing apparatus of the fourth embodiment (Example 4 of the information processing apparatus) according to the present invention.

[0067] (Explanation from the perspective of the necessity (purpose) of automatic collision detection) Walls and floors can be bumped into, doors can disappear (or be assumed not to exist), or you can pass through them, making a natural virtual tour (or virtual viewing) possible.

[0068] (Explanation from a technical standpoint regarding automatic collision detection) One approach is to use image recognition to determine whether an object is a wall or floor, or a door, window, staircase, or other object, and then automatically decide whether to collide with or pass through it. Alternatively, an approach that simply determines what kind of surface an object is is also used.

[0069] As shown in Figure 12, in the interior 1200 of the building, horizontal boundary lines of vertical surfaces (boundary lines 1204, 1205, and 1206) are detected, and the length of connected lines (lines that share a start or end point) is examined. If both of the two connected lines have a length of 0.35m or more, and the angle between the lines is between 45° and 135°, then it is determined that those lines belong to a mesh that constitutes a wall. Reference numeral 1201 is a light source that virtually emits light, and reference numerals 1202 and 1203 are columns on which the brightness state is calculated at regular intervals, with the taller the column, the greater the amount of light.

[0070] In the interior 1300 of the building, the horizontal boundary lines 1303 and 1304 of the door are connected to the horizontal boundary line 1302 of the door frame (the boundary line indicated by arrow 1306 in Figure 13) via vertex 1305, sometimes forming a 90° angle. However, because the length (width) of the horizontal boundary line 1302 of the door frame is narrower than 0.35m, it is not misidentified as a wall.

[0071] Furthermore, for floors, detection is performed under the condition that the dot product of the weighted average of the surface normals (weighted by the area of ​​each triangle) of all the triangles constituting the floor mesh and the normal vector pointing straight up is approximately 1. In this way, several pieces of information such as the boundaries, length, direction, position, and image recognition of the mesh (the surface shape of the 3D shape) are combined to automatically determine whether a collision should occur. The system also handles stairs and enables smooth movement over stairs.

[0072] The contents described above regarding the fourth embodiment of the present invention (Example 4 of the information processing device) can be applied to the first to third embodiments of the present invention described above and the fifth to sixth embodiments of the present invention described later, unless there are any particular technical inconsistencies.

[0073] <6. Fifth Embodiment (Example 5 of Information Processing Device)> A fifth embodiment of the present invention (Example 5 of the information processing device) will be described with reference to Figure 14.

[0074] Figure 14 is a diagram illustrating the automatic weight reduction process by applying the information processing device of the fifth embodiment (Example 5 of the information processing device) according to the present invention.

[0075] (Explanation from the perspective of the necessity (purpose) of automated weight reduction processing) To ensure that 3D models are smoothly displayed in a web browser and that users can enjoy a virtual tour (visit experience), optimizing the data size is crucial.

[0076] (Explanation from a technical standpoint of automated weight reduction processing) In 3D models, meshes (surface shape models) of the same material are sometimes divided. Combining these divided meshes into a single mesh is effective for reducing file size, and the benefits of integrating floors and walls into one are significant. The system automatically and appropriately integrates these parts of the model to reduce file size.

[0077] In Figure 14, a mesh 1401 is created in which all the walls in the interior 1400 of the building, which were previously divided into separate room meshes, have been merged into a single mesh.

[0078] The contents described above regarding the fifth embodiment of the present invention (Example 5 of the information processing device) can be applied to the first to fourth embodiments of the present invention described above and the sixth embodiment of the present invention described later, unless there are any particular technical inconsistencies.

[0079] <7. Sixth Embodiment (Example 6 of Information Processing Device)> A sixth embodiment of the present invention (Example 6 of the information processing apparatus) will be described.

[0080] (Explanation from the perspective of the necessity (purpose) of automatic thumbnail image creation and automatic scene name creation) It's necessary to make it clear what kind of place each travel point is.

[0081] (Explanation from a technical standpoint regarding automatic thumbnail image creation and automatic scene name creation) At the movement point shown in Figure 11, the camera is positioned at approximately eye level (1.6m from the floor) and slightly downwards, looking in the direction of the user's line of sight. The image captured from this point, focusing on the area with greater depth, is then generated as a thumbnail. The scene name is then automatically determined and labeled using image recognition. The scene name may also be estimated using an AI processing unit based on an AI estimation mechanism (learning model) that utilizes predetermined data as training data.

[0082] The contents described above regarding the sixth embodiment of the present invention (Example 6 of the information processing device) can be applied to the first to fifth embodiments of the present invention described above, unless there are any particular technical inconsistencies.

[0083] It should be noted that the present invention is not limited to the embodiments described above, and various modifications are possible without departing from the spirit of the invention.

[0084] The present invention can take the following configuration. [1] A 3D model data acquisition unit that acquires 3D model data of buildings, A 3D model data storage unit stores the 3D model data of the building acquired by the 3D model data acquisition unit on the cloud, An information processing device comprising: an automatic conversion unit for viewing content that automatically converts 3D model data of a building stored in the 3D model data storage unit into content for viewing the building.

[0085] [2] The information processing apparatus according to [1], further comprising a viewing content playback unit for playing back the viewing content that has been automatically converted by the viewing content automatic conversion unit.

[0086] [3] The information processing apparatus according to [1] or [2], wherein the automatic content conversion unit for viewing the interior is equipped with an automatic lighting processing unit that automatically processes the lighting of the building.

[0087] [4] The information processing device according to any one of [1] to [3], wherein the automatic content conversion unit for viewing the interior is further equipped with an automatic floor plan generation unit that automatically generates a floor plan of the building.

[0088] [5] The information processing device according to any one of [1] to [4], wherein the automatic content conversion unit for viewing the interior is further equipped with an automatic movement point setting unit that automatically sets movement points in the building.

[0089] [6] The information processing apparatus according to [5], wherein the automatic content conversion unit for viewing the content comprises a thumbnail image generation unit that generates a thumbnail image (a thumbnail image based on the display of the movement points) that displays the movement points that have been automatically set by the automatic movement point setting unit.

[0090] [7] The information processing device according to any one of [1] to [6], wherein the automatic content conversion unit for viewing the interior is further equipped with an area determination unit that determines collision areas and non-collision areas in the building.

[0091] [8] The information processing apparatus according to any one of [1] to [7], wherein the automatic conversion unit for viewing content includes an automatic 3D model data optimization processing unit that automatically optimizes the 3D model data of the building by integrating several substantially identical materials in the building into one to create a single mesh.

[0092] [9] Computers, A means for acquiring 3D model data of a building, A 3D model data storage means that stores the 3D model data of the building acquired by the 3D model data acquisition means on the cloud, An information processing program that functions as an automatic conversion means for viewing content, which automatically converts 3D model data of a building stored in the 3D model data storage means into content for viewing the building. [Explanation of Symbols]

[0093] 1. Information processing device, 1P... Information processing program, 2. 3D model data generation device, 3. Network, 4. Information processing systems, 10. 3D model data acquisition unit, 10M...3D model data acquisition module, 20. 3D model data storage unit, 20M...3D model data storage module, 30. Automatic content conversion unit for viewing, 30M... Automatic content conversion module for virtual tours, 31. Automatic lighting processing unit, 31M...Automatic lighting processing module, 32...Automatic floor plan generation unit, 32M...Automatic floor plan generation module, 33. Automatic movement point setting unit, 33M... Automatic movement point setting module, 34. Thumbnail image generation unit, 34M...Thumbnail image generation module, 35...area determination unit, 35M... Area detection module, 36. Automatic optimization processing unit for 3D model data. 36M...Automatic 3D model data optimization processing module, 209...System bath, 210...CPU, 220...ROM, 230...RAM, 240...HDD, 241...SSD 250... Input section, 260...display section, 270... Communications Department, 1500M... Main module.

Claims

1. A 3D model data acquisition unit that acquires 3D model data of buildings, A 3D model data storage unit stores the 3D model data of the building acquired by the 3D model data acquisition unit on the cloud, An information processing device comprising: an automatic viewing content conversion unit that automatically converts the 3D model data of the building stored in the 3D model data storage unit into viewing content for the building.

2. The information processing apparatus according to claim 1, further comprising a preview content playback unit for playing back the preview content that has been automatically converted by the preview content automatic conversion unit.

3. The information processing apparatus according to claim 1 or 2, wherein the automatic content conversion unit for viewing the interior includes an automatic lighting processing unit that automatically processes the lighting of the building.

4. The information processing apparatus according to claim 1 or 2, wherein the automatic content conversion unit for viewing the interior includes an automatic floor plan generation unit that automatically generates a floor plan of the building.

5. The information processing apparatus according to claim 1 or 2, wherein the automatic content conversion unit for viewing the interior includes an automatic movement point setting unit that automatically sets movement points in the building.

6. The information processing apparatus according to claim 5, wherein the automatic content conversion unit for viewing the content comprises a thumbnail image generation unit that generates a thumbnail image displaying the movement points that have been automatically set by the automatic movement point setting unit.

7. The information processing apparatus according to claim 1 or 2, wherein the automatic content conversion unit for viewing the interior includes a region determination unit that determines collision areas and non-collision areas in the building.

8. The information processing apparatus according to claim 1 or 2, wherein the automatic content conversion unit for viewing the interior includes an automatic 3D model data optimization processing unit that automatically optimizes the 3D model data of the building by integrating a plurality of substantially identical materials in the building into one to create a single mesh.

9. Computers, A means for acquiring 3D model data of a building, A 3D model data storage means that stores the 3D model data of the building acquired by the 3D model data acquisition means on the cloud, An information processing program that functions as an automatic conversion means for viewing content, which automatically converts 3D model data of a building stored in the 3D model data storage means into content for viewing the building.

Images