Information processing device and information processing program

Abstract

To provide an information processing device that can realize further efficiency in allowing a third party to obtain information (information for viewing / inspection) on the inside of a building (for example, the interior of a house), information (information for viewing / inspection) on the exterior of the building, and information (information for viewing / inspection) on the outside of the building (for example, a garden, balcony, etc. arranged around the exterior of a house). [Solution] The present invention provides an information processing device comprising: a 3D model data acquisition unit that acquires 3D model data of a building; a 3D model data storage unit that stores the 3D model data of the building acquired by the 3D model data acquisition unit on the cloud; and an automatic interior viewing content conversion unit that automatically converts the 3D model data of the building stored by the 3D model data storage unit into interior viewing content of the building.

Description

[Technical Field]

[0001] The present invention relates to an information processing device and an information processing program. [Background technology]

[0002] There is known a technology for digitizing a three-dimensional model (3D model) of a building to allow a third party to obtain information about the interior of the building (information obtained through viewings) (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2024-142688 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology proposed in Patent Document 1 may not be able to further improve the efficiency of allowing third parties to obtain information about the inside of a building (for example, the interior of a house, etc.) (information for viewings), information about the exterior (shape) of the building (information for viewings), and information about the outside of the building (for example, a garden, balcony, etc. located around the outside of a house) (information for viewings).

[0005] The present invention has been made in consideration of the above circumstances, and its main purpose is to provide an information processing device and an information processing program that can achieve greater efficiency in allowing third parties to obtain information about the inside of a building (for example, the interior of a house, etc.) (information for viewing), information about the exterior (shape) of the building (information for viewing), and information about the outside of the building (for example, a garden, balcony, etc. located around the exterior of a house) (information for viewing). [Means for solving the problem]

[0006] As a result of intensive research conducted by the inventors to achieve the above-mentioned objectives, they have succeeded in developing an information processing device and an information processing program that can achieve greater efficiency in allowing third parties to obtain information about the inside of a building (for example, the interior of a house, etc.) (information for viewing), information about the exterior (shape) of the building (information for viewing), and information about the outside of the building (for example, a garden, balcony, etc. located around the exterior of a house) (information for viewing), thereby completing the present invention.

[0007] That is, in a first aspect, the present invention provides: a 3D model data acquisition unit that acquires 3D model data of a building; a 3D model data storage unit that stores the 3D model data of the building acquired by the 3D model data acquisition unit on a cloud; The information processing device includes an automatic interior viewing content conversion unit that automatically converts the 3D model data of the building stored in the 3D model data storage unit into interior viewing content of the building.

[0008] An information processing device according to a first aspect of the present invention includes: The system may further include a preview content playback unit that plays back the preview content that has been automatically converted by the preview content automatic conversion unit.

[0009] In the information processing device according to the first aspect of the present invention, The preview content automatic conversion unit may include an automatic lighting processing unit that automatically processes the lighting of the building.

[0010] In the information processing device according to the first aspect of the present invention, The preview content automatic conversion unit may include an automatic floor plan generation unit that automatically generates a floor plan of the building.

[0011] In the information processing device according to the first aspect of the present invention, The preview content automatic conversion unit may include an automatic movement point setting unit that automatically sets movement points in the building.

[0012] In the information processing device according to the first aspect of the present invention, The preview content automatic conversion unit may include a thumbnail image generation unit that generates a thumbnail image that displays the travel point that has been automatically set by the travel point automatic setting unit.

[0013] In the information processing device according to the first aspect of the present invention, The preview content automatic conversion unit may include an area discrimination unit that discriminates between a collision area and a non-collision area in the building.

[0014] In the information processing device according to the first aspect of the present invention, The automatic conversion unit for preview content may include a 3D model data automatic lightweighting processing unit that automatically lightweights the 3D model data of the building by integrating multiple substantially identical materials in the building into one to create a single mesh.

[0015] In addition, in the present invention, as a second aspect, Computer, a 3D model data acquisition means for acquiring 3D model data of a building; a 3D model data storage means for storing the 3D model data of the building acquired by the 3D model data acquisition means on a cloud; An information processing program is provided that functions as an automatic preview content conversion means that automatically converts the 3D model data of the building stored by the 3D model data storage means into preview content of the building. [Effects of the Invention]

[0016] According to the present invention, it is possible to realize further efficiency improvements in allowing third parties to obtain information (information for viewing) about the inside of a building (for example, the interior of a house), information (information for viewing) about the exterior (shape) of the building, and information (information for viewing) about the outside of the building (for example, a garden, balcony, etc. located around the exterior of a house). Note that the effects described here are not necessarily limited to those described herein and may be any of the effects described in this specification. [Brief explanation of the drawings]

[0017] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of an information processing system using an information processing device according to the present invention. [Figure 2] FIG. 2 is a block diagram showing an example of the functional configuration of an information processing device according to the present invention. [Figure 3] FIG. 3 is a block diagram showing an example of the functional configuration of the preview content automatic conversion unit included in the information processing device according to the present invention. [Figure 4] FIG. 4 is a block diagram showing an example of the electrical configuration of an information processing device according to the present invention. [Figure 5] FIG. 5 is a diagram illustrating an example of a 3D model of a building. [Figure 6] FIG. 6 is a diagram showing an example of contents for viewing a building to which the information processing device according to the present invention is applied. [Figure 7] FIG. 7 is a diagram for explaining automatic lighting processing by applying the information processing device according to the first embodiment of the present invention. [Figure 8] FIG. 8 is a diagram for explaining automatic creation of a floor plan by applying an information processing device according to the second embodiment of the present invention. [Figure 9] FIG. 9 is a diagram for explaining automatic creation of a floor plan by applying an information processing device according to the second embodiment of the present invention. [Figure 10] FIG. 10 is a diagram for explaining automatic creation of a floor plan by applying an information processing device according to the second embodiment of the present invention. [Figure 11]FIG. 11 is a diagram for explaining automatic setting of a travel point by applying an information processing device according to the third embodiment of the present invention. [Figure 12] FIG. 12 is a diagram for explaining automatic collision determination by application of an information processing device according to the fourth embodiment of the present invention. [Figure 13] FIG. 13 is a diagram for explaining automatic collision determination by application of an information processing device according to the fourth embodiment of the present invention. [Figure 14] FIG. 14 is a diagram for explaining the automatic weight reduction process by applying the information processing device according to the fifth embodiment of the present invention. [Figure 15] FIG. 15 is a block diagram showing an example of the functional configuration of an information processing program according to the present invention. [Figure 16] FIG. 16 is a block diagram showing an example of the functional configuration of a preview content automatic conversion module included in the information processing program according to the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0018] A preferred embodiment for carrying out the present invention will be described below. The embodiment described below shows an example of a typical embodiment of the present invention, and the scope of the present invention should not be construed as being narrow.

[0019] Unless otherwise specified, in the drawings, "upper" means the upper direction or upper side in the drawing, "lower" means the lower direction or lower side in the drawing, "left" means the left direction or left side in the drawing, and "right" means the right direction or right side in the drawing. Furthermore, in the drawings, the same or equivalent elements or members are given the same reference numerals, and redundant explanations will be omitted.

[0020] The explanation will be given in the following order. 1. Overview of the Invention 2. First Embodiment (Example 1 of Information Processing Device) 3. Second Embodiment (Example 2 of Information Processing Device) 4. Third Embodiment (Example 3 of Information Processing Device) 5. Fourth Embodiment (Example 4 of Information Processing Device) 6. Fifth Embodiment (Example 5 of Information Processing Device) 7. Sixth Embodiment (Example 6 of Information Processing Device)

[0021] <1. Overview of the present invention> First, an outline of the present invention will be described.

[0022] This will be explained with reference to Fig. 1. Fig. 1 is a diagram showing an example of the configuration of an information processing system using an information processing device according to the present invention.

[0023] 1, an information processing system 4 includes an information processing device 1 and a 3D model data generation device 2. The information processing device 1 and the 3D model data generation device 2 are connected to each other via a network 3 (communication network) such as the Internet or a telephone communication network.

[0024] In FIG. 1, only one information processing device 1 is shown, but this is for convenience, and there may be multiple information processing devices 1. Similarly, in FIG. 1, only one 3D model data generation device 2 is shown, but this is also for convenience, and there may be multiple 3D model data generation devices 2.

[0025] The information processing device will be described with reference to FIGS.

[0026] Figure 2 is a block diagram showing an example of the functional configuration of an information processing device according to the present invention, Figure 3 is a block diagram showing an example of the functional configuration of an automatic preview content conversion unit provided in the information processing device according to the present invention, and Figure 4 is a block diagram showing an example of the electrical configuration of the information processing device according to the present invention.

[0027] 2, the information processing device 1 includes a 3D model data acquisition unit 10, a 3D model data storage unit 20, a preview content automatic conversion unit 30, and a preview content playback unit 40. Note that the information processing device 1 may include the 3D model data acquisition unit 10, the 3D model data storage unit 20, and the preview content automatic conversion unit 30, but may not include the preview content playback unit 40.

[0028] The 3D model data acquisition unit 10 acquires 3D model data of the building. The 3D model data storage unit 20 stores the 3D model data of the building acquired by the 3D model data acquisition unit 10 on the cloud. The preview content automatic conversion unit 30 automatically converts the 3D model data of the building stored by the 3D model data storage unit 20 into preview content of the building. The preview content playback unit 40 plays the preview content automatically converted by the preview content automatic conversion unit 30.

[0029] Here, in this specification, the concept of viewing content includes information about the interior of a building for viewing (for example, the interior of a house), information about the exterior of a building for viewing (the building's outer shape), and information about the exterior of a building for viewing (for example, a garden, balcony, etc. located around the exterior of a house).

[0030] 3, the preview content automatic conversion unit 30 includes an automatic lighting processing unit 31, an automatic floor plan generation unit 32, an automatic movement point setting unit 33, a thumbnail image generation unit 34, an area discrimination unit 35, and an automatic 3D model data lightweight processing unit 36. Note that the preview content automatic conversion unit 30 may include at least one of the automatic lighting processing unit 31, the automatic floor plan generation unit 32, the automatic movement point setting unit 33, the thumbnail image generation unit 34, the area discrimination unit 35, and the automatic 3D model data lightweight processing unit 36.

[0031] 4, the information processing device 1 is configured as a computer (server) that executes information processing, and includes a CPU (Central Processing Unit) 210 that is a main control unit that controls the overall operation of the information processing device 1, a ROM (Read Only Memory) 220 in which various programs and various data are pre-stored, a RAM (Random Access Memory) 230 that is used as a work area when the CPU 210 executes various programs, and a HDD (Hard Disk Drive) 240 and an SSD (Solid State Drive) 241 that serve as storage means for storing various programs and various data. Note that the information processing device 1 may include either the HDD (Hard Disk Drive) 240 or the SSD (Solid State Drive) 241 as the storage device (storage unit).

[0032] Furthermore, the information processing device 1 includes an input unit 250 consisting of a keyboard, a mouse, etc., which accepts input for various operations, a display unit 260 such as a liquid crystal display device, which displays various images, and a communication unit 270 which is connected to the 3D model data generation device 2 via the network 3 and sends and receives various data to and from the 3D model data generation device 2.

[0033] In the information processing device 1, the CPU 210, ROM 220, RAM 230, HDD 240, SSD 241, input unit 250, display unit 260, and communication unit 270 are electrically connected to one another via a system bus 209. Therefore, in the information processing device 1, the CPU 210 can access the ROM 220, RAM 230, and HDD 240, grasp the operation status of the input unit 250, display images on the display unit 260, and send and receive various types of data to and from the 3D model data generation device 2 via the communication unit 270.

[0034] The information processing device 1 performs predetermined processing by, for example, loading a program stored in the ROM 220, the HDD 240, and / or the SSD 241 into the RAM 230 and executing the program loaded into the RAM 230 with the CPU 210. Specifically, the information processing device 1 loads a program related to information processing stored in the ROM 220, the HDD 240, and / or the SSD 241 into the RAM 230 and executes the program related to information processing loaded into the RAM 230 with the CPU 210, thereby performing processing related to information processing and realizing the respective functions of the 3D model data acquisition unit 10, the 3D model data storage unit 20, the preview content automatic conversion unit 30, and the preview content playback unit 40, as well as the respective functions of the automatic lighting processing unit 31, the automatic floor plan generation unit 32, the automatic movement point setting unit 33, the thumbnail image generation unit 34, the area determination unit 35, and the automatic 3D model data weight reduction processing unit 36.

[0035] Next, the information processing program will be described with reference to FIGS.

[0036] FIG. 15 is a block diagram showing an example of the functional configuration of the information processing program according to the present invention, and FIG. 16 is a block diagram showing an example of the functional configuration of the information processing program according to the present invention. 10 is a block diagram showing an example of the functional configuration of a preview content automatic conversion module provided in the RAM. FIG.

[0037] 15, the information processing program 1P includes a main module 1500M, a 3D model data acquisition module 10M, a 3D model data storage module 20M, a preview content automatic conversion module 30M, and a preview content playback module 40M. Note that the information processing program 1P may include the main module 1500M, the 3D model data acquisition module 10M, the 3D model data storage module 20M, and the preview content automatic conversion module 30M, but may not include the preview content playback module 40M.

[0038] Execution of the main module 1500M enables centralized control of a server (e.g., information processing device 100). Execution of the 3D model data acquisition module 10M realizes the function of a 3D model data acquisition means, execution of the 3D model data storage module 20M realizes the function of a 3D model data storage means, execution of the preview content automatic conversion module 30M realizes the function of a preview content automatic conversion means, and execution of the preview content playback module 40M realizes the function of a preview content playback means.

[0039] 16, the preview content automatic conversion module 30M includes an automatic lighting processing module 31M, an automatic floor plan generation module 32M, an automatic movement point setting module 33M, a thumbnail image generation module 34M, an area determination module 35M, and an automatic 3D model data lightweight processing module 36M. Note that the preview content automatic conversion module 30M may include at least one of the automatic lighting processing module 31M, the automatic floor plan generation module 32M, the automatic movement point setting module 33M, the thumbnail image generation module 34M, the area determination module 35M, and the automatic 3D model data lightweight processing module 36M.

[0040] As described above, the function of the preview content automatic conversion means is realized by executing the preview content automatic conversion module 30M. Specifically, the function of the lighting automatic processing means is realized by executing the lighting automatic processing module 31M, the function of the floor plan automatic generation module 32M is realized by executing the floor plan automatic generation means, the function of the movement point automatic setting module 33M is realized by executing the movement point automatic setting means, the function of the thumbnail image generation module 34M is realized by executing the thumbnail image generation means, the function of the area discrimination module 35M is realized by executing the area discrimination means, and the function of the 3D model data automatic lightening processing module 36M is realized by executing the 3D model data automatic lightening processing means.

[0041] The outline of the present invention will now be described in more detail.

[0042] This will be explained using Figures 5 and 6. Figure 5 is a diagram showing an example of a 3D model of a building, and Figure 6 is a diagram showing an example of content for viewing a building using an information processing device according to the present invention.

[0043] The 3D model 51 of a building (house) shown on screen 50 in Figure 5 has not been automatically processed and is simply imported. The 3D model 51 is a collection of material information, including shape (including size) and color, and surface texture images, and the 3D model 51 can be viewed from any direction (round and round). For example, viewers that import and view 3D model data files, such as Fbx format files, exported from 3D CAD software using cloud web apps or installed software have long existed. By uploading the 3D model 51 of a building (house) using icon 51-1 shown on screen 50-1, you can view the interior of the 3D model 51 of the building (house) by using the mouse or zooming in and out.

[0044] The preview content (or preview content, the same applies below) shown in FIG. 6 is obtained by applying the present invention and importing it as a web application and automatically processing it.

[0045] As indicated by reference numeral 61, an automatic lighting processing unit 31 that automatically processes the lighting of a building (house) can be used to brighten the entire interior of the building (house) and express shadows. As indicated by reference numeral 62, a floor plan can be created using an automatic floor plan generation unit 32 that automatically generates a floor plan of the building.

[0046] As shown by reference numerals 63 and 64, thumbnail images corresponding to the movement points can be displayed at the bottom of the preview content screen 60 using an automatic movement point setting unit 33 that automatically sets movement points in the building, and a thumbnail image generation unit 34 that generates thumbnail images displaying the movement points automatically set by the automatic movement point setting unit 33.

[0047] Hereinafter, embodiments of the present invention will be described specifically and in detail.

[0048] 2. First Embodiment (Example 1 of Information Processing Device) An information processing device according to a first embodiment (example 1 of information processing device) of the present invention will be described with reference to FIG.

[0049] FIG. 7 is a diagram for explaining automatic lighting processing by applying an information processing device according to the first embodiment (example 1 of information processing device) of the present invention.

[0050] (Explanation from the viewpoint of the necessity (purpose) of automatic writing processing) In a typical viewer, there are no shadows and the image lacks realism. Also, there are cases where you want to brighten the surface of some of the objects that make up the overall model (for example, a block of desk). To address this, you can place light sources appropriately in the room to create a realistic interior appearance.

[0051] (Technical explanation of automatic lighting processing) A light source (e.g., sunlight) is placed far outside, and areas where the light can enter without hitting walls or other obstacles are brightened. Furthermore, the brightness of the interior of a house 70 is quantified at eye level (e.g., the pillar indicated by reference numeral 72 in Figure 7), and light sources 71 are automatically and appropriately placed above areas with low brightness. The brightness is then quantitatively calculated, and the placement of light sources 71 is repeated to create a natural lighting environment throughout the entire area, and shadows and other effects are calculated. With this method, strictly speaking, it is not necessary to place light sources 71 where lighting fixtures are present; image recognition can be used to place light sources 71 in illuminated areas. From the perspective of computation time, the former approach primarily enables visualization of naturally bright interiors and shading such as shadows.

[0052] In a building (for example, the interior of a house 70), the brightness state is calculated at regular intervals, and the height of a pillar (for example, the pillar indicated by reference number 72 in FIG. 7) is used to visualize the amount of light. Low areas are identified and virtual light sources 71 are installed in natural locations. Note that the higher the pillar (for example, the pillar indicated by reference number 72 in FIG. 7), the greater the amount of light in the room.

[0053] The above description of the first embodiment (example 1 of information processing device) according to the present invention can be applied to the second to sixth embodiments of the present invention, which will be described later, unless there is any particular technical contradiction.

[0054] 3. Second Embodiment (Example 2 of Information Processing Device) An information processing device according to a second embodiment (example 2 of information processing device) of the present invention will be described with reference to FIGS. 8 to 10. FIG.

[0055] 8 to 10 are diagrams for explaining automatic creation of a floor plan by applying an information processing device according to the second embodiment (example 2 of information processing device) of the present invention.

[0056] (Explanation from the viewpoint of the necessity (purpose) of automatic floor plan creation) By creating a floor plan (the floor plan indicated by reference numeral 900 in FIG. 9 and the floor plan indicated by reference numeral 1000 in FIG. 10), the floor plan and the current location of the person viewing the property can be displayed there, providing an easy-to-understand viewing experience. Furthermore, a comfortable viewing experience can be achieved by specifying (using a movement point 1001 and a viewpoint 1002 at the movement point shown in FIG. 10) the location to which the person has moved (desired to move) from the floor plan (the floor plan indicated by reference numeral 900 in FIG. 9 and the floor plan indicated by reference numeral 1000 in FIG. 10). By displaying the movement point 1001, the person can experience a viewing of the building from the viewpoint 1002.

[0057] (Explanation from a technical perspective of automatic floor plan creation) A virtual light source 91 illuminates the surrounding area from the eye level of a person standing inside the house model 90, and collisions are confirmed to identify the enclosed space of the building (house model 90), i.e., the room. A grid layout (grid layout indicated by reference numeral 80 in Figure 8) is then created on a plane within the room to detect the area between the room and the building. The area outside the building is not shown on the floor plan. While the floor surface can also be identified in the same way, floors such as the first and second floors are identified, and the surface visible up to floor height is cut out as a plan view from near the ceiling of the floor toward the vertical downward surface. This allows the floor and furniture above it to be represented on the floor plan. In addition to this approach, it is also possible to identify rooms, etc., by image judgment using artificial intelligence processing by an AI processing unit to determine what is visible from a certain point, such as walls and floors, from an image, thereby improving accuracy. The AI ​​processing unit may be included in the automatic content conversion unit for interior viewing.

[0058] The above description of the second embodiment (example 2 of information processing device) of the present invention can be applied to the first embodiment of the present invention described above and the third to sixth embodiments of the present invention described below, unless there is any particular technical contradiction.

[0059] 4. Third Embodiment (Example 3 of Information Processing Device) An information processing device according to a third embodiment (third example of information processing device) of the present invention will be described with reference to FIG.

[0060] FIG. 11 is a diagram for explaining automatic setting of a movement point by applying an information processing device according to the third embodiment (third example of information processing device) of the present invention.

[0061] (Explanation from the viewpoint of the necessity (purpose) of automatically setting movement points) Automatic setting of travel points is an important element for easily navigating rooms in a building (e.g. a house) by being able to navigate to a point based on its representation on the floor plan, its appearance from that point, and the scene name.

[0062] (Technical explanation of automatic setting of movement points) When a room of a building is identified as shown in the floor plan 1000 in Figure 10, within that room (inside the room (interior) of the building indicated by reference number 1100), several lines (for example, lines indicated by reference numbers 1104, 1107, and 1111) can be drawn from the wall on a horizontal plane, and their intersections can be set as candidate movement points. Line 1104 (horizontal line of interior of building 1100) is a line connecting end point 1102, which is a point close to the door, and end point 1103, which is a point at the back of the door of interior of building 1100; line 1107 (horizontal line of interior of building 1100) is a line connecting end point 1105, which is a point close to the door, and end point 1106, which is a point at the back of the door of interior of building 1100; and line 1111 (vertical line of interior of building 1100) is a line connecting end point 1109, which is a point close to the door, and end point 1110, which is a point at the back of the door of interior of building 1100.

[0063] As shown in FIG. 11, for example, movement point 1108 is set near the door of line 1107, which is longer than line 1104. Also, for example, movement point 1112 is set near the door of line 1111, which is longer than line 1104. Movement points 1108 and 1112 are each set to make the interior 1100 of the building appear larger. In the case of a large room, an intersection far from the interior (for example, the intersection of line 1107 and line 1111) may also be selected as a movement point. Note that movement can be performed by movement point, but smooth walk-through movement is also possible.

[0064] The above description of the third embodiment (example 3 of information processing device) of the present invention can be applied to the first and second embodiments of the present invention described above and the fourth to sixth embodiments of the present invention described below, unless there is any particular technical contradiction.

[0065] 5. Fourth Embodiment (Example 4 of Information Processing Device) An information processing device according to a fourth embodiment (example 4 of information processing device) of the present invention will be described with reference to FIGS.

[0066] 12 and 13 are diagrams for explaining automatic collision determination by application of an information processing device according to a fourth embodiment (example 4 of information processing device) of the present invention.

[0067] (Explanation from the viewpoint of the necessity (purpose) of automatic collision detection) Walls and floors collide, doors disappear (you can assume they don't exist), and you can walk through them, allowing for a natural viewing experience (introspection experience).

[0068] (An explanation of automatic collision detection from a technical perspective) One way is to automatically determine whether a wall or floor, door, window, staircase, or other object is hit or passed through by image recognition. Another approach is to simply determine the type of surface.

[0069] 12, in a building interior 1200, horizontal boundaries of vertical surfaces (boundary 1204, boundary 1205, and boundary 1206) are detected, and the lengths of connected lines (lines that share a common start or end point) are checked. If two connected lines are both 0.35 m or longer in length and the angle they form is between 45° and 135°, those lines are determined to belong to a mesh that makes up a wall. Reference numeral 1201 is a virtual light source that emits light, and reference numerals 1202 and 1203 are pillars for which the brightness state is calculated at regular intervals; the higher the pillar, the greater the amount of light.

[0070] In the interior 1300 of a building, the horizontal boundary lines 1303 and 1304 of the door are connected to the horizontal boundary line 1302 of the door frame (the boundary line indicated by arrow 1306 in Figure 13) via vertex 1305, and may form an angle of 90 degrees, but since the length (width) of the horizontal boundary line 1302 of the door frame is narrower than 0.35 m, it is not erroneously determined to be a wall.

[0071] Additionally, floors are detected under the condition that the inner product of the weighted average (weighted by the area of ​​the triangles) of the surface normals of all the triangles that make up the floor mesh and the normal vector pointing directly upward is approximately 1. In this way, the system automatically determines whether a collision is likely by combining several pieces of information such as the boundary line, length, direction, position, and image recognition of the mesh (the surface shape of the 3D shape). It also handles cases including stairs, allowing smooth movement on those stairs.

[0072] The above description of the fourth embodiment (example 4 of information processing device) of the present invention can be applied to the first to third embodiments of the present invention described above and the fifth and sixth embodiments of the present invention described below, unless there is any particular technical contradiction.

[0073] 6. Fifth Embodiment (Example 5 of Information Processing Device) An information processing device according to a fifth embodiment (example 5 of information processing device) of the present invention will be described with reference to FIG.

[0074] FIG. 14 is a diagram for explaining an automatic weight reduction process by applying an information processing device according to the fifth embodiment (example 5 of information processing device) of the present invention.

[0075] (Explanation from the viewpoint of the necessity (purpose) of automatic weight reduction processing) Reducing the data size is extremely important in order to allow the 3D model itself to be displayed smoothly in a web browser and to allow guests to have a viewing experience.

[0076] (Technical explanation of automatic weight reduction process) In 3D models, meshes (surface shape models) of the same material may be divided, and combining them into a single mesh is more effective for reducing weight than dividing them all up. The weight-saving benefits of combining floors, walls, etc. into one are significant, so models in such cases are automatically combined appropriately to reduce weight.

[0077] In FIG. 14, a mesh 1401 is created when all the walls in an interior 1400 of a building that were previously divided into room partitions and meshes are integrated into one.

[0078] The above description of the fifth embodiment (example 5 of information processing device) of the present invention can be applied to the first to fourth embodiments of the present invention described above and the sixth embodiment of the present invention described below, unless there is any particular technical contradiction.

[0079] 7. Sixth Embodiment (Example 6 of Information Processing Device) An information processing device according to the sixth embodiment (sixth example of information processing device) of the present invention will be described.

[0080] (Explanation from the viewpoint of the necessity (purpose) of automatic thumbnail image creation and automatic scene name creation) It is necessary to make it clear where the movement points are.

[0081] (Technical explanation of automatic thumbnail image creation and automatic scene name creation) At the movement point shown in Figure 11, the camera is positioned at a height of about eye level, such as 1.6 m above the floor, and the camera is positioned slightly downwards to capture the depth of field, and a thumbnail is generated. Furthermore, the scene name is automatically determined from the image using image recognition and labeled. The scene name may be estimated using an AI processing unit based on an AI estimation mechanism (learning model) that learns using predetermined data as training data.

[0082] The above description of the sixth embodiment (example 6 of information processing device) of the present invention can be applied to the first to fifth embodiments of the present invention described above, unless there is any particular technical contradiction.

[0083] The present invention is not limited to the above-described embodiment, and various modifications are possible without departing from the spirit of the present invention.

[0084] The present invention can have the following configurations. [1] a 3D model data acquisition unit that acquires 3D model data of a building; a 3D model data storage unit that stores the 3D model data of the building acquired by the 3D model data acquisition unit on a cloud; an automatic interior viewing content conversion unit that automatically converts the 3D model data of the building stored by the 3D model data storage unit into interior viewing content of the building.

[0085] [2] The information processing device according to [1], further comprising a preview content playback unit that plays back the preview content automatically converted by the preview content automatic conversion unit.

[0086] [3] The information processing device according to [1] or [2], wherein the automatic conversion unit for preview content includes an automatic lighting processing unit that automatically processes the lighting of the building.

[0087] [4] The information processing device according to any one of [1] to [3], wherein the automatic conversion unit for preview content includes an automatic floor plan generation unit that automatically generates a floor plan of the building.

[0088] [5] The information processing device according to any one of [1] to [4], wherein the automatic conversion unit for preview content includes an automatic movement point setting unit that automatically sets movement points in the building.

[0089] [6] The information processing device described in [5], wherein the automatic preview content conversion unit is provided with a thumbnail image generation unit that generates a thumbnail image (thumbnail image based on the display of the movement point) that displays the movement point automatically set by the automatic movement point setting unit.

[0090] [7] The information processing device according to any one of [1] to [6], wherein the automatic preview content conversion unit includes an area discrimination unit that discriminates between collision areas and non-collision areas in the building.

[0091] [8] The information processing device described in any one of [1] to [7], wherein the automatic conversion unit for preview content is provided with a 3D model data automatic lightweighting processing unit that automatically lightweights the 3D model data of the building by integrating multiple substantially identical materials in the building into one to create a single mesh.

[0092] [9] Computer, a 3D model data acquisition means for acquiring 3D model data of a building; a 3D model data storage means for storing the 3D model data of the building acquired by the 3D model data acquisition means on a cloud; an information processing program that functions as an automatic interior viewing content conversion means that automatically converts the 3D model data of the building stored by the 3D model data storage means into interior viewing content of the building. [Explanation of symbols]

[0093] 1. Information processing device, 1P: Information processing program, 2. 3D model data generation device, 3. Network, 4. Information processing system, 10. 3D model data acquisition unit, 10M 3D model data acquisition module, 20. 3D model data storage unit, 20M 3D model data storage module, 30. Automatic content conversion unit for previewing, 30M... Automatic content conversion module for preview, 31. Lighting automatic processing unit, 31M···Lighting automatic processing module, 32. Automatic floor plan generation section, 32M···Automatic floor plan generation module, 33. Automatic moving point setting unit, 33M···Movement point automatic setting module, 34. Thumbnail image generation unit, 34M···Thumbnail image generation module, 35...area determination unit, 35M···Area determination module, 36···3D model data automatic weight reduction processing unit, 36M···3D model data automatic weight reduction processing module, 209···System bus, 210···CPU, 220···ROM, 230···RAM, 240···HDD, 241···SSD 250···input section, 260...display section, 270···Communications Department, 1500M···Main module.

Claims

1. a 3D model data acquisition unit that acquires 3D model data of a building; a 3D model data storage unit that stores the 3D model data of the building acquired by the 3D model data acquisition unit on a cloud; an automatic conversion unit for contents for interior viewing that automatically converts the 3D model data of the building stored by the 3D model data storage unit into contents for interior viewing of the building; the automatic conversion unit for preview content includes an area discrimination unit that discriminates between a collision area and a non-collision area in the building; The area discrimination unit, based on image recognition information of an object that is a part of the 3D model data of the building, An information processing device automatically determines whether the location of the object is a location where a collision should occur.

2. A 3D model data acquisition unit that acquires 3D model data of a building; a 3D model data storage unit that stores the 3D model data of the building acquired by the 3D model data acquisition unit on a cloud; an automatic conversion unit for contents for interior viewing that automatically converts the 3D model data of the building stored by the 3D model data storage unit into contents for interior viewing of the building; the automatic conversion unit for preview content includes an area discrimination unit that discriminates between a collision area and a non-collision area in the building; The area discrimination unit detects two connected boundary lines that constitute a mesh, which is the surface shape of the 3D model data of the building, based on whether or not the lengths of the two boundary lines are equal to or greater than a predetermined length and whether or not the angle formed by the two boundary lines is within a predetermined angle range, An information processing device automatically determines whether the location of the mesh is a location where a collision is likely to occur.

3. A 3D model data acquisition unit that acquires 3D model data of a building; a 3D model data storage unit that stores the 3D model data of the building acquired by the 3D model data acquisition unit on a cloud; an automatic conversion unit for contents for interior viewing that automatically converts the 3D model data of the building stored by the 3D model data storage unit into contents for interior viewing of the building; the automatic conversion unit for preview content includes an area discrimination unit that discriminates between a collision area and a non-collision area in the building; the area discrimination unit determines whether the inner product of a weighted average of the surface normals of all triangles constituting a mesh that is the surface shape of the 3D model data of the building, with the area size of the triangle as the weight, and a normal vector pointing directly upward is approximately 1, An information processing device automatically determines whether the location of the mesh is a location where a collision is likely to occur.

4. The information processing device according to claim 1 , further comprising a preview content playback unit that plays back the preview content automatically converted by the preview content automatic conversion unit.

5. The information processing device according to claim 1 , wherein the automatic preview content conversion unit includes an automatic lighting processing unit that automatically processes lighting of the building.

6. The information processing device according to claim 1 , wherein the automatic preview content conversion unit includes an automatic floor plan generation unit that automatically generates a floor plan of the building.

7. The information processing device according to claim 1 , wherein the automatic preview content conversion unit includes an automatic travel point setting unit that automatically sets travel points in the building.

8. The information processing device according to claim 7 , wherein the preview content automatic conversion unit includes a thumbnail image generation unit that generates a thumbnail image that displays the travel point automatically set by the travel point automatic setting unit.

9. 4. The information processing device according to claim 1, wherein the automatic conversion unit for preview content includes a 3D model data automatic lightweighting processing unit that automatically lightweights the 3D model data of the building by integrating multiple substantially identical materials in the building into one to create a single mesh.

10. Computer, 3D model data acquisition means for acquiring 3D model data of a building; a 3D model data storage means for storing the 3D model data of the building acquired by the 3D model data acquisition means on a cloud; and functioning as an automatic conversion means for contents for interior viewing that automatically converts the 3D model data of the building stored by the 3D model data storage means into contents for interior viewing of the building; the automatic conversion means for contents for previewing further functions as an area discrimination means for discriminating between a collision area and a non-collision area in the building; The area discrimination means, based on image recognition information of an object that is a part of the 3D model data of the building, An information processing program that automatically determines whether the location of the object is a location where a collision should occur.

11. A computer, 3D model data acquisition means for acquiring 3D model data of a building; a 3D model data storage means for storing the 3D model data of the building acquired by the 3D model data acquisition means on a cloud; and functioning as an automatic conversion means for contents for interior viewing that automatically converts the 3D model data of the building stored by the 3D model data storage means into contents for interior viewing of the building; the automatic conversion means for contents for previewing further functions as an area discrimination means for discriminating between a collision area and a non-collision area in the building; The area discrimination means detects two connected boundary lines that constitute a mesh, which is the surface shape of the 3D model data of the building; based on whether or not the lengths of the two boundary lines are equal to or greater than a predetermined length and whether or not the angle formed by the two boundary lines is within a predetermined angle range, An information processing program that automatically determines whether the location of the mesh is a location where a collision should occur.

12. A computer, 3D model data acquisition means for acquiring 3D model data of a building; a 3D model data storage means for storing the 3D model data of the building acquired by the 3D model data acquisition means on a cloud; and functioning as an automatic conversion means for contents for interior viewing that automatically converts the 3D model data of the building stored by the 3D model data storage means into contents for interior viewing of the building; the automatic conversion means for contents for previewing further functions as an area discrimination means for discriminating between a collision area and a non-collision area in the building; the area discrimination means determines whether the inner product of a weighted average of the surface normals of all triangles constituting a mesh that is the surface shape of the 3D model data of the building, with the area size of the triangle as the weight, and a normal vector pointing directly upward is approximately 1, An information processing program that automatically determines whether the location of the mesh is a location where a collision should occur.

Images