Input / output device, information processing device, input / output method, program, and information processing system

Abstract

This ensures that areas within a mesh model composed of multiple polygons that do not require backface hiding are not rendered invisible. [Solution] The system includes a reception unit that accepts the selection of a selection region, which is at least a portion of the multiple regions included in a mesh model composed of multiple polygons, and a display control unit that displays a display screen in which the selection region accepted by the reception unit is visible only from one side of the polygon and not visible from the other side of the polygon, and the unselected regions, which are regions not accepted by the reception unit, are visible.

Description

Technical Field

[0001] The present invention relates to an input / output device, an information processing device, an input / output method, a program, and an information processing system.

Background Art

[0002] Patent Document 1 describes a system for displaying a three-dimensional map that three-dimensionally represents a building or the like, in which an overhead shadow wall polygon is made visible only from the back side and invisible (appears transparent) from the front side. Such a display method is hereinafter referred to as "non-display of the back side".

Summary of the Invention

Problems to be Solved by the Invention

[0003] However, according to the conventional technology, among a plurality of regions included in a mesh composed of a plurality of polygons, if there is an error in the setting of the front and back sides in a region where non-display of the back side is unnecessary, some polygons may become invisible. Thus, when invisible polygons occur in a region where non-display of the back side is unnecessary, there is a problem that it takes time to individually change (correct) the error in the polygon setting.

[0004] The present invention has been made in view of the above, and an object thereof is to prevent a region where non-display of the back side is unnecessary from being made invisible among a plurality of regions included in a mesh composed of a plurality of polygons.

Means for Solving the Problems

[0005] The input / output device according to the present invention includes a reception unit that accepts the selection of a selection region, which is at least a portion of a plurality of regions included in a mesh model composed of a plurality of polygons, and a display control unit that displays a display screen in which the selection region accepted by the reception unit is visible only from one side of the polygon and not visible from the other side of the polygon, and the unselected region, which is a region not accepted by the reception unit, is visible. [Effects of the Invention]

[0006] According to the present invention, among the multiple regions included in a mesh composed of multiple polygons, regions where backface hiding is unnecessary can be prevented from becoming invisible. [Brief explanation of the drawing]

[0007] [Figure 1] Figure 1 is an overall diagram of a point cloud processing system equipped with an input / output device according to the first embodiment. [Figure 2] Figure 2 is a hardware configuration diagram of a terminal device according to the first embodiment. [Figure 3] Figure 3 is a functional block diagram of a terminal device according to the first embodiment. [Figure 4] Figure 4 shows an example of a mesh display of the structural frame and its internal objects. [Figure 5] Figure 5 shows an example of the display of the mesh editing tool. [Figure 6] Figure 6 shows an example of a screen for selecting the area to be hidden on the back side. [Figure 7] Figure 7 is a flowchart showing an example of a data processing procedure according to the first embodiment. [Figure 8] Figure 8 is a flowchart showing an example of a data processing procedure according to the second embodiment. [Figure 9] Figure 9 shows an example of how the results of the region classification are displayed. [Modes for carrying out the invention]

[0008] The following describes in detail embodiments of the input / output device, information processing device, input / output method, program, and information processing system with reference to the attached drawings.

[0009] In industries such as civil engineering and construction, the adoption of BIM (Building Information Modeling) and CIM (Construction Information Modeling) is progressing with the aim of addressing issues such as the declining birthrate and aging population, and improving labor productivity.

[0010] BIM is a solution for utilizing a database of buildings—which is a digital model of a three-dimensional building created on a computer (hereinafter referred to as a 3D model) with attribute data such as cost, finishes, and management information—in all stages of construction, from design and construction to maintenance and management.

[0011] CIM is a solution for the civil engineering sector (including infrastructure in general, such as roads, power, gas, and water) that was proposed following the example of BIM, which was being developed in the building sector. Similar to BIM, it is being pursued to improve the efficiency and sophistication of the entire construction production system by sharing information among stakeholders, primarily using 3D models.

[0012] A key aspect of promoting BIM / CIM implementation is how to easily acquire 3D information about objects such as buildings and public facilities. Here, 3D information refers to three-dimensional point clouds (sometimes simply called point clouds) that contain distance information to the object, obtained by measuring the object with a laser scanner (hereinafter referred to as LS), as well as mesh models and 3D-CAD (Computer-Aided Design) models generated from point cloud data representing these three-dimensional points.

[0013] Here, a mesh model is a model that represents an object using a mesh composed of multiple polygons. To display color on the mesh, data such as RGB representing the color can be mapped to predetermined positions on the mesh. Meshes are generated by transforming point cloud data into a mesh using mesh generation processes such as the Ball Pivoting algorithm or the Marching Cubes algorithm.

[0014] When constructing a structure from scratch, it's relatively easy to implement BIM / CIM because the finished product can be designed from the ground up using BIM / CIM software. On the other hand, with existing buildings, the original design drawings may not exist, or the current state may differ from the original drawings due to renovations over time, raising the bar for BIM / CIM implementation. BIM implementation of such existing buildings is sometimes called As-Build BIM, and it is an important issue for promoting future BIM / CIM adoption.

[0015] One way to realize As-Build BIM is through a workflow that involves spatial measurement using the aforementioned LS (LaserScan) and creating a 3D-CAD model from the measured point cloud data. Traditionally, this work has been done using methods such as taking photographs or using measuring tapes, or by sketching by hand. However, depending on the size of the space, the presence or absence of installed objects, and its complexity (such as the intricate arrangement of piping), this can result in significant work costs. Therefore, introducing an LS that can acquire 3D information of the space is attracting attention as a promising way to solve this problem.

[0016] While As-Build using LS has made it easier to acquire 3D information, it creates a new task of point cloud processing, which was not present in conventional work. Typical point cloud processing involves "multi-point measurement using LS," "generation of an integrated point cloud by aligning each point cloud," "removal of unnecessary point clouds such as noise," and "mesh generation processing."

[0017] When displaying the mesh generated by the mesh generation process on a display or the like, a display method called the dollhouse view is used. The dollhouse view is a display such as viewing a three-dimensional model of the entire frame structure of a building or the like from an overhead perspective. Also, in the dollhouse view, by not rendering (making invisible and transparent) the surfaces of the walls and ceiling on the front side of the viewpoint, objects such as desks and chairs arranged in the internal space of the frame structure can be made visible. Backface Culling is used. The dollhouse view is particularly useful for buildings with multiple floors, as it allows the user to intuitively grasp the general shape, making it an easy-to-understand display for the user. Also, backface culling is a display method in which, for example, when viewing the mesh from the backside viewpoint, it is not rendered and made invisible (backside invisible).

[0018] When displaying a mesh using backface culling, the front and back (front and back) of each polygon constituting the mesh are set. For example, the front is the surface to be rendered (made visible), and the back is the surface not to be rendered (made invisible). In this case, the polygon is visible only from the surface that is set as the front, and is invisible from the surface that is set as the back (objects on the other side of the polygon as seen from the viewpoint are visible).

[0019] Hereafter, the front surface of the polygon will be simply referred to as "front" and the back surface as "back". Note that the back of the polygon may be made visible and the front made invisible. In the following description, it is assumed that the front is visible and the back is invisible.

[0020] The setting of the front and back of the polygon plays an important role when displaying the mesh. For example, the meshes of the walls, ceiling, and floor are set such that the inner surfaces of the room are all the front, and the meshes of the objects (desks and chairs) inside the room are set such that all the surfaces are the front. With such a setting, a dollhouse view can be realized that allows the user to view the inside of the frame structure while being a display from a viewpoint outside the frame structure.

[0021] When a mesh is generated and the front and back of each polygon are set, if an error occurs in the setting, problems will occur in the display of back-face culling. For example, for a part of the polygon that constitutes the mesh of a wall, if the outer surface of the room is set to the front, in the dollhouse view, that polygon will be rendered and become opaque, and objects (internal objects) such as desks and chairs placed inside the room may become invisible. On the other hand, for a part of the polygon that constitutes the mesh of a desk, if the surface of the desk is set to the back, that polygon may not be rendered and may be visually recognized as having a hole.

[0022] When the front and back of a polygon are set incorrectly, the user has to check the displayed mesh and correct the settings of individual polygons, which is time-consuming and laborious.

[0023] In view of the above problems, an object of the present invention is to create a mesh that can be displayed naturally with a small amount of work even when the front and back of a polygon are set incorrectly.

[0024] (The first embodiment) FIG. 1 is an overall configuration diagram of a point cloud processing system including an input / output device according to the first embodiment. The point cloud processing system 1 of the present embodiment is constructed by a terminal device 3 and a management server 5.

[0025] The terminal device 3 is an example of an input / output device. The management server 5 is an example of a point cloud processing device that executes one or more point cloud processes on point cloud data indicating a three-dimensional point cloud.

[0026] Here, a three-dimensional point cloud is a collection of coordinate points in the X, Y, and Z directions corresponding to measurement points on the surface of an object when the space in which the object is located is measured using a laser scanner (LS), etc. Each coordinate point is denoted, for example, (1, 3, 5). Color information may also be attached to each coordinate point, and the RGB values ​​of each coordinate point may be attached as color information. A three-dimensional point cloud is sometimes called a point cloud. Point cloud data is data that can be handled by a computer, etc., as a collection of coordinate points in a virtual three-dimensional space.

[0027] The above example shows how to measure a three-dimensional point cloud using a laser scanner (LS), but three-dimensional point clouds can also be measured using other optical or mechanical measurement methods. Other optical measurement methods include using a stereo camera or Visual SLAM (Simultaneous Localization and Mapping).

[0028] Terminal device 3 and management server 5 can communicate via communication network 100. Communication network 100 is constructed using the Internet, mobile communication networks, LAN (Local Area Network), etc. Communication network 100 may include not only wired communication but also wireless communication networks such as 3G (3rd Generation), WiMAX (Worldwide interoperability for Microwave Access), LTE (Long Term Evolution), and 5G (5th Generation). In addition, terminal device 3 can communicate using short-range communication technologies such as NFC (Near Field Communication) (registered trademark).

[0029] <Hardware Configuration> Figure 2 is a hardware configuration diagram of the terminal device 3 according to the first embodiment.

[0030] Terminal device 3 includes a CPU (Central Processing Unit) 301, ROM (Read Only Memory) 302, RAM (Random Access Memory) 303, HD (Hard Disk) 304, HDD (Hard Disk Drive) 305, recording media 306, media I / F 307, display 308, network I / F 309, keyboard 311, mouse 312, CD-RW (Compact Disc-Rewritable) drive 314, and bus line 310.

[0031] Of these, the CPU 301 controls the operation of the entire terminal device 3. The ROM 302 stores the program used to drive the CPU 301. The RAM 303 is used as the work area for the CPU 301. The HD 304 stores various data such as programs. The HDD 305 controls the reading or writing of various data to the HD 304 according to the control of the CPU 301. The media I / F 307 controls the reading or writing (storage) of data to the recording media 306, such as flash memory. The display 308 displays various information such as cursors, menus, windows, characters, or images. The network I / F 309 is an interface for data communication using the communication network 100. The keyboard 311 is a type of input means equipped with multiple keys for inputting characters, numbers, and various instructions. The mouse 312 is a type of input means for selecting and executing various instructions, selecting processing targets, moving the cursor, etc. The CD-RW drive 314 controls the reading or writing of various data to the CD-RW 313, which is an example of a removable recording medium. Terminal device 3 may also be configured to control the reading or writing (storage) of data to or from an external PC (Personal Computer) or external device connected via wired or wireless means such as Wi-Fi (Wireless Fidelity).

[0032] The CD-RW drive 314 may be replaced with a CD-R drive or the like. Furthermore, the terminal device 3 and the management server 5 may each be constructed using a single computer, or they may be constructed using multiple computers, each arbitrarily assigned to a different component (function, means, or storage unit).

[0033] <Functional Configuration of Terminal Devices> Figure 3 is a functional block diagram of the terminal device 3 according to the first embodiment.

[0034] As shown in Figure 3, the terminal device 3 includes a transmitting / receiving unit 31, a receiving unit 32, a processing unit 33, a display control unit 34, and a storage / reading unit 39. Each of these units is a function or means of functioning, realized by any of the components shown in Figure 2 operating according to instructions from the CPU 301 that follow a program deployed from the HD 304 onto the RAM 303. The terminal device 3 also has a storage unit 3000 constructed from the RAM 303 and HD 304 shown in Figure 2.

[0035] (Functional configuration of each terminal device) Next, we will describe each component of terminal device 3.

[0036] The transmitting / receiving unit 31 is an example of a receiving unit and is implemented by commands from the CPU 301 shown in Figure 2, as well as the network I / F 309, and transmits and receives various data (or information) with other terminals, devices, or systems via the communication network 100.

[0037] The reception unit 32 is mainly implemented by commands from the CPU 301 shown in Figure 2, as well as the keyboard 311 and mouse 312, and accepts various inputs from the user.

[0038] The processing unit 33 is implemented by instructions from the CPU 301 shown in Figure 2 and performs various processes, including mesh generation and polygon display method modification. Furthermore, if there is an error in the polygon front / back setting, the processing unit 33 corrects the setting correctly upon user instruction. The mesh data processed in this embodiment may be either a mesh generated by the management server 5 and received by the transmission / reception unit 31, or a mesh generated by the processing unit 33 by converting point cloud data received from the management server 5.

[0039] The display control unit 34 is implemented by instructions from the CPU 301 shown in Figure 2, and causes the display screen (various images and screens) to be displayed on the display unit, which is an example of a display unit, the display 308. The display control unit 34 causes the display screen on the display 308 to display a mesh according to the polygon display method and the setting of the front and back sides of the polygons.

[0040] Furthermore, the display control unit 34 has a screen generation unit 341, which generates a display screen to be shown on the display 308 based on various inputs received by the reception unit 32. The screen generation unit 341 generates a display screen in which a mesh is displayed according to the polygon display method and the setting of the front and back sides of the polygons. Here, the device including the reception unit 32 and the screen generation unit 341 is an example of an information processing device.

[0041] The display control unit 34 may, in place of the display 308, or together with the display 308, cause the display screen generated by the screen generation unit 341 to be displayed on a display device connected from outside the terminal device 3. In this case, the system including the screen generation unit 341 and the display device is an example of an information processing system.

[0042] The storage / reading unit 39 is an example of a storage control means and is executed by instructions from the CPU 301 shown in Figure 2, as well as by the HDD 305, media I / F 307, CD-RW drive 314, and external PCs or external devices. It performs processing to store various data in the storage unit 3000, recording media 306, CD-RW 313, and external PCs or external devices, and to read various data from the storage unit 3000, recording media 306, CD-RW 313, and external PCs or external devices.

[0043] (Operation of the terminal device) First, we will explain the effect of the front / back setting of polygons that make up the mesh on the display, and the causes of errors in the front / back setting. Figure 4 shows an example of the mesh display of a structural frame and its internal objects. Figure 4(a) shows an example where the front / back setting of polygons is correct, and Figure 4(b) shows an example where the front / back setting of polygons is incorrect.

[0044] Figure 4(a) shows a dollhouse view of the mesh containing room 600 and objects 620 (desk set of desk, chair, and monitor) placed inside, viewed from the upper right. In this example, the front and back settings of each polygon are correct, and the front wall and ceiling of room 600 disappear (become transparent), making the floor and objects 620 placed on the floor visible.

[0045] Figure 4(b) shows that some of the polygons making up walls 601-604 and ceiling 605 of room 600 have incorrect front / back settings, resulting in problems such as areas that should be transparent being visible, and conversely, areas that should be visible becoming invisible and appearing as holes. Additionally, some of the polygons making up object 620 have incorrect front / back settings, making the area 621, indicated by the dashed line, invisible.

[0046] Errors in setting the front and back of polygons occur because the mesh generation algorithm is not perfect. For example, in the ball pivot algorithm described above, a mesh is constructed by connecting vertices within a certain range that come into contact with the ball as it rolls across the surface of the point cloud. In this algorithm, the front and back of polygons are set locally, making it prone to errors in setting the front and back.

[0047] Next, the operation of the terminal device 3 in this embodiment will be described.

[0048] If there is an error in the front and back of a polygon, the user needs to correct the settings using a mesh editing tool. In this embodiment, the user selects the polygon with the error and performs the process of flipping the front and back of the polygon.

[0049] Figure 5 shows an example of the mesh editing tool display. As shown in Figure 5, the front and back settings of walls 603 and 604 and ceiling 605 of room 600 are displayed with diagonal lines and a mesh pattern. Here, the polygons that make up the areas indicated by diagonal lines (area 603A of wall 603, area 604A of wall 604, and area 605A of ceiling 605) are set to the front, and the polygons that make up the areas indicated by the mesh (area 604B of wall 604 and area 605B of ceiling 605) are set to the back.

[0050] In Figure 5, in order to see the interior of room 600, the outer surfaces of walls 603 and 604 and ceiling 605 must all be set to the back. The user can achieve the intended display by using a mesh editing tool to modify the polygon settings of regions 603A, 604A, and 605A to the back.

[0051] Settings can be modified on an individual polygon basis or in groups of multiple polygons. Structural elements such as walls, ceilings, and floors have relatively simple shapes, making modification easy. However, internal objects often have irregular shapes, requiring considerable effort to modify. Therefore, in this embodiment, it is possible to select areas to hide the back surface, as shown below.

[0052] Figure 6 shows an example of a screen for selecting an area to be hidden on the back surface. The display control unit 34 in Figure 3 displays the display screen 1000 shown in Figure 6 on the display 308. The display screen 1000 includes an area selection area 1200. The area selection area 1200 also includes an area name area 1210, a checkbox area 1220, and an execution button 1230.

[0053] Area Name Area 1210 lists the names of areas such as walls and ceilings included in the mesh, and Checkbox Area 1220 displays checkboxes corresponding to each area.

[0054] Furthermore, the display control unit 34 displays a pointer 1240, such as a mouse 312, on the display screen 1000 for checking each checkbox. The user operates the pointer 1240 to check the checkboxes corresponding to the areas to be hidden on the back surface, and selects the areas to be hidden on the back surface.

[0055] When the user clicks the checkbox with the pointer 1240, the display control unit 34 displays a checkmark or similar indicator in the checkbox. Also, when the user clicks the execute button 1230, the reception unit 32 in Figure 3 accepts the operation to select the area to be hidden on the back surface.

[0056] The display control unit 34 may also display the mesh editing tool shown in Figure 5 and the area selection area 1200 side by side on the display screen 1000.

[0057] When the display control unit 34 receives the above selection operation, it hides the selected area (selected area) on the back side (that is, it makes the selected area visible only from the face set as the front of the polygon and invisible from the face set as the back). On the other hand, the display control unit 34 displays the areas that have not been selected (unselected areas) in a way that makes them visible from any face of the polygon (normal display).

[0058] Figure 7 is a flowchart showing an example of a data processing procedure according to the first embodiment. First, the processing unit 33 performs segmentation, which divides the point cloud data received from the management server 5 into regions, and region classification, which classifies each region into walls, ceilings, floors, etc. (step S10).

[0059] Next, the processing unit 33 generates a mesh for each region from the point cloud through a mesh generation process, and the display control unit 34 displays the mesh on the display 308 in dollhouse view according to the front and back settings of each polygon (step S11).

[0060] The user checks the mesh display and, if necessary, selects the area to hide the back face if the front and back faces of the polygon need to be changed (modified) (step S12). Specifically, the display control unit 34 displays a display screen 1000 as shown in Figure 6, and the reception unit 32 receives the user's operation to select the area to hide the back face.

[0061] When an area to be hidden on the back surface is selected, the processing unit 33 divides the selected area into segments (step S13). The division of the selected area is performed, for example, by a process called segmentation. The user changes the front and back of the polygon for each segment obtained by the division (step S14).

[0062] Once the front / back change is complete, the storage / reading unit 39 saves the modified mesh data to the storage unit 3000 or the like. At this time, by saving information on area classification and whether or not an area is selected, the selected area can be displayed with only the back side hidden during subsequent displays.

[0063] In the above example, we described how to convert point cloud data received from the management server 5 into a mesh. However, it is also possible to receive mesh data that has already been region-classified from the management server 5. In that case, the processing unit 33 may omit steps S10 and S11 in Figure 7 and start data processing from step S12.

[0064] In this embodiment, internal objects are displayed normally even if the front and back of the mesh are not oriented in the same way as the actual object, thus suppressing the problem of them disappearing from the screen (becoming transparent). Furthermore, since time-consuming mesh modifications of internal objects are not required, it is possible to construct a mesh model that can be displayed well while keeping the overall development time down.

[0065] Thus, according to this embodiment, by not selecting areas where backface hiding is unnecessary (for example, areas of internal objects), the problem of the mesh disappearing (becoming transparent) from the screen even if the front and back of the mesh differ from the actual orientation is suppressed. In other words, among the multiple areas included in a mesh composed of multiple polygons, areas where backface hiding is unnecessary can be made visible. Furthermore, since the front and back of polygons can be corrected by selecting the area of ​​the structural frame, even if there is an error in the front and back setting for internal objects, the problem of the erroneous part disappearing from the display can be prevented without having to perform time-consuming area correction work. Since time-consuming correction work for internal objects is unnecessary, it becomes possible to construct a mesh model that can be displayed well in dollhouse view while keeping the overall work time down.

[0066] (Second Embodiment) In the second embodiment, areas where backface hiding is unnecessary (for example, areas of internal objects) are made visible regardless of whether backface hiding is performed or not by applying a different mesh generation process to the selected area. In the following description of the second embodiment, the parts that overlap with the first embodiment will be omitted, and the parts that differ from the first embodiment will be described.

[0067] Figure 8 is a flowchart showing an example of a data processing procedure according to the second embodiment. The differences from the first embodiment are that a region to be hidden on the backface is selected before generating a mesh from the point cloud, and different mesh generation processes are used for the selected region and the other regions. The processes in steps S20, S24, and S25 in Figure 8 are the same as S10, S13, and S14 in Figure 7, respectively, so their explanation is omitted.

[0068] The display control unit 34 displays the area classification results and the area selection area 1200, and the reception unit 32 accepts the user's operation to select an area to be hidden on the back side (step S21).

[0069] Figure 9 shows an example of how the results of the area classification are displayed. As shown in Figure 9, the walls 601-604, the ceiling 605, the floor 606, and the object 620 are each displayed with different patterns. The display control unit 34 may also display the area classification results as shown in Figure 9 and the area selection area 1200 side by side on the display screen 1000 in Figure 6.

[0070] The processing unit 33 generates a mesh from the point cloud of the selected region by a first mesh generation process (step S22). The processing unit 33 also generates a mesh from the point cloud of the non-selected region by a second mesh generation process different from the first mesh generation process (step S23). For example, the first mesh generation process is a ball pivot algorithm, and the second mesh generation process is a marching cube algorithm.

[0071] The ball pivot algorithm generates a mesh on the surface of the point cloud, so each polygon can have both its front and back faces rendered. In contrast, the marching cube algorithm transforms the voxels, each of which is a vertex of the point cloud, into a mesh. This generates a mesh that encloses the point cloud, and each polygon can only have its outer face rendered.

[0072] As a result, meshes generated in non-selected areas will always be visible, regardless of whether backfaces are hidden or normally displayed, because the backfaces of each polygon will be hidden from any viewpoint. In other words, the mesh will always be visible as long as there are no other obstacles between the viewpoint and the mesh.

[0073] In this embodiment, by selecting the structural frame as the area, and then, after generating a mesh and correcting the front and back sides of the selected area, displaying the entire area with the back side hidden in the dollhouse view, the walls and ceiling in the foreground disappear, allowing the interior to be seen, while objects in the unselected areas remain visible. In other words, a good dollhouse view like that shown in Figure 4(a) can be obtained.

[0074] The memory / reading unit 39 saves the mesh data after data processing is complete to the memory unit 3000 or the like. At this time, it is not necessary to save information on region classification or whether a region is selected or not. This is because meshes of objects that do not require backface hiding are generated with the backfaces of each polygon hidden, so a good dollhouse view can be obtained by hiding the backfaces of all regions in subsequent displays.

[0075] Thus, according to this embodiment, it is possible to select a region of the structural frame and generate a mesh of the unselected region with its back surface hidden. This ensures that among the multiple regions included in a mesh composed of multiple polygons, regions where back surface hiding is unnecessary (for example, regions of internal objects) remain visible. Since time-consuming modification work on internal objects is unnecessary, it becomes possible to construct a mesh model that displays well in dollhouse view while reducing the overall workload.

[0076] The programs executed by the input / output devices and information processing devices of each embodiment described above are provided as installable or executable files recorded on computer-readable recording media such as CD-ROMs, flexible disks (FDs), CD-Rs, and DVDs (Digital Versatile Disks).

[0077] Furthermore, the programs executed by the input / output devices and information processing devices of each embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Alternatively, the programs executed by the input / output devices and information processing devices of each embodiment may be provided or distributed via a network such as the Internet.

[0078] Furthermore, the programs for each embodiment may be pre-installed and provided in a ROM or the like.

[0079] The programs executed in the input / output devices and information processing devices of each embodiment are configured as modules including the above-described parts (transmit / receive unit 31, receiving unit 32, processing unit 33, display control unit 34, etc.). In actual hardware, the CPU (processor) reads the program from the recording medium and executes it, thereby loading the above-described parts onto the main memory and generating the programs.

[0080] Each function of the embodiments described above can be realized by one or more processing circuits. Hereinafter, "processing circuit" as used herein includes processors programmed to execute each function by software, such as processors implemented by electronic circuits, as well as devices such as ASICs (Application Specific Integrated Circuits), DSPs (Digital Signal Processors), FPGAs (Field Programmable Gate Arrays), and conventional circuit modules designed to execute each function described above.

[0081] Furthermore, the apparatus described in each embodiment represents only one of several computing environments for carrying out each embodiment disclosed herein.

[0082] In one embodiment, the management server 5 includes multiple computing devices, such as a server cluster. These computing devices are configured to communicate with each other via any type of communication link, including networks and shared memory, and perform the processing disclosed herein. Similarly, the terminal device 3 may include multiple computing devices configured to communicate with each other.

[0083] Although the present invention has been described above based on various embodiments, the present invention is not limited to the requirements shown in the above embodiments. These points can be modified as long as they do not impair the spirit of the present invention, and can be appropriately determined according to their application.

[0084] Examples of the present invention are as follows: <1> A receiving unit that accepts the selection of a selection region, which is at least a portion of the multiple regions included in a mesh composed of multiple polygons, A display control unit displays a display screen that makes the selected area, which has been selected by the reception unit, visible from only one side of the polygon and not visible from the other side of the polygon, and makes the unselected area, which is an area not selected by the reception unit, visible. This is an input / output device characterized by having the following features: <2> The display control unit makes the non-selected area visible from either the front or back side of the polygon. <1> This is the input / output device described in [reference]. <3> The display control unit, For the selected region, the mesh generated from the point cloud by the first mesh generation process is displayed. For the non-selected region, the mesh generated from the point cloud by a second mesh generation process different from the first mesh generation process is displayed. <1> This is the input / output device described in [reference]. <4> The receiving unit receives an instruction to change the front and back sides of the polygon for the selected area. The display control unit displays the selected area in which the front and back sides of the polygon have been changed based on the instruction. <1> ~ <3> It is an input / output device as described in any one of the following. <5> The selected region is the region corresponding to the structural body. <1> ~ <4> It is an input / output device as described in any one of the following. <6> The non-selected region is the region corresponding to an object placed in the internal space of the structural body. <5> This is the input / output device described in [reference]. <7> The first mesh generation process described above is a process that generates a mesh based on a ball pivot algorithm, The second mesh generation process is a process that generates a mesh based on the marching cube algorithm. <3> This is the input / output device described in [reference]. <8> A receiving unit that accepts the selection of a selection region, which is at least a portion of the multiple regions included in a mesh model composed of multiple polygons, A screen generation unit generates a display screen that makes the selected area, which has been selected by the reception unit, visible only from one side of the polygon and not visible from the other side of the polygon, and makes the unselected area, which is an area not selected by the reception unit, visible. This is an information processing device characterized by having the following features. <9> An input / output method performed by an input / output device, A receiving process that accepts the selection of a selection region, which is at least a portion of the multiple regions included in a mesh model composed of multiple polygons, A display control step that displays a display screen in which the selected area, for which a selection was accepted in the acceptance step, is made visible from only one side of the polygon and not visible from the other side of the polygon, and the unselected area, for which a selection was not accepted in the acceptance step, is made visible. This is an input / output method characterized by including [a specific feature]. <10> Computer A receiving means for accepting the selection of a selected region, which is at least a portion of the multiple regions included in a mesh model composed of multiple polygons, A display control means that displays a display screen in which the selected region, which has been selected by the reception means, is visible from only one side of the polygon and not visible from the other side of the polygon, and the unselected region, which is a region not selected by the reception means, is visible. This program is characterized by its ability to function as such. <11> The aforementioned <8> The information processing device described above, A display device that displays a display screen generated by the aforementioned information processing device, It is an information processing system equipped with [the following features]. [Explanation of symbols]

[0085] 1. Point cloud processing system 3 Terminal devices 5. Management Server 32 Reception Department 33 Processing Unit 34 Display Control Unit 39 Memory / readout section 100 Communication Networks 308 displays 311 keyboard 312 mice 1000 display screen 1200 area selection area [Prior art documents] [Patent Documents]

[0086] [Patent Document 1] Patent No. 5883818

Claims

1. A receiving unit that accepts the selection of a selection region, which is at least a portion of the multiple regions included in a mesh composed of multiple polygons, A display control unit displays a display screen that makes the selected area, which has been selected by the reception unit, visible from only one side of the polygon and not visible from the other side of the polygon, and makes the unselected area, which is an area not selected by the reception unit, visible. An input / output device characterized by comprising the following features.

2. The input / output device according to claim 1, wherein the display control unit makes the non-selected area visible from either the front or back surface of the polygon.

3. The display control unit, For the selected region, the mesh generated from the point cloud by the first mesh generation process is displayed. The input / output device according to claim 1, which displays a mesh generated from a point cloud by a second mesh generation process different from the first mesh generation process for the non-selected region.

4. The receiving unit receives an instruction to change the front and back sides of the polygon for the selected area. The input / output device according to claim 2 or 3, wherein the display control unit displays the selected region in which the front and back sides of the polygon have been changed based on the instruction.

5. The input / output device according to claim 2 or 3, wherein the selected region is a region corresponding to the chassis structure.

6. The input / output device according to claim 5, wherein the non-selected region is a region corresponding to an object arranged in the internal space of the structural body.

7. The first mesh generation process is a process that generates a mesh based on a ball pivot algorithm, The input / output device according to claim 3, wherein the second mesh generation process is a process of generating a mesh based on a marching cube algorithm.

8. A receiving unit that accepts the selection of a selection region, which is at least a portion of the multiple regions included in a mesh model composed of multiple polygons, A screen generation unit generates a display screen that makes the selected area, which has been selected by the reception unit, visible only from one side of the polygon and not visible from the other side of the polygon, and makes the unselected area, which is an area not selected by the reception unit, visible. An information processing device characterized by comprising:

9. An input / output method performed by an input / output device, A receiving process that accepts the selection of a selection region, which is at least a portion of the multiple regions included in a mesh model composed of multiple polygons, A display control step that displays a display screen in which the selected area, for which a selection was accepted in the acceptance step, is made visible from only one side of the polygon and not visible from the other side of the polygon, and the unselected area, for which a selection was not accepted in the acceptance step, is made visible. An input / output method characterized by including the following.

10. Computer A receiving means for accepting the selection of a selected region, which is at least a portion of the multiple regions included in a mesh model composed of multiple polygons, A display control means that displays a display screen in which the selected region, which has been selected by the reception means, is visible from only one side of the polygon and not visible from the other side of the polygon, and the unselected region, which is a region not selected by the reception means, is visible. A program characterized by being designed to function as such.

11. The information processing apparatus according to claim 8, A display device that displays a display screen generated by the aforementioned information processing device, An information processing system equipped with the following features.

Images