Information processing device, information processing method, and program

Abstract

This disclosure provides an information processing device that can provide a user with display data at a level of detail appropriate to the user's characteristics. The information processing device comprises a storage unit and a level of detail determination unit. The storage unit stores a fixed-length bit string representing object information about an object represented by three-dimensional data associated with a unit space, for each of a plurality of unit spaces obtained by dividing a virtual three-dimensional space. The object information includes at least attribute information indicating the attributes of the object. Each of the multiple bit fields of the fixed-length bit string is associated with a plurality of different categories. The plurality of categories includes one or more attribute categories relating to the attributes of the object. The level of detail determination unit determines the level of detail of the display data to be output to the user's terminal for each fixed-length bit string, based on job-related information relating to the user's job and the attributes set in the bit fields of the attribute categories in the fixed-length bit string.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] In the high-speed display method of three-dimensional space data described in Patent Document 1, spatial data with multiple levels of detail is created for one three-dimensional object. According to the distance from the viewpoint, data with an appropriate level of detail is selected and displayed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the high-speed display method described in Patent Document 1, only data with a level of detail corresponding to the distance from the viewpoint is displayed. Therefore, the data is not necessarily displayed with a level of detail suitable for the characteristics of the user.

[0005] Therefore, the present disclosure has been made in view of the above problems, and an object thereof is to provide an information processing apparatus, an information processing method, and a program that can provide display data to a user with a level of detail suitable for the characteristics of the user.

Means for Solving the Problems

[0006] According to this disclosure, an information processing device is provided, comprising a storage unit and a detail determination unit, wherein the storage unit stores a fixed-length bit string representing object information relating to an object represented by three-dimensional data associated with a unit space, for each of a plurality of unit spaces obtained by dividing a virtual three-dimensional space, the object information includes at least attribute information indicating the attributes of the object, the fixed-length bit string includes a plurality of bit fields, each of the plurality of bit fields is associated with a plurality of different categories, each of the plurality of categories includes one or more attribute categories relating to the attributes of the object, the bit field associated with the attribute category represents the attributes of the object belonging to the attribute category in binary format, and the detail determination unit determines the level of detail of display data to be output to the user's terminal for each fixed-length bit string, based on job-related information relating to the user's job and the attributes set in the bit fields of the attribute categories.

[0007] According to this disclosure, an information processing method is provided in which a computer uses a fixed-length bit string to represent object information relating to an object represented by three-dimensional data associated with a unit space, for each of a plurality of unit spaces obtained by dividing a virtual three-dimensional space, the object information includes at least attribute information indicating the attributes of the object, the fixed-length bit string includes a plurality of bit fields, each of the plurality of bit fields is associated with a plurality of different categories, each of the plurality of categories includes one or more attribute categories relating to the attributes of the object, the bit field associated with the attribute category represents the attributes of the object belonging to the attribute category in binary format, and the computer determines the level of detail of display data to be output to the user's terminal for each fixed-length bit string, based on job-related information relating to the user's job and the attributes set in the bit field of the attribute category.

[0008] According to this disclosure, a program is provided that causes a computer to use a fixed-length bit string representing object information relating to an object represented by three-dimensional data associated with a unit space, for each of a plurality of unit spaces obtained by dividing a virtual three-dimensional space, wherein the object information includes at least attribute information indicating the attributes of the object, the fixed-length bit string includes a plurality of bit fields, each of the plurality of bit fields is associated with a plurality of different categories, each of the plurality of categories includes one or more attribute categories relating to the attributes of the object, the bit field associated with the attribute category represents the attributes of the object belonging to the attribute category in binary format, and the computer is caused to determine the level of detail of the display data to be output to the user's terminal for each fixed-length bit string, based on job-related information relating to the user's job and the attributes set in the bit field of the attribute category. [Effects of the Invention]

[0009] According to this disclosure, it is possible to provide an information processing device, an information processing method, and a program that can provide display data to a user with a level of detail that matches the user's characteristics. [Brief explanation of the drawing]

[0010] [Figure 1] This figure shows an example of an information processing system according to the embodiments of this disclosure. [Figure 2] This is a perspective view illustrating the hierarchical structure of the unit space according to this embodiment. [Figure 3] This is a block diagram showing an example configuration of the information processing device according to this embodiment. [Figure 4] This is a conceptual diagram showing an example of a fixed-length bit string and a reference bit string according to this embodiment. [Figure 5] This figure shows an example of a set of reference bit sequences for each job type according to this embodiment. [Figure 6] This figure shows an example of a logical operation between a reference bit string and a fixed-length bit string according to this embodiment. [Figure 7]This figure shows an example of how a three-dimensional model is displayed according to the level of detail determined by the level of detail determination unit according to this embodiment. [Figure 8] This figure shows an example of the job-related information setting screen according to this embodiment. [Figure 9] This flowchart shows an example of an information processing method according to the present embodiment. [Modes for carrying out the invention]

[0011] Preferred embodiments of this disclosure will be described in detail below with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant descriptions will be omitted. In this embodiment, a rectangular parallelepiped includes a cube.

[0012] An information processing system SYS according to an embodiment of this disclosure will be described with reference to Figures 1 to 9. Figure 1 is a diagram showing an example of the information processing system SYS according to this embodiment. As shown in Figure 1, the information processing system SYS comprises an information processing device 100 and one or more user terminals 300. The information processing device 100 and the user terminals 300 are connected to a network NW. The information processing device 100 is, for example, a computer such as a server. The network NW is a communication network. The network NW includes, for example, one or more of the Internet, LAN (Local Area Network), wireless communication network, and mobile communication network.

[0013] The information processing device 100 performs processing based on multiple unit spaces obtained by dividing a virtual three-dimensional space into a rectangular grid. The virtual three-dimensional space is, for example, a digital twin space. A digital twin space is a virtual three-dimensional space constructed by reproducing physical objects (e.g., features, etc.) that exist in real space (the real world) within the digital space. The unit space is, for example, a rectangular prism. By recursively dividing the unit space, unit spaces of various sizes (hierarchies) can be defined. The unit space is, for example, a tile or a voxel. The unit space is assigned a spatial address, for example, to uniquely identify the position and hierarchy of the unit space in the virtual space. The spatial address also functions as identification information to uniquely identify the unit space.

[0014] Figure 2 is a perspective view illustrating the hierarchical structure of the unit space according to this embodiment. As shown in Figure 2, for example, the virtual three-dimensional space is hierarchically divided by an octree structure. For each lower hierarchical level, each unit space 10 is divided into two in the XYZ axis direction, resulting in a total of eight unit spaces 11. By recursively repeating the division, unit spaces of hierarchical level 1, hierarchical level 2, hierarchical level 3, ..., hierarchical level N are generated. In this way, a unit space has a hierarchical level in the hierarchical structure. For example, the X and Y axes are parallel to the horizontal direction, and the Z axis is parallel to the vertical direction. N represents an integer of 2 or greater. In this example, a larger number indicating the hierarchical level indicates a smaller unit space VX. Hereafter, regardless of the hierarchical level, the unit space may be collectively referred to as unit space VX. Also, a large hierarchical level may be described as a deep hierarchical level, and a small hierarchical level may be described as a shallow hierarchical level.

[0015] A unique spatial address is assigned to each unit space VX. The spatial address includes, for example, information on the hierarchical level of the unit space VX and information for specifying the position of the unit space VX in the virtual three-dimensional space. The deeper the hierarchical level, the smaller the size of the unit space VX and the higher the spatial resolution. The spatial address indirectly indicates the position of the unit space VX in the virtual three-dimensional space with a spatial resolution corresponding to the hierarchical level. Note that the spatial address is not information directly indicating longitude, latitude, and altitude (height). However, the spatial address can be converted into longitude, latitude, and altitude (height) according to a predetermined rule. That is, the spatial address may be associated with geographical coordinates.

[0016] For example, the spatial address may be composed of a hierarchical level h, an x index and a y index corresponding to the horizontal position, and an index z corresponding to the vertical position. The indexes x, y, and z are indexes for identifying the position in the virtual three-dimensional space corresponding to the unit space VX defined at the hierarchical level h. For example, the index x corresponds to the position of the unit space in the X direction (longitude direction), the index y corresponds to the position of the unit space in the Y direction (latitude direction), and the index z corresponds to the position of the unit space in the Z direction (height direction). The unit space and the spatial address are, respectively, for example, tiles and tile coordinates in the "Implicit Tiling" defined in the "3D Tiles 1.1 Specification" of the OGC (Open Geospatial Consortium).

[0017] Returning to FIG. 1, the user terminal 300 is a terminal device used by the user. The user terminal 300 receives input information from the user and transmits it to the information processing apparatus 100 via the network NW. Also, the user terminal 300 receives and displays output information from the information processing apparatus 100 via the network NW. The user terminal 300 is, for example, a desktop personal computer, a tablet personal computer, a notebook personal computer, or a mobile terminal such as a smartphone. Note that the user terminal 300 includes, for example, a processing unit, an input unit, an output unit, a communication unit, and a storage unit. The hardware configurations of the processing unit, input unit, output unit, communication unit, and storage unit of the user terminal 300 are the same as those of the processing unit 110, input unit 120, output unit 130, communication unit 140, and storage unit 150 of the information processing apparatus 100 in FIG. 3, respectively.

[0018] Next, the information processing apparatus 100 will be described with reference to FIG. 3. FIG. 3 is a block diagram showing a configuration example of the information processing apparatus 100 according to the present embodiment. As shown in FIG. 3, the information processing apparatus 100 includes a processing unit 110, a communication unit 140, and a storage unit 150. The information processing apparatus 100 may include an input unit 120 and an output unit 130.

[0019] The processing unit 110 executes various processes (various operations). The processing unit 110 controls the input unit 120, the output unit 130, the communication unit 140, and the storage unit 150. The processing unit 110 includes one or more processors. The processor is a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), a DSP (Digital Signal Processor), or an ASIC (Application Specific Integrated Circuit). The processor may operate according to a program or may operate according to hard-wired logic. <000009The input unit 120 is an input device for inputting various types of information to the processing unit 110. For example, the input unit 120 may be a keyboard and pointing device, or a touch panel.

[0021] The output unit 130 outputs various types of information. The output unit 130 includes, for example, a display unit that displays various types of information. The display unit is, for example, a liquid crystal display or an organic electroluminescent display.

[0022] The communication unit 140 is connected to a network NW. The communication unit 140 communicates with the user terminal 300 via the network NW. The communication unit 140 is a communication device that performs communication according to a predetermined communication protocol, and includes, for example, a network interface controller. The predetermined communication protocol is, for example, a protocol compliant with Ethernet®, the Internet Protocol Suite, and a protocol compliant with a short-range wireless communication standard. The short-range wireless communication standard is, for example, Wi-Fi® or Bluetooth®.

[0023] The storage unit 150 includes one or more storage devices and stores data and programs. The storage devices of the storage unit 150 include a main memory such as semiconductor memory and an auxiliary storage device such as semiconductor memory and a storage drive. The storage drive is, for example, a hard disk drive or a solid-state drive. The storage unit 150 is, for example, a non-temporary computer-readable storage medium.

[0024] The storage unit 150 stores three-dimensional data 160 representing an object. The storage unit 150 may store multiple three-dimensional data 160. Multiple three-dimensional data may be treated as a single three-dimensional data 160.

[0025] The three-dimensional data 160 is, for example, BIM (Building Information Modeling) data, point cloud data, mesh data, or 3DGS (3D Gaussian Splatting) data. The three-dimensional model of the object is constructed using the three-dimensional data 160. The storage unit 150 stores the three-dimensional data 160 for each object. In this case, the object may be, for example, a single tangible object, multiple tangible objects of different or the same type, or a complex tangible object with unclear boundaries, and is not particularly limited as long as it is a tangible object represented by the three-dimensional data 160. Furthermore, the object in this case may include not only tangible objects that are intentionally represented as three-dimensional data 160, but also tangible objects that are not intentionally represented as three-dimensional data 160 (for example, the physical background).

[0026] For example, the subject is one or more movable or immovable property. The subject is, for example, one or more objects. Typically, the subject is one or more stationary objects. Stationary objects are, for example, artifacts or natural objects. Artifacts are, for example, structures, machinery, electronic equipment, or copyrighted works. Structures are, for example, buildings or infrastructure. Buildings are, for example, office buildings or houses. Infrastructure is equipment for providing social infrastructure. For example, infrastructure is roads, bridges, road traffic facilities, power generation facilities, power transmission facilities, water treatment facilities, or gas distribution facilities. Machinery is, for example, automobiles, work vehicles, trains, aircraft, ships, submarines, or robots. Natural objects are, for example, trees, forests, the ground, cliffs, coastlines, or rivers.

[0027] Here, a three-dimensional model composed of three-dimensional data 160 may occupy multiple unit spaces VX. In this case, the three-dimensional data of the portion of the three-dimensional model contained within unit space VX may be referred to as "three-dimensional data 160A". Three-dimensional data 160A is associated with unit space VX. Specifically, three-dimensional data 160A is associated with the spatial address of unit space VX. For example, by processing the spatial address according to a predetermined rule, the address where three-dimensional data 160 is stored can be calculated. It is also possible that the entire three-dimensional model composed of three-dimensional data 160 is contained within a single unit space VX. In this case, three-dimensional data 160 corresponds to three-dimensional data 160A.

[0028] The memory unit 150 stores a fixed-length bit sequence BS (hereinafter referred to as "fixed-length bit sequence BS") for each of the multiple unit spaces VX obtained by dividing the virtual three-dimensional space, which represents object information about an object represented by the three-dimensional data 160A associated with the unit space VX. In other words, the memory unit 150 stores multiple fixed-length bit sequences BS corresponding to each of the multiple unit spaces VX. Specifically, the memory unit 150 stores the fixed-length bit sequences BS in association with the spatial address of the unit space VX. The fixed-length bit sequence BS is, for example, a structured hash value. Processing can be sped up by using a hash value. Structured means that the fixed-length bit sequence BS is composed of multiple bit fields divided into multiple categories. The categories are divisions defined according to the meaning of the information about the object. The fixed-length bit sequence BS represents object information about an object represented by the three-dimensional data 160A associated with the unit space VX. The object information includes at least attribute information indicating the attributes of the object. Attributes indicate, for example, one or more of the following: visual characteristics, semantic characteristics, and context. Context indicates, for example, the semantic background, situation, environment, or scene of the object. Further details will be provided later.

[0029] The storage unit 150 stores job-related information 170 concerning job types. For example, the storage unit 150 stores job-related information 170 for each job type. Each piece of job-related information 170 includes job type information indicating the job type, and one or more reference bit sequences RB associated with the job type information. The storage unit 150 also stores alternative data 180 that is used as a substitute for the three-dimensional data 160A when displaying the target on the user terminal 300. The alternative data 180 and the reference bit sequences RB will be described later.

[0030] A job title indicates the type of occupation or job. A job title may also include a professional skill. A job title may specify details, such as civil engineer, architect, or electrical equipment engineer, or it may be a general category, such as technical, research, or sales.

[0031] The processing unit 110 includes a detail level determination unit 111. The processing unit 110 may also include an output control unit 112 and / or an information setting unit 113. The processing unit 110 may further include a three-dimensional data generation unit 114. Specifically, the processor of the processing unit 110 functions as the detail level determination unit 111, the output control unit 112, the information setting unit 113, and the three-dimensional data generation unit 114 by executing a program stored in the storage device of the storage unit 150.

[0032] The level of detail determination unit 111 determines the level of detail (LOD: Level of Detail) of the display data to be output to the user terminal 300 for each fixed-length bit sequence BS, based on the job-related information 170 concerning the user's job type and the fixed-length bit sequence BS associated with each unit space VX.

[0033] Figure 4 is a conceptual diagram showing an example of a fixed-length bit sequence BS and a reference bit sequence RB according to this embodiment. As shown in Figure 4, the fixed-length bit sequence BS includes multiple bit fields F. For example, the fixed-length bit sequence BS is 256 bits and the bit fields F are 16 bits each. Note that the number of bits in each bit field F may be different.

[0034] Each of the multiple bit fields F is associated with a different category. Each category includes at least one category relating to the target attribute. In this embodiment, each category includes two or more categories relating to the target attribute. For example, the fixed-length bit string BS includes bit fields F1 to F3 associated with categories relating to the target attribute. Bit fields F1 to F3 represent the target attribute within the categories associated with bit fields F1 to F3 in binary format. Hereinafter, categories relating to the target attribute may be referred to as "attribute categories". Bit fields F4 and F5 will be described later.

[0035] For example, the attributes of an object include one or more of the following: type, state, and characteristics. Multiple categories include one or more of the following as attribute categories: a type category indicating the type of object, a state category indicating the state of the object, and a characteristic category indicating the characteristics of the object.

[0036] The bit field F1 associated with the type category indicates the type of object in binary format. The type of object may indicate, for example, the category of a bridge pier, bridge girder, or tunnel. For example, the type of object may be a structure or a geographical feature. Each type is assigned a unique binary code. For example, the type may be indicated by a 16-bit bit pattern, or the type may be indicated by a flag assigned to each of the 16 bits. Hereafter, bit patterns and flags may be collectively referred to as binary codes. Also, since the type of object may be considered from multiple perspectives, for example, the fixed-length bit sequence BS may include a bit field F1 for each perspective.

[0037] The bit field F2 associated with the state category indicates the state of the object in binary format. The state of the object indicates the condition of the object, for example, cracked, damaged, rusted, or normal. For example, the state may be indicated by a 16-bit bit pattern, or the state may be indicated by a flag assigned to each of the 16 bits. Also, since the state of the object may be captured from multiple perspectives, for example, the fixed-length bit string BS may contain a bit field F2 for each perspective.

[0038] The bit field F3 associated with a characteristic category represents the characteristics of the object in binary format. The characteristics of the object represent the material of the object, such as concrete, steel, wood, or asphalt. For example, the material may be represented by a 16-bit bit pattern, or each of the 16 bits may be assigned a material and the material may be represented by a flag. Furthermore, the characteristics of the object are not limited to material; there may be multiple types of characteristics, such as the shape, pattern, color, surface texture (e.g., smooth, rough, uneven, glossy, etc.), dimensions, transparency, hardness, or reflectivity. For this reason, the fixed-length bit sequence BS may contain a bit field F3 for each of the multiple types of characteristics.

[0039] Furthermore, the attributes of the subject are not limited to type, etc. For example, attributes may include the construction status of the subject (e.g., construction process name, progress status, whether it was carried out or not, progress rate, etc.), management status (e.g., whether inspections were carried out or not, repair history, etc.), form (e.g., structural type of the structure), specifications, model (e.g., model of equipment, etc.), environmental conditions (e.g., installation environment, temperature and humidity conditions, etc.), purpose, or time-related information (e.g., construction date, repair date, etc.).

[0040] In this embodiment, the detail level determination unit 111 determines the detail level of the display data to be output (transmitted) to the user terminal 300 for each fixed-length bit sequence BS, based on the job-related information 170 concerning the user's job type and the attributes set in the bit fields F1 to F3 of the attribute category. Then, the output control unit 112 outputs (transmits) the display data according to the detail level for each unit space VX to the user terminal 300. Here, the level of interest in the target attribute differs depending on the user's job type. For example, attributes such as "bridge pier" and "crack" are of high interest to civil engineers, while they are of low interest to architectural engineers. In this embodiment, the detail level of the display data is determined based on the relationship between such job types and target attributes.

[0041] Therefore, according to this embodiment, the level of detail of the display data for each unit space VX corresponding to each fixed-length bit sequence BS can be determined according to the user's occupation. As a result, display data with optimized level of detail for each user's occupation can be provided to the user terminal 300. In other words, display data can be provided with a level of detail that matches the user's characteristics. For this reason, depending on the occupation, areas of interest can be displayed with a high level of detail for high resolution, and areas of no interest can be displayed with a low level of detail for coarser resolution. As a result, user satisfaction can be improved by reducing the amount of communication data between the information processing device 100 and the user terminal 300 while providing a high-resolution display for areas of interest to the user. In addition, memory consumption on the user terminal 300 can be reduced. Therefore, even if the user terminal 300 is, for example, a smartphone or tablet with low specifications, the display and operation of three-dimensional models in a large virtual three-dimensional space can be performed smoothly.

[0042] For example, civil engineers and architectural engineers have different job roles, and therefore their areas of interest (areas they want to observe) may differ. In such cases, this embodiment can provide display data with a level of detail appropriate to the job role. For example, bridge piers and roads can be displayed in high definition and buildings in a lower definition for civil engineers, while the exterior walls and rooftops of buildings can be displayed in high definition and bridge piers and roads in a lower definition for architectural engineers.

[0043] In this embodiment, an example is given in which the level of detail is determined to be a first level or a second level. The first level indicates that the amount of data for display is larger and more detailed than the second level. However, the level of detail may be determined to be 3 or higher, or the level of detail may be indicated by a continuous value.

[0044] Specifically, if the attributes corresponding to the user's job-related information 170 are set in the bit fields F1 to F3 of the attribute category in the fixed-length bit sequence BS, the detail level determination unit 111 determines the detail level to the first level. Then, the output control unit 112 outputs (transmits) display data with the first level of detail to the user terminal 300 for each unit space VX. Display data with the first level of detail is, for example, three-dimensional data 160A. In other words, the output control unit 112 outputs (transmits) the three-dimensional data 160A as display data to the user terminal 300, corresponding to the unit space VX to which the fixed-length bit sequence BS is associated.

[0045] Accordingly, according to this embodiment, high-resolution three-dimensional data 160A is provided to the user terminal 300 for the unit space VX corresponding to the fixed-length bit sequence BS, which contains attributes related to the user's occupation. As a result, the user can view areas of high occupational interest in high resolution, enabling detailed observation and inspection of the target.

[0046] On the other hand, if the attribute corresponding to the user's job-related information 170 is not set in the bit fields F1 to F3 of the attribute category in the fixed-length bit sequence BS, the detail level determination unit 111 determines the detail level to the second level. Then, the output control unit 112 outputs (transmits) display data with the second level of detail for each unit space VX to the user terminal 300. Display data with the second level of detail is, for example, alternative data 180 related to the subject. In other words, the output control unit 112 outputs (transmits) alternative data 180 as display data to the user terminal 300 corresponding to the unit space VX to which the fixed-length bit sequence BS is associated. The amount of data of the alternative data 180 (amount of data per unit space VX) is less than the amount of data of the three-dimensional data 160A (amount of data per unit space VX). In other words, the display image based on the alternative data 180 is coarser than the display image based on the three-dimensional data 160A.

[0047] Accordingly, according to this embodiment, for unit space VX where attributes unrelated to the user's occupation are set, alternative data 180 with a small amount of data is provided. As a result, the amount of communication data and processing load between the information processing device 100 and the user terminal 300 can be reduced, and three-dimensional data 160A of areas of high interest to the user can be delivered preferentially and at high speed.

[0048] Alternative data 180 may be, for example, simplified three-dimensional data in which the outline of the object is approximated by a simple geometric shape such as a rectangular prism, coarser three-dimensional data with a reduced number of polygons and point cloud density compared to three-dimensional data 160A, or dummy data.

[0049] More specifically, the user's job-related information 170 includes a reference bit string RB set to correspond to the user's job. The reference bit string RB is logically operated on each fixed-length bit string BS associated with each unit space VX, thereby extracting two or more fixed-length bit strings BS from among multiple fixed-length bit strings BS that represent the content corresponding to the user's job.

[0050] As shown in Figure 4, the reference bit string RB has the same bit length as the fixed-length bit string BS. The reference bit string RB also contains multiple bit fields G. Each of the multiple bit fields G corresponds to a multiple bit field F of the fixed-length bit string BS. Therefore, each of the multiple categories associated with the multiple bit fields F is associated with a multiple bit field G. Each bit field G has the same bit length as bit field F. For example, bit field G1 is associated with the type category, bit field G2 with the state category, and bit field G3 with the characteristic category. In other words, bit fields G1 to G3 are associated with attribute categories. Bit fields G1 to G3 represent the target attribute within the attribute category associated with bit fields G1 to G3 in binary format. In the reference bit string RB, as an example, dummy data (e.g., 0) is set in the bit fields GD of categories other than attribute categories.

[0051] Figure 5 shows an example of a job-specific reference bit string group 175 according to this embodiment. As shown in Figure 5, multiple reference bit string groups 175 are stored in the storage unit 150, each corresponding to a plurality of job types. In other words, the reference bit string group 175 is associated with job type information 177 that indicates a job type. Each reference bit string group 175 contains one or more reference bit strings RB. Each reference bit string RB represents an attribute that a user of the job type indicated by the job type information 177 is interested in or is presumed to be interested in. In the reference bit string RB, one or more bit fields G from bit fields G1 to G3 of the attribute category are set in binary format with the attribute that a user of the job type indicated by the job type information 177 is interested in or is presumed to be interested in.

[0052] For example, if job information 177 indicates "civil engineer," the reference bit string group 175 will contain at least two reference bit strings RB. The first reference bit string RB has a binary code indicating "bridge pier" in the bit field G1 of the type category, a binary code indicating "crack" in the bit field G2 of the state category, and a binary code indicating "concrete" in the bit field G3 of the characteristic category. In other words, this reference bit string RB corresponds to "a concrete bridge pier with cracks." The second reference bit string RB has "road" set in bit field G1, "sinkhole" in bit field G2, and all "0"s set in bit field G3. "0" indicates that no attribute of the characteristic category is specified. In other words, this reference bit string RB corresponds to "a road with a sinkhole" regardless of the characteristic of the target. In addition, in both reference bit strings RB, "0" is set as dummy data in bit fields G other than the attribute category. If you do not specify attributes for the type category or state category, the bit fields G1 and G2 of the type category and state category will all be set to "0".

[0053] Similarly, for example, if job information 177 indicates "architectural engineer," the first reference bit string RB has "exterior wall" set in bit field G1, "crack" in bit field G2, and "concrete" in bit field G3, corresponding to "a concrete exterior wall with cracks." The second reference bit string RB has "rooftop" set in bit field G1, "water leakage" in bit field G2, and "waterproofing layer" in bit field G3, corresponding to "a waterproofing layer on a rooftop with water leakage."

[0054] As explained above with reference to Figure 5, the bit fields G1 to G3 of the attribute category of the reference bit string RB are set with the target attributes corresponding to the job type indicated by the job type information 177. In other words, the bit fields G1 to G3 of the attribute category of the reference bit string RB are set with the attributes that the user of the job type indicated by the job type information 177 is interested in, or is presumed to be interested in.

[0055] For example, the information setting unit 113 pre-creates a reference bit string group 175 for each different job type indicated by the job type information 177. Therefore, the reference bit string group 175 is not created for a specific user, but is pre-created for each job type. However, as described later, the reference bit string RB may be changed or created depending on environmental information related to the user's work environment or the attributes of the target specified by the user.

[0056] Next, with reference to Figure 6, the details of the logical operation performed by the detail level determination unit 111 will be explained. Figure 6 is a diagram showing an example of a logical operation between a reference bit sequence RB and a fixed-length bit sequence BS according to this embodiment. As shown in Figure 6, the detail level determination unit 111 determines the detail level of the display data based on the result of a logical operation between the reference bit sequence RB and the fixed-length bit sequence BS, which are set according to the user's occupation. The logical operation used to determine the detail level is, for example, a logical AND operation.

[0057] The following is an example of a logical operation when the user's occupation is "Civil Engineer" and the reference bit string RB indicates "Bridge Pier with Cracks". In this case, the reference bit string RB has the type category associated with bit field G1 set to a binary code indicating "Bridge Pier" (e.g., "000...01001"), and the state category associated with bit field G2 set to a binary code indicating "Crack" (e.g., "000...00100"). All other bit fields G are set to "0".

[0058] The detail level determination unit 111 performs a logical AND operation between the fixed-length bit sequence BS of each unit space VX stored in the storage unit 150 and the reference bit sequence RB, and outputs the logical operation result RS. The logical operation result RS is represented by a bit sequence with the same bit length as the fixed-length bit sequence BS and the reference bit sequence RB.

[0059] In the example in Figure 6, a fixed-length bit string BS in a unit space VX contains a bit field F1 associated with a type category, which contains the binary code "000...01001" indicating a "bridge pier," and a bit field F2 associated with a state category, which contains the binary code "000...00100" indicating a "crack." Bit fields F associated with other categories each contain their own binary codes (e.g., "000...01000," "000...00011," etc.).

[0060] As a result of the logical AND operation, each bit field H of the logical operation result RS is as follows: Bit field H1 associated with the type category shows the result of the logical AND of bit field G1 of the reference bit string RB and bit field F1 of the fixed-length bit string BS, and is "000...01001". Bit field H2 associated with the state category shows the result of the logical AND of bit field G2 of the reference bit string RB and bit field F2 of the fixed-length bit string BS, and is "000...00100". Bit fields H associated with other categories all show the result of the logical AND of "000...0000" because the corresponding bit fields G of the reference bit string RB are all "0".

[0061] The detail level determination unit 111 compares the logical operation result RS with the reference bit string RB. If each bit of the logical operation result RS matches each bit of the reference bit string RB, the detail level of the display data in the unit space VX corresponding to the fixed-length bit string BS is determined to be the first level (e.g., high detail). In the example in Figure 6, the bit field H1 of the type category of the logical operation result RS matches the bit field G1 of the reference bit string RB, and the bit field H2 of the state category matches the bit field G2 of the reference bit string RB. In addition, the bit fields H of other categories (all 0) also match the corresponding bit field GD (all 0) of the reference bit string RB. Therefore, the detail level determination unit 111 determines the detail level of the display data in the unit space VX corresponding to the fixed-length bit string BS that was the subject of the logical AND operation to be the first level. In other words, the unit space VX is determined to be a unit space VX that includes a "bridge pier with cracks," and as a location of interest to civil engineers, high-resolution three-dimensional data 160A is used as display data in the unit space VX.

[0062] On the other hand, although not illustrated in Figure 6, if the logical operation result RS does not match the binary code of the reference bit string RB, the detail level determination unit 111 determines the detail level of the display data in the unit space VX corresponding to the fixed-length bit string BS to be the second level (e.g., low detail level). In this case, in the unit space VX, alternative data 180 with a small amount of data is used as the display data.

[0063] The detail level determination unit 111 performs a logical AND operation with each of the multiple fixed-length bit sequences BS associated with each of the multiple unit spaces VX, using the reference bit sequence RB included in the reference bit sequence group 175 corresponding to the user's job type. Furthermore, if the reference bit sequence group 175 contains multiple reference bit sequences RB, the detail level determination unit 111 performs a logical AND operation with each of the multiple reference bit sequences RB for each fixed-length bit sequence BS. In this case, if any of the reference bit sequences RB included in the reference bit sequence group 175 match the logical operation result RS, the detail level determination unit 111 determines the detail level of the display data in the unit space VX corresponding to the fixed-length bit sequence BS that was the subject of the logical operation to be the first level. On the other hand, if none of the reference bit sequences RB included in the reference bit sequence group 175 match the logical operation result RS, the detail level determination unit 111 determines the detail level of the display data in the unit space VX corresponding to the fixed-length bit sequence BS that was the subject of the logical operation to be the second level.

[0064] As explained above with reference to Figure 6, according to this embodiment, the level of detail can be determined by a bitwise operation, which is a logical operation between a reference bit string RB and a fixed-length bit string BS. As a result, even if the virtual three-dimensional space has a vast number of unit spaces VX, the level of detail of the display data can be determined quickly for each unit space VX.

[0065] Furthermore, in this embodiment, in the fixed-length bit sequence BS and the reference bit sequence RB, the bit fields F1 and G1 associated with the type category indicate the type of object. Therefore, the type category makes it possible to distinguish, for example, whether the object is a bridge pier or an exterior wall, and the object to be observed can be accurately set according to the job. In addition, the bit fields F2 and G2 associated with the state category indicate the state of the object. Therefore, the state category makes it possible to distinguish, for example, whether or not there are abnormalities such as cracks, sinkholes, or water leaks in the object, and the type of abnormality to pay attention to can be accurately set according to the job. Furthermore, the bit fields F3 and G3 associated with the characteristic category indicate the characteristics of the object. Therefore, the characteristic category makes it possible to distinguish, for example, whether the object is concrete or steel, or other characteristics (e.g., material), and the characteristics of the object can be accurately set according to the job.

[0066] Now, returning to Figure 4, we will describe the bit fields F4 and F5 of the fixed-length bit sequence BS. The fixed-length bit sequence BS may include bit field F4 and / or bit field F5.

[0067] The fixed-length bit string BS represents object information about an object represented by three-dimensional data 160A associated with a unit space VX. In this case, the object information may include confidence information indicating the likelihood (e.g., reliability) of the object's attribute information and / or change information indicating the object's change over time. Furthermore, in the fixed-length bit string BS, multiple bit fields F are each associated with multiple different categories. These multiple categories may include confidence categories related to confidence information and / or time-change categories related to change information. For example, the fixed-length bit string BS includes bit field F4 associated with the confidence category and / or bit field F5 associated with the time-change category.

[0068] The bit field F4 associated with the confidence category indicates the likelihood of the target attribute information (hereinafter referred to as "confidence") in binary format. The confidence indicates, for example, the likelihood of the artificial intelligence model's estimation result of the target's attributes. For example, the processing unit 110 inputs three-dimensional data 160, one or more two-dimensional images used to generate the three-dimensional data 160, or one or more two-dimensional images representing the three-dimensional model on a two-dimensional plane from a viewpoint defined in a virtual three-dimensional space, into the artificial intelligence model, causing the artificial intelligence model to estimate (output) each attribute of the target. The three-dimensional model is composed of three-dimensional data 160. The artificial intelligence model is, for example, a generative AI (Artificial Intelligence) such as a Vision Language Model (VLM).

[0069] For example, if the confidence level is expressed as a continuous value such as 87%, the continuous value may be represented by a binary code and set in bit field F4. Alternatively, bit field F4 may consist of 2 bits and represent the confidence level in multiple stages such as "low," "medium," "high," and "very high."

[0070] In this embodiment, for example, confidence levels may be estimated for each attribute set in bit fields F1 to F3 of multiple attribute categories (type category, state category, and characteristic category) relating to the target attribute. Therefore, the fixed-length bit string BS may have multiple bit fields F4 corresponding to each of the multiple attribute categories relating to the target attribute. Accordingly, a binary code representing the confidence level is set in each bit field F4 for each target attribute.

[0071] Furthermore, bit field F5, associated with a time change category, represents the time change in binary format. For example, if the time change is represented as a continuous value, the continuous value may be represented as a binary code and set in bit field F5. Also, bit field F5 may represent multiple categories such as "new occurrence," "deterioration," "improvement," and "no change."

[0072] In this embodiment, for example, the fixed-length bit string BS may have multiple bit fields F5 corresponding to each of the multiple attribute categories (type category, state category, and characteristic category) related to the target attribute. Therefore, for each target attribute, a binary code representing the change over time is set in each bit field F5.

[0073] In the above, dummy data was set in bit field G of the reference bit string RB, which corresponds to bit fields F4 and F5 of the fixed-length bit string BS, respectively. However, the confidence level may be set in bit field G of the reference bit string RB, which corresponds to bit field F4, according to the occupation indicated by occupation information 177. Also, time-varying information may be set in bit field G of the reference bit string RB, which corresponds to bit field F5, according to the occupation indicated by occupation information 177.

[0074] In the above explanation, the level of detail of the display data was determined based on job-related information 170 and the fixed-length bit string BS. Next, referring to Figures 3 and 7, an example of determining the level of detail while also considering the distance from the user's viewpoint will be explained. Note that considering distance is not mandatory.

[0075] As shown in Figure 3, the detail level determination unit 111 determines the detail level of the display data for each fixed-length bit sequence BS (for each unit space VX) based on the job-related information 170 including the reference bit sequence RB, the attributes set in the bit fields F1 to F3 of the attribute category of the fixed-length bit sequence BS, and the distance from the user's viewpoint position 60 (Figure 7) in the virtual three-dimensional space. The viewpoint position 60 indicates the position of the virtual camera in the virtual three-dimensional space where the three-dimensional model composed of three-dimensional data 160 is placed. The virtual camera represents the user's viewpoint in the virtual three-dimensional space and can move within the virtual three-dimensional space in response to operations on the user terminal 300, and the three-dimensional model within the range corresponding to the position and orientation of the virtual camera is rendered on the screen of the user terminal 300. "Distance from viewpoint position 60" refers, for example, to the distance in the depth direction from the viewpoint position in the virtual three-dimensional space.

[0076] Specifically, if an attribute corresponding to the user's job-related information 170 is set in the bit field F of the attribute category of the fixed-length bit string BS, the detail level determination unit 111 determines the detail level of the display data in the unit space VX corresponding to the fixed-length bit string BS to be a first level within the first range 61 (Figure 7) from the viewpoint position 60 in the virtual three-dimensional space. In other words, for objects that match the job, a high level of detail is maintained over a wide range, including distant objects. Here, "if an attribute corresponding to the user's job-related information 170 is set in the bit field F of the attribute category of the fixed-length bit string BS" means that the result RS of the logical operation between the reference bit string RB and the fixed-length bit string BS matches the reference bit string RB.

[0077] If the attribute corresponding to the job-related information 170 is set in the bit field F of the attribute category in the fixed-length bit sequence BS, the output control unit 112 outputs three-dimensional data 160A corresponding to the unit space VX within the first range 61 from the viewpoint position 60 as display data according to the first level of detail to the user terminal 300. As a result, the user terminal 300 displays a three-dimensional model in the first range 61 based on the high-resolution three-dimensional data 160A.

[0078] On the other hand, if the attribute corresponding to the user's job-related information 170 is not set in the bit field F of the attribute category of the fixed-length bit string BS, the detail level determination unit 111 determines the detail level of the display data in the unit space VX corresponding to the fixed-length bit string BS to be the first level within the second range 62 (Figure 7) from the viewpoint position 60 in the virtual three-dimensional space, and sets the detail level of the display data in the unit space VX corresponding to the fixed-length bit string BS to the second level outside the second range 62. In other words, for objects that do not match the job, a high level of detail is maintained near the viewpoint position 60, but switches to a lower level of detail when outside the vicinity. Here, "if the attribute corresponding to the user's job-related information 170 is not set in the bit field F of the attribute category of the fixed-length bit string BS" indicates that the result RS of the logical operation between the reference bit string RB and the fixed-length bit string BS does not match the reference bit string RB.

[0079] If the attribute corresponding to the job-related information 170 is not set in the bit field F of the attribute category in the fixed-length bit string BS, the output control unit 112 outputs three-dimensional data 160A corresponding to the unit space VX within the second range 62 from the viewpoint position 60 as display data corresponding to the first level of detail to the user terminal 300, and transmits alternative data 180 corresponding to the unit space VX outside the second range 62 from the viewpoint position 60 as display data corresponding to the second level of detail to the user terminal 300. As a result, the user terminal 300 displays a three-dimensional model based on the high-resolution three-dimensional data 160A in the second range 62, and displays a three-dimensional model based on the coarser alternative data 180 outside the second range 62.

[0080] An example of displaying a three-dimensional model according to the level of detail determined as described above will be explained with reference to Figure 7. Figure 7 is a diagram showing an example of displaying a three-dimensional model according to the level of detail determined by the level of detail determination unit 111 according to this embodiment. In Figure 7, the target OBJ1 (e.g., an apartment building) and the target OBJ2 (e.g., a road) are displayed as three-dimensional models on the user terminal 300.

[0081] As shown in Figure 7, in the virtual three-dimensional space, the first range 61 is wider than the second range 62. In other words, the distance R1 from the user's viewpoint 60 to the outer edge of the first range 61 is longer than the distance R2 from the viewpoint 60 to the outer edge of the second range 62. Therefore, object OBJ1 that matches the occupation (e.g., architectural engineer) is displayed with high resolution at the first level of detail even at a distance (first range 61), while object OBJ2 that does not match the occupation (e.g., architectural engineer) is displayed with high resolution at the first level of detail only in the vicinity (second range 62), and switches to a coarser display at the second level of detail when outside the vicinity.

[0082] In this specification, "far" and "near" refer to relative distances, not absolute distances.

[0083] Next, we will explain an example where job-related information 170 further includes user environment information. Note that including environment information is not mandatory.

[0084] The job-related information 170 may include information indicating the attributes of the target according to the user's job, and environmental information regarding the user's work environment. Environmental information may include, for example, information about the user's affiliated organization and / or jurisdiction. Even with the same job, if the work environment is different, the target or area of ​​interest of the user may differ. For example, even among civil engineers, a civil engineer belonging to an organization that manages expressways may be interested in expressway-specific targets or areas such as damage to sound barriers, while a civil engineer belonging to a local government may be interested in targets or areas specific to regional infrastructure. Therefore, in this embodiment, the detail level determination unit 111 determines the detail level of the display data based on information indicating the attributes of the target according to the user's job, environmental information regarding the user's work environment, and the attributes set in the bit field F of the attribute category in the fixed-length bit string BS, thereby enabling the determination of a detail level that is more suited to the user's actual work situation.

[0085] Specifically, the information setting unit 113 modifies the content of the attribute category bit field G in the reference bit string RB, which has attributes pre-set according to the job type, according to environmental information about the user's work environment. Alternatively, the information setting unit 113 creates a new reference bit string RB and sets attributes according to the environmental information about the user's work environment in the attribute category bit field G of the newly created reference bit string RB. As a result, the reference bit string RB is modified or newly generated as job-related information 170, which includes information on the target attributes according to the user's job type and the target attributes according to the environmental information about the user's work environment. The detail level determination unit 111 then determines the detail level of the display data by performing a logical operation between the reference bit string RB modified or newly generated by the information setting unit 113 and each fixed-length bit string BS.

[0086] Next, we will explain an example where job-related information 170 further includes attribute information specified by the user. Note that including user-specified attribute information is not mandatory.

[0087] The job-related information 170 may include information indicating the attributes of a target according to the user's job, and attribute information indicating the attributes of a target specified by the user. In this embodiment, the detail level determination unit 111 determines the detail level of the display data based on the information indicating the attributes of a target according to the user's job, the attribute information indicating the attributes of a target specified by the user, and the attributes set in the bit field F of the attribute category in the fixed-length bit string BS, thereby enabling the determination of a fine level of detail that meets the user's specific interests.

[0088] Specifically, the information setting unit 113 modifies the content of the attribute category bit field G in the reference bit string RB, which has attributes pre-set according to the job type, according to the attribute of the target specified by the user. Alternatively, the information setting unit 113 creates a new reference bit string RB and sets the attribute specified by the user in the attribute category bit field G of the newly created reference bit string RB. As a result, the reference bit string RB is modified or newly generated as job-related information 170 that includes information on the target attribute according to the user's job type and the target attribute of the target specified by the user. Then, the detail level determination unit 111 determines the detail level of the display data by performing a logical operation between the reference bit string RB modified or newly generated by the information setting unit 113 and each fixed-length bit string BS.

[0089] Next, the setting of job-related information 170 will be explained with reference to Figure 8. Figure 8 is a diagram showing an example of the job-related information setting screen 50 according to this embodiment. As shown in Figure 8, the user terminal 300 displays the job-related information setting screen 50. In this case, the output control unit 112 outputs (transmits) display data for displaying the job-related information setting screen 50 to the user terminal 300 via the communication unit 140. The job-related information setting screen 50 is a GUI (Graphical User Interface) screen.

[0090] The job-related information settings screen 50 includes a job selection area 51, a work environment area 52, an initial setting attribute area 53, an individual attribute specification area 54, and an application widget 55.

[0091] The job selection area 51 is an area for the user to select their job. The job selection area 51 includes a widget for the user to select their job, such as a drop-down list. The job selected by the job selection area 51 is stored in the storage unit 150 as the user's job information.

[0092] The work environment area 52 is an area that displays environmental information related to the user's work environment. Environmental information is, for example, information that is pre-configured based on a service contract between the organization to which the user belongs and the operator of the information processing device 100. However, the work environment area 52 may include widgets for the user to select or specify environmental information. In other words, the user may configure the environmental information.

[0093] The initial attribute area 53 is an area that displays the content of the attribute to be initially set in the bit field G of the attribute category of the reference bit string RB. The initial attribute area 53 may include a widget for selecting the target attribute, such as radio buttons. In the initial state, all radio buttons are selected. The user can delete the attribute initially set in the reference bit string RB by manipulating the radio buttons.

[0094] The attribute specification area 54 is an area for the user to individually specify the attribute information to be set in the bit field G of the attribute category of the reference bit string RB. The attribute specification area 54 may include, for example, radio buttons as a widget for specifying the target attribute. The user can individually specify the attribute information to be set in the reference bit string RB by operating the radio buttons.

[0095] The application widget 55 is a widget used to confirm the settings made on the job-related information setting screen 50. A widget is, for example, a button. When a user operates the application widget 55, job-related information 170 (reference bit string RB) is set for each user based on the job selected in the job selection area 51, the environment information in the work environment area 52, the attributes set in the initial setting attribute area 53, and the attributes specified in the individual attribute specification area 54. The detail level determination unit 111 then determines the detail level of the display data based on the result of a logical operation between the reference bit string RB and the fixed-length bit string BS.

[0096] Next, an example of an information processing method according to this embodiment will be described with reference to Figures 3 and 9. Figure 9 is a flowchart of an example of an information processing method according to this embodiment. The information processing method is executed by an information processing device 100. The information processing device 100 is an example of a computer. In the information processing method, the information processing device 100 uses a fixed-length bit sequence BS that represents object information relating to an object represented by three-dimensional data 160A associated with a unit space VX, for each of the multiple unit spaces VX obtained by dividing the virtual three-dimensional space. As shown in Figure 9, the information processing method includes steps S1 to S5.

[0097] First, in step S1, the detail level determination unit 111 of the processing unit 110 retrieves job-related information 170 stored in association with the job indicated by the user's job information from the storage unit 150. Specifically, the detail level determination unit 111 retrieves a group of reference bit sequences 175 associated with the user's job.

[0098] Next, in step S2, the detail level determination unit 111 obtains a fixed-length bit sequence BS corresponding to each unit space VX from the storage unit 150.

[0099] Next, in step S3, the detail level determination unit 111 performs a logical operation (for example, a logical AND operation) between each reference bit sequence RB included in the reference bit sequence group 175 and each fixed-length bit sequence BS.

[0100] Next, in step S4, the detail level determination unit 111 determines the detail level of the display data for each fixed-length bit string BS (for each unit space VX) based on the result of the logical operation in step S3 (logical operation result RS). Specifically, for unit spaces VX where the logical operation result RS matches with any of the reference bit strings RB in the reference bit string group 175, the detail level is determined to be the first level, and for unit spaces VX where the logical operation result RS does not match with any of the reference bit strings RB in the reference bit string group 175, the detail level is determined to be the second level. As explained with reference to Figure 7, the detail level determination unit 111 may also determine the detail level by taking into account the distance from the user's viewpoint position 60 in the virtual three-dimensional space (Figure 7).

[0101] Next, in step S5, the output control unit 112 outputs (transmits) display data corresponding to the level of detail determined in step S4 to the user terminal 300 for each of the multiple unit spaces VX. Specifically, the output control unit 112 transmits three-dimensional data 160A to the user terminal 300 for unit spaces VX whose level of detail is determined to be the first level, and transmits alternative data 180 to the user terminal 300 for unit spaces VX whose level of detail is determined to be the second level. As explained with reference to Figure 7, the output control unit 112 may also control the level of detail of the display data to be transmitted according to the distance from the viewpoint position 60.

[0102] As an example, the output control unit 112 transmits a spatial address (e.g., tile coordinates) to the user terminal 300 for each unit space VX. The user terminal 300 then obtains display data corresponding to the level of detail for each unit space VX from the information processing device 100 based on the spatial address. In this example as well, in substance, the output control unit 112 outputs (transmits) display data corresponding to the level of detail for each unit space VX to the user terminal 300 in response to the user terminal 300's request. The information processing method ends when step S5 is completed. The output control unit 112 may also transmit image data obtained by rendering the three-dimensional data 160A and image data obtained by rendering the alternative data 180 to the user terminal 300.

[0103] As explained above with reference to Figure 9, according to this embodiment, the level of detail of the display data is determined for each of the multiple fixed-length bit sequences BS (for each of the multiple unit spaces VX) by performing a logical operation between the reference bit sequence group 175 included in the user's occupation-related information 170 and the fixed-length bit sequence BS of each unit space VX. In this way, while achieving high-speed arithmetic processing in the information processing device 100 by executing bit operations, it is possible to output highly detailed three-dimensional data 160A to the user terminal 300 for unit spaces VX related to the user's occupation, and output alternative data 180 with a small amount of data for unit spaces VX that are less related to the user's occupation. As a result, the amount of communication data between the information processing device 100 and the user terminal 300 can be reduced, and memory consumption in the user terminal 300 can be reduced. Furthermore, display data can be provided to the user with a level of detail that matches the user's occupation, that is, the user's characteristics.

[0104] Furthermore, in this embodiment, the detail level determination unit 111 may determine the detail level of the display data for each fixed-length bit sequence BS for unit spaces VX outside the rendering range, in addition to the unit spaces VX within the rendering range based on the user's viewpoint position. That is, the detail level determination unit 111 may pre-determine the detail level for a wide range of unit spaces VX included in the virtual three-dimensional space, regardless of the user's viewpoint position. As mentioned above, logical operations between the reference bit sequence RB and the fixed-length bit sequence BS can be executed at high speed, making it easy to pre-determine the detail level for a large number of unit spaces VX. As a result, even if the user moves their viewpoint position, the detail level of each unit space VX at the destination has already been determined, so the display data corresponding to the viewpoint movement can be transmitted without delay.

[0105] Returning to Figure 3, the three-dimensional data generation unit 114 acquires multiple two-dimensional images from the video data or still image dataset, generated by capturing the target from multiple different imaging positions. Then, the three-dimensional data generation unit 114 generates three-dimensional data 160 representing the target based on the multiple two-dimensional images. The three-dimensional data 160 is stored in the storage unit 150. As an example, the three-dimensional data generation unit 114 generates the three-dimensional data 160 by performing SfM (Structure from Motion) processing. SfM processing is a process that generates three-dimensional data 160 using the principle of triangulation based on multiple two-dimensional images generated by capturing an target having multiple feature points from multiple imaging positions. Through SfM processing, for example, sparse point cloud data is generated as three-dimensional data 160. In addition to SfM processing, the three-dimensional data generation unit 114 may also perform MVS (Multi View Stereo) processing. The MVS processing involves calculating the depth and normal for each pixel of each two-dimensional image using multi-view stereo measurement, integrating these, and generating dense point cloud data of the target. The dense point cloud data may be treated as three-dimensional data 160. Furthermore, the method of generating the three-dimensional data 160 by the three-dimensional data generation unit 114 is not particularly limited; for example, the three-dimensional data generation unit 114 may generate BIM data, mesh data, or 3DGS data, etc.

[0106] (modified version) In the examples explained in Figures 4 to 6, a fixed-length bit string BS was configured with attribute categories such as type category and state category, and a bit field F was assigned to each. In contrast, the modified example provides multiple subfields within the bit field of the fixed-length bit string BS. Each subfield consists of a predetermined number of bits. For example, if the bit field is 16 bits, the bit field is configured with four subfields, each consisting of 4 bits. Note that there may be unused bits in the 16-bit bit field, such as when the number of bits in a subfield is 3 bits.

[0107] Each subfield contains a binary code representing two or more attributes of the object represented by the type associated with the subfield. For example, if the type associated with the subfield is "bridge girder," then in the subfield, the first bit indicates the type, "presence (1) or absence (0) of the bridge girder," the second bit indicates the material of the bridge girder, "concrete (1) or steel (0)," the third bit indicates the condition of the bridge girder, "presence (1) or absence (0) of cracks," and the fourth bit indicates the type of bridge girder, "upper deck (1) or lower deck (0)." In this way, flags are set for each bit of the subfield as an example. Note that a single attribute may be represented in the subfield by a bit pattern using multiple bits (for example, 2 bits).

[0108] As an example, in a modified version, attribute categories may be set for each different type. In this case, for example, attribute categories are set for each type of target, such as bridge system category, tunnel system category, and railway system category. For example, the bridge system category includes bridge piers and bridge girders. Then, these attribute categories are associated with each of the multiple bit fields of the fixed-length bit string BS. Furthermore, multiple subfields are provided within the bit fields associated with the attribute categories for each type. Each subfield is associated with a specific type (lower-level type) that is contained within the type (higher-level type) associated with the bit field. For example, the bit field for the bridge system category includes a subfield associated with bridge piers, a bit field associated with bridge girders, etc. Then, each subfield is set with a binary code representing two or more attributes of the target represented by the specific type associated with the subfield (for example, specific type, state, material, and form, etc.) (see the example above).

[0109] Furthermore, the bit field of the reference bit string RB has a bit field corresponding to the fixed-length bit string BS. The structure of the bit field of the reference bit string RB is the same as the structure of the bit field of the fixed-length bit string BS. In addition, the bit field of the reference bit string RB has multiple subfields. The structure of the subfields of the reference bit string RB is the same as the structure of the subfields of the fixed-length bit string BS.

[0110] Furthermore, in the modified example, each of the two or more bits corresponding to two or more attributes within the subfield can be considered a bit field. Also, the subfield in the modified example can be considered a bit field. In other words, in this specification, a bit field refers to a predetermined bit range within a fixed-length bit sequence BS (reference bit sequence RB).

[0111] Preferred embodiments and modifications of the present disclosure have been described in detail above with reference to the attached drawings, but the technical scope of the present disclosure is not limited to such examples. It is clear to any person with ordinary skill in the art of the present disclosure that various modifications or alterations can be conceived within the scope of the technical idea set forth in the claims, and these too are understood to fall within the technical scope of the present disclosure.

[0112] For example, the fixed-length bit string BS may include a bit field F for setting the time information of the object in binary format. The time information indicates the time of the object contained in the unit space VX. Specifically, the time information indicates the time when the object was measured in order to generate the three-dimensional data 160 representing the object. In this case, the time is indicated by one or more of the following: year, month, day, and time of day, but it may also be indicated by a season such as spring, or a construction period such as the first construction period, and the way the time is expressed is not particularly limited.

[0113] For example, all unit spaces VX may be set at the same hierarchical level, or unit spaces VX belonging to different hierarchical levels may be mixed together. Also, in the above embodiment, three-dimensional data 160A was used as highly detailed display data, but other three-dimensional data may be used.

[0114] The apparatus or system described herein may be implemented as a single apparatus, or it may be implemented by a group of apparatuses (e.g., a cloud server) that are partially or entirely connected by a network. For example, each of the functional units 111 to 114 of the processing unit 110 (Figure 3) may be implemented by separate computers. Also, for example, some groups of the functional units 111 to 114 may be implemented by separate computers. For example, all or part of the fixed-length bit string BS, the three-dimensional data 160, and the reference bit string RB may be stored in a database outside the information processing apparatus 100. Also, for example, some or all of the functional units 111 to 114 in Figure 3 may be implemented by the processing unit of the user terminal 300. Furthermore, for example, the processing unit 110 of the information processing apparatus 100 may function as part of the functional units 111 to 114, and the user terminal 300 may function as another part of the functional units 111 to 114, and the two may share the processing.

[0115] The series of processes performed by the apparatus described herein may be implemented using software, hardware, or a combination of software and hardware.

[0116] Furthermore, the processes described using flowcharts in this specification do not necessarily have to be executed in the order shown. Some processing steps may be executed in parallel. Additional processing steps may be adopted, and some processing steps may be omitted.

[0117] In Figure 9, the processing unit 110 executes each step included in the information processing method by executing the program stored in the storage unit 150. In other words, the program causes the processing unit 110 to execute each step included in the information processing method. The processing unit 110 corresponds to an example of a "computer" in this disclosure. To put it another way, the program product realizes each step included in the information processing method when the program is executed by the processing unit 110.

[0118] Furthermore, the effects described herein are merely descriptive or illustrative and not limiting. In other words, the technology relating to this disclosure may produce other effects that are obvious to those skilled in the art from the description herein, in addition to or in lieu of the effects described herein.

[0119] Furthermore, the following configurations also fall within the technical scope of this disclosure.

[0120] (Item 1) It comprises a memory unit and a detail level determination unit, The memory unit stores, for each of the multiple unit spaces obtained by dividing the virtual three-dimensional space, a fixed-length bit string representing object information relating to an object represented by three-dimensional data associated with the unit space. The aforementioned target information includes, at a minimum, attribute information indicating the attributes of the target, The aforementioned fixed-length bit string includes multiple bit fields, Each of the aforementioned bit fields is associated with a different category. The aforementioned multiple categories include one or more attribute categories relating to the target attribute, The bit field associated with the attribute category represents the target attribute belonging to the attribute category in binary format. The detail level determination unit is an information processing device that determines the level of detail of the display data to be output to the user's terminal for each fixed-length bit string, based on job-related information relating to the user's job and the attributes set in the bit field of the attribute category.

[0121] (Item 2) The information processing apparatus according to item 1, further comprising an output control unit that transmits the three-dimensional data as display data to the user's terminal, corresponding to the unit space to which the fixed-length bit string is associated, when an attribute corresponding to the job-related information is set in the bit field of the attribute category in the fixed-length bit string.

[0122] (Item 3) If the attribute corresponding to the job-related information is not set in the bit field of the attribute category in the fixed-length bit string, the output control unit further provides to transmit alternative data relating to the object as display data to the user's terminal, corresponding to the unit space to which the fixed-length bit string is associated. The information processing device according to item 1 or item 2, wherein the amount of data in the alternative data is less than the amount of data in the three-dimensional data.

[0123] (Item 4) The detail level determination unit determines the detail level for each fixed-length bit string based on the job-related information, the attributes set in the bit fields of the attribute categories, and the distance from the user's viewpoint in the virtual three-dimensional space. If an attribute corresponding to the job-related information is set in the bit field of the attribute category in the fixed-length bit string, the system further includes an output control unit that outputs the three-dimensional data corresponding to the unit space within a first range from the viewpoint position as display data according to the level of detail to the user's terminal. If the attribute corresponding to the job-related information is not set in the bit field of the attribute category in the fixed-length bit string, the output control unit outputs the three-dimensional data corresponding to the unit space within the second range from the viewpoint position to the user's terminal as display data according to the level of detail. An information processing device according to any one of items 1 to 3, wherein in the virtual three-dimensional space, the first range is wider than the second range.

[0124] (Item 5) The job-related information includes a reference bit string set in accordance with the user's job type. The information processing apparatus according to any one of items 1 to 4, wherein the detail determination unit determines the detail based on the result of a logical operation between the reference bit sequence and the fixed-length bit sequence.

[0125] (Item 6) The job-related information includes information indicating the attributes of the target according to the user's job, and environmental information relating to the user's work environment, as described in any of items 1 to 5 of the information processing device.

[0126] (Item 7) The job-related information includes information indicating the attributes of a target corresponding to the user's job, and attribute information indicating the attributes of a target specified by the user, as described in any of items 1 to 6 of the information processing device.

[0127] (Item 8) The detail determination unit determines the level of detail for each fixed-length bit sequence in the unit space outside the rendering range, in addition to the unit space within the rendering range based on the user's viewpoint position, according to any information processing device described in item 1 to item 7.

[0128] (Item 9) The attributes of the aforementioned target include one or more of the type, state, and characteristics of the aforementioned target. The aforementioned multiple categories include, as attribute categories, one or more of the following: a type category indicating the type of the target, a state category indicating the state of the target, and a characteristic category indicating the characteristics of the target. The bit field associated with the aforementioned type category indicates the type of the target, The bit field associated with the aforementioned state category indicates the state of the subject, The bit field associated with the characteristic category is an information processing device according to any of items 1 to 8, which indicates the characteristics of the target.

[0129] (Item 10) The computer divides a virtual three-dimensional space into multiple unit spaces, and for each of these unit spaces, it uses a fixed-length bit string to represent object information relating to an object represented by three-dimensional data associated with that unit space. The aforementioned target information includes, at a minimum, attribute information indicating the attributes of the target, The aforementioned fixed-length bit string includes multiple bit fields, Each of the aforementioned bit fields is associated with a different category. The aforementioned multiple categories include one or more attribute categories relating to the target attribute, The bit field associated with the attribute category represents the target attribute belonging to the attribute category in binary format. An information processing method in which the computer determines the level of detail of the display data to be output to the user's terminal for each fixed-length bit string, based on job-related information relating to the user's job and the attributes set in the bit field of the attribute category.

[0130] (Item 11) The computer is instructed to use a fixed-length bit string to represent object information about an object represented by three-dimensional data associated with a unit space, for each of the multiple unit spaces obtained by dividing a virtual three-dimensional space. The aforementioned target information includes, at a minimum, attribute information indicating the attributes of the target, The aforementioned fixed-length bit string includes multiple bit fields, Each of the aforementioned bit fields is associated with a different category. The aforementioned multiple categories include one or more attribute categories relating to the target attribute, The bit field associated with the attribute category represents the target attribute belonging to the attribute category in binary format. A program that causes the computer to determine the level of detail of the display data to be output to the user's terminal for each fixed-length bit string, based on job-related information concerning the user's job and the attributes set in the bit field of the attribute category. [Industrial applicability]

[0131] This disclosure provides an information processing device, an information processing method, and a program, and has industrial applicability. [Explanation of Symbols]

[0132] 100 Information processing device, 110 Processing unit, 111 Detail level determination unit, 112 Output control unit, 113 Information setting unit, 114 Three-dimensional data generation unit, BS Fixed-length bit sequence, RB Reference bit sequence

Claims

1. It comprises a memory unit and a detail level determination unit, The memory unit stores, for each of the multiple unit spaces obtained by dividing the virtual three-dimensional space, a fixed-length bit string representing object information relating to an object represented by three-dimensional data associated with the unit space. The aforementioned target information includes, at a minimum, attribute information indicating the attributes of the target, The aforementioned fixed-length bit string includes multiple bit fields, Each of the aforementioned bit fields is associated with a different category. The aforementioned multiple categories include one or more attribute categories relating to the attributes of the subject, The bit field associated with the attribute category represents the target attribute belonging to the attribute category in binary format. The detail level determination unit is an information processing device that determines the level of detail of the display data to be output to the user's terminal for each fixed-length bit string, based on job-related information relating to the user's job and the attributes set in the bit field of the attribute category.

2. The information processing apparatus according to claim 1, further comprising an output control unit that transmits the three-dimensional data as display data to the user's terminal, corresponding to the unit space associated with the fixed-length bit string, when an attribute corresponding to the job-related information is set in the bit field of the attribute category in the fixed-length bit string.

3. If the attribute corresponding to the job-related information is not set in the bit field of the attribute category in the fixed-length bit string, the output control unit further provides to transmit alternative data relating to the object as display data to the user's terminal, corresponding to the unit space to which the fixed-length bit string is associated. The information processing apparatus according to claim 1 or claim 2, wherein the amount of the alternative data is less than the amount of the three-dimensional data.

4. The detail level determination unit determines the detail level for each fixed-length bit string based on the job-related information, the attributes set in the bit fields of the attribute categories, and the distance from the user's viewpoint in the virtual three-dimensional space. If an attribute corresponding to the job-related information is set in the bit field of the attribute category in the fixed-length bit string, the system further includes an output control unit that outputs the three-dimensional data corresponding to the unit space within a first range from the viewpoint position as display data according to the level of detail to the user's terminal. If the attribute corresponding to the job-related information is not set in the bit field of the attribute category in the fixed-length bit string, the output control unit outputs the three-dimensional data corresponding to the unit space within the second range from the viewpoint position to the user's terminal as display data according to the level of detail. The information processing apparatus according to claim 1 or claim 2, wherein in the virtual three-dimensional space, the first range is wider than the second range.

5. The job-related information includes a reference bit string set in accordance with the user's job type. The information processing apparatus according to claim 1 or 2, wherein the detail determination unit determines the detail based on the result of a logical operation between the reference bit sequence and the fixed-length bit sequence.

6. The information processing apparatus according to claim 1 or claim 2, wherein the job-related information includes information indicating the attributes of a target corresponding to the user's job, and environmental information relating to the user's work environment.

7. The information processing apparatus according to claim 1 or 2, wherein the job-related information includes information indicating the attributes of a target corresponding to the user's job, and attribute information indicating the attributes of a target specified by the user.

8. The information processing apparatus according to claim 1 or 2, wherein the detail determination unit determines the detail for each fixed-length bit sequence for the unit space outside the rendering range, in addition to the unit space within the rendering range based on the user's viewpoint position.

9. The attributes of the aforementioned target include one or more of the type, state, and characteristics of the aforementioned target. The aforementioned multiple categories include, as attribute categories, one or more of the following: a type category indicating the type of the target, a state category indicating the state of the target, and a characteristic category indicating the characteristics of the target. The bit field associated with the aforementioned type category indicates the type of the target, The bit field associated with the aforementioned state category indicates the state of the subject, The information processing apparatus according to claim 1 or claim 2, wherein the bit field associated with the characteristic category indicates the characteristics of the target.

10. The computer divides a virtual three-dimensional space into multiple unit spaces, and for each of these unit spaces, it uses a fixed-length bit string to represent object information relating to an object represented by three-dimensional data associated with that unit space. The aforementioned target information includes, at a minimum, attribute information indicating the attributes of the target, The aforementioned fixed-length bit string includes multiple bit fields, Each of the aforementioned bit fields is associated with a different category. The aforementioned multiple categories include one or more attribute categories relating to the attributes of the subject, The bit field associated with the attribute category represents the target attribute belonging to the attribute category in binary format. An information processing method in which the computer determines the level of detail of the display data to be output to the user's terminal for each fixed-length bit string, based on job-related information relating to the user's job and the attributes set in the bit field of the attribute category.

11. The computer is instructed to use a fixed-length bit string to represent object information about an object represented by three-dimensional data associated with a unit space, for each of the multiple unit spaces obtained by dividing a virtual three-dimensional space. The aforementioned target information includes, at a minimum, attribute information indicating the attributes of the target, The aforementioned fixed-length bit string includes multiple bit fields, Each of the aforementioned bit fields is associated with a different category. The aforementioned multiple categories include one or more attribute categories relating to the attributes of the subject, The bit field associated with the attribute category represents the target attribute belonging to the attribute category in binary format. A program that causes the computer to determine the level of detail of the display data to be output to the user's terminal for each fixed-length bit string, based on job-related information concerning the user's job and the attributes set in the bit field of the attribute category.

Images