Information processing system, information processing method, and program

The system addresses the challenge of specifying GUI elements by assigning attributes in natural language, enabling intuitive and efficient management and operation of objects.

WO2026234930A1PCT designated stage Publication Date: 2026-11-12TOKUYAMA YOSHITERU
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2026/014409
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2025-05-07
Filing Date
2026-04-07
Publication Date
2026-11-12

AI Technical Summary

Technical Problem

Users find it difficult to specify elements in a graphical user interface (GUI) using mechanically assigned identification codes, as these codes do not align with the contextual meaning users associate with the elements.

Method used

An information processing system that assigns attributes to elements based on object information using natural language, allowing for unique identification and management of elements in a namespace.

Benefits of technology

Enables users to intuitively specify and manage elements using natural language, improving user convenience and efficiency in operations on objects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2026014409_12112026_PF_FP_ABST
    Figure JP2026014409_12112026_PF_FP_ABST
Patent Text Reader

Abstract

An information processing system according to one mode of the present invention comprises at least one processor capable of executing a program so as to perform the following steps. In an acquisition step, object information relating to at least one object arranged in an expression space for visually expressing the object is acquired, the object information including information relating to elements constituting the object. In an assignment step, an attribute different from an identification code is assigned to the elements constituting the object on the basis of the information relating to the object and predetermined reference information, the attribute being described in natural language and the reference information representing the correspondence between the states of the elements of the object per attribute. In a management step, the elements constituting the object in a namespace corresponding to the attribute are managed in a mode in which one meaning can be specified by using natural language.
Need to check novelty before this filing date? Find Prior Art

Description

Information Processing System, Information Processing Method, and Program

[0001] The present invention relates to an information processing system, an information processing method, and a program.

[0002] Patent Document 1 discloses a technology capable of facilitating data management in a design and manufacturing support system. In the design and manufacturing support system constituted by a design system (CAD system), an evaluation system (CAE system), and a production management system according to the technology, the association between CAD data files and components is defined in a bill of materials, and the granularity of data used in each system (the content of data contained in one data file) is unified. This discloses that registration of CAD data from the design system to the evaluation system and the production management system can be performed automatically without processing.

[0003] Japanese Unexamined Patent Application Publication No. 2007-193665

[0004] By the way, elements constituting an object arranged in an expression space are uniquely distinguished by mechanically assigned identification codes, and when a user non-linguistically designates the elements for the expression space through a graphical user interface (GUI), operations on the designated elements may be executable. However, some users may wish to complete operations related to operations on elements via a character user interface (CUI). However, since a user gives meaning to the elements constituting the object arranged in the expression space through various contexts such as shape, function, and relevance to other elements, and recognizes the elements through the given meaning, it has been difficult to specify the elements identified by the mechanically assigned identification codes via the CUI.

[0005] According to one aspect of the present invention, an information processing system is provided, comprising at least one processor capable of executing a program such that the following steps are performed: an acquisition step acquires object information relating to at least one object placed in a representation space for visually representing an object, the object information includes information relating to the elements constituting the object; an assignment step assigns attributes different from an identification code to the elements constituting the object based on the object information and predetermined reference information, the attributes are described in natural language, the reference information indicates the correspondence between each attribute and the state of the object's elements; and a management step manages the elements constituting the object in a namespace corresponding to the attributes in a manner that allows for unique identification using natural language.

[0006] With this configuration, it is possible to identify the elements that make up an object using natural language. For example, a user can intuitively specify the elements of an object placed in the representation space using natural language, rather than using non-natural language such as identification numbers.

[0007] This is a configuration diagram representing information processing system 1. This is a block diagram showing the hardware configuration of information processing device 2. This is a block diagram showing the hardware configuration of user terminal 3. This is a diagram showing an example of the data structure of model data. This is a diagram showing the relationships between elements that constitute an object. This is a diagram showing an example of reference information IF1 including naming attributes. This is a diagram showing an example of reference information IF2 including position attributes. This is a diagram showing an example of reference information IF3 including shape attributes. This is a diagram showing an example of reference information IF4 including appearance attributes. This is an activity diagram showing an example of the flow of information processing for assigning attributes, which is performed in information processing system 1. This is a diagram showing an example of attributes assigned to the object shown in Figure 5. This is a diagram showing an activity that shows the flow of information processing for performing operations on an object. This is a diagram showing the relationship between the change in topology information and attributes when a specific operation is performed on the object shown in Figure 11. This is an example of an operation screen displayed on the display unit in information processing for performing operations on an object.

[0008] Embodiments of the present invention will be described below with reference to the drawings. The various features shown in the embodiments below can be combined with each other.

[0009] Incidentally, the program or program product for realizing the software appearing in one embodiment may be provided as a computer-readable non-transitor-readable medium, or it may be provided so that the program or program product is launched on an external computer and its functions are realized on a client terminal (so-called cloud computing).

[0010] Furthermore, in various information processing according to one embodiment, an input and an output corresponding to the input can be realized. Here, as long as an output is obtained as a result of the input, the form of the information referenced in such information processing (hereinafter referred to as "reference information") is not limited. The reference information may be, for example, rule-based information such as a database, a lookup table, or a predetermined function (including a decision formula such as a regression equation constructed by a statistical method), or a trained model that has been pre-trained to learn the correlation between input and output, or a generative AI such as a large-scale language model that can output a desired result by inputting a prompt (these models include parameters that construct the correlation relationship between input and output) or a visual language model.

[0011] Furthermore, in one embodiment, "part" may include, for example, hardware resources implemented by a circuit in a broad sense, and the information processing of software that can be specifically realized by these hardware resources. Also, in one embodiment, various types of information are handled, and this information can be represented, for example, by the physical values ​​of signal values ​​representing voltage and current, the high or low values ​​of signal values ​​as a set of binary bits composed of 0s or 1s, or by quantum superposition (so-called qubits), and communication and calculations can be performed on a circuit in a broad sense.

[0012] Furthermore, a circuit in a broad sense is a circuit realized by combining at least an appropriate combination of circuits, circuits, processors, and memory. The processor may be a general-purpose processor or a dedicated circuit. In other words, this includes application-specific integrated circuits (ASICs), programmable logic devices (for example, simple programmable logic devices (SPLDs), complex programmable logic devices (CPLDs), and field programmable gate arrays (FPGAs)), etc.

[0013] 1. Hardware Configuration This section describes the hardware configuration.

[0014] <Information Processing System 1> Figure 1 is a configuration diagram representing Information Processing System 1. Information Processing System 1 comprises an information processing device 2 and a user terminal 3. The information processing device 2 and the user terminal 3 are configured to communicate with each other via a telecommunications line. In one embodiment, Information Processing System 1 consists of one or more devices or components. For example, if it consists only of the information processing device 2, then Information Processing System 1 can be the information processing device 2. These components will be described below.

[0015] <Information Processing Device 2> Figure 2 is a block diagram showing the hardware configuration of the information processing device 2. The information processing device 2 comprises a communication bus 20, a communication unit 21, a storage unit 22, and a processor 23, and these components are electrically connected within the information processing device 2 via the communication bus 20. Each component will be described further.

[0016] The communication unit 21 preferably uses wired communication methods such as USB, IEEE 1394, Thunderbolt®, and wired LAN network communication, but may also include wireless LAN network communication, mobile communication such as 3G / LTE / 5G, and Bluetooth® communication as needed. In other words, it is more preferable to implement it as a collection of these multiple communication methods. That is, the information processing device 2 may communicate various types of information from the outside via the communication unit 21 and the network.

[0017] The storage unit 22 stores various types of information as defined above. This can be implemented, for example, as a storage device such as a solid-state drive (SSD) that stores various programs related to the information processing device 2 executed by the processor 23, or as a memory such as a random access memory (RAM) that stores temporarily necessary information (arguments, arrays, etc.) related to program calculations. The storage unit 22 stores various programs and variables related to the information processing device 2 executed by the processor 23.

[0018] For example, the memory unit 22 stores the data structure DS and reference information IF1 to IF4, which will be described later.

[0019] The processor 23 performs processing and control of the overall operation related to the information processing device 2. The processor 23 is, for example, a Central Processing Unit (CPU) (not shown). The processor 23 realizes various functions related to the information processing device 2 by reading predetermined programs stored in the storage unit 22. That is, information processing by software stored in the storage unit 22 is concretely realized by the processor 23, which is an example of hardware, and can be executed as each functional unit included in the processor 23. These will be described in more detail in the next section. Note that the processor 23 is not limited to being a single unit, and may be implemented with multiple processors 23 for each function, or a combination thereof.

[0020] The processor 23 is configured as an acquisition unit to acquire information from the user terminal 3 or other devices. The processor 23 is configured to acquire various information by reading various information stored in the storage area, which is at least a part of the memory unit 22, and writing the read information to the work area, which is at least a part of the memory unit 22. The storage area is, for example, the area of ​​the memory unit 22 that is implemented as a storage device such as an SSD. The work area is, for example, the area that is implemented as memory such as RAM. The acquisition by the processor 23 includes acquiring the output results of each functional unit included in the processor 23.

[0021] The processor 23 is configured as a display processing unit to display various information. This information can be presented to the user via the display unit 34 of the user terminal 3 or other devices, as described later. In such a case, for example, the processor 23 controls the display unit 34 of the user terminal 3 to display visual information such as screens, images including still images or videos, icons, and messages. The processor 23 may generate only rendering information for displaying the visual information on the user terminal 3. The processor 23 may also present the outputted information to the user without going through the user terminal 3 or other devices.

[0022] <User Terminal 3> Figure 3 is a block diagram showing the hardware configuration of user terminal 3. User terminal 3 comprises a communication bus 30, a communication unit 31, a storage unit 32, a processor 33, a display unit 34, and an input unit 35. These components are electrically connected within user terminal 3 via the communication bus 30. The explanation of the communication unit 31, storage unit 32, and processor 33 is the same as the explanation of each part in the information processing device 2 and is therefore omitted.

[0023] The display unit 34 may be included in the user terminal 3 housing or it may be an external component. The display unit 34 displays a GUI screen that can be operated by the user. This is preferably done by using different display devices such as a CRT display, liquid crystal display, organic EL display, and plasma display depending on the type of user terminal 3.

[0024] The input unit 35 is configured to accept input from the user. The input unit 35 may be included in the casing of the user terminal 3 or it may be an external component. For example, the input unit 35 may be integrated with the display unit 34 and implemented as a touch panel. If it is a touch panel, the user can input tap operations, swipe operations, etc. Of course, instead of a touch panel, a switch button, mouse, QWERTY keyboard, voice recognition device, gesture detection device, gaze detection device, biosignal detection device, imaging device, etc. may be used. In other words, the input unit 35 accepts operation input made by the user. In response, the input unit 35 transmits a signal corresponding to the operation input to the processor 33 via the communication bus 30. The processor 33 can then perform predetermined controls and calculations as needed.

[0025] <Sound Collection Device 4> The information processing system 1 may further include a sound collection device 4. The sound collection device 4 is a so-called microphone configured to convert external sounds into signals. The sound collection device 4 may be directly connected to the user terminal 3 or connected to the information processing device 2. Alternatively, the sound collection device 4 may be built into the user terminal 3.

[0026] The sound collection device 4 is configured to generate audio data by collecting the user's speech. The audio data is temporarily stored in the memory of the user terminal and does not necessarily need to be stored non-volatilely in the storage unit 32. The audio data generated by the sound collection device 4 is configured to be transferable to the information processing device 2 via the network.

[0027] The sound collection device 4 is not particularly limited, but it collects sound in the human audible range, specifically between 20 Hz and 20,000 Hz, and converts it into an electrical signal. The sound may be recorded in mono or stereo. When digitally processing the sound data, the sampling rate may be, for example, 48,000 Hz, 44,100 Hz, 32,000 Hz, 22,050 Hz, 16,000 Hz, 11,025 Hz, 11,000 Hz, 8,000 Hz, etc. Any of the values ​​exemplified here may be used. By increasing the sampling rate, the temporal timing of the sound can be discretized more precisely, thereby improving the accuracy of speech recognition.

[0028] Furthermore, the data collected by the sound collection device 4 may be compressed as appropriate by the processor 33 of the user terminal 3. The compression format can be any of MP3, AAC, WMA, Vorbis, AC3, MP2, FLAC, TAK, etc. Compression can reduce communication traffic caused by data transfer from the user terminal to the information processing device 2.

[0029] 3. Information Processing This section describes the information processing performed in the information processing system 1 mentioned above. As an example, this information processing is configured to make objects placed in the representation space uniquely identifiable using natural language.

[0030] 3.1. Data and Data Structures First, the various data and data structures used in this information processing will be described. These data and data structures may be stored in the storage unit 22, the processor 33, or in other external databases, external servers, etc.

[0031] <Model Data> Model data is data used to represent a model. The model may be a spatial model such as a three-dimensional space model, a two-dimensional space model, or a one-dimensional space model, or a hyperdimensional space model of four dimensions or more, or a spatiotemporal model that includes a time axis in addition to spatial degrees of freedom, or a model that includes other degrees of freedom (for example, field degrees of freedom such as electromagnetic fields or thermal fields). The model data itself may be binary data configured to be decoded based on the data structure DS described above, or it may be managed to explicitly have the data structure DS described later. A model can be represented by at least one object. Therefore, model data is an example of object information relating to at least one object placed in the representation space. The representation space is a space for visually representing objects, and can be described using parameters relating to degrees of freedom that can be represented in the representation space, such as position coordinates that represent spatial positions. As described above, the representation space may be an N-dimensional Euclidean space, a Minkowski space that includes a time axis, a complex space, or a space described by quaternions, and may include any space in which a state can be described.

[0032] <Object Information> Object information includes information about the elements that make up the object. The elements that make up an object may include, for example, zero-dimensional elements that describe the object (e.g., points, especially vertices), one-dimensional elements (e.g., line segments, curves, arcs, circles, etc.), two-dimensional elements (e.g., planes and surfaces), and three-dimensional elements (e.g., cubes, spheres, etc.). These elements of different dimensions are managed in relation to each other. These relationships will be described later.

[0033] <Data Structure> Figure 4 shows an example of the data structure of model data. As shown in Figure 4, model data has a data structure DS called a drawing database. The drawing database is configured to read model data as a data structure. The data structure DS includes, for example, a block table. The block table is configured to describe model data mutually in different types of representation spaces, such as model space, paper space, and block definitions that can be arbitrarily defined by various users. Model space is configured to represent model data as a three-dimensional solid (for example, a CG model such as a polygon). Paper space is configured to represent model data as at least one two-dimensional drawing data. The model represented by model space may be configured to describe elements of other dimensions based on the relationships between one-dimensional elements, such as multiple line segments (first line segment, second line segment, third line segment, etc.), arcs, and circles, as elements that constitute the model. Furthermore, the elements that constitute an object may include the object itself, which constitutes the whole set. In other words, the elements that make up an object may include a portion of the three-dimensional region that constitutes the object, at least a portion of the two-dimensional region that constitutes the three-dimensional region, or at least a portion of the one-dimensional region that constitutes the two-dimensional region. Furthermore, object information may include information about the boundaries of the elements that make up the object.

[0034] <Relationships between elements> Figure 5 is a diagram illustrating the relationships between the elements that make up an object. As shown in Figure 5, object Ob1 is a three-dimensional solid in the shape of a rectangular parallelepiped and has six faces. Each face is enclosed by four edges, and each edge is described as a line segment connecting two vertices. Here, object Ob1 treats the four edges as directed line segments and describes other elements using the order relationship of each directed line segment. Each directed line segment can be described, for example, by the relative position coordinates of its start and end points. The order relationship from the first directed line segment to the second directed line segment can be defined by connecting the end point of the first directed line segment to the start point of the second directed line segment. When multiple such directed line segments form a closed loop, the closed surface bounded by this loop can be described as a two-dimensional element, a continuous surface (especially a plane). Furthermore, the adjacency of faces can be described by the relationship between two directed line segments describing two different faces. Furthermore, vertices can be formed by assigning the identifier "vertex" to the connection relationship between two directed line segments. Curves can be formed by connecting infinitesimal directed line segments. Surfaces can be formed by smoothly connecting infinitesimal surfaces.

[0035] <Identification Code> Each element constituting these objects is assigned an identification code. The identification code is described by a non-natural language code (e.g., a number or a random string) that uniquely identifies the element constituting the object, and is called, for example, an entity ID. The processor 23 accepts the user's non-textual input operation (e.g., touch operation, tap operation, click operation, etc.) to the GUI displayed on the display unit 34, identifies the identification code of the element to be operated on according to the input operation, and can execute the operation. However, the identification code itself is determined independently of the context of the element (e.g., randomly). Context refers to the meaning of the elements constituting the object as perceived or intended by the user (e.g., common name, function, part, appearance, relative positional relationship from the user's perspective, etc.). Therefore, by allowing the user to identify the elements constituting the object to be operated on using text input (especially natural language input), it may be possible to perform more efficient operations on the object through the CUI.

[0036] <Reference Information> Reference information is information for assigning attributes to elements that constitute an object, which can be managed under a predetermined namespace, and it shows the correspondence between each attribute and the state of the object's elements. An attribute is a code that represents the "context" described above, and is written in natural language, for example. Attributes may include naming attributes relating to the name of the object or the object represented by the elements that constitute the object. Figure 6 shows an example of reference information IF1 that includes naming attributes. The reference information IF1 shown in Figure 6 hierarchically represents the concept of a structure called "house". For example, reference information IF1 indicates that the structure called "house" is associated with the highest level (for example, the level that represents an entire set of objects), and that the house includes (or is composed of) walls, a roof, a front door, windows, pillars, and rooms. Reference information IF1 is specified to show the correspondence between these natural language identifiers and the elements that constitute the object included in the imported model. In other words, reference information can be associated with naming attributes corresponding to each of the elements that constitute the object. This configuration allows for the use of natural terminology when specifying objects, thereby improving user convenience when specifying objects. Reference information IF1 is configured to allow the assignment of terminology attributes to each object included in the imported model by associating it with model data that has these terminology attributes pre-assigned to the positional relationships of each element included in a house (for example, walls extend from the floor, the roof is placed on the floor, the entrance is located on one of the walls, etc.) and to the elements that make up multiple sample objects representing a "house".

[0037] Furthermore, attributes may include positional attributes that describe the positional relationships within or between the elements constituting an object using natural language. Figure 7 shows an example of reference information IF2 that includes positional attributes. As shown in Figure 7, reference information IF2 may include positional relationships such as center, front, back, left, right, top, bottom, outer edge, inner edge, etc. For example, a partial element contained within an element (e.g., face A) can be expressed using reference information IF2 as "the central part of face A," "the front part of face A," "the outer edge of face A," "the inner edge of face A," etc. Each of these parts may be assigned a non-natural language identification code. Each of these positional attributes may be associated with a predetermined determination formula (e.g., coordinate comparison between objects). Positional attributes can describe the positional relationships between the elements constituting an object (e.g., one object is located to the left of another object). Note that the positional relationships within the elements constituting an object can also be expressed as the positional relationships between those elements.

[0038] Furthermore, attributes may include shape information that describes the shape of the elements constituting an object using natural language. Figure 8 shows an example of reference information IF3 that includes shape attributes. As shown in Figure 8, reference information IF3 can describe shape attributes using modifying natural language clauses that represent the shape, such as "flat," "wide," "angular," "curved," and "bent." These shape attributes can be defined in association with conditions that assign the attribute, such as determination conditions based on the connection relationships of line segment elements (for example, indicating "angular" if the angle between line segment elements is greater than or equal to a predetermined value).

[0039] Furthermore, attributes may include appearance attributes relating to the appearance of the elements that make up an object. Figure 9 shows an example of reference information IF4 that includes appearance attributes. Appearance attributes may include, for example, attributes representing colors such as "red," "yellow," "blue," and "green," attributes representing patterns such as "striped," "checkerboard," and "triangular grid," and attributes representing textures such as "smooth," "rough," and "rough." These attributes may be defined in association with discrimination conditions based on texture information assigned to the object (e.g., RGB values, type of material texture, etc.).

[0040] Thus, reference information can be configured to hierarchically represent the relative relationships of the elements that make up an object (for example, the "wall" of the "house," the "left part" of the "floor" of the "house," etc.).

[0041] The specific form of the reference information may be a table linking "terms" and "judgment conditions" as described above, a hierarchical network model describing knowledge, or a pre-trained model (especially a generative AI model). A pre-trained model can be trained, for example, by machine learning using a training dataset that includes model data describing objects to which natural language attributes, different from the identification codes, have been assigned in advance.

[0042] 3.2. Flow of Information Processing for Assigning Attributes Figure 10 is an activity diagram showing an example of the flow of information processing for assigning attributes, which is performed in the information processing system 1. Note that this information processing may include any exception handling not shown. Exception handling includes interrupting the information processing or omitting each process. The selection or input performed in this information processing may be based on user operation or may be performed automatically without user operation.

[0043] [Action A1] As shown in Figure 10, first, in Action A1, the processor 33 accepts model data input from the user. The model data input may be existing model data created by the user, or it may be model data of the template model to be generated.

[0044] [Action A2] Next, in action A2, the processor 33 defines a model space as an expression space based on the model data. Thereby, a space in which an object can be arranged is virtually obtained.

[0045] [Action A3] Next, in action A3, the processor 33, acting as an acquisition unit, acquires object information related to at least one object arranged in the expression space for visually representing the object. When the model data is blank model data in which no object is arranged, the processor 33 may appropriately acquire information related to an object newly arranged in the model space as the object information.

[0046] [Action A4] Next, in action A4, the processor 33 assigns an identification code to each of the elements constituting the acquired object. The identification code may be defined by, for example, a natural number. The identification code may be assigned as a different value each time the model space is defined.

[0047] [Action A5] Next, in Action A5, the processor 33, acting as an assigning unit, assigns the above-mentioned attributes different from the identification code to the elements constituting the object based on the object information and predefined reference information. As described above, the attributes are described in natural language. For example, the processor 33 may acquire a list of attributes of the elements constituting the object (for example, the attributes representing each element constituting the "house" shown in FIG. 6), which is output by inputting the object information and the context representing the entire object into a predefined trained model, identify the corresponding determination condition of the reference information from the list, and assign the corresponding attribute to the object information (for example, shape, positional relationship, etc.) that satisfies the determination condition. In other words, by inputting information related to the object into a trained model that has been trained based on predefined reference information, the processor 33 may assign the output related to each of the elements constituting the object from the trained model (for example, generative AI) to the elements constituting the object as an attribute. According to such a configuration, when one object includes a large number of elements, the time for assigning attributes to each of the elements can be shortened. At this time, the processor 33 preferably assigns attributes to all of the elements constituting the object. According to such a configuration, the possibility that an element constituting an unspecifiable object occurs can be reduced.

[0048] At this time, for example, the processor 33 may assign a position attribute to the elements constituting the object based on the positional relationship between the elements constituting the object. Further, the processor 33 may assign attributes according to the boundaries of the elements constituting the object. According to such a configuration, since information related to the shape can be assigned as an attribute through natural language, the elements can be specified more intuitively in language. For example, the processor 33 may assign shape attributes such as square, triangle, and circle according to the mode of loop connection of directed line segments that are the minimum units of the elements constituting the object.

[0049] Subsequently, the processor 33 determines whether to terminate the attribute assignment. If it determines to continue assigning attributes, the processor 33 continues processing action A5 and iteratively assigns or modifies attributes. For example, the processor 33 may assign a higher-level naming attribute (in other words, a higher-level conceptual naming) to the elements constituting the object, and then assign lower-level naming attributes belonging to that higher-level naming attribute. After that, the processor 33 may assign naming attributes up to a predetermined level, and then assign position attributes, etc., in association with the naming attributes at each level. The processor 33 may also assign new attributes in response to user input.

[0050] [Action A6] When the assignment of attributes is complete, the process proceeds to Action A6. In Action A6, the processor 33 executes a management process, and as a management unit, manages the elements that constitute the object in the namespace corresponding to the assigned attributes in a manner that can be uniquely identified using natural language. With this configuration, since the elements that constitute the object can be identified using natural language, for example, a user can intuitively specify the elements of an object placed in the representation space using natural language rather than non-natural language such as an identification number.

[0051] For example, the processor 33 can manage the elements of an object in a hierarchical namespace relating to the attributes of the elements that make up the object, based on the hierarchical structure of the elements that constitute the object. With such a configuration, for example, even if there are multiple elements of the same type of object and the attributes of each individual element of that object are identical, they can be managed in different namespaces based on the hierarchical structure. Therefore, it becomes easier to manage the elements of the same type of object. For example, the processor 33 can uniquely identify the modifying relationships of each element that makes up an object representing "house" in a hierarchical namespace, such as "house / floor", "house / wall", "house / roof", "house / entrance", and "house / window".

[0052] As an alternative example, the processor 33 may manage the elements constituting an object assigned the same designation attribute in a manner that allows for unique identification using natural language on a namespace based on positional attributes. With such a configuration, for example, when there are objects with the same designation, the user can intuitively specify the element while managing them uniquely by their positional relationship. For example, the processor 33 may manage the objects of each "pillar" on a namespace so that for objects assigned the same designation attribute (for example, multiple "pillars" in a "house"), additional positional attributes such as "center pillar," "right pillar," "front pillar," and "pillar closest to the entrance" are assigned according to their relative positional relationship. In this case, the "center pillar" may be managed hierarchically, for example, as "house / room / pillar / center," and the "right pillar" as "house / room / pillar / right." Note that front, back, left, and right can be identified according to the positional relationship of the elements constituting the object, regardless of the coordinate system. For example, in the case of a "house," the direction in which the object corresponding to the "entrance" is positioned from a point in the "room" is defined as "front," the opposite direction of this "front" is defined as "back (rear)," the direction in which the "floor" is located is defined as "down," the direction in which the "roof" is located is defined as "up," and the directions orthogonal to these are defined as "left" and "right." Therefore, the processor 33 can manage the attributes assigned to elements regardless of the coordinate system of the representation space. With this configuration, since the attributes are maintained even when the coordinate system changes, for example, when multiple users share an object, the terminology used to specify the object can be standardized even if the users use different coordinate systems. The coordinate system can be arbitrary, such as the Cartesian coordinate system, cylindrical coordinate system, or polar coordinate system. By iteratively performing the assignment or modification of such attributes, the accuracy of attribute assignment can be further improved.In particular, the processor 33, based on the input of a command statement from the user to a trained model such as a generation AI that includes the attributes of the entire object (especially the naming attribute), causes the generation AI to mechanically output the attributes of the elements constituting the object with initial values, and by comparing these initial values ​​with predetermined dictionary data, modifies them to attributes that align with the user's intuition, and by iteratively generating or modifying such intuitive attributes, the attributes can be managed hierarchically so that they can be uniquely identified in the namespace. With such a configuration, it is possible to manage objects using character information in a unified manner with higher accuracy than when simply using a generation AI.

[0053] After that, the processor 33 terminates this information processing.

[0054] 3.3 Relationship between Attributes and Elements Constituting an Object Next, we will explain the relationship between attributes assigned to the elements constituting an object through the above information processing. Figure 11 is a diagram showing an example of attributes assigned to the object shown in Figure 5. As shown in Figure 11, each of the loop structures corresponding to the six faces of the rectangular "box" object Ob1 is assigned an attribute that can identify the "face," and these nominal attributes of "face" (which are also shape attributes) are subordinate to the nominal attribute of "box." Also, since the six "face" attributes overlap, these faces are assigned attributes such as "front," "right face," and "top face" in conjunction with the position attribute to ensure that they do not overlap and are uniquely determined. In this case, attributes such as "front," "right," and "top (upper)" are subordinate to the "faces" belonging to the "box," for example. In addition, the boundary represented by the loop structure, which is an example of an element constituting an object, is assigned the attribute "outer perimeter (edge)." Since this attribute indicates the boundary of a "face," it is subordinate to the "face." Furthermore, the "perimeter" is defined by four directed line segments that constitute a loop structure, and each of these four directed line segments is assigned the attribute of "end". The "end" is an element that constitutes the "face" or "perimeter" and is subordinate to these attributes. Here, since the four "ends" overlap with the "front," each directed line segment is managed in a way that makes it uniquely identifiable using positional attributes such as "bottom end," "top end," "right end," and "left end." Also, each directed line segment can be divided and assigned attributes such as "center," "right part," and "left part." In addition, the X, Y, and Z directions in the model space can also be redefined based on the elements that constitute the object. In other words, the processor 33 may assign attributes to the direction describing the representation space based on the attributes (especially positional attributes) assigned to the elements that constitute the object.

[0055] 3.4. Information Processing for Executing Operations on Objects Next, we will explain the information processing for executing operations on objects using the attributes assigned by the information processing described above. Figure 12 is a diagram showing the activity flow for information processing to execute operations on objects.

[0056] [Action A11] As shown in Figure 12, first, in Action A11, the processor 33 performs an input reception process, and as an input reception unit, it receives input of a command statement from the user as character information for specifying the elements that constitute an object. The command statement is defined in natural language (not limited to complete sentences, but may include a sequence of words). In other words, in this information processing, the processor 33 accepts character input via CUI. Note that this does not mean that it refuses to accept GUI input. The command statement may include first character information that can identify an attribute and second character information that can identify the operation content on the elements that constitute the object. The first character information is configured to identify an attribute that is attached to the object and managed in the namespace, for example, "right column". The first character information can select elements that constitute multiple objects that can be operated on. The second character information defines the type of operation, for example, and may include combining, deleting, smoothing, changing color, etc.

[0057] The method for inputting commands is not limited to input via a keyboard, which is one example of input to the input unit 35; it may also be voice input via a microphone or the like. In other words, the processor 33 may function as a voice input unit and accept voice input from the user. In this case, the processor 33 may generate character information based on the voice input and accept the generated character information as a command. With such a configuration, object operations can be performed naturally by voice, thus providing a system that enables more convenient object operations.

[0058] [Action A12] Next, in action A12, the processor 33 performs an operation identification process to identify the elements that constitute the object to be operated on (for example, the object identified by the first character information) and the operation performed on the object, based on the received instruction statement. For example, the processor 33 performs natural language processing on the received instruction statement to identify the elements that constitute the object having attributes represented by the first character information as the object to be operated on (or a candidate for the object to be operated on), and identifies an operation that can perform the operation corresponding to the second character information. Note that any form of instruction statement is not limited to instruction statements containing the first and second character information, as long as the operation can be uniquely identified. Here, the operation performed on the object may include an identification operation. An identification operation is an operation that requires the process of assigning a new identification code to the elements that constitute the object on which the identification operation was performed, and includes, for example, an operation based on a Boolean operation on the elements that constitute the object. With this configuration, even if the identification code of an existing object is changed by an operation that adds elements to a new object using Boolean operations (for example, an operation that creates holes or grooves in a plane, or an operation that combines objects), the existing object can still be identified based on the attributes that were assigned before the particular operation. Boolean operations may include, for example, union operations that combine two shapes, difference operations that cut out one shape from another, and multiplication operations that remove the intersection of two shapes. Such operations significantly change the topology information of an object because the shapes before and after the operation cannot be reversibly obtained through continuous deformation. Therefore, since a new topology is created with the change in topology information, the existing identification code cannot be reused.

[0059] [Action A13] Next, in action A13, the processor 33 executes an operation based on the result of the operation identification process performed in action A12. As a result, the processor 33 executes the operation identified by the second character information on an element that defines an object belonging to a namespace defined by an attribute identified by the first character information. With this configuration, operations on elements constituting an object that is intuitively associated by attributes can be intuitively executed by character input using natural language. Therefore, for example, a more user-friendly CUI can be provided. If the identified operation is a specific operation, the processor 33 can execute the specific operation on the elements constituting the object.

[0060] [Action A14] Subsequently, if the operation is a Boolean operation, in Action A14, the processor 33 reassigns an identification code to the processor 33 that has the new topology information. Since the identification code is reassigned regardless of whether the topology has changed or not, in order to identify the target of the operation in the CUI based on the identification code, it is necessary to keep track of the newly assigned identification code one by one.

[0061] [Action A15] Subsequently, in Action A15, the processor 33 assigns attributes to the elements constituting the object based on the object information and reference information, so as to maintain the attributes. At this time, the processor 33 may restrict the attributes to be assigned again based on existing attributes so as to maintain the attributes that have already been assigned to the elements constituting the object. In other words, the processor 33 can manage the elements constituting the object in a namespace using common attributes before and after a particular operation in a manner that allows for unique identification using natural language. With such a configuration, for example, even if it is necessary to assign a new identification code by changing the topology of the object, the elements constituting the object to which attributes have already been assigned can be specified using a common natural language before and after a particular operation. Note that the specific manner of this process is arbitrary as long as the already assigned attributes are maintained, and it is not necessary to use object information or reference information.

[0062] [Action A16] Next, in action A16, the processor 33 manages the attributes in a namespace. This allows the attributes assigned to the new topology information to be consistently managed in the namespace obtained before the operation and the corresponding namespace (including the same namespace).

[0063] [Action A17] Subsequently, in Action A17, the processor 33 displays the operation result on the display unit 34. If the operation performed in Action A13 is an operation other than a specific operation, the processor 33 omits the processing of Actions A14 to A16 and executes the processing of Action A17.

[0064] After that, the processor 33 terminates this information processing.

[0065] 3.5. Changes in Topological Information in Specific Operations and Management in Namespaces Based on Attributes Next, we will explain the changes in topology information and management in namespaces based on attributes when specific operations are performed in the information processing described in the previous section. Figure 13 is a diagram showing the relationship between changes in topology information and attributes when specific operations are performed on the object shown in Figure 11. The specific operation performed here is an operation that includes a difference operation, which creates a round hole on the top surface of the "box" object Ob1. In Figure 13, for the sake of explanation, the object before the specific operation is performed is denoted as Ob1, and the object after the specific operation is performed is denoted as Ob2.

[0066] As shown in Figure 13, the top surface of object Ob1 before the operation is defined using only one loop defined by four directed line segments, whereas the top surface of object Ob2 after the operation has a discontinuous boundary defined by a circle inside that loop. As a result, various elements that constitute objects related to the hole are newly generated, such as a circle separating the hole from the top surface, the side surface of the hole continuous with the hole, and the space defined by the side surface.

[0067] The processor 33 assigns new attributes to object information, including elements that constitute the new object generated by such a specific operation, based on attributes managed in an existing namespace. In this embodiment, the processor 33 assigns the attribute "round hole" subordinate to "top surface" to the newly generated circle, and assigns the attribute "side surface" (side surface of the round hole) subordinate to "round hole" to the surface generated as a result of a difference operation extending from the circle. The processor 33 may also manage the new attributes in the namespace in a multi-level hierarchical structure, such as "round hole" in the "center" of the "top surface".

[0068] 3.6. Screen Examples Next, an example of a screen displayed on the display unit 34 in the information processing for performing operations on the above object will be described. Figure 14 is an example of an operation screen displayed on the display unit in the information processing for performing operations on an object. As shown in Figure 14, the operation screen 5 displayed on the display unit 34 may include an object display area 51, a history area 52, and an input area 53.

[0069] The object display area 51 is an area for visually displaying the representation space (e.g., model space) and the objects placed within the representation space. Users can input GUI operations on objects by performing mouse or touch operations on the object display area 51.

[0070] The history area 52 is an area that displays a history of operations performed on an object (which may include not only operations instructed by the user, but also operations performed automatically by the system).

[0071] The input area 53 is an area for the user to input a command statement. This input can be as text information, for example, "Please make a round hole on the top of the box." The processor 33 executes an operation based on the input content in the input area 53. In this case, "top of the box" corresponds to the first piece of text information, and "Please make a round hole" corresponds to the second piece of text information. In this case, a round hole of appropriate dimensions may be formed in any area of ​​the top of the box. For example, the object Ob2 shown in Figure 13 is displayed in the object display area 51 as an object representing the latest model.

[0072] The input area 53 may include a voice input button 531. When the voice input button 531 is operated, the processor 33 requests voice input using the sound collection device 4 and displays a command statement identified based on the input voice information in the input area 53.

[0073] The processor 33, through the above information processing, assigns natural language attributes that the user can recognize as concepts to the elements constituting an object, and manages these attributes in a namespace according to a conceptual hierarchical structure, thereby providing the user with intuitive GUI operations on a vast number of elements constituting an object.

[0074] In other words, the processor 33 assigns attributes to the elements that make up an object so as to form a projection from the semantic space represented by the namespace to the instance space. This allows the processor 33 to make the namespace corresponding to the assigned attributes function as a semantic space, and to manage the elements that make up the object while preserving relationships, hierarchy, order, symmetry, etc.

[0075] 4. The above embodiments may be modified as follows:

[0076] The processor 33 may accept input regarding attribute changes. For example, the processor 33 may accept a command statement that changes attributes related to direction or positional relationship, such as "Set the currently largest displayed face to the front of the box." In this case, the processor 33 may update the positional attributes representing up, down, front, back, left, and right, based on the relationship between the attributes of the largest displayed face among the displayed contents in the object display area 51 and the elements constituting other objects relative to that face.

[0077] The above reference information is optional, as long as it allows attributes to be assigned to the elements that make up the object, and may be specified to include generated AI.

[0078] The above information processing is not limited to computer-aided design, but can be applied to any design or simulation, such as disaster evacuation routes, air conditioning simulations, heat conduction, electromagnetic interference, and structural design under specific environmental conditions.

[0079] In the above embodiment, a so-called on-premise configuration was adopted in which the user terminal 3 performs information processing. However, the above information processing may also be performed in a cloud configuration by the information processing device 2 based on the information input to the user terminal 3. As a cloud-based information processing device 2, for example, the above functions and processing may be provided in the form of SaaS (Software as a Service) or cloud computing.

[0080] In the above embodiment, the information processing device 2 performed various storage and control functions, but instead of the information processing device 2, multiple external devices may be used. That is, various information and programs may be distributed and stored across multiple external devices using blockchain technology or the like.

[0081] The above embodiment is not limited to the information processing system 1, but may also be an information processing method or an information processing program. The information processing method includes each step of the information processing system 1. The program causes at least one computer to execute each step of the information processing system 1.

[0082] The above-mentioned information processing system 1, etc., may be provided in any of the following embodiments.

[0083] (1) An information processing system comprising at least one processor capable of executing a program such that the following steps are performed, wherein in the acquisition step, object information relating to at least one object placed in a representation space for visually representing an object is acquired, the object information includes information relating to the elements constituting the object, in the assignment step, attributes different from an identification code are assigned to the elements constituting the object based on the information relating to the object and predetermined reference information, the attributes are described in natural language, the reference information indicates the correspondence between each attribute and the state of the elements of the object, and in the management step, the elements constituting the object are managed in a manner that can be uniquely identified using natural language in a namespace corresponding to the attributes.

[0084] With this configuration, it is possible to identify the elements that make up an object using natural language. For example, a user can intuitively specify the elements of an object placed in the representation space using natural language, rather than using non-natural language such as identification numbers.

[0085] (2) In the information processing system described in (1) above, the reference information is configured to hierarchically represent the relative relationships of the elements constituting the object, and in the management step, the elements of the object are managed in a hierarchical namespace relating to the attributes of the elements constituting the object, based on the hierarchical structure of the elements constituting the object.

[0086] With this configuration, for example, even if multiple elements of the same type of object exist and the attributes of each individual element of that object are identical, they can be managed in different namespaces based on the hierarchical structure. Therefore, it becomes easier to manage elements of the same type of object.

[0087] (3) In the information processing system described in (1) or (2) above, the attribute includes a naming attribute relating to the naming of an object represented by the object or the elements constituting the object, and the reference information is associated with the naming attribute corresponding to each of the elements constituting the object.

[0088] This configuration allows for the use of natural terminology when specifying objects, thereby improving the user's convenience when selecting objects.

[0089] (4) The information processing system described in (3) above, wherein the attribute includes a position attribute that describes the positional relationship among the elements constituting the object, or the positional relationship between the elements constituting the object, using natural language, and in the management step, the system further assigns the position attribute to the elements constituting the object based on the positional relationships between the elements constituting the object, thereby managing the elements constituting the object that have been assigned the same naming attribute in a manner that allows them to be uniquely identified in a namespace using natural language based on the position attribute.

[0090] With this configuration, for example, when objects with the same name exist, they can be uniquely managed based on their positional relationship, while the user can intuitively specify the element.

[0091] (5) An information processing system according to any one of (1) to (4) above, wherein the object information includes information relating to the boundaries of the elements constituting the object, and in the assignment step, the attributes are assigned according to the boundaries of the elements constituting the object.

[0092] With this configuration, information about the shape can be assigned as attributes through natural language, allowing elements to be specified more intuitively using language.

[0093] (6) An information processing system according to any one of (1) to (5) above, wherein in the management step, the system manages the attributes assigned to the elements regardless of the coordinate system of the representation space.

[0094] With this configuration, attributes are maintained even when the coordinate system changes. For example, when multiple users share an object, the terminology used to specify the object can be standardized even if the users use different coordinate systems.

[0095] (7) An information processing system according to any one of (1) to (6) above, wherein the specific operation step is to perform a specific operation on the elements constituting the object, the specific operation is an operation that requires the process of newly assigning the identification code that has been assigned to the elements constituting the object on which the specific operation was performed, and the management step is to manage the elements constituting the object in a namespace using the common attribute before and after the specific operation in a manner that can be uniquely identified using natural language.

[0096] With this configuration, for example, even when it is necessary to assign a new identification code by changing the topology of an object, the elements that make up an object to which attributes have already been assigned can be specified using a common natural language before and after a particular operation.

[0097] (8) In the information processing system described in (7) above, the specific operation includes an operation based on a Boolean operation on the elements constituting the object.

[0098] With this configuration, even if the identification code of an existing object is changed by an operation that adds elements to a new object using Boolean operations (for example, an operation that creates holes or grooves in a plane, or an operation that combines objects), the existing object can still be identified based on the attributes that were assigned to it before the particular operation.

[0099] (9) An information processing system according to any one of (1) to (8) above, wherein in the input reception step, the system receives input of character information from a user for specifying the elements constituting the object, the character information is defined in natural language and includes first character information that can identify the attribute and second character information that can identify the content of an operation on the elements constituting the object, and in the operation step, the system causes the system to perform the operation specified by the second character information on the element that defines the object belonging to the namespace defined by the attribute specified by the first character information.

[0100] With this configuration, operations on the elements constituting an object, which are intuitively mapped by attributes, can be performed intuitively using natural language input. Therefore, for example, a more user-friendly CUI can be provided.

[0101] (10) The information processing system described in (9) above, further comprising: a voice input step, which receives voice input from the user; and an input reception step, which generates the character information based on the voice input.

[0102] With this configuration, object manipulation can be performed naturally using voice commands, thus providing a system that enables more convenient object manipulation.

[0103] (11) An information processing system according to any one of (1) to (10) above, wherein in the assignment step, information about the object is input to a trained model that has been trained based on predetermined reference information, thereby assigning the output of the trained model for each of the elements constituting the object as attributes to the elements constituting the object.

[0104] This configuration allows for a reduction in the time required to assign attributes to each element when an object contains a large number of elements.

[0105] (12) An information processing system according to any one of (1) to (11) above, wherein the elements constituting the object include a part of the three-dimensional region constituting the object, at least a part of the two-dimensional region constituting the three-dimensional region, or at least a part of the one-dimensional region constituting the two-dimensional region.

[0106] (13) An information processing method comprising each step of the information processing system described in any one of (1) to (12) above.

[0107] (14) A program that causes at least one computer to perform each step of the information processing system described in any one of (1) to (12) above. Of course, this is not limited to this.

[0108] Finally, while various embodiments relating to this disclosure have been described, these are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be implemented in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims and their equivalents.

[0109] 1: Information processing system, 2: Information processing device, 20: Communication bus, 21: Communication unit, 22: Storage unit, 23: Processor, 3: User terminal, 30: Communication bus, 31: Communication unit, 32: Storage unit, 33: Processor, 34: Display unit, 35: Input unit, 4: Sound collection device, 5: Operation screen, 51: Object display area, 52: History area, 53: Input area, 531: Voice input button, DS: Data structure, IF1-IF4: Reference information, Ob1, Ob2: Objects

Claims

1. An information processing system comprising at least one processor capable of executing a program such that the following steps are performed: an acquisition step, which acquires object information relating to at least one object placed in a representation space for visually representing an object; the object information includes information relating to the elements constituting the object; an assignment step, which assigns attributes different from an identification code to the elements constituting the object based on the information relating to the object and predetermined reference information; the attributes are described in natural language; the reference information indicates the correspondence between each attribute and the state of the elements of the object; and a management step, which manages the elements constituting the object in a namespace corresponding to the attributes in a manner that allows for unique identification using natural language.

2. An information processing system according to claim 1, wherein the reference information is configured to hierarchically represent the relative relationships of the elements constituting the object, and in the management step, the elements of the object are managed in a hierarchical namespace relating to the attributes of the elements constituting the object, based on the hierarchical structure of the elements constituting the object.

3. An information processing system according to claim 1 or 2, wherein the attribute includes a naming attribute relating to the naming of an object or an element constituting the object, and the reference information is associated with the naming attribute corresponding to each of the elements constituting the object.

4. The information processing system according to claim 3, wherein the attribute includes a position attribute that describes the positional relationship among the elements constituting the object, or the positional relationship between the elements constituting the object, using natural language, and in the management step, the system further assigns the position attribute to the elements constituting the object based on the positional relationships between the elements constituting the object, thereby managing the elements constituting the object to which the same designation attribute has been assigned in a manner that allows them to be uniquely identified in a namespace using natural language based on the position attribute.

5. An information processing system according to any one of claims 1 to 4, wherein the object information includes information relating to the boundaries of the elements constituting the object, and the assignment step assigns the attributes according to the boundaries of the elements constituting the object.

6. An information processing system according to any one of claims 1 to 5, wherein the management step manages the attributes assigned to the elements regardless of the coordinate system of the representation space.

7. An information processing system according to any one of claims 1 to 6, wherein in a specific operation step, a specific operation is performed on the elements constituting the object, the specific operation is an operation that requires the process of newly assigning the identification code that has been assigned to the elements constituting the object on which the specific operation was performed, and in a management step, the elements constituting the object are managed in a manner that can be uniquely identified using natural language in a namespace using the common attribute before and after the specific operation.

8. The information processing system according to claim 7, wherein the specific operation includes an operation based on a Boolean operation on the elements constituting the object.

9. An information processing system according to any one of claims 1 to 8, wherein in an input reception step, the system receives input of character information from a user for specifying elements constituting the object, the character information is defined in natural language and includes first character information that can identify the attribute and second character information that can identify the content of an operation on the elements constituting the object, and in an operation step, the system causes the user to perform the operation specified by the second character information on the element that defines the object belonging to the namespace defined by the attribute specified by the first character information.

10. An information processing system according to claim 9, wherein the voice input step further includes receiving voice input from the user, and the input reception step includes generating the character information based on the voice input.

11. An information processing system according to any one of claims 1 to 10, wherein in the assignment step, information about the object is input to a trained model that has been trained based on predetermined reference information, thereby assigning the output of the trained model regarding each of the elements constituting the object as attributes to the elements constituting the object.

12. An information processing system according to any one of claims 1 to 11, wherein the elements constituting the object include a part of a three-dimensional region constituting the object, at least a part of a two-dimensional region constituting the three-dimensional region, or at least a part of a one-dimensional region constituting the two-dimensional region.

13. An information processing method comprising each step of an information processing system according to any one of claims 1 to 12.

14. A program that causes at least one computer to perform each step of the information processing system described in any one of claims 1 to 12.