Design tradeoff in interactive design development

Abstract

Designing an object in an interactive design environment is performed by capturing information from a user's interaction, arranging the information into a knowledge graph. When the user changes an aspect of the design, at least one other aspect of the design that is affected by the change of the user is identified. The influence is identified and visualized by checking the knowledge graph. A user interface of the interactive design environment provides the ability to edit the knowledge graph. The visualization can be displayed to the user in real time. The visualization may include a radar map indicative of affected aspects of the design. Visualization may highlight violations to constraints, or based on past design metrics in captured interactions. If the design metrics fall outside the range of past designs, detailed evaluation may be performed on changes in a first aspect of the design.

Description

Technical Field

[0001] This application relates to a collaborative design environment. Background Technology

[0002] Product design typically involves multiple aspects, encompassing a wide range of expertise across the entire product lifecycle, including performance and aesthetics. Often, product designs are evaluated incrementally by different experts. For example, mechanical engineers, design engineers, manufacturing engineers, materials engineers, user experience designers, and even customers may test multiple design versions and iterations. When one stakeholder implements a change to meet their specific requirements, other stakeholders must re-evaluate the overall design to ensure the implemented changes do not affect the requirements of another stakeholder. For instance, reducing the thickness of a part to lower material costs may adversely affect other aspects, such as structural performance or reduced stiffness. Therefore, product design iterations must produce a design that meets all product requirements. This can be done by human experts or through offline design space exploration and optimization software to generate outputs without user interaction during design generation. Interactive environments, such as those involving metaverse-like structures, allow different people to work in separate, independent environments and collaborate on many aspects of computer-aided design (CAD) design. However, without simultaneous input from other experts, engineers lack a direct method to examine trade-offs for different requirements in a real-time environment. A method is needed for real-time trade-off analysis in multidisciplinary design environments. Summary of the Invention

[0003] According to the embodiments described in this disclosure, a method for designing objects in an interactive design environment includes: capturing information from user interactions with the interactive design environment and arranging the captured information in the form of a knowledge graph. When a user changes an aspect of the design in the interactive design environment, at least one other aspect of the design affected by the user's change is identified. Potential impacts are identified and visualized by examining the knowledge graph. The affected aspect of the design may be a key performance indicator (KPI) or a design requirement. The user interface of the interactive design environment provides the ability to edit the knowledge graph. Editing the knowledge graph may include adding or removing nodes and edges, or editing the feasible range of design metrics. Future design actions may be guided based on the captured information and the knowledge graph. The visualization of the impact on at least one other aspect of the design may be displayed to the user in real time. The visualization may include a radar chart indicating the aspects of the design affected by the change proposed for the first aspect of the design. The visualization may also highlight violations of design constraints resulting from the change proposed for the first aspect of the design, or highlight the range of metrics based on past designs stored in the captured interactions. If design metrics fall outside the range of past designs, a detailed evaluation of the change for the first aspect of the design can be performed.

[0004] According to one embodiment, a system for designing objects in an interactive design environment includes a computer processor and a non-transitory computer memory in communication with the computer processor. The non-transitory computer memory stores machine-readable instructions that, when executed by the computer processor, cause the computer to perform the following steps: capturing information from user interaction with the interactive design environment; arranging the captured information into the form of a knowledge graph; identifying at least one other aspect of the design affected by the user's change in the knowledge graph, given that the user has changed a first aspect of the design in the interactive design environment; and creating a visualization of the impact on the at least one other aspect of the design. The at least one other aspect of the design may be a design KPI or a design requirement. The system may include a user interface for the interactive design environment configured to edit the knowledge graph. Editing the knowledge graph may include performing at least one of the following: adding or removing nodes and adding or removing edges, or editing the feasible range of design metrics. The system may also display the visualization of the impact on the at least one other aspect of the design to the user in real time. According to one embodiment, a radar chart indicates changes to the at least one other aspect of the design caused by a change proposed in the first aspect of the design. Attached Figure Description

[0005] The above and other aspects of the invention are best understood from the following detailed description when read in conjunction with the accompanying drawings. For the purpose of illustrating the invention, the drawings show currently preferred embodiments; however, it should be understood that the invention is not limited to the specific means disclosed. The drawings include the following figures: Figure 1 This is an illustration based on multidisciplinary design considerations according to embodiments of this disclosure.

[0006] Figure 2 This is a schematic diagram of a system for visualizing trade-offs in design changes according to embodiments of this disclosure.

[0007] Figure 3 This is a flowchart illustrating the process of weighing trade-offs in implementing visual design changes according to embodiments of this disclosure.

[0008] Figure 4 This is a block diagram of a computer system for visualizing design trade-offs according to embodiments of the present disclosure. Detailed Implementation

[0009] Figure 1 Illustrations are provided for the multidisciplinary design of products such as the Bike 101. Various key performance indicators (KPIs) related to the performance of the Bike 101 can be specified by the manufacturer to achieve the performance levels expected by customers, or for marketing purposes to deliver the benefits of the Bike 101. Figure 2 The document provides two performance metrics, 103 and 105. These include aesthetics 107, which provides the overall look and feel of the bicycle design to produce a bicycle 101 that meets the desired appearance of the final product. Ergonomics 109 provides requirements for providing comfort and ease of operation for the user of the bicycle 101. Standards and regulations 111 (such as wheel diameter or general safety requirements applied to bicycles) can be considered additional requirements. The materials used to construct the bicycle 101 have associated costs 113 that may need to be managed. The manufacturing process provides measures 114 that may affect construction time or build quality. An expected product lifespan 115 can be provided, which must be met to meet market expectations. Other considerations (such as sustainability 116) are increasingly important to both manufacturers and consumers. Transportation costs 117 to bring the product to market increase overall costs, and efforts can be made to reduce transportation costs 117 to lower the final price of the product. The requirements arising from all these disciplines are cumulative, and changes in one discipline may affect the ability of another discipline to comply with its requirements.

[0010] Interactive design environments allow multiple designers or engineers to work within the same design environment. According to the embodiments described in this disclosure, knowledge is captured of how different users modify the design and how these modifications relate to design requirements across different disciplines. For example, this knowledge can be captured and stored in the form of a knowledge graph. The stored knowledge can be used to guide future design decisions and actions. For instance, when a new user modifies a first aspect of the design in the interactive design environment, other KPIs or requirements that may be affected by that change are identified and visualized in the user interface. The impact of the proposed change can be identified through prior knowledge or determined through the results of performance evaluations, such as those performed during simulation. This allows users to visualize and consider the trade-offs arising from the proposed change relative to its impact on other KPIs. These trade-offs can be displayed in real-time or near real-time, so that users are aware of the impact of the change when it is created in CAD tools.

[0011] Figure 2 This is an illustration of an interactive design environment that provides trade-off analysis according to certain embodiments of this disclosure. Environment 200 includes multiple components. Knowledge database 203 stores data from past design data, including design variables and requirement metrics across various disciplines. User interface 201 allows users to import existing data. Additional new design data is also acquired when the user interacts with the design in the interactive design environment 200.

[0012] Knowledge graph 205 is constructed based on data and variables defined in knowledge database 203. Knowledge graph 205 depicts the relationships between design variables and design metrics extracted from knowledge database 203. This data can be extracted using known techniques, including statistical methods such as data correlation mining. Nodes in knowledge graph 205 represent aspects of the design, such as dimensions, weight, material cost, manufacturing cost, performance, etc. Edges connecting two nodes represent the relationship between those two nodes. For example, material cost can be related to weight. Each design metric can be linked to a different number of design variables, depending on the correlation between each linked variable.

[0013] The knowledge graph editor 220 provides a user interface that allows users to edit the knowledge graph 205. For example, users can add or remove nodes and / or edges. Furthermore, users can define feasible ranges for design variables and design metrics.

[0014] As referenced above, knowledge database 203 can receive design data from users interacting with design environment 220. When a user interacts with the design environment and calculates any metrics, available design variables and metrics are automatically saved and stored in knowledge database 203. For example, metrics can be calculated through forward modeling of relevant metrics (e.g., geometric evaluation, physical simulation, or machine learning models). For instance, geometric evaluations of weight, maximum width, height, and length when the user changes the design. This allows for the calculation of material and transportation costs, and also the identification of other information, such as dimensional limitations due to product standards and regulations. In another example, manufacturability can be assessed using geometric evaluations of design features (such as overhang angles or feature thicknesses), such as the feasibility of additive manufacturing designs. In yet another example, simulation models (such as finite element analysis or other physics-based simulation or machine learning models or hybrid methods) can model performance metrics, which can then be used to assess product lifespan fatigue and sustainability.

[0015] The constraints and trade-offs resulting from the proposed changes can be visualized and displayed to the user 207. As the knowledge database 203 populates with possible design instances and constructs an associated knowledge graph, these constraints and trade-offs of metrics can be visualized 207. When the user changes design variables in the interactive design environment 200, the knowledge graph 205 is queried to identify the affected metrics associated with the changed design variables. For example, visualizations can be provided in real-time, where relevant metrics can be evaluated in real-time. Violations of any specified constraints can be displayed on the user's monitor. In one implementation, affected metrics can be displayed in a radar chart 206 within the interactive design environment. Values ​​from the original design can be displayed alongside values ​​from the new design. For metrics whose design values ​​cannot be evaluated in real-time, the correlation between changes in design variables and metrics can be displayed and compared, for example, shown as positive or negative correlations. Different correlations can be visualized using different colors to highlight differences.

[0016] The range of metrics stored in knowledge database 203 can also be displayed to the user to inform them of the values ​​of the current design metrics relative to the ranges of designs evaluated in the past. For example, parallel graphs can be used to visualize in parallel the values ​​and ranges of multiple metrics for an explored past design. If a design metric falls outside the range of a past design, the user may use the data used to populate knowledge database 203 to conduct a detailed evaluation of the proposed changes.

[0017] Furthermore, a measure of the uncertainty of each trade-off can be calculated and provided as part of the trade-off visualization. In this way, users can visualize the possibility that a proposed change will affect another aspect of the design. This can inform the appropriate action relative to the proposed change.

[0018] Figure 3 A flowchart illustrating a process for visualizing trade-offs in an interactive design environment according to an embodiment of this disclosure is shown. When a user interacts with the design environment, actions performed by the user are stored as knowledge in a knowledge base 301. From the various actions, a knowledge graph is constructed to represent the captured knowledge 302. When the user makes a change in the interactive design environment, the relevant aspects of the design that will be affected by the change can be determined through the knowledge graph 303. Changes to the relevant aspects can be calculated and displayed to the user to visualize the design trade-offs resulting from the proposed change 304.

[0019] Figure 4 An exemplary computing environment 400 is illustrated, within which embodiments of the present invention can be implemented. Computers and computing environments (such as computer system 410 and computing environment 400) are well known to those skilled in the art and are therefore briefly described herein.

[0020] like Figure 4 As shown, computer system 410 may include communication mechanisms, such as system bus 421 or other communication mechanisms for transmitting information within computer system 410. Computer system 410 also includes one or more processors 420 coupled to system bus 421 for processing information.

[0021] Processor 420 may include one or more central processing units (CPUs), graphics processing units (GPUs), or any other processor known in the art. More generally, a processor, as used herein, is a means for executing machine-readable instructions stored on a computer-readable medium to perform a task, and may include any one or a combination of hardware and firmware. The processor may also include memory storing machine-readable instructions executable to perform the task. The processor acts on information by manipulating, analyzing, modifying, transforming, or transmitting it for use by an executable process or information means, and / or by routing information to an output means. For example, the processor may use or include the capabilities of a computer, controller, or microprocessor, and may be modulated using executable instructions to perform special functions not performed by a general-purpose computer. The processor may be coupled (electrically coupled and / or include executable components) to any other processor to enable interaction and / or communication between them. A user interface processor or generator is a known element that includes electronic circuitry or software, or a combination of both, for generating portions of a displayed image or picture. The user interface includes one or more displayed images to enable interaction between the user and the processor or other means.

[0022] Continue to refer to Figure 4The computer system 410 also includes a system memory 430 coupled to a system bus 421 for storing information and instructions to be executed by the processor 420. The system memory 430 may include computer-readable storage media in the form of volatile and / or non-volatile memory, such as read-only memory (ROM) 431 and / or random access memory (RAM) 432. RAM 432 may include other dynamic storage devices (e.g., dynamic RAM, static RAM, and synchronous DRAM). ROM 431 may include other static storage devices (e.g., programmable ROM, erasable PROM, and electrically erasable PROM). Additionally, the system memory 430 may be used to store temporary variables or other intermediate information during the execution of instructions by the processor 420. A basic input / output system 433 (BIOS) containing basic routines may be stored in the ROM 431, which facilitates the transfer of information between components within the computer system 410, such as during startup. RAM 432 may contain data and / or program modules that are immediately accessible to the processor 420, and / or data and / or program modules currently being operated by the processor. The system memory 430 may additionally include, for example, an operating system 434, application programs 435, other program modules 436, and program data 437.

[0023] Computer system 410 also includes a disk controller 440 coupled to system bus 421 to control one or more storage devices for storing information and instructions, such as magnetic hard disks 441 and removable media drives 442 (e.g., floppy disk drives, optical disk drives, magnetic tape drives, and / or solid-state drives). Storage devices can be added to computer system 410 using appropriate device interfaces such as Small Computer System Interface (SCSI), Integrated Device Electronics (IDE), Universal Serial Bus (USB), or FireWire.

[0024] Computer system 410 may also include a display controller 465 coupled to system bus 421 to control a display or monitor 466, such as a cathode ray tube (CRT) or liquid crystal display (LCD), for displaying information to a computer user. The computer system includes an input interface 460 and one or more input devices (such as a keyboard 462 and a clicking device 461) for interacting with the computer user and providing information to processor 420. For example, clicking device 461 may be a mouse, light pen, trackball, or pointing stick for transmitting directional information and command selections to processor 420 and for controlling cursor movement on display 466. Display 466 may provide a touchscreen interface that allows input to supplement or replace the transmission of directional information and command selections by clicking device 461. In some embodiments, a user-wearable augmented reality device 467 may provide input / output functionality that allows the user to interact with both the physical and virtual worlds. The augmented reality device 467 communicates with the display controller 465 and the user input interface 460, thereby allowing the user to interact with virtual objects generated by the display controller 465 in the augmented reality device 467. The user can also provide gestures, which are detected by the augmented reality device 467 and transmitted as input signals to the user input interface 460.

[0025] Computer system 410 can perform some or all of the processing steps in embodiments of the present invention in response to processor 420 executing one or more sequences of one or more instructions contained in memory (such as system memory 430). Such instructions can be read into system memory 430 from another computer-readable medium (such as magnetic hard disk 441 or removable media drive 442). Magnetic hard disk 441 may contain one or more data repositories and data files used by embodiments of the present invention. The contents of the data repositories and data files can be encrypted to improve security. Processor 420 can also be employed in a multiprocessing arrangement to execute one or more sequences of instructions contained in system memory 430. In alternative embodiments, hard-wired circuitry can be used instead of or in combination with software instructions. Therefore, the implementation is not limited to any particular combination of hardware circuitry and software.

[0026] As described above, computer system 410 may include at least one computer-readable medium or memory for storing instructions programmed according to embodiments of the present invention and for containing data structures, tables, records, or other data described herein. As used herein, the term "computer-readable medium" refers to any medium that participates in providing instructions to processor 420 for execution. Computer-readable media can take many forms, including but not limited to non-transitory media, non-volatile media, volatile media, and transmission media. Non-limiting examples of non-volatile media include optical discs, solid-state drives, magnetic disks, and magneto-optical discs, such as magnetic hard disk 441 or removable media drive 442. Non-limiting examples of volatile media include dynamic memory, such as system memory 430. Non-limiting examples of transmission media include coaxial cables, copper wires, and optical fibers, including wires constituting system bus 421. Transmission media may also take the form of sound waves or light waves, such as those generated during radio wave and infrared data communication.

[0027] The computing environment 400 may also include a computer system 410 that operates in a networked environment using logical connections to one or more remote computers, such as remote computing device 480. Remote computing device 480 may be a personal computer (laptop or desktop computer), a mobile device, a server, a router, a network PC, a peer-to-peer device, or other common network nodes, and typically includes many or all of the elements described above with respect to computer system 410. When used in a networked environment, computer system 410 may include a modem 472 for establishing communication over a network 471, such as the Internet. Modem 472 may be connected to system bus 421 via user network interface 470 or via another suitable mechanism.

[0028] Network 471 can be any network or system commonly known in the art, including the Internet, intranet, local area network (LAN), wide area network (WAN), metropolitan area network (MAN), direct connection or a series of connections, cellular telephone network, or any other network or medium capable of facilitating communication between computer system 410 and other computers (e.g., remote computing device 480). Network 471 can be wired, wireless, or a combination thereof. Wired connections can be implemented using Ethernet, Universal Serial Bus (USB), RJ-6, or any other wired connection commonly known in the art. Wireless connections can be implemented using Wi-Fi, WiMAX and Bluetooth, infrared, cellular networks, satellite, or any other wireless connection method commonly known in the art. Furthermore, multiple networks can operate independently or communicate with each other to facilitate communication within network 471.

[0029] As used herein, an executable application includes code or machine-readable instructions used to adjust a processor to perform predetermined functions, such as those of an operating system, a context data acquisition system, or other information processing system, in response to user commands or input. An executable program is a segment of code or machine-readable instructions, subroutines, or other distinct sections of code or part of an executable application used to perform one or more specific procedures. These procedures may include: receiving input data and / or parameters, performing operations on the received input data and / or performing functions in response to received input parameters, and providing the obtained output data and / or parameters.

[0030] As used herein, a graphical user interface (GUI) includes one or more display images generated by a display processor and enabling user interaction with the processor or other devices, as well as associated data acquisition and processing functions. The GUI also includes an executable program or executable application. The executable program or executable application modulates the display processor to generate signals representing the GUI display images. These signals are provided to a display device that displays the images for the user to view. Under the control of the executable program or executable application, the processor manipulates the GUI display images in response to signals received from an input device. In this way, the user can interact with the display images using an input device, thereby enabling user interaction with the processor or other devices.

[0031] The functions and process steps described herein may be executed automatically or in whole or in part in response to user commands. Automatically executed activities (including steps) are performed in response to one or more executable instructions or device operations without direct user initiation.

[0032] The systems and processes shown in the diagram are not exclusive. Other systems, processes, and menus can be derived from the principles of this invention to achieve the same objective. Although the invention has been described with reference to specific embodiments, it should be understood that the embodiments and variations shown and described herein are for illustrative purposes only. Modifications to the present design can be made by those skilled in the art without departing from the scope of the invention. As described herein, various systems, subsystems, agents, managers, and processes can be implemented using hardware components, software components, and / or combinations thereof.

Claims

1. A method for designing objects in an interactive design environment, comprising: Capture information from the user's interaction with the interactive design environment; Arrange the captured information into the form of a knowledge graph; Given that a user changes a first aspect of the design in the interactive design environment, at least one other aspect of the design affected by the user's change is identified by examining the knowledge graph. as well as Create a visualization of the impact on at least one other aspect of the design.

2. The method according to claim 1, wherein, The at least one other aspect of the design includes the design’s key performance indicators (KPIs).

3. The method according to claim 1, wherein, The at least one other aspect of the design is a requirement of the design.

4. The method according to claim 1, further comprising: The knowledge graph is edited within the user interface of the interactive design environment.

5. The method according to claim 4, further comprising: Edit the knowledge graph by performing at least one of the following: adding or removing nodes, and adding or removing edges.

6. The method according to claim 4, further comprising: The knowledge graph is edited by modifying the feasible range of design metrics.

7. The method according to claim 1, further comprising: The captured information and the knowledge graph will guide future design actions.

8. The method according to claim 1, further comprising: A visualization of the impact on at least one other aspect of the design is displayed to the user in real time.

9. The method according to claim 1, further comprising: A radar chart is displayed as one aspect of the visualization, indicating changes to at least one other aspect of the design caused by the proposed change to the first aspect of the design.

10. The method according to claim 1, further comprising: Violations of the constraints of the design created by changes made to the first aspect of the design are highlighted as one aspect of the visualization.

11. The method according to claim 1, further comprising: At least one design metric is displayed as one aspect of the visualization, and the range of that metric with respect to past designs stored in the captured interactions is affected by changes in the first aspect.

12. The method according to claim 9, further comprising: A detailed evaluation is performed on the changes to the first aspect of the design, provided that at least one design metric falls outside the scope of the past design.

13. A system for designing objects in an interactive design environment, comprising: Computer processor; as well as A non-transitory computer memory, in communication with the computer processor, stores machine-readable instructions that, when executed by the computer processor, cause the computer to perform the following steps: Capture information from the user's interaction with the interactive design environment; Arrange the captured information into the form of a knowledge graph; Given that a user changes a first aspect of the design in the interactive design environment, at least one other aspect of the design affected by the user's change is identified by examining the knowledge graph. as well as Create a visualization of the impact on at least one other aspect of the design.

14. The system according to claim 13, wherein, The at least one other aspect of the design includes the design’s key performance indicators (KPIs).

15. The system according to claim 13, wherein, The at least one other aspect of the design is a requirement of the design.

16. The system of claim 13, wherein the non-transitory computer memory further stores machine-readable instructions that, when executed by the computer processor, cause the computer to perform the following steps: The knowledge graph is edited within the user interface of the interactive design environment.

17. The system of claim 16, wherein the non-transitory computer memory further stores machine-readable instructions that, when executed by the computer processor, cause the computer to perform the following steps: Edit the knowledge graph by performing at least one of the following: adding or removing nodes, and adding or removing edges.

18. The system of claim 16, wherein the non-transitory computer memory further stores machine-readable instructions that, when executed by the computer processor, cause the computer to perform the following steps: The knowledge graph is edited by modifying the feasible range of design metrics.

19. The system of claim 13, wherein the non-transitory computer memory further stores machine-readable instructions that, when executed by the computer processor, cause the computer to perform the following steps: A visualization of the impact on at least one other aspect of the design is displayed to the user in real time.

20. The system of claim 13, wherein the non-transitory computer memory further stores machine-readable instructions that, when executed by the computer processor, cause the computer to perform the following steps: A radar chart is displayed as one aspect of the visualization, indicating changes to at least one other aspect of the design caused by the proposed change to the first aspect of the design.

Images