Computer-implemented method for optimizing design of one or more virtual assets presented in computer simulation environment
By presenting a 3D model of virtual assets in a computer simulation environment and optimizing the design using a safety simulation scenario and AI modules, the problem of the inability to detect design defects and safety violations in industrial environments at an early stage in existing technologies is solved. This enables early identification and correction of design defects and improves the safety of industrial environments.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-08-29
- Publication Date
- 2026-03-10
AI Technical Summary
Existing technologies lack effective computer simulation methods for industrial environment design, making it impossible to detect design flaws and safety violations before physical installation, leading to potential safety hazards and accident risks.
By presenting 3D models of virtual assets in a computer simulation environment, enriching simulation data and defining safe simulation scenarios using processing units, automatically or interactively verifying security standards, optimizing virtual asset design to overcome security violations, and providing design modification suggestions using AI modules.
Before the physical realization of industrial environments, it is possible to identify and correct design flaws and safety violations early, improve safety, reduce accident risks, and optimize designs to meet safety standards.
Smart Images

Figure CN121637964A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to computer simulation environments, and more specifically, to computer implementation methods for optimizing the design of one or more virtual assets presented in a computer simulation environment such that the optimized design conforms to the safety conditions of an industrial environment. Background Technology
[0002] Industrial environments typically comprise a variety of assets installed within a single area, such as machinery, safety equipment, tools, and IoT devices. These assets are interconnected and interact with each other to enable the operation of the industrial environment. The physical installation of all assets and their interconnection is a complex process, where the safety of human users in an industrial environment is a critical aspect to consider during asset installation. Improper installation of assets such as machinery can lead to accidents and serious injury to human operators in an industrial environment. Therefore, the proper design and installation of assets in an industrial environment is crucial for minimizing accidents or disasters in that environment.
[0003] Traditionally, industrial environments are designed using two-dimensional (2D) drawings generated by CAD systems. These 2D drawings represent the layout of various assets to be deployed in the industrial environment. Such drawings do not provide human operators with an interactive experience of the industrial environment before the assets are installed. As a result, any flaws in the industrial environment design are likely to go undetected until the environment is implemented or commissioned. This can lead to the creation of unsafe environments for human operators working in the industrial setting.
[0004] Existing solutions for validating industrial environment designs lack the ability to perform standard safety checks, which are typically performed as soon as the industrial environment is physically realized. Therefore, in existing solutions, any failure to comply with safety standards to be detected requires a physical implementation of the industrial environment, which is both time-consuming and expensive.
[0005] In view of the above, there is a need to provide a computer simulation of an industrial environment and a computer simulation method for inspecting an industrial environment, so as to detect design defects in the industrial environment before its physical installation.
[0006] Therefore, the object of the present invention is to provide a computer implementation method for optimizing the design of one or more virtual assets presented in a computer simulation environment, such that the optimized design conforms to the safety conditions of an industrial environment.
[0007] As used herein, the term "industrial environment" refers to any environment in which one or more assets interact. The term "industrial environment" can refer to any building, such as a factory or any type of manufacturing facility, office building, etc., which can be filled with various entities. In this document, the term "industrial environment" refers to an entire machine or part thereof that collaborates to allow the implementation of any kind of production process. Examples of industrial environments can be any industrial setup having multiple assets such as power plants, wind farms, power grids, manufacturing facilities, processing plants, etc. While this disclosure has provided a general description of industrial environments as a form of factory workshop, the term "industrial environment" as used in the preferred embodiments and claims of this disclosure should be broadly understood to include not only factory workshops but also other indoor facilities and buildings such as hospitals, office spaces, apartments, mixed-use buildings, schools, training centers, etc. The term "industrial environment" can also include other outdoor facilities such as parking lots, transportation hubs, and vehicles such as airplanes, ships, and trucks.
[0008] The term "asset" refers to a specific object, element, component, or entity within an industrial environment. In one example, an asset can be equipment, machinery, robots, gear, assembly lines, conveyors, motors, pumps, compressors, or any other mechanical, electrical, or electronic equipment, worker, operator, or supervisor within an industrial environment. In another example, an industrial environment is an office building, and one or more assets can be desks, chairs, tables, cabinets, shelves, partitions, workstations, conference room furniture, lighting fixtures, or any other furniture or appliances typically found in an office environment. Furthermore, one or more assets can be equipment or systems used in office operations, including computers, printers, scanners, copiers, telephones, projectors, audiovisual systems, networking devices, or any other technical or electronic equipment typically used in an office setup.
[0009] Throughout this disclosure, the term "computer simulation environment," as used herein, refers to a three-dimensional (3D) representation of the real or physical world. It can be understood as a virtual world. The computer simulation environment is accessible to the user; that is, it is accessible from the real / physical world. This includes data exchange between the computer simulation environment and the real / physical world. In particular, the computer simulation environment can be understood as a "metaverse." It is also possible to interact with the computer simulation environment, i.e., to influence or use processes, components, and / or functions within the computer simulation environment. Therefore, processes in the computer simulation environment can directly influence processes in the real / physical world, for example, by virtually modeling control processes.
[0010] For example, it is possible that a user can access a computer-simulated environment via an interface (such as a virtual reality (VR) or augmented reality (AR) interface). A copy of the computer-simulated environment does not necessarily have to exist, but can be, for example, a 3D model. It is also possible that physical forces and phenomena (such as gravity) are represented in the computer-simulated environment in a way different from the real world, such as gravitational acceleration. For the purposes of this invention, the metaverse consists of one or more animated scenes presented corresponding to multiple assets interacting in an industrial environment.
[0011] The metaverse can include multiple computer simulation components. A computer simulation component can be understood, for example, as a representation of a real or physical component, particularly a 3D representation. For example, a component can be a room, building, project, or object. Computer simulation components can have different functionalities / features, such as access interfaces. Computer simulation components also include component-specific data, such as sensor data from virtual sensors, which can be retrieved, for example, via the access interface. Access to a computer simulation component can include, for example, using, modifying, and connecting to other computer simulation components. Computer simulation components can interact with a computer simulation environment. For the purposes of this invention, a computer simulation component can be one or more entities presented in a computer simulation collaborative environment or metaverse.
[0012] The metaverse can be implemented through a managed environment. The managed environment can be implemented, for example, as a cloud environment, an edge cloud environment, and / or on a specific device (e.g., a mobile device).
[0013] The method involves a processing unit importing simulations of one or more virtual assets into a computer simulation environment. The virtual assets include three-dimensional computer models of assets implemented in an industrial environment. The processing unit can retrieve the three-dimensional computer models of the assets and present the imported simulations into the computer simulation environment.
[0014] This method involves a processing unit enriching the simulation with data corresponding to safety standards associated with the industrial environment. The simulation of the virtual assets is supplemented by data obtained from real-world industrial environments. The data used to enrich the simulation may include industry-related safety standards.
[0015] The term "safety standard" refers to a set of established guidelines, protocols, and regulations designed to ensure the protection and safety of workers, equipment, and the environment from potential hazards associated with industrial operations. Safety standards encompass a variety of practices, such as the implementation of protective measures, maintenance plans, and emergency procedures. These standards can be developed by government or industry-specific bodies and are designed to mitigate risks associated with machinery operation, chemical handling, and occupational hazards. For example, compliance with U.S. OSHA regulations, adherence to an ISO 45001 occupational health and safety management system, or the requirement to use personal protective equipment (PPE) such as helmets and gloves in certain work areas are all manifestations of safety standards. Together, these measures help minimize accidents, enhance operational efficiency, and foster a safety culture within industrial settings.
[0016] This method includes a processing unit defining multiple security simulation scenarios to be simulated in a computer simulation environment for verifying the security standards of one or more virtual assets. As an example, the processing unit can receive data related to security standards in industry and define security simulation scenarios accordingly. Furthermore, the processing unit can utilize predefined security simulation scenarios to verify the security standards of one or more virtual assets.
[0017] In one embodiment, a secure simulation scenario can be an operation performed by a user on virtual assets in a computer simulation environment. Advantageously, performing such an operation makes it possible to identify security violations that are typically outside of industry-standard security standards.
[0018] This method involves a processing unit performing a security simulation scenario on one or more virtual assets in a computer simulation environment to identify security violations associated with those virtual assets. The security simulation scenario can be performed on the virtual assets with or without human intervention to identify security violations.
[0019] The term "safety breach" refers to an action, negligence, or condition that fails to comply with established safety standards, regulations, or procedures, thereby posing a risk to the health and safety of workers, equipment, or the environment. Safety breaches can occur due to negligence, lack of proper training, willful disregard for safety protocols, or inadequate equipment maintenance. Examples of safety breaches include installing two incompatible machines in the same area, storing flammable liquids near welding areas, improperly storing hazardous materials, and operating machinery without proper lockout / tagout procedures in place. Such breaches can result in accidents, injuries, equipment damage, and regulatory penalties.
[0020] In one aspect of the invention, security breaches of one or more virtual assets can be automatically determined by the processing unit based on predefined security standards associated with the industry.
[0021] In one aspect of the invention, a security breach of one or more virtual assets can be determined by a user based on their expertise.
[0022] The method involves a processing unit receiving one or more inputs from a user to optimize the design of one or more virtual assets to overcome identified security violations. Once a security violation associated with a virtual asset is identified, the user can provide one or more inputs to correct the violation. The inputs may involve optimizing the design of the virtual asset so that the updated optimized design overcomes the security violation.
[0023] The term "design" for virtual assets refers to the configuration, size, installation, and construction of a digital representation of a physical component in an industrial environment. Virtual assets can include 3D models, digital twins, simulations, and data visualizations that replicate real-world industrial components. Optimizing the design of virtual assets involves altering their geometry, functionality, and operational characteristics. For example, a virtual asset can include a digital twin of a conveyor belt system. The design of a virtual asset (conveyor belt system) can include the number of pulleys, pulley dimensions, base coordinates, belt design, and so on.
[0024] The step of receiving one or more inputs from the user for optimizing the design also includes the user interacting with a computer simulation environment to perform a security simulation scenario on one or more virtual assets within the computer simulation environment. The user can interact with one or more virtual assets in the computer simulation environment to perform a security simulation scenario on the virtual assets.
[0025] This step also includes user verification of the identified security violations to provide one or more inputs for optimizing the design of one or more virtual assets to overcome the identified security violations. The processing unit can then automatically determine the security violations associated with one or more virtual assets. The user can verify the accuracy of the security violations determined by the processing unit. Once the identified security violations are verified, the user can provide one or more inputs to optimize the design of one or more virtual assets to overcome the identified security violations.
[0026] The method involves a processing unit optimizing the design of one or more virtual assets based on input received from a user. The design of the virtual asset is optimized by modifying at least one design parameter of at least one virtual asset to meet safety standards for industrial environments.
[0027] The method includes having a processing unit perform a security simulation scenario on optimized virtual assets in a computer simulation environment to identify security violations. The optimized virtual assets are further subjected to the security simulation scenario to identify security violations. The method includes having the processing unit optimize the design of one or more virtual assets by receiving input from a user to overcome the identified security violations until no security violations are detected. If any security violations are detected, the optimized design of the virtual assets is further optimized until zero security violations are detected.
[0028] Advantageously, the design of virtual assets can be modified to meet safety standards before the industrial environment is implemented or set up. Therefore, any potential design flaws or safety violations in the industrial environment design can be identified at an early stage before the physical implementation of the industrial environment.
[0029] In one embodiment, the method includes performing operations on one or more virtual assets, other than those within a secure simulation scenario, to optimize the one or more virtual assets. The method includes having a user perform operations on one or more virtual assets within a computer simulation environment. The user can perform operations on the one or more virtual assets, where the operations can be any random operation typically performed in an industrial environment.
[0030] The method includes receiving one or more inputs from a user corresponding to an operation being performed, by a processing unit, for optimizing the design of one or more virtual assets. The inputs may correspond to design changes to one or more virtual assets.
[0031] The method includes a processing unit verifying input received from the user to determine security violations in design modifications corresponding to the received input. The processing unit determines whether the user-proposed design modification is likely to result in a security violation.
[0032] This method involves a processing unit optimizing the design of one or more virtual assets based on input received from the user if no security violation is identified. Advantageously, the processing unit verifies the input received from the user before making any design modifications to the one or more virtual assets. Therefore, any potential security violations due to human error or negligence can be avoided.
[0033] In one embodiment, one or more virtual assets of a computer simulation environment include three-dimensional computer models of physical assets deployed in an industrial environment.
[0034] In one embodiment, the method includes, by a processing unit, authenticating a user based on a unique identifier associated with the user before granting the user access to interact with the computer simulation environment. The unique identifier may be login credentials corresponding to the user, which allow the user to interact with the computer simulation environment.
[0035] In one embodiment, the simulation of one or more virtual assets is generated by retrieving and presenting a three-dimensional computer model of the asset deployed in an industrial environment.
[0036] In one embodiment, the method includes automatically suggesting modifications to one or more virtual assets. The method includes a processing unit analyzing one or more inputs received from a user to validate the inputs using an AI module.
[0037] This method involves a processing unit using the AI module suggesting modifications to the virtual asset to overcome security violations, provided that the AI module has been trained with sufficient training data. Advantageously, the AI module automatically proposes appropriate modifications to the design of the virtual asset based on the training data to overcome security violations.
[0038] The method includes: if the AI module does not provide suggestions based on input received from the user, training the AI module using the input received from the user and modifications made to the design of one or more virtual assets. Advantageously, the AI module can further learn from the input received from the user and the modifications made to the design to suggest future design modifications.
[0039] In one embodiment, the method includes a processing unit determining modifications to be made to a virtual asset to overcome a security violation by associating the security violation with a repository of security and design standards stored in memory. The AI module includes design parameters for one or more virtual assets and historical data on security violations. The AI module correlates the historical data with input received from a user to determine modifications to the design of one or more virtual assets.
[0040] The object of the present invention is achieved by an apparatus comprising one or more processing units and a memory unit communicatively coupled to the one or more processing units. The memory unit includes one or more modules stored in the form of machine-readable instructions executable by the one or more processing units. The one or more modules are configured to perform the method steps described above.
[0041] The object of this invention is achieved by a system comprising a computer simulation environment, a communication network communicatively coupled to the computer simulation environment, and means communicatively coupled to the communication network and the computer simulation environment. The computer simulation environment includes one or more virtual assets. The means is configured to optimize the design of one or more virtual assets presented in the computer simulation environment such that the optimized design conforms to the safety standards defined for an industrial environment as described above.
[0042] The object of the present invention is achieved by a computer program product in which machine-readable instructions are stored, which, when executed by a processor, cause the processor to perform the method as described above.
[0043] The object of the present invention is also achieved by a computer-readable storage medium including instructions that, when executed by a computer, cause the computer to perform the method as described above. Attached Figure Description
[0044] The invention is further described below with reference to the illustrated embodiments shown in the accompanying drawings, wherein:
[0045] Figure 1 The diagram illustrates a block diagram of a system 100 for optimizing the design of one or more virtual assets (104a-104n) presented in a computer simulation environment 102 so that the optimized design conforms to the safety conditions of an industrial environment.
[0046] Figure 2 An exemplary illustration of a user performing an operation in a computer simulation environment 102 according to an embodiment of the present invention;
[0047] Figure 3 The illustration shows a block diagram of an exemplary apparatus 108 for optimizing the design of one or more virtual assets presented in a computer simulation environment 102 according to an embodiment of the present invention.
[0048] Figure 4 The illustration shows the architecture 400 of a system for optimizing the design of one or more virtual assets according to an embodiment of the present invention;
[0049] Figure 5 The illustration shows a flowchart 500 of a method for optimizing the design of one or more virtual assets presented in a computer simulation environment according to an embodiment of the present invention, such that the optimized design conforms to the safety conditions of an industrial environment.
[0050] Figure 6 The illustration shows a flowchart 600 of a method for optimizing the design of one or more virtual assets presented in a computer simulation environment according to an embodiment of the present invention;
[0051] Figure 7 A flowchart 700 illustrating a method for optimizing the design of one or more virtual assets presented in a computer simulation environment according to an embodiment of the present invention; and
[0052] Figure 8 The illustration shows a flowchart 800 of a method for automatically suggesting design modifications to one or more virtual assets presented in a computer simulation environment using an AI module, according to an embodiment of the present invention. Detailed Implementation
[0053] The embodiments for carrying out the invention are described in detail below. Various embodiments are described with reference to the accompanying drawings, wherein the same reference numerals are always used to refer to the same elements. In the following description, numerous specific details are set forth for purposes of explanation in order to provide a thorough understanding of one or more embodiments. It may be apparent that such embodiments can be practiced without these specific details.
[0054] Figure 1 This is a block diagram of a system 100 for optimizing the design of one or more virtual assets (104a-104n) presented in a computer simulation environment 102, such that the optimized design conforms to the safety conditions of an industrial environment. System 100 includes a computer simulation environment 102, one or more virtual assets (104a-104n) presented in the computer simulation environment 102, and a device 108 communicating via a communication network 106. The computer simulation environment 102 is a three-dimensional (3D) representation of the real or physical world. It can be understood as a virtual world representing one or more virtual assets (104a-104n) of a real-world asset in an industrial environment. As used herein, the term "industrial environment" refers to any industrial environment including one or more assets interacting therein. The term industrial environment can refer to any building, such as a factory or any type of manufacturing facility, office building, etc., which can be filled with various assets. In this document, the term "factory" or industrial environment refers to an entire machine or part thereof that collaborates to allow the implementation of any kind of production process. Examples of a factory can be any industrial setup with multiple assets such as a power plant, wind farm, power grid, manufacturing facility, processing plant, etc. While this disclosure has provided a general description of an industrial environment as a form of factory workshop, the term "industrial environment" as used in the preferred embodiments and claims of this disclosure should be broadly understood to include not only factory workshops but also other indoor facilities and buildings such as hospitals, offices, apartments, mixed-use buildings, schools, training centers, and so on. The term "industrial environment" may also include other outdoor facilities such as parking lots, transportation hubs, and vehicles such as airplanes, ships, and trucks.
[0055] Maintaining safety standards within industrial environments is crucial to ensuring the safety of human users and preventing accidents or disasters. Therefore, it is essential that industrial environments are designed to comply with safety standards and provide a safe environment for users within them. The design of an industrial environment includes the various machines / equipment handled, the layout of the factory floor, the storage of materials, and so on. In the proposed invention, a digital replica of the industrial environment is used to verify its design to ensure that the design does not violate any safety standards. Furthermore, if any safety violations are detected, the design of the industrial environment is optimized by modifying the design of one or more assets within the industrial environment. Therefore, in this invention, a digital replica of the industrial environment is verified to ensure that the design meets safety requirements, and the design of the digital replica of the industrial environment is further modified to correct any safety violations in the original design of the industrial environment.
[0056] The term "one or more virtual assets" refers to a specific object, element, component, or entity within an industrial environment. In one example, one or more virtual assets (104a-104n) can be digital representations of assets, equipment, machines, robots, gear, assembly lines, conveyors, motors, pumps, compressors, or any other mechanical, electrical, or electronic equipment, workers, operators, or supervisors within an industrial environment. In one example, if the industrial environment is an office building, one or more virtual assets (104a-104n) can be digital representations of desks, chairs, tables, cabinets, shelves, partitions, workstations, conference room furniture, lighting fixtures, or any other furniture or appliances typically found in an office environment. Furthermore, one or more assets can be equipment or systems used in office operations, including computers, printers, scanners, copiers, telephones, projectors, audiovisual systems, networking devices, or any other technical or electronic equipment typically used in an office setup. In another example, the facility is an aircraft under maintenance. One or more assets can be the physical frame, airframe, or fuselage of the aircraft, including wings, tail, landing gear, engine nacelles, cockpit, cabin, doors, windows, and any other structural components that contribute to the overall form and integrity of the aircraft; jet engines, turboprops, propellers, fuel systems, exhaust systems, thrust reversers, or any other elements involved in generating and controlling the propulsion of the aircraft; electronic systems and instruments used for the navigation, communication, monitoring, and control of the aircraft, including flight control systems, flight management systems, autopilot systems, navigation systems, communication systems, radar systems, or any other electronic equipment or subsystems installed on the aircraft; seating arrangements, overhead bins, lavatories, galley equipment, lighting systems, entertainment systems, safety equipment, passengers, pilots, crew, and so on.
[0057] One or more virtual assets (104a-104n) are three-dimensional models of assets implemented in an industrial environment. The three-dimensional models of the assets are imported as simulations in the computer simulation environment 102.
[0058] The computer simulation environment 102 is accessible to users, meaning it can be accessed from the real / physical world. Specifically, the computer simulation environment 102 can be understood as a "metaverse." Interaction with the computer simulation environment 102 is also possible, i.e., influencing or using processes, components, and / or functions within the computer simulation environment 102. Users or avatars can interact with virtual assets presented in the metaverse.
[0059] For example, it is possible that a user can access the computer simulation environment 102 via an interface (e.g., a virtual reality (VR) or augmented reality (AR) interface). For the purposes of this invention, the metaverse consists of one or more animated scenes presented corresponding to multiple assets interacting in an industrial environment. The metaverse may include multiple computer simulation components. Computer simulation components can be understood, for example, as representations of real or physical components, particularly 3D representations. For example, a component may be a room, building, project, or object. Computer simulation components may have different functions / features, such as access interfaces. The metaverse can be implemented through a hosted environment. The hosted environment may be implemented, for example, as a cloud environment, an edge cloud environment, and / or on a specific device (e.g., a mobile device).
[0060] In one embodiment, device 108 is deployed in a cloud computing environment. As used herein, a “cloud computing environment” refers to a processing environment that includes configurable physical and logical computing resources (e.g., networks, servers, storage, applications, services, etc.) and data distributed over a network (e.g., the Internet). A cloud computing environment provides on-demand network access to a shared pool of configurable physical and logical computing resources. Device 108 may include processing unit 302 and modules for optimizing the design of one or more virtual assets (104a-104n) presented in a computer simulation environment 102.
[0061] Figure 2This is an exemplary illustration of a user performing operations in a computer simulation environment 102 according to an embodiment of the present invention. As can be seen, the user is equipped with a wearable device 202 configured for the visualization of a simulation of one or more virtual assets (104a-104n) in the computer simulation environment 102. In one example, the wearable device 202 includes a display module that presents visual information to the user in a realistic and immersive manner, presenting one or more assets. The display module may include a high-resolution screen, a holographic display, augmented reality (AR) glasses, or any other suitable technology for visually presenting virtual content to the user. Additionally, the wearable device 202 incorporates a tracking system to capture the user's movements and gestures, thereby allowing real-time interaction and navigation within the metaverse. The tracking system may utilize sensors, cameras, motion trackers, or any other suitable means of capturing and interpreting user movements. Furthermore, the wearable device 202 includes connectivity features to facilitate communication and data exchange with the metaverse infrastructure. These features may include wireless communication capabilities, such as Wi-Fi, Bluetooth, or cellular connectivity, enabling the wearable device 202 to connect to the metaverse platform, retrieve asset data, and transmit user actions or preferences. The wearable device 202 may also incorporate input mechanisms, such as touch-sensitive surfaces, buttons, voice recognition, or motion sensors, allowing users to issue commands, make choices, or manipulate virtual assets within the metaverse environment. The wearable device 202, used for visualizing assets in the metaverse, is designed to enhance the user's experience and immersion in the virtual world. It enables users to seamlessly perceive, interact with, and navigate virtual assets, objects, and environments, providing a novel and immersive way to explore and visualize digital content within the metaverse.
[0062] Users can interact with virtual assets in a computer simulation environment to experience the operation of an industrial environment. Users can perform operations on the virtual assets, which can be analogous to operations performed on real physical assets deployed in an industrial environment. Therefore, the system provides an immersive experience similar to a real-world scenario. As an example, a user can perform a welding operation on a virtual asset, interacting with a virtual model of a welding machine to simulate the welding process in the computer simulation environment. The user might notice hot fumes from the welding process entering a storage area containing flammable chemicals. The user can then suggest design modifications to relocate the flammable chemical storage area. Thus, the immersive experience provided to the user enables the detection of design flaws and helps optimize the design by obtaining user input.
[0063] Figure 3This is a block diagram of an exemplary apparatus 108 for optimizing the design of one or more virtual assets (104a-104n) presented in a computer simulation environment 102 according to an embodiment of the present invention. In the exemplary embodiment, apparatus 108 is communicatively coupled to the computer simulation environment 102 that presents one or more assets.
[0064] Device 108 may be a personal computer, laptop computer, tablet computer, server, virtual machine, etc. Device 108 includes a processing unit 302, a memory 308 including module 310, a database 304, an input unit 320, a display unit 322, and a bus 306.
[0065] As used herein, processing unit 302 refers to any type of computing circuit, such as, but not limited to, a microprocessor, microcontroller, complex instruction set computing microprocessor, reduced instruction set computing microprocessor, very long instruction word microprocessor, explicit parallel instruction computing microprocessor, graphics processor, digital signal processor, or any other type of processing circuit. Processing unit 302 may also include embedded controllers, such as general-purpose or programmable logic devices or arrays, application-specific integrated circuits, single-chip computers, etc.
[0066] Memory 308 may be non-transitory volatile memory and / or non-volatile memory. The memory may be coupled for communication with processing unit 302, such as a computer-readable storage medium. Processing unit 302 may execute instructions and / or code stored in the memory. Various computer-readable instructions may be stored in and accessed from the memory. The memory may include any suitable element for storing data and machine-readable instructions, such as read-only memory, random access memory, erasable programmable read-only memory, electrically erasable programmable read-only memory, hard disk drive, removable media drive for handling compact disks, digital video disks, magnetic disks, tape cartridges, memory cards, etc.
[0067] In this embodiment, the memory 308 includes modules stored in the form of machine-readable instructions on any of the aforementioned storage media, and can communicate with and be executed by the processing unit 302. When the machine-readable instructions are executed by the processing unit 302, the module causes the processing unit 302 to present one or more virtual assets (104a-104n) in the computer simulation environment 102.
[0068] Module 310 also includes presentation module 312, authentication module 314, interface module 316 and artificial intelligence (AI) module 318.
[0069] The presentation module 312 is configured to present one or more virtual assets (104a-104n) in the computer simulation environment 102. The presentation module 312 acquires a 3D computer model of the asset deployed in an industrial environment. Furthermore, the presentation module 312 presents one or more virtual assets (104a-104n) to generate a simulation of the one or more virtual assets (104a-104n) in the computer simulation environment 102.
[0070] The authentication module 314 is configured to authenticate users interacting with the computer simulation environment 102. The authentication module 314 is configured to receive an identifier from the user, verify the authenticity of the identifier, and further authorize the user to interact with the simulation environment 102. This identifier can be a unique login credential associated with the user interacting in the computer simulation environment 102. Furthermore, the authentication module 314 can also record information about the user interacting with the computer simulation environment 102.
[0071] Interface module 316 is configured to provide a platform for users to access computer simulation environment 102. Interface module 316 may include hardware and software components, such as libraries enabling access to computer simulation environment 102. In one embodiment, the interface module may be implemented as wearable device 202, which is configured to provide a platform for interacting with the simulation.
[0072] AI module 318 is configured to automatically detect security violations in the design of one or more virtual assets (104a-104n) and provide suggestions to optimize the design of one or more virtual assets (104a-104n) to overcome the security violations. AI module 318 can be trained using a training dataset that includes historical data related to industry-specific safety and design standards. AI module 318 can use machine learning algorithms to automatically detect security violations and suggest design modifications to overcome them.
[0073] Processing unit 302 is configured to execute all functions of the module. Processing unit 302 is configured to import simulations of one or more virtual assets (104a-104n) into computer simulation environment 102. Processing unit 302 is configured to enrich the simulation with data corresponding to safety standards associated with an industrial environment. Processing unit 302 is configured to define multiple security simulation scenarios to be simulated in computer simulation environment 102 to verify the security standards of one or more virtual assets (104a-104n). Processing unit 302 is configured to execute security simulation scenarios on one or more virtual assets (104a-104n) in computer simulation environment 102 to determine security violations associated with one or more virtual assets (104a-104n). Processing unit 302 is configured to receive one or more inputs from a user to optimize the design of one or more virtual assets (104a-104n) to overcome the determined security violations. The processing unit 302 is configured to optimize the design of one or more virtual assets (104a-104n) based on input received from the user, wherein at least one design parameter of at least one virtual asset is modified to optimize the design of the virtual asset to meet safety standards for industrial environments.
[0074] Database 304 can be configured to store 3D computer models of assets deployed in industrial environments. The database can be provided using various types of storage technologies, such as solid-state drives, hard disk drives, and flash memory, and can be stored in various formats, such as relational databases, non-relational databases, flat files, spreadsheets, and extended tag files.
[0075] Input unit 320 may provide a port to receive input from input devices such as keypads, touch-sensitive displays, cameras (such as cameras that receive gesture-based input), etc., capable of receiving a set of requests for simulating one or more virtual assets (104a-104n). Display unit 322 may provide a port to output data via an output device with a graphical user interface for displaying one or more scenes in a computer-simulated virtual environment. A bus serves as an interconnect between processing unit 302, memory, database, input unit, and display unit.
[0076] Those skilled in the art will understand that Figure 3The hardware depicted may vary for specific implementations. For example, other peripheral devices, such as optical disc drives, local area network (LAN) / wide area network (WAN) / wireless (e.g., Wi-Fi) adapters, graphics adapters, disk controllers, and input / output (I / O) adapters, may be used in addition to or in place of the depicted hardware. The examples depicted are provided for illustrative purposes only and are not intended to imply any limitation on the architecture of this disclosure.
[0077] Figure 4 The illustration shows the architecture 400 of a system 100 for optimizing the design of one or more virtual assets (104a-104n) according to an embodiment of the present invention. The database may include the design of one or more virtual assets (104a-104n) to be deployed in an industrial environment. The design may be in the form of a three-dimensional computer model representing one or more assets deployed in the industrial environment.
[0078] The presentation module 312 is configured to retrieve designs 402 of one or more virtual assets (104a-104n) from the database 304. Furthermore, the presentation module 312 can present 3D models of the retrieved virtual assets to generate simulations 404 of the one or more virtual assets (104a-104n). The simulations 404 generated by the presentation module 312 enable users to interact with the one or more virtual assets, providing an immersive experience. The presentation module 312 can employ a physics engine to generate simulations that mimic real-world environments within the computer simulation environment 102. As an example, the simulation 404 allows users to perform actions that would be performed in a real-world environment, such as operating a crane to lift objects within an industrial environment. The simulation 404 generated by the presentation module 312 can then be stored in the database 304, where it can be retrieved whenever needed. The database 304 can be a decentralized database that can be shared by different users using the computer simulation environment 102.
[0079] Authentication module 314 authenticates the identity of user 408 and authorizes user 408 to engage in simulated interaction with one or more virtual assets (104a-104n). Authentication module 314 can verify the user based at least on a unique identifier such as login credentials associated with the user.
[0080] After user authentication, interface module 316 provides the user with access to the simulation platform. Interface module 316 can be a combination of hardware and software components that provide the platform, allowing the user to interact with the simulation to perform operations within the computer simulation environment 102. Interface module 316 may include libraries such as ARCore and ARKit to provide the platform for accessing the simulation.
[0081] After executing the security simulation scenario in the simulation, the user can provide Input 406 as feedback. Input 406 can relate to design modifications to one or more virtual assets (104a-104n) to overcome security violations of one or more virtual assets (104a-104n). Inputs and security violations can be further stored in a database for reference.
[0082] The artificial intelligence (AI) module can receive input from the user and provide suggestions to overcome safety violations. The AI module 318 can be trained using a training dataset to identify safety violations in an industrial environment and provide appropriate suggestions to overcome them. The suggestions provided by the AI module 318, along with the corresponding safety violations, can be stored in a database for future reference.
[0083] Furthermore, in scenarios where the AI module 318 is not sufficiently trained to provide recommendations for overcoming identified security violations, the AI module is configured to learn by training on user-provided input and design modifications made to one or more virtual assets (104a-104n).
[0084] In one embodiment, AI module 318 is configured to verify input received from a user to confirm whether design modifications corresponding to user-provided input could lead to safety violations in an industrial environment. Therefore, input received from the user is carefully examined to ensure it does not result in a safety violation.
[0085] In one embodiment, the AI module 318 may further include a classifier configured to classify input received from the user. The classifier receives input from the user and determines whether the input corresponds to a minor modification or a major modification to a virtual asset. If the input corresponds to a minor modification, the AI module 318 may automatically make design modifications to one or more virtual assets. If the input corresponds to a major modification, the AI module 318 may suggest that the user manually modify the design of one or more virtual assets.
[0086] Figure 5 This is a flowchart 500 of a method for optimizing the design of one or more virtual assets (104a-104n) presented in a computer simulation environment 102 according to an embodiment of the present invention, such that the optimized design conforms to the safety conditions of an industrial environment. In step 502, processing unit 302 retrieves three-dimensional computer models of one or more assets. The three-dimensional computer models of the assets may be stored in a database and retrieved from the database when needed.
[0087] In step 504, simulations of one or more virtual assets (104a-104n) are imported into the computer simulation environment 102 by processing unit 302. Presentation module 312 can generate simulations of the virtual assets by presenting three-dimensional computer models of the assets. Furthermore, the simulation can be stored in a database, which can be further imported into the computer simulation environment 102 by processing unit 302.
[0088] In step 506, the simulation is enriched with data corresponding to safety standards associated with the industrial environment. The data used to enrich the simulation can be real-time data and historical data obtained from the factory floor using sensors.
[0089] In step 508, processing unit 302 defines multiple security simulation scenarios to be simulated in computer simulation environment 102 for verifying security standards of one or more virtual assets (104a-104n). In one embodiment, processing unit 302 may utilize historical data associated with an industry to define security simulation scenarios within an industrial environment. In another embodiment, a user may predefine a set of security simulation scenarios for an industry associated with an industrial environment. As an example, a security simulation scenario may identify obstacles in industrial shop floor equipment.
[0090] In step 510, the processing unit 302 executes a security simulation scenario on one or more virtual assets (104a-104n) in the computer simulation environment 102 to determine security violations associated with the one or more virtual assets (104a-104n). In one embodiment, the processing unit 302 may automatically execute the security simulation scenario to determine security violations associated with the one or more virtual assets (104a-104n). In another embodiment, a user may execute the security simulation scenario in the computer simulation environment 102 to determine security violations associated with the one or more virtual assets (104a-104n).
[0091] In step 512, processing unit 302 receives input from a user to optimize the design of one or more virtual assets (104a-104n) to overcome the identified security violations. The user can provide input in the form of comments, text, or gestures within the computer simulation environment 102. This input can correspond to design modifications to be made to one or more virtual assets (104a-104n) to overcome the security violations.
[0092] In step 514, processing unit 302 optimizes the design of one or more virtual assets (104a-104n) based on input received from the user. Processing unit 302 can identify at least one design parameter to be modified to optimize the design of the virtual assets, thereby meeting safety standards in the industrial environment. Design parameters may include the orientation of one or more assets in the industrial environment, the location of one or more virtual assets (104a-104n) in the industrial environment, etc.
[0093] In step 516, a security simulation scenario is performed on the optimized virtual assets to detect any security violations in the optimized design of the virtual assets. The optimized virtual assets undergo the security simulation scenario to identify any new security violations caused by design modifications to one or more virtual assets (104a-104n).
[0094] If no security violation is detected in the optimized design of the virtual asset, then in step 518, the processing unit 302 completes the optimized design.
[0095] If a security violation is detected during the optimization design, the violation is shared with the user, and the method proceeds to step 512, where processing unit 302 receives input from the user to overcome the detected security violation. This design optimization is repeated until no security violations are detected in one or more virtual assets (104a-104n).
[0096] An example scenario is presented to optimize the design of one or more virtual assets (104a-104n) presented in the computer simulation environment 102, ensuring that the optimized design meets the safety conditions of a steel plant. Three-dimensional models of all equipment and machines deployed in the steel plant are presented to generate a simulation of the steel plant. Furthermore, real-time sensor data from the steel plant is supplemented to the simulation, making it a digital twin of the steel plant. Users can interact with the simulation and execute safety simulation scenarios within it. For example, a user can operate a crane transporting molten metal within the plant. According to safety standards, there must be a minimum distance between two cranes in a steel plant to ensure that the cranes do not collide. The user or processing unit 302 can detect a safety violation where the distance between two cranes in the plant does not meet industrial safety standards. The user can provide input or feedback to overcome the safety violation by providing new coordinates for locating the cranes, ensuring that the cranes do not collide. The processing unit 302, using the AI module 318, processes the input and optimizes the plant design by changing the crane's position. Therefore, any safety violations associated with the design of an industrial environment should be detected using simulation, and corrective measures should be taken to overcome the safety violations.
[0097] Figure 6This is a flowchart 600 of a method for optimizing the design of one or more virtual assets (104a-104n) presented in a computer simulation environment 102 according to an embodiment of the present invention. In step 602, a user interacting with the computer simulation environment 102 performs a security simulation scenario on the one or more virtual assets (104a-104n). The user can execute certain portions of the security simulation scenario performed on the one or more virtual assets (104a-104n). The user can also remain as an observer, observing the security simulation scenario performed on the one or more virtual assets (104a-104n).
[0098] In step 604, the user verifies the security violations automatically detected by the processing unit 302. The user can use their knowledge and expertise in the field to determine whether the security violations identified by the processing unit 302 are genuine. The processing unit 302 can learn from the results of the user verification to train the AI module 318 to automatically detect security violations. The user can detect any erroneous determinations of security violations associated with one or more virtual assets (104a-104n) in the computer simulation environment 102.
[0099] In step 606, input is received from the user to optimize the design of one or more virtual assets (104a-104n) to overcome the identified security violation. The input may involve design changes to be made to one or more virtual assets (104a-104n).
[0100] In step 608, processing unit 302 optimizes the design of one or more virtual assets (104a-104n) based on input received from the user. Processing unit 302 may identify at least one design parameter to be modified to optimize the design of the virtual assets, thereby meeting safety standards in an industrial environment. As an example, design parameters may be the orientation of one or more assets in the industrial environment, the location of one or more virtual assets (104a-104n) in the industrial environment, etc.
[0101] As an example, the processing unit can determine the presence of object A in region B as a security violation. The security violation is presented to the user for verification to determine if the detected violation is genuine. If the user provides input that the presence of object A in region B is not a security violation, the processing unit receives this input and reverses the security violation. Furthermore, this information is used to train AI module 318 to automatically determine security violations associated with one or more virtual assets. Therefore, the user performs additional checks to verify the security violations automatically determined by the processing unit.
[0102] Figure 7This is a flowchart 700 of a method for optimizing the design of one or more virtual assets (104a-104n) presented in a computer simulation environment 102 according to an embodiment of the present invention. In step 702, a user performs an operation on one or more virtual assets (104a-104n) in the computer simulation environment 102. The operation performed can be any safety-related operation typically associated with an industrial environment, or a normal daily operation performed in an industrial environment.
[0103] In step 704, processing unit 302 receives one or more inputs from the user, corresponding to operations performed to optimize the design of one or more virtual assets (104a-104n). The inputs may relate to design modifications to be made to the one or more virtual assets (104a-104n). These inputs may be general modifications and do not require modification due to security violations.
[0104] In step 706, processing unit 302 verifies the input received from the user to determine any security violations associated with the design modifications corresponding to the user-received input. In other words, if the user proposes a design modification as input, processing unit 302 receives the input and checks whether the proposed design modification to one or more virtual assets (104a-104n) would result in a security violation. Therefore, the verification of the input received from the user ensures that the resulting design modifications do not lead to security violations.
[0105] In step 708, if no security violation is identified, the design of one or more virtual assets (104a-104n) is optimized based on the input received from the user. If the proposed design modification does not result in a security violation, the design of one or more virtual assets (104a-104n) is optimized based on the input received from the user.
[0106] As an example, the processing unit can determine a safety violation where machine X comes into contact with machine Y when machine X operates. The user can provide input to overcome the safety violation, where this input might correspond to moving machine X to a new coordinate. The processing unit can receive the input and check whether moving machine X to the new coordinate would result in a new safety violation. For example, if machine X moves to the new coordinate, then a portion of machine X might extend into a traffic lane. Therefore, the processing unit can determine that the input received from the user might lead to a safety violation and can notify the user that the input might result in a safety violation. If moving machine X to the new coordinate would not result in a safety violation, the processing unit optimizes the design by modifying the design of one or more virtual assets to overcome the safety violation.
[0107] Figure 8This is a flowchart 800 of a method for automatically suggesting design modifications to one or more virtual assets (104a-104n) presented in a computer simulation environment 102 using an AI module 318, according to an embodiment of the present invention. In step 802, the processing unit 302 analyzes one or more inputs received from a user to verify the inputs using the AI module 318. The AI module 318 verifies the inputs to determine suggestions for overcoming security violations associated with the one or more virtual assets (104a-104n). The AI module 318 can be trained using a training dataset that includes design modifications to the one or more virtual assets (104a-104n) and security violations associated with them.
[0108] In step 804, if the AI module 318 is trained with sufficient training data, the AI module 318 generates recommendations for modifying the virtual assets to overcome security violations. If the AI module 318 is trained with a training dataset that includes data corresponding to detected security violations associated with one or more virtual assets, the AI module 318 can automatically generate recommendations for modifying the design of one or more virtual assets to overcome security violations.
[0109] In step 806, if the AI module 318 does not make any suggestions, where the training dataset does not include data corresponding to detected security breaches associated with one or more virtual assets, then the AI module 318 can learn and train using input received from the user. The AI module 318 can record the input received from the user and corresponding design modifications made to one or more virtual assets (104a-104n). Therefore, when similar security breaches are encountered, the AI module 318 can learn and propose design modifications in the future.
[0110] The advantage of this invention is that it enables the detection of safety violations in industrial environment design even before actual implementation in the industrial environment. Therefore, it offers cost-effectiveness and reduces the manpower required to correct design flaws that lead to safety violations after installation in the industrial environment.
[0111] Although the invention has been described and illustrated in detail with reference to preferred embodiments, the invention is not limited to the disclosed examples. Those skilled in the art can derive other modifications without departing from the scope of the claimed invention.
Claims
1. A computer-implemented method for optimizing a design of one or more virtual assets (104a-104n) presented in a computer simulation environment (102) such that the optimized design complies with safety conditions of an industrial environment, wherein the method comprises: importing, by a processing unit (302), a simulation of one or more virtual assets (104a-104n) into the computer simulation environment (102); enriching, by the processing unit (302), the simulation with data corresponding to safety standards associated with the industrial environment; defining, by the processing unit (302), a plurality of safety simulation scenarios to be simulated in the computer simulation environment (102) for verifying safety standards of the one or more virtual assets (104a-104n); executing, by the processing unit (302), the safety simulation scenarios on the one or more virtual assets (104a-104n) in the computer simulation environment (102) to determine safety violations associated with the one or more virtual assets (104a-104n); receiving, by the processing unit (302), one or more inputs from a user for optimizing the design of the one or more virtual assets (104a-104n) to overcome the determined safety violations; and optimizing, by the processing unit (302), the design of the one or more virtual assets (104a-104n) based on the inputs received from the user, wherein at least one design parameter of at least one virtual asset (104a-104n) is modified to optimize the design of the virtual asset (104a-104n) to meet the safety standards of the industrial environment.
2. The method of claim 1, wherein receiving the one or more inputs from the user for optimizing the design comprises: interacting, by the user, with the computer simulation environment (102) to execute the safety simulation scenarios on the one or more virtual assets (104a-104n) in the computer simulation environment (102); and verifying, by the user, the determined safety violations to provide the one or more inputs for optimizing the design of the one or more virtual assets (104a-104n) to overcome the determined safety violations.
3. The method of any of the preceding claims, wherein the method comprises: executing, by the processing unit (302), the safety simulation scenarios on the optimized virtual assets (104a-104n) in the computer simulation environment (102) to determine safety violations; and optimizing, by the processing unit (302), the design of the one or more virtual assets (104a-104n) by receiving inputs from the user to overcome the determined safety violations until no safety violations are detected.
4. The method of any of the preceding claims, wherein the method comprises: performing, by the user, an operation on the one or more virtual assets (104a-104n) in the computer simulation environment (102); receiving, by the processing unit (302), one or more inputs from the user corresponding to the performed operation for optimizing the design of the one or more virtual assets (104a-104n); the input received from the user to determine a safety violation in the design modification corresponding to the received input; and if no safety violation is determined, optimizing, by the processing unit (302), the design of one or more virtual assets (104a-104n) based on the input received from the user.
5. The method according to any one of the preceding claims, wherein, The one or more virtual assets (104a-104n) of the computer simulation environment (102) comprise three-dimensional computer models of physical assets deployed in an industrial environment.
6. The method of any one of the preceding claims, wherein the method comprises: authenticating, by the processing unit (302), the user based on a unique identifier associated with the user prior to providing the user with access to interact with the computer simulation environment (102).
7. The method according to any one of the preceding claims, wherein, The simulation of the one or more virtual assets (104a-104n) is generated by retrieving and rendering three-dimensional computer models of assets deployed in an industrial environment.
8. The method of any one of the preceding claims, wherein the method comprises: analyzing, by the processing unit (302), one or more inputs received from the user to validate the input with an AI module (318); if the AI module (318) is trained with sufficient training data, using the AI module (318) to suggest modifications to be made to the virtual assets (104a-104n) to overcome the safety violation; and if the AI module (318) has no suggestion for the input received from the user, training the AI module (318) using the input received from the user and the modifications made to the design of the one or more virtual assets (104a-104n).
9. The method of any one of the preceding claims, wherein the method comprises: determining, by the processing unit (302), the modifications to be made to the virtual assets (104a-104n) to overcome the safety violation by associating the safety violation with a repository of safety standards and design standards stored in the memory (308).
10. An apparatus (108) for optimizing a design of one or more virtual assets (104a-104n) presented in a computer simulation environment (102) such that the optimized design complies with safety standards defined for an industrial environment, the apparatus (108) comprising: one or more processing units (302); a memory (308) communicatively coupled to the one or more processing units (302), the memory (308) comprising modules (310) stored in the form of machine-readable instructions executable by the one or more processing units (302), wherein the modules (310) are configured to perform the method steps according to claims 1 to 9.
11. A system (100) for optimizing a design of one or more virtual assets (104a-104n) presented in a computer simulation environment (102) such that the optimized design complies with safety standards defined for an industrial environment, the system comprising: a computer simulation environment (102) comprising one or more virtual assets (104a-104n); a communication network (106) communicatively coupled to the computer simulation environment (102); and The apparatus (108) according to claim 8, which is communicatively coupled to the communication network (106) and to the computer simulation environment (102), wherein the apparatus (108) is configured for optimizing a design of one or more virtual assets (104a-104n) rendered in the computer simulation environment (102) according to any one of the method claims 1 to 9, such that the optimized design complies with safety standards defined for the industrial environment.
12. A computer program product, in which computer readable instructions are stored, which, when executed by a processing unit (302), cause the processing unit (302) to perform the method steps according to any one of claims 1 to 9.
13. A computer readable medium having stored thereon program code sections of a computer program, the program code sections being loadable into and / or executable within a system, to cause the system to perform the method steps according to any one of claims 1 to 9, when the program code sections are executed within the system.