AR System Marker Recognition for Biopharm Assembly

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The complexity of measurement and production set-ups, particularly in the biopharmaceutical industry, leads to challenges in efficient assembly, monitoring, and maintenance due to the need for manual visual inspection and navigation through multiple manuals, which increases the likelihood of errors and reduces operational efficiency.

Innovation Solution

An augmented reality system with sensing devices and a processing unit that captures and identifies markers associated with set-up components, providing real-time feedback on alignment and connection status, thereby automating the assembly and monitoring process and reducing human error.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual visual inspection and navigation through multiple manuals is used for assembly and monitoring, then operators can perform basic setup tasks, but the complexity of measurement and production set-ups increases error likelihood and reduces operational efficiency

Engineering Contradiction:
Improveease of assembly and monitoringVSAvoidcomplexity of measurement and production set-ups
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces manual visual inspection and manual navigation through multiple manuals with an automated optical recognition system. The system uses cameras or sensors to detect markers on components, automatically identifies component types and connections, and retrieves relevant information from databases, substituting the mechanical human eye and hand navigation through documents with an automated vision-based system.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables the measurement and production set-ups to self-identify and self-document their configuration. Components with embedded markers automatically provide their identity and connection status to the system, which then autonomously builds a digital model and retrieves appropriate information, eliminating the need for operators to manually document or navigate through manuals.

Inventive Principle:
Principle #25Self-service

2Productivity

If manual inspection methods are used, then basic assembly can be performed, but the likelihood of errors increases and operational efficiency decreases

Engineering Contradiction:
Improveoperational efficiencyVSAvoiderror likelihood in assembly
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system implements automated feedback by continuously monitoring component connections through optical recognition of markers. The system compares the detected physical configuration against the intended configuration from technical data sheets, automatically identifies deviations or errors, and provides real-time feedback to operators, thereby reducing error likelihood and improving reliability.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent replaces error-prone manual inspection with automated optical recognition and database querying systems. The automated system consistently identifies component markers, determines connections, and retrieves verification information without human fatigue or distraction, significantly reducing error likelihood while improving operational efficiency.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Loss of information

If operators navigate through multiple manuals to find relevant information, then comprehensive technical data can be accessed, but time is lost and operational efficiency is reduced

Engineering Contradiction:
Improveaccess to technical informationVSAvoidtime to locate and process information
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system performs preliminary action by pre-organizing all technical information in structured databases associated with specific component types and configurations. Before operators need the information, the system has already captured the component markers, identified the components, and made the relevant technical data immediately accessible through automatic database querying based on the detected configuration.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces the manual process of navigating through multiple physical or digital manuals with an automated information retrieval system. The system uses optical recognition to identify components, automatically queries databases using component identifiers and connection data, and presents relevant information without requiring operators to manually search through documentation, thereby eliminating time loss while maintaining comprehensive information access.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Manufacturing precision

If visual and manual inspection is used for connection verification, then basic assembly validation can be performed, but the process is time-consuming and prone to human error

Engineering Contradiction:
Improveaccuracy of connection verificationVSAvoidtime for inspection and validation
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent replaces manual visual inspection of connections with an automated optical recognition system that detects markers on components and uses image processing to verify connection status. The system automatically determines whether components are properly connected by analyzing marker positions and configurations, providing precise verification without human error while reducing inspection time through automated processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system implements automated feedback for connection verification by continuously monitoring marker positions and connection status. The system immediately provides feedback on whether connections are correct or incorrect, eliminating the delay associated with manual inspection and providing real-time validation that prevents propagation of assembly errors.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS8749396B2Assembling method, monitoring method, communication method, augmented reality system and computer program product
Publication Date: 2014.06.10 SARTORIUS STEDIM BIOTECH GMBH
  • US8749396B2 patent drawing
  • US8749396B2 patent drawing
  • US8749396B2 patent drawing

AI summary

An augmented reality system, an assembling method for assembling a first set-up component to a second set-up component under the assistance of an augmented reality system, a method for monitoring a set-up component and a method for transmitting data from or to a set-up component are provided. The augmented realty system may capture a variable marker associated with the respective set-up component. The augmented reality system can recognize the location and/or status of the variable marker and thus decide whether the connection between the first and second set-up component is established correctly or not. Further, data can be transmitted by the variable marker monitored by the augmented reality system.