Method for virtually configuring a device, computer program product, and corresponding augmented reality system

Description

[0001] The present invention relates to a method for the virtual configuration of a device, a corresponding computer program product, and a corresponding augmented reality system. In particular, an improved method for the configuration and / or adaptation and / or individualization and / or optimization of a device, in particular a bioprocess device, is provided. The invention can be used in particular in the following fields: biotechnology, the biopharmaceutical and pharmaceutical industry, medical technology, the chemical industry, physical engineering, food technology, processing technology, and the like. Particular preference is given to the interactive use of the method by a user, in particular a customer, who wishes to place an order with a provider / seller, for example online, via a self-configured device.

[0002] Until now, it has been common practice for a device to be configured by positioning and / or assembling and / or testing and / or commissioning real device elements in a real environment. For this purpose, the operating status and / or functionality, and in particular the correct connection of the real device elements to be assembled, are checked visually and / or manually. Accordingly, before commissioning the device, a user must verify all compatibilities and / or connections, in particular by consulting technical data sheets and selecting suitable and compatible real device elements.

[0003] As systems and facilities become increasingly complex, more effective and, in particular, more efficient procedures for configuration and / or optimization and / or test runs are required. The biopharmaceutical industry, in particular, which is subject to strict regulations and record-keeping requirements, relies on the most reliable and trouble-free operation of systems and facilities.

[0004] Furthermore, the usually very high-quality products that are produced and / or used within a facility, for example, in single-use vessels of a bioreactor, require perfectly functioning equipment elements and / or the flawless interaction of multiple equipment elements. This requires that faulty assembly be avoided right from the start during the configuration of a facility.

[0005] US 2017 / 076500 A1 describes a method for a measurement or production setup, which comprises providing a visualization system with a processor, an output device, and a capture module for capturing identification data of a workspace. The method further provides a first setup component having at least one first marker in the workspace, and a second setup component having at least one second marker in the workspace and connectable to the first setup component via at least one connection. The method captures identification data about the markers and identifies the markers. The processor retrieves digital information for the markers from a database and makes a decision about connecting the setup components based on the retrieved digital information and the captured identification data.The method then outputs a visual representation of the connection between the first and second device components according to the decision. The visualization system may be an augmented reality system.

[0006] The invention is therefore based on the object of providing a method, a computer program product and an augmented reality system, each of which enables an efficient configuration of a device.

[0007] The object is achieved by the independent claims. Particularly preferred embodiments are the subject of the dependent claims.

[0008] The invention relates to a method for the virtual configuration of a device, in particular a bioprocess device, according to claim 1.

[0009] A bioprocessing facility is understood to mean objects / elements, in particular for the processing of biological media, as well as their systemic combination, for example in modular form, in systems. Such a system and / or such an element can be or comprise, for example, a bioreactor, a disposable bag, a container, a tank, a filter system, a mixing tank, a fermentation tank, etc., which can be arranged as individual objects or in so-called process units (unit operations). These can be accommodated in rooms such as laboratories, clean rooms, manufacturing and production halls in which, for example, biopharmaceutical active ingredients and / or functional food are developed and produced. The invention can be used in particular in the pharmaceutical and / or biopharmaceutical industry and / or the food and / or beverage industry.

[0010] A medium can, in particular, be a gas and / or a liquid and / or a solid, for example, a granulate. In particular, the term "medium" can refer to a dispersion, in particular an emulsion, a suspension, a gel, and / or a foam. A medium particularly preferably comprises a biological and / or chemical substance, for example, cells, plants, bacteria, and / or their components and / or products. For example, a medium can be a cell culture medium and / or a buffer system. Most preferably, the medium is a fluid or has fluid properties. A medium can also comprise a substance or mixture of substances that serves for the production of and / or as a component of a food, in particular a so-called functional food. In other words, a medium can, in particular, be any substance or anything that can flow.

[0011] In particular, based on an augmented reality system or a system for generating an augmented reality, which comprises a computer or a computing unit and at least one sensor or detector unit, the following method is carried out: Recording sensor data by means of the sensor unit or entries of a sensor data set which correspond to a physical environment or at least partially characterize a physical environment; translating or transforming or digitizing the physical environment into a virtual environment based on entries of the sensor data set, in particular comprising reconstructing and / or mapping the physical environment in a virtual format; virtually arranging or positioning a virtual device element, to which entries of a parameter data set are assigned, within and / or with respect to the virtual environment; virtually testing, in particular comparing compatibilities and / or simulating the device and its function based on the entries of the parameter data set and the sensor data set.

[0012] This advantageously enables a method that translates and / or digitizes a real physical environment, and preferably a physical furnishing element, into a virtual representation or a virtual environment. In other words, physical aspects of a real environment are digitized or digitally captured. In this process, virtual furnishing elements can be virtually added to the virtual environment. In particular, a virtual furnishing element is essentially a model, at least an approximate model, of a real physical furnishing element in its virtual properties, or corresponds at least partially to the properties of a real physical furnishing element in its virtual properties.

[0013] The virtual properties of a virtual furnishing element are defined by key data, which can typically be obtained from corresponding data sheets and / or a property database, among other sources. Such key data can be or comprise part of a parameter data set. This also corresponds to a type of digitization and / or modeling of a physical furnishing element. Consequently, a virtual environment comprising virtual furnishing elements corresponds to a digital model of a real physical environment comprising one or more physical furnishing elements. The model can be as detailed as desired, i.e., it can be characterized by any number of parameters, which are, among other things, predetermined by the physical environment.

[0014] This advantageously enables the user to configure a virtual facility, in particular a bioprocess facility or, for example, a laboratory setup for biotechnological applications, particularly efficiently and intuitively, and especially interactively, using computer support. The virtual facility comprises at least one virtual facility element. The configuration essentially takes place before the physical facility element, which corresponds to the at least one virtual facility element, is installed, whereby it often has to be ordered and actually acquired for this purpose.

[0015] In this way, a user of the method interested in installing one or more corresponding installation elements can try out or test it in advance to determine whether it meets their requirements and / or whether it is compatible with other, particularly existing, physical installation elements. Preferably, the user can check and / or test and / or try out whether the installation can be operated essentially error-free.

[0016] The described method is particularly advantageous for the configuration of complex devices and systems or facilities that are defined by a large number of parameters from a parameter data set. It is therefore not necessary to actually install the device, system or facility in question in order to test or try it out in the physical environment. The testing or trying out of the device and / or facility takes place virtually in an augmented reality, in any desired complexity and including any desired number of parameters, and in particular predicts whether or not it will function correctly and without errors. In other words, it can be virtually determined or predicted whether a facility, as desired or initially configured by a user, can be constructed and / or connected and / or set up and / or operated without errors.It is particularly preferred to be able to simulate a function or functionality and / or an operating state so that the user also receives information about whether the desired configuration has the functionality suitable for his purposes and requirements.

[0017] A function can, for example, comprise process steps performed by an element or the entire device, and in particular include temperature control, mixing of the medium, adding a substance to the medium, building up or reducing pressure, discharging a portion of the medium, and / or other steps. An operating state can encompass the compatibility or "matching" of elements, the "fitting" of the elements into the space, and / or a specific state, such as "container empty" or "container full," "valve open," "valve closed," "element at operating temperature," or similar. It may also be the case that a "function and / or functionality" is not clearly distinguished from an "operating state," which is why the terms "function and / or functionality" and "operating state" may mean the same thing under certain circumstances.

[0018] Using the described method, the user and / or distributor of physical furnishing elements can thus minimize considerable costs and time expenditure by configuring a complex facility and / or system in advance in a virtual, interactive, and computer-assisted manner, and thus avoid corresponding configuration errors. In particular, it can prevent physical furnishing elements, such as biotechnological systems and / or bioreactors, from being installed "on suspicion" (in particular, manufactured and assembled, acquired, and / or delivered), which may pose the risk of faulty functionality and / or compatibility being discovered on-site after installation, particularly in interaction with the physical environment and / or other physical furnishing elements.In this case, the unsuitable physical furnishing element that was purchased or at least delivered would have to be returned, which would cause undesirable time and expense for the user and / or the supplier.

[0019] Furthermore, it advantageously avoids the need for a customer and / or user to study numerous complicated data sheets and / or catalogs and / or consult databases to identify and select a suitable and compatible furnishing element. The described method has the advantage of providing a particularly intuitive, efficient, and user-friendly way to configure a furnishing.

[0020] The at least one sensor unit comprises a camera or a photographic device. The camera can in particular be a 3D-capable camera, i.e. a camera capable of capturing two- or three-dimensional coordinates of a space or an environment. The step of detecting the sensor data set associated with the physical environment comprises a step of recording or capturing an image of the physical environment. The sensor data set comprises spatial information, in particular a 3D topography and / or three-dimensional (3D) coordinates of a space, and a direction of gravity. A photo is taken of a physical, real environment, for example a laboratory. The photo preferably comprises data that contains three-dimensional coordinates or from which three-dimensional coordinates can be derived. Such data correspond, for example, to entries in a sensor data set.

[0021] Capturing spatial properties of a physical or real environment allows a virtual 3D environment to be reconstructed as an image of the physical environment. This is particularly advantageous for determining distances and comparing dimensions. For example, it can be determined whether a piece of furniture has sufficient space at the desired location. Physical components, such as parts of laboratory equipment and / or pieces of furniture, can also be recognized, particularly as storage areas, and can be considered for the virtual positioning or arrangement of virtual furniture elements.

[0022] A direction of gravity, which can be provided, for example, by a marking in the room, here referred to as a gravity marker, is detected. The direction of gravity is determined using at least one gravity sensor that is arranged in the physical environment and / or contained in a detector (e.g., a smartphone). Using the direction of gravity indicated by the gravity marker and the position of two virtual furnishing elements, it is possible, for example, to predict the pumping power required to generate a flow from one virtual furnishing element to another. In addition, load distributions and / or lengths of sagging cables and hoses or cables running / lying on the floor can be calculated.

[0023] According to one aspect, the method further comprises a step of providing at least one spatial or environmental marker, in particular comprising a first augmented reality marker (AR marker for short) and / or a QR marker (in particular according to the standard ISO / IEC 18004:2006), in the physical or real environment, wherein the spatial information, in particular a 3D topology of the physical environment, can be captured and reproduced or specified by means of the spatial marker.

[0024] An augmented reality (AR) marker can essentially be any type of marker that allows assignment or recognition. For example, a sheet of paper with a dot or cross on it can serve as a physical marker. The sheet of paper can be placed by a user at a location in the physical environment, and the computing unit recognizes that a virtual furnishing element is to be virtually placed at that location. A direction of gravity, for example, can also be indicated by such an AR marker, for example by an arrow. Essentially, the only thing that matters is which function or coding is assigned to the AR marker. The AR marker itself can be any possible marker that can be arranged in a detectable (especially visible) manner in the physical environment.

[0025] An AR marking can be displayed not only on its own, but also, for example, together with a QR marking or can include one. In general, a distinction must be made between the coding of a QR marking and the coding of an AR marking, since the QR marking in the form of black and white boxes essentially corresponds to or is assigned to a specific string according to the corresponding QR coding, which can be read out by a computing unit that knows the QR coding. Essentially, the QR marking does not contain any coded information about the position and / or orientation of an object in space due to the QR coding. However, since an AR marking can have any pattern, it could also be displayed in the form of a QR marking. To analyze the spatial information, only the pattern itself would be used based on the perspective representation orcan be analyzed based on its spatial position, whereby the QR code can initially be neglected. However, to read the coded information, such as the identity of the object to be represented, the QR code is decoded. Both processes can take place separately. Thus, in principle, a QR code could also serve as an AR marker.

[0026] Providing or attaching a spatial marker in a room allows a user who does not own and / or wish to use a 3D-capable camera to easily mark or indicate the spatiality of an area in the room, allowing a computing unit to extract the spatial information from it. Such spatial markers can, for example, be provided online for printing by the distributor of the furnishing elements. A suitable algorithm can then be executed by the computing unit, whereby the spatial coordinates or features of the marked area are derived or determined.

[0027] According to one aspect, the method further comprises a step of providing an object marker (which can also be referred to as a destination marker of a virtual and / or physical facility element and can optionally also comprise an identity marker), in particular comprising a second augmented reality marker (AR marker for short) and / or a QR marker (in particular according to the standard ISO / IEC 18004:2006), in the physical environment, wherein a virtual position or a virtual destination and / or a virtual orientation with respect to the virtual environment and / or an identity of the virtual facility element is given or specified by means of the object marker.

[0028] An object marker may be a marker that a user places in the physical environment at a physical target location where a virtual furnishing element is to be placed at the target location in the virtual environment. The object marker may include information about the target location and / or about the orientation of the virtual furnishing element relative to the virtual environment and / or about the identity of the virtual furnishing element.

[0029] Particularly preferably, the object marker comprises an AR marker, which in particular comprises information about its position and location in the space of the physical environment. This information is then translated such that a virtual furnishing element can be arranged in a virtual space based on the AR marker and its location or positioning in the space of the physical environment. In particular, the AR marker also contains information about the identity of the virtual furnishing element, so that the computing unit can identify the virtual furnishing element and arrange it accordingly virtually in the virtual environment. This specific case could be achieved by physically arranging an AR marker and a QR marker at one location in the physical environment.A very special case is when only a QR mark is physically arranged, which is then read based on the position of its pattern in space with respect to the spatial arrangement and is read out by decoding the QR coding for its coded content, for example comprising an identity.

[0030] According to one aspect, the method comprises the following steps: Allowing a user and / or the computing unit to select at least one virtual furnishing element, preferably from a selection of several virtual furnishing elements, for example from a product range or a product catalog; and in particular providing a registered or known physical furnishing element in the physical environment, wherein the selection of the at least one virtual furnishing element preferably takes place by means of the computing unit, in particular automatically, and wherein the selection of the at least one virtual furnishing element is based on a step of identifying the registered physical furnishing element with a virtual furnishing element, in particular from the selection of the several virtual furnishing elements.

[0031] In other words, the user can select a desired virtual furnishing element themselves, in particular from a selection, for example from an online product catalog. Additionally or alternatively, a computing unit can also select a suitable, for example compatible, virtual furnishing element. In particular, a computing unit can suggest a plurality of suitable virtual furnishing elements from which the user can search for and / or select a virtual furnishing element. In particular, a computing unit can recognize or identify a registered physical furnishing element positioned in the physical environment and assign it to a corresponding virtual furnishing element, which corresponds to an automatic selection of the virtual furnishing element predetermined by the furnishing element present in the physical environment.

[0032] The described selection of a virtual furnishing element has the advantage of being particularly intuitive, efficient, and user-friendly. The processing unit can assist the user in selecting a suitable virtual furnishing element, eliminating the need to consult a data sheet. The processing unit can also automatically recognize registered devices, i.e., registered physical furnishing elements that are currently and / or have been sold by the distributor.

[0033] According to one aspect, the previously described step of identifying the registered physical device element comprises a step of recognizing one or more shape features of the device element and / or an identity marking, in particular a third AR marking and / or QR marking of the registered physical device element.

[0034] Particularly preferred is the embodiment in which a computing unit recognizes which registered device or physical device element is involved based on typical or characteristic shape features of the physical device element, since advantageously, essentially no input from the user is required. Another embodiment is based on the provision of an identity marker, which the user can attach to the corresponding physical device element before capturing the sensor data set. The computing unit evaluates this identity marker, which can be an AR marker, for example, and assigns or allocates a corresponding virtual device element to the physical device element.

[0035] According to one aspect, the at least one virtual device element comprises at least one of the following device elements: a bioreactor, a disposable bag, a container, a tank, a filter system, a mixing device, a fermentation tank, a centrifuge, a chromatography column, a membrane adsorber, a filling device. The at least one virtual device element comprises at least one virtual connecting element, which is a virtual cable or a virtual hose. For a better understanding of the invention, the virtual connecting element can comprise at least one of the following: an attachment, an adapter, a connection, a connector, a pipe, a line, a tube, a pump.Furthermore, the parameter data set comprises in particular at least one variable and / or one fixed value from the following parameters: an identification code, an order number, a volume, a length, a spatial extent, a diameter, a structure, a material, an operating range, an operating limit value, compatibility with another virtual device element, compatibility with a biological and / or chemical reaction, a parameter data set for a medium, in particular a fluid medium, and preferably the biological and / or chemical reaction of the medium.

[0036] Accessories for biotechnological and / or chemical applications, for example, among others, bioreactors, reusable and / or disposable bags, containers, tanks, filter systems, mixing tanks and / or equipment, fermentation tanks, a centrifuge, a filtration column, a membrane adsorber, a filling device and / or similar devices can be of varying complexity in their handling and operation. These often involve very specialized devices and articles or accessories that can be used for very specific purposes. It is therefore rarely obvious whether different devices are compatible with one another and can be coordinated or harmonized. The accessories mentioned as examples can be identified in detail by the parameter entries in the respective parameter data set. Checking whether two devices are compatible with one another usually requires comparing the parameter entries.According to the aforementioned aspect, this step can be (at least partially) automated, so that the computing unit evaluates, assesses, or predicts in advance whether two devices are compatible. For this purpose, virtual equipment elements are created, such as virtual bioreactors, virtual disposable bags, virtual containers, virtual tanks, virtual filter systems, virtual mixing tanks, and virtual fermentation tanks, which, as virtual models, correspond to the respective physical equipment elements.

[0037] The virtual and / or physical device elements mentioned as examples can be characterized by data and / or parameter entries, such as, among others, a volume, a material, a compressive strength, a spatial extent, a diameter, a structure, an operating range, an operating limit, compatibility with another virtual device element, compatibility with a biological and / or chemical reaction and / or a sterilization process.

[0038] The accessories are often containers or the accessories include containers in which media, for example buffer systems and / or cell culture media, are processed and / or stored. It can happen that a medium is to flow between two containers, for example if a first process, e.g. the production of a substance in a medium, takes place in a first container and then into a second or further containers for a second process. This requires that a virtual connecting element virtually connects the two containers to one another, for example using a virtual hose, a virtual pipe, a virtual line, a virtual tube, a virtual pump, a virtual attachment, a virtual adapter, a virtual and / or physical connector and / or a virtual connection, unless the medium is to be transported in any other way.The aforementioned elements each correspond in particular to a real, i.e. physical hose, a physical pipe, a physical line, a physical tube, a physical pump, a physical attachment, a physical adapter or a physical connection. In this way, for example, it is also possible to predict, in particular to simulate, whether and how a medium, in particular a liquid, will flow between two containers. In particular, a required pumping power can also be determined, preferably taking into account gravity or the direction of gravity. Furthermore, it may be possible to predict, in particular to simulate, multiple processes in multiple containers.

[0039] A virtual connection element is a virtual cable, which corresponds to a physical cable, or a virtual hose. For example, a power outlet present in the physical environment can be recognized by the computing unit and translated into a virtual power outlet. In this case, a virtual device, in particular a power-operated device, can be virtually connected to the virtual power outlet via the virtual cable. It would also be possible to connect multiple virtual device elements to one another, for example, via a virtual power cable and / or a virtual data cable.

[0040] A virtual device element is defined by the data and / or parameter entries of a parameter data set. A virtual connection element, such as a virtual hose, can be defined by the following data entries of a parameter data set, among others: a volume, a length, a weight per unit length, a diameter, a structure, a material, a strength and / or flexibility, an operating range with regard to temperature, acid and / or base concentration and / or pressure, a corresponding operating limit, compatibility with another virtual device element, compatibility with a biological and / or chemical reaction, resistance to sterilization, a reactive / inert property towards substances.

[0041] A data and / or parameter entry can also include a function or a dependency. For example, a characteristic curve determined in an experiment can represent or represent a dependency between two quantities or data and / or parameter entries. For example, the material strength and / or material expansion of a hose can be plotted against a pressure or described by the function.

[0042] The data entries can be used, for example, to simulate a flow of a medium and / or to predict which virtual adapter or virtual connector is required.

[0043] Other data entries in the parameter data set can relate to a medium and / or a process. While such data entries do not characterize the intrinsic properties of a piece of equipment, they can be used to predict and, in particular, simulate a process and / or the flow of a medium. For example, to determine a material flow, parameters such as viscosity and density, as well as the volume of the medium, are required. Using these parameter entries and the parameter entries of a virtual hose, such as diameter and length, it is possible to calculate how the medium will flow through the hose.

[0044] Other data entries corresponding to administrative variables and characterizing a virtual and thus also physical furnishing element can include an identification code, an order number, a price per unit or per meter, and / or an existing quantity. These parameters can be used to determine a price offer.

[0045] Parameter entries can include fixed entries, i.e., values that cannot be changed by the user, especially a buyer. For example, this would be the case for values or parameter entries such as the identification code, the order number, but also for parameter entries such as weight per unit volume or length, material strength, and similar. However, parameter entries can also be changed by a user and / or a buyer or customer. For example, the customer can specify the length of a fastener, the volume of a container, or the material on a scale with continuous or discrete values.

[0046] According to this aspect, a high degree of flexibility in configuring the device is enabled, while at the same time, a variety of operating states can be predicted, in particular simulated. Therefore, this embodiment offers a particularly high degree of user-friendliness and efficiency.

[0047] According to one aspect, determining the virtual arrangement comprises determining at least two virtual device elements, one of which comprises a virtual connection element, and the method further comprises the following steps: Checking the compatibility between the at least two virtual device elements; if compatibility was determined during the test: ∘ Allowing a virtual connection of the at least two virtual device elements by means of the virtual connection element by the user and / or the computing unit; if compatibility was not determined during the test: ∘ Output of an error message indicating the lack of compatibility.

[0048] In particular, it is advantageous to be able to predict whether two physical equipment elements are compatible with each other, so that this is not determined until the physical equipment elements have been purchased and delivered to the customer. Compatibility is tested or verified through the virtual configuration of the virtual equipment elements. Compatibility may be compromised, for example, if two connections are incompatible or if operating ranges, such as pressure or temperature, do not overlap.By issuing an error message indicating the lack of compatibility, the user and / or customer can decide whether they actually want to purchase the physical furnishing elements that correspond to the selected virtual furnishing elements, or whether they would prefer to select a compatible physical furnishing element that meets their requirements. The computing unit can preferably make a selection of compatible furnishing elements from which the user can search for or select a suitable one.

[0049] If the test concludes that all virtual furnishing elements are compatible with each other, the user and / or customer can be sure that they can order or purchase the desired furnishing elements without the risk that these furnishing elements will then not be compatible with each other on site.

[0050] Determining the virtual arrangement comprises determining at least three virtual device elements, wherein one of the at least three virtual device elements corresponds to the virtual connection element; wherein the parameter data set associated with the virtual connection element comprises a length of the connection element; and wherein two of the at least three virtual device elements each comprise at least one connector for connecting one end of the virtual connection element; and the method further comprises the following steps: Determining a virtual distance between the at least two connections in the virtual environment based on the sensor data set, the parameter data set, and the virtual arrangement; Determining the virtual length of the connecting element, in particular an optimal length, in particular based on the distance between the at least two connections in the virtual environment, wherein the length is determined by means of a computing unit and / or by means of a user.

[0051] When determining the virtual length, the connecting element is arranged in the virtual environment taking into account a detected direction of gravity and the resulting weight force.

[0052] The described embodiment has the advantage that a connecting element, in particular a hose, can be adapted efficiently and intuitively to the furnishings, as well as to the virtual furnishing elements and the positioning of the furnishing elements in the virtual environment. Thus, the optimal length of a hose can be determined depending on its desired virtual path in the room, thus avoiding the risk of choosing an excessively short length or excess length "on suspicion." In particular, the path of a hose is realistically determined by its own weight. The virtual hose is connected at each of its ends to two virtual furnishing elements. The virtual hose hangs from a virtual connection of one virtual furnishing element and runs virtually along the virtual floor to another virtual connection of the other virtual furnishing element.

[0053] The augmented reality system further comprises a screen, in particular a touch screen, and the method further comprises a step of imaging the virtual environment and the at least one virtual furnishing element in the form of an augmented reality image of the virtual arrangement on the screen.

[0054] A user interface is displayed on the screen. This can be designed to be used interactively by the user. This means that the user can provide inputs that are processed by a computing unit. An embodiment in which the user interface is designed to be intuitive and simple is particularly preferred. In particular, the virtual environment, i.e., the reconstructed physical environment or the image of the physical environment, is displayed on the screen within the user interface, along with selected virtual device elements positioned in the virtual environment. The user can thus obtain a visual impression of the configured device or its intermediate results during the process steps of the virtual configuration.

[0055] According to one aspect, determining the virtual arrangement further comprises at least one step of arranging the at least one virtual furnishing element by dragging and dropping it by the user using the screen.

[0056] This preferred embodiment allows the user to position, move, add, and / or modify virtual elements in a virtual environment, and to determine, modify, optimize, and / or change parameters or parameter entries of a parameter data set, particularly intuitively and efficiently. This can be done using a mouse pointer or cursor and / or drag-and-drop, and in particular, the method step can be performed manually on the touch screen. No special expertise or prior knowledge is required to perform the step according to this aspect, and the step can be performed intuitively in a short time. "Drag-and-drop" refers to selecting and virtually grasping an element by clicking with the mouse pointer and then virtually dragging it to a desired location in the user interface on the screen.

[0057] According to one aspect, at least one variable size of the parameter data set, in particular a length of the virtual furnishing element, can be determined by the user on the screen, in particular by actuating the touch screen.

[0058] This particularly intuitive design allows the user, for example, to determine and / or predict the possible path of a hose depending on the selected length. Using a so-called "slider" or "track bar," the user can dynamically adjust or determine the length of a virtual hose, for example, using the mouse cursor or by hand on the touchscreen. Alternatively, a discrete value and / or parameter entry can be entered or clicked.

[0059] Parameter entries can preferably be set dynamically or selectively. In other words, the user can continuously or discretely determine on a scale which value a parameter entry in the parameter data set should assume. For example, using a checkbox or a slider, the user can determine whether the volume of a container should assume or have discrete values, such as 5 l, 100 l, 200 l, 500 l, 1000 l, 3000 l, or 5000 l. This makes configuration particularly simple and efficient.

[0060] According to one aspect, the sensor data set associated with the physical environment comprises at least one of the following quantities: a temperature, a time, an electric field strength, a light intensity, a vibration, a sound.

[0061] In other words, the sensor or sensor unit can preferably record a quantity or an associated field, which can then be overlaid, for example, with the spatial coordinates. If one of the sensor units is an infrared camera, the user can record the temperature of the room, which is overlaid with the spatial representation or the virtual environment. Based on such a data set, the influence of a quantity such as temperature on a furnishing element and / or a process occurring within a furnishing element can be simulated.This particular embodiment allows the user to simulate processes in advance at a relatively complex level, i.e., by incorporating a large number of sensor parameters from a sensor parameter dataset, and to predict whether the selected virtual facility elements, as physical facility elements, will meet the requirements of the physical environment and the desired processes in reality. Since the products used and / or produced in biochemical processes often involve very high-quality media or substances, it is particularly advantageous if a process can be modeled at least approximately using the available parameters in such a way that the success or yield of a process can at least be estimated or predicted, in particular simulated, in advance. This would avoid carrying out a real process at great expense with unsuitable physical facility elements and / or parameters.

[0062] An embodiment of the method may also include a step of detecting disturbing factors, such as light and / or vibrations, so that the user can be informed that the disturbing factor may be problematic for the use of a physical device element or for the course of a process and should possibly be eliminated by the user.

[0063] In particular, sensor parameters are recorded dynamically over a certain period of time so that, for example, the effect of a temperature fluctuation on a process can be predicted.

[0064] According to one aspect, the step of predicting the operating state of at least one part of the device comprises a step of simulating at least one dynamic variable of a dynamic process, based on the sensor data set, the parameter data set, and / or the virtual arrangement. The dynamic process comprises, in particular, at least one of the following properties or processes: a material flow, a biological process, a chemical process, a physical process, and / or a mechanical process. Therefore, parameter entries relating to a desired process are preferably also provided. For example, a user can specify which quantity(s) and / or which substance(s) are used for the process. For example, a starting temperature, a starting pressure, and / or a stirring speed can also be set.The method can be designed to predict the course of the process with regard to the biochemical and / or thermodynamic processes.

[0065] According to one aspect, the step of predicting an operating state comprises a step of reporting a correct operating state or reporting an incorrect operating state, in particular based on the step of simulating the at least one dynamic variable.

[0066] It is advantageous to test and / or verify in advance, in a model of the virtual facility that the user has configured, particularly with the aid of a suitable user interface, whether the corresponding physical facility will meet the user's requirements. If this is not the case according to the prediction and / or simulation, the user can easily and flexibly replace virtual facility elements and verify whether the newly configured virtual facility achieves better results with regard to the dynamic processes. Alternatively or additionally, the user can also adapt, change, or vary parameters of a parameter data set.

[0067] The trial and error process can preferably serve to optimize a virtual device with regard to a desired aspect. Particularly preferred is the step of assistance by the computing unit, which can suggest to the user possibly improved and, in particular, optimal solutions for configuring the virtual device with regard to an aspect and, in particular, an optimal dynamic process. For example, the computing unit can suggest to the user the most cost-effective and / or space-saving and / or efficient solution for a configured device. The computing unit can also make a suggestion regarding optimal positioning of the virtual device elements in the virtual environment by recognizing surfaces on which a virtual device element can be positioned.For this purpose, a particular embodiment may allow the user to determine one or more priorities according to which the optimization should be based.

[0068] According to one aspect, the method further comprises the following steps: Allowing a request for quotation for the at least one virtual furnishing element based on the parameter data set; creating a quotation based on the request for quotation; allowing a goods order request; processing a goods order based on the goods order request.

[0069] This preferred embodiment enables the user, particularly after testing and / or trying out the virtually configured facility, to submit a request for a quote and receive a corresponding quote for the respective physical facility elements. The user can then place an order for the desired physical facility elements. The advantage of this embodiment is, among other things, that the user can familiarize themselves with the facility before purchasing the physical facility elements. In particular, the user and / or customer can save the virtual facility as a file on a server or other storage device. This has the advantage that a service employee of the provider can access the virtual model of the physical facility online from a distance, i.e. not on site, for example for the purpose of fault diagnosis and / or technical advice.The virtual model can thus serve as a so-called digital twin of the physical facility. By specifying the utilization of the physical facility, the wear and tear of aging elements of the physical facility can be predicted and / or forecast. Furthermore, the user can receive notification from the distributor about when an inspection or maintenance of the physical facility should take place.

[0070] According to one aspect, the method comprises a step of manual marking, preferably by finger on a touch screen or by mouse pointer, in the virtual environment with the aid of a screen, in particular for marking a virtual spatial point and / or a virtual and / or physical furnishing element.

[0071] If marking is to be carried out without physically attaching a room and / or identity marker, the user can also subsequently place markers manually in the virtual environment. For example, an application function can allow the user to indicate with a finger the direction of gravity and / or the location of a virtual furnishing element and / or which physical furnishing element is to be identified. The user can also mark a virtual connection in the virtual space, for example a power outlet and / or a virtual connection of a virtual furnishing element and / or a gas supply and / or a drain. This allows the user to configure a facility with even less effort. In particular, this can achieve a greater degree of flexibility.Particularly preferred is a function of the application that offers a step of providing options. For example, the application can provide the user with the option of manually placing an identity marker and / or a spatial marker in the virtual environment.

[0072] The invention also relates to a computer program product, in particular a computer program product stored on a computer-readable storage medium, for a computer-aided virtual configuration of a device, in particular a bioreactor device, according to claim 14.

[0073] A computer program product, particularly in the form of an application and / or app, can cause the computing unit to execute the essential automated steps of the process for configuring the device in augmented reality. Using a user interface, the computing unit can execute the configuration together with the user's interactive inputs. Essential steps that require computing power are executed by the computing unit to support the user.

[0074] Furthermore, the invention relates to an augmented reality (AR) system for a virtual configuration of a device, in particular a bioreactor system, according to claim 15.

[0075] A system for generating augmented reality, i.e., an augmented reality system according to the invention, is designed to be particularly simple, so that an average user who has a smartphone and / or a tablet and / or a PC and a camera essentially needs to purchase no additional elements and merely needs to download an application and / or software. Nevertheless, the augmented reality system can comprise special elements, such as a 3D-capable camera or an infrared vision device or an infrared camera. In particular, the normal or ordinary or average user and / or customer is enabled to configure a device, in particular a system for processing biochemical and / or chemical media, in particular liquids, without great effort.

[0076] The terms "physical environment" and "physical furnishing element" can also refer to a physical or real environment and a physical or real furnishing element, respectively. The terms "physical" and "physical" specifically refer to "real" and "realistic" respectively.

[0077] In the following, particular and / or preferred embodiments are described in detail with reference to the figures. Individual aspects that are not described in combination may be explicitly combined with one another, provided they are not mutually exclusive.

[0078] They show: Fig. 1a a flowchart of a chronological sequence of method steps for the virtual configuration of a device according to one embodiment; Fig. 1b a flowchart of a chronological sequence of procedural steps corresponding to the Fig. 1a follow the method steps shown for the virtual configuration of a device 500 according to one aspect; Fig. 2a a step of recording sensor data by the user according to an embodiment; Fig. 2b a step of digitizing the sensor data according to an embodiment; Fig. 3 a step of determining a virtual environment according to an embodiment; Fig. 4 a step of determining a virtual environment according to an embodiment; Fig. 5 a step of determining a virtual environment according to an embodiment; Fig. 6 a step of determining a virtual environment according to an embodiment; Fig. 7 a step of determining a virtual environment according to an embodiment; Fig. 8 a step of determining a virtual environment according to an embodiment; Fig. 9 a step of predicting an operating state of at least a part of the device according to an embodiment; Fig. 10 a user interface according to an embodiment; Fig. 11 a user interface according to an embodiment; Fig. 12 a user interface according to an embodiment; Fig. 13 a user interface according to one embodiment.

[0079] Fig. 1a is a flowchart of a substantially chronological sequence of method steps for the virtual configuration of a device 500 according to one embodiment. The method is carried out, in particular, interactively between a computing unit 10 and a user 13. In other words, the user 13 makes inputs, and the computing unit 10 executes necessary computing processes and / or communicates with the user 13 in this regard. In particular, a suitable application or a computer program product causes the computing unit to execute method steps. In the following, it is regularly mentioned that a computing unit 10 executes a method step. Essentially, this therefore means that an application causes the computing unit 10 to execute said method steps. The method steps for the virtual configuration of a device 500 according to one embodiment are described in more detail below.

[0080] The method comprises a step of providing 100 a system with augmented reality or an augmented reality (AR) system 1000, which is also referred to as a "system for generating an augmented reality." In particular, the augmented reality system 1000 provides a visual representation of information that supplements a representation (e.g., an image or video) with computer-generated additional information or virtual objects by means of overlay and / or superimposition. The augmented reality system 1000 comprises a computing unit 10, at least one sensor unit 20, and a screen 11, and preferably an application, a program, or a computer program product. Furthermore, the augmented reality system 1000 can comprise an identity marker 62, a spatial marker 33, and / or an object marker 61.The computing unit 10 can be a PC and / or a smartphone 12 and / or a tablet 12 and / or the like. A sensor unit 20 comprises at least one camera, in particular a 3D-capable camera or camera system. A 3D-capable camera is or comprises, in particular, a unit for using photogrammetry or a method designed to record three-dimensional (3D) coordinates or to acquire 3D data. In particular, the 3D-capable camera is designed for 3D data acquisition and spatial and / or object reconstruction. Such a camera can, for example, comprise a laser scanner and its own computing unit for digitizing the spatial coordinates. Any other technology for capturing three-dimensional or 3D coordinates is also conceivable. Additionally or alternatively, the sensor unit 20 can also comprise an infrared camera.Furthermore, the sensor unit 20 can also be designed to detect one or more environmental influences and / or interference signals and / or disturbance variables. For example, the sensor unit 20 can detect or record noises, vibrations, temperatures and temperature fluctuations, electromagnetic fields, and others, in particular over a time course. For this purpose, a sensor unit can also comprise a clock or a chronometer. A screen 11 can be a computer screen and / or the screen of a smartphone 12 and / or a tablet 12, in particular with touchscreen capability. An identity marking 62 can serve to identify an object. An identity marking 62 can in particular comprise a QR code marking (in particular according to the ISO / IEC 18004:2006 standard). A spatial marking 33 can serve to determine spatial features or 3D coordinates and / or directions in space, for example a direction of gravitational force.A spatial marker can also comprise, in particular, an AR marker and / or a QR marker (in particular according to the ISO / IEC 18004:2006 standard). An object marker 61, which is physically arranged in a physical environment 30, can, on the other hand, define or determine the target or destination location of a virtual furnishing element 50 in a virtual environment 40. In an augmented reality system, which is designed to depict or determine a temporally changing virtual environment 40 in real time, an object marker 61 can be moved and / or shifted in the physical environment 30, while the user 13 can monitor or observe in real time how the virtual furnishing element 50 would move virtually in the virtual environment 40. In this way, the user 13 can immediately or in real time create a virtual arrangement and positioning orachieve a "straightening out" of the virtual furnishing element 50.

[0081] The method comprises a step of recording 110 a sensor data set 200 of a physical environment 30 or a real environment, such as a laboratory. The step of recording 110 a sensor data set 200 can be carried out or initiated, in particular, by the user 13. To this end, the user 13 utilizes the at least one function of the sensor unit 20 or the at least one sensor unit 20.

[0082] The sensor data set 200 comprises digitized parameters of a real physical environment 30. Particularly preferably, the sensor data set 200 comprises the spatial or 3D coordinates of at least parts of the physical environment 30. The digitization or the translation and / or transfer of the spatial features into data entries of the sensor data set 200 can be carried out directly by means of the sensor unit, in particular the digital 3D-capable camera, or subsequently by means of the computing unit 10. Furthermore, a temperature and / or a temperature distribution in the room or in the physical environment 30 can be recorded statically or dynamically, in particular over a certain period of time, for example by means of an infrared camera. The data entries in the sensor data set 200 can further comprise electric fields, magnetic fields, electromagnetic fields, vibrations, light intensities, and / or other influences.

[0083] A physical environment 30 corresponds to a real space. Such a space can, for example, comprise a laboratory and / or a hall and / or a similar environment. A sensor data set 200 can preferably also comprise information about the direction of gravity 33 or the direction in which the weight of a potential physical element or furnishing element 51 acts or would act. Such information can, for example, be provided by the user 13 by positioning a physical marking 33 to indicate the direction of gravity, for example in the form of a printed arrow. Alternatively, the computing unit 10 can independently recognize surfaces and / or orientations in an image or illustration, through which the computing unit 10 can independently derive the direction 33 of the direction of gravity and, in particular, a weight force.

[0084] Furthermore, the method comprises a step of determining 120, in particular simulating a virtual environment 40 and / or mapping the physical environment 30 in the form of a virtual environment 40. The step of determining 120 preferably comprises a step of reconstructing the recorded physical environment 30 based on the recorded and digitized sensor data of the sensor data set 200. In other words, a spatial or spatio-temporal model of the physical environment 30 is reconstructed as a model. This can, for example, also comprise an object reconstruction in which a three-dimensional object in the physical environment 30, for example a table or another piece of furniture, is reconstructed and virtually mapped in the virtual environment 40 in a substantially realistic manner.

[0085] Furthermore, determining 120 may also include generating field maps and / or overlaying sensor data, such as a spatial temperature distribution, with a spatial 3D representation of the physical environment 30.

[0086] The method comprises a step of determining 130, 140 a virtual arrangement. This step 130, 140 essentially comprises selecting 130 at least one virtual device element 50.

[0087] Method step 130 may, on the one hand, comprise a step 132 comprising providing a selection of one or more virtual furnishing elements 50. In particular, the computing unit may preselect mutually compatible virtual furnishing elements 50 and, in particular, propose and present them to the user 13. This method step is followed by selecting at least one virtual furnishing element 50. The selection may be performed either by the user 13 or by the computing unit 10. The computing unit may, for example, at least partially independently select, based on predetermined criteria, which virtual furnishing element 50 best meets the requirements of the user 13.

[0088] Additionally or alternatively, method step 130 may also include another step 132. Step 132 comprises providing a physical furnishing element 51 that already exists or has already been installed and / or acquired by user 13 in the past. Physical furnishing element 51 is or was offered and / or registered, in particular, by the provider; for example, there may be data entries of a parameter data set relating to physical furnishing element 51 in a database (e.g., a catalog or product list). Preferably, physical furnishing element 51 is included in its physical appearance in sensor data set 200. In other words, physical furnishing element 51 can be seen or displayed, in particular, on an image, preferably a 3D image, which corresponds to a depiction of physical environment 30.Step 132 further comprises identifying the registered physical furnishing element 51 with a product entry, for example, in a catalog and / or a product list. This product corresponds to a virtual furnishing element 50, i.e., a model of a physical furnishing element that is or was offered for sale by the provider. Identification can be performed, on the one hand, by recognizing a distinctive or characteristic shape property or shape feature using the computing unit 10. In doing so, one or more structures or shape features of the physical furnishing element 51 are compared with those of the virtual furnishing element(s) 50. Alternatively, identification can be performed by the computing unit recognizing an identity marking 62 applied by the user 13 to the physical furnishing element 51 and assigning or associating it with a virtual furnishing element 50.In particular, such an identity marking 62 for the products offered may be made available for printing by the provider on its website.

[0089] Step 132 also includes assigning the registered physical furnishing element 51 to a corresponding virtual furnishing element 50 and to the parameter data set by which the virtual furnishing element 50 and thus also the physical furnishing element 51 is identified. This assignment essentially corresponds to selecting a virtual furnishing element 50, which is preferably carried out automatically by the computing unit 10. Additionally or alternatively, it is also possible for the user 13 to assign the physical furnishing element 51 to a virtual furnishing element 50, for example manually or using a corresponding suggestion list (e.g. in the form of a pull-down menu), in particular if the computing unit 10 does not identify the physical furnishing element 51 or does so only incorrectly or insufficiently or completely. If the computing unit 10 does not identify the physical furnishing element 51 sufficiently orcompletely identified, the suggestion list can be narrowed down or tailored taking into account the information partially recognized by the computing unit 10.

[0090] Fig. 1b is a flowchart of a chronological sequence of process steps 140-180, which refer to the Fig. 1a illustrated method steps 100-130 follow, for the virtual configuration of a device 500 according to an embodiment. The determination of a virtual arrangement, which is already partially Fig. 1a described, further comprises a step of virtual arrangement 140 or positioning of the at least one virtual furnishing element 50, which was selected or determined in the previous step 130. Step 131, in which a virtual furnishing element 50 is selected, for example, from a pre-selected selection, is followed by a step of manual and / or preferably automated virtual arrangement 141 or positioning of the selected virtual furnishing element 50 with respect to (in particular within) the virtual environment 40. In particular, a user 13 can position and / or move the selected virtual furnishing element 50 within the virtual environment 40 by "drag and drop". It is particularly preferred that the computing unit 10 recognizes or determines a suitable position for positioning the virtual furnishing element 50 and suggests or suggests it to the user 13 accordingly.so that the user 13 can position the virtual furnishing element 50 at the suggested virtual location in the virtual environment 40 or can confirm the positioning. Alternatively or additionally, the computing unit 10 can independently and automatically position the selected virtual furnishing element 50 within the virtual environment 40. In particular, the computing unit 10 can independently and automatically perform a calculation by which an optimal virtual position can be determined. For example, the computing unit 10 can recognize that there is a virtual location in the virtual environment 40 which is free and / or which is, for example, sufficiently close to a connection (e.g., a power outlet) and / or another virtual furnishing element 50.After determining a suitable and / or optimal virtual position, the computing unit 10 can automatically position the virtual furnishing element 50 at the determined location in the virtual environment 40.

[0091] The virtual arrangement 140 or positioning of the at least one virtual furnishing element 50, which was selected or determined in the previous step 130, can additionally or alternatively also comprise a step 142, which follows step 132, in which a virtual furnishing element 50 was selected or determined. Step 142 comprises automatically arranging or positioning the virtual furnishing element 50 at the virtual position in the virtual environment 40 that corresponds to the physical location of the physical environment 30 at which the physical furnishing element 51 is located. This step 142 can, for example, merely consist in assigning or associating a corresponding parameter data set of a corresponding virtual furnishing element 50 to the identified physical furnishing element 51.However, step 142 may also be similar to step 141 and correspond to automatically positioning the assigned virtual device element 50 in the virtual environment 40 at said predetermined virtual location.

[0092] The step of determining 130, 140 a virtual arrangement of virtual device elements 50 of a virtual device 500 can, in particular, comprise the step of selecting at least one virtual device element 50 (in particular a connecting element) and virtually positioning or switching it between two virtual device elements 50. These steps, in particular, comprise the functional virtual connection of two virtual device elements 50 such that a connection can be established, for example, by means of a virtual hose and / or a virtual cable. For this purpose, the computing unit 10 can recognize which connections, in particular flow and / or hose connections and / or electrical and / or data transmission connections, are present on a virtual device element 50 or in the physical and virtual environment 30, 40.Preferably, the computing unit 10 can recognize which connecting elements are particularly suitable with regard to the specifications of the user and / or the virtual furnishing elements 50 and / or the virtual environment 40 and are in particular compatible with possible virtual connections of the virtual furnishing elements 50. The computing unit 10 can also perform a calculation to determine how long a connecting element should optimally be. To this end, the computing unit 10 can include the determined direction of gravity and a corresponding gravitational force to calculate the optimal length L if the sensor data set 200 contains this information. The user 13 can additionally or alternatively determine the length L of a selected virtual connecting element and / or vary it if necessary, as described below with reference to FIG. Fig. 7 and / or Fig. 10-12 is described as an example.

[0093] The step of determining the virtual arrangement 140 is followed by a prediction step 150, in particular a simulation, in such a way that an operating state of virtual components or elements, in particular virtual device elements 50 of the device 500, is estimated in advance and / or predicted and / or simulated. An interaction between virtual components or elements, in particular virtual device elements 50, can also be predicted and / or simulated. An operating state can additionally be identified by means of a marker. For example, a marker can indicate that a physical device element 51 is out of operation. In this case, this physical device element 51 can essentially be neglected with regard to its functions during digitization or translation into a virtual model.

[0094] In this step 150, static and / or dynamic, i.e., time-dependent parameters can be predicted and / or simulated. Compatibility between two virtual components / elements, in particular virtual device elements 50, can preferably be checked or tested. The calculation of such static and / or dynamic parameters can be based on the static and / or dynamic variables or data entries of the sensor data set 200 and / or the parameter data set 300.

[0095] With regard to checking compatibility(ies), it can be checked whether a virtual device element 50 can be connected to a virtual power plug that corresponds to a real physical power plug in the physical environment 30. Of particular interest here is whether the power supply is compatible with the virtual device element 50. In another possible case, it can be checked whether a gas and / or liquid supply and / or discharge is suitable for being connected to the virtual device element 50, for example, whether the requirements and conditions regarding variables such as pressure and / or current are compatible. In yet another case, it can be checked whether two virtual device elements 50 are compatible with each other or can at least be harmonized or adjusted to one another (e.g., by means of suitable interposed components) so that they can be connected to one another.For example, it can be checked whether the operating ranges of two virtual device elements 50 do not overlap or match with each other with regard to a size or parameter, if necessary. This can be the case if a virtual device element 50 can be operated within a certain operating pressure range that does not at least partially overlap or match the operating pressure range of another virtual device element 50, wherein an open connection exists between the two virtual device elements 50. Another example can be that a virtual device element 50 is to be connected to a virtual socket that has an incorrect voltage value and / or an insufficient current value.Checking compatibility may also only concern the compatibility of connections and / or the spatial extent with regard to a possible positioning in the virtual environment 40 of virtual furnishing elements 50. In other words, it may be checked, for example, whether a virtual furnishing element 50 has sufficient space for positioning in the virtual environment 40.

[0096] The step of predicting 150 an operating state may further comprise the step of simulating a dynamic process or dynamic process parameters 400 and / or a material flow between two virtual facility elements 50. Process parameters 400 may be previously determined by a user and / or from a database and transmitted to the computing unit 10. For example, a user 13 may determine that they wish to run a specific biochemical reaction within a virtual facility element 50. To this end, the user 13 may determine or specify the type of process or a specific reaction that is desired, the amount of the desired reactant and / or product, the temperature and / or its temporal progression, and the like as respective process parameters 400 (e.g., to be entered into a table or a data set).Based on the data available to the computing unit 10, in particular, among others, the process parameters 400, the sensor data set 200, and the parameter data set 300, a simulation of a biochemical and / or chemical and / or thermodynamic and / or biological process can be carried out. For this purpose, known relationships, for example dependencies between various parameters, are used for the simulation. Depending on the number of parameters to be included, a simulation can be arbitrarily complex or merely correspond to a very rough approximation. The virtual environment, together with the simulation or prediction, corresponds to an arbitrarily complex model of reality that would occur under the predetermined circumstances characterized by the given parameter entries. In particular, the prediction can take external influences corresponding to one or more entries in a sensor data set 200 into account in the simulation.For example, a real light source 34, as shown in . Fig. 2a shown, and / or a temperature fluctuation has an effect on a process that can be predicted by means of the simulation. This would be the case, for example, if a light source, for example a window through which daylight passes, were to influence the photosynthesis process of a biological medium. A typical temperature fluctuation in the physical environment 30, for example between daytime and nighttime and / or between winter and summertime, which was in particular previously measured or recorded by means of the sensor unit 20, can also have an effect on the process or the reaction. Such influences and their effects, which are of interest to the user 13, can be at least approximately predicted or estimated by the simulation. The aim here is essentially to achieve an optimal configuration of the device or system 500 in advance.For example, upon detecting interfering light sources and / or temperature fluctuations and corresponding unsatisfactory simulated process results, the computing unit 10 can suggest additional products that can suppress these predicted effects. Such products or physical furnishing elements can include, for example, a darkening element, such as a curtain or a screen, which can block out light from interfering light sources and / or a thermostat for actively compensating for external temperature fluctuations. Such products can also already be integrated into a physical furnishing element 51 or can be integrated into it and supplied as special equipment.

[0097] The prediction step 150, in particular the simulation, can be followed by the transmission of a status message to the user 13 and / or to the screen 11, in particular to the user interface, indicating whether the device 500 can be operated essentially error-free and flawlessly, and in particular whether a process achieves a desired result. An error message, on the other hand, would indicate that fundamental problems are predicted or result from the simulation. The result of the simulation can also identify problems in advance and indicate that special equipment and / or alternative physical device elements 51 are required for the flawless operation of the device 500. In particular, a user 13 can try out or test a virtual model of a self-configured device 500 in advance and / or familiarize themselves with the functions.

[0098] Following the transmission of a status message, the user 13 can decide whether they wish to purchase one or more physical furnishing elements 51 that correspond to the corresponding virtual furnishing elements 50 of the configured facility 500. To this end, the method allows the user 13 to submit a request for a quote and possibly a request for goods or order placement to one or more suppliers in a step 160. In another step 170, the user 13 carries out the corresponding actions, namely the request for a quote and the order placement. This step can, for example, include entering personal data of the user 13. In step 180, the request for a quote is processed, after which an offer is created. Furthermore, the order placement is processed in accordance with the offer and in particular the personal data of the user 13 and possibly sent to the distributor or seller.forwarded and processed by the sales unit.

[0099] In particular, the procedure can be carried out in accordance with the Fig.1a and 1bfor individual consultation by a representative or salesperson and / or service personnel. The model of the configured device 500 can also be stored in a data memory. If necessary, in particular for error analysis, a service employee can access the model (e.g., online) and diagnose possible weak points or errors. If the user 13 keeps a logbook, in particular a digital logbook, on the operation of the physical device or system acquired, this logbook data record can be loaded into an application that simulates the operation of the device 500 based on the stored model and can, for example, draw attention to possible wear and tear. Furthermore, an automated message can be sent to the user 13 when maintenance and / or repair and / or inspection of the device 500 is required.In this case, the model is essentially also used as a so-called "digital twin".

[0100] The Fig. 2a illustrates a method step according to an embodiment, which is carried out as part of step 110 in Fig. 1a is executed, and in particular essentially to step 110 in Fig. 1a corresponds. Method step 110 can be carried out by means of an augmented reality system 1000. An exemplary augmented reality system 1000 has a smartphone 12. In this step 110, the user 13 takes a photograph 31 or image of a physical environment 30, in particular a photogrammetry of a physical environment 30, using a detector (e.g., using a camera 21 of a smartphone 12). Alternatively, this step can also be automated and carried out by a computing unit 10. The image 31 of the physical environment 30 can be seen on the display or screen 11 of the smartphone 12. The smartphone 12 comprises a computing unit 10 or is connected to it and a screen or display 11, in particular a touch-sensitive screen (or touch screen), and a sensor unit 20 that includes the camera 21.The execution of the calculation steps, in particular the simple, less complex calculation steps, can be carried out partially by means of the computing unit 10. More complex calculation steps that require high computing power can be carried out at least partially by means of an external computing unit or a cluster to which the smartphone 12 can be connected. The results of these calculation steps are then simply transmitted to the smartphone 12. A corresponding application (or app) can be loaded onto the smartphone 12 and executed in connection with or during the method. The application can be designed, together with a suitable user interface, in particular to guide or lead the user 13 through the configuration of a device and / or to prompt them to make one or more inputs.

[0101] Positioned in the physical environment 30 is a marker indicating a direction of gravity 33, which is also depicted in the figure 31 of the physical environment 30. This marker may simply consist of an arrow indicating the direction of gravity. According to the invention, the direction of gravity is determined by means of a sensor; it can be determined by means of a sensor of the smartphone 12.

[0102] A physical facility element 51 is also positioned in the physical environment 30. The physical facility element 51 is a bioprocessing system that is already registered in a product database and can be recognized and identified by the computing unit 10. If the physical facility element 51 corresponds to a component that is not registered, the spatial structure can be captured and digitized or translated into a three-dimensional virtual model.

[0103] Fig. 2b illustrates a method step according to an embodiment, which is carried out as part of step 120 in Fig. 1a is executed, and in particular essentially to step 120 in Fig. 1a This step may also be included, at least in part, in step 110. In other words, two steps 110 and 120 are described separately, which may nevertheless be performed in one step or at least partially at the same time and / or may be substantially linked to one another.

[0104] In the Fig. 2b A smartphone or tablet 12 is shown, on whose screen or display 11 the image 31 of the physical environment 30 can be seen according to one embodiment. The smartphone or tablet 12 is not necessarily the device with which the sensor data 200 was recorded. It can also be, for example, a computer or personal computer (PC) onto which the sensor data 200 is loaded or transferred. The image 31 of the physical environment 30 is essentially a component of the sensor data set 200.

[0105] It may be preferred that in step 120 the sensor data set 400 is processed together with the image 31 of the physical environment 30 such that a virtual environment 40 is generated. Furthermore, the virtual environment 40 may be generated or created shortly after the sensor data set 200 has been recorded, i.e., in step 110, by means of a computing unit integrated into a digital camera. Alternatively, the image 31 of the physical environment 30 may already substantially correspond to a virtual environment 40. It may also be the case that spatial information, for example the 3D coordinates of an area of the physical environment 30, is indicated or provided by a spatial marker arranged on the area of the physical environment 30. Only by evaluating the position of the spatial marker can this information about the space be digitized.Similarly, an object marker 61 (or several) can be arranged on or in a surface of the physical environment 30. The physical surface in the physical environment can, on the one hand, be translated into a virtual surface in the virtual environment 40. In any case, the virtual furnishing element 50 corresponding to the object marker 61 is positioned and / or aligned and / or displayed at the virtual location defined by the object marker 61 with respect to the virtual environment 40.

[0106] In this regard, it should also be noted that the method according to the invention generally does not necessarily require that a physical environment 30 be displayed on a screen 11. In other words, the method may alternatively not be subject to the "what-you-see-is-what-you-get" principle. In this case, the method may also be quite abstract, for example, via a text editor in which the user can enter and / or edit source code, based on which the method steps can be processed and / or executed.

[0107] The Fig. 2a shown light source 34 can be used in the virtual environment of the Fig. 2b as a functional element, namely as a virtual light source 35, which emits a virtual light, can be recognized or reconstructed.

[0108] In Fig. 2b On the screen or display 11, not only the image 31 of the physical environment 30 is shown, but also a virtual environment 40, which serves as a digital model of the physical environment 30. The drawn grid 32 indicates that the three-dimensional properties of the physical environment 30, i.e. the 3D coordinates, have been digitized.

[0109] Preferably, the spatial structure of a physical furnishing element 51 can be mapped in the virtual environment 40. In particular, the physical furnishing element 51 is a known or registered one. Spatial structures of one or more other unregistered physical furnishing elements 51 or components, such as tables, laboratory benches, power outlets and / or gas supplies or the like, can also be mapped in the virtual environment 40. These are visible in step 120 as 3D-reconstructed objects or images 52 of physical furnishing elements 51 in the virtual environment. In step 120, the image 52 of a registered physical furnishing element 51 is initially unidentified, i.e., the computing unit has not yet recognized which physical furnishing element 51 it is and no assignment to a virtual furnishing element 50 has yet been made.

[0110] In Fig. 3 Method steps 130 to 140, in particular steps 132 to 142, are illustrated in more detail, at least in part, according to one embodiment. In this step, the computing unit 10 recognizes that the image 52 of the physical furnishing element 51 is a known one, in particular a registered one. In this case, the physical furnishing element 51 can be compared with products from a product catalog or product list. A product can, for example, be present digitally in a database as a virtual furnishing element 50. However, the product can at least be assigned to a parameter data set. For example, the parameter data set of the corresponding product can also include 3D coordinates of the spatial structure of the product. These 3D coordinates of the spatial structure of the product can then be compared with the 3D coordinates of the image of the physical furnishing element 51.If there are one or more matches in the structural features between the physical device element 51 and the product, the computing unit can recognize the physical device element 51 based on the image 52 and assign it to a product, in particular a virtual device element 50, but at least to a parameter data set 300. This step corresponds to the automatic identification of a physical device element 51.

[0111] The said step of identification 120 can be carried out with the assistance of a user 13, e.g., if the computing unit 10 could not perform the identification and / or should not automatically search for a registered physical device element 51 to be identified because this would, for example, require too much computing power. This is exemplified in the Fig. 3 indicated. In this case, the user 13 can indicate by means of an indicator 60 (e.g. mouse pointer 60 and / or by touching the touch-sensitive screen) where a possible physical furnishing element 51 to be identified is depicted in the virtual environment 40. On the one hand, the computing unit 10 can be prompted by the indication of the user 13 to start a search itself, which in particular leads to a physical furnishing element 51 being automatically identified. On the other hand, the computing unit 10 can display a selection of possible products, in particular virtual furnishing elements 50, to the user 13, wherein the virtual furnishing elements 50 have similar structural spatial features to those of the physical furnishing element 51. For example, they can be different generations and / or model series and / or series of a product that appears similar or identical on the outside.In this case, the user 13 can determine the appropriate virtual furnishing element 50 from the suggested selection (e.g. as a list with one or more icons or representations and / or as a drop-down menu) by clicking or selecting it and / or using a "select button", as in the . Fig. 3 is indicated, clicks.

[0112] By assigning the physical furnishing element to a virtual furnishing element 50 or following this assignment, an arrangement 140, in particular an automatic arrangement 142, of the virtual furnishing element 50 takes place at the virtual position of the image 52 of the physical furnishing element 51. On the other hand, a virtual furnishing element 50 corresponding to the physical furnishing element 51 can also be superimposed on and / or exchanged with the image 52 of the physical furnishing element 51 in the virtual environment. It is preferably possible to move and / or rotate and / or rearrange or reposition the virtual furnishing element 50 corresponding to the physical furnishing element 51 and / or the image 52 of the physical furnishing element 51 in the virtual environment.

[0113] In Fig. 4 Method step 130, in particular step 131, is illustrated in more detail according to one embodiment. The computing unit 10 offers a list 57 of one or more virtual furnishing elements 50 on the user interface, which is displayed on the screen 11, from which the user 13 can select or determine a virtual furnishing element 50. In particular, the computing unit 10 makes a preselection of virtual furnishing elements 50 with regard to an aspect that can be predetermined by the user 13. For example, a list 57 of virtual furnishing elements 50, which are indicated by "Goods 1," "Goods 2," and "Goods 3," can be displayed, wherein these are compatible with one another and / or assigned to the already identified physical furnishing element 51 or virtual furnishing element 50.

[0114] The user 13 can use the indicator (e.g., mouse pointer) 60 to select a corresponding virtual device element 50 from the list 57 by clicking on the displayed item or an associated "Select button." Alternatively, the computing unit 10 can also select a corresponding virtual device element 50 from the list 57, particularly if it is a virtual device element 50 that is necessary for proper functioning of the device 500. For example, a user 13 can select a virtual pump from a list 57 or a product range or product catalog. The computing unit 10 can thereby be prompted to immediately select a suitable oil for the physical pump corresponding to the virtual pump, so that the physical pump can be immediately filled with oil and put into operation after purchase and delivery.

[0115] In Fig. 5 Method step 140, in particular step 141, is illustrated in more detail according to one embodiment. The user 13 can use the indicator (e.g., mouse pointer) 60 to arrange the selected virtual furnishing element 50 by dragging and dropping it to a location within the virtual environment 40 or relative to the virtual environment 40, in particular taking into account the weight force or the direction of gravity 33. Input via the touchscreen, for example, using a finger, is also conceivable. The user 13 can move and / or rotate and / or rearrange the virtual furnishing elements 50 in the virtual environment 40.

[0116] In particular, the computing unit 10 can calculate and / or suggest and / or implement an optimal arrangement of the virtual furnishing elements 50 with respect to a specific (predetermined or predeterminable) aspect. For example, a power outlet already identified by the computing unit in the virtual environment 40 can be taken into account when arranging a virtual furnishing element 50. Or, in another example, the computing unit 10 can recognize that a location or a virtual position in the virtual environment 40 may be rather unsuitable for a virtual furnishing element 50 and / or a process, in particular if the sensor data set 200 indicates or allows inference of interference signals, for example, interfering light sources 34 and / or interfering temperature fluctuations at this virtual location.

[0117] The computing unit 10 can also detect that a virtual location is already "occupied" by a component, in particular a virtual furnishing element 50, and / or that the virtual environment 40 does not offer sufficient space for arranging a specific virtual furnishing element 50. In this case, the computing unit 10 can suggest another option and / or issue an error message in this regard.

[0118] In Fig. 6 a special method step 130, in particular a step 131 according to an embodiment is shown in more detail, namely that of selecting 131 a virtual device element 50 that corresponds to a virtual connection element 54. On the user interface or the screen 11, a product range, in particular a list 57 of compatible virtual connection elements 54, is displayed. Fig. 6 A virtual hose 55 and a virtual adapter and / or connector 56 are shown. Similar or identical to Fig. 4 The step of selecting 130 or 131 a virtual device element 50 is shown, the user 13 and / or the computing unit 10 can select a virtual connection element 54 from the offered selection 57. In particular, this also involves a preselection of virtual connection elements 54 that are compatible with a previously selected virtual device element 50.

[0119] In Fig. 7 a special method step 140, in particular a special step 141 according to one embodiment is shown in more detail, in which a virtual connection element 54 is arranged in the virtual environment 40. Particularly preferably, the method comprises a step of recognizing or identifying a connection or connector x (reference number 59) of a virtual device element 50 and / or a virtual or physical connection x, for example a power socket or a water supply, which belongs to the infrastructure of the physical environment 30. In particular, the method can comprise a step of automatically virtually connecting virtual connections x by means of the virtual connection elements 54 by the computing unit 10. The method can also preferably comprise a virtual connection of virtual connections x by the user 13. For this purpose, the computing unit 10 can assist orsupport the marking of virtual connections x in the virtual environment 40 so that they are visible to the user 13. The user 13 can virtually arrange the selected connection element 54 at the virtual connections x by clicking or dragging and dropping, thereby virtually connecting the virtual furnishing elements 50. It is also conceivable for the connection x to have an AR marking for its identification. Furthermore, the connection x itself can also serve as a room marker.

[0120] Preferably, in one method step, the computing unit 10 can determine, taking into account the force of gravity or the direction of gravity 33, the distance D between two virtual connections x and the length L a virtual connecting element 50 must have for a virtual connection to be successful. The virtual connecting element 54 is a virtual cable or a virtual hose 55 and "sags" and / or runs at least partially along the virtual floor B. In particular, the user 13 can manipulate or change the length L of the virtual connecting element 54. For example, the user 13 can enter a length L in a field of the user interface and / or change a length L dynamically using a slider. In a preferred method step, the computing unit 10 can also be prompted to optimize a length L of the virtual connecting element 54 with respect to an aspect.

[0121] In general, the step of determining a virtual environment 130, 140 may include steps 131, 141 and / or steps 132, 142. In other words, steps 131, 141 may be independent of steps 132, 142. However, determining a virtual environment 130, 140 preferably includes steps 132, 142, which has the advantage that a new virtual device element 50 is virtually tested and possibly acquired by the user 13.

[0122] In particular, after steps 110 to 140, the virtual environment 40 comprises, in addition to the spatial properties or features, also functional features, provided that the virtual device element 50 is assigned a specific virtual function, for example a concrete processing of a medium.

[0123] In Fig. 8 The method step of predicting 150 (in particular simulating) an operating state according to one embodiment is presented in more detail. In one method step, for example, it can be predicted whether the virtual connection 54, 55 is correct. This can mean checking whether all relevant virtual connections x are compatible with one another, whether the connecting elements 54, 55 have the required features, for example a suitable length L, and whether the correct virtual connections x have been selected. The correct virtual connection can be displayed or communicated to the user 13 by a corresponding status message S. An error message to this effect would indicate the faulty virtual connection.The computing unit 10 can (in particular additionally) also specifically point out at least one problem and provide the user 13 with concrete suggestions for solutions, for example by pointing out a suitable virtual adapter 56 from the product range or a suitable length L of the connecting element 54.

[0124] In particular, in the case where a simulation is to be performed, the user 13 can select a process from possible processes in one step. For example, a material flow can be simulated or calculated based on the connected virtual facility elements 50, which have containers. For this purpose, the user 13 can also select and / or enter and / or change process parameters 400.

[0125] For example, the user 13 can specify the desired volume of the medium and the time required to transfer the medium from one virtual device element 50 to another. The computing unit executes the requested operation, calculation, or simulation using a function. The static or dynamic parameters resulting from the calculation, such as a flow, a pressure, or the like, can be communicated or transmitted to the user 13, for example, in a log file. The simulation can also be visualized and "played" on the screen 11. The user 13 can, in particular, change parameter entries of variable quantities of the parameter 300 and / or sensor 200 and / or process parameter data sets 400.

[0126] The user 13 can, for example, also select a process, for example a biochemical process, provided that this process, together with the required model for calculation or simulation, is stored in at least one database for access. In particular, the user 13 can determine a process parameter 400 in one step. For example, photosynthesis of algae in a medium can be simulated. In the simulation, for example, one or more of the following parameters from various parameter data sets can then be considered and / or calculated: temperature (fluctuation), light incidence, volume of the medium, amount of nutrients, light incidence, duration of the process, pressure and / or stirring speed, and similar variables. Some parameters can be fixed or invariable, whereas other parameters are flexible or variable. In particular, thermodynamically relevant processes are also simulated.

[0127] For example, the user 13 can use a "Run button" to cause the computing unit 10 to predict and / or simulate the desired process or operating state.

[0128] In Fig. 9 The method step of a status report and the quotation request 160, 170 is presented in more detail according to one embodiment. If all operating states are assessed as harmless or correct based on the prediction or simulation, i.e., in particular, if there are no error messages, the user 13 can be allowed to request a quote for the essential virtual or physical furnishing elements 50. For example, a "get a quote" button can be provided, which serves to submit a quotation request to one or more providers with a single click.

[0129] The computing unit 10 can directly process and / or forward the quotation request. In a further step 180, a quotation can be created. The user 13 can then decide whether to order the goods, in particular one or more physical furnishing elements 51 of the configured facility 500, based on the quotation and / or the simulation results.

[0130] Fig. 10 shows a virtual environment 40 according to an embodiment in which a virtual device 500 is arranged and / or positioned. In the virtual environment 40, an image 52 of a physical device element 51 is shown, which is preferably identified by means of the sensor data set 200 and is assigned to a virtual device element 50 (and preferably its parameter data set 300). In other words, based on the sensor data set 200, a physical device element 51 can be recognized or detected or identified and assigned to the virtual environment 40 as a virtual element. Furthermore, a further virtual device element 50 is arranged in the virtual environment 40. The virtual device element 50 is connected to the virtual environment 40 by means of a virtual connection element 54 orby means of a virtual hose 55 virtually connected to the virtual device element 50, which corresponds to the physical device element 51.

[0131] The embodiment of the method for configuring a device 500 by means of an augmented reality of the Fig. 10 includes the display of a toolbar T. The toolbar T allows the user 13 to cause the computing unit 10 to determine a tube length L of the virtual tube 55 ("calculate tube length"). Further elements of a user interface BO are displayed on the toolbar T, for example, a control field for changing and / or determining parameter entries 300 relating to the virtual tube 54 ("edit tube"). Furthermore, the user 13 can virtually route the virtual tube 55 over the virtual floor B using the toolbar element ("set tube to ground") and the dynamic curvature adjustment ("adapt tube curvature"). Furthermore, the created configuration of the virtual device 500 can be reset ("reset configuration") and / or saved ("save configuration").

[0132] Fig. 11 shows a user interface BO according to one embodiment. The user interface BO can be generated by an application and displayed on a screen 11. A virtual device element 50 is displayed in a field for selection. In the example shown, this is a virtual plastic container, in particular a virtual disposable plastic bag, which also has a virtual connecting element 54, namely a virtual tube 55. Furthermore, an identity marking 62 in the form of a QR marking according to a QR coding is displayed. The identity marking 62 can, for example, be printed out by the user 13 and positioned at a location in the physical environment 30, so that the computing unit 10 can display this identity marking 62 in the virtual environment 40 and can virtually arrange the corresponding virtual device element 50 at the corresponding virtual location.

[0133] A parameter field P ("Bag Chamber") is also depicted, on which one or more fields for entering and / or determining parameters, in particular a parameter data set 300, are provided. For example, the user 13 can select a suitable virtual container under a field ("Container of the bag") by clicking. The product or virtual equipment element 50 "Palletank®<" has already been selected, as indicated by the displayed check mark and the filled-in field. Furthermore, a volume of "100 L" was also selected under the "Working Volume" field from the displayed selection between 100 L, 200 L, 500 L, and 1000 L. The selected parameters are part of a parameter data set 300, by which the virtual container 50 shown is determined or characterized. The virtual container 50 corresponds in particular to a product, namely a physical equipment element 51, which is available or sold by the provider.For example, the product may already exist, or the product may only be manufactured after configuration for user 13.

[0134] Furthermore, the user interface BO displays another parameter field P "Flexsafe ®< 3D Bag for Palletank ®<" within which further parameters of a parameter data set 300 of the virtual bag named "Palletank" can be selected and / or determined. Thus, a user 13 can configure a virtual device element 50 with respect to one or more possible parameters prior to its arrangement in a virtual environment 40.

[0135] Fig. 12 shows a user interface BO according to an embodiment, which has already been partially described on the basis of the Fig. 11 The virtual bag or container 50 with connections x, as well as virtual connecting elements 54, namely two virtual hoses 55, each with virtual connections x, is shown.

[0136] Using the parameter field P named "Flexsafe ®< 3D Bag for Palletank ®< ", the user 13 can specify that they can configure a virtual connector 54 named "Aseptic Connector." In the associated parameter field P named "Tube material by application," the user can specify parameters such as the material and length L of the virtual tube. For example, a length of "1500 mm (59")" has already been selected or specified from a range of 300 mm, 500 mm, 800 mm, 1000 mm, 1500 mm, 3000 mm, and 5000 mm.

[0137] Fig. 13 shows a user interface BO according to an embodiment, which has already been partially described on the basis of the Fig. 11 and 12 In particular, the Fig. 13 clearly shows how the representation of the virtual device element 50, in particular the virtual hose 55, is adapted by the parameter determination by the user 13. The user 13 has determined here that the virtual hose 55 should have a length L of "3000 mm (59")" instead of "1500 mm (59")". In the representation of the virtual hose 55 of the Fig. 13 you can see that the virtual tube appears longer than in the representation of the Fig. 12 . This method step of immediately adjusting visually displayed virtual furnishing elements 50 has the advantage that the user 13 can proceed particularly intuitively when configuring a facility.

[0138] In general, a user 13 of the described method can, for example, be a customer or (potential) purchaser who is interested in equipping their laboratory with devices or a facility comprising one or more physical furnishing elements 51 that are offered in an online catalog or on a website of at least one provider. The laboratory can, for example, already include one or more devices or physical furnishing elements 51 that the provider sells or has sold in the past. However, the laboratory can also be unequipped or empty and be virtually equipped with virtual furnishing elements 50.

[0139] A physical component can comprise a real physical component, for example a piece of furniture or a piece of laboratory equipment, in particular a table, a chair, a laboratory bench, a fume hood, a frame, a shelf, a storage unit and / or a physical furnishing element 51, in particular one which is sold by a provider. A real physical component can also be or comprise a connection, in particular a gas and / or liquid discharge and / or supply, a socket or a network access or supply, a light switch, a light, a ventilation system, a window, a door and / or other infrastructure elements of a room. A computing unit 10 can be designed to map and identify a physical furnishing element 51 orand to assign this to a corresponding virtual furnishing element 50, which is essentially equivalent to transforming and / or digitizing a physical furnishing element 51 into a virtual furnishing element 50. In particular, a physical real component can therefore be a registered physical, i.e. real, furnishing element 51. A registered physical furnishing element 51 is a furnishing element that corresponds to or is assigned to an entry in a table and / or a catalog and in particular to a parameter data set 300. The entry preferably represents a physical furnishing element 51 that can be ordered and purchased by a user and / or is and / or was offered for purchase by a provider.A component may also comprise a virtual component, in particular a virtual device element 50, for example a device element which corresponds to an entry in a table and / or a catalog.

[0140] In particular, the method for configuring a device 500 can be particularly intuitive. Furthermore, the operator or user 13 can preferably be guided through process sequences for configuring a device 500 without requiring or having to consult a manual.

[0141] The computing unit 10 may comprise a microcontroller, a microprocessor, and / or an integrated circuit configured to receive data from the at least one sensor unit 20 and transmit data to an output device, in particular a screen 11. The computing unit 10 may be part of a computer system such as a PC, a smartphone 12, and / or a tablet 12. In particular, the computing unit 10 may comprise a computing unit of a device of the user 13 and the computing unit of a remote device, for example, a provider of goods. In other words, the computing power of multiple devices or units can be used to execute a calculation. In this case, the term computing unit 10 may encompass the individual computing subunits.

[0142] All of the aforementioned virtual elements 50 are arbitrarily simplified or arbitrarily complex models for physical real elements 51. The virtual elements 50 are determined by parameters (entries) of a parameter data set 300, which were determined, among other things, based on the corresponding physical furnishing elements 51 and / or subsequently varied. Each virtual furnishing element 50 can thus serve as a digital model or digital twin of the physical furnishing element 51. However, this does not mean, conversely, that the parameters by which a virtual furnishing element 50 is determined also entirely determine the parameters of a physical furnishing element 51. In this respect, the virtual furnishing element 50 can also serve merely as a simplified model.The parameters by which a virtual device element 50 and / or another virtual component is determined are maintained in a data set, for example a parameter 300 and / or a sensor 200 and / or a process parameter data set 400.

[0143] The encoded information content of a QR code according to a QR code does not essentially correspond to the information content of an augmented reality AR code. However, due to its structural design, a QR code can serve as an AR code, namely when only the pattern is analyzed, not the coding.

[0144] In general, a standard AR marker can also be visually similar to a standard QR marker, but typically have fewer black and white squares and are larger. The goal of an AR marker is not to convey a string according to a QR code, whereas a QR marker conveys a string or corresponds to a string. A system based on the AR marker can recognize the position and orientation of the AR marker identified by a camera in 3D or derive it from the AR marker. In other words, an AR marker can contain information, in particular two-dimensional patterns, that allows the position and orientation of the AR marker in space to be derived by analyzing the perspective representation of the AR marker in an image.

[0145] The evaluation of a QR code by decoding a QR code and an AR code are essentially very different. A QR code reads a value from black and white squares according to a code; however, the position and orientation are generally not read in this step. An AR code, on the other hand, is identified from a group of known AR codes, and their position and orientation are simultaneously analyzed in real time. In particular, the movements of an object tagged with an AR code can also be analyzed in this way.

[0146] AR markers are typically somewhat larger than QR codes and can be easily tracked using augmented reality systems. AR markers do not necessarily need to be read or decode. An AR marker can also simply be recognized or identified, and a position and / or orientation can be derived from the AR marker's spatial location. In particular, a movement of the AR marker can be tracked. Based on this, an interactive 3D animation and / or a virtual environment 40 with a virtual furnishing element 50 can be reproduced accordingly and in real time. In particular, an augmented reality system is designed to operate without additional markers. This means that in this case, it is not necessary for a user to attach or provide a marker, which is referred to as "markerless tracking." However, this does not mean that there is no marker at all.Instead, existing features in an image can serve as markers. For example, a company's logo or an image on an object could serve as an AR marker, which would already be present in the physical environment 30 and in the image of the physical environment 31 without any further action by the user. This could make an additional (black-and-white) AR marker by the user unnecessary. Reference symbol

[0147] 10 Processing unit 11 Screen 12 Smart device and / or smartphone and / or tablet 13 User 20 Sensor unit 21 Camera 30 Physical environment 31 Image or illustration of the physical environment 32 Grid and / or digitized 3D coordinates 33 Spatial marking, in particular the direction of gravity or a marking to indicate the direction of gravity 34 Real light source 35 Virtual light source 40 Virtual environment 50 Virtual furnishing element 51 Physical furnishing element 52 Illustration of a physical furnishing element 54 Virtual connecting element 55 Virtual hose 56 Virtual adapter element 57 Suggested and / or presented selection of virtual furnishing elements and / or catalog items and / or product list and / or selection 58 End of a connecting element 60 Mouse pointer 61 Object marking can be an AR marking and / or QR marking 62 Identity marking can be an AR marking and / or QR marking Mark his 100th step of deploying an augmented reality system 110th stepof recording a sensor data set 120 Step of determining a virtual environment 130 Step of determining a virtual arrangement - selecting 131 Providing a product selection and / or a list of virtual furnishing elements and selecting a virtual furnishing element 132 Providing, identifying, and assigning a physical furnishing element 140 Step of determining a virtual arrangement - arranging 141 Automatic and / or manual arranging of a virtual furnishing element 142 Automatic arranging 150 Step of predicting or making a prediction, in particular simulating a function and / or an operating state 160 Allowing a request for a quote and / or a goods order request 170 Creating a quote 180 Creating a quote 200 Sensor data set 300 Parameter data set 400 Process parameter data set 500 Facility 1000 Augmented reality system or system for generating an augmented reality BVirtualFloor in the virtual environment BOUser interface DDistance between virtual connections LLength of a connection element PParameter field SStatus message TToolbar and / or toolbar xVirtual connection

Claims

1. Method for virtually configuring a piece of equipment (500), in particular bioprocessing equipment, the method comprising the following steps: - providing (100) an augmented reality system (1000) comprising: a computer unit (10); at least one sensor unit (20) and a screen (11); - detecting (110) a sensor dataset (200) associated with a physical environment (30) by means of the at least one sensor unit (20); - determining (120) a virtual environment (40) based on the sensor dataset (200) by means of the computer unit (10); - determining (130, 140) a virtual arrangement of at least one virtual equipment element (50) relative to the virtual environment (40) by means of the computer unit (10), wherein the virtual equipment element (50) is assigned a respective parameter dataset (300); - displaying the virtual environment (40) and the at least one virtual equipment element (50) in the form of an augmented reality image of the virtual arrangement on the screen (11); and - generating a prediction (150) of a functionality and / or an operating status of at least one part of the equipment (500) based on the parameter dataset (300) and the sensor dataset (200) by means of the computer unit (10), wherein the at least one sensor unit (20) comprises a camera (21) and at least one gravitational sensor, wherein the step of detecting (110) the sensor dataset (200) associated with the physical environment (30) further comprises a step of recording, by means of the camera (21), an image (31) of the physical environment (30) comprising spatial information (32), wherein the at least one virtual equipment element (50) comprises at least one virtual connection element (54), wherein determining (140) the virtual arrangement comprises determining at least three virtual equipment elements (50), wherein one of the at least three virtual equipment elements (50) corresponds to the virtual connection element (54); wherein the parameter dataset (300) associated with the virtual connection element (54) comprises a length (L) of the virtual connection element (54); wherein two others of the at least three virtual equipment elements (50) each comprise at least one port (59) for connecting a respective end (58) of the virtual connection element (54); and wherein the virtual connection element (54) is a virtual cable or a virtual tube, which extends at least partially along a virtual ground (B) of the virtual environment (40); and the method further comprises the following steps: - determining a virtual distance (D) between the at least two ports (59) in the virtual environment (40) based on the sensor dataset (200), the parameter dataset (300) and the virtual arrangement, by means of the computer unit (10); - detecting a gravitational direction (33) by means of the at least one gravitational sensor, which is arranged in the physical environment (30) or is contained in a detector of a smart device or smartphone or tablet; - determining the virtual length (L) of the connection element (54) based on the distance (D) between the at least two ports (59) in the virtual environment (40); wherein, when the virtual length (L) is being determined, the connection element (54) is arranged in the virtual environment (40) taking into consideration the detected gravitational direction; and wherein a user interface (BO) is displayed on the screen (11), wherein elements of the user interface (BO) are displayed on a toolbar (T), which makes it possible for a user (13) to move the virtual connection element (54) over the virtual ground (B) by means of a toolbar element and by means of a dynamic curvature adaptation and to cause the computer unit (10) to determine the virtual length (L) of the connection element (54).

2. Method according to claim 1, wherein the at least one sensor unit (20) comprises a 3D-capable camera, and the step of detecting (110) the sensor dataset (200) associated with the physical environment (30) further comprises a step of recording a 3D topography of a space.

3. Method according to claim 1 or 2, further comprising a step of providing at least one spatial marking, in particular comprising a first augmented reality marking, in the physical environment (30), wherein the spatial information (32), in particular a 3D topology of the physical environment (30), can be detected or specified by means of the spatial marking.

4. Method according to any one of the preceding claims, comprising the step of providing an object marking (61), in particular comprising a second augmented reality marking and / or a QR marking, in the physical environment (30), wherein a virtual destination and / or a virtual orientation with respect to the virtual environment (30) of the virtual equipment element and / or an identity of the virtual equipment element is identified and / or determined and / or specified by means of the object marking.

5. Method according to any one of the preceding claims, further comprising the following steps: - allowing the selection, by the user (13) and / or the computer unit (10), of at least one virtual equipment element (50), preferably from a selection (57) of a plurality of virtual equipment elements (50); and in particular - providing (132) a registered physical equipment element (51) in the physical environment (30), wherein the selection of the at least one virtual equipment element (50) preferably takes place by means of the computer unit (10), in particular automatically, and wherein the selection of the at least one virtual equipment element (50) is based on a step of identifying the registered physical equipment element (51) using a virtual equipment element (50) in particular from the selection (57) of the plurality of virtual equipment elements (50), wherein preferably the step of identifying the registered physical equipment element (51) comprises a step of recognizing a shape feature of the physical equipment element (51) and / or an identity marking (62), in particular a third AR marking of the registered physical equipment element (51).

6. Method according to any one of the preceding claims, wherein the at least one virtual equipment element (50) comprises at least one of the following: a bioreactor, a disposable bag, a container, a tank, a filter system, a mixing device, a fermentation tank, a centrifuge, a chromatography column, a membrane adsorber, a filling device; and in particular the parameter dataset (300) comprises at least one variable and / or one fixed parameter from the following: an identification coding, an order number, a volume, a length, a spatial extent, a diameter, a structure, a material, an operating range, an operating limit, a compatibility with a further virtual equipment element (50), a compatibility with a biological and / or chemical reaction, a parameter dataset relating to a medium and preferably the biological and / or chemical reaction of the medium.

7. Method according to claim 6, wherein determining (140) the virtual arrangement comprises determining at least two virtual equipment elements (50), and the method further comprises the following steps: - checking the compatibility between the at least two virtual equipment elements (50); - wherein if the check finds that they are compatible: ∘ allowing a virtual connection of the at least two virtual equipment elements (50) by means of the virtual connection element (54) by the user (13) and / or the computer unit (10); - wherein if the check finds that they are not compatible: ∘ outputting an error message reporting the lack of compatibility.

8. Method according to any one of the preceding claims, wherein the screen (11) is a touch screen.

9. Method according to claim 1, wherein determining (140) the virtual arrangement further comprises at least one step of arranging the at least one virtual equipment element (50) by drag-and-drop by means of the user (13) and the screen (11).

10. Method according to any one of the preceding claims, wherein at least one variable parameter of the parameter dataset (300), in particular the length (L) of the virtual equipment element (50), can be determined by the user (13) on the screen (11), in particular by actuation on the touch screen, and / or wherein the sensor dataset (200) associated with the physical environment (30) comprises at least one of the following parameters: a temperature, a time, an electric field strength, a light intensity, a vibration, a noise.

11. Method according to any one of the preceding claims, wherein the step of predicting (150) the operating status of the at least one part of the equipment (500) comprises a step of simulating at least one dynamic parameter of a dynamic process, namely based on the sensor dataset (200), the parameter dataset (300) and the virtual arrangement, wherein the dynamic process comprises at least one of the following: a material flow, a biological process, a chemical process, a physical process, a mechanical process, wherein preferably the step of predicting (150) an operating status comprises a step of reporting a correct operating status or reporting a faulty operating status, in particular based on the step of simulating the dynamic parameter.

12. Method according to any one of the preceding claims, further comprising the following steps: - allowing (160) a quotation request for the at least one virtual equipment element (50) based on the parameter dataset (300); - creating a quotation (180) based on the quotation request; - allowing (160) a goods order request; - processing (180) a goods order based on the goods order request.

13. Method according to any one of the preceding claims, comprising the step of manually marking in the virtual environment (40) with the aid of a screen (11), in particular for marking a virtual spatial point and / or a virtual (50) and / or physical equipment element (51).

14. Computer program product for virtually configuring a piece of equipment (500), in particular bioprocessing equipment, in a computer-aided manner, the computer program product comprising commands which, when the computer program is executed by an augmented reality system (1000), comprising at least a computer unit (10), a sensor unit (20) and a screen (11), cause the augmented reality system to carry out the method according to claim 1.

15. Augmented reality system (1000) for virtually configuring a piece of equipment (500), in particular bioprocessing equipment, wherein the augmented reality system (1000) comprises: - at least one sensor unit (20) configured to detect a sensor dataset (200) associated with a physical environment (30), wherein the sensor unit (20) comprises at least one gravitational sensor; - a screen; and - a computer unit (10) configured to perform the following steps: - determining (120) a virtual environment (40) based on a sensor dataset (200) associated with a physical environment (30); - determining (130, 140) a virtual arrangement of at least one virtual equipment element (50) relative to the virtual environment (40), wherein the virtual equipment element (50) is assigned a respective parameter dataset (300); - displaying the virtual environment (40) and the at least one virtual equipment element (50) in the form of an augmented reality image of the virtual arrangement on the screen (11); and - predicting (150) a functionality and / or an operating status of at least one part of the equipment (500) based on the parameter dataset (300) and the sensor dataset (200); - determining a virtual distance (D) between at least two ports (59) in the virtual environment (40) based on the sensor dataset (200), the parameter dataset (300) and the virtual arrangement; - detecting a gravitational direction by means of the at least one gravitational sensor, which is arranged in the physical environment (30) and / or is contained in a detector of a smart device and / or smartphone and / or tablet; - determining a virtual length (L) of a virtual connection element (54) based on the distance (D) between the at least two ports (59) in the virtual environment (40); wherein the virtual connection element (54) is a virtual cable or a virtual tube, which extends at least partially along a virtual ground (B) of the virtual environment, wherein, when the virtual length (L) is being determined, the connection element (54) is arranged in the virtual environment (40) taking into consideration the detected gravitational direction; and wherein a user interface (BO) is displayed on the screen (11), wherein elements of the user interface (BO) are displayed on a toolbar (T), which makes it possible for a user (13) to move the virtual connection element (54) over the virtual ground (B) by means of a toolbar element and by means of a dynamic curvature adaptation and to cause the computer unit (10) to determine the virtual length (L) of the connection element (54).