Device for providing a reference scale

Abstract

The present invention relates to a device (1) for providing a reference scale, in particular for localizing digital 3D objects in space. The device (1) comprises a support element (2) having at least three reference points (P). The at least three reference points (P) are positioned on the support element (2) in such a way that they define an at least two-dimensional system of coordinates.

Description

[0001] Description

[0002] Device for providing a reference scale

[0003] The present invention relates to a device for providing a reference scale, in particular for locating digital 3D objects in space.

[0004] For years now, the increasing prevalence of digital technologies in society has been evident. It is expected that this digitalization of society will increase significantly in everyday life. Virtual, augmented, and mixed reality technologies and applications represent a particular manifestation of digitalization. In virtual reality (VR), the user is immersed in a fully virtual, computer-generated world. Head-mounted display devices (HMDs) are typically used for this purpose.

[0005] Augmented Reality (AR) is the enhancement of the perception of the real world with virtual elements that are registered with precise location in three-dimensional space and allow real-time interaction. Data glasses, for example, can be used to display AR displays. Data glasses are worn like normal glasses, but have one or more projection units or displays that can be used to project information in front of the wearer's eyes or directly onto the retina. The data glasses are designed so that the wearer can also perceive their surroundings. New technologies for data glasses, such as light field technology, advances in battery technology, and the entry of major companies into this field suggest that these devices will become increasingly accepted.Another option for displaying AR content is the use of tablets or smartphones. In this case, the user views the real environment on the device's screen, which is continuously filmed by the device's camera. The image of the real environment is enriched with additional virtual content that is inserted into the image at the correct location. There is also what is known as spatial AR (SAR), also known as projection-based AR (PbAR). In this case, a projector projects image information into the real environment in such a way that it allows the positionally accurate perception of virtual 3D geometries from the perspective of (usually) individual users.

[0006] AR applications project digital objects into physical space. A key question is how 3D objects can be correctly located in physical space. With so-called QR code tracking, the AR application recognizes a QR code in physical space. The 3D objects are then projected directly relative to this QR code. Although the spatial position is defined, the scaling and orientation in space are relatively imprecise.

[0007] By using multiple QR codes or trackers in a room, objects can be represented more precisely. The trackers can be freely distributed throughout the room. The scale, orientation, and position of the objects are directly related to the trackers.

[0008] In this context, WO 2022 / 207687 A2 describes a method for configuring a headset to display a building information model on a construction site. The method uses trackers positioned at known positions relative to a coordinate system of a building information model.

[0009] However, this approach is relatively complex, as the position of the trackers in the room must exactly match the position of the trackers in the 3D software used. Therefore, the positions of the trackers relative to each other must be precisely measured. The room and the positions are then precisely recreated in the 3D software. Even small deviations can lead to inaccuracies in the representation, making this approach quite error-prone. Furthermore, the measurement and recreated in the 3D software must be performed separately for each room.

[0010] It is an object of the present invention to provide improved solutions for providing a reference scale.

[0011] This object is achieved by a device for providing a reference scale having the features of claim 1. Preferred embodiments of the invention are the subject of the dependent claims.

[0012] According to a first aspect of the invention, a device for providing a reference scale comprises a carrier element with at least three reference points, wherein the at least three reference points are arranged on the carrier element in such a way that they span an at least two-dimensional coordinate system.

[0013] In the solution according to the invention, a coordinate reference system in space is defined by a support element with at least three reference points. The reference points have a defined and known or easily determinable position and orientation relative to one another. This is used by the 3D software to correctly locate objects in physical space. The reference points can be located, for example, on a plate or another surface, such as a flexible mat. The support element is laid out in the desired space. If made of a flexible material, the support element can be rolled onto a table like a blanket, which allows for very simple application. Objects such as tables can thus be defined as a uniform projection surface. Flexible support elements are also very easy to transport and store, as they can be rolled up or folded, for example, and require very little storage space.

[0014] The inventive solution easily enables multiple people to experience the same objects with identical placement in space. This is made possible by the fact that all users refer to the same coordinate reference system. It is also possible for multiple people at different locations to experience the same digital scene. This requires a coordinate reference system for each location. The 3D data is then preferably made available via a server. For example, in the field of architecture, a complex building can be shown to scale to multiple people, e.g., as a partial model at one location or together in a 1:1 model on-site, or location-independently, e.g., as part of an online meeting.

[0015] According to one aspect of the invention, the carrier element is modular and comprises at least three marking elements, each providing a reference point, wherein the marking elements can be connected to one another in a grid-like arrangement by means of connectors. In this embodiment, the carrier element is designed like a puzzle, which allows for rapid assembly and disassembly of the carrier element. The modular design allows the reference points to be set precisely and easily in digital space. The modular design specifies precise joining variants of the marking elements, which enables exact positioning, orientation, scaling, and overlaying of digital objects in physical space. The marking elements are preferably made of plastic. They can be manufactured from a plate, for example, by injection molding, 3D printing, or milling.

[0016] According to one aspect of the invention, the marking elements have a base defined by a polygon. The use of bases defined by a polygon has the advantage that the relative position and orientation of the marking elements, and thus of the reference points, can be determined very easily. A square base is preferably used, but other shapes, such as triangles, rectangles, hexagons, etc., also work. The polygons are preferably regular polygons.

[0017] According to one aspect of the invention, the modularly designed support element further comprises at least one spacer element, which can be connected to the marking elements in the grid-like arrangement by means of connectors. The spacer elements serve as spacers between the marking elements. This enables the representation of large 3D scenes; i.e., the modular expandability with the spacer elements allows objects to be precisely located even in large rooms or outside of rooms. The spacer elements are preferably made of plastic. Like the marking elements, they can be manufactured from a sheet by injection molding, 3D printing, or milling.

[0018] According to one aspect of the invention, the base area of ​​the at least one spacer element corresponds to the base area of ​​a marking element or to the combination of several marking elements or to a fraction of the base area of ​​a marking element. Different sizes can be realized here, e.g. spacer elements with one, two, three or generally n times the base area of ​​the marking element, where n is a natural number, or spacer elements in which the base area corresponds to one half, one third, one quarter, or generally one m / n-th of the base area of ​​the marking element, where m and n are natural numbers. This has the advantage that even with a carrier element composed of many elements, the relative position and orientation of the marking elements and thus of the reference points can be determined very easily.

[0019] According to one aspect of the invention, the modularly designed support element further comprises at least one angle element that can be connected to the marking elements or a spacer element by means of connectors. Such an angle element can, for example, establish a vertical connection, which enables the provision of a three-dimensional coordinate system.

[0020] According to one aspect of the invention, the connectors are molded onto the component or designed as separate connectors. If molded connectors are used, the elements can be assembled extremely precisely, like a puzzle. No additional joining mechanisms are required, which speeds up assembly and disassembly. The use of separate connectors, on the other hand, reduces the dimensions of the marking and spacer elements and thus the space required for storage.

[0021] According to one aspect of the invention, the reference points are provided by a visually detectable marking or a transmitter module. Visually detectable markings can be passive or active and can be easily captured by a camera. They do not necessarily have to be visible to the human eye; for example, markings that are detectable in the infrared or ultraviolet wavelength range are also possible. Passive markings, such as patterns, have the advantage that no power supply is required, but active systems can also be used, which can use, for example, light-emitting diodes. Such markings are easily detectable even in unfavorable environmental conditions, e.g., in poor lighting conditions. However, systems that do not function visually but, for example, via radio are also possible. Here, the markings serve as transmitters, while the terminal device, e.g.,a data glasses, works as a receiver.

[0022] According to one aspect of the invention, the visually detectable marking or the transmitting module provides supplementary information about the device. For example, information about the design of the device or the dimensions of the markings can be provided directly. Alternatively, a link to a location where corresponding information or other data can be retrieved can be provided.

[0023] According to one aspect of the invention, the visually detectable marking is designed as a QR code. The use of QR codes is advantageous in that known algorithms for recognizing QR codes can be used. The markings can thus be detected very easily.

[0024] According to one aspect of the invention, the carrier element further comprises a module for determining the position of at least one of the reference points. This makes it possible not only to determine the relative position and orientation of the reference points, but also to determine absolute position information. For example, a GPS module (GPS: Global Positioning System) can be integrated into the carrier element.

[0025] Further features of the present invention will become apparent from the following description and the appended claims, taken in conjunction with the figures. Figure 1 illustrates the basic principle of augmented reality;

[0026] Fig. 2 illustrates a well-known approach for locating digital objects in physical space;

[0027] Fig. 3 shows a first embodiment of a device according to the invention for providing a reference scale;

[0028] Fig. 4 shows a second embodiment of a device according to the invention for providing a reference scale;

[0029] Fig. 5 shows a plate-shaped support element with several reference points;

[0030] Fig. 6 shows a first embodiment of a modular support element;

[0031] Fig. 7 shows a second embodiment of a modular support element;

[0032] Fig. 8 shows a third embodiment of a modular support element;

[0033] Fig. 9 shows a support element composed of a plurality of elements;

[0034] Fig. 10 shows various spacer elements;

[0035] Fig. 11 shows a support element with an angle element; and

[0036] Fig. 12 illustrates the use of a device according to the invention for providing a reference scale in a large room.

[0037] For a better understanding of the principles of the present invention, embodiments of the invention are explained in more detail below with reference to the figures. The same reference numerals are used in the figures for the same or similarly functioning elements and are not necessarily described again for each figure. It is understood that the invention is not limited to the embodiments shown and that the described features can also be combined or modified without departing from the scope of the invention as defined in the appended claims. Fig. 1 illustrates the basic principle of augmented reality. Augmented reality involves enriching the perception of the real world with virtual elements that are registered with the correct location in three-dimensional space and allow real-time interaction. In the example shown, a person U wears data glasses B.Of course, other AR devices can also be used, such as tablets or smartphones. The data glasses B are worn like normal glasses, but have one or more projection units or displays that can be used to project information in front of the wearer's eyes or directly onto the retina. Using the data glasses B, an AR application projects digital objects O into physical space R. A key question is how these objects O can be correctly located in physical space R.

[0038] Fig. 2 illustrates a known approach for locating digital objects O in physical space R. In the example shown, three so-called trackers T are arranged in space R, each having a QR code. These can be captured by a camera assigned to the data glasses B. The trackers T can be freely distributed in space R. The scaling, orientation and position of the digital objects O are directly related to the trackers. For correct location of the objects O, the position of the trackers T in space R must exactly match the position of the trackers in the 3D software used. Therefore, the positions of the trackers T relative to each other must be precisely measured. The space R and the positions of the trackers T are then exactly recreated in the 3D software and used to project the digital objects O into the physical space R.

[0039] Fig. 3 shows a first embodiment of a device 1 according to the invention for providing a reference scale. The device 1 comprises a support element 2 with three reference points P. The reference points P are arranged on the support element 2 such that, in the example shown, they span a two-dimensional coordinate system. Of course, more than three reference points P can also be present. In the embodiment of Fig. 3, the support element 2 is a plate that is laid out in the desired space, here, for example, on a table S. The table S can thus be defined as a uniform projection surface for several people U. Since the relative position of the reference points P on the support element 2 is known, the positions of the reference points relative to one another do not have to be measured first. As an alternative to a rigid plate, the support element 2 can also be designed as a flexible element, e.g.as a flexible mat. In this case, the support element 2 can be rolled onto the table S like a blanket, allowing for a very simple application.

[0040] Fig. 4 shows a second embodiment of a device 1 according to the invention for providing a reference scale. The device 1 again comprises a support element 2 with at least three reference points P. However, the support element 2 is modular and comprises three marking elements 3. The marking elements 3 each provide a reference point P. Of course, more than three marking elements 3 can also be used. The marking elements 3 are connected to one another by means of connectors 4 in a grid-like arrangement such that reference points P span a two-dimensional coordinate system. In addition to the marking elements 3, the support element 2 comprises a plurality of spacer elements 5, each of which is arranged between the marking elements 3. The modular design allows for rapid assembly and disassembly of the support element 2.In addition, precise joining variants of the marking elements 3 are specified, whereby the reference points P can be set precisely and easily in the digital space and an exact positioning, orientation, scaling and overlay of digital objects O in the physical space R is enabled.

[0041] Fig. 5 shows a plate-shaped support element 2 with a plurality of reference points P. The reference points P are each defined by a visually detectable marking 30, here in the form of a QR code. In the example shown, the top left corner of a QR code defines the corresponding reference point. Of course, the reference points P can also be defined differently, e.g. by the centers of the QR codes. The visually detectable markings 30 have a known, defined position relative to one another. In Fig. 5, the reference points P have the positions P1 (0,0,0), P2 (3,0,0) and P3 (0,-2,0), which together span a coordinate system. The positions P1 (0,0,0) and P2 (3,0,0) define the X-axis, and the positions P1 (0,0,0) and P3 (0,-2,0) define the Y-axis. P1 (0,0,0) represents the coordinate origin. The two axes are perpendicular to each other. The Z axis is perpendicular to both the X and Y axes.In the example shown, the plate-shaped support element 2 is flexible and can be folded or rolled up.

[0042] Fig. 6 shows a first embodiment of a modular support element 2. Shown are a marking element 3, which provides a reference point P, and a spacer element 5. The marking element 3 and the spacer element 5 each have a substantially square base. In this example, the reference point P is formed by a visually detectable marking 30, which is arranged on the marking element 3, here in the form of a QR code. Connectors 4 are provided to connect the various elements 3, 5. In this embodiment, these connectors are molded onto the elements 3, 5, so that the elements 3, 5 can be assembled extremely precisely like a puzzle. No additional joining mechanisms are required, which speeds up assembly and disassembly.

[0043] Fig. 7 shows a second embodiment of a modular support element 2. It again shows a marking element 3, which provides a reference point P, and a spacer element 5, both of which have a substantially square base. The embodiment of Fig. 7 largely corresponds to the embodiment of Fig. 6, except that the connectors 4 in this case are designed as separate connectors 4. This reduces the dimensions of the marking element 3 and the spacer element 5 and thus the space required for storage.

[0044] Fig. 8 shows a third embodiment of a modular support element 2. Again shown are a marking element 3, which provides a reference point P, and a spacer element 5, both of which have a substantially square base area. The embodiment of Fig. 8 largely corresponds to the embodiment of Fig. 7, but in this embodiment the reference point P is not formed by a visually detectable marking arranged on the marking element 3. Instead, the marking element 3 has a transmission module 31, e.g. a Bluetooth module, which in this example is embedded in the marking element 3. A power supply 32, which is also embedded in the marking element 3, serves to operate the transmission module 31.

[0045] Fig. 9 shows a support element 2 composed of a plurality of elements. The support element 2 comprises three marking elements 3, each with a reference point P in the form of a visually detectable marking 30, and three spacer elements 5. The spacer elements 5 ensure a fixed grid spacing between the marking elements 3. The assembled elements 3, 5 with the positions P1 (0,0,0), P2 (3,0,0) and P3 (0,-2,0) span a coordinate system. The positions P1 (0,0,0) and P2 (3,0,0) define the X-axis, and the positions P1 (0,0,0) and P3 (0,-2,0) define the Y-axis. P1 (0,0,0) represents the coordinate origin. Due to the shape of the elements 3, 5, the two axes are perpendicular to each other. The Z-axis is perpendicular to both the X-axis and the Y-axis. Fig. 10 shows various spacer elements 5. In the previous embodiments, the spacer elements 5 had the same base area as the marking elements.However, this is not necessarily the case. As long as the shape and size of the spacer elements 5 are known, other dimensions can also be used. Preferably, the base area of ​​a spacer element 5 corresponds to the combination of several marking elements. Different sizes can be realized here, e.g., spacer elements 5 with twice, three times, or generally n times the base area of ​​the marking element, where n is a natural number. For example, Fig. 10a) shows a spacer element 5 with twice the base area of ​​the marking element. Fig. 10b) shows a spacer element 5 with three times the base area of ​​the marking element. Alternatively, the base area of ​​a spacer element 5 can also correspond to a fraction of the base area of ​​a marking element. Different sizes can be realized here, e.g.Spacer elements 5 whose base area corresponds to one-half, one-third, one-quarter, or generally one-m / nth of the base area of ​​the marking element, where m and n are natural numbers. For example, Fig. 10c) shows a spacer element 5 with half the base area of ​​the marking element. Fig. 10d) shows a spacer element 5 with three-quarters of the base area of ​​the marking element.

[0046] Fig. 11 shows a support element 2 with an angle element 6. The angle element 6 can be connected to the marking elements 3 or the spacer elements 5 by means of connectors 4. Such an angle element 6 can establish a vertical connection, which enables the provision of a three-dimensional coordinate system. For improved stability, the angle element 6, as shown in Fig. 11, can be thicker than the other elements 3, 5. Alternatively or additionally, it can be made of a different material, e.g., metal, while the marking elements 3 and the spacer elements 5 are preferably made of a plastic.

[0047] Fig. 12 illustrates the use of a device 1 according to the invention for providing a reference scale in a large room R. Due to the modular expandability with the spacer elements 5, objects O can also be precisely located in large rooms R, e.g., exhibition rooms, or outside of rooms. An example of such a large room R, in which numerous people U are present, is shown in Fig. 12. The support element 2 has a plurality of marking elements 3 and spacer elements 5, so that a sufficient number of reference points P can be detected regardless of the respective location of the people U. In particular, the support element 2 also extends vertically in the example shown. List of reference symbols

[0048] 1 device

[0049] 2 support element

[0050] 20 Positioning Module

[0051] 3 Marking element

[0052] 30 Marking

[0053] 31 Transmitter module

[0054] 32 Energy supply

[0055] 4 connectors

[0056] 5 spacer element

[0057] 6 Angle element

[0058] B Data glasses

[0059] O Object

[0060] P Reference point

[0061] R Room

[0062] S table

[0063] TT racker

[0064] U Person

Claims

Patent claims 1. Device (1) for providing a reference scale, comprising a carrier element (2) with at least three reference points (P), wherein the at least three reference points (P) are arranged on the carrier element (2) in such a way that they span an at least two-dimensional coordinate system.

2. Device (1) according to claim 1, wherein the carrier element (2) is of modular design and comprises at least three marking elements (3), each providing a reference point (P), wherein the marking elements (3) can be connected to one another in a grid-like arrangement by means of connectors (4).

3. Device (1) according to claim 2, wherein the marking elements (3) have a base area defined by a polygon.

4. Device (1) according to claim 2 or 3, wherein the modularly designed carrier element (2) further comprises at least one spacer element (5) which can be connected to the marking elements (3) in the grid-shaped arrangement by means of connectors (4).

5. Device (1) according to claim 4, wherein the base area of ​​the at least one spacer element (5) corresponds to the base area of ​​a marking element (3) or the combination of several marking elements (3) or a fraction of the base area of ​​a marking element (3).

6. Device (1) according to one of claims 2 to 5, wherein the modularly designed support element (2) further comprises at least one angle element (6) which can be connected to the marking elements (3) or a spacer element (5) by means of connectors (4).

7. Device (1) according to one of claims 2 to 6, wherein the connectors (4) are molded on or designed as separate connectors.

8. Device (1) according to one of the preceding claims, wherein the reference points (P) are provided by a visually detectable marker (30) or a transmitter module (31).

9. Device (1) according to claim 8, wherein the visually detectable marking (30) or the transmitting module (31) provides supplementary information about the device (1).

10. Device (1) according to claim 8 or 9, wherein the visually detectable marking (30) is designed as a QR code.

11. Device (1) according to one of the preceding claims, wherein the carrier element (2) further comprises a module (20) for determining a position of at least one of the reference points (P).

Images