Method for positioning an augmented reality (AR) object in a virtual space superimposed on a real space relative to an object, as well as augmented reality (AR) display device and augmented reality (AR) system

By creating AR objects as interactive apps for AR display devices, the limitations of existing AR technologies are overcome, providing versatile and secure user interaction and enhanced functionality in real-world environments.

DE102020104669B4Active Publication Date: 2025-12-24HUBSCHNEIDER INVESTMENT GMBH
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
DE102020104669
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-02-21
Publication Date
2025-12-24
Estimated Expiration
2040-02-21

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Method for positioning an augmented reality (AR) object (10) in a virtual space superimposed on a real space relative to an object (12, 12'), comprising at least procedural steps (46-70) in which: - the object (12, 12') is selected using an AR display device (14), - the AR object (10) is selected and / or created using the AR display device (14), - the AR object (10) is positioned relative to the object (12, 12') using the AR display device (14), wherein the AR object (10) is receivable by a receiver (32) which detects the object (12, 12') with another AR display device (16), characterized by the fact that the AR object (10) is designed as an AR app executable in the virtual space, wherein the AR object (10) is displayed exclusively to recipients (32) who have been previously selected by a sender or editor (30) of the AR object (10) and who are exclusively biometrically identified persons, wherein the biometric identification of the recipient (32) is used for carrying out and / or authorizing a payment transaction of the AR app.
Need to check novelty before this filing date? Find Prior Art

Description

State of the art

[0001] The invention relates to a method according to the preamble of claim 1, an augmented reality (AR) display device according to claim 13 and an augmented reality (AR) system according to claim 14.

[0002] In documents US 2018 / 0253900 A1 and US 2016 / 0247324 A1, methods for positioning an augmented reality (AR) object in a virtual space superimposed on a real space relative to an object have already been proposed, comprising at least process steps in which the object is selected using an AR display device, the AR object is selected and / or created using the AR display device, and the AR object is positioned relative to the object using the AR display device, wherein the AR object is receivable for a receiver that captures the object with another AR display device.

[0003] The object of the invention is, in particular, to provide a method with advantageous properties with regard to versatile usability and / or user-friendliness. This object is achieved according to the invention by the features of claims 1, 13 and 14, while advantageous embodiments and further developments of the invention can be found in the dependent claims. Advantages of the invention

[0004] The invention relates to a method for positioning an augmented reality (AR) object in a virtual space superimposed on a real space relative to an object, comprising at least method steps in which the object is selected by means of an AR display device, the AR object is selected and / or created by means of the AR display device, and the AR object is positioned relative to the object by means of the AR display device, wherein the AR object is receivable for a receiver which detects the object with another AR display device.

[0005] It is proposed that the AR object be designed as an application (app). This allows for particularly versatile usability. A high degree of user interaction can be advantageously enabled, especially compared to static, unchanging, and / or unoperable AR objects. The information density of the AR objects can be significantly increased. A particularly high level of user-friendliness can be achieved, for example, by enabling AR objects to guide and / or accompany the operation of a device or similar in real space, or to provide targeted, user-controlled guidance and / or support for actions in real space. A significantly improved and / or expanded AR environment can be created, particularly with regard to the available possibilities.

[0006] An "AR object" is understood to be, in particular, a virtual object that is provided with at least one reference point in the real world, for example, a fixed location coordinate or a relative coordinate dependent on another, especially virtual and / or real, object. The fixed location coordinate is understood here to be, in particular, a geographic coordinate, such as a GPS coordinate. The relative coordinate is understood here to be, in particular, a coordinate linked to a position of the virtual and / or real object, which moves with the virtual and / or real object. Specifically, when viewed by a user with a suitable device, the AR object is superimposed on real space, preferably projected into real space.In this context, "real space" refers specifically to a physical, existing space that can be perceived solely through the user's senses, i.e., without an AR display device. "Virtual space" refers specifically to an artificial space generated by computer graphics. Specifically, AR objects are displayed at a fixed or relative position in real space when viewed with a suitable AR display device. In this context, "object" refers specifically to a virtual object, such as another AR object, and / or preferably to a real, existing object, particularly a physical one.An "AR display device" is understood to mean, in particular, a display device that enables a visual representation of the AR object within real space, for example, by means of a screen, projection, hologram, or the like. Typically, the AR display device has at least a recording device for capturing real space, such as a camera, as well as one of the aforementioned display devices. In particular, the AR display device includes software (an app), preferably pre-installed, which is designed to detect and / or display AR objects, especially when a viewing window of the AR display device and / or a field of view of the recording device of the AR display device is directed at the AR object and / or the AR object is located within the viewing window and / or the field of view.In particular, it is conceivable that the recording device is integrated with the AR display device. Alternatively, however, it is also conceivable that the recording device is separate from the AR display device and transmits the recorded data to the AR display device, especially for display by means of the AR display device's display mechanism. For example, the AR display device could be a smartphone, a tablet, a laptop, a notebook, VR glasses, or another type of personal computer. "Intended" is understood to mean, in particular, specifically programmed, designed, and / or equipped. The fact that an object is intended for a specific function is understood to mean, in particular, that the object fulfills and / or performs this specific function in at least one application and / or operating state.

[0007] In particular, selecting an object using the AR display device and / or positioning the AR object relative to the real-world object can be achieved by entering data into the AR display device. For example, location data, such as coordinates, can be entered directly into the AR display device, and / or the object can be selected using gestures, such as tapping the object / desired position or pointing at the object / desired position in real space and / or virtual space, i.e., on the screen. Alternatively or additionally, it is conceivable that the object / desired position can be determined or selected by a description using speech recognition. Specifically, selecting an AR object using the AR display device can be achieved by entering data into the AR display device, for example, by selecting from a menu of predefined AR objects.Alternatively, it is conceivable that the AR object is configurable or createable by the user. In particular, the AR object is designed as a virtual application software (app) displayed and operable within a virtual space superimposed on real space. Specifically, the user interface and / or the interaction area of ​​the app, especially of the AR object designed as an app, is displayed in the virtual space superimposed on real space. For example, the AR object has at least one virtual interaction surface, such as a button or input area, which is displayed in the virtual space superimposed on real space.

[0008] According to the invention, the app is designed as an AR app executable in virtual space. This advantageously allows for particularly versatile usability. A high degree of user interaction is advantageously enabled, especially compared to static, unchanging, and / or non-operable AR objects. To illustrate this, an example situation is described below, in which it is assumed that a user regularly needs to take a specific medication. To support the documentation of medication intake, this user or their doctor links a pillbox or medication packaging to an AR app. Alternatively, it is conceivable that a manufacturer has already linked the medication packaging to an AR app, and the AR display device identifies the medication packaging via image recognition.When the user views a pillbox or medication packaging using an AR display device, the AR app is shown. This app could, for example, be a documentation app for recording medication intake. The documentation app might display a confirmation area that the user confirms after taking the medication. Information about the time, dose, user, etc., is then recorded and transmitted to a cloud service, the doctor, etc. The user could also record other aspects of medication intake in the documentation app (e.g., well-being, side effects, etc.). In particular, the AR app can display moving images (videos, animations), static images / text, and / or links / references to information or other AR objects.

[0009] If the AR app has at least one virtual button that can be activated by the recipient via the AR display device, a particularly high degree of versatility and / or user-friendliness can be advantageously achieved. A "virtual button" is understood to be, in particular, an element, preferably a control element, of the AR app's graphical user interface, which is superimposed on the real space, especially a part of the real space, in the display of the AR display device. Preferably, activation of the button triggers an associated function of the AR app. In particular, the virtual button serves to address and / or trigger individual control commands of the AR app.

[0010] Furthermore, if the AR app features at least one virtual input form that the recipient can fill out via the AR display device, significantly improved versatility and / or user-friendliness can be achieved. In particular, the AR app, preferably the virtual button and / or the virtual input form, can be operated via existing input devices of the AR display device, such as a touchscreen, buttons, or voice recognition. Alternatively or additionally, the AR app can be operated directly via gestures in the real space (e.g., by tapping the medication packaging in the example above), which are registered by the AR display device.A "virtual input mask" is understood to be, in particular, an element, preferably an input element or a database element, of a graphical user interface of the AR app, which is superimposed on the real space, especially a part of the real space, in the display of the AR device. Preferably, an entry in the input mask creates a database entry by the AR app.

[0011] Furthermore, it is proposed that at least one activation of the virtual button or at least one entry into the virtual input mask be transmitted to a central database and preferably stored there. This would create particularly advantageous interaction possibilities, especially by allowing data from the AR app to be shared with or transmitted to other individuals / companies, etc. The database is designed specifically as a cloud or an internet server. The AR display device is specifically designed to transmit data, particularly data from the AR app, via the internet or a mobile network.

[0012] Furthermore, it is proposed that the sender or editor of the AR object be biometrically identified, particularly via the AR display device. This can advantageously achieve a high level of data security. It also allows for the processing of confidential information from the AR object, especially from the AR app. Moreover, the biometric identification of the sender / editor can advantageously and unequivocally establish the identity of the creator of an AR object or AR app. This can advantageously prevent misuse or illegal / undesirable activities. In particular, an AR object can be clearly attributed to its creator. It is conceivable that the creator could establish terms of use or usage fees for an AR object, especially an AR app. Specifically, the AR display device can be designed to create and / or place the AR object.In particular, the AR display device is designed to perform biometric identification of a user, especially the sender / editor. Specifically, the user and / or the sender or editor can be identified by recognizing at least one biometric feature, such as fingerprint recognition, facial recognition, hand recognition, iris recognition, voice recognition, or at least one other biometric feature. The AR display device includes a security device for determining, evaluating, and / or recognizing the biometric feature. For example, the security device can be a fingerprint scanner, a camera, a microphone, or the like. Preferably, the security device is integrated into the AR display device.Alternatively, it is also conceivable that the security device is designed separately from the AR display device and is specifically intended to exchange data with the AR display device.

[0013] Alternatively or additionally, it is proposed that a user and / or viewer of the AR object be biometrically identified, particularly via the AR display device. This can advantageously achieve a high level of data security. Furthermore, confidential information from the AR object, especially from the AR app, can be processed in this way. For example, in the aforementioned case, this can ensure that the person confirming medication intake is indeed the person for whom the medication is intended. In addition, the respective sender or editor of an AR object can obtain information about who views and / or uses their AR objects.

[0014] According to the invention, the AR object is displayed exclusively to recipients who have been previously selected by a sender or editor of the AR object. This advantageously allows for a high level of data security. Confidential information can be stored and / or displayed within AR objects. Access and / or the group of recipients can be limited. Individualized AR objects can be stored for each recipient.

[0015] According to the invention, the selected recipients are exclusively biometrically identified persons. This advantageously enhances data security, particularly for confidential information. Specifically, the AR display device determines a unique identification of a recipient, for example, using a security feature. The AR display device then only shows AR objects to a specific recipient within the user group restricted by the sender or editor if the unique identification of the recipient was successful and if the object was intended for that uniquely identified recipient.For example, it is conceivable that the biometric identification of a user of the AR display device, in particular a sender / editor using the AR display device and / or a receiver using the AR display device, is automatically verified each time the AR display device is started and / or each time the software providing the AR functionality of the AR display device is started. Furthermore, it is conceivable that the biometric identification is regularly and automatically verified during operation of the AR display device, in particular during operation of the software providing the AR functionality of the AR display device, for example, by means of regular facial recognition, preferably unnoticed by the user. Alternatively or additionally, it is conceivable that the AR display device performs a new biometric identification of the user of the AR display device before each access, display, and / or operation of an AR app.

[0016] According to the invention, the biometric identification of the recipient is used for the execution and / or authorization of a payment transaction by the application software, in particular the AR app. This advantageously allows for a particularly high level of user-friendliness. It also advantageously enables the creation of a straightforward payment system.

[0017] Additionally, it is proposed that a defined access period be assigned to the AR object via the AR display device. This can advantageously achieve a particularly high level of user-friendliness, for example, by ensuring that AR objects are highly up-to-date and / or by creating a particularly clear overview of the available AR objects. This can also advantageously prevent the waste of computing power and / or computing capacity, which can lead to energy savings. The access period can be a single period (e.g., a few hours, days, weeks, etc.) and / or a recurring period (e.g., daily from 12 pm to 2 pm, every Sunday, or whenever a specific condition is met, such as...).(every time the sun shines, every time there is no train at the platform, every time the traffic light is red, every time the medication has not yet been taken within the target period, etc.).

[0018] If the AR object, especially the AR app, is only displayed to the recipient within a defined access period, this can advantageously result in high user-friendliness and / or a high degree of clarity. This can also save computing power and thus energy. Furthermore, if the AR app can only be operated and / or started by the recipient within the defined access period, effective usage control can be achieved.

[0019] Furthermore, it is proposed that, particularly by the sender or editor, different access periods to an AR object, especially the AR app, can be defined and / or set for different recipients, preferably biometrically identified, and / or for different groups of recipients, preferably biometrically identified. This allows for advantageous usage control and / or user control. It is advantageous to reach a target group at a precisely definable time.

[0020] Furthermore, it is proposed that the object be designed as a real, and in particular mobile, object in real space. This advantageously allows a fixed relationship to be established between the AR object and a real object. For example, moving the real object would also move the AR object. Specifically, it is conceivable that the object in real space is identified by image recognition, and the position of the AR object is defined in a display on the AR display device relative to the position of the recognized object. The object can be designed as a mobile object, such as the pillbox described above, or as a stationary object, such as a house, a tree, etc.

[0021] Alternatively or additionally, it is suggested that the object be implemented as a virtual item, specifically as an AR object and / or an AR app, within the virtual space. This would allow for particularly versatile usability. In the aforementioned application example, for instance, alongside the medication documentation app, an app could be displayed that shows the current medication inventory based on documented consumption and indicates when it should be refilled, and / or offers a reordering function, for example, via a virtual button.

[0022] Furthermore, if the recipient defines at least one filter criterion that restricts the display of AR objects by the other AR display device to those AR objects that meet the filter criterion, a particularly high level of user-friendliness can be achieved. User-defined customization of the displayed AR objects can also be advantageously achieved. This can improve clarity and / or reduce processing effort. The filter criterion can, in particular, restrict the display to a specific topic (e.g., only medical AR objects), a specific access period (e.g., only AR objects visible during the day), a specific location (e.g., only AR objects on a specific side of the street), a specific type of AR object (e.g., only AR apps), or a specific user group (e.g.,only non-public AR objects, only AR objects included in a premium membership, or only AR objects for members of a specific group of people), to a specific group of senders / editors (e.g., only AR objects from a specific information network), to a specific cultural group (e.g., only AR objects in English), to a specific quality characteristic (e.g., only AR objects well-rated by other recipients or only AR objects directly recommended for the specific recipient), and / or to a specific target group (e.g., only AR objects for children), etc.

[0023] Furthermore, the Augmented Reality (AR) display device, for example a smartphone, is proposed to be equipped with software (app), in particular pre-installed software, which is at least intended to carry out the procedure for positioning an Augmented Reality (AR) object.

[0024] Furthermore, an augmented reality (AR) system is proposed, comprising an augmented reality (AR) display device designed to position an augmented reality (AR) object in a virtual space superimposed on real space, and a further augmented reality (AR) display device designed to receive and / or display the AR object in the virtual space superimposed on real space. In particular, the AR display device and the further AR display device of the AR system can be at least substantially identical. For example, both the AR display device and the further AR display device can be smartphones. Specifically, the AR display device and the further AR display device can have at least substantially identical software (app) that, in particular, simultaneously allows the creation and positioning, as well as the display and application of AR objects.Alternatively, it is also conceivable that the software (app) for creating and positioning an AR object and the software (app) for displaying and using AR objects are different from each other, so that, for example, the further AR display device is free of software (app) that enables the creation and positioning of AR objects.

[0025] The inventive method, the inventive AR display device, and the inventive AR system are not intended to be limited to the application and embodiment described above. In particular, the inventive method, the inventive AR display device, and the inventive AR system may, to achieve a functionality described herein, comprise a different number of individual elements, components, and units than the number specified herein. Drawings

[0026] Further advantages become apparent from the following description of the drawings. The drawings illustrate four exemplary embodiments of the invention. The drawings, the description, and the claims contain numerous features in combination. A person skilled in the art will expediently consider the features individually and combine them into meaningful further combinations.

[0027] They show: Fig. 1. A schematic representation of an AR system with one AR display device and another AR display device. Fig. 2 a schematic detail view of the AR display device on which software for positioning an AR object is active, Fig. 3 a schematic detail view of the further AR display device on which software for displaying the AR object is active, Fig. 4 a first further schematic detail view of the further AR display device, Fig. 5 a schematic flowchart of a procedure for positioning the AR object, Fig. 6 a first further schematic detail view of the AR display device, Fig. 7 a second further schematic detail view of the AR display device, Fig. 8 a third further schematic detail view of the AR display device, Fig. 9 a fourth further schematic detail view of the AR display device, Fig. 10 a second further schematic detail view of the further AR display device, Fig. 11 a third further schematic detail view of the further AR display device, Fig. 12 a fourth further schematic detail view of the further AR display device with an exemplary representation of a second embodiment of the invention, Fig. 13 a fifth further schematic detail view of the further AR display device with an exemplary third embodiment of the invention and Fig. 14 a sixth further schematic detail view of the further AR display device with an exemplary fourth embodiment of the invention. Description of the exemplary implementations

[0028] The Fig. Figure 1 shows Augmented Reality (AR) system 28. The AR system 28 includes an Augmented Reality (AR) display device 14. The AR display device 14 is used to position an Augmented Reality (AR) object 10 (see also Figure 1). Fig. 2) provided by a sender or editor 30 in a virtual space superimposed on a real space. The AR object 10 is designed as application software 20. The AR object 10 is designed as an AR app. Software (app) is installed, in particular pre-installed, on the AR display device 14, which is at least intended to perform a method for positioning the AR object 10 in the virtual space relative to an object 12 in the real space or in the virtual space. In the example shown, the AR display device 14 is designed as a smartphone. The AR system 28 has another augmented reality (AR) display device 16. The other AR display device 16 is intended for receiving the AR object 10. The other AR display device 16 is intended for displaying the AR object 10 in a way that is visible to a receiver 32 (see Figure 1). Fig. 3) in the virtual space that overlays the real space. Software (app) is installed, in particular pre-installed, on the further AR display device 16, which is at least intended to carry out a method for displaying the AR object 10 or for executing an AR object 10 designed as application software 20, in particular as an AR app. In the example shown, the further AR display device 16 is designed as a smartphone.

[0029] The Fig. Figure 2 shows a detailed view of the AR display device 14, on which the software (app) for positioning the AR object 10 is active. The AR display device 14 has a display device 34. The display device 34 is configured as a screen. In the depicted case, the display device 34 shows the superposition of virtual space and real space. The AR display device 14 is directed at an object 12. The object 12 is configured as a real object in real space. In the depicted case, the object 12 is configured as a pillbox. The display device 34 displays the object 12. The display device 34 displays a virtual object superimposed on real space. The virtual object is in the Fig. In the case 2 shown as an example, the AR display device 14 is configured as a crosshair for positioning an AR object 12. The AR display device 14 has a security device 36. The security device 36 includes a camera 38, a fingerprint scanner 40, and a microphone 42. The security device 36 is designed to biometrically identify a user of the AR display device 14, in particular the sender or editor 30.

[0030] The Fig. Figure 3 shows a detailed view of the additional AR display device 16, on which the software for displaying the AR object 10 is active. The display device 34 of the additional AR display device 16 shows a superimposition of virtual space and real space. The AR object 10 displayed by the additional AR display device 16 is positioned relative to a real object 12. In the illustrated case, object 12 is designed as a pillbox. The AR object 10 is designed as an AR app. The AR app is designed as a documentation app for taking medication. The AR app has a virtual button 22. The virtual button 22 can be activated by the receiver 32 via the AR display device 16. In the example shown, the virtual button 22 is intended to confirm medication intake. The AR app has a virtual input form 24.The virtual input mask 24 can be filled out by the recipient 32 via the AR display device 16. In the example shown, the virtual input mask 24 is intended for entering a dose of the documented medication intake. The additional AR display device 16 has a security device 36 identical to that of the AR display device 14.

[0031] The Fig. Figure 4 shows a further detailed view of the additional AR display device 16, on which the software for displaying the AR object 10 is active. The display device 34 of the additional AR display device 16 shows another AR object 44. The additional AR object 44 is arranged in the virtual space, which overlays the real space, relative to an object 12'. In this case, the object 12' is designed as a virtual object in the virtual space. The object 12' is designed as an AR object 10. In this case, the object 12' is designed as an AR app, specifically the documentation app. The additional AR object 44 is designed as an AR app. The additional AR object 44 is designed as an app that displays the current medication inventory based on documented consumption. The additional AR object 44 has another virtual button 18, which, when pressed, triggers a reorder of the medication.

[0032] The Fig. Figure 5 shows a flowchart of a procedure for positioning the AR object 10 in the virtual space superimposed on the real space relative to the object 12. In at least one procedure step 46, the sender or editor 30 is identified. In procedure step 46, the sender or editor 30 is biometrically identified. In procedure step 46, the sender or editor 30 is biometrically identified using the security device 36 of the AR display device 14. The identification of the sender / editor 30 is compared with a human reference database. If the comparison is successful, the sender or editor 30 is registered and logged in to the AR display device 14. In at least one further procedure step 48, the object 12 is selected by the sender or editor 30 using the AR display device 14. In procedure step 48, the sender or editor 30 selects the object 12 using the display of the AR display device 14 (see Figure 5).also . Fig. 6) In at least one further process step 50, the AR object 10 is selected using the AR display device 14 (see also Fig. 7) Alternatively, in process step 50, the AR object 10 can be created or at least user-configured using the AR display device 14. In at least one further process step 52, the AR object 10 is positioned relative to the object 12 using the AR display device 14 (see also Fig. 2).

[0033] In at least one further process step 54, a defined access period is assigned to the AR object 10 by means of the AR display device 14, during which access to the AR object 10 by a receiver 32 is possible and / or during which the AR object 10 is displayed to the receivers 32 (see also Fig. 8) The AR object 10 is displayed to the recipient 32 only within the defined access period. The application software 20, in particular the AR app, can only be operated and / or started by the recipient 32 within the defined access period. In at least one further process step 56, the sender or editor 30 determines a group of recipients 32 who are authorized to view the AR object 10, in particular to whom the AR object 10, especially the AR app, is displayed on their other AR display devices 16 (see also Fig. 9) The selected recipients 32 are exclusively identified persons. The selected recipients 32 can only be biometrically identified persons. The selected recipients 32 are persons who possess an AR display device 16 with corresponding software, on which they are registered and / or biometrically identified. Consequently, the AR object 10 is receivable for the selected recipients 32, who capture the object 12 with their other AR display devices 16.

[0034] In at least one further process step 58, a receiver 32 is registered in the software of its further AR display device 16. In process step 58, the receiver 32 is biometrically identified. The receiver 32 is biometrically identified by means of the security device 36 of its further AR display device 16. In at least one further process step 60, the object 12 is detected by the receiver 32 in a field of view of the further AR display device 16. In at least one further process step 62, the AR object 10, which is located in the field of view of the further AR display device 16, is displayed to the receiver 32 in a superimposition of real space on the display device 34 of the further AR display device 16 (see also Fig. 4) In process step 62, the AR object 10 is displayed exclusively to the receivers 32 who were previously selected by the sender or editor 30 of the AR object 10. In process step 62, the AR object 10 is also displayed exclusively to receivers 32 who are biometrically identified and / or registered in the software of the additional AR display device 16. In at least one further process step 64, the receiver 32 defines at least one filter criterion. This definition by the receiver 32 restricts the display of the AR objects 10 located in the respective field of view of the additional AR display device 16 of the receiver 32 to those AR objects 10 that meet the filter criterion.

[0035] In at least one further process step 66, the AR object 10, in particular the AR app, is operated by the recipient 32. For example, the recipient 32 documents the intake of the medication or triggers a reorder of the medication. In process step 66, the recipient 32, for example, activates the virtual button 22 of the AR object 10 (see figure). Fig. 10). In process step 66, for example, the receiver 32 makes an entry in the virtual input mask 24 of the AR object 10. In at least one further process step 68, the activation of the virtual button 22 or the entry in the virtual input mask 24 is transmitted to a database 26 (see Fig. 10). In process step 68, the actuation of button 22 or the entry into the virtual input mask 24 is stored in the database 26.

[0036] In at least one further process step 70, the biometric identification of the recipient 32 is used for the execution and / or authorization of a payment transaction by the application software 20, in particular the AR app. For example, when the further virtual button 18 of the further AR object 44 is activated, which triggers an order process, a payment transaction is automatically initiated and / or carried out using the positive biometric identification (see Fig. 11).

[0037] In one of the Fig. In the second exemplary embodiment of the invention, as illustrated in Figure 12, the field of view of the additional AR display device 16 is directed towards the entrance of a holiday home. A sender or editor 30, who in this embodiment is a holiday home owner, has previously selected the biometrically identified receiver 32, who in this embodiment is a holiday home tenant, using their AR display device 14, so that an AR app placed by the holiday home owner is displayed to the holiday home tenant as soon as the holiday home tenant directs their additional AR display device 16 towards the entrance of the holiday home. Furthermore, the holiday home owner has limited the access period to the AR app placed by them for the holiday home tenant to a rental period of the holiday home (e.g., from Saturday at 2:00 p.m. to the following Saturday at 10:00 a.m.). The AR app displays a keypad comprising a plurality of virtual buttons 22.The holiday home tenant can unlock, i.e. open, the door lock of the holiday home or a key safe of the holiday home by entering a previously communicated combination into the keypad.

[0038] In one of the Fig. In the third exemplary embodiment of the invention, shown in Figure 13, the field of view of the additional AR display device 16 is directed at a coffee machine. A sender or editor 30, who in this embodiment is a coffee machine manufacturer, has previously selected (e.g., at the time of purchase) the receiver 32, who in this embodiment is a coffee machine owner, so that the coffee machine owner sees an AR app placed relative to the coffee machine by the coffee machine manufacturer as soon as the coffee machine owner directs their additional AR display device 16 at the coffee machine. The AR app displays various virtual buttons 22, by means of which, for example, animated step-by-step instructions for certain processes of the coffee machine (e.g., descaling or maintenance, etc.) can be started.

[0039] In one of the Fig.In the fourth exemplary embodiment of the invention, illustrated in Figure 14, the field of view of the additional AR display device 16 is directed at a sculpture exhibited in a museum. A sender or editor 30, who in this embodiment is a museum operator, has previously selected the biometrically identified receiver 32, who in this embodiment is a museum visitor, so that an AR app placed by the museum operator relative to the sculpture is displayed to the museum visitor as soon as the museum visitor directs their additional AR display device 16 at the sculpture. Furthermore, the museum operator has restricted the access period to the AR app they have placed for the museum visitor to a specific period of time the museum visitor is authorized to visit (e.g., from 9:00 a.m. to 5:00 p.m. for day ticket holders or from January 1 to December 31 for annual ticket holders).The AR app displays a button (22) that provides access to information about the sculpture. It also displays another virtual button (18) that allows users to purchase an image or a copy of the sculpture. Activating this second virtual button (18) initiates and / or completes a payment process using the museum visitor's biometric identification.

[0040] Numerous other comparable applications of the invention are conceivable. Reference sign 10 Augmented Reality (AR) object 12 objects 14 AR display device 16. Another AR display device 18 More virtual buttons 20 application software 22 virtual buttons 24 virtual input masks 26 database 28 AR system 30 Sender / Editor 32 recipients 34 Display device 36 Safety device 38 Camera 40 fingerprint scanners 42 microphones 44 Another AR object 46-70 Procedure step

Claims

[1] Method for positioning an augmented reality (AR) object (10) in a virtual space superimposed on a real space relative to an object (12, 12'), comprising at least method steps (46-70) in which: - the object (12, 12') is selected using an AR display device (14), - the AR object (10) is selected and / or created using the AR display device (14), - the AR object (10) is positioned relative to the object (12, 12') using the AR display device (14), wherein the AR object (10) is receivable by a receiver (32) which detects the object (12, 12') with another AR display device (16), characterized by , that the AR object (10) is designed as an AR app executable in the virtual space, wherein the AR object (10) is displayed exclusively to recipients (32) who have been previously selected by a sender or editor (30) of the AR object (10) and who are exclusively biometrically identified persons, wherein the biometric identification of the recipient (32) is used for carrying out and / or authorizing a payment transaction of the AR app. [2] Method according to claim 1, characterized by that the AR app has at least one virtual button (22) that can be activated by the receiver (32) via the further AR display device (16). [3] Method according to claim 1 or 2, characterized by that the AR app has at least one virtual input mask (24) that can be filled out by the receiver (32) via the further AR display device (16). [4] Method according to claim 2 or 3, characterized by, that at least one actuation of the virtual button (22) or at least one entry into the virtual input mask (24) is transmitted to a database (26) and preferably stored in the database (26). [5] Method according to any one of the preceding claims, characterized by , that the sender or editor (30) of the AR object (10) is biometrically identified, in particular by means of the AR display device (14). [6] Method according to any one of the preceding claims, characterized by , that a defined access period is assigned to the AR object (10) by means of the AR display device (14, 16). [7] Method according to claim 6, characterized by , that the AR object (10) is only displayed to the recipient (32) within the defined access period. [8] Method according to claim 6 or 7, characterized by , that the AR app can only be operated and / or started by the recipient (32) within the defined access period. [9] Method according to any one of claims 6 to 8, characterized by , that different access periods to an AR object (10), in particular to the AR app, can be set for different, preferably biometrically identified, recipients (32) and / or for different groups of, preferably biometrically identified, recipients (32). [10] Method according to any one of the preceding claims, characterized by , that the object (12) is formed as a real object in real space. [11] Method according to any one of claims 1 to 9, characterized by , that the object (12') is formed as a virtual object in the virtual space. [12] Method according to any one of the preceding claims, characterized by, that the receiver (32) defines at least one filter criterion which restricts the display of AR objects (10) by the further AR display device (16) to AR objects (10) which correspond to the filter criterion. [13] Augmented Reality (AR) display device (14), for example a smartphone, with software which is at least designed to perform a method for positioning an Augmented Reality (AR) object (10) according to any of the preceding claims. [14] Augmented Reality (AR) system (28) comprising an Augmented Reality (AR) display device (14) according to claim 13, which is provided for positioning an Augmented Reality (AR) object (10) in a virtual space superimposed on a real space, and with a further Augmented Reality (AR) display device (16) according to claim 13, which is provided for receiving and / or displaying the AR object (10) in the virtual space superimposed on the real space.

Citation Information

Patent Citations

  • Augmented reality content creation

    US20160247324A1

  • System and method for authoring and sharing content in augmented reality

    US20180253900A1