Method for implementing augmented reality
Patent Information
- Application Number
- CN202210362539.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-04-07
- Publication Date
- 2026-09-08
- Estimated Expiration
- 2042-04-07
AI Technical Summary
不过,这些作法虽然能够在笔记本电脑上增添特殊图案,但是使用者一次只能选择一个具有代表性的图案,无法任意更换图案
[0004] The augmented reality implementation method provided in this disclosure allows virtual objects to be associated with a target device to generate augmented reality content displayed on the mobile device. This enables the presentation of virtual objects on the target device, highlighting the user's personal style. Users of the target device can also freely change the associated virtual objects to reflect their individual characteristics as needed.
Smart Images

Figure CN116935003B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to an augmented reality (AR) technology, and more particularly to a method for implementing augmented reality. Background Technology
[0002] As laptops become increasingly popular, users, in addition to emphasizing practical functions, also want their laptops to reflect their personal style when purchasing them. Common methods to express this personal style include printing special designs on the laptop casing, using protective cases with unique patterns, or purchasing screen protectors. However, while these methods allow users to add special designs to their laptops, they can only choose one representative design at a time and cannot freely change the design. Summary of the Invention
[0003] This disclosure provides a method for implementing augmented reality (AR), applicable to a server, wherein the server has multiple AR objects and multiple sets of settings corresponding to these AR objects. The method includes: the server receiving an AR request from a mobile device, wherein the AR request is associated with a target device; the server connecting to the target device to obtain current context data of the target device; and the server confirming settings corresponding to the current context data from these settings, and selecting one of the AR objects as a virtual object based on the confirmed settings and providing it to the mobile device.
[0004] The augmented reality implementation method provided in this disclosure allows virtual objects to be associated with a target device to generate augmented reality content displayed on the mobile device. This enables the presentation of virtual objects on the target device, highlighting the user's personal style. Users of the target device can also freely change the associated virtual objects to reflect their individual characteristics as needed. Attached Figure Description
[0005] Figure 1 This is a schematic diagram of an augmented reality system provided according to an embodiment of the present disclosure;
[0006] Figure 2 show Figure 1 An example of an augmented reality system performing an augmented reality setup procedure;
[0007] Figure 3 show Figure 1 An example of an augmented reality system generating augmented reality;
[0008] Figure 4This is a flowchart of an augmented reality implementation method provided according to an embodiment of the present disclosure; and
[0009] Figure 5 yes Figure 4 A flowchart of one embodiment of step S140. Detailed Implementation
[0010] Please refer to Figure 1 This disclosure provides a method for implementing augmented reality (AR), which is implemented through an AR system 100. The AR system 100 includes a server 120, a mobile device 140, and a target device 160. The mobile device 140 connects to the server 120 to obtain a virtual object Xi associated with the target device 160, so as to generate AR content C0 and present it on the mobile device 140. The target device 160 connects to the server 120 to set the generation context of the aforementioned virtual object Xi.
[0011] In one embodiment, the mobile device 140 may be a smartphone, and the target device 160 may be a laptop computer. However, it is not limited to these. The mobile device 140 may be any electronic device with a camera module for image acquisition and network connectivity. The target device 160 may be any electronic device with network connectivity.
[0012] In one embodiment, server 120 includes a network module 122, a context module 124, and a content module 126. The network module 122 is used to manage users. Users must log in to server 120 through the network module 122 before they can execute the setup procedure. In this embodiment, target device 160 can only connect to context module 124 to execute the augmented reality setup procedure after logging into server 120 through network module 122. For a detailed description of the augmented reality setup procedure, see [link to documentation]. Figure 2 And its corresponding paragraphs. The setting information D0, D1...Dm generated by the augmented reality setting program is stored in the context module 124.
[0013] Mobile device 140 is connected to context module 124 to obtain virtual object Xi to generate augmented reality that is displayed on the display of mobile device 140 (not shown). For a detailed explanation of the augmented reality generation process, please refer to [link to documentation]. Figure 3 And its corresponding paragraphs. Content module 126 is used to store a variety of different augmented reality objects AR0, AR1...ARn. These augmented reality objects AR0, AR1...ARn can be associated with the target device 160 as virtual objects Xi and presented as augmented reality on the mobile device 140.
[0014] Figure 2 show Figure 1This is an embodiment of an augmented reality system 100 performing an augmented reality setup procedure. The augmented reality setup procedure is mainly performed by the target device 160 and the server 120.
[0015] As shown in the diagram, firstly, as indicated by arrow A1, the user logs in via the network module 122 of the server 120 through the target device 160. Then, as indicated by arrow A2, the user notifies the context module 124 to begin augmented reality setup.
[0016] Next, as shown by arrows A3 and A4, the context module 124 notifies the content module 126 to send all available augmented reality objects AR0, AR1…ARn back to the network module 122 for the user to choose from. Then, as shown by arrows A5 and A6, the user selects the desired virtual object Xi from these augmented reality objects AR0, AR1…ARn using the target device 160, and establishes a corresponding context number Ni in the context module 124. Next, as shown by arrow A7, the context module 124 queries the network module 122 for the context corresponding to the virtual object Xi. Subsequently, as shown by arrows A8 and A9, the user inputs the context corresponding to the virtual object Xi into the network module 122 using the target device 160. The network module 122 then generates context data Si based on this context and inputs it into the context module 124, thus completing the augmented reality setup process.
[0017] Therefore, the setting information Di input in the augmented reality setup program corresponds to a scenario number Ni, and includes scenario data Si and a corresponding virtual object Xi. Users can input multiple sets of setting information D0, D1...Dm in the aforementioned augmented reality setup program, corresponding to different scenarios.
[0018] In one embodiment, the context data Si can be the user's state, time, or location. Taking the user's state as an example, multiple sets of setting information D0, D1...Dm can be entered in the augmented reality setting program to correspond to different augmented reality objects for various user states such as during a meeting or during a break. In this way, the server 120 can select the corresponding augmented reality object as a virtual object Xi and associate it with the target device 160 based on these setting information and the current user state.
[0019] Taking time as an example, multiple sets of setting information D0, D1...Dm can be entered in the augmented reality setting program to map different time periods such as morning, afternoon, and evening to different augmented reality objects. In this way, the server 120 can select the corresponding augmented reality object as a virtual object Xi based on the current time period and associate it with the target device 160.
[0020] Taking location as an example, multiple sets of setting information D0, D1...Dm can be entered in the augmented reality setting program to associate the workplace and home with different augmented reality objects. In this way, the server 120 can select the corresponding augmented reality object as a virtual object Xi and associate it with the target device 160 based on the current location of the target device 160.
[0021] Figure 3 show Figure 1 An embodiment of an augmented reality system that generates augmented reality. The process of generating augmented reality involves the collaborative work of a mobile device 140, a target device 160, and a server 120.
[0022] As shown in the figure, firstly, as indicated by arrow B1, the user connects to the context module 124 of the server 120 using mobile device 140 and generates an augmented reality request R1 associated with the target device 160. In one embodiment, this augmented reality request R1 can be a web AR request. For example, mobile device 140 can scan a barcode pattern, such as a two-dimensional barcode, to connect to a specific URL to generate the augmented reality request R1 associated with the target device 160. This barcode pattern can be printed or affixed to the target device 160. In one embodiment, this barcode pattern can be located at the location where augmented reality is expected to occur, such as the casing 162 of the target device 160.
[0023] Next, as shown by arrows B2 and B3, the context module 124 will connect to the target device 160 to obtain the current context data SS of the target device 160, such as user status, time period, or location of the target device 160. Then, the target device 160 will send the current context data SS back to the context module 124 so that the context module 124 can select the virtual object to be used.
[0024] Subsequently, as shown by arrows B4 and B5, the context module 124 will check the setting information (assuming it is setting information Di) corresponding to the current context data SS in the setting information D0, D1...Dm to select the virtual object Xi to be used, and notify the content module 126 to transmit the virtual object Xi to the mobile device 140.
[0025] After receiving the virtual object Xi, the mobile device 140 associates the virtual object Xi with the image of the target device 160 to generate augmented reality content C0, which is then displayed on the screen of the mobile device 140. Thus, the associated virtual object Xi is displayed on the target device 160 as seen by the user through the screen of the mobile device 140.
[0026] For example, mobile device 140 overlays virtual object Xi onto the casing 162 of target device 160 (e.g., a laptop computer), causing the casing 162 of target device 160 to display an augmented reality object (i.e., virtual object Xi). Thus, the image of virtual object Xi will be displayed on the casing 162 of target device 160 as seen by the user through the display of mobile device 140.
[0027] In one embodiment, the target device 160 may be an electronic device having a housing 162, and the virtual object Xi may be a pattern corresponding to the shape of the housing 162. The size of the pattern may be greater than or equal to the size of the housing 162. This pattern may be a 2D pattern or a 3D pattern. For example, if the target device 160 is a laptop computer, the virtual object Xi may be a planar pattern covering the entire laptop housing 162. It may also be a three-dimensional pattern extending outward from the laptop housing 162.
[0028] In one embodiment, the mobile device 140 can determine the position of the target device 160 based on the outline of the outer shell 162 of the target device 160 and the two-dimensional barcode on the outer shell 162, and then cover the outer shell 162 of the target device 160 with a virtual object Xi, so that the virtual object Xi moves with the target device 160 on the screen of the mobile device 140. When the target device 160 leaves the screen of the mobile device 140, the virtual object Xi will disappear.
[0029] In one embodiment, the user can further select a virtual object Xi on the mobile device 140 to perform further functions or interact with the virtual object Xi. For example, the user can change the color or shape of the virtual object Xi by selecting it, or when the user selects the virtual object Xi, a description of the virtual object Xi will be displayed on the screen.
[0030] Through augmented reality operations, from the perspective of the mobile device 140, the virtual object Xi appears as if it were attached to the laptop's casing 162, thus altering the original appearance of the laptop's casing 162. In this way, the augmented reality implementation method provided by this disclosure allows the laptop's casing 162 to present a variety of different designs without actually replacing the laptop's casing 162 or adding a decorative protective cover to the laptop.
[0031] In the foregoing Figure 2 as well as Figure 3In one embodiment, the setting information D0, D1…Dm is set by the user of the target device 160 through the target device 160 and stored in the server 120. However, it is not limited to this. In other embodiments, the setting information D0, D1…Dm may also be set by the user of the mobile device 140 through the mobile device 140 and stored in the server. Furthermore, the aforementioned… Figure 2 as well as Figure 3 In one embodiment, the context data of the setting information D0, D1…Dm is associated with the context of the target device 160, such as the user state of the target device 160, the location of the target device 160, etc., but it is not limited to this. In other embodiments, the context data of the setting information D0, D1…Dm may also depend on the context of the mobile device 140. For example, the virtual object associated with the target device 160 can be determined based on the user state data stored in the mobile device 140.
[0032] Figure 4 This is a flowchart illustrating an augmented reality implementation method according to an embodiment of the present disclosure. This augmented reality implementation method is applicable to... Figure 1 The server 120 shown pre-stores various augmented reality objects AR0, AR1…ARn and corresponding configuration information D0, D1…Dm for these augmented reality objects AR0, AR1…ARn. This augmented reality implementation method includes the following steps.
[0033] First, as described in step S120, server 120 receives an augmented reality request R1 from a mobile device 140, wherein the augmented reality request R1 is associated with a target device 160.
[0034] Subsequently, as described in step S130, server 120 connects to target device 160 to obtain current context data SS of target device 160.
[0035] Next, as described in step S140, the server 120 confirms the setting information Di corresponding to the current context data SS from these setting information D0, D1...Dm, and provides a virtual object Xi to the mobile device 140 according to the confirmed setting information Di. In one embodiment, the server 120 selects one of a variety of different augmented reality objects AR0, AR1...ARn stored in the server 120 as the virtual object Xi according to the setting information Di.
[0036] The configuration information Di may include contextual data Si and a corresponding virtual object Xi. For example, the contextual data Si may be the user's state, time, or location.
[0037] After receiving the virtual object Xi, as described in step S160, the mobile device 140 associates the virtual object Xi with the image of the target device 160 to generate augmented reality content C0, which is then presented on the mobile device 140. In one embodiment, the mobile device 140 may directly present the augmented reality content C0 using a browser, such as using WEB AR.
[0038] Figure 5 yes Figure 4 A flowchart of one embodiment of step S140. (Continued) Figure 4 In step S120, in step S142, the server 120 checks whether there is setting information corresponding to the current context data SS of the target device 160 in these setting information D0, D1...Dm.
[0039] If there is setting information corresponding to the current context data SS (let's say setting information Di), as described in step S144, server 120 selects one of the various augmented reality objects AR0, AR1...ARn stored in server 120 as the virtual object Xi based on the confirmed setting information Di. If there is no setting information corresponding to the current context data SS, as described in step S146, server 120 selects one of these augmented reality objects AR0, AR1...ARn as the virtual object Xi according to an algorithm. In one embodiment, this algorithm is a random function.
[0040] The augmented reality implementation method provided in this disclosure allows virtual objects to be associated with a target device 160 to generate augmented reality content C0 that is presented on the mobile device 140. This enables the virtual object Xi to be displayed on the target device 160, highlighting the unique characteristics of the target device 160 and the user's personal style. Users of the target device 160 can also freely change the associated virtual object Xi to reflect their individual preferences.
[0041] Although the present invention has been disclosed above with reference to embodiments, it is not intended to limit the present invention. Any person skilled in the art can make some changes and modifications without departing from the concept and scope of the present invention. Therefore, the scope of protection of the present invention shall be determined by the claims.
Claims
1. A method for implementing augmented reality, applicable to a server, wherein the server has multiple augmented reality objects and multiple sets of settings corresponding to the multiple augmented reality objects, characterized in that, The above-mentioned methods for implementing augmented reality include: The server receives augmented reality requests from mobile devices, wherein the augmented reality requests are associated with the target device; The aforementioned server connects to the aforementioned target device to obtain the current context data of the aforementioned target device; and The server confirms the setting information corresponding to the current context data from the plurality of setting information, and selects one of the plurality of augmented reality objects as a virtual object based on the confirmed setting information and provides it to the mobile device. Specifically, the server confirms whether there is setting information corresponding to the current context data among the plurality of setting information; if so, the server selects one of the plurality of augmented reality objects as the virtual object based on the confirmed setting information; otherwise, the server selects one of the plurality of augmented reality objects as the virtual object according to an algorithm. The aforementioned virtual objects are used to be overlaid on the image of the target device by the aforementioned mobile device.
2. The method for implementing augmented reality according to claim 1, characterized in that, in, The aforementioned target device is an electronic device, and the aforementioned electronic device includes a housing.
3. The method for implementing augmented reality according to claim 2, characterized in that, in, The aforementioned virtual object is a pattern corresponding to the shape of the aforementioned outer shell.
4. The method for implementing augmented reality according to claim 3, characterized in that, in, The dimensions of the above-mentioned drawing are greater than or equal to the dimensions of the above-mentioned housing displayed on the display of the above-mentioned mobile device.
5. The method for implementing augmented reality according to claim 1, characterized in that, in, The virtual objects mentioned above are either 2D or 3D graphics.
6. The method for implementing augmented reality according to claim 1, characterized in that, in, The above algorithm is a random function.
7. The method for implementing augmented reality according to claim 1, characterized in that, in, The above settings include contextual data.
8. The method for implementing augmented reality according to claim 7, characterized in that, in, The above contextual data includes time.
9. The method for implementing augmented reality according to claim 1, characterized in that, in, The aforementioned mobile device scans the barcode pattern to generate the aforementioned augmented reality request.
10. The method for implementing augmented reality according to claim 9, characterized in that, in, The barcode pattern is located on the outer casing of the target device.
11. The method for implementing augmented reality according to claim 10, characterized in that, in, The barcode pattern above is a two-dimensional barcode.
Citation Information
Patent Citations
Wearable computer with superimposed controls and instructions for external device
CN103946734A