Constructing an augmented reality image
By projecting a structured light array onto a mobile device to measure the multi-directional cross-section of an object, reconstructing a 3D image, and displaying the augmented reality image on the user interface, the problem of augmented reality image construction and display in the prior art is solved, and efficient 3D image reconstruction and virtual object overlay are achieved.
Patent Information
- Application Number
- CN202110948211.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-08-27
- Filing Date
- 2021-08-18
- Publication Date
- 2025-11-25
- Estimated Expiration
- 2041-08-18
AI Technical Summary
Existing technologies struggle to effectively construct and display augmented reality images, especially in user interface interactions with the real-world environment, lacking efficient methods for 3D image reconstruction and virtual object overlay.
By using a structured light array to project onto an object from a mobile device, multi-directional cross-sections are measured, a 3D image is reconstructed, and an augmented reality image associated with the 3D image is displayed on the user interface, utilizing infrared illuminators and cameras for measurement and display.
It enables the efficient construction and display of augmented reality images on the user interface, enhances the immersive experience of the real-world environment, and provides accurate overlay of virtual objects and the ability to reconstruct 3D images.
Smart Images

Figure CN114119843B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates generally to computing devices, and more specifically, to methods, apparatuses, and systems related to constructing augmented reality (AR) images. BACKGROUND
[0002] A computing device can be a personal laptop, a desktop computer, a mobile device (e.g., a headset, a smartphone, a tablet, a wrist-worn device, a digital camera, etc.), and / or a redundant combination thereof, among other types of computing devices. In some examples, a computing device can construct an AR image and display the AR image on a user interface and / or perform artificial intelligence (AI) operations.
[0003] AR can overlay virtual objects on a real-world (e.g., natural) environment. For example, AR can add 3D holograms to reality. In some examples, AR can be an interactive experience of a real-world environment where the objects in the real-world are augmented by computer-generated sensory information. AR can mask a portion of a real-world environment and / or add to a real-world environment such that it is perceived as an immersive aspect of the real-world environment. Thus, AR can change a person’s perception of a real-world environment and mixed reality. AR can be created using a heads-up display, a headset, smart glasses, smart touchpoints, a light field display, a laser, and / or a number of light sources. SUMMARY
[0004] An embodiment of the present disclosure provides a method for constructing an augmented reality image, comprising: projecting a structured light array from a mobile device onto an object; measuring a multi-directional cross-section of the object with the projected light; reconstructing a three-dimensional (3D) map of the object based on the measured multi-directional cross-section; and displaying an augmented reality (AR) image associated with the 3D map on a user interface of the mobile device.
[0005] Another embodiment of the present disclosure provides an apparatus for constructing an augmented reality image, comprising: a user interface of a mobile device; a camera of the mobile device; a memory of the mobile device; and a processing resource configured to execute executable instructions stored in the memory to: project a structured light array from the camera of the mobile device onto a user; measure a multi-directional cross-section of the user based on data collected from the projected light; reconstruct a three-dimensional (3D) map of the user based on the measured multi-directional cross-section; and display an augmented reality (AR) image of the user associated with the 3D map on the user interface of the mobile device. BRIEF DESCRIPTION OF DRAWINGS
[0006] Figure 1 Examples of a computing device for constructing an AR image according to a number of embodiments of the present disclosure are shown.
[0007] Figure 2An example of a user interface of a computing device for constructing an AR image is shown in accordance with embodiments of the present disclosure.
[0008] Figure 3 Another example of a computing device for constructing an AR image is shown in accordance with embodiments of the present disclosure.
[0009] Figure 4 A flowchart of a method for constructing an AR image in accordance with embodiments of the present disclosure.
[0010] Figure 5 Another flowchart of a method for constructing an AR image in accordance with embodiments of the present disclosure. DETAILED DESCRIPTION
[0011] The present disclosure includes methods, devices, and systems related to constructing and displaying AR images on a user interface. An example method can include projecting a structured light array from a mobile device onto an object. The method also includes measuring a multi-directional cross section of the object with the projected light. The method also includes reconstructing a three-dimensional (3D) map of the object based on the measured multi-directional cross section. The method also includes displaying an augmented reality (AR) image associated with the 3D map on a user interface of the mobile device.
[0012] A computing device can include a micro-sensor to construct an AR image. The micro-sensor can include an infrared (IR) illuminator. The micro-sensor can be projected onto a user in the form of a dot projector. The dot projector can produce IR illumination as a structured light array. In some examples, a flood illuminator within the computing device can produce the IR illumination. The IR illumination includes IR light, which includes electromagnetic radiation having a longer wavelength than that of visible light, such that the IR illumination is invisible to the human eye. The IR illuminator can be used within the micro-sensor to shine light on an object. Sensors such as a proximity sensor and an ambient light sensor can be used by the computing device to determine how much illumination is needed to create a 3D map.
[0013] As used herein, a 3D map can refer to an image of an object having a height, a width, and a depth. The 3D map can be formed by developing techniques for creating an illusion of depth in an image. The 3D map can be constructed using a pattern from a dot projector and thermal features that reflect back to the IR illuminator from the object.
[0014] As used herein, a dot projector is a structured light source with a flash component that emits a predetermined light pattern on the surface of the dot projector. In some examples, the dot projector produces more than 30,000 dots of invisible IR illuminator for creating a 3D map measurement, although other dot quantities are possible. By projecting a product onto the 3D map, an AR image can be projected from the 3D map. The AR image can also be projected as a hologram onto the user. The AR image can be displayed as a computer-generated image overlaid on the user's real-world view and can be displayed on a user interface. As used herein, an AR image can refer to an image that overlays digital information, such as an image, onto a 3D map. For example, an AR image can be created by projecting a 3D map by overlaying a product on the 3D map.
[0015] In various embodiments, a computing device is used to construct an AR image. A dot projector of the computing device can project small dots of IR illuminator, which act as microsensors, onto an object to collect measurements of the object. For example, the object can be a person, such as a user of the computing device or an animal, etc. The IR illuminator can be used within the microsensors to shine light as a structured array of light on the object. The computing device can be set at a particular distance from the object to measure the object using the structured array of light. In some examples, the object can be the width of the user's body. That is, the dot projector can project small dots of IR illuminator, projecting structured light onto the width of the user's body to collect body measurements of the user, where the structured light acts as a measuring instrument of the width of the user's body. In such examples, the computing device can be set at a particular distance from the user to obtain measurements of the user using the structured light. For example, the dot projector can project onto the user's face, shoulders, arms, legs, feet, or a combination thereof.
[0016] The measurements can be collected and used to construct a 3D map of the object. That is, a 3D map of the user can be constructed based on the information collected by the structured light. An AR image can be formed based on the 3D map. The AR image can be displayed on a user interface of the computing device. The AR image can be displayed as a computer-generated image overlaid on the user's real-world view. The AR image can also be projected as a hologram onto the user. The AR image projection can be a projection of a product for the user to view. The AR image projection can be a projection of a 3D map of the user wearing the product. The AR image can be accessed by the computing device. An AR headset can be used to view the hologram. For example, the AR image can be saved on the computing device and / or an external memory.
[0017] In the following detailed description of the disclosure, reference is made to the accompanying drawings that form a part hereof, and in which are shown by way of illustration, one or more examples of practicing the disclosure. These examples are described in sufficient detail to enable those skilled in the art to practice the examples of the disclosure, and it is to be understood that other examples can be utilized and that process, electrical, and / or structural changes can be made without departing from the scope of the present disclosure. As used herein, "a number of" something can refer to one or more of such things. For example, a number of computing devices can refer to one or more computing devices. A number of something means two or more.
[0018] The drawings herein follow a numbering convention in which the first numeral or numerals correspond to the figure number and the remaining numerals identify an element or component within the figure. Similar elements or components between different figures can be identified by the use of similar numerals. For example, Figure 1 reference numeral 102 in FIG. 1 can represent element "2," and Figure 2 similar elements in FIG. 2 can be represented as 202. As will be appreciated, elements shown in various embodiments herein can be added, exchanged, and / or eliminated so as to provide a number of additional examples of the present disclosure. In addition, the proportion and the relative scale of the elements provided in the figures are intended to illustrate various embodiments of the present disclosure and are not to be used in a limiting sense.
[0019] Figure 1 An example of a computing device 101 for constructing an AR image in accordance with a number of embodiments of the present disclosure is shown. As used herein, a "computing device" can refer to any electronic device that uses an operating system running loaded onto the electronic device. Examples of computing devices can include a personal laptop computer, a desktop computer, a mobile device (e.g., a mobile phone, a smart phone, a tablet, a wrist-worn device, a digital camera, etc.), and / or redundant combinations thereof. The computing device 101 can include a processing resource (not shown in FIG. 1) communicatively coupled to a memory (not shown in FIG. 1) to perform functions associated with constructing an AR image. Figure 1 Figure 1
[0020] In a number of embodiments, the computing device 101 can include a camera 104. In some examples, the computing device 101 can include one or more cameras. One of the one or more cameras can be used individually to construct an AR image. In a number of embodiments, one or more optical sensors can be used with the one or more cameras to construct a 3D map associated with the AR image. The camera 104 can project a structured light array 105 onto an object. The object can be a person, such as a user 103 of the computing device.
[0021] A point projector within the camera 104 can project small dots of IR illumination with a structured light array 105 onto the user 103 to collect measurements of the user. The structured light array 105 can be used as a measuring instrument for the user's body 103. That is, the structured light array 105 can measure the user's 103 body width, collecting measurements needed for proper fit and function of a product on the user 103. In this way, the computing device 101 can be set at a particular distance from the user 103 to use the structured light array 105 to obtain measurements of the user. For example, the point projector can project onto the user's face, shoulders, arms, legs, feet, or a combination thereof.
[0022] A 3D map can be created based on the measurements obtained from the structured light array. The point projection can take measurements of the user's 103 height and weight, among others. The measurements taken can also include clothing measurements of the user 103, such as clothing sizes and measurements (neck size, sleeve length and width, and waist width, among others). The measurements are not limited to the user's body 103, but can also be taken of the user's head or feet. In one example, the structured light array 105 can be used to measure the width of the user's face. In another example, the structured light array 105 can be used to measure the width and length of the user's feet.
[0023] In some examples, a 3D map can be created based on pictures accessible to the computing device 101. The structured light array 105 can also be used to obtain measurements of the user based on scaled measurements of the pictures. That is, the structured light array 105 can be used to measure the user 103 and collect measurements needed for proper fit and function of a product on the user 103. These measurements can be accessible by the computing device 101. For example, the measurements can be stored on the computing device 101 and / or in an external memory.
[0024] An AR image can be formed based on the 3D map captured using the structured light array 105 within the camera 104. The AR image can be displayed on the user interface 102. Upon receiving the AR image, the user 103 can choose to use or discard the received AR image. For example, the user 103 can save a preferred AR image. In another example, the user 103 can discard the AR image and select another AR image based on the user's 3D map. The computing device 101 can prompt the user 103 to upload another 3D map or use a different AR image based on the selected 3D map. The user 103 can select an AR image based on a previous 3D map uploaded by the user 103.
[0025] A user 103 can set a preferred 3D map. The preferred 3D map can be accessed by the computing device 101. For example, the preferred 3D map can be saved on the computing device 101 and / or an external memory. The saved 3D map can be accessed by using a password. As used herein, the term password refers to a security form used for user authentication to gain access to a system. For example, the password can include, but is not limited to, a pin number, a password code, a secret key, an eye scan, or facial recognition, etc. The saved 3D map can be accessed at a later time to create an AR image. The user 103 can use or discard the saved 3D map at the time of access.
[0026] A user 103 can also set a preferred AR image. The preferred AR image can be accessed by the computing device. For example, the preferred AR image can be saved on the computing device and / or an external memory. The saved AR image can be accessed by using a password. The preferred AR image can be accessed at a later time. The user 103 can use or discard the saved AR image at the time of access.
[0027] The AR image can be copied from the user interface 102 onto other media. Examples of other media can include, but are not limited to, a website, a document, or an email. In one example, the AR image can be directly uploaded to a product website. For example, a user can virtually try on clothes from a website of a product using the AR image. In another example, the user 103 can transfer the AR image from the memory of the computing device 101 to a product website. In such examples, the user can store the AR image locally on the memory of the computing device and access it when needed (e.g., to transfer to a product website). In some examples, the AR image can be copied to a website, a different mobile device, or both. In other examples, the computing device can display and / or automate multiple images and / or augment the AR image 104 to move and / or change on the user interface 102. For example, the user 103 can rotate the AR image and display the rotation on the user interface 102.
[0028] Figure 2 An example of a user interface 202 of a computing device for building an AR image in accordance with a number of embodiments of the present disclosure is shown. In a number of embodiments, the user interface 202 can be activated in response to detecting a 3D map by a camera. The 3D map can be displayed on the user interface 202 (e.g., displayed 3D map 207), and an AR image can be displayed on the user interface 202 based on the displayed 3D map 207. That is, the AR image can be displayed on the user interface 202 by projecting a digital image onto the displayed 3D map 207. In one example, the digital image can be a piece of clothing.
[0029] A user of the computing device can interact with the computing device through a user interface 202 displayed on the display. The user interface 202 can be generated by the computing device. For example, the user interface 202 can be a graphical user interface (GUI) capable of providing information to and / or receiving information from a user. The user interface 202 can be displayed on a display of the computing device. In some examples, the display can be a touchscreen.
[0030] In some examples, the user interface 202 can include a notification. For example, the user interface 202 can display a notification to inform the user that a 3D map has been captured by a structured light array (e.g., structured light array 105 in Figure 1 The 3D map can be displayed on the user interface 202 as a displayed 3D map 207. An AR image can be derived from the 3D map and displayed on the user interface 202 as displayed in the 3D map 207. The AR image overlays digital information such as images onto the displayed 3D map 207. The AR image can be created by placing a product on the displayed 3D map 207. The product can be clothing. For example, a user can select a piece of clothing and using a digital pen or a finger, the user can move the selected item onto the displayed 3D map 207. For example, the AR image can be created by placing the clothing on the head, torso, limbs, feet, or a combination thereof of the displayed 3D map 207. The clothing can be a dress as shown in Figure 2 but embodiments of the disclosure are not limited to this example.
[0031] In some examples, the user interface 202 can display multiple products on the AR image. The user interface 202 can be responsive to receiving a selection on the user interface 202, such as a user press, tap, and / or click of the user interface 202 of the computing device. The selection can be made to access a saved 3D map or a saved AR image. The product to be placed on the 3D map can also be selected. In multiple embodiments, the user interface 202 can display the AR image in response to the computing device receiving a password.
[0032] In some examples, the product can be found in an online marketplace. The product can be scaled down to fit the scale of the 3D map and / or the displayed 3D map 207. The retailer can scale down the product so that the product can fit the user appropriately. The user can select a properly fitting measurement of equipment based on the measurements taken by the structured light array of the camera of the computing device.
[0033] Figure 3 An example of a computing device 301 using to build an AR image is shown in accordance with multiple embodiments of the disclosure. As shown in Figure 3 The computing device 301, such as a mobile device, can include a processing resource (e.g., processor) 322, a memory 324, a user interface 302, and a camera 304.
[0034] The memory 324 may be any type of storage medium accessible by the processing resource 322 to execute various instances of the present disclosure. For example, according to the present disclosure, the memory 324 may be a non-transitory computer-readable medium having computer-readable instructions (e.g., computer program instructions) stored therein, which may be executed by the processing resource 322 to: receive input at the computing device 301, detect a user via a camera 304 on the computing device 301, capture a 3D image, and display an AR image on a user interface 302 of the computing device 301.
[0035] Memory 324 may be volatile or non-volatile memory. Memory 324 may also be removable (e.g., portable) memory or non-removable (e.g., internal) memory. For example, memory 324 may be random access memory (RAM) (e.g., dynamic random access memory (DRAM) and / or phase-change random access memory (PCRAM)), read-only memory (ROM) (e.g., electrically erasable programmable read-only memory (EEPROM) and / or optical disc read-only memory (CD-ROM)), flash memory, laser disc, digital multifunction disc (DVD) or other optical storage, and / or magnetic media (such as magnetic tape cassettes / tapes or disks), and other types of memory.
[0036] Furthermore, although memory 324 is shown to be located within computing device 301, embodiments of this disclosure are not limited thereto. For example, memory 324 may be located on an external computing resource (e.g., enabling computer-readable instructions to be downloaded via the Internet or other wired or wireless connections).
[0037] like Figure 1 As shown, computing device 301 includes a user interface 302. A user of computing device 301 (e.g., an operator) can interact with computing device 301 through the user interface 302 displayed on a monitor. For example, the user interface 302 can provide (e.g., display and / or present) information to the user of computing device 301 through the monitor, and / or receive information from the user of computing device 301 (e.g., input / selection by the user of the computing device). For example, in some embodiments, the user interface 302 may be a GUI capable of providing information to the user of computing device 301 and / or receiving information from the user of the computing device. The monitor displaying the user interface 302 may be a touchscreen (e.g., the GUI may include touchscreen capabilities), etc.
[0038] The computing device 301 may include one or more cameras 304. The one or more cameras 304 may be used to detect objects and project a structured light array. In some instances, one of the one or more cameras 328 may be used solely for object detection. In various embodiments, one or more optical sensors (e.g., Figure 1The sensors 105 in the mobile device 101 can be used with or in place of one or more cameras to detect a user.
[0039] The computing device 301 can also include an eye tracking sensor, a tracking device, a proximity sensor, a microelectromechanical system (MEMS) gyroscope, or a combination thereof. The combination of these technologies within the computing device 301 can help define a user's product preferences, suggestions for future products. The computing device 301 is capable of detecting a user's movement, proximity to the computing device 301, location, or rate of rotation based on which technology is added to the computing device 301.
[0040] The processing resource 322 can also be configured to execute executable instructions stored in the memory 324 to upload the AR image from the memory of the mobile device to a product website. The AR image can be displayed on a user interface of the computing device, copied from the user interface to other media, or both. Examples of other media can include, but are not limited to, a website, a document, or an email.
[0041] The processing resource 322 can also be configured to execute executable instructions stored in the memory 324 to display a 3D map on the user interface 302. A user of the computing device can interact with the computing device 301 through the user interface 302. The user interface 302 can be generated by the computing device 301. In a number of embodiments, the user interface 202 can be activated in response to detecting a 3D map by the camera 328. The 3D map can be displayed on the user interface 302.
[0042] The processing resource 322 can also be configured to execute executable instructions stored in the memory 324 to capture an image of a user using a camera of the mobile device and use the captured image to construct an additional 3D map. After a 3D map has been created using measurements from the structured light array of the camera 328, the computing device 301 can prompt the user to upload an additional 3D map using an image captured by the user. In this way, the computing device 301 can prompt the user to capture more images, and the user can use the captured images to create additional 3D maps. The 3D maps can then be used to create AR images. The user can select a previously saved 3D map or select to upload a new 3D map.
[0043] The processing resource 322 can also be configured to execute executable instructions stored in the memory 324 to write at least one of the 3D maps or the AR images to memory or discard at least one of the 3D maps or the AR images, or a combination thereof. The user can set a preferred 3D map. The preferred 3D map can be accessible by the computing device 301. For example, the preferred 3D map can be saved on the computing device 301 and / or in external memory. In another example, the user can discard a 3D map and select another 3D map using the structured light array of the camera 328 or an image saved within the memory 324.
[0044] The saved 3D map can be accessed by using a password. The processing resource 322 can also be configured to execute executable instructions stored in the memory 324 to access at least one of the 3D map or the AR image written to the memory using the password. The saved 3D map can be accessed at a later time to create the AR image. The user can use or discard the saved 3D map at the time of access.
[0045] The user can also set a preferred AR image. The preferred AR image can be accessed by the computing device 301. For example, the preferred AR image can be saved on the computing device 301 and / or in an external memory. The saved AR image can be accessed by using a password. The preferred AR image can be accessed at a later time. The user can use or discard the saved AR image at the time of access.
[0046] Figure 4 A flowchart of a method 430 for building an AR image in accordance with a number of embodiments of the present disclosure is shown. The method 430 can be performed by a mobile device or other computing device. For example, the method can be performed using a processing resource, a memory communicatively coupled to the processing resource, or a combination thereof.
[0047] At block 432, the method 430 can include projecting a structured light array from the mobile device onto the object. In some instances, the mobile device can include a structured light array to build a 3D map. A flood illuminator within the mobile device can produce IR illumination, and / or a dot projector within the mobile device can project small dots of IR illumination onto the object to collect measurements of the object. The object can be a person, such as a user of the mobile device or an animal, among others. The IR illuminator can be used to shine light on the object during the building of the 3D map.
[0048] At block 434, the method 430 can include measuring multiple directional cross sections of the object with the projected structured light array. The computing device can be set at a particular distance from the object to measure the object using the structured light array. That is, the dot projector can project small dots of IR illumination as a structured array of light onto the user's body width to collect measurements of the user. For example, the dot projector can project onto the user's face, shoulders, arms, legs, feet, or a combination thereof.
[0049] The acquired measurements can include clothing measurements of the user's body width, such as clothing sizes and measurements (e.g., neck size, sleeve length and width, and waist width, among others). The measurements are not limited to the user's body width, but can also be taken of the user's head or feet. In one instance, the structured light array can be used to measure the width of the user's head. In another instance, the structured light array can be used to measure the width and length of the user's feet.
[0050] At block 436, the method 430 can include reconstructing a 3D map of the object based on the measured multi-directional cross-sections. The measurements received using the structured light array can be used to construct a 3D map of the object. The object can be the user. That is, a 3D map of the user can be constructed based on the information collected by the structured light array within the camera of the computing device.
[0051] In some instances, the 3D map can be created based on pictures accessible to the computing device. The structured light array can also be used to obtain measurements of the user based on scaled measurements of the pictures. That is, the structured light array can be used to measure the user and collect measurements needed for proper fit and function of the product on the user. These measurements can be accessible to the computing device. For example, the measurements can be stored on the mobile device and / or in an external memory.
[0052] At block 438, the method 430 can include displaying an AR image associated with the 3D map on a user interface of the mobile device. The AR image can be derived from the 3D map. AR can overlay a virtual object on a real-world environment to mask a portion of the real-world environment and / or add to the real-world environment such that it is perceived as an immersive aspect of the real-world environment. The AR image can be displayed as a computing device generated image superimposed on a real-world view of the user. The AR image can be viewed by projecting a hologram of the product onto the user. The AR image can also be viewed by projecting a hologram of the 3D map of the user wearing the product. The user can use AR headsets to view the hologram.
[0053] In some instances, the computing device can display and / or automate multiple images and / or augment the AR image to move and / or change on the user interface. For example, the user can rotate the AR image and display the rotation on the user interface. The AR image can be displayed on the user interface of the computing device. The AR image can be generated by projecting a product, such as clothing, on the 3D map. The AR image can be generated by placing the clothing on the head, torso, limbs, feet, or a combination thereof of the 3D map.
[0054] In some instances, the product can be found in an online marketplace. The product can be displayed as a 3D model on the user interface. The product can be scaled down to fit the scale of the 3D map. The retailer can scale down the product such that the product can properly fit the user. The user can select a measured fit of the product that properly fits the user based on the measurements taken by the structured light array of the camera of the computing device. The resulting AR image can be displayed on the user interface of the mobile device. The AR image can be copied from the user interface to other media, such as a website, a document, or an email, among others.
[0055] Figure 5A flowchart of a method 540 for constructing an AR image in accordance with a number of embodiments of the present disclosure. The method 540 can be performed by a mobile device or other computing device. For example, the method can be performed using a processing resource, a memory communicatively coupled to the processing resource, or a combination thereof.
[0056] At block 542, the method 430 can include projecting a structured light array from the mobile device onto the user using an infrared (IR) illuminator and visible light. The computing device can include a flood illuminator within the computing device to construct a 3D map. The IR illuminator can be used in conjunction with the visible light to project the structured light array onto the user. A point projector within the computing device can project small dots of IR illumination onto the user to collect measurements of the user. For example, the point projector can project onto the user's face, shoulders, arms, legs, feet, or a combination thereof.
[0057] At block 544, the method 540 can include measuring a number of dimensions of the user based on data collected from the projected light. The multi-directional measurements can include a height and weight of the user, among others. The mobile device can be set at a particular distance from the user to measure a body width of the user. That is, the point projector can project small dots of IR illumination as a structured light array onto the user to collect measurements of the user.
[0058] The measurements taken can include clothing measurements of the user's body width, such as clothing sizes and measurements (e.g., neck size, sleeve length and width, and waist width, among others). The measurements are not limited to the user's body width, but can also take measurements of the user's head or feet. In one example, the structured light array can be used to measure a width of the user's head. In another example, the structured light array can be used to measure a width and length of the user's feet.
[0059] At block 546, the method 540 can include reconstructing a 3D map of the user using the measured number of dimensions. The measurements received using the structured light array can be used to construct a 3D map of the user. That is, a 3D map of the user can be constructed based on information collected by the structured light array.
[0060] At block 548, the method 540 can include projecting an AR image associated with the 3D map from the mobile device as a hologram onto the user. The AR image can be derived from the 3D map. AR can overlay virtual objects on a real-world environment to mask a portion of the real-world environment and / or add to the real-world environment such that it is perceived as an immersive aspect of the real-world environment.
[0061] The AR image can be projected on a user interface of a computing device. The AR image can be generated by placing a product such as a garment on a 3D figure. The AR image can be generated by placing a garment on a head, torso, limb, or foot of a 3D figure. The AR image can be displayed as a computing device generated image superimposed on a user's real world view. The AR image can be viewed by projecting a hologram of the product onto the user. The AR image can also be viewed by projecting a hologram of a 3D figure of the user wearing the product. The user can view the hologram using AR glasses.
[0062] After receiving the AR image, the user can choose to use or discard the received AR image. For example, the user can set a preferred AR image. The user can also save the preferred AR image. The preferred AR image can be accessible by the mobile device. For example, the preferred AR image can be saved on the mobile device and / or an external memory. The saved AR image can be accessed by using a password. The preferred AR image can be accessed at a later time.
[0063] In some instances, the mobile device can display and / or automate multiple images and / or augment the AR image to move and / or change on the user interface. For example, the user can rotate the AR image and display the rotation on the user interface.
[0064] In the above detailed description of the disclosure, reference is made to the accompanying drawings, which form a part hereof, and in which are shown by way of illustration one or more examples in which the disclosure can be practiced. These examples are described in sufficient detail to enable those skilled in the art to practice the examples of the disclosure, and it is to be understood that other examples can be utilized and that process, electrical, and / or structural changes can be made without departing from the scope of the present disclosure.
[0065] It should be understood that the terms used herein are for the purpose of describing particular examples and are not intended to be limiting. As used herein, the singular forms "a," "an," and "the" include singular and plural referents, unless the context clearly dictates otherwise, as in "multiple," "at least one," and "one or more" (e.g., a plurality of memory arrays can refer to one or more memory arrays), while the term "plurality" is intended to refer to more than one of such things. Further, the words "can" and "may" are used throughout this application in a permissive sense (i.e., having the potential to, being able to), not in a mandatory sense (i.e., must). The term "include," and derivations thereof, means "including, but not limited to." The terms "coupled" and "coupling" mean to be directly or indirectly connected physically and, unless otherwise indicated, can include wireless connectivity for accessing and / or moving (transferring) instructions (e.g., control signals, address signals, etc.) and data, as appropriate, depending on the context.
[0066] While specific embodiments have been shown and described in the foregoing detailed description, it will be understood by those skilled in the art that other alternatives to the specific embodiments can be used to implement the same or similar results. The disclosure is intended to cover all modifications or variations of one or more embodiments of the disclosure. It should be appreciated that the above description is an illustrative and not restrictive manner. Combinations of the above embodiments, and other embodiments not specifically described herein, will be apparent to those of ordinary skill in the art upon reading the above description. The scope of the one or more embodiments of the disclosure includes other applications that can use the structures and methods described above. The scope of the one or more embodiments of the disclosure should therefore be determined not with reference to the above description, but instead with reference to the appended claims, along with their full scope of equivalents.
[0067] In the foregoing DETAILED DESCRIPTION, some features are grouped together in a single embodiment for the purpose of streamlining the disclosure. This disclosure is not to be interpreted in the manner contravening the common sense to the art. Rather, the inventive subject matter is defined with respect to at least one of the embodiments illustrated in the claims that follow. Accordingly, the following claims are hereby incorporated into the DETAILED DESCRIPTION, with each claim standing on its own as a separate embodiment.
Claims
1. A method (430) for constructing an augmented reality image, comprising: accessing a captured image of an object (432) from a mobile device (101, 301); measuring a multi-directional cross section (434) of the object with a projected light (105) using the captured image; reconstructing a three-dimensional (3D) map (207) of the object (436) based on the measured multi-directional cross section; displaying an augmented reality (AR) image associated with the 3D map (207) as a hologram projected onto a user; and rotating and moving the projected AR image in response to user interaction with a user interface of the mobile device.
2. The method (430) of claim 1, further comprising copying the AR image to a website, a different mobile device, or both.
3. The method (430) of claim 1, further comprising placing a product on the 3D map and displaying the result on the user interface of the mobile device.
4. The method (430) of claim 3, further comprising projecting the product as an AR image on the 3D map.
5. The method (430) of claim 3, further comprising: receiving a 3D model of a product from a user (103) at the mobile device; and placing the product on the 3D map of the object.
6. The method (430) of any of claims 1-5, further comprising displaying the AR image as a computing device generated image superimposed on a real world view of a user (103).
7. The method (540) of any one of claims 1-5, wherein, Measuring the multi-directional cross section of the object comprises measuring a height of a user, a clothing size of the user, a body width of the user, a width and length of a foot of the user, or any combination thereof.
8. The method (540) of any of claims 1-5, further comprising viewing the AR image using a headset.
9. The method (540) of any of claims 1-5, further comprising viewing the AR image using a heads-up display.
10. The method (540) of any of claims 1-5, further comprising rotating the AR image and displaying the rotation on a user through a user interface.
11. The method (540) of any of claims 1-5, further comprising writing a preferred AR image of a user to a memory of the mobile device.
12. The method (540) of any of claims 1-5, further comprising viewing the AR image using a laser.
13. An apparatus (301) for constructing an augmented reality image, comprising: a user interface (102, 202, 302) of a mobile device (101, 301); a camera (104, 304) of the mobile device (101, 301); a memory (324) of the mobile device (101, 301); and a processing resource (322) configured to execute executable instructions stored in the memory to: projecting a structured light array (105) from a camera (104, 304) of the mobile device (101, 301) onto a captured image of a user (103); measuring a multi-directional cross section of the user (103) based on data collected from the projected light (105) using the captured image; reconstructing a three-dimensional, 3D, map (207) of the user (103) based on the measured multi-directional cross section; displaying an augmented reality, AR, image of the user associated with the 3D map (207) as a hologram projected onto the user; and rotating and moving the projected AR image in response to user interaction with the user interface of the mobile device.
14. The apparatus (301) of claim 13, further comprising an eye tracking sensor, a tracking device, a proximity sensor, a MEMS gyroscope, or a combination thereof.
15. The apparatus (301) of claim 13, further comprising executable instructions to upload the AR image from the memory (324) of the mobile device (101, 301) to a product website.
16. The apparatus (301) of any of claims 13 to 15, further comprising executable instructions to: capture an image of the user (103) using the camera (104, 304) of the mobile device (101, 301); construct an additional 3D map using the captured image; and select a 3D map as the AR image to display.
17. The apparatus (301) of any of claims 13 to 15, further comprising executable instructions to write at least one of the 3D map or the AR image to the memory, discard at least one of the 3D map or the AR image, or a combination thereof.
18. The apparatus (301) of claim 17, further comprising executable instructions to access at least one of the 3D map or the AR image written to the memory using a password.
Citation Information
Patent Citations
Devices, systems and methods of capturing and displaying appearances
US20130229482A1