System and method for providing virtual facilities

Abstract

A system for use by a user to provide a virtual facility includes a handheld scanning device operated by the user to scan a real-world item to capture item data characterizing one or more physical features of the real-world item. A modeling processor receives the item data and generates a three-dimensional model of the real-world item from the item data. A game engine receives the three-dimensional model of the real-world item to generate a virtual facility including virtual items based on the three-dimensional model of the real-world item. An information database stores item information related to the real-world item and correlated with the virtual item. A customer device is operated by a customer to visit the virtual facility and perform actions based on the item information. Related methods are also provided.

Description

[Technical Field]

[0001] The present invention relates to a system for providing a virtual facility. Although the invention is described herein with reference to a system for providing a virtual facility in the form of a virtual store accessible to customers over the Internet, the invention is not limited to this particular application. [Background technology]

[0002] Owners and operators of real-world establishments such as shops, points of interest, places of cultural significance, tourist destinations, etc., would benefit from offering online offerings in the form of typical e-commerce platforms.

[0003] Online offerings provide an alternative for customers when it is impractical or inconvenient for them to physically visit a real-world facility. Online offerings also provide an additional channel through which an owner or operator can market goods or services. The online offerings can, in turn, encourage customers to physically visit the real-world facility. Similarly, customers who visit the real-world facility can also be encouraged to visit the online offering. This cross-marketing effect of driving customers from one to the other can increase overall customer numbers and revenue for the owner or operator.

[0004] Physical facilities are costly and capital-intensive endeavors. This limits the scope for establishing such facilities in terms of number and location. Stocking products in physical facilities is costly and inefficient, especially with rapid changes in product lines and / or different product lines at different locations. Online offerings offer flexibility in this regard.

[0005] Online offerings range from basic e-commerce portals to feature-rich website experiences that closely mimic the real-world experience gained by physically visiting a real-world establishment, strengthening the connection with the real-world establishment and enhancing the cross-marketing benefits mentioned above.

[0006] The quality of the online offering and experience is typically limited by the owner's or operator's marketing budget and the amount of time the owner or operator can devote to developing the online offering. Technological limitations, such as limited hardware, software, and network capabilities, are also factors. Higher quality online offerings typically require greater investment of time and money to acquire the technology necessary to deliver such online offerings.

[0007] It is an object of the present invention to overcome or ameliorate at least one of the disadvantages of the prior art, or to provide a useful alternative. Summary of the Invention

[0008] A first aspect of an embodiment of the present invention provides a system for use by a user to provide a virtual facility, said system comprising: a handheld scanning device operated by the user to scan a real-world item to capture item data characterizing one or more physical features of the real-world item; a modeling processor that receives the item data and generates a three-dimensional model of the real-world item from the item data; a game engine that receives the three-dimensional models of the real-world items to generate a virtual facility including virtual items based on the three-dimensional models of the real-world items; an information database that stores item information related to the real-world item and correlated with the virtual item; and a customer device operated by a customer to visit the virtual facility and perform an action based on the item information.

[0009] A second aspect of an embodiment of the present invention provides a method for a user to provide a virtual facility, the method comprising: the user scanning a real-world item with a handheld scanning device to capture item data characterizing one or more physical features of the real-world item; generating a three-dimensional model of the real-world item from the item data; generating a virtual facility including virtual items based on the three-dimensional models of the real-world items; storing item information related to the real-world item and correlated with the virtual item; and executing an action based on the item information in response to an instruction from a customer visiting the virtual facility.

[0010] A third aspect of an embodiment of the present invention provides a non-transitory computer-readable medium storing a program for a user to provide a virtual facility, the program comprising: receiving item data characterizing one or more physical features of a real-world item captured by the user scanning the real-world item with a handheld scanning device; generating a three-dimensional model of the real-world item from the item data; generating a virtual facility including virtual items based on the three-dimensional models of the real-world items; storing item information related to the real-world item and correlated with the virtual item; and performing an action based on the item information in response to an instruction from a customer visiting the virtual facility.

[0011] Other features and embodiments of the invention are set forth in the accompanying claims.

[0012] Throughout this specification, including the claims, the terms "including," "comprising," and the like, are to be construed in their inclusive sense, i.e., "including but not limited to," rather than in their exclusive or exhaustive sense, unless expressly stated otherwise or unless the context clearly requires otherwise. [Brief explanation of the drawings]

[0013] Preferred embodiments in accordance with the best mode of the present invention will now be described, by way of example only, with reference to the accompanying drawings, in which like reference numerals refer to like parts throughout the drawings unless otherwise specified, and in which:

[0014] [Figure 1] FIG. 1 is a flow diagram illustrating features of a system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a flow diagram of a further aspect of a system according to an embodiment of the present invention. [Figure 3] FIG. 3 is a flow diagram of another aspect of a system according to an embodiment of the present invention. [Figure 4] FIG. 4 is a screen capture of a customer view of a virtual store according to an embodiment of the present invention. [Figure 5] FIG. 5 is a screen capture of a customer's view of a virtual item selected by a customer in a virtual store according to an embodiment of the present invention. [Figure 6] FIG. 6 is a screen capture of a customer view of another virtual item selected by a customer in a virtual store according to an embodiment of the present invention. [Figure 7] FIG. 7 is a screen capture of a customer view of a virtual store according to an embodiment of the present invention. [Figure 8] FIG. 8 is a screen capture of a customer view of a virtual store according to an embodiment of the present invention. [Figure 9]FIG. 9 is a screen capture of a customer's view of a virtual item selected by the customer in a virtual store according to an embodiment of the present invention. [Figure 10] FIG. 10 is a screen capture of a user view of a virtual facility during selection of virtual components to create the virtual facility according to an embodiment of the present invention. [Figure 11] FIG. 11 is a screen capture of a user's view of the virtual facility of FIG. 10 while placing a virtual component within the virtual facility according to an embodiment of the present invention. [Figure 12] FIG. 12 is a screen capture of a customer view of a virtual building according to an embodiment of the present invention. [Figure 13] FIG. 13 is a screen capture of a customer view of a virtual streetscape according to an embodiment of the present invention. [Figure 14] FIG. 14 is a screen capture of a customer view of another virtual streetscape according to an embodiment of the present invention. [Figure 15] FIG. 15 is a screen capture of yet another virtual streetscape customer view according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0015] Referring to the figure, a system 1 is provided for use by a user to provide a virtual facility 2. The system 1 includes a handheld scanning device 14 operated by the user to scan real-world items 3 to capture item data characterizing one or more physical features of the real-world items. A modeling processor 4 receives the item data and generates a three-dimensional model 5 of the real-world items from the item data. A game engine 6 receives the three-dimensional model 5 of the real-world items to generate a virtual facility 2 including virtual items 7 based on the three-dimensional model 5 of the real-world items. An information database stores item information 13 related to the real-world items and correlated with the virtual items 7. A customer device 15 is operated by the customer to visit the virtual facility 2 and perform actions based on the item information 13.

[0016] An advantage of system 1 is that a user, such as an owner or operator of a real-world facility, does not need any specialized knowledge, equipment, hardware, or software to provide virtual facility 2. The user only needs handheld scanning device 14, which can be a camera or a lidar device in the user's smartphone. Modeling processor 4 can be located remotely from the user's handheld scanning device and accessible through an application on the handheld scanning device or a smartphone that includes the handheld scanning device. Game engine 6 can be located remotely from the user's handheld scanning device and accessible through an application on the handheld scanning device or a smartphone that includes the handheld scanning device. The information database can also be located remotely from the user's handheld scanning device and accessible through an application on the handheld scanning device or a smartphone that includes the handheld scanning device. One or more of modeling processor 4, game engine 6, and information database can be located on one or more servers that are remotely accessible by the application on the handheld scanning device or a smartphone that includes the handheld scanning device.

[0017] The customer device 15 may be a smartphone operated by a customer. The customer may visit the virtual facility 2 through an application on the customer device 15. In particular, the application on the customer device 15 may connect to the game engine 6 so that the customer may perform actions such as navigating through the virtual facility 2, selecting virtual items 7, or purchasing virtual items 7. The game engine 6 is typically located on a remote server accessible by the application on the customer device 15.

[0018] The purchase of the virtual item 7 is made based on item information 13, such as price, availability, and / or manufacturing location of the real-world item 3, which correlates with the virtual item on the information database, to trigger a real-world purchase of the real-world item based on the virtual item 7. The application on the customer device 15 may include e-commerce functionality to facilitate the purchase of the real-world item triggered by the purchase of the virtual item 7 at the virtual facility 2.

[0019] In the above-described embodiment, the real-world item 3 is a commodity, and the item information 13 enables the customer to purchase the commodity. However, the virtual facility may also be a tourist attraction or cultural facility, such as a museum or art gallery, and the real-world item 3 may be, for example, a real-world artifact exhibited in a real-world museum. In these cases, the item information 13 may relate to one or more of a description, origin, and history. For example, an action performed by a customer may be to select a virtual item 7 in the form of an artifact exhibited in a virtual museum and review information regarding the origin and / or history of the artifact and / or a description of the artifact.

[0020] The handheld scanning device 14 may be operated by a user to scan real-world components 8 of a real-world facility to capture component data characterizing one or more physical features of the real-world components. The modeling processor 4 receives the component data and generates a three-dimensional model 5 of the real-world components from the component data. The game engine 6 receives the three-dimensional model 5 of the real-world components to generate a virtual facility 2 including virtual components 9 based on the three-dimensional model 5 of the real-world components.

[0021] The item or component data captured by a scan can be data relating to the size, shape, texture, color, or other physical characteristics of a real-world item or component characterized and captured by a handheld scanning device.

[0022] Thus, in a process similar to scanning real-world items as described above, a user can also scan real-world components, such as one or more of structural components, fixtures, and furniture, thereby enabling a user to build and customize a virtual facility with virtual components that correspond to the real-world components, thus allowing a user to mimic a real-world facility to varying degrees.

[0023] The system 1 may include a component database 10 for storing one or more pre-loaded virtual components. A user device may be operated by a user to select one or more pre-loaded virtual components. The game engine 6 may then generate a virtual facility having the selected virtual components. This may be an alternative to the user having to scan real-world components to generate virtual components to augment the virtual facility.

[0024] The component database 10 may also store virtual components 9 that are based on previously generated three-dimensional models based on component data captured from previous scans of real-world components 8 by a user.

[0025] The game engine 6 can also receive a lighting model 16 to generate the virtual venue 2 with real-world lighting effects. Lighting effects, particularly those faithfully recreating real-world lighting effects, can require significant processor resources. Calculating lighting effects includes, among other things, data about light source parameters and the properties of materials on which light falls. The calculations include calculating how light reflects and interacts with the surroundings. These calculations are performed dynamically, meaning they take into account the movement of the sun and the resulting movement of light and shadow. However, such calculations typically require very powerful processors, typically beyond the capabilities of processors in handheld devices such as smartphones. To remedy this, lighting effects can be pre-calculated remotely and then sent back to the handheld device; this process is called "static baking." However, even this "static baking" process is too demanding for handheld devices.

[0026] Thus, in one embodiment, the lighting model 16 is generated by a remote lighting processor 17 based on virtual facility data characterizing the virtual facility, which is then transmitted to the remote lighting processor, which, once computed, transmits the lighting model to the game engine. The remote lighting processor may be located on a much more powerful server.

[0027] Game engine 6 also receives live or pre-recorded audio to generate the virtual venue with real-world audio effects. Live audio is captured by microphones installed in the real-world venue and then streamed to game engine 6. Pre-recorded audio is captured by microphones during user audio exploration and then uploaded to game engine 6 and synchronized with customer actions or navigation within the virtual venue.

[0028] The above can be combined to provide virtual facilities 2 that mimic corresponding real-world items or facilities with varying degrees of realism. One advantage is that the 3D models generated by system 1 can provide virtual items and / or facilities with photorealistic quality. Furthermore, the 3D models generated by system 1 can provide virtual items and / or facilities that mimic specific real-world items and / or specific real-world facilities selected by the user. This provides an online offering and customer experience that closely mimics the real-world experience that would be obtained by physically visiting the real-world facility, thus resulting in a stronger connection with the real-world facility and should significantly enhance the cross-marketing effects mentioned above.

[0029] The virtual facility can form part of a virtual environment. The virtual environment can be comprised of one or more of buildings 11, streetscapes 12, neighborhoods, and cities. With respect to the virtual facility 2 described above, a user can scan real-world components of a real-world environment to enable the game engine 6 to generate the virtual environment. The virtual environment may be generated to mimic a particular real-world environment, including lighting and audio effects. Such a virtual environment further enhances the cross-marketing effect described above. For example, a customer can visit a virtual city that mimics a real-world city and view virtual facilities that form part of that virtual city.

[0030] For owners or operators of real-world facilities, system 1 can provide virtual facilities that have the same look and feel as the real-world facility. Such virtual facilities can even be co-located within a virtual environment, such as a virtual city that mimics the real-world city in which the real-world facility is actually located. Alternatively or additionally, a virtual facility that mimics a real-world facility can be located in another real-world city in which the real-world facility is actually located. This allows the owner or operator to provide customers with the experience of visiting a real-world facility in another city in which the real-world facility is actually located. This can be a way for the owner or operator to test the feasibility or popularity of a real-world facility in a location different from its actual real-world location before incurring the expense of actually establishing a real-world facility in that other location.

[0031] The virtual facility can include a virtual portal that, when selected by a customer, transports the customer to a second virtual facility. The virtual portal can be in the form of advertising related to the second virtual facility. The customer can be represented as an avatar within the virtual facility or environment to enhance the customer's experience. Alternatively, the customer can navigate within the virtual facility from a viewport perspective that corresponds to the customer's line of sight.

[0032] In another aspect, the present invention also provides a method for a user to provide a virtual facility. In one embodiment, the method comprises: said user scanning said real-world item 3 with a handheld scanning device to capture item data characterizing one or more physical features of said real-world item; generating a three-dimensional model (5) of the real-world item from the item data; generating a virtual facility (2) including virtual items (7) based on the three-dimensional models (5) of the real-world items; storing item information related to the real-world item and correlated with the virtual item; and executing an action based on the item information in response to an instruction from a customer visiting the virtual facility (2).

[0033] In another aspect, the present invention provides a non-transitory computer readable medium storing a program for a user to provide a virtual facility. In one embodiment, the program comprises: receiving item data characterizing one or more physical features of the real-world item 3 captured by the user scanning the real-world item with a handheld scanning device; generating a three-dimensional model (5) of the real-world item from the item data; generating a virtual facility (2) including virtual items based on the three-dimensional model (5) of the real-world items; storing item information related to the real-world item and correlated with the virtual item; and performing an action based on the item information in response to an instruction from a customer visiting the virtual facility.

[0034] The program may be in the form of a downloadable application that can be purchased from an application store.

[0035] It is understood that the above-described embodiments are merely exemplary embodiments adopted to explain the principles of the present invention, and that the present invention is not limited thereto. Those skilled in the art can make various changes and modifications without departing from the spirit and essence of the present invention, and these changes and modifications are also included within the scope of the present invention. Thus, although the present invention has been described with reference to specific examples, those skilled in the art will understand that the present invention can be embodied in many other forms. It will also be understood that those skilled in the art can combine features of the various examples described in other combinations.

Claims

1. 1. A system for use by a user to provide a virtual venue, comprising: a handheld scanning device operated by the user to scan a real-world item to capture item data characterizing one or more physical features of the real-world item; a modeling processor that receives the item data and generates a three-dimensional model of the real-world item from the item data; a game engine that receives the three-dimensional model of the real-world item to generate a virtual facility including the virtual item based on the three-dimensional model of the real-world item; an information database that stores item information related to the real-world item and correlated with the virtual item; a customer device operated by a customer to visit the virtual facility and perform an action based on the item information; A system comprising:

2. The system of claim 1 , wherein the real-world item is a commodity, and the item information enables the customer to purchase the commodity.

3. The system of claim 1 or claim 2, wherein the item information relates to one or more of price, place of manufacture, availability, description, origin, and history.

4. the handheld scanning device is operated by the user to scan a real-world component in a real-world facility to capture component data characterizing one or more physical features of the real-world component; the modeling processor receives the component data and generates a three-dimensional model of the real-world component from the component data; the game engine receives the three-dimensional model of the real-world components to generate the virtual facility including virtual components based on the three-dimensional model of the real-world components; A system according to any one of claims 1 to 3.

5. a component database for storing one or more pre-loaded virtual components; a user device operated by the user to select one or more of the pre-loaded virtual components; a game engine for generating the virtual facility having the selected virtual components; The system according to any one of claims 1 to 4, comprising:

6. The system of claim 4 or claim 5, wherein the component is one or more of a structural component, an attachment, and a fixture.

7. The system of claim 1 , wherein the game engine receives a lighting model for generating the virtual facility with real-world lighting effects.

8. 8. The system of claim 7, wherein the lighting model is generated by a remote lighting processor based on virtual facility data characterizing the virtual facility, the virtual facility data being transmitted to the remote lighting processor, and the remote lighting processor transmitting the lighting model to the game engine.

9. 9. The system of claim 1, wherein the game engine receives live or pre-recorded audio to generate the virtual venue with the real-world audio effects.

10. The system of claim 1 , wherein the handheld scanning device comprises one or more of a camera and a lidar device.

11. The system of claim 1 , wherein the virtual facility forms part of a virtual environment.

12. The system of claim 11 , wherein the virtual environment includes one or more of a building, a streetscape, a neighborhood, and a city.

13. The system of claim 1 , wherein the three-dimensional model or the virtual facility is photorealistic.

14. The system of claim 1 , wherein the three-dimensional model mimics the real-world item or the virtual facility mimics a real-world facility.

15. 15. The system of claim 1, wherein the virtual facility includes a virtual portal, and when the customer selects the virtual portal, the customer is transferred to a second virtual facility.

16. 16. The system of claim 15, wherein the virtual portal is in the form of an advertisement related to the second virtual establishment.

17. 1. A method for a user to provide a virtual facility, comprising: the user scanning a real-world item with a handheld scanning device to capture item data characterizing one or more physical features of the real-world item; generating a three-dimensional model of the real-world item from the item data; generating a virtual facility including virtual items based on the three-dimensional models of the real-world items; storing item information related to the real-world item and correlated with the virtual item; and performing an action based on the item information in response to an instruction from a customer visiting the virtual facility.

18. A non-transitory computer-readable medium storing a program for a user to provide a virtual facility, the program comprising: receiving item data characterizing one or more physical features of a real-world item captured by the user scanning the real-world item with a handheld scanning device; generating a three-dimensional model of the real-world item from the item data; generating a virtual facility including virtual items based on the three-dimensional models of the real-world items; storing item information related to the real-world item and correlated with the virtual item; and performing an action based on the item information in response to instructions from customers visiting the virtual facility.

Images