System and method for virtual feature development
By adjusting the appearance of virtual features within a simulated real-world setting using an AR lightbox system, the problem of virtual features being difficult to adapt to real-world lighting conditions in existing technologies is solved, achieving efficient development and realism of AR features simultaneously.
Patent Information
- Application Number
- CN202080046471.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-06-22
- Filing Date
- 2020-06-24
- Publication Date
- 2025-11-28
- Estimated Expiration
- 2040-06-24
AI Technical Summary
When developing virtual features for augmented reality experiences, existing technologies struggle to effectively adjust the appearance of virtual features to adapt to different lighting conditions in the real world, making the development process tedious and time-consuming.
An AR lightbox system is used to evaluate the appearance of virtual features in a simulated real-world setting, including physical lights and controllers. The parameters of the virtual features and physical lights are dynamically adjusted to synchronize with real-world lighting conditions, thereby achieving the realism of the virtual features.
It improves the efficiency of evaluating the realism of virtual features under different lighting conditions, promotes the development of AR features and the optimization of rendering algorithms, and reduces development time and cost.
Smart Images

Figure CN113993601B_ABST
Abstract
Description
[0001] Cross Reference to Related Applications
[0002] This application claims priority to and the benefit of U.S. Provisional Application No. 62 / 866,481, filed June 25, 2019, entitled “SYSTEMS AND METHODS FOR VIRTUAL FEATURE DEVELOPMENT,” which is hereby incorporated by reference in its entirety for all purposes. BACKGROUND
[0003] Amusement parks and / or theme parks can include a variety of entertainment attractions, restaurants, and rides that can be useful in providing enjoyment to customers of the amusement park, e.g., families and / or people of all ages. Areas of the amusement park can have different themes that specifically target certain audiences. For example, certain areas can include themes that are traditionally of interest to children, while other areas can include themes that are traditionally of interest to more mature audiences. Generally speaking, locations having themes associated with such amusement parks can be referred to as attractions or themed attractions. It is recognized that it can be desirable to enhance the immersive experience of customers for such attractions by augmenting the theme with virtual features. Unfortunately, developing virtual features for various amusement park attractions can prove difficult and time consuming. SUMMARY
[0004] A summary of certain embodiments disclosed herein is set forth below. It should be understood that these aspects are presented merely to provide the reader with a brief summary of these certain embodiments and that
[0005] In one embodiment, a system for evaluation of an augmented reality (AR) experience provided to a user includes a background screen, a physical light configured to project light onto the background screen, and a display system. The display system is configured to display a virtual feature to enable the user to view the virtual feature as overlaid onto the background screen. The system also includes a controller communicatively coupled to the display system and to the physical light. The controller is configured to render the virtual feature within a virtual space, receive feedback indicative of an operating parameter of the physical light, and receive additional feedback indicative of a state of a virtual light, wherein the state of the virtual light defines an appearance of the virtual feature. The controller is further configured to adjust the appearance of the virtual feature to an updated appearance based on the feedback indicative of the operating parameter of the physical light, adjust the operating parameter of the physical light based on the additional feedback indicative of the state of the virtual light, or both.
[0006] In one embodiment, a method for evaluating an augmented reality (AR) experience provided to a user includes overlaying, via a display system, a virtual feature onto a background scene to enable a user to view the virtual feature overlaid onto the background scene. The method also includes receiving, from a sensor, feedback indicative of an operating parameter of a physical light configured to illuminate the background scene and receiving, at a controller, additional feedback indicative of a state of a virtual light, wherein the state of the virtual light defines an appearance of the virtual feature. The method further includes adjusting, via the controller, the appearance of the virtual feature to an updated appearance based on the feedback indicative of the operating parameter of the physical light, adjusting the operating parameter of the physical light based on the additional feedback indicative of the state of the virtual light, or both.
[0007] In one embodiment, an augmented reality (AR) system includes a display system configured to overlay a virtual feature onto an environment viewable by a user, a physical light configured to illuminate the environment, and a controller communicatively coupled to the display system and the physical light. The controller is configured to render the virtual feature within a virtual space having a virtual light, wherein a state of the virtual light defines an appearance of the virtual feature. The controller is also configured to adjust the state of the virtual light based on feedback indicative of an operating parameter of the physical light and to adjust the operating parameter of the physical light based on additional feedback indicative of the state of the virtual light.
[0008] Various modifications of the features noted above can be implemented with respect to the various aspects of the present disclosure. Additional features can likewise be incorporated into these various aspects. These modifications and additional features can exist individually or in any combination. BRIEF DESCRIPTION OF DRAWINGS
[0009] These and other features, aspects, and advantages of the present disclosure will become better understood when the following detailed description is read, with reference to the accompanying drawings, in which like characters represent like parts throughout the drawings, wherein:
[0010] Figure 1 is a block diagram of an embodiment of an augmented reality (AR) system that can be utilized to overlay virtual features onto real-world environments in accordance with the present embodiments;
[0011] Figure 2 is an illustration of an embodiment of a head-mounted display that can be used in an AR system in accordance with the present embodiments; and
[0012] Figure 3 is an illustration of an embodiment of an augmented reality (AR) lightbox system that can be used in an AR system in accordance with the present embodiments. DETAILED DESCRIPTION
[0013] One or more specific embodiments will be described below. In an effort to provide a concise description of these embodiments, not all features of an actual implementation are described in the specification. It should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which can vary from one implementation to another. Moreover, it should be appreciated that such a development effort might be complex and time consuming, but would nevertheless be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill having the benefit of this disclosure.
[0014] When introducing elements of various embodiments of the present disclosure, the articles "a," "an," and "the" are intended to mean that there are one or more of the elements. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there can be additional elements other than the listed elements. Additionally, it should be understood that references to "one embodiment" or "an embodiment" of the present disclosure are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate those features.
[0015] An amusement park can include an augmented reality (AR) system configured to personalize a guest experience of an amusement park attraction or otherwise enhance a guest experience of an amusement park attraction by providing an AR experience to a guest. Indeed, a combination of certain hardware configurations, software configurations (e.g., algorithmic structures and / or modeled responses), and certain attraction features can be utilized to provide a guest with an AR experience that can be customizable, personalized, and interactive.
[0016] For example, a viewing device, such as a head-mounted display (e.g., electronic eyewear or display, glasses), can be configured to enable an amusement park guest or other user to view an AR and / or mixed reality scene. In particular, a head-mounted display can be utilized to enhance a guest experience by, for example, virtually adding or overlaying features in a real-world environment associated with an amusement park, provide an adjustable virtual environment for different experiences in the same amusement park ride, and so forth. Unfortunately, it can be difficult to predict a perceived realism of certain AR features in various real-world environments of an amusement park. In particular, it can be tedious or otherwise time consuming for a developer (e.g., a design engineer developing an AR feature) to evaluate whether an AR system effectively adjusts an appearance (e.g., shading, coloring) of an AR feature based on certain lighting conditions of a real-world environment.
[0017] Accordingly, embodiments of the present disclosure relate to a virtual object simulation system, referred to herein as an AR lightbox system, that enables developers to evaluate the appearance of particular AR features in a variety of simulated real-world settings and across a wide variety of different lighting conditions. In particular, the AR lightbox system enables developers to evaluate whether an AR system configured to generate and overlay AR features onto a real-world environment (e.g., via a head-mounted display) effectively adjusts the appearance of the AR features based on changes in aspects of various lighting conditions of the real-world environment. As such, the AR lightbox system can facilitate the development of AR features that appear to be based on a real-world environment and can facilitate the development of algorithms for overlaying such AR features onto a real-world environment, such as the theme of an amusement park attraction.
[0018] With the foregoing in mind, Figure 1 is a block diagram of an embodiment of an augmented reality (AR) system 10 configured to enable a user (e.g., a guest, an amusement park employee, a passenger of a ride vehicle) to experience (e.g., view, interact with) a controlled AR and / or mixed reality scene. In some embodiments, the AR system 10 can include a communication network 14 (e.g., a wired and / or wireless communication network, such as a wireless local area network [WLAN], a wireless wide area network [WWAN], and near field communication [NFC]), a controller 16, and one or more user systems 18 (e.g., gaming systems). The communication network 14 can include wired or wireless communication components that communicatively couple the controller 16, the one or more user systems 18, and / or any other suitable components of the AR system 10 to one another.
[0019] Controller 16 can be a programmable logic controller (PLC) or other suitable control device. Controller 16 can include a processor 20 (e.g., a general purpose processor, a system on a chip [SoC] device, an application specific integrated circuit [ASIC], or some other similar processor configuration) operatively coupled to a memory 22 (e.g., a tangible, non-transitory computer readable medium and / or other storage device) to execute instructions stored in memory 22. One or more user systems 18 can be central processing units (CPUs) or other suitable systems. As discussed below, controller 16 and one or more user systems 18 can generally be configured to render virtual or augmented graphics for overlay onto a real world environment view. One or more user systems 18 can also be responsible for certain game logic and for placement of certain virtual objects in real space. In certain embodiments, one or more user systems 18 can be communicatively coupled to each other, thereby enabling multiple users to participate in a shared game (e.g., a game with multiple players). In some embodiments, each of one or more user systems 18 can include a user input device 26 (e.g., a user interface) or a group of multiple user input devices 26 and a computer graphics generation system 28. User input device 26 can be communicatively coupled to computer graphics generation system 28, and computer graphics generation system 28 can be communicatively coupled to a display system 29 (e.g., via communication network 14).
[0020] As discussed herein, in some embodiments, display system 29 can include a head mounted display (HMD) 30 configured to be worn by a user of AR system 10 and configured to overlay AR features onto a real world environment perceived by the user. Thus, HMD 30 can enable a user to visualize and perceive a surreal environment 32 (e.g., a game environment) that can include an AR experience, a mixed reality experience, a computer-mediated reality experience, a combination thereof, or other similar surreal environment. That is, surreal environment 32 can include real world views and objects that can be augmented (e.g., overlaid) with AR features. In some embodiments, a user can wear HMD 30 during a duration of a ride (e.g., an amusement park ride) or during another predetermined point, such as during a game, at an entrance to a particular area of an amusement park, during a ride to a hotel associated with an amusement park, at the hotel, and the like.
[0021] The computer graphics generation system 28 can generate and transmit AR graphics to be displayed on the head-mounted displays 30. In particular, the computer graphics generation system 28 includes processing circuitry, such as a processor 34 (e.g., a general purpose processor or other processor) and a memory 36, and can process data useful in generating aspects of the surreal environment 32 for the user. Data useful in generating aspects of the surreal environment 32 can include, but is not limited to, real-time data received from the respective head-mounted displays 30, the user input device(s) 26, the controller 16, various sensor data received by the user system(s) 18, and data stored in the memory 36. In some embodiments, the computer graphics generation system 28 can use such data to generate a frame of reference to coordinate AR features presented by the head-mounted displays 30 with the real-world environment surrounding the user.
[0022] For example, the computer graphics generation system 28 can selectively generate AR graphics to display on the head-mounted displays 30 to reflect changes in the user's orientation, position, gaze direction, field of view, motion, and the like. The computer graphics generation system 28 can also selectively generate AR graphics to reflect changes in the input provided by the user(s) using the user input device(s) 26. In addition, the computer graphics generation system 28 can generate AR graphics based on simulated interactions that can cause AR features to be affected according to certain predetermined or modeled algorithms stored by the computer graphics generation system 28 (e.g., in the memory 36). As an example, the predetermined or modeled algorithms can be implemented by a physics engine or similar module or as part of the computer graphics generation system 28. In certain embodiments, the computer graphics generation system 28 can track the information or data set forth above corresponding to multiple users in a shared game such that a particular user in the multiple users in the shared game can see game effects applied by other users in the multiple users in the shared game (e.g., players).
[0023] It should be appreciated that display system 29 can include any other suitable display device and / or projection device that is used in addition to, or instead of, head-mounted display 30 to overlay AR features onto the real-world environment perceived by the user. Thus, such display devices and / or visualization devices enable the user to visualize and perceive a surreal environment 32 that includes a real-world view augmented (e.g., overlaid) with AR features. As non-limiting examples, display system 29 can include one or more projectors 37 configured to project AR features (e.g., light) directly or indirectly into one or both eyes of the user so that the user can perceive the AR features as being overlaid onto the real-world environment viewed by the user. For example, in some embodiments, one or more projectors 37 can operate as a virtual retinal display configured to raster AR images directly onto the iris and / or retina of the user's eye. In certain embodiments, display system 29 can include any other suitable holographic display or transparent light-emitting diode (LED) display. For example, display system 29 can include a standalone transparent display separate from (e.g., not wearable by) the user.
[0024] In any case, as discussed above, it can be difficult to synchronize certain features of AR features (e.g., shading, coloring, reflections) with the instantaneous environmental conditions (e.g., lighting conditions) of the real-world environment. Indeed, it can be tedious or otherwise time-consuming for a developer to evaluate the perceived realism of AR features in various environmental settings of an amusement park, hotel, or other area. Thus, a developer can not be able to efficiently adjust the manner in which modeling algorithms of AR features can be employed by computer graphics generation system 28 to render AR features to enhance the appearance (e.g., realism perceived by a user) of AR features in a particular real-world environment.
[0025] Accordingly, embodiments of the AR system 10 discussed herein include an AR lightbox system 38 that enables developers to efficiently evaluate the appearance of particular AR features in a variety of simulated real-world settings (e.g., themes) and across a variety of different environmental conditions (e.g., natural lighting conditions or artificial lighting conditions) in a test environment. Accordingly, developers can quickly evaluate the appearance (e.g., perceived realism) of AR features in a variety of settings, which can facilitate the development of AR features and the development of algorithms used by the computer graphics generation system 28 to control the rendering of AR features and the overlay of AR features onto real-world environment views. The AR lightbox system 38 can be communicatively coupled to any suitable component of the AR system 10, such as, for example, to the controller 16 or to the computer graphics generation system 28, and the AR lightbox system 38 will be discussed in detail below.
[0026] Figure 2 is an illustration of an embodiment of a head-mounted display 30 that can be included in the display system 29. The head-mounted display 30 can be worn by a user 40, such as a customer of an amusement park, an employee of an amusement park, or a developer of the AR system 10. When implemented in an amusement park setting, the head-mounted display 30 can be coupled (e.g., tethered via a cable or wire) to a ride vehicle of a passenger ride (e.g., an amusement park attraction). For example, in some embodiments, a user 40 (e.g., a customer) can purchase or otherwise be provided the head-mounted display 30 for use within an amusement park setting. The head-mounted display 30 can include electronic eyewear 42 (e.g., AR glasses, goggles) and a wearable portion 44 configured to house at least a portion of the electronic eyewear 42. The head-mounted display 30 can be used alone or in combination with other features to create a surreal environment 32. For example, in some embodiments, the head-mounted display 30 can be worn by the user 40 throughout the duration of an amusement park ride.
[0027] The head-mounted display 30 can include a processor 46 and a memory 48 (e.g., a tangible, non-transitory computer-readable medium). The processor 46 and the memory 48 can be configured to allow the head-mounted display 30 to act as a display (e.g., to receive signals from a computer graphics generation system 28 that ultimately drives the head-mounted display 30). The processor 46 can be a general-purpose processor, a system-on-a-chip (SoC) device, an application-specific integrated circuit (ASIC), or some other kind of similar processor configuration.
[0028] The head-mounted display 30 can include a tracking system 50, which can include orientation and / or position sensors such as accelerometers, magnetometers, gyroscopes, GPS receivers, motion tracking sensors, electromagnetic and solid-state motion tracking sensors, inertial measurement units (IMUs), presence sensors, or other sensors. The tracking system 50 can collect real-time data indicative of the position, orientation, focal length, gaze direction, field of view, motion, or any combination thereof of the user 40. The head-mounted display 30 can include a communication interface 52 (e.g., including a wireless transceiver) that can transmit the real-time data captured via the tracking system 50 to the processor 46 and / or the computer graphics generation system 28 for processing. The communication interface 52 can also allow the head-mounted display 30 to receive display signals transmitted by the computer graphics generation system 28.
[0029] In some embodiments, the electronic eyewear 42 can include a pair of displays 60 and 62 corresponding to each eye of the user 40, respectively. In some embodiments, a unified display can be employed in place of the pair of displays 60, 62. By way of non-limiting example, the displays 60, 62 can each include a liquid crystal display (LCD), an organic light-emitting diode (OLED) display, or other similar display or transparent screen that enables the user 40 to view a real-world image 66 of the actual physical environment (e.g., real-world environment) surrounding the user 40. In certain embodiments, the displays 60, 62 can each include a transparent (e.g., see-through) LED display or a transparent (e.g., see-through) OLED display that enables the user 40 to view real-world objects 68 (e.g., physical objects such as a long bench) within the physical or real-world environment. In other words, the real-world image 66 generally represents what the user 40 would see even without wearing the head-mounted display 30.
[0030] The electronic eyewear 42 can include features (e.g., circuitry, light emitters) that enable the displays 60, 62 to overlay the augmented reality images 70 onto the real-world images 66 viewed by the user 40. That is, in some embodiments, the light emitters can project one or more virtual features onto the displays 60, 62 such that the virtual features reflect off of the displays 60, 62 and into the eyes of the user 40. As such, the head-mounted display 30 can enable the user 40 to view a physical environment through a pair of substantially transparent electronic eyewear 42 with certain virtual features overlaid onto the surface of the electronic eyewear 42. Thus, the user 40 can perceive that the virtual features are integrated into the physical environment. In this way, the user 40 can feel completely surrounded by the surreal environment 32 while wearing the head-mounted display 30 such that the user 40 can perceive the surreal environment 32 as a real-world physical environment that includes certain virtual features. In effect, the head-mounted display 30 can at least partially control the view of the user 40 such that the surreal environment 32 is the actual physical environment (e.g., real-world images 66) with augmented reality images 70 overlaid onto the physical environment.
[0031] For example, the displays 60, 62 can overlay a virtual object 72 or virtual feature (e.g., a ghost) onto a real-world object 68 (e.g., a long bench), thereby creating the illusion that the virtual object 72 physically exists in the real-world environment and is interacting with the real-world object 68 (e.g., the head-mounted display 30 can create the illusion that the ghost is sitting on the long bench). In some embodiments, the augmented reality images 70 can also be used to overlay the real-world object 68 such that the real-world object 68 appears to be deleted or no longer existent (e.g., the real-world object 68 is completely or partially occluded with a virtual object 72 or virtual environment).
[0032] As noted above, in some embodiments, display system 29 can comprise one or more projectors 37 in place of head-mounted display 30. In such embodiments, one or more projectors 37 can be configured to project augmented reality images 70 directly into the eyes of user 40 (e.g., without requiring user 40 to view the physical environment through a display) to enable user 40 to perceive virtual objects 72 overlaid onto real-world objects 68 of the physical environment. In certain embodiments, display system 29 can comprise a standalone transparent display (e.g., a liquid crystal display (LCD), an organic light-emitting diode (OLED) display, or other similar display) that is separate from user 40 (e.g., not worn by user 40) and positioned within the physical environment. The standalone transparent display can be configured to overlay augmented reality images 70 onto real-world images 66 in a similar manner to the techniques discussed above with respect to electronic glasses 42. Thus, when viewing the physical environment through the standalone transparent display, user 40 can view real-world images 66 with augmented reality images 70 overlaid thereon.
[0033] In some embodiments, the real-world environment can include various illumination sources 80 (e.g., incident sunlight, a user-operated flashlight or laser pointer) that can illuminate physical objects present in the real-world environment. As an example, in some embodiments, user 40 can be provided with an illumination device 82 (e.g., a flashlight, a laser pointer) as part of a theme park attraction. Illumination device 82 can comprise user input device 26 or can comprise a portion of user input device 26. User 40 can use illumination device 82 to selectively illuminate certain real-world objects 68 (e.g., a long bench) surrounding user 40 (e.g., as part of a game associated with the theme park attraction). Thus, user 40 can perceive, through electronic glasses 42, a segment of the real-world environment that is selectively illuminated by the user. If user 40 directs the flashlight toward and / or onto virtual object 72 (e.g., a ghost), it can be desirable to update the appearance of virtual object 72 (e.g., a shadowing effect, a color, a reflection) to generate the illusion that illumination device 82 illuminated virtual object 72. As discussed below, AR lightbox system 38 enables developers to efficiently update, modify, and / or otherwise adjust modeling algorithms that can be implemented by AR system 10 to adjust the appearance of virtual object 72 in response to such illumination input, thereby enhancing the perceived realism of virtual object 72. In fact, such synchronization between adjustments in aspects of the appearance of virtual objects and real-world illumination conditions can enhance the illusion that virtual object 72 physically exists in the real-world environment.
[0034] To facilitate the following discussion, Figure 3is an embodiment of the AR lightbox system 38. As briefly discussed above, the AR lightbox system 38 enables a developer to evaluate the perceived realism of the virtual object 72 when rendered in real-world environments exposed to various lighting conditions. In particular, the AR lightbox system 38 can provide a test environment configured to reproduce certain real-world lighting conditions that are expected to occur throughout the duration of a theme park ride or another attraction in which the virtual object 72 is to be implemented. Thus, the developer can evaluate whether the computer graphics generation system 28 is properly configured to present the virtual object 72 in a realistically appearing manner under such lighting conditions. In effect, the AR lightbox system 38 can enable the developer to quickly make modifications, updates, and / or adjustments to the modeling algorithms employed to generate the virtual object 72 (e.g., via the computer graphics generation system 28) under the various lighting conditions simulated in the test environment of the AR lightbox system 38 at the time of evaluation and inspection of the virtual object 72. Thus, the developer can customize the modeling algorithms of the computer graphics generation system 28 to better present (e.g., render) the virtual object 72 and / or better update the appearance of the virtual object 72 in various real-world environments in response to instantaneous lighting conditions, thereby enhancing the perceived realism of the virtual object 72 in these environments. Moreover, the AR lightbox system 38 can enable the developer to derive such modifications to the modeling algorithms without involving empirical testing at the theme park attraction in which the AR system 10 is to be implemented.
[0035] For example, in the illustrated embodiment, the AR lightbox system 38 includes a physical stage 90 (e.g., an environment) having a backdrop 92 defined by one or more interior walls 94. Thus, the physical stage 90 defines a physical space 96 within a real-world environment. For the sake of clarity, it should be understood that the physical stage 90 can include any suitable platform, surface, wall, panel, or combination thereof that defines the physical space 96 or a portion of the physical space 96. As discussed below, the display system 29 (e.g., the head-mounted display 30, the one or more projectors 37) can be configured to overlay the virtual object 72 onto the backdrop 92 to enable a user 40 (e.g., a developer) using the display system 29 to perceive the virtual object 72 as being positioned within the physical space 96. The AR lightbox system 38 includes one or more physical lights 100 that can be individually operable to illuminate certain portions of the physical stage 90. Specifically, in the illustrated embodiment, the AR lightbox system 38 includes a first physical light 102, a second physical light 104, and a third physical light 106. For the sake of clarity, as used herein, a "physical light" refers to a suitable lighting device that is positioned within a real-world environment and configured to illuminate real-world objects within the real-world environment, such as the physical stage 90. By way of non-limiting example, such a physical light can include an incandescent light bulb, a compact fluorescent light, a halogen light, a neon light, a light-emitting diode (LED), a flash light (e.g., a user-operable flash light and / or a flash light that can be controlled via one or more actuators), or any other suitable lighting device. It should be noted that the physical lights 100 can be positioned within the physical space 96 defined by the physical stage 90, or can be positioned outside of the physical space 96. For example, in certain embodiments, the physical lights 100 can be positioned adjacent to the physical stage 90 and configured to project light into the physical space 96 and onto the backdrop 92.
[0036] In certain embodiments, the backdrop 92 can include various themes, designs, and / or other graphics displayed on and / or integrated with the backdrop 92. For example, in some embodiments, various graphics can be painted or drawn onto the backdrop 92 to simulate a particular environment (e.g., a space theme, a jungle theme) in which the virtual object 72 is to be displayed when the virtual object 72 is presented in the attraction. In certain embodiments, the various graphics can be projected onto the backdrop 92 via a projection system such that the graphics overlay onto the surface of the backdrop 92. In further embodiments, portions or substantially all of the backdrop 92 can include one or more displays configured to display various still images or video feeds. As an example, the one or more displays can include liquid crystal displays (LCDs), organic light emitting diode (OLED) displays, LED displays, or other suitable displays for displaying image data. As discussed below, it should be appreciated that the backdrop 92 can include one or more walls, a floor, and / or a ceiling of a room such that the user 40 can traverse (e.g., walk through) the room while wearing the head-mounted display 30 and utilizing the AR lightbox system 38 in accordance with the techniques discussed herein.
[0037] In some embodiments, one or more of the physical lights 100 can be selectively controllable to output visible light of a particular color (e.g., wavelength). As an example, a number / amount of the physical lights 100 can include controllable LEDs operable to selectively project various colors of light onto the backdrop 92. In certain embodiments, the physical lights 100 can be configured to adjust the intensity of the light (e.g., luminous intensity) via internal control circuitry. In some embodiments, one or more physical adjustment devices can be used in addition to, or instead of, integrated control circuitry that can be included in the physical lights 100 to adjust the color of the light output by the physical lights 100 and / or the intensity of the light output by the physical lights 100. For example, the physical lights 100 can be associated with respective colored gels that can be selectively placed in front of the physical lights 100 to adjust the color of the light output by the physical lights 100. Further, the physical lights 100 can be associated with respective shutters configured to adjust the intensity of the light output by the physical lights 100.
[0038] In some embodiments, certain of the physical lights 100 can be coupled to respective actuators 108 that can be operable to adjust an orientation and / or a position of the physical lights 100 relative to the physical stage 90. For example, the actuators 108 can be configured to adjust an angle at which the physical lights 100 direct light onto a particular portion of the physical stage 90. Additionally or alternatively, the actuators 108 can adjust a separation distance between the physical lights 100 and the physical stage 90 and / or can move the physical lights 100 relative to the physical stage 90. The actuators 108 can include, for example, linear actuators, pneumatic actuators, electromechanical actuators, or other suitable actuators. As such, it should be appreciated that the actuators 108 can be configured to impart rotational motion, linear movement, and / or other movement to one or more of the physical lights 100.
[0039] The physical lights 100 and the actuators 108 can be communicatively coupled (e.g., via wired or wireless communication components) to a light controller 110 or to another suitable control device of the AR lightbox system 38. As discussed below, the light controller 110 can be configured to direct the physical lights 100 to adjust an intensity of light output by each of the physical lights 100 and / or a color of the light. Further, the light controller 110 can be configured to direct the actuators 108 to adjust an orientation and / or a position of the physical lights 100 relative to the physical stage 90.
[0040] The light controller 110 can be communicatively coupled to a lightbox controller 112 of the AR lightbox system 38, which can be used to control various components of the AR lightbox system 38. In some embodiments, the lightbox controller 112 can include or can be integrated with the computer graphics generation system 28. In other embodiments, the lightbox controller 112 can include a controller that is separate from the computer graphics generation system 28 and that is configured to receive information from or send information to the computer graphics generation system 28. For example, in some embodiments, the computer graphics generation system 28 can provide the lightbox controller 112 with instructions (e.g., modeling algorithms) that enable the lightbox controller 112 to render and display virtual features via the display system 29 (e.g., via the head-mounted display 30 and / or the one or more projectors 37). It should be appreciated that the light controller 110 and the lightbox controller 112 can each include respective processors 114, 116 and respective memories 118, 120 (e.g., tangible, non-transitory computer-readable media) that enable the light controller 110 and the lightbox controller 112 to perform the techniques and processes discussed herein.
[0041] The lightbox controller 112 can be configured to generate (e.g., render) a virtual stage 128, which is a virtual representation of the physical stage 90. The virtual stage 128 can define a virtual space 130 (e.g., a game space) that is configured to match the size and / or scale of the physical space 96. In other words, the lightbox controller 112 can ensure that the relative dimensions of the virtual stage 128 are proportional to or equal to the relative dimensions of the physical stage 90. In some embodiments, the lightbox controller 112 can not render the virtual stage 128 as a digital representation, but instead can utilize the virtual stage 128 to define the outer dimensional boundaries of the virtual space 130. The virtual space 130 can include one or more virtual lights 132 that are each associated with a corresponding one of the physical lights 100. In particular, in the illustrated embodiment, the virtual space 130 includes a first virtual light 134, a second virtual light 136, and a third virtual light 138 that are respectively associated with the first physical light 102, the second physical light 104, and the third physical light 106. For clarity, as used herein, a "virtual light" can refer to a light simulation that is configured to update a representation of virtual lighting within the virtual space 130. It should be appreciated that although the illustrated embodiment of the AR lightbox system 38 includes three physical lights 100 and three virtual lights 132, in other embodiments, the AR lightbox system 38 can include any suitable number of physical lights 100 and corresponding virtual lights 132.
[0042] The virtual space 130 can include a representation 140 of the virtual object 72. The representation 140 can be a model (e.g., a digital representation) of the virtual object 72. In particular, in accordance with the techniques discussed above, the lightbox controller 112 can be configured to provide the representation 140 to the display system 29 as input to enable the display system 29 to overlay the virtual object 72 onto a suitable real-world environment. In other words, in some embodiments, the virtual object 72 can be a rendering of the representation 140 generated by the lightbox controller 112. As discussed in detail herein, the lightbox controller 112 can be configured to update the appearance of the representation 140 (e.g., color, shading) based on changes in aspects of the lighting conditions of the physical space 96 and changes in aspects of the lighting conditions of the virtual space 130. As a result, changes in aspects of the appearance of the representation 140 can be reflected as changes in aspects of the appearance of the virtual object 72 (e.g., a rendering of the virtual object 72 can be updated in accordance with the representation 140).
[0043] To evaluate the appearance of virtual object 72 in a particular lighting environment, a developer can direct lightbox controller 112 to overlay virtual object 72 onto background screen 92 using display system 29 via input device 144 (e.g., user input device 26). Physical lights 100 can be configured to simulate particular real-world lighting conditions in physical space 96 that can be specified by the developer. For example, the developer can direct (e.g., via input provided to lightbox controller 112) physical lights 100 to simulate lighting conditions that are expected to occur throughout the duration of a particular amusement park ride. Each of physical lights 100 can be configured to provide feedback to light controller 110 indicative of the current operating parameters of that particular physical light 100. As examples, such operating parameters can include an identifier associated with each of physical lights 100 (e.g., an identification code to distinguish first physical light 102, second physical light 104, and third physical light 106), the intensity of the light output by each of physical lights 100, the color (e.g., hue) of the light output by each of physical lights 100, the location of each of physical lights 100 relative to physical stage 90, the orientation of each of physical lights 100 relative to physical stage 90, or combinations thereof. In certain embodiments, physical lights 100 can include sensors (e.g., integrated sensors) configured to provide feedback to light controller 110 indicative of any one or combination of the aforementioned operating parameters. Additionally or alternatively, physical lights 100 can be associated with respective sensors 148 (e.g., external sensors) configured to provide feedback to light controller 110 indicative of such operating parameters. For example, in some embodiments, sensors 148 can include optical sensors (e.g., light intensity sensors, wavelength detectors), GPS sensors, photoelectric sensors, or other suitable sensors.
[0044] In certain embodiments, some of the physical lights 100 and corresponding actuators 108 can be configured to execute a particular lighting sequence (e.g., a pre-determined lighting sequence) that defines, over time, the position, orientation, lighting hue, lighting intensity, and / or other parameters of the physical lights 100. The lighting sequence can be initiated upon a particular operation or input (e.g., a user providing input to a user interface coupled to the lightbox controller 112) and / or sensor feedback (e.g., a user moving toward a particular position relative to the physical stage 92). The lighting sequence associated with the physical lights 100 can be stored, for example, in the respective memories 118, 120 of the light controller 110 and / or the lightbox controller 112. Additionally or alternatively, the lighting sequence can be stored in an associated memory (e.g., an integrated memory) of the physical lights 100. In any case, upon initiation of the particular lighting sequence, one or more of the physical lights 100 can provide feedback to the lightbox controller 112 indicative of the current operating parameters of the physical lights 100 during execution of the corresponding lighting sequence. That is, the lightbox controller 112 can receive feedback indicative of the current operating parameters of the physical lights 100 directly from the corresponding controller of the physical lights 100 configured to execute the lighting sequence instead of receiving feedback indicative of the operating parameters of the physical lights 100 from the sensors 148.
[0045] In some embodiments, the AR lightbox system 38 can include one or more environmental lighting sensors 150 configured to provide feedback (e.g., environmental lighting feedback) to the light controller 110 indicative of the environmental lighting surrounding the physical stage 90. As a non-limiting example, the one or more environmental lighting sensors 150 can be configured to provide feedback to the light controller 110 indicative of natural sunlight projected onto the physical stage 90 or indicative of simulated sunlight that can be projected onto the physical stage 90 from additional lighting devices positioned above the physical stage 90. In certain embodiments, some of the one or more environmental lighting sensors 150 can be coupled to an actuated manipulator (e.g., a robotic manipulator) configured to adjust the position of the environmental lighting sensors 150 relative to the physical stage 90. Accordingly, the actuated manipulator can enable the one or more environmental lighting sensors 150 to capture feedback indicative of environmental lighting conditions at various positions along the physical stage 90. The actuated manipulator can be communicatively coupled to the lightbox controller 112, thereby enabling the lightbox controller 112 to send instructions to adjust the position of the one or more environmental lighting sensors 150 via the actuated manipulator. In some embodiments, the display system 29 can be configured to overlay the actuated manipulator with AR features such that, to a developer (e.g., the user 40) viewing the physical stage 90 through the display system 29, the actuated manipulator appears to be removed or no longer present (e.g., the display system 29 can represent the actuated manipulator as being completely or partially occluded by a virtual environment).
[0046] The lamp controller 110 can provide the lightbox controller 112 with information indicative of feedback received from the physical lamps 100 and / or feedback received from the sensors 148 and / or the ambient lighting sensors 150. It should be appreciated that, in certain embodiments, the physical lamps 100, the sensors 148, and / or the ambient lighting sensors 150 can directly provide such feedback to the lightbox controller 112. Indeed, in such embodiments, the lamp controller 110 can be omitted from the AR lightbox system 38. In any event, the lightbox controller 112 can update the virtual lighting conditions (e.g., the respective states of the virtual lamps 132) within the virtual space 130 based on the feedback provided by the physical lamps 100, the feedback provided by the sensors 148, and / or the feedback provided by the ambient lighting sensors 150. For example, the lightbox controller 112 can update the position and / or orientation of each of the virtual lamps 132 within the virtual space 130 based on the determined position and / or determined orientation of the corresponding physical lamp 100 within the physical space 96. In particular, the lightbox controller 112 can adjust the position parameters (e.g., position, orientation) of the virtual lamps 132 relative to the virtual space 130 to match the position parameters (e.g., position, orientation) of the physical lamps 100 relative to the physical space 96. Moreover, the lightbox controller 112 can update the color and / or intensity of the virtual lighting rendered onto the representation 140 based on the current color and / or intensity of the light projected by the physical lamps 100.
[0047] As a non-limiting example, the lightbox controller 112 can be configured to receive feedback from the first physical light 102, directly or indirectly, that indicates an operating parameter or a plurality of operating parameters of the first physical light 102, such as a position of the first physical light 102 (e.g., relative to the physical stage 90), an orientation of the first physical light 102 (e.g., relative to the physical stage 90), a hue (e.g., color) of light output by the first physical light 102, and / or an intensity (e.g., luminous intensity) of light output by the first physical light 102. Upon receiving such feedback, the lightbox controller 112 can be configured to update a state of the first virtual light 134 to match the corresponding operating parameter(s) of the first physical light 102. That is, the lightbox controller 112 can adjust a position and / or orientation of the first virtual light 134 (e.g., relative to the virtual stage 128) within the virtual space 130 to match a current position and a current orientation of the first physical light 102 (e.g., relative to the physical stage 90) in the physical space 96. Accordingly, the lightbox controller 112 can adjust an angle at which the virtual light is rendered onto the representation 140 based on the position and / or orientation of the first physical light 102 within the physical space 96. The lightbox controller 112 can also adjust a hue and an intensity of the virtual light rendered by the first virtual light 134 to match a hue and an intensity of light output by the first physical light 102. Accordingly, the lightbox controller 112 can adjust a color and an intensity of the virtual light rendered onto the representation 140 to match a color and an intensity of light output by the first physical light 102. In other words, by adjusting the state of the first virtual light 134 (e.g., based on the operating parameters of the first physical light 102), the lightbox controller 112 can adjust (e.g., update) an appearance of the virtual object 72.
[0048] According to the aforementioned techniques, the lightbox controller 112 can adjust the virtual light rendered by the second virtual light 136 and the third virtual light 138 based on the lighting output of the second physical light 104 and the third physical light 106, respectively. That is, the lightbox controller 112 can adjust the virtual light rendered by the second virtual light 136 and the third virtual light 138 based on feedback from integrated sensors within the second physical light 104 and the third physical light 106, respectively, and / or feedback from the sensors 148 (e.g., sensors located outside of the second physical light 104 and the third physical light 106). In this way, the lightbox controller 112 can adjust the appearance (e.g., shading, brightening, coloring) of the rendering of the representation 140, and thus the appearance of the rendering of the virtual object 72, based on the operating parameters of the physical lights 100. Indeed, the lightbox controller 112 can perform the aforementioned techniques substantially in real-time to adjust the appearance of the virtual object 72 in response to changes in aspects of the operating parameters (e.g., position, orientation, color, intensity) of the physical lights 100 in the physical space 96. The AR lightbox system 38 thereby enables a developer to evaluate whether the appearance of the rendering of the virtual object 72 looks realistically commensurate with the lighting conditions generated by the physical lights 100. In other words, the developer can determine whether the computer graphics generation system 28 properly adjusts the appearance of the virtual object 72 in response to changes in aspects of the lighting output by the physical lights 100.
[0049] As an example, the developer can determine whether the lightbox controller 112 adjusts the shading and / or occlusion of the virtual object 72 in a spatially and / or temporally realistic manner when one or more of the physical lights 100 move relative to the physical stage 90 and / or are directed to output different color tones or intensities of light. In effect, the developer can use the AR lightbox system 38 to simulate various real-world lighting conditions (e.g., via the physical lights 100) that can occur throughout the duration of a particular amusement park ride, for example, and evaluate the realism of the instantaneous adjustments to the appearance of the virtual object 72 in response to such changes in aspects of the real-world lighting conditions. Accordingly, the developer can predict how the virtual object will appear in a particular setting of the amusement park in a testing environment with the AR lightbox system 38. Thus, the AR lightbox system 38 can enable the developer to make adjustments to the algorithms used to render the appearance of the virtual object 72 when the currently employed algorithms adjust the appearance of the virtual object 72 in an unrealistic or inappropriate manner. As such, the AR lightbox system 38 enables the developer to better customize the modeling algorithms of the lightbox controller 112 and / or the computer graphics generation system 28 in a manner that enables the lightbox controller 112 and / or the computer graphics generation system 28 to more effectively generate the illusion that the light output by the physical lights 100 interacts with (e.g., reflects off of, changes the shading or coloration of) the virtual object 72. It should be appreciated that the lightbox controller 112 can adjust the light rendered by any of the first virtual light 134, the second virtual light 136, and / or the third virtual light 138 based on the environmental lighting feedback provided by the environmental lighting sensor 150. As such, the lightbox controller 112 can adjust the appearance of the virtual object 72 based on the environmental lighting conditions of the backdrop 92 that surrounds the physical stage 90.
[0050] In some embodiments, in addition to adjusting the operating state of the virtual light 132 based on the operating parameters of the physical light 100, the AR lightbox system 38 can also be configured to adjust the operating parameters of the physical light 100 (e.g., the position and / or orientation of the physical light 100 relative to the physical stage 90, the hue and / or intensity of the light output by the physical light 100) based on the operating state of the virtual light 132 (e.g., the position and / or orientation of the virtual light 132 relative to the virtual stage 128, the hue and / or intensity of the virtual light rendered by the virtual light 132), or instead of adjusting the operating state of the virtual light 132 based on the operating parameters of the physical light 100, the AR lightbox system 38 can also be configured to adjust the operating parameters of the physical light 100 (e.g., the position and / or orientation of the physical light 100 relative to the physical stage 90, the hue and / or intensity of the light output by the physical light 100) based on the operating state of the virtual light 132 (e.g., the position and / or orientation of the virtual light 132 relative to the virtual stage 128, the hue and / or intensity of the virtual light rendered by the virtual light 132). For example, a developer can direct the lightbox controller 112 to adjust the operating state of the virtual light 132 via instructions provided through the input device 144. In particular, the developer can use the input device 144 to adjust the position of the first virtual light 134 (e.g., relative to the virtual stage 128), adjust the orientation of the first virtual light 134 (e.g., relative to the virtual stage 128), adjust the hue (e.g., color) of the virtual light rendered by the first virtual light 134, and / or adjust the intensity of the virtual light rendered by the first virtual light 134. Such instructions can be used to simulate possible user inputs that can be provided by a user during a game generated by the computer graphics generation system 28 (such as a game presented as part of an amusement park attraction). In accordance with the techniques discussed above, upon receiving such instructions, the lightbox controller 112 can adjust the appearance of the representation 140 and the appearance of the virtual object 72. Essentially, the lightbox controller 112 can adjust (e.g., via the corresponding actuator 108) the position and / or orientation of the first physical light 102 in the physical space 96 (e.g., relative to the physical stage 90) in conjunction with adjusting the appearance of the virtual object 72 to match the current position and orientation (e.g., state) of the first virtual light 134 in the virtual space 130 (e.g., relative to the virtual stage 128). Additionally, the lightbox controller 112 can adjust the hue and / or intensity of the light output by the first physical light 102 to match the hue and intensity (e.g., state) of the virtual light rendered by the first virtual light 134. It should be appreciated that, in accordance with these techniques, the lightbox controller 112 can adjust the operating parameters of the second and third physical lights 104 and 106 based on the states of the second and third virtual lights 136 and 138, respectively.
[0051] In this manner, the lightbox controller 112 can adjust the operating parameters of the physical lights 100 based on the updated appearance of the virtual object 72 (e.g., as defined by the manipulation of the virtual light 132). The lightbox controller 112 can adjust the operating parameters (e.g., position, orientation, hue, intensity) of the physical lights 100 in substantially real-time to the specified adjustment in the appearance of the virtual object 72, thereby enabling the developer to evaluate whether the physical lights 100 adjust the lighting output of the physical lights 100 in a synchronized and realistically commensurate manner with the adjusted appearance of the virtual object 72. Accordingly, the AR lightbox system 38 can enable the developer to make adjustments to the algorithm used to control the operation of the physical lights 100 when the currently employed algorithm adjusts the operation of the physical lights 100 in an unrealistic manner (e.g., with respect to the adjusted appearance of the virtual object 72).
[0052] In certain embodiments, the lightbox controller 112 can be configured to determine the occurrence of a failure condition of one or more of the physical lights 100. For example, the lightbox controller 112 can determine whether one or more of the physical lights 100 are operating inefficiently or not operating at all (e.g., due to a failure of a filament within the light). Upon detecting such a failure condition, the lightbox controller 112 can provide a notification to the developer prompting the developer to perform maintenance (e.g., replacement, repair) on the one or more of the physical lights 100 (e.g., via a suitable display device such as the head-mounted display 30, an audible alert). In certain embodiments, the identifier associated with each of the physical lights 100 can enable the lightbox controller 112 to notify the developer as to which of the physical lights 100 (e.g., the first physical light 102, the second physical light 104, the third physical light 106) is specifically causing the failure condition. For example, the lightbox controller 112 can notify the developer of the location of the particular physical light exhibiting the failure condition via display of the identifier (e.g., in response to detecting the occurrence of the failure condition).
[0053] In some embodiments, the AR lightbox system 38 can be a portable kit configured to be easily transported to various testing locations or settings. For example, the physical stage 90 can be sized for placement on a table or other suitable structure. The light controller 110 and the lightbox controller 112 can also be housed in a portable structure and configured to communicatively couple to components of the physical stage 90, such as the physical lights 100, the sensors 148, 150, and / or the actuators 108. In some embodiments, the light controller 110, the lightbox controller 112, and / or other features included in the AR lightbox system 38 can be integrated within a suitable portion of the physical stage 90. It should be appreciated that, in other embodiments, the physical stage 90 can be scaled to any suitable size. For example, in some embodiments, the physical stage 90 can be sized to enable a developer to stand on the physical stage 90 and / or walk across the physical stage 90 to view the virtual object 72 from various perspectives (e.g., relative to the physical stage 90). Moreover, certain props (e.g., electronic animal figures, theatrical props, other objects) can be placed on the physical stage 90 to enable a developer to evaluate the appearance of the virtual object 72 relative to the props on the physical stage 90. In some embodiments, the physical stage 90 includes a room having the features of the physical stage 90 discussed above (e.g., the backdrop 92, the physical lights 100, the actuators 108, etc.). As such, a user (e.g., a developer, a customer of an amusement park attraction) can utilize the AR lightbox system 38 to view virtual objects in various real-world settings according to the techniques discussed above.
[0054] As set forth above, embodiments of the present disclosure can provide one or more technical effects useful for evaluating the appearance of AR features in various simulated real-world settings and across a wide variety of different lighting conditions. In particular, the AR lightbox systems discussed herein can enable developers or other users to more effectively develop AR features that appear based on real-world environments and algorithms for overlaying such AR features onto real-world environments. It should be understood that the technical effects and technical problems in the specification are examples and are not limiting. Indeed, it should be noted that embodiments described in the specification can have other technical effects and be able to solve other technical problems.
[0055] While the embodiments set forth in the present disclosure can be susceptible to various modifications and alternative forms, specific embodiments have been shown by way of example in the drawings and have been described in detail herein. However, it should be understood that the present disclosure is not intended to be limited to the particular
[0056] The technology presented and claimed herein was made in view of the real-world, practical nature of the subject matter and examples, which demonstrably improve the art and are thus not abstract, intangible or purely theoretical. Moreover, if any of the claims appended to the end of this specification contain one or more elements specified as "means for [performing]...[function]" or "step for [performing]...[function]", it is intended that such elements are to be interpreted under 35 U.S.C. 112(f). However, for any claim containing elements otherwise specified as "means for [performing]...[function]" or "step for [performing]...[function]", it is intended that such elements are not to be interpreted under 35 U.S.C. § 112(f).
Claims
1. A system for evaluation of an augmented reality (AR) experience provided to a user, the system comprising: a backdrop; a physical light configured to project light onto the backdrop; a display system configured to display a virtual feature to enable the user to view the virtual feature as overlaid onto the backdrop; and a controller communicatively coupled to the display system and the physical light, wherein the controller is configured to: render the virtual feature within a virtual space; receive feedback indicative of an operating parameter of the physical light; receive additional feedback indicative of a state of a virtual light, wherein the state of the virtual light defines an appearance of the virtual feature; and adjust the appearance of the virtual feature to an updated appearance based on the feedback indicative of the operating parameter of the physical light and adjust the operating parameter of the physical light based on the additional feedback indicative of the state of the virtual light, a physical light sensor configured to provide the controller with the feedback indicative of the operating parameter of the physical light, wherein the operating parameter comprises a position of the physical light relative to the backdrop, an orientation of the physical light relative to the backdrop, a hue of light projected onto the backdrop, an intensity of light projected onto the backdrop, or a combination thereof, wherein the controller is configured to render a virtual stage in the virtual space, wherein the virtual stage corresponds to a physical stage having the backdrop, wherein the state of the virtual light comprises a position of the virtual light relative to the virtual stage, an orientation of the virtual light relative to the virtual stage, a hue of virtual light rendered by the virtual light, an intensity of virtual light rendered by the virtual light, or a combination thereof. the controller is configured to instruct the actuator to adjust the operating parameter of the physical light in response to receiving the additional feedback indicative of the state of the virtual light.
2. The system of claim 1, comprising an actuator coupled to the physical light and configured to adjust the operating parameter of the physical light, wherein, 3. The system of claim 1, comprising a user input device communicatively coupled to the controller and configured to enable the user to provide the controller with the additional feedback indicative of the state of the virtual light. the display system comprises a head-mounted display configured to be worn by the user and configured to overlay the virtual feature onto the backdrop via a transparent screen of the head-mounted display.
4. The system of claim 1, wherein, the display system comprises one or more projectors configured to project the virtual feature into eyes of the user to overlay the virtual feature onto the backdrop.
5. The system of claim 1, wherein, the controller is configured to:
6. The system of claim 1, wherein, receive environmental lighting feedback indicative of environmental lighting conditions surrounding the backdrop from an environmental lighting sensor; and adjust the appearance of the virtual feature to the updated appearance based on the environmental lighting feedback.
7. A method for evaluation of an augmented reality (AR) experience provided to a user, the method comprising: overlaying a virtual feature onto a backdrop via a display system to enable the user to view the virtual feature overlaid onto the backdrop; receive, from a sensor, feedback indicative of an operational parameter of a physical light configured to illuminate the backdrop, wherein the operational parameter comprises a position of the physical light relative to the backdrop, an orientation of the physical light relative to the backdrop, a hue of light projected onto the backdrop, an intensity of light projected onto the backdrop, or a combination thereof; receive, at a controller, additional feedback indicative of a state of a virtual light, wherein the state of the virtual light defines an appearance of the virtual feature; adjust, via the controller, the appearance of the virtual feature to an updated appearance based on the feedback indicative of the operational parameter of the physical light; and adjust, via the controller, the operational parameter of the physical light based on the additional feedback indicative of the state of the virtual light, render the virtual feature in a virtual stage of a virtual space, wherein the virtual stage corresponds to a physical stage having the backdrop and is proportional in size to the physical stage, wherein the state of the virtual light comprises a position of the virtual light relative to the virtual stage, an orientation of the virtual light relative to the virtual stage, a hue of virtual light rendered by the virtual light, an intensity of virtual light rendered by the virtual light, or a combination thereof.
8. The method of claim 7, comprising adjusting, via an actuator coupled to the physical light, the operational parameter of the physical light in response to receiving the additional feedback indicative of the state of the virtual light.
9. The method of claim 7, comprising receiving the additional feedback indicative of the state of the virtual light from a user interface communicatively coupled to the controller.
10. The method of claim 7, comprising: associating the physical light with an identifier unique to the physical light, wherein the physical light is a first physical light of a plurality of physical lights configured to illuminate the backdrop and associated with respective identifiers; detecting an occurrence of a fault condition in the first physical light; and displaying, via the display system, the identifier associated with the first physical light in response to detecting the occurrence.
11. An augmented reality (AR) system, comprising: a display system configured to overlay a virtual feature onto an environment viewable by a user; a physical light configured to illuminate the environment; and a controller communicatively coupled to the display system and the physical light, wherein the controller is configured to: render the virtual feature within a virtual space having a virtual light, wherein a state of the virtual light defines an appearance of the virtual feature; adjust the state of the virtual light based on feedback indicative of an operational parameter of the physical light; and adjust the operational parameter of the physical light based on additional feedback indicative of the state of the virtual light, a sensor configured to monitor the operating parameter, wherein the operating parameter comprises a position of the physical light in the environment, an orientation of the physical light in the environment, a hue of light output by the physical light, an intensity of the light output by the physical light, or a combination thereof, wherein the state of the virtual light comprises a position of the virtual light relative to a virtual stage, an orientation of the virtual light relative to the virtual stage, a hue of virtual light rendered by the virtual light, an intensity of virtual light rendered by the virtual light, or a combination thereof.
12. The system of claim 11, comprising a user interface configured to generate the additional feedback indicative of the state of the virtual light in response to user input at the user interface.
13. The system of claim 11, wherein, the display system comprises a head-mounted display configured to be worn by the user.
14. The system of claim 11, wherein, the state of the virtual light defines a shadow, a shading, a hue, and / or a highlight of the virtual feature. the display system comprises a head-mounted display configured to be worn by the user. the state of the virtual light defines a shadow, a shading, a hue, and / or a highlight of the virtual feature.
Citation Information
Patent Citations
Intelligent light box controller
CN108519748A
Augmented reality lighting effects
US20160364914A1