Tangible / virtual design system and method for amusement park attraction design

Abstract

The amusement park attraction design system may include an object token having a first tracker coupled to a first projection surface, a visualization tool having a second tracker, and an image sensor that generates location data based on the first tracker and the second tracker. The amusement park attraction design system may also include a controller communicatively coupled to the image sensor and the projector. The controller may receive the location data from the image sensor and determine the object token and the visualization tool based on the first tracker and the second tracker, respectively. The controller may also receive image content based on an interaction between the object token and the visualization tool and send an indication of the image content to be projected. The projector may receive the indication of the image content and project the image content onto the first projection surface.

Description

[Technical Field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to U.S. Provisional Patent Application No. 63 / 403,981, entitled "TANGIBLE / VIRTUAL DESIGN SYSTEMS AND METHODS FOR AMUSEMENT PARK ATTRACTION DESIGN," filed September 6, 2022, and U.S. Provisional Patent Application No. 63 / 495,954, entitled "TANGIBLE / VIRTUAL DESIGN SYSTEMS AND METHODS FOR AMUSEMENT PARK ATTRACTION DESIGN," filed April 13, 2023, both of which are incorporated herein by reference in their entirety for all purposes. [Background technology]

[0002] This section is intended to introduce the reader to various aspects of art that may be related to various aspects of the present technology, which are described and / or claimed below. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present disclosure. As such, it should be understood that these statements are to be read in this light, and not as admissions of prior art.

[0003] Amusement parks and other entertainment venues may use special effects to help immerse guests in the ride or attraction experience. Immersive environments may include three-dimensional (3D) props and scenery, robotic or mechanical elements, and / or display surfaces for presenting media. Immersive environments may also include sound effects, smoke effects, and / or motion effects. Thus, immersive environments may include a combination of dynamic and static elements. However, the design, implementation, and operation of special effects can be complex. For example, it can be difficult to ensure that certain elements of a special effect operate in a consistent and desirable manner to create an immersive environment. With the increasing sophistication and complexity of modern ride attractions and experiences, and the corresponding rising expectations among theme park or amusement park guests, current attraction design techniques can be time-consuming and costly. Therefore, techniques for efficiently designing and ensuring consistent operation would be desirable. Summary of the Invention

[0004] The following provides an overview of some embodiments disclosed herein. It should be understood that these aspects are merely intended to provide the reader with a summary of some embodiments and are not intended to limit the scope of the present disclosure. In fact, the present disclosure may include various aspects that may not be set forth below.

[0005] In one embodiment, an amusement park attraction design system may include an object token having a first tracker coupled to a first projection surface, a visualization tool having a second tracker coupled to a second projection surface, and an image sensor configured to detect the first tracker and the second tracker and generate location data based on the first tracker and the second tracker. The amusement park attraction design system may also include a controller communicatively coupled to the image sensor and the projector. The controller may receive the location data provided by the image sensor, determine the object token based on the first tracker, and determine the visualization tool based on the second tracker. The controller may also receive image content based on an interaction between the object token and the visualization tool and send an indication of the image content to be projected onto the first projection surface based on the location data. The projector may receive the indication of the image content from the controller and project the image content onto the first projection surface.

[0006] In another embodiment, a method may include receiving, via a processing circuit, location data and configuration data associated with an object token and a visualization tool, identifying the object token and the visualization tool based on the configuration data, and receiving an indication of an interaction between the visualization tool and the object token. The method may then receive, via the processing circuit, image content based on the interaction and configuration data, and project the image content based on the position data.

[0007] In another embodiment, an amusement park attraction design system may include a display surface configured to receive one or more object tokens, a timeline tool coupled to the display surface and a motion sensor, and an image sensor configured to generate image data indicative of the display surface and the object tokens. The system may also include a controller communicatively coupled to the image sensor and the motion sensor. The controller may receive image content based on the object tokens, receive instructions from the motion sensor indicative of movement of the timeline tool, adjust the image content based on the instructions to generate adjusted image content, and cause the adjusted image content to be projected onto the display surface.

[0008] These and other features, aspects and advantages of the present invention will be better understood from the following detailed description when read in conjunction with the accompanying drawings, in which like reference characters refer to like elements throughout. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram of a tangible / virtual design system including a display surface according to an embodiment of the present disclosure.

[0010] [Figure 2] 2 is a perspective view of an example embodiment of the tangible / virtual design system of FIG. 1 detecting object tokens on a display surface.

[0011] [Figure 3] 10 is a perspective view of another example embodiment of the tangible / virtual design system of FIG. 1 for designing an amusement park experience attraction.

[0012] [Figure 4] 2 is a flowchart of a process for generating an object visualization using the tangible / virtual environment system of FIG. 1 according to an embodiment of the present disclosure.

[0013] [Figure 5]1. FIG. 4 is a perspective view of another example embodiment of the tangible / virtual design system of FIG. 1 detecting object tokens on a display surface.

[0014] [Figure 6A] 2 is a perspective view of an example embodiment of an object token of the tangible / virtual design system of FIG. 1.

[0015] [Figure 6B] 2 is a perspective view of another example embodiment of an object token of the tangible / virtual design system of FIG. 1.

[0016] [Figure 7] 2 is a flowchart of a process for generating an object visualization using the tangible / virtual environment system of FIG. 1 according to an embodiment of the present disclosure.

[0017] [Figure 8] 2 is a flowchart of a process for adjusting attributes of an object token using the tangible / virtual environment system of FIG. 1 according to an embodiment of the present disclosure.

[0018] [Figure 9] 2 is a flowchart of a process for designing an amusement park illusion using the tangible / virtual environment system of FIG. 1 according to an embodiment of the present disclosure.

[0019] [Figure 10] 2 is a flowchart of a process for adjusting the position of an object token using the tangible / virtual environment system of FIG. 1 according to an embodiment of the present disclosure.

[0020] [Figure 11] 2 is a flowchart of a process for problem solving in amusement park attraction design using the tangible / virtual environment system of FIG. 1 according to an embodiment of the present disclosure.

[0021] [Figure 12A]2 is a schematic diagram of an example embodiment of a visualization tool of the tangible / virtual design system of FIG. 1 in the form of a paintbrush tool.

[0022] [Figure 12B] 2 is a schematic diagram of an example embodiment of a visualization tool of the physical / virtual design system of FIG. 1 in the form of a magnification tool.

[0023] [Figure 12C] 2 is a schematic diagram of an example embodiment of a visualization tool of the physical / virtual design system of FIG. 1 in the form of a scissors tool.

[0024] [Figure 12D] 2 is a schematic diagram of an example embodiment of a visualization tool of the physical / virtual design system of FIG. 1 in the form of a ruler tool.

[0025] [Figure 12E] FIG. 2 is a block diagram of an example embodiment of a visualization tool for the physical / virtual design system of FIG. 1, in accordance with an embodiment of the present disclosure.

[0026] [Figure 13] 2 is a perspective view of an example embodiment of a visualization tool for the physical / virtual design system of FIG. 1 in the form of one or more filter tiles, according to an embodiment of the present disclosure.

[0027] [Figure 14A] 14 is a perspective view of an example embodiment of an object visualization as a projection map generated by the tangible / virtual design system of FIG. 1 based on the visualization tool of FIG. 13.

[0028] [Figure 14B] 14 is a perspective view of an example embodiment of an object visualization as a projection map generated by the tangible / virtual design system of FIG. 1 based on the visualization tool of FIG. 13.

[0029] [Figure 14C]14 is a perspective view of an example embodiment of an object visualization as a projection map generated by the tangible / virtual design system of FIG. 1 based on the visualization tool of FIG. 13. DETAILED DESCRIPTION OF THE INVENTION

[0030] One or more specific embodiments are described below. In the interest of brevity in describing these embodiments, not all features of the implementations are described herein. It should be understood that the development of any such implementation, as in any engineering or design project, requires numerous implementation-specific decisions to achieve the developer's particular objectives, including compliance with system- and business-related constraints that may vary from implementation to implementation. Moreover, it should be understood that such a development effort might be complex and time-consuming, but would be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill in the art having the benefit of this disclosure.

[0031] When introducing elements of various embodiments of the present disclosure, the articles "a," "an," and "the" are intended to mean the presence of one, two, or more of the element. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there may be additional elements other than the listed elements. Furthermore, references to "one embodiment" or "an embodiment" of the present disclosure are not intended to be interpreted as excluding the existence of additional embodiments that also contain the recited features.

[0032] Theme parks and other such entertainment venues are becoming increasingly popular. Furthermore, there is a high demand for immersive experiences within such entertainment venues. To provide new and exciting experiences, attractions such as ride experiences and scenes (e.g., visual shows including live action, animated figures, and computer-generated imagery) are becoming increasingly complex, involving the integration of lighting, sound, movement, interactive elements, visual media, and the like. While traditional attraction design software can enable attractions to be updated and modified at low cost, using the design software can require specialized knowledge and training. Meanwhile, small-scale design models may not accurately represent all aspects of complex attractions and therefore may not allow for efficient problem solving.

[0033] Alternatively, the disclosed tangible / virtual design system can display media content via projection mapping to more accurately visually represent the texture, color, and surface of an attraction, while also allowing for modifications and updates to solve different design problems. The disclosed tangible / virtual design system can also utilize objects (e.g., ride vehicles, buildings, structures, animated figures, guests, pathways, etc.) that correspond to virtual models. Thus, the disclosed tangible / virtual design system can display virtual models on display surfaces, electronic displays, etc. Objects can be equipped with trackers that enable tracking cameras to identify the movement, position, and orientation of the corresponding virtual models. Furthermore, the tangible / virtual design system can include markers and / or tools that interact with the objects to modify or update the texture, color, surface, and other features of the corresponding models. Thus, the tangible / virtual system provides an interactive experience for attraction design that combines tangible and virtual elements, including customizable features, without the challenges and / or costs associated with the prior art.

[0034] With this in mind, the present disclosure generally relates to a combined tangible / virtual design system for amusement park attractions and / or experiences. The tangible / virtual design system includes any number of object tokens that can represent corresponding virtual models, such as small-scale models (e.g., ride vehicles, buildings, structures, scenery, animated figures, guests, and pathways) or other tangible objects. For example, the object tokens can include machine-readable indicia (e.g., barcodes, quick response (QR) codes, dot patterns, identification numbers, radio frequency (RF) tags, etc.) that allow a camera or other scanning device to detect the object tokens and capture image data, including QR codes. The tangible / virtual design system can identify the corresponding virtual model based on the QR code. The tangible / virtual design system can then generate a visualization of the model based on the virtual model and display the visualization via a projector, electronic display, etc. For example, the object token can correspond to a virtual model of a building, and the tangible / virtual design system can project an image of the building onto a display surface.

[0035] In some embodiments, the object tokens may include trackers, such as retroreflective markers and machine-readable indicia, that enable a camera to identify the movement, position, and orientation of the object tokens and / or projection surface in real time via optical performance capture or optical motion capture. Thus, the tangible / virtual design system may dynamically generate and display projected images on the object tokens and / or display surface that emulate structures, figures, characters, movements, and / or reactions corresponding to other effects (e.g., environmental effects, visual effects, pyrotechnic effects, fluid flow effects) associated with the amusement park attraction or experience. In some embodiments, the object tokens may take the shape of a corresponding virtual model. Additionally or alternatively, the object tokens may include a label that identifies the corresponding virtual model. Thus, the tangible / virtual design system may detect the object tokens and project images in corresponding positions and / or orientations to accurately represent the amusement park attraction or experience, thereby enabling efficient design and problem solving of amusement park attractions or experiences.

[0036] Images can also be projected onto the display surfaces and / or object tokens to create optical illusions of structure, texture, material, or color. For example, to enhance the authenticity and visual representation of an amusement park attraction or experience, any number of projection surfaces can display the texture (e.g., smooth, rough, bumpy, pointed, wavy, etc.) and / or material (e.g., brick, stone, wood, metal, glass, etc.) of a virtual model of an object. In some embodiments, the tangible / virtual design system includes any number of visualization tools that can represent corresponding attributes (e.g., structure, texture, material, color, length, width, perspective or angle, etc.). The visualization tools include machine-readable indicia that enable a camera or other scanning device to detect the visualization tools and capture image data. The tangible / virtual design system can identify the corresponding attributes based on the captured image data and generate and / or update the projected image based on the identified attributes. For example, the tangible / virtual design system can detect and identify a visualization tool that corresponds to a brick material. Thus, the tangible / virtual design system can control the projector to operate and project an image corresponding to the brick material onto the display surface, the object token, and / or the designated area corresponding to the object token.

[0037] Additionally or alternatively, the tangible / virtual design system may detect interactions between object tokens and visualization tools. For example, a camera may determine the proximity between the visualization tool and the object token and / or determine the object token that is closest to the visualization tool. Thus, a visualization of the object token may be generated and / or updated based on the nearby visualization tool. In some cases, a projector may project an image onto a display surface and / or the object token based on the visualization tool.

[0038] As an example, a visualization tool can interact with an object token to change, update, or determine one or more attributes of a virtual model corresponding to the object token. For example, a paintbrush tool can change the color of or apply color to a virtual model based on an interaction between the visualization tool and the object token. The tangible / virtual design system can detect the interaction between the paintbrush tool and the object token and control a projector to update the visualization of the object token (e.g., model virtualization). For example, the paintbrush tool can correspond to color, and the tangible / virtual design system can operate through the interaction between the paintbrush tool and the object token to control a projector to project an image corresponding to the color onto a display surface, the object token, and / or a designated area corresponding to the object token. In another example, a magnifying tool can enable visualization of a virtual model from different perspectives (e.g., a bird's-eye view, a close-up or zoomed-in view, a zoomed-out view, a perspective view) through interaction with the object token. The tangible / virtual design system can detect the interaction between the magnifying tool and the object token and control a projector to update the visualization of the object token. Additionally or alternatively, the tangible / virtual design system may determine physical properties (e.g., length, width, surface area, angle, shape, mass, density, specific heat, odor, color) of the virtual model corresponding to the object token based on the interaction between the visualization tool and the object token. For example, a measurement tool may enable measurements of the virtual model, such as height, length, width, and surface area. Additionally or alternatively, the measurement tool may measure luminosity (e.g., light, brightness), volume, temperature, etc. of the virtual model and / or within a designated area corresponding to the object token.

[0039] In yet another example, one or more filter tools may enable the display of attributes associated with a virtual model corresponding to an object token. Attributes may include cost, brightness, volume, viewing time, user input, and the like. For example, a cost filter tile may cause the tangible / virtual design system to control a projector to project an image corresponding to the cost associated with each portion of the virtual model. Multiple filter tools may also be combined or overlaid to provide a visualization showing multiple attributes of the virtual model. For example, a first filter tool may correspond to the cost of building the virtual model, and a second filter tool may correspond to the amount of time a guest can view the virtual model (e.g., when passing by an object while traveling in a vehicle). By combining filters (e.g., overlaying a first filter tool on top of a second filter tool), the tangible / virtual design system may determine the amount of time a guest can view each portion of the virtual model (e.g., while riding a ride or walking through an attraction system) divided by the cost associated with each corresponding portion of the virtual model. When filter tools are combined in the reverse manner (e.g., a second filter tool on top of a first filter tool), the tangible / virtual design system can determine the cost divided by the amount of time a guest can view each portion of the virtual model. Thus, the visualization tools can modify, vary, or measure one or more attributes of the virtual model for efficient design and problem-solving of amusement park attractions or experiences.

[0040] In one embodiment, the physical / virtual design system includes effect tiles corresponding to environmental effects, visual effects, firework effects, fluid flow effects, and the like. The effect tiles may include machine-readable indicia that enable the physical / virtual design system to determine the corresponding effect and / or markers that enable a camera to determine the position and / or orientation of the effect tile. For example, a clock tile may correspond to the time of day and adjust lighting effects based on the determined position of the sun. The physical / virtual design system may determine the time of day based on the orientation and / or position of the clock tile. A projector may project an image corresponding to a virtual light source based on the time of day and the determined position and angle of the sun. As another example, a weather tile may correspond to a selected weather and adjust lighting effects, environmental effects, and the like for any number of objects. Environmental effects may include wind speed, precipitation, cloud cover, humidity, fog, and the like. Environmental effects may alter the visualization of one or more objects. For example, a projector may project an image of branches and leaves moving in the wind on a landscape object. In this manner, the effect tile may alter the visualization of one or more objects.

[0041] In some cases, the effect tile may include a timeline tool that advances, rewinds, stops, or pauses time in the system. For example, the timeline tool may include a physical device coupled to a display surface, which may be pushed, pulled, or otherwise adjusted relative to the display surface. The display surface may also be coupled to a sensor that may receive an indication of movement of the physical device. In some cases, the tangible / virtual design system may receive the movement indication and adjust the simulation time in the tangible / virtual design system. For example, the tangible / virtual design system may advance the simulation time from morning to afternoon based on the movement indication. In other cases, the tangible / virtual design system may receive the movement indication and adjust the actual project time. For example, when the tangible / virtual design system receives user input indicating the start of a project or the continuation of a project, the tangible / virtual design system may control a camera to capture and store for a period of time an image of the display surface, a projected image, or both, that includes object tokens. In response to receiving the movement indication, the tangible / virtual design system may play the captured image. In other words, the actual time of the project may be reversed. Additionally or alternatively, the tangible / virtual design system may pause or stop playback in response to receiving a movement instruction.

[0042] In some embodiments, the tangible / virtual design system includes a camera object that enables visualization of a point of view based on the position and / or orientation of the player vehicle. The tangible / virtual design system can generate a point-of-view visualization that is displayed on an electronic display and / or display surface. Additionally or alternatively, the tangible / virtual design system can detect interactions between the camera object and other object tokens, such as ride vehicles. For example, interactions between the camera object and other object tokens can indicate selection of the other object tokens, such as ride vehicles, for generation of the point-of-view visualization. Thus, the tangible / virtual design system generates a visualization of a passenger's point of view as the ride vehicle moves along the track. Additionally, any number of the object tokens can include actuators, such as electric motors, for moving the object tokens along or across the display surface.

[0043] The tangible / virtual design system facilitates the design of various attractions or experiences, such as optical illusions generated through lighting effects. One such optical illusion is conventionally referred to as "Pepper's Ghost." The Pepper's Ghost illusion utilizes the reflective properties of translucent or transparent materials (e.g., glass or plastic) to virtually project an image into the scene being viewed by guests. For example, an angled glass pane can be placed in front of the stage, and an image can be projected onto the glass from outside the audience's line of sight, which then partially reflects it back toward the audience. Thus, the audience simultaneously sees the scene presented within the audience's line of sight behind the glass and perceives a reflected image. Depending on the lighting, this effect can give the reflected image a ghostly appearance, as light behind the glass remains visible through the reflected image. Thus, the tangible / virtual design system can determine the position and / or orientation of the reflective material and the object token corresponding to the projected image. Thus, the tangible / virtual design system determines the position and / or orientation of the reflected image to generate a visualization of the reflected image. Additionally or alternatively, the tangible / virtual design system may include an object token corresponding to the reflected image. The tangible / virtual design system may determine the position and / or orientation of two of the projected image, the reflected image, and the reflective material, and identify the position and / or orientation of the remaining object token to complete the visual effect. In some embodiments, the object token may include an actuator, and the tangible / virtual design system may send a signal to control the actuator to move the object token to the identified position and / or orientation.

[0044] In some embodiments, the tangible / virtual design system can include constraints related to the amusement park attraction or experience. For example, the constraints can include speed constraints (e.g., a threshold speed constraint, a maximum speed constraint, and a minimum speed constraint, etc.), turn constraints, and spatial constraints, etc. In another example, the constraints can include brightness constraints (e.g., a minimum brightness constraint, a maximum brightness constraint), volume constraints (e.g., a minimum volume constraint, a maximum volume constraint), and temperature constraints, etc. The tangible / virtual design system can compare the determined positions and / or orientations of the object tokens with any number of constraints and identify design inconsistencies or errors based on the comparison. The tangible / virtual design system can also capture image data to record configurations of different object tokens, tools, etc. Thus, a projector can project images based on the recorded configurations to enable quick setup of the amusement park attraction or experience.

[0045] In some embodiments, object tokens, tools, and the like may be located and detected on the same display surface on which the projected image is displayed. Alternatively, a second staging surface may be used for object detection and position and / or orientation determination, with the display surface being used to display the projected image. Thus, a camera or other image capture device captures image data of objects on the staging surface, and a projector projects an image onto the display surface based on the image data.

[0046] In this manner, the techniques described in this disclosure can facilitate the coordination of composite tangible and virtual representations of an amusement park attraction or experience based on identified objects corresponding to the virtual model, which, at least in some instances, can facilitate the design and problem-solving of the amusement park attraction or experience.

[0047] With this in mind, FIG. 1 illustrates an example tangible / virtual design system 100 that includes a controller 102, a display surface 108, and a secondary display 126. The tangible / virtual design system 100 can be used to design and problem-solve various elements of an amusement park attraction and / or experience. The tangible / virtual design system 100 can include a control system having multiple controllers, such as automation controllers 102. Each controller can have at least one processor 104 and at least one memory 106. The automation controllers 102 can control the operation of any number of image sensors 120 and / or any number of projectors 122 and can process data received from the image sensors 120. The automation controllers 102 can be communicatively coupled to the image sensors 120 and the projectors 122 via any suitable technique for conveying data and control signals (e.g., image content instructions) between the automation controller 102, the image sensors 120, and the projectors 122, such as wireless, optical, coaxial, or other suitable connections. In some embodiments, the automation controller 102, the image sensor 120, the projector 122, or any combination thereof, may include respective communications circuitry, such as an antenna, wireless transceiver circuitry, a wireless transmitter, a wireless receiver, and signal processing hardware and / or software (e.g., hardware or software filters, analog-to-digital or digital-to-analog converters, multiplexers, amplifiers), or any combination thereof, that may be configured to communicate over a wired or wireless communications path, such as via radio frequency communications, infrared communications, Ethernet, satellite communications, broadcast radio, microwave radio, Bluetooth, Zigbee, Wi-Fi, ultra-wideband communications, and near field communications.

[0048] The tangible / virtual design system 100 may also include a display surface 108 capable of displaying image content. The display surface 108 may correspond to the setting of an amusement park attraction or experience. For example, the display surface 108 may be used to design an amusement park attraction or experience using various object tokens 110, visualization tools 112, and effect tiles 114 arranged (e.g., installed) on the display surface 108 or a presentation surface. Additionally or alternatively, the display surface 108 may include a first portion for arranging various objects and tools and a second portion for receiving projected image content (e.g., object visualizations 116) from a projector 122. In some embodiments, the display surface 108 may include any number of projection surfaces, each capable of depicting image content related to the setting of the amusement park attraction and / or experience. For example, if an amusement park ride is to appear to take place in an active volcano, the display surface 108 may depict image content related to the active volcano (e.g., flowing lava, flames, etc.). Image content may include ride vehicles, ride tracks, guests, walkways, buildings, scenery, structures, natural features, and any other suitable components of an amusement park attraction or experience. In some embodiments, display surface 108 may include machine-readable indicia (e.g., barcodes, QR codes, etc.) and / or may include trackers (e.g., trackable markers) located on display surface 108. The machine-readable indicia and / or trackers may be located on or within any suitable portion of display surface 108, where the machine-readable indicia and / or trackers may be concealed so as not to be visible and / or interfere with the projected image.

[0049] It should be understood that the tracker can be in the shape of a rounded cylinder or a light-emitting diode, but can have any suitable shape, including spherical and rectangular prism shapes, etc. The tracker can enable image sensor 120 to sense or resolve the position and / or orientation of display surface 108, such as through optical performance capture or optical motion capture techniques. Optical performance capture or optical motion capture refers to techniques that record objects by capturing data from an image sensor, such as image sensor 120, and a tracker coupled to the surface. In some embodiments, the tracker can be an active element that can emit a distinct signal to image sensor 120. For example, the tracker can emit infrared light, electromagnetic energy, or any other suitable signal that is undetectable by an individual but distinguishable by image sensor 120. Alternatively, the tracker can be a passive element (e.g., a reflector, pigmented portions) that does not emit a signal and that image sensor 120 can accurately distinguish from other portions of display surface 108. In some embodiments, the tracker can be flush with or recessed within the exterior surface of display surface 108. The type and / or configuration of image sensor 120 can be individually selected to correspond to the type of tracker. Image sensor 120 can be designed to receive signals from trackers (e.g., active elements) to sense the position and / or orientation of display surface 108. Additionally or alternatively, image sensor 120 can be designed to identify trackers (e.g., passive elements) on display surface 108.

[0050] The machine-readable indicia and / or trackers may correspond to settings of the amusement park attraction or experience, such as particular landscapes (e.g., forests, volcanoes, mountains, deserts, etc.), particular terrains (e.g., highlands and bodies of water, etc.), particular sections of the amusement park (e.g., themed sections, routes through the amusement park), particular parts of the amusement park attraction or experience (e.g., queues, boarding areas, drop-off areas, effects areas, etc.), or any other suitable locations that can be depicted by image content projected onto display surface 108. Image sensor 120 may generate and transmit image data including images of the machine-readable indicia and / or trackers. Processor 104 may receive the image data via image sensor 120 by scanning a barcode, a QR code, or any other suitable machine-readable indicia. The machine-readable indicia may serve as identifiers for the landscape, terrain, etc. of the amusement park attraction or experience. For example, processor 104 may process the image data to detect the machine-readable indicia and identify corresponding image content to be projected onto display surface 108. The processor 104 may receive and / or retrieve corresponding image content from the memory 106 based on the detected machine-readable indicia and control the operation of the projector 122 to project the image content onto the display surface 108.

[0051] The tangible / virtual design system 100 can also include any number of object tokens 110, which can be positioned (e.g., installed) on the display surface 108 or other suitable surface. The object tokens 110 can include machine-readable indicia and / or trackers disposed on one or more surfaces of the object tokens 110. In some embodiments, the machine-readable indicia and / or trackers can be disposed on or within any suitable portion of the object token 110, where the machine-readable indicia and / or trackers can be concealed so as not to be visible and / or interfere with the projected image. The image sensor 120 can capture image data of the object tokens 110, and the automation controller 102 can detect the object tokens 110 based on the image data. The automation controller 102 can also identify the visualization tool 112 based on the image data. For example, the image sensor 120 can detect the position, orientation, and / or configuration of trackers on the exposed surface of the object token 110 and / or can detect machine-readable indicia on the exposed surface of the object token 110. The image sensor 120 can generate tracker data (e.g., location data, orientation data, configuration data) and / or scan data based on the detected trackers and / or machine-readable indicia. As used herein, location data can include the current position, current orientation, and current configuration of one or more trackers, etc. The automation controller 102 can receive the tracker data and / or scan data and identify corresponding image content based on the tracker data and / or scan data. In some embodiments, the object tokens 110 can correspond to various components of an amusement park attraction or experience, such as buildings, ride vehicles, portions of a ride track, guests, guest paths, natural features, and barriers. For example, one object token 110 placed on the display surface 108 can correspond to a ride vehicle. The automation controller 102 can identify the corresponding ride vehicle based on the tracker data and / or scan data.Additionally, certain object tokens 110 may correspond to a camera or a guest. In some instances, a designer of an amusement park attraction may utilize a camera object token to visualize the perspective or view of a guest viewing an attraction or experience. For example, the image sensor 120 may detect the camera object token and generate position data and / or orientation data based on the detection. The automation controller 102 may determine the perspective or view of the captured camera object based on the position data and / or orientation data and instruct the projector 122 based on the perspective. For example, the automation controller 102 may determine the view in which the camera object token is pointed at another object token on the display surface 108 based on the orientation data. Thus, the automation controller 102 may instruct the projector 122 to project image content including a visual representation of the view from the camera object token. Thus, the tangible / virtual design system 100 may provide a visual representation of the guest's view when viewing an amusement park attraction or experience.

[0052] The automation controller 102 can determine the tracker configuration on the object token 110 and compare it to stored tracker configurations in the memory 106. The automation controller 102 can determine a correlation between the configuration on the object token 110 and one or more stored tracker configurations. Accordingly, the automation controller 102 can identify and / or retrieve image content corresponding to the object token and control the operation of the projector 122 to display this image content. For example, the automation controller 102 can control the operation of the projector 122 to generate one or more object visualizations 116 on the display surface 108. The object visualizations 116 can be image content representing the identified object tokens 110. For example, the projector 122 can project the object visualizations 116 onto the display surface 108. The automation controller 102 can instruct the projector 122 to adjust the object visualizations 116 based on image data from the image sensor 120. For example, the image data may include updated positions of the object tokens 110, updated orientations of the object tokens 110, additional object tokens 110, removed object tokens 110, updated attributes of the object tokens 110 (e.g., color, texture, material, etc.), etc. In some embodiments, the object visualization 116 may include a projective mapping of image content onto the object tokens 110. Additionally or alternatively, the object visualization 116 may correspond to a virtual model displayed on the display 126. Accordingly, the automation controller 102 may control the display 126 to generate and / or update a visual model on the display 126.

[0053] The tangible / virtual design system 100 may include any number of visualization tools 112 that can interact with object tokens 110 positioned on the display surface 108 or any other suitable surface. The visualization tools 112 may include machine-readable indicia and / or trackers located on one or more surfaces of the visualization tools 112. In some embodiments, the machine-readable indicia and / or trackers may be located on or within any suitable portion of the visualization tool 112, where the machine-readable indicia and / or trackers may be hidden from view. The image sensor 120 may capture image data of the visualization tools 112, and the automation controller 102 may detect the visualization tools 112 based on the image data. The visualization tools 112 may interact with the object tokens 110 to update any number of object attributes, such as color, material, and texture. For example, a texture tool and / or a paintbrush tool may be positioned adjacent to and / or in contact with the object tokens 110. The image sensor 120 may detect the paintbrush tool and / or the object tokens 110 and generate image data based on the detection. The automation controller 102 receives the image data and can determine, based on the image data, that the visualization tool 112 meets the interaction criteria (e.g., is within a threshold distance from the object token 110, is in contact with the object token 110).

[0054] The automation controller 102 can also identify the visualization tool 112 based on the image data. For example, the image sensor 120 can detect the position, orientation, and / or configuration of trackers on the exposed surface of the visualization tool 112 and / or can detect machine-readable indicia on the exposed surface of the visualization tool 112. The image sensor 120 can generate tracker data (e.g., location data, orientation data, configuration data) and / or scan data based on the detected trackers and / or machine-readable indicia. The automation controller 102 can receive the tracker data and / or scan data and identify corresponding image content based on the tracker data and / or scan data. For example, the automation controller 102 can determine the configuration of the trackers on the visualization tool 112 and compare it to stored tracker configurations in the memory 106. The automation controller 102 can retrieve image content based on the comparison and control the projector 122 based on the image content. For example, the automation controller 102 can determine that the visualization tool 112 corresponds to a paintbrush tool that adjusts color attributes of the object token 110. The automation controller 102 can retrieve and / or update color attributes of the object tokens 110 and control the projector 122 to display the object visualization 116 based on the adjusted color attributes. Thus, the automation controller 102 can generate and / or adjust the image content (e.g., the object visualization 116) displayed by the projector 122 based on the tracker data, the scan data, and / or the interaction criteria. In another example, a filter tool can correspond to attributes of the object tokens 110, such as cost, brightness, and volume. The tangible / virtual design system 100 can update the visualization of the object tokens 110 based on the filter tool. Multiple filter tools can also be arranged (e.g., stacked) to provide composite attributes of the object tokens 110.The physical / virtual design system 100 can determine the composite attribute based on the position of each of the filter effect tiles.

[0055] The tangible / virtual design system 100 may include any number of effect tiles 114 corresponding to various visual effects that can be displayed on the display surface 108 and / or any object tokens 110 on the display surface 108. The effect tiles 114 may include machine-readable indicia and / or trackers located on one or more surfaces of the effect tiles 114. In some embodiments, the machine-readable indicia and / or trackers may be located on or within any suitable portion of the effect tiles 114, where the machine-readable indicia and / or trackers may be hidden from view. The image sensor 120 may capture image data of the effect tiles 114, and the automation controller 102 may detect the effect tiles 114 based on the image data. The effect tiles 114 may interact with the display surface 108 and / or object tokens 110 to adjust projected image content. For example, a clock effect tile may correspond to the time of day and adjust lighting effects based on the determined position of the sun. The tangible / virtual design system 100 may determine the time of day based on the orientation and / or position of the clock tile. For example, the image sensor 120 may detect the position, orientation, and / or configuration of a tracker on the exposed surface of the effect tile 114 and / or may detect machine-readable indicia on the exposed surface of the effect tile 114.

[0056] The image sensor 120 can generate tracker data (e.g., location data, orientation data, configuration data) and / or scan data based on the detected trackers and / or machine-readable indicia. The automation controller 102 can receive the tracker data and / or scan data and identify corresponding image content based on the tracker data and / or scan data. For example, the automation controller 102 can determine the orientation of the tracker on the clock tile and compare this orientation to stored tracker orientations associated with the clock tile in the memory 106. The automation controller 102 can determine an associated time of day based on the comparison and control the projector 122 based on the time of day. For example, the automation controller 102 can determine that the time is sunset and adjust lighting effects to depict shadows, low brightness, movement of virtual light sources, and the like. The automation controller 102 can control the projector 122 to adjust image content based on the lighting effects. As another example, a weather tile can correspond to a selected weather and adjust lighting effects, environmental effects, and the like for any number of objects. The environmental effects can include wind speed, precipitation, cloud cover, humidity, fog, etc. The environmental effects can change the object visualization 116. For example, the automation controller 102 can control the projector 122 to adjust the image content of wind-moving branches and leaves of a landscape object.

[0057] In one embodiment, the tangible / virtual design system 100 can include a timeline tool 118 coupled to the display surface 108 and / or the motion sensor 124. The timeline tool 118 can include physical devices such as ropes, pulleys, levers, sliders, cranks with or without chains, wires, gears, sliding magnets, cammed physical devices on a timeline track, and / or software tools such as a graphical user interface (GUI) integrated with the display surface 108. For example, the timeline tool 118 can associate a start time (e.g., time point = t0) with a first end of the timeline track and an end time (e.g., time point t = t1) with a second end of the timeline track. In another example, the timeline tool 118 can associate a first point (e.g., a location, spot, mark) on the timeline track with a reversing time (e.g., within the tangible / virtual design system 100), a second point on the timeline track with a paused time, and a third point on the timeline track with a forwarding time. The area between the first end, the second end, and / or the third end can be associated with a speed at which the time can be adjusted. In yet another example, the timeline tool 118 can include a rope that can be pulled, pushed, or otherwise moved relative to the display surface 108. The motion sensor 124 can receive motion instructions, and the automation controller 102 can adjust the simulation time or project time based on the instructions. In another example, the timeline tool 118 can be integrated with a GUI and the display surface 108, and the GUI can receive user input to adjust the time. For example, the automation controller 102 may advance simulation time, reverse simulation time, stop simulation time, or pause simulation time within a simulation presented by the tangible / virtual design system 100 .The automation controller 102 can control the projector 122 to adjust image content based on simulation time. As an example, vehicle throughput can be simulated by advancing simulation time within the tangible / virtual design system 100. In another example, the automation controller 102 can reverse project time, stop project time, or pause project time. The automation controller 102 can control the image sensor 120 to capture images of the display surface 108, including the object tokens 110, visualization tools 112, effect tiles 114, and / or timeline tools 118, over a period of time and store the captured images in the memory 106. The automation controller 102 can also control the projector 122 to store objection visualizations 116 in the memory 106. The automation controller 102 can store the images and / or object visualizations along with a generation time and / or generation date (e.g., project time). In this manner, the automation controller 102 may reproduce stored images by controlling the projector 122 and / or the display 126 in response to receiving movement instructions.

[0058] In some embodiments, display 126 may be provided in the form of a computing device, such as a head-mounted display device, a personal computer, a laptop, a tablet, a mobile device (e.g., a smartphone), or any other suitable computing device. Automation controller 102 may control the operation of display 126 to display image content generated based on various objects detected on display surface 108. In some embodiments, display 126 may be an electronic display, such as a light-emitting diode (LED) display, a liquid crystal display, a plasma display, a projector, or any other suitable electronic display. Additionally or alternatively, display 126 may be a head-mounted display that can be worn on a user's head, and display 126 may be positioned in front of one or both of the user's eyes. Display 126 may display computer-generated images, live images, virtual reality images, augmented reality images, mixed reality images, and the like. In some embodiments, any number of users may view display surface 108 and / or display 126. Thus, multiple users may view and collaborate on display 126 and / or display surface 108 during the design of an amusement park attraction or experience using tangible / virtual design system 100.

[0059] The automation controller 102 may represent a unified hardware component or an assembly of independent components integrated through a communications coupling (e.g., wired or wireless communications). The automation controller 102 may be provided in the form of a computing device, such as a programmable logic controller (PLC), a personal computer, a laptop, a tablet, a mobile device, a server, or any other suitable computing device. The memory 106 may include one or more tangible, non-transitory computer-readable media that store instructions executable by the processor 104 (representing one or more processors) and / or data to be processed by the processor 104. For example, the memory 106 may include random access memory (RAM), read-only memory (ROM), rewritable non-volatile memory such as flash memory, a hard drive, and / or an optical disk. The processor 104 may also include one or more general-purpose microprocessors, one or more application-specific integrated circuits (ASICs), one or more field-programmable logic arrays (FPGAs), any suitable processing circuitry, or any combination thereof.

[0060] Additionally, the memory 106 may store image data acquired via the image sensor 120 and / or algorithms utilized by the processor 104 to facilitate controlling the operation of the image sensor 120 and / or the projector 122. For example, the memory 106 may store image data of one or more users interacting with the display surface 108, the object tokens 110, the visualization tools 112, the effect tiles 114, and / or the timeline tool 118 over a period of time. In other instances, the memory 106 may store image data of the object visualizations 116. The processor 104 may control the generation of the object visualizations 116 via the projector 122. The processor 104 may also process image data to generate control signals for the projector 122 and / or the image sensor 120, control and / or monitor the operation of the display 126, and / or detect and determine the position, orientation, and motion attributes, etc., of any number of the object tokens 110, the visualization tools 112, and the effect tiles 114.

[0061] In some embodiments, the tangible / virtual design system 100 can access, input, and / or output additional data. For example, the additional data can include measured and / or derived data from measurements and / or predictions. The predictions can include mathematical and / or statistical predictions. The additional data can include temperature, humidity, precipitation, wind, clouds, and / or celestial data (e.g., rise and set times, height, angle, location), and the additional data can relate to location (e.g., the location of the object token 110, the location of a data collection site located near the object token 110 (e.g., the data collection site closest to the object token 110)). The additional data can be from internal sources (e.g., measured, derived, and / or predicted by the tangible / virtual design system 100 and / or a user) or external sources. The external sources can include one or more scientific databases, government databases, research databases, and / or other relevant databases. The tangible / virtual design system 100 can display additional data and / or utilize the additional data to derive and display output. This allows the tangible / virtual design system 100 to display conditions (e.g., environmental conditions, astronomical conditions) for a particular time and / or season. The conditions can be related to a particular location (e.g., the location of the object token 110, the location of a data collection site near the object token 110 (e.g., the data collection site closest to the object token 110)). For example, the tangible / virtual design system 100 can display the brightness of light reflecting off at least a portion of the feature represented by the object token 110. For example, the brightness of light reflecting off at least a portion of the feature represented by the object token 110 can be derived from sun position data for a particular coordinate location and / or altitude on Earth and can be specific to a particular time and / or season.Another example may include using historical temperature and humidity data for a particular location on Earth to predict a particular temperature over a period of time (e.g., a particular time and / or season) for one or more features represented by an object token, and displaying the predicted particular temperature, for example, via a color scale of a particular output of the tangible / virtual design system 100.

[0062] In some embodiments, an image sensor 120 can be incorporated into the automation controller 102 to capture images and / or video of the display surface 108, object tokens 110, visualization tools 112, effect tiles 114, etc. The image sensor 120 can generate and / or transmit image data corresponding to the captured images to the automation controller 102. The image sensor 120 can include any number of cameras, such as any number of video cameras, any number of depth cameras capable of determining depth and distance to the display surface 108 or objects, any number of infrared cameras, any number of digital cameras, etc. In some embodiments, the image sensor 120 can process the image data before transmitting it to the automation controller 102. Alternatively, the image sensor 120 can transmit raw image data to the automation controller 102. As a specific example, the image sensor 120 can be an infrared camera operative to detect infrared signals emitted from a tracker. The automation controller 102 can receive information based on such detection and process the information to determine and monitor the position and / or orientation of the display surface 108 and / or objects on the display surface 108. The automation controller 102 can control the operation of the projector 122 based on the detection, position, and / or orientation. For example, the image sensor 120 can detect a tracker on the exposed surface of the display surface 108 and / or any number of objects on the display surface 108 and generate location data and / or orientation data based on the detection. The automation controller 102 can receive the location data and / or orientation data from the image sensor 120 and instruct the projector 122 to depict image content on the projection surface of the display surface 108 and / or the objects on the display surface 108. Thus, the automation controller 102 can generate and / or adjust the image content displayed by the projector 122 based on the location data and / or orientation data.

[0063] The image sensor 120 can also generate image data based on the detection. The automation controller 102 can receive the image data from the image sensor 120 and process the image data to identify corresponding image content to be projected onto the display surface 108 and / or objects on the display surface 108. For example, the image data can include one or more images of the object token 110 corresponding to a vehicle. The image sensor 120 can detect the position, orientation, and / or configuration of a tracker on the exposed surface of the object token 110 and / or can detect machine-readable indicia on the exposed surface of the object token 110. The image sensor 120 can generate tracker data (e.g., location data, orientation data, configuration data) and / or scan data based on the detected tracker and / or machine-readable indicia. The automation controller 102 can receive the tracker data and / or scan data and identify corresponding image content based on the tracker data and / or scan data. For example, the automation controller 102 can determine the configuration of the tracker on the object token 110 and compare it to stored tracker configurations in the memory 106. The automation controller 102 can obtain image content based on the comparison and control the projector 122 based on the image content. Thus, the automation controller 102 can generate and / or adjust the image content displayed by the projector 122 based on the tracker data and / or scan data for the display surface 108 and / or for any number of objects on the display surface 108.

[0064] With this in mind, Figure 2 is a perspective view illustrating an example embodiment 200 of the tangible / virtual design system 100 of Figure 1, including a display surface 108, an image sensor 120, a projector 122, and a display 126, in accordance with an embodiment of the present disclosure. Specifically, the display 126 can be a head-mounted display worn by one or more users to provide computer-generated images, live images, virtual reality images, augmented reality images, mixed reality images, and the like. The image sensor 120 can receive control signals from a control system, such as the automation controller 102 of Figure 1. The image sensor 120 can capture an image 202 of the display surface 108 and any number of object tokens 110, visualization tools 112, and / or effect tiles 114 on the display surface 108. The image sensor 120 may include a camera (e.g., an infrared camera) and may detect trackers, object tokens 110 (individually referred to herein as a first object token 110A, a second object token 110B, a third object token 110C, and a fourth object token 110D), visualization tools 112, and effect tiles 114 (individually referred to herein as first effect tiles 114, 114A and second effect tiles 114, 114B), etc., on the exposed (e.g., top) surface of the display surface 108. The image sensor 120 may detect the display surface 108, the object tokens 110, the visualization tools 112, and the effect tiles 114, etc. The image sensor 120 may transmit image data to a control system based on the detection results.

[0065] The projector 122 can receive control signals (e.g., instructions for image content) from the control system. The projector 122 can project image content 204 onto any number of projection surfaces, such as the display surface 108 and the object tokens 110. For example, the projector 122 can receive a control signal to project image content 204 corresponding to the setting of an amusement park attraction or experience onto the display surface 108. Additionally or alternatively, the display 126 can receive a control signal to display the image content 204. For example, a user can wear the display 126 (e.g., a head-mounted display) and view the tangible / virtual design system 100 in augmented reality, mixed reality, virtual reality, and the like. For example, the display 126 can update images using augmented reality and / or use projection mapping to update images for a mixed reality system. The user can interact with the tangible / virtual design system 100 by adjusting the timeline tool 118, the position of the object tokens 110, and / or the visualization tool 112, and the controller can cause the display 126 to update the image being viewed. Additional users may also wear displays 126 to view the updated images. For example, multiple users may wear displays 126, and control signals may cause the projected image content in each display 126 to be updated in response to an action taken by one user. In other cases, the control signals may cause a first set of displays 126 to be updated but a second set of displays 126 not to be updated, such as when a first group of users is designing a first area of ​​an amusement park attraction and a second group of users is designing a second area of ​​the amusement park attraction. The image content 204 may include landscapes, buildings, structures, scenery, natural features, terrain, and the like. Additionally or alternatively, the image content may include representations of ride vehicles, guests, animated figures, and the like.With this in mind, FIG. 3 is a perspective view illustrating an example embodiment 250 of the tangible / virtual design system 100 of FIG. 1 , including the display surface 108, the timeline tool 118, the image sensor 120, and the display 126, in accordance with an embodiment of the present disclosure. In the illustrated embodiment 250, the display 126 includes an electronic display, such as an LED display, a liquid crystal display, a plasma display, or any other suitable electronic display. In some cases, the display 126 may include a projector (e.g., the projector 122 described with reference to FIG. 2 ) that projects image content 204 onto a screen viewed by multiple users. The display 126 may project the image content 204 to visually represent components and features of a real-world location or structure, such as an amusement park attraction or experience. The display 126 may also project image content 204 (e.g., stored image content captured or sensed by the image sensor 120) of one or more users interacting with the display surface 108, the object tokens 110, the visualization tool 112, the effect tiles 114, and the timeline tool 118, etc. In this manner, one or more users can collaborate within the tangible / virtual design system 100 and view the object visualization 116 on the display 126 in real time or near real time.

[0066] The display surface 108 can also be coupled to a timeline tool 118 and a motion sensor 124, both of which enable the coordination of time within the tangible / virtual design system 100. The timeline tool 118 can include a physical device, and the motion sensor 124 can generate sensor data indicative of the movement of the physical device. As shown, the timeline tool 118 includes a pulley system having a rope 252 and wheels 254 disposed below the display surface 108. The pulley system can be a fixed pulley system, a movable pulley system, a compound pulley system, or the like. The rope 252 can be disposed along the length and width of the display surface 108 to allow multiple users to interact with the rope 252. For example, the rope 252 can be pulled in a clockwise direction (e.g., relative to the display surface 108), a counterclockwise direction (e.g., relative to the display surface 108), upward toward the display surface 108, downward away from the display surface 108, etc. The rope 252 can be coupled to wheels 254, which facilitate the movement of the rope 252. Although one wheel 254 is shown in the exemplary embodiment 250, any suitable number of wheels may be coupled to the display surface 108 to move the rope 252.

[0067] In one embodiment, the timeline tool 118 may include an actuator coupled to the automation controller 102 that can control the actuator to move the rope 252. The actuator may include a mechanical linear actuator, an electric actuator, or the like. For example, the actuator may receive a control signal from the automation controller 102 and adjust the position of the rope 252 based on the signal. While the illustrated timeline tool 118 includes a pulley system, in other embodiments, the timeline tool 118 may include levers, dials, sliders, a GUI integrated with the display 126, or the like. For example, the timeline tool 118 may include a GUI integrated with the display surface 108 that can include one or more inputs (e.g., buttons) related to adjusting time. Thus, the GUI may receive user input indicating time to advance, reverse, and / or pause.

[0068] The motion sensor 124 can generate sensor data indicative of the movement of the rope 252 relative to the display surface 108. For example, the motion sensor 124 can include a pressure sensor, an acceleration sensor, a proximity sensor, a touch switch, a force sensor, etc. The motion sensor 124 can detect the speed of movement, the direction of movement, and / or the position of the rope 252 relative to the display surface 108. For example, the motion sensor 124 can generate sensor data indicative of the rope 252 being in an upper position, a middle position, and / or a lower position and transmit the sensor data to the control system based on the detected position. In another example, the motion sensor 124 can generate sensor data indicative of the movement of the rope 252 in a clockwise direction, a counterclockwise direction, upward, downward, etc. The motion sensor 124 can transmit the sensor data to the control system.

[0069] The control system can receive the sensor data and adjust the simulation time or the actual project time. For example, moving the rope 252 clockwise can correspond to advancing the simulation time, and moving the rope 252 counterclockwise can correspond to reversing the simulation time. In another example, an upper position of the rope 252 can correspond to advancing time, an intermediate position of the rope 252 can correspond to stopping or pausing time, and a lower position of the rope 252 can correspond to reversing time. In some instances, the time adjustment can be related to the speed of movement. For example, moving the rope slowly in a clockwise direction can increment time more slowly than moving the rope quickly. The control system can output control signals based on the sensor data.

[0070] The display 126 can receive control signals (e.g., image content instructions) from the control system to project the image content 204. In some instances, the image content 204 can include an object visualization 116 within the tangible / virtual design system 100. For example, the display 126 can display image content 204 of a ride vehicle progressing through a ride as a rope 252 moves clockwise (e.g., as simulation time progresses). In another example, the image content 204 can include guest throughput at a vendor as simulation time progresses, and the image content 204 can be paused (e.g., stopping or pausing simulation time) if the rope 252 stops moving.

[0071] In other cases, the image content 204 may include image data of one or more users interacting with the tangible / virtual design system 100, and the display 126 may project a playback of the interactions. For example, the image sensor 120 may generate image data of multiple users interacting with the object tokens 110, visualization tools 112, effect tiles 114, etc. over a period of time. The display 126 may project (e.g., play) the image data at a playback speed that may be based on movement instructions.

[0072] With this in mind, FIG. 4 illustrates a flowchart of a method or process 270 for coordinating time (e.g., simulation time, actual time, project time) within the tangible / virtual design system 100 of FIG. 1 in accordance with an embodiment of the present disclosure. While process 270 is described as being performed by the automation controller 102, it should be understood that any suitable device or processing circuitry, such as the processor 104, capable of controlling and / or communicating with components of the tangible / virtual design system 100 may perform process 270. Furthermore, while process 270 is described using a particular order of steps, it should be understood that the present disclosure contemplates performing the described steps in an order different from that illustrated, skipping some described steps, or not performing them entirely. In some embodiments, process 270 may be implemented by executing instructions stored in a tangible, non-transitory computer-readable medium, such as the memory 106, using any suitable processing circuitry, such as the processor 104.

[0073] In block 272, the automation controller 102 receives an indication of a movement of a device (e.g., the timeline tool 118). For example, the timeline tool 118 can move in a clockwise or counterclockwise direction, and the motion sensor 124 can generate sensor data indicative of the movement. The sensor data can also include the speed and / or position of the movement of the timeline tool 118. For example, moving the timeline tool 118 slowly (e.g., moving a small amount within a period of time) can advance or rewind time at a first, slower rate, or moving it more quickly (e.g., moving a larger amount within a period of time) can advance or rewind time further at a second, faster rate.

[0074] In block 274, the automation controller 102 determines whether the instruction is in a first direction. For example, the timeline tool 118 can move in a clockwise or counterclockwise direction relative to the display surface 108. In one example, clockwise movement can be associated with advancing time within the tangible / virtual design system 100, while counterclockwise movement can be associated with reversing time, or vice versa. In another example, the timeline tool 118 can be moved (e.g., relative to the display surface 108) to an upper position, a lower position, and / or an intermediate position. The upper position can be adjacent to the display surface 108, the intermediate position can be adjacent to and / or below the upper position, and the lower position can be adjacent to and / or below the intermediate position. In some cases, the upper position can be associated with advancing time, the lower position can be associated with reversing time, and the intermediate position can be associated with pausing time. In other cases, the upper position can be associated with reversing time and the lower position can be associated with advancing time.

[0075] If the automation controller 102 determines that the instruction is in a first direction, it advances time within the tangible / virtual design system 100 at block 276. The controller 102 can adjust the image data based on the progression of time and control the display surface 108 to project the object visualization 116. For example, the image data can include guest throughput throughout the day at the attraction. The controller 102 can simulate guest throughput over a simulated progression of time based on the timeline tool 118 moving in a first direction. In another example, the image data can include a user interacting with the object token 110, and the controller 102 can advance project time based on the timeline tool 118 moving in a first direction. The process 270 can return to block 272 to receive another instruction for device movement.

[0076] If the automation controller 102 determines that the instruction is not the first direction, then in block 278, the automation controller 102 determines whether the instruction is a second direction. For example, if the first direction is a clockwise movement, the second direction can be a counterclockwise movement. In another example, the second direction can be a movement to a lower position.

[0077] If the automation controller 102 determines that the instruction is in a second direction, then in block 280, the automation controller 102 reverses time within the tangible / virtual design system 100. The controller 102 may adjust the image data based on the reversal of time within the tangible / virtual design system 100 and transmit the image data to the display 126. For example, the image data may include a ride vehicle moving backward within the vehicle. In another example, the image data may include a replay of a user interaction with an object token 110 of the tangible / virtual design system 100 over a period of time. The process 270 may return to block 272 to receive another instruction for device movement.

[0078] If the automation controller 102 determines that the instruction is not in the second direction, it stops or pauses time in the tangible / virtual design system 100 at block 282. For example, pulling the rope 252 laterally or longitudinally relative to the display 126 may be associated with stopping or pausing time in the tangible / virtual design system 100. In another example, placing the rope 252 in an intermediate position may be associated with a stop or pause time. Thus, the controller 102 may determine whether the movement is not in the first direction or the second direction and update the image data to stop or pause at a particular point. The process 270 may return to block 272 to receive an instruction for the movement of the device.

[0079] With this in mind, FIG. 5 is a perspective view illustrating an example embodiment 300 of the tangible / virtual design system 100 of FIG. 1 , including a display surface 108 and a projector 122, in accordance with an embodiment of the present disclosure. The projector 122 can project image content 204 onto the display surface 108 to visually represent components and features of an amusement park attraction or experience. For example, the tangible / virtual design system 100 of FIG. 1 can be used to design a Pepper's Ghost illusion. The Pepper's Ghost illusion utilizes the reflective properties of translucent or transparent materials (e.g., glass, plastic, etc.) to virtually project an image into the scene viewed by guests. For example, an angled glass pane can be placed in front of the stage, and an image can be projected onto the glass from outside the audience's line of sight, where it can be partially reflected by the glass pane back toward the audience.

[0080] As shown in FIG. 5 , a first object token 110, 110A can represent an image designed to be projected toward a second object token 110, 110B representing a reflective material, such as an angled pane of glass. A third object token 110, 110C can represent one or more guests viewing the optical illusion. The image sensor 120 in FIG. 1 can capture image data of the object tokens 110 and determine position data, orientation data, configuration data, and the like for each of the object tokens 110. Additionally or alternatively, the image sensor 120 can capture image data and detect trackers and / or machine-readable indicia of the object tokens 110. The image sensor 120 can identify the object tokens based on the detected trackers and / or machine-readable indicia. In some embodiments, the automation controller 102 can receive the image data and identify the object tokens based on the tracker data and / or scan data generated by the image sensor 120. The automation controller 102 can determine that the first object token 110, 110A corresponds to a device that projects an image to provide a visual effect, the second object token 110, 110B corresponds to a reflective material or surface, and the third object token 110, 110C corresponds to one or more guests. The automation controller 102 can determine the positions and orientations of the first object token 110, 110A and the second object token 110, 110B and generate position and orientation data for the object tokens 110. The automation controller 102 can use the position and orientation data to determine the position and orientation of the reflected image perceived by the audience. Accordingly, the automation controller 102 can instruct the projector 122 to generate an object visualization 116 corresponding to the reflected image. Based on the instructions from the automation controller 102, the projector 122 can project image content 204 onto the display surface 108 at the corresponding position and orientation.Thus, the tangible / virtual design system 100 can accurately represent visual effects to provide a better understanding of an amusement park attraction or experience.

[0081] Additionally or alternatively, any number of the object tokens 110 may include actuators, such as electric motors, that can move the object tokens to different positions along and around the display surface 108. For example, a user may input a desired position and / or a desired orientation of the reflected image within the Pepper's Ghost illusion via a user input interface of the control system or any other suitable input device (e.g., a mouse and keyboard, etc.). Additionally or alternatively, a fourth object token may correspond to the reflected image and be placed on the display surface 108. The image sensor 120 may detect the position and / or orientation of the fourth object token and generate position data and / or orientation data based on the detection. Additionally or alternatively, a user may place a third object token 110, 110C corresponding to one or more guests at the amusement park at a second desired position and / or a second desired orientation. The image sensor 120 may detect the position and / or orientation of the third object token 110, 110C and generate or update position data and / or orientation data based on the detection. The automation controller 102 can receive the position and / or orientation data to determine the position and / or orientation of the first object token 110, 110A and the second object token 110, 110B. In some cases, the automation controller 102 can instruct the projector 122 to project image content corresponding to the determined position and / or orientation. Accordingly, the projector 122 can project markers or indicators on the display surface 108 that indicate the position and / or orientation of the projected image and / or reflective material. Additionally or alternatively, the automation controller 102 can control actuators of the first object token 110, 110A and / or the second object token 110, 110B to move to the determined position and / or orientation.The tangible / virtual design system 100 may also monitor the display surfaces and object tokens 110 for updates to the position and / or orientation of the display surfaces and object tokens 110. Thus, adjusting the position of any of the object tokens 110, 110A, 110B, 110C may adjust the remaining object tokens 110 and / or object visualizations 116.

[0082] In some embodiments, the automation controller 102 can compare the orientation data and / or position data with constraint criteria (e.g., line-of-sight criteria, threshold angles, brightness thresholds, etc.). The automation controller 102 can determine that a reflective image may not be generated based on one or more of these constraint criteria. For example, the automation controller 102 can determine that another object is positioned between the projected image object token 110, 110A and the reflective material object token 110, 110B. Thus, the projected image may not be reflected by the reflective material. The automation controller 102 can instruct one or more components of the tangible / virtual design system 100 based on the constraint criteria. For example, the automation controller 102 can instruct the projector 122 to project image content identifying one or more misplaced object tokens 110. Additionally or alternatively, the automation controller 102 can instruct the projector 122 and / or the display 126 to display a notification indicating the constraint criteria.

[0083] In some embodiments, the tangible / virtual design system 100 can capture image data including the configuration, position, and / or orientation of the object tokens 110, visualization tools 112, and / or effect tiles 114. The image sensor 120 can generate configuration data, position data, and / or orientation data based on the detected objects. The automation controller 102 can receive the configuration data, position data, and / or orientation data and store the data as a particular design. For example, the tangible / virtual design system 100 can receive an input instructing the automation controller to store the data as a design for an amusement park attraction or experience. The automation controller 102 can store the data and images in the memory 106. Thus, the tangible / virtual design system 100 can store a database of any number of amusement park attraction designs. The automation controller 102 can also retrieve the stored designs and control components of the tangible / virtual design system 100 based on the stored designs. For example, the automation controller 102 can retrieve the configuration data, position data, orientation data, image data, and the like. The automation controller 102 can command the projector 122 based on the stored design. For example, the projector 122 can project image content, including indicators for placement of object tokens 110, visualization tools 112, effect tiles, etc., onto the display surface 108 and / or the performance surface. Additionally or alternatively, the automation controller 102 can command actuators of the objects to move the objects to desired positions and / or orientations based on the stored design.

[0084] With this in mind, FIG. 6A is a perspective view of an embodiment of an object token 110 having one or more trackers 330 (individually referred to herein as a first tracker 330A and a second tracker 330B). As shown, the object token 110 comprises a block having a first tracker 330, 330A and a second tracker 330, 330B on its surface. The object token 110 may comprise any suitable shape, size, or color. The automation controller 102 can identify an object visualization 116 (e.g., a virtual model) associated with the object token 110 based on the one or more trackers 330. For example, the first tracker 330, 330A may comprise an identifier (e.g., a number, a barcode, a quick response (QR) code, a radio frequency (RF) tag) stored in the memory 106 that can be associated with the object visualization 116. The automation controller 102 can identify a first tracker 330, 330A on the object token 110 and compare the first tracker 330, 330A to tracker configurations (e.g., numbers, barcodes, QR codes, RF tags) stored in the memory 106. The automation controller 102 can determine a match between the first tracker 330, 330A and one or more stored tracker configurations, identify and / or retrieve image content (e.g., object visualization 116) corresponding to the object token 110, and control operation of the projector 122 to display the image content. For example, the first tracker 330, 330A can correspond to a building, and the automation controller 102 can identify the corresponding building based on the first tracker 330, 330A. The automation controller 102 can control operation of the projector 122 to generate a visualization of the building on the display surface 108.

[0085] Additionally or alternatively, the automation controller 102 can utilize the configuration (e.g., position, orientation) of the second tracker 330, 330B to identify the corresponding object visualization 116. The second tracker 330, 330B can be a unique configuration that can be mapped to a corresponding object visualization 116 stored in a database, such as the memory 106. As shown, the second tracker 330, 330B can be four dots in a rectangular configuration. The automation controller 102 can identify the object token 110 based on the rectangular configuration of the second tracker 330, 330B and identify the corresponding object visualization 116. For example, the second tracker 330, 330B can be associated with a building.

[0086] Additionally, the second trackers 330, 330B can be utilized to determine the position and / or orientation of the object token 110 within the tangible / virtual design system 100. As illustrated, the second trackers 330, 330B include four dots, but the second trackers 330, 330B can include any suitable number of dots. The image sensor 120 can generate image data, and the automation controller 102 can determine tracker data (e.g., location data, orientation data, configuration data) based on the image data. The automation controller 102 can also determine the configuration of the second trackers 330, 330B on the surface of the object token 110 to determine the position, orientation, and / or configuration of the corresponding object virtualization 116. For example, the corresponding object virtualization 116 can be a building, and the building's layout (e.g., windows, doors, rooms) can be determined based on the configuration of the second trackers 330, 330B. In effect, the automation controller 102 can instruct the projector 122 to generate the object visualization 116 based on the configuration of the second trackers 330, 330B on the object token 110.

[0087] 6B is a perspective view of an object token 110 having a tracker 330 and machine-readable indicia 332. As shown, the object token 110 includes a train model on an exposed surface (e.g., a projection surface) having the tracker 330 and machine-readable indicia 332. As shown, the tracker 330 includes four dots positioned across the exposed surface, which the automation controller 102 uses to determine the position and / or orientation of the object token 110 within the tangible / virtual design system 100.

[0088] The object token 110 may also include machine-readable indicia 332, such as a barcode, a QR code, and an RF tag. The illustrated machine-readable indicia 332 includes a QR code, which the image sensor 120 may capture as image data. The automation controller 102 may identify the QR code in the image data and compare the QR code to machine-readable indicia stored in the memory 106. The automation controller 102 may determine a match between the machine-readable indicia 332 and the stored machine-readable indicia to determine an associated object visualization 116. For example, the automation controller 102 may identify one or more attributes of the object token 110, such as color, texture, material, movement speed, number of passengers, and cost. The automation controller 102 may instruct the projector 122 to adjust the object visualization 116 based on the attributes of the object token 110 (e.g., color, texture, material, movement speed indication, number of passengers, cost indication, etc.).

[0089] With this in mind, FIG. 7 illustrates a flowchart of a process 400 for operating the tangible / virtual design system 100 of FIG. 1 in accordance with an embodiment of the present disclosure. While the process is described as being performed by the automation controller 102, it should be understood that any suitable device or processing circuitry, such as the processor 104, capable of controlling and / or communicating with components of the tangible / virtual design system 100, may perform the process 400. Furthermore, while the process 400 is described using a particular order of steps, it should be understood that the present disclosure contemplates performing the described steps in an order different from that illustrated, skipping some described steps, or not performing them entirely. In some embodiments, the process 400 may be implemented by executing instructions stored in a tangible, non-transitory computer-readable medium, such as the memory 106, using any suitable processing circuitry, such as the processor 104.

[0090] In block 402, the automation controller 102 receives image data via the image sensor 120. The image sensor 120 may detect one or more object tokens 110 on the display surface 108 and capture image data based on the detection. In some embodiments, the image sensor 120 may detect image data in the form of trackers 330 and / or machine-readable indicia 332 displayed on the object tokens 110. In block 404, the automation controller 102 may identify the object tokens 110 based on the image data. The automation controller 102 may process the image data to detect the trackers 330 and / or machine-readable indicia 332. In some embodiments, the automation controller 102 may scan the machine-readable indicia 332 to identify corresponding objects (e.g., buildings, ride vehicles, ride paths, guests, scenery, etc.). The automation controller 102 may also determine the configuration of the trackers 330 displayed on the surface of the object tokens 110. Each object token 110 may have a unique configuration of trackers that can be mapped to a corresponding object stored in a database, such as the memory 106. Thus, the configuration of the tracker 330 can serve as an identifier for the object token 110 .

[0091] The automation controller 102 may determine attributes associated with the identified object token 110 (block 406). For example, the automation controller 102 may retrieve physical attributes (e.g., size, color, texture, material, etc.) of the identified object token. For example, the object token 110 may correspond to a ride vehicle. The automation controller 102 may receive and / or retrieve attributes of the ride vehicle, such as design, shape, color, size, number of seats, number of wheels, restraints, presence of one or more passengers, and number of passengers.

[0092] The automation controller 102 may also determine position data for the object token 110 based on the image data (block 408). For example, the automation controller 102 may determine the position of the object token 110 on the display surface 108. The automation controller 102 may also determine the position of the object token 110 relative to one or more other object tokens 110, one or more visualization tools 112, and / or one or more effect tiles 114 on the display surface 108. In block 410, the automation controller 102 may determine orientation data for the object token 110 based on the image data. For example, the automation controller 102 may determine the orientation of a tracker 330 displayed on the surface of the object token 110. The automation controller 102 may determine that the tracker is located on the front, top, back, bottom, side, etc. of the object token 110. Thus, the automation controller 102 may generate orientation data for the object token 110 using the orientation of the tracker 330.

[0093] The automation controller 102 may generate the object visualization 116 based at least in part on the object attributes, the position data, and / or the orientation data (block 412). For example, the automation controller 102 may determine whether the top surface of the ride vehicle object token 110 is facing upward toward the image sensor 120 and / or the projector 122. Accordingly, the automation controller 102 may instruct the projector 122 to project image content including a visualization of the top surface of the ride vehicle onto the object token 110 and / or the display surface 108. Thus, the tangible / virtual design system 100 may provide a visualization to accurately represent features and aspects of the amusement park attraction or experience.

[0094] With this in mind, FIG. 8 illustrates a flowchart of a process 500 for operating the tangible / virtual design system 100 of FIG. 1 in accordance with an embodiment of the present disclosure. While the process is described as being performed by the automation controller 102, it should be understood that any suitable device or processing circuitry, such as the processor 104, capable of controlling and / or communicating with components of the tangible / virtual design system 100, may perform the process 500. Furthermore, while the process 500 is described using a particular order of steps, it should be understood that the present disclosure contemplates performing the described steps in an order different from that illustrated, skipping some described steps, or not performing them entirely. In some embodiments, the process 500 may be implemented by executing instructions stored in a tangible, non-transitory computer-readable medium, such as the memory 106, using any suitable processing circuitry, such as the processor 104.

[0095] In block 502, the automation controller 102 receives image data via the image sensor 120. The image sensor 120 may detect one or more object tokens 110, one or more visualization tools 112, and one or more effect tiles 114 on the display surface 108 and capture image data based on the detection. In some embodiments, the image sensor 120 may detect trackers 330 and / or machine-readable indicia 332 displayed on the object tokens 110, visualization tools 112, and effect tiles 114. In block 504, the automation controller 102 may identify the object token 110 based on the image data. The automation controller 102 may process the image data to detect the trackers 330 and / or machine-readable indicia 332. In some embodiments, the automation controller 102 may scan the machine-readable indicia 332 to identify corresponding objects (e.g., buildings, ride vehicles, ride paths, guests, scenery, etc.). The automation controller 102 may also determine the configuration of the trackers 330 displayed on the surface of the object token 110. Each object token 110 may have a unique configuration of tracker 330 that can be mapped to a corresponding object stored in a database, such as memory 106. The configuration of tracker 330 may thus serve as an identifier for the object token 110.

[0096] In block 506, the automation controller 102 can identify the visualization tool 112 based on the image data. The automation controller 102 can process the image data to detect markers and / or machine-readable indicia displayed on the surface of the visualization tool 112. In some embodiments, the automation controller 102 can control the image sensor 120 to scan the machine-readable indicia to identify the corresponding visualization tool 112 (e.g., a paintbrush tool, a texture tool, a material tool, a magnification tool, a measurement tool, a filter tool, etc.). The automation controller 102 can also determine the configuration of trackers displayed on the surface of the visualization tool 112. Each visualization tool can have a unique configuration of trackers that can be mapped to a corresponding visualization tool stored in a database, such as the memory 106. Thus, the tracker configuration can serve as an identifier for the visualization tool 112.

[0097] At block 508, the automation controller 102 may identify an interaction between the object token 110 and the visualization tool 112 based on the image data. The automation controller 102 may process the image data to determine position data and / or orientation data for the object token 110 and / or the visualization tool 112. The automation controller 102 may utilize the position data and / or orientation data to determine that the visualization tool 112 meets an interaction criteria based on the image data (e.g., is within a threshold distance of the object token 110, is in contact with the object token 110).

[0098] The automation controller may adjust one or more attributes of the object token 110 based on the identified interactions (block 510). For example, the visualization tool 112 may correspond to a material tool that updates material attributes, texture attributes, color attributes, etc. of the object token 110. The automation controller 102 may store the adjusted attributes in the memory 106. In block 512, the automation controller 102 may generate an object visualization 116 for the object token 110 based on the adjusted object attributes and control the projector 122 to project image content based on the adjusted object attributes. Thus, the tangible / virtual design system 100 may generate and / or adjust the object visualization 116 to reflect the interactions between the object token 110 and the various visualization tools 112.

[0099] With this in mind, FIG. 9 illustrates a flowchart of a process 600 for operating the tangible / virtual design system 100 of FIG. 1 in accordance with an embodiment of the present disclosure. While the process is described as being performed by the automation controller 102, it should be understood that any suitable device or processing circuitry, such as the processor 104, capable of controlling and / or communicating with components of the tangible / virtual design system 100, may perform the process 600. Furthermore, while the process 600 is described using a particular order of steps, it should be understood that the present disclosure contemplates performing the described steps in an order different from that illustrated, skipping some described steps, or not performing them entirely. In some embodiments, the process 600 may be implemented by executing instructions stored in a tangible, non-transitory computer-readable medium, such as the memory 106, using any suitable processing circuitry, such as the processor 104.

[0100] In block 602, the automation controller 102 receives image data via the image sensor 120. The image sensor 120 may detect one or more object tokens 110, one or more visualization tools 112, and one or more effect tiles 114 on the display surface 108 and capture image data based on the detection. In some embodiments, the image sensor 120 may detect trackers 330 and / or machine-readable indicia 332 displayed on the object tokens 110, visualization tools 112, and effect tiles 114. In block 604, the automation controller 102 may identify multiple object tokens 110, such as a first object token 110, 110A, a second object token 110, 110B, and a third object token 110, 110C, based on the image data. The automation controller 102 may process the image data to detect the trackers 330 and / or machine-readable indicia 332. In some embodiments, the automation controller 102 can scan the machine-readable indicia 332 to identify the corresponding object (e.g., a building, a ride vehicle, a ride path, a guest, a scene, etc.). The automation controller 102 can also determine the configuration of the tracker 330 displayed on the surface of the object token 110. Each object token 110 can have a unique configuration of trackers that can be mapped to a corresponding object stored in a database, such as the memory 106. Thus, the tracker configuration can serve as an identifier for the object token 110.

[0101] In block 606, the automation controller 102 may generate position data and / or orientation data for one or more of the object tokens 110. In some embodiments, the automation controller 102 may determine distances between the object tokens 110 and angles between the object tokens 110. The automation controller 102 may generate visualization position data and / or visualization orientation data for the object visualization 116 based on the image data (block 608). For example, as shown in FIG. 3 , the position data and / or orientation data of the first object token 110, 110A and the second object token 110, 110B may be utilized to determine the visualization position data and / or visualization orientation data for the object visualization 116. The visualization position data may include a relative position of the object visualization 116 with respect to one or more object tokens 110 and / or an absolute position of the object visualization 116 on the display surface 108. The visualization orientation data may include a relative orientation of the object visualization 116 with respect to one or more object tokens 110 and / or an absolute orientation with respect to the display surface 108 .

[0102] In block 610, the automation controller 102 can generate an object visualization 116 based at least in part on the visualization position data, the visualization orientation data, the identified object token 110, or any combination thereof. The automation controller 102 can detect a first object token 110, 110A and identify that the first object token 110, 110A corresponds to a projected image. The automation controller 102 can receive image content based on the identified first object token 110, 110A and instruct the projector 122 to project the object visualization 116 including a reflected image. Thus, the tangible / virtual design system 100 can display visual effects and visual representations of optical illusions, such as Pepper's Ghost.

[0103] With this in mind, FIG. 10 illustrates a flowchart of a process 700 for operating the tangible / virtual design system 100 of FIG. 1 in accordance with an embodiment of the present disclosure. While the process is described as being performed by the automation controller 102, it should be understood that any suitable device or processing circuitry, such as the processor 104, capable of controlling and / or communicating with components of the tangible / virtual design system 100, may perform the process 700. Furthermore, while the process 700 is described using a particular order of steps, it should be understood that the present disclosure contemplates performing the described steps in an order different from that illustrated, skipping some described steps, or not performing them entirely. In some embodiments, the process 700 may be implemented by executing instructions stored in a tangible, non-transitory computer-readable medium, such as the memory 106, using any suitable processing circuitry, such as the processor 104.

[0104] In block 702, the automation controller 102 receives image data via the image sensor 120. The image sensor 120 may detect one or more object tokens 110, one or more visualization tools 112, and one or more effect tiles 114 on the display surface 108 and capture image data based on the detection. In some embodiments, the image sensor 120 may detect trackers and / or machine-readable instructions displayed on the object tokens 110, the visualization tools 112, and the effect tiles 114. In block 704, the automation controller 102 may identify the object token 110 based on the image data. The automation controller 102 may process the image data to detect the tracker 330 and / or the machine-readable indicia 332. In some embodiments, the automation controller 102 may scan the machine-readable indicia 332 to identify the corresponding object (e.g., a building, a ride vehicle, a ride path, a guest, a scene, etc.). The automation controller 102 may also determine the configuration of the tracker displayed on the surface of the object token 110. Each object token 110 may have a unique configuration of tracker 330 that can be mapped to a corresponding object stored in a database, such as memory 106. The configuration of tracker 330 may thus serve as an identifier for the object token 110.

[0105] In block 706, the automation controller 102 may determine that at least one of the object tokens 110 corresponds to a position and / or orientation for the object visualization 116. For example, the object tokens 110 may correspond to a position and / or orientation of a reflected image for a pepper's ghost illusion. The automation controller 102 may determine location data (e.g., position data and / or orientation data) for any number of the object tokens 110 based on the position and / or orientation of the reflected image (block 708). For example, the automation controller 102 may determine position data and / or orientation data for a reflective material object token and / or a projected image object token to facilitate the design of the illusion.

[0106] In block 710, the automation controller 102 may adjust the position and / or orientation of the reflective material object token and / or the projected image object token based on the position data and / or the orientation data. The automation controller 102 may instruct actuators of the display surface 108 and / or the object token 110 to move the object token to the adjusted position and / or adjusted orientation. Additionally or alternatively, the automation controller 102 may instruct the projector 122 to project a marker or indicator onto the display surface 108 that corresponds to the adjusted position and / or adjusted orientation.

[0107] With this in mind, FIG. 11 illustrates a flowchart of a process 800 for operating the tangible / virtual design system 100 of FIG. 1 in accordance with an embodiment of the present disclosure. While the process is described as being performed by the automation controller 102, it should be understood that any suitable device or processing circuitry, such as the processor 104, capable of controlling and / or communicating with components of the tangible / virtual design system 100, may perform the process 800. Furthermore, while the process 800 is described using a particular order of steps, it should be understood that the present disclosure contemplates performing the described steps in an order different from that illustrated, skipping some described steps, or not performing them entirely. In some embodiments, the process 800 may be implemented by executing instructions stored in a tangible, non-transitory computer-readable medium, such as the memory 106, using any suitable processing circuitry, such as the processor 104.

[0108] In block 802, the automation controller 102 receives image data via the image sensor 120. The image sensor 120 may detect one or more object tokens 110, one or more visualization tools 112, and one or more effect tiles 114 on the display surface 108 and capture image data based on the detection. In some embodiments, the image sensor 120 may detect trackers and / or machine-readable instructions displayed on the object tokens 110, the visualization tools 112, and the effect tiles 114. In block 804, the automation controller 102 may identify the object token 110 based on the image data. The automation controller 102 may process the image data to detect markers and / or machine-readable indicia. In some embodiments, the automation controller 102 may scan the machine-readable indicia to identify corresponding objects (e.g., buildings, ride vehicles, ride paths, guests, scenery, etc.). The automation controller 102 may also determine the configuration of trackers displayed on the surface of the object token 110. Each object token 110 may have a unique configuration of the tracker 330 that can be mapped to a corresponding object stored in a database, such as the memory 106. The configuration of the tracker may thus serve as an identifier for the object token 110.

[0109] The automation controller 102 may determine attributes associated with the identified object tokens 110 (block 806). For example, the automation controller 102 may retrieve physical attributes (e.g., size, color, texture, material, etc.) of the identified object tokens. For example, the object tokens 110 may correspond to ride vehicles. The automation controller 102 may receive and / or retrieve attributes of the ride vehicles, such as design, shape, color, size, number of seats, number of wheels, restraints, etc. In block 808, the automation controller 102 may generate position data and / or orientation data for one or more of the object tokens 110. In some embodiments, the automation controller 102 may determine distances and orientations between the object tokens 110, the visualization tools 112, and the effect tiles 114. Additionally or alternatively, the automation controller 102 may also determine speeds or velocities associated with the object tokens 110, the visualization tools 112, and the effect tiles 114. In some embodiments, the movement of the object tokens 110 may be scaled relative to a life-size model. For example, guest object tokens may move at a fraction of the speed of an actual guest of an amusement park attraction or experience (e.g., 1 / 5, 1 / 10, 1 / 20, etc.), ride vehicle object tokens may move at a fraction of the speed of a full-scale ride vehicle, and ride vehicle object tokens may move a fraction of the distance of a full-scale ride vehicle.

[0110] In block 810, the automation controller 102 may determine whether any of the object tokens meet at least one constraint criterion. For example, the constraint criterion may include a maximum speed criterion for the ride vehicle. The automation controller 102 may compare the determined speed of the ride vehicle object token to the maximum speed criterion. If the determined speed exceeds the maximum speed criterion (NO path from block 810), the automation controller 102 may generate a notification based on the deviation from the constraint criterion (block 814) and instruct the projector 122 and / or the display 126 to display the notification. If the determined speed is within the maximum speed criterion (YES path from block 810), the automation controller 102 may generate and / or adjust the object visualization 116 based on the movement of the object token 110 (block 812).

[0111] 12A-12D are schematic diagrams illustrating an example embodiment of the visualization tool 112 of the tangible / virtual design system 100 of FIG. 1. The visualization tool 112 may include one or more trackers and / or machine-readable indices disposed on one or more surfaces, which may be captured by the image sensor 120. Thus, the automation controller 102 may identify the type of visualization tool 112 based on the one or more trackers and / or machine-readable indices in the image data. Furthermore, the automation controller 102 may identify an interaction between the visualization tool 112 and the object token 110 and control the projector 122 to update the object visualization 116 based on the interaction. For example, the interaction may trigger updates to object attributes (e.g., color, material, texture) and measurements (e.g., length, width, angle, angular motion, brightness, volume, temperature).

[0112] With this in mind, FIG. 12A is a schematic diagram illustrating an example embodiment of the visualization tool 112 of the tangible / virtual design system 100 of FIG. 1 as a paintbrush tool 112, 112A. As shown, the paintbrush tool 112, 112A includes a tracker 850 that includes two dots configured in a line. The automation controller 102 can identify the paintbrush tool 112, 112A by comparing the configuration of the tracker 850 to stored tracker configurations in the memory 106. In some instances, the automation controller 102 can identify the paintbrush tool 112, 112A using the tracker 850 and image processing techniques.

[0113] The paintbrush tool 112, 112A can update one or more object attributes of the object token 110. Specifically, a user can move the paintbrush tool 112, 112A so that it is positioned adjacent to and / or in contact with the object token 110. The automation controller 102 can determine that the visualization tool 112 corresponds to the paintbrush tool 112, 112A to adjust a color attribute of the object token 110. The automation controller 102 can control the projector 122 to retrieve and / or update the color attribute of the object token 110 and display the object visualization 116 based on the adjusted color attribute. For example, a user can select (e.g., via a GUI or an input on the paintbrush tool 112, 112A) a color attribute to be applied by or associate the paintbrush tool 112, 112A with a color attribute. Placing the paintbrush tool 112, 112A adjacent to and / or in contact with the object token 110 can cause the projector 122 to project an image having the color of the color attribute onto the object token 110, causing the object token 110 to appear that color. In another example, the paintbrush tool 112, 112A can adjust the texture attribute, material attribute, and any other suitable visual attribute of the object token 110. Thus, the automation controller 102 can generate and / or adjust the image content (e.g., the object visualization 116) displayed by the projector 122 based on the tracker data, the scan data, and / or the interaction criteria.

[0114] With this in mind, FIG. 12B is a schematic diagram illustrating an example embodiment of the visualization tool 112 of the tangible / virtual design system 100 of FIG. 1 as a magnification tool 112, 112B. As shown, the magnification tool 112, 112B includes a tracker 850 that includes three dots on the outer edge of the magnification tool 112, 112B. The automation controller 102 can determine the configuration of the tracker 850 on the magnification tool 112 and compare it to stored tracker configurations in the memory 106 to identify the magnification tool 112, 112B.

[0115] The magnification tool 112B can adjust the perspective of the object token 110 and / or a portion of the tangible / virtual design system 100, such as the image content 204, that the user views via the projector 122 and / or display 126. For example, a user may desire a close-up or zoom-in on a 10 centimeter (cm) by 10 cm area on the display surface 108 and can point the magnification tool 112, 112B toward and / or hover the magnification tool 112, 112B over the area. The automation controller 102 can determine the position of the magnification tool 112, 112B and control the projector 122 and / or display 126 to display a close-up view of the 10 cm by 10 cm area. In another example, a user may desire a bird's-eye view (e.g., a top perspective view) of the object token 110 and can hover the magnification tool 112, 112B over the object token 110. The automation controller 102 can identify an interaction between the magnification tool 112, 112B and the object token 110 and control the projector 122 and / or the display 126 to display a bird's-eye view of the object token 110. In some instances, a user can move the magnification tool 112, 112B for a side perspective view of the object token 110, and the automation controller 102 can control the projector 122 to update the projection to the side perspective view and / or control the display 126 to update the displayed image content 204 to the side perspective view. In this manner, a user can adjust the position or orientation of the magnification tool 112, 112B to adjust the perspective view of the object token 110 (e.g., projected by the projector 122 or display 126).

[0116] 12C is a schematic diagram illustrating an example embodiment of the visualization tool 112 of the tangible / virtual design system 100 of FIG. 1 as an angle measurement tool 112, 112C. The angle measurement tool 112, 112C may include machine-readable indicia 852 (e.g., barcode, QR code, RF tag) on ​​an exposed surface. The image sensor 120 may generate image data including the machine-readable indicia 852, and the automation controller 102 may identify a corresponding visualization tool based on the image data.

[0117] The angle measurement tool 112, 112C can measure angles within the tangible / virtual design system 100. As shown, the angle measurement tool 112, 112C includes a first wing 854, 854A, a second wing 854, 854B, and a hinge 856 between the two wings 854. To extend the length of the first wing 854, 854A and the second wing 854B, one or more laser emitters (e.g., laser pointers) can be integrated along one or more longitudinal edges of the wing 854. In this manner, light 860 from the laser emitters can be emitted from the first wing 854A and the second wing 854, 854B, respectively. To measure an angle (e.g., between object tokens 110, between structures on the display surface 108 representing buildings or other structures), the first wing 854, 854A can be aligned with a first point (e.g., the first object token 110, 110A) and the second wing 854, 854B can be aligned with a second point (e.g., the second object token 110, 110B). In some cases, light 860 can be emitted from the first wing 854, 854A, the second wing 854, 854B, or both, and intersect with the object token 110. The image sensor 120 can capture image data of the angle measurement tool 112, 112C, including the first wing 854, 854A, the second wing 854, 854B, and the hinge 856, as well as the first object token 110 and the second object token 110. The automation controller 102 can receive the image data and determine the angle between the first point and the second point by determining the angle 858 between the first wing 854, 854A and the second wing 854, 854B. As an example, the angle measurement tool 112, 112C can determine the angle between the object virtualization 116 and a wall of the tangible / virtual design system 100. The first wing 854, 854A can be aligned with the corresponding object token 110, and the second wing 854, 854B can be aligned with the second object token 110.The automation controller 102 can receive this interaction indication and determine the angle 858 between the object virtualization 116 and the wall.

[0118] In another example, the angle measurement tools 112, 112C can be used to detect angular movement of the object token 110 and / or the corresponding object virtualization 116. In another example, the angle measurement tools 112, 112C can be used to determine the surface area of ​​the object token 110. In yet another example, the angle measurement tools 112, 112C can determine the amount and / or angle of light within the tangible / virtual design system 100. For example, the angle measurement tools 112, 112C can measure light from a first direction. In practice, the first wing 854, 854A can point to the direction of incident light, and the second wing 854, 854B can point to a reference or viewing direction to measure ambient light in the reference or viewing direction within the tangible / virtual design system 100. Additionally or alternatively, the angle measurement tool 112, 112C may measure light within an angle 858 between the first wing 854, 854A and the second wing 854, 854B.

[0119] With this in mind, Figure 12D is a schematic diagram illustrating an example embodiment of the visualization tool 112 of the tangible / virtual design system 100 of Figure 1 as a ruler tool 112, 112D. As shown, the ruler tool 112, 112D can include machine-readable indicia 852 (e.g., barcode, QR code, RF tag) on ​​an exposed surface, and the automation controller 102 can receive sensor data including the machine-readable indicia 852 to identify the ruler tool 112, 112D.

[0120] The ruler tool 112, 112D can measure physical attributes of the object visualization 116, the object token 110, and / or other structures within the tangible / virtual design system 100. For example, the ruler tool 112, 112D can interact with the object token 110 to cause the automation controller 102 to determine physical attributes of the corresponding object visualization 116. In some cases, the range of the ruler tool 112D can be extended to improve measurements. Accordingly, the first and second ends of the ruler tool 112, 112D can each include a laser emitter (e.g., a laser pointer) that generates (e.g., emits) a linear beam of light 860. As a result, the range of the ruler tool 112, 112D can be extended beyond the length of the ruler tool 112, 112D.

[0121] The automation controller 102 determines physical attributes of the object tokens 110. For example, a user can select a physical attribute to be determined (e.g., length, width, surface area) via a GUI and / or input on the ruler tool 112, 112D. Interaction between the ruler tool 112, 112D and one or more object tokens 110 can cause the automation controller 102 to determine physical attributes associated with the object visualization 116 corresponding to the object token 110 and control the projector 122 to project the physical attributes. For example, the automation controller 102 can determine the length of an edge of the object visualization 116 in response to the ruler tool 112, 112D being positioned adjacent to an edge of the object token 110. In another example, the automation controller 102 can determine the distance between two object visualizations 116. For example, the ruler tool 112, 112D can be positioned between two object tokens 110 to cause the automation controller 102 to determine the distance between the two corresponding object visualizations 116. In some cases, the length of the ruler tool 112, 112D may not extend from the first object token 110, 110A to the second object token 110. Therefore, light 860 can be emitted from the first end, the second end, or both to extend the length of the ruler tool 112, 112D. The light 860 emitted from the first end can intersect with the first object token 110, 110B, and the light 860 emitted from the second end can intersect with the second object token 110, 110B. In this manner, a user can visually confirm that a measurement is being taken between the first object token 110, 110A and the second object token 110, 110B. Additionally or alternatively, the automation controller 102 can receive image data indicative of the first object token 110, 110A, the second object token 110, 110B, and the light 860, and can determine a measurement value in response to receiving the image data.For example, a first object token 110, 110A may correspond to a building, and a second object token 110, 110B may correspond to a ride attraction. Thus, the measurement determined by the automation controller 102 may correspond to the distance between the building and the ride attraction. Additionally or alternatively, a ruler tool 112, 112D may be utilized to obtain dimensions (e.g., length and width) of a room within the physical / virtual design system 100.

[0122] The visualization tool 112 may include one or more of the embodiments described with respect to FIGS. 12A-12D , including, but not limited to, other tools such as a pen, pencil, input device (e.g., mouse, display), AR / VR control device, laser pointer, presentation clicker, and / or any combination of the above. Any of the tools, object tokens, sensors, or other components of the system may include controls that can make decisions and / or send instructions. These controllers may be communicatively coupled to the automation controller 102, receiver, transceiver, and / or transmitter to send and / or receive instructions. Any controller and / or combination of controllers of the present disclosure may perform the controller functions described in the present disclosure.

[0123] With this in mind, FIG. 12E is a block diagram of an example embodiment of a visualization tool 112 of the tangible / virtual design system 100. The visualization tool 112 may include a first end 862 and a second end 864. The visualization tool 112 may also include identification information 866, such as an image, text, color, number, and / or pattern, to provide the user with the identification information 866. For example, a user may use the identification information 866 to distinguish between each of the visualization tools 112 described above. Additionally or alternatively, a system (e.g., the automation controller 102) may use the identification information 866 to identify each visualization tool 112. For example, the automation controller 102 may identify the visualization tool 112 based on the tracker 850. In another example, the automation controller 102 may identify the visualization tool 112 based on a machine-readable indicia 852. The machine-readable indicia 852 may include a QR code, a barcode, an RFID, a light pulse, or the like. The automation controller 102 may identify the visualization tool 112 using sensors 853, such as an RFID reader, a QR reader, a barcode reader, a photodetector, a camera, etc. Additionally or alternatively, the visualization tool 112 may include sensor(s) 853 that can be used to identify the type of visualization tool 112, measure and / or track the position and / or orientation of the visualization tool within the tangible / virtual design system 100, and / or measure and / or identify a parameter within the tangible / virtual design system 100 (e.g., the distance between two or more object tokens 110), such as distance sensors (e.g., distance sensors that use light (e.g., laser light) and / or sound), accelerometers, proximity sensors, LiDAR sensors, infrared sensors, and ultraviolet sensors.

[0124] The visualization tool 112 may include input device(s) 868, such as buttons, a touch screen, a dial, a touchpad, and a microphone. The visualization tool 112 may receive input (e.g., from a user) to determine the type of visualization tool 112 and / or measurement parameters. For example, a user may select the type of visualization tool 112 using the input device(s) 868. In another example, gesture recognition may be used to adjust parameters while the user is interacting with the visualization tool 112. For example, the automation controller 102 may receive sensor data from the image sensor 120 and identify a user gesture (e.g., movement), such as the user's free hand, while the user is interacting with the visualization tool 112. In some embodiments, the type of visualization tool 112 and / or measurement parameters may be set by default. The automation controller 102 may dynamically update the type of visualization tool 112 and / or the parameters measured by the visualization tool 112. To this end, the visualization tool 112 can include output device(s) 870, such as light emitters (e.g., LEDs, lasers) and / or sound emitters. The visualization tool 112 can dynamically update from emitting light to emitting sound. Additionally or alternatively, the automation controller 102 can receive voice commands from the user. For example, the visualization tool 112 can generate audio recordings via a sensor 853, such as a microphone, that can be partially integrated with and / or coupled to the visualization tool. In another example, the tangible / virtual design system 100 can include one or more audio input devices (e.g., microphones). Thus, the efficiency of the tangible / virtual design system 100 can be increased by reducing the steps performed by the user.

[0125] In some embodiments, the visualization tool 112 may include a brightness tool, a volume tool, a temperature tool, an odor tool, and / or other tools that measure characteristics of the object tokens 110 and the corresponding object visualizations 116. In some instances, the brightness tool may interact with at least a portion of the object tokens 110 to cause the automation controller 102 to determine the brightness (e.g., luminance) level of the corresponding object visualization 116. For example, the first end 862 of the brightness tool may interact with the object tokens 110, 110A to measure and / or determine a corresponding brightness value. The brightness tool may also measure a change in brightness level from the first end 862 of the visualization tool and the second end 864 of the visualization tool. For example, the brightness tool may measure and / or determine a difference in brightness level between the brightness associated with the first object token 110, 110A and the brightness associated with the second object token 110, 110B. For example, the brightness tool can measure and / or determine a brightness associated with at least a portion of a first object token 110, 110A located at, near, or in front of the first end 862 of the brightness tool and measure and / or determine a brightness associated with at least a portion of a second object token 110, 110B, and the brightness tool and / or automation controller 102 can determine a brightness difference associated with at least a portion of the first object token 110, 110A and at least a portion of the second object token 110, 110B. Additionally or alternatively, the brightness tool can indicate to the automation controller 102 where (e.g., a location relative to the location of the token indicated by the tool) to measure and / or determine a brightness level associated with at least a portion (e.g., a portion, end) of that token. The brightness tool can include light emitted from the first end 862, the second end 864, or both to extend the range of the brightness tool.For example, light emitted from the first end may intersect a first object token 110, 110A, and light emitted from the second end 864 may intersect a second object token 110, 110B. As a result, the brightness tool and / or automation controller 102 may determine and / or compare (e.g., determine a difference between) brightnesses associated with at least a portion of any object token 110 intersected by light emitted from either end of the brightness tool (e.g., at least a portion of the first object token 110, 110A intersected by light emitted from the first end 862 of the brightness tool and at least a portion of the second object token 110, 110B intersected by light emitted from the second end 864 of the brightness tool).

[0126] In another example, a volume tool can interact with an object token 110 to cause the automation controller 102 to determine the volume of, near, and / or at least partially output by a corresponding object virtualization 116, and / or a change in volume between two corresponding object virtualizations 116. For example, the volume tool can measure and / or determine the volume associated with (e.g., occurring in the area of) and / or at least partially output by a first object token 110, 110A located at, near, or in front of the first end 862 of the volume tool. Additionally or alternatively, a second object token 110, 110B can be positioned at the second end 864 of the volume tool, and the volume tool can determine the volume of, around, and / or output by the first object token 110, 110A and the second object token 110, 110B, or the difference in volume between the first end 862 and the second end 864 of the volume tool. Additionally or alternatively, the volume tool may indicate to the automated controller 102 where (e.g., a location relative to the location of the token indicated by the tool) to measure and / or determine the volume associated with at least a portion (e.g., a portion, end) of the token. To extend the range of the volume tool, light may be emitted from the first end 862, the second end 864, or both.Thus, the volume tool and / or automation controller 102 can determine a volume associated with at least a portion of any object token 110 intersected by light emitted from either end of the volume tool (e.g., at least a portion of the first object token 110, 110A intersected by light emitted from the first end 862 of the brightness tool) and / or measure and / or derive a volume difference between at least a portion of any two object tokens 110 intersected by light emitted from either end of the volume tool (e.g., at least a portion of the first object token 110, 110A intersected by light emitted from the first end 862 of the brightness tool and at least a portion of the second object token 110, 110B intersected by light emitted from the second end 864 of the brightness tool). The light can intersect the object tokens 110 to provide a visual indication to the user that a measurement and / or determination is being made.

[0127] In yet another instance, interaction between a temperature tool and an object token 110 can cause the automation controller 102 to determine the temperature of the corresponding object virtualization 116. For example, the temperature tool can measure and / or determine a temperature associated with at least a portion of a first object token 110, 110A located at, near, or forward of the first end 862 of the temperature tool. The temperature tool can also measure a temperature difference associated with at least a first object token 110, 110A located at the first end 862 of the temperature tool and at least a portion of a second object token 110, 110B located at, near, or forward of the second end of the temperature tool, and / or the automation controller 102 can determine a temperature difference between a temperature associated with at least a portion of the first object token 110, 110A and a temperature associated with at least a portion of the second object token 110, 110B. Additionally or alternatively, the temperature tool may indicate to the automation controller 102 where (e.g., a location relative to the location of the token indicated by the tool) to measure and / or determine a temperature associated with at least a portion (e.g., a portion, an end) of that token. Additionally or alternatively, the range of the temperature tool may be extended by light emitted from a first end, a second end, or both. For example, the temperature tool and / or automation controller 102 may determine a temperature associated with at least a portion of any object token 110 intersected by light emitted from either end of the temperature tool, and / or compare (e.g., determine a difference between) two or more temperatures associated with at least a portion of any two object tokens 110 intersected by light emitted from either end of the temperature tool.

[0128] In another case, the smell tool can measure the odor level (e.g., odor intensity) of the corresponding object virtualization 116. The smell tool can measure and / or determine an odor level associated with at least a portion of the first object token 110, 110A located at, near, or in front of the first end 862 of the smell tool. The smell tool and / or automation controller 102 can determine a difference in odor levels associated with at least a portion of the first object token 110, 110A and at least a portion of the second object token 110, 110B located at, near, or in front of the second end 862 of the smell tool. Additionally or alternatively, the smell tool can indicate to the automation controller 102 where (e.g., a location relative to the location of the token indicated by the tool) the odor associated with at least a portion (e.g., a portion, end) of that token should be measured and / or determined. In some cases, the length of the smell tool can be shorter than the distance between the first object token 110, 110A and the second object token 110, 110B. To this end, the range of the smell tool can be extended by light emitted from the first end, the second end, or both. For example, light emitted from the first end 862 can intersect with the first object token 110, 110A, and / or light emitted from the second end 864 can intersect with the second object token 110, 110B. The smell tool and / or the automation controller 102 can determine and / or compare odor levels associated with at least a portion of any object token 110 intersected by light emitted from either end of the smell tool. Additionally or alternatively, the smell tool can measure and / or determine an odor type (e.g., banana scent, rose scent, bread scent) associated with the object token 110. Certain features of a particular visualization tool 112 can be combined with certain further features of other visualization tools.For example, range magnification can be combined with the paintbrush tool 112, 112A such that, instead of bringing the paintbrush tool 112, 112A close to or touching the paintbrush tool 112, 112A, light emitted from one end of the paintbrush tool is directed at the object token 110 to identify the object token for attribute (e.g., color, texture) changes. Thus, the visualization tool 112 can measure and / or determine physical attributes of the object token 110 and corresponding object visualization. In this manner, the tangible / virtual design system 100 can enable efficient design and / or problem solving for amusement park attractions or experiences.

[0129] 13 is a perspective view illustrating an example embodiment 900 of the tangible / virtual design system 100 of FIG. 1 , including a display surface 108, an image sensor 120, and a projector 122, in accordance with an embodiment of the present disclosure. The example embodiment 900 of the tangible / virtual design system 100 is similar to the example embodiment 200 of the tangible / virtual design system 100 described with reference to FIG. 2 , with the addition of a filter tool 902 (e.g., the visualization tool 112 described with reference to FIG. 12 ). The filter tool 902 can be utilized to provide a visual representation of one or more attributes of the object tokens 110. The filter tool 902 can include a cost filter, a brightness filter, a volume filter, a water usage filter, a viewing time filter, a sound level filter, a user-input filter, and the like. The filter tool 902 can include markers and / or machine-readable indicia that can enable the automation controller 102 to detect the filter tool 902 based on image data captured by the image sensor 120. The automation controller 102 can detect the type of filter tool 902 based on the marker and / or machine-readable indicator and update the object visualization 116 based on the type of filter tool 902. For example, the automation controller 102 can control the projector 122 to generate the updated object visualization 116 for display. In this manner, the projector 122 can display heuristic data for the object token 110.

[0130] For example, the automation controller 102 may receive image data that includes a cost filter disposed on the display surface 108. The cost filter may be utilized to generate a cost associated with the object token 110 (e.g., a portion of the object token 110). The automation controller 102 may retrieve the cost associated with the object token 110 from a data structure, such as a database, stored in the memory 106 and update the visualization of the object token 110 to include the cost. For example, a color may be associated with each price range, such as red for high price, yellow for medium price, and green for low price. In another example, a sliding legend may be provided for each price. In yet another example, the cost may be displayed in text next to the object token 110.

[0131] In another example, a brightness filter can be used to provide a visualization showing the object tokens 110 and / or surface brightness within a room. For example, a user may be designing a haunted house and want to understand the amount of light reaching a scare mirror (e.g., a mirror that displays an optical illusion intended to frighten the viewer). The automated controller 102 can generate a composite image of both the object tokens 110 and the amount of light reaching the surface of the scare mirror. In another example, a room may include one or more object tokens 110 representing light sources, and a brightness filter can be set to a threshold amount (e.g., due to brightness constraints, building standards, amusement park standards, etc.). The automated controller 102 can generate a visualization of the room showing brightness above and / or below the threshold amount. For example, the visualization of the room may include portions having brightness below a threshold that can be shaded with a first color or pattern, and portions of the room having brightness above the threshold can be shaded with a second color or pattern.

[0132] Additionally or alternatively, a user can adjust the object token 110 to adjust the brightness within the visualization. For example, the automation controller 102 can update the visualization and / or brightness calculations in response to identifying movement of the object token 110. In effect, the updated visualization of the room can include portions of the room having brightness below a threshold shaded with a first color or pattern and portions of the room having brightness above the threshold shaded with a second color or pattern. In some instances, the adjustment can result in the room visualization being shaded with one color or pattern to indicate brightness below or above the threshold.

[0133] Additionally or alternatively, a volume filter may be used to provide a visualization indicating the sound level on the surface of the object visualization 116 and / or within the room visualization. The volume filter may be set to a threshold amount (e.g., a volume constraint, a building code constraint). The automation controller 102 may generate a room visualization with one or more object visualizations 116 (e.g., corresponding to one or more identified object tokens 110) to indicate that the volume is above or below a threshold level. For example, the object tokens 110 may correspond to speakers and / or any suitable sound system. The automation controller 102 may determine the volume output by each of the corresponding objects based on the configuration of the object tokens 110 to generate the room visualization. In practice, the room visualization may include portions with a volume below the threshold, which may be shaded with a first color or pattern, and portions with a volume above the threshold, which may be shaded with a second color or pattern.

[0134] Additionally, the automation controller 102 may suggest configurations of object tokens 110 that satisfy the constraints. In some instances, the filter tool 902 may receive input (e.g., via a GUI, via an input of the filter tool 902) of constraints (e.g., brightness threshold, volume threshold, energy usage threshold). Returning to the brightness example, a user may use the GUI to set a brightness constraint of 30 lumens within a room visualization. The user may place two object tokens 110 corresponding to light sources on the display surface 108. The automation controller 102 may determine attributes (e.g., light output, position, orientation, configuration, location) of the object tokens' 110 corresponding object visualizations 116 to determine brightness levels in different areas of the room. In response to determining that the brightness may be below a threshold, the automation controller 102 may adjust the position and / or orientation of one or more object visualizations 116 to adjust the brightness in the room to achieve a brightness of 30 lumens at that position and / or orientation.

[0135] In another example, the filter tool 902 can include a physical property filter. The physical property filter can provide geometric properties such as height, length, width, surface area, and volume of the object visualization 116. For example, the object visualization 116 can represent a rock, and a physical property filter can be used to provide physical attributes of the rock, such as the rock material, rock size, and rock weight. In another example, the object visualization 116 can represent a waterfall attraction, and a physical property filter can be used to determine areas of calcium deposits due to running water over a period of time. In yet another example, the object visualization 116 can represent a building, and a physical property filter can be used to determine wind loads on different parts of the building. In some cases, a physical property filter can simulate guest throughput for attractions such as shops, rides, and restaurants. For example, when designing an amusement park, a physical property filter can be used to map guest movement in a crowd flow simulation. The object tokens 110 may correspond to object visualizations 116, such as stores, restaurants, vehicles, or walkways, and adding a physics filter may cause the automation controller 102 to generate a visualization of guest movement relative to the object visualization 116. For example, the automation controller 102 may generate a visualization of guests walking down a walkway to arrive at or leave a store during peak crowd flow periods. Based on the visualization, a user may determine whether the size of the walkway is wide enough to accommodate the guests.

[0136] In yet another example, the filter tool 902 can include a user input tool that causes the automation controller 102 to generate image data including the object visualization 116 and tags (e.g., badges, notifications, text labels, colors). The tags can indicate the most recent user to edit the object visualization 116, the edit date or time, the number of edits, and other suitable edit attributes of the project. For example, the object visualization 116 can be an animated figure that multiple users worked on. The head of the animated figure can have been edited three times by one user. Thus, the object visualization 116 can include tags in the head that indicate the user name and the number of edits. In this manner, the object visualization 116 can be accompanied by editor annotations associated with the project for reference.

[0137] In another example, the filter tool 902 can include an observation time filter. For example, a guest may view certain portions of the object visualization 116 more frequently than other portions. For example, a guest may only see a portion of an object, such as a figurine, from a ride vehicle. The automation controller 102 can update the object visualization 116 to indicate the observation time. As described further with respect to FIG. 14B , the object visualization 116 can be updated to indicate the observation time using a color gradient. For example, a portion of the object visualization 116 can be shaded with a first color or pattern to indicate a high observation time, and another portion of the object visualization 116 can be shaded with a second color or pattern to indicate a low observation time.

[0138] The filter tool 902 can be positioned within a designated area 904 of the display surface 108. For example, the designated area 904 can be a corner of the display surface 108, but can be any suitable area on the display surface 108. The image sensor 120 can generate image data including the filter tool 902 within the designated area 904, and the automation controller 102 can control the projector 122 to update the object visualization 116 based on the filter tool 902. In some cases, two or more filter tools 902 can be utilized to display relationships between characteristics of the filter tools 902. For example, a cost filter can be combined with or stacked on a viewing time filter, and the resulting projection mapping can show the relationship between the cost associated with building and / or maintaining the object virtualization 116 divided by the viewing time by a guest. In another example, a brightness filter can be combined with or stacked on a cost filter, and the resulting projection mapping can show the relationship between the brightness in a room and the cost associated with generating the brightness. Additionally or alternatively, object tokens 110 can be moved or shifted within the tangible / virtual design system 100, and the automation controller 102 can update the object visualization 116 in real time or near real time based on the applied filter tool 902. For example, the object tokens 110 can correspond to one or more light sources within the attraction. The automation controller 102 can determine an operational cost associated with each light source and the brightness (e.g., luminous flux, luminance) of each light source and control the projector 122 to project the visualization. A user can adjust the configuration of the light sources (e.g., by moving one or more object tokens 110), and the automation controller 102 can update the visualization based on the adjusted configuration. For example, adjusting the position of one light source can change the overall brightness and / or operational cost.

[0139] With this in mind, FIGS. 14A, 14B, and 14C illustrate an embodiment of projection mapping using the tangible / virtual design system 100 of FIG. 1. For example, a user can place two object tokens 110 on the display surface 108 for projection mapping. The first object token 110 can correspond to an animated figure 1000, and the second object token 110 can correspond to a ride attraction. For example, the ride attraction can include a track that passes the animated figure 1000, allowing guests to view specific portions of the animated figure 1000 over a period of time. Furthermore, the animated figure 1000 can include moving parts, which can be expensive relative to non-moving parts. To determine such attributes, a user can place one or more filter tools 902 on the display surface 108, and the automation controller 102 can update and / or adjust the object visualization 116 based on the identified filter tools 902. For example, the automation controller 102 can control the projector 122 to project a projection map of the animated figure 1000 based on the filter tool 902 .

[0140] With this in mind, FIG. 14A is a cost projection map of an animated figure 1000 (e.g., associated with object tokens 110 on the display surface 108). Specifically, the display surface 108 may include one or more object tokens 110, including object tokens 110 associated with the animated figure 1000 and object tokens 110 representing ride attractions, and a user may place one or more filter tools 902 (e.g., including cost filters) on the display surface 108 to project the cost projection map of FIG. 14A. The animated figure 1000 may include a monkey with animated eyes 1002 and an animated mouth 1004. For example, both the animated eyes 1002 and the animated mouth 1004 may blink, change color, emit sound, and / or appear to emit light. The remainder of the animated figure 1000, such as the head, ears, and nose, may remain stationary. Therefore, the cost associated with animated eyes 1002 and animated mouth 1004 may be high compared to static parts (eg, head, ears, nose).

[0141] The projection mapping of the animated figure 1000 can indicate the relative cost associated with each portion of the animated figure 1000. As shown, the animated eyes 1002 are white, the animated mouth 1004 is gray, and the remainder of the animated figure is dark gray or black. In some instances, dark colors represent lower costs and lighter colors represent higher costs. For example, the projection mapping can indicate that the animated eyes 1002 are believed to be more expensive to manufacture and / or maintain over a period of time than the animated mouth 1004. The projection mapping can also indicate that the animated mouth 1004 is believed to be more expensive to manufacture and / or maintain over a period of time than the remaining (e.g., static) portions of the animated figure 1000. Thus, a user can visually understand the relative costs associated with each portion of the animated figure 1000. In some instances, a legend can be displayed adjacent to the projection mapping providing the cost corresponding to each color. For example, white can correspond to $5,000 and black can correspond to $500. In other embodiments, the color scale can start with white representing low cost and go to black representing high cost, and the color scale can include red, green and blue, or any suitable color selected by user input.

[0142] With this in mind, FIG. 14B is a viewing time projection map of the animated figure 1000. For example, a user may want to understand how frequently guests are likely to view each part of the animated figure 1000. In one instance, a first object token 110 may be adjacent to a second object token 110, which may correspond to the animated figure 1000 being adjacent to the ride. Thus, a first side 1010 of the animated figure 1000 may face the track of the ride, and guests may view the first side 1010 more frequently (e.g., for a longer period of time) than the second side 1012. In effect, the second side 1012 may face away from the track. To this end, projection mapping of the animated figure 1000 may provide a visualization showing the time during the ride when guests can view each part of the animated figure 1000. For example, the first side 1010 may be white or light gray, generally representing a longer viewing period for guests, compared to the second side 1012, which may generally be black or dark gray.

[0143] In some instances, the ride attraction associated with the second object token 110 may wrap around the bottom of the animated figure 1000. Thus, projection mapping may indicate that the first longitudinal edge 1014 of the animated figure 1000 is generally black or dark gray, and the second longitudinal edge 1016 of the animated figure 1000 is generally white or light gray. In other words, the first longitudinal edge 1014 may be viewed for a shorter period of time than the second longitudinal edge 1016. In some instances, a user may utilize observation time projection to determine attributes of each portion of the animated figure 1000. For example, because guests view the first side 1010 for a longer period of time than the second side 1012, the user may select a relatively inexpensive material for the second side 1012 and a relatively expensive material for the first side 1010. In another example, a user may spend less time designing the second side 1012 than the first side 1010 .

[0144] With this in mind, FIG. 14C is a cost per viewing time projection map of the animated figure 1000. In some instances, a user may want to understand the relationship between two attributes of the object token 1100. Accordingly, the user may combine or stack multiple filter tools 902 to overlay multiple attributes on the object visualization 116. For example, a first filter tool 902, 902A may be combined with a second filter tool 902, 902B, which may include a viewing time filter, or may include a cost filter that may be stacked on the second filter tool 902, 902B. The automation controller 102 may identify the combination or stacking of the first filter tool 902, 902A and the second filter tool 902, 902B to determine a relationship. For example, the automation controller 102 may determine this relationship to be the cost per viewing time associated with each portion of the animated figure 1000.

[0145] As shown in the projection mapping, the animated eye 1002 of the animated figure 1000 may be lighter in color than the rest (e.g., static) parts of the animated figure 1000, such as the head or ears. Thus, the projection mapping can indicate that the cost per observation hour of the animated eye 1002 is higher than the static parts of the animated figure 1000. Also, the first side 1010 of the animated figure 1000 may be lighter in color than the second side 1012, indicating a higher cost per observation than the second side 1012. Based on the visualization, a user may invest more resources in the first side 1010 compared to the second side 1012 because guests are likely to observe it for longer periods of time.

[0146] In some embodiments, the automated controller 102 can generate a projection map of brightness per cost in response to identifying a combined or stacked brightness filter on a cost filter. For example, the eyes 1002 of the animated figure 1000 can emit an amount of light that can be related to cost. In some cases, each eye 1002 can emit light at different times and / or for different lengths of time. Thus, the projection map can visualize differences between the two eyes 1002. A user can also be interested in the observation time of each eye 1002. Thus, a user can arrange brightness filters, cost filters, and observation time filters in a combined or stacked configuration on the display surface 108 to have the automated controller 102 projection map the cost and brightness per observation time of the animated figure 1000. In some embodiments, the eyes 1002 of the animated figure 1000 can emit sound. The filter tool 902 can include a volume filter, a cost filter, and an observation time filter in a combined or stacked configuration. Thus, the automation controller 102 can determine the cost and volume per observation time of each part of the animated figure 1000 and control the projector 122 to project a projection map of the cost and volume per observation time.

[0147] While only certain features of the invention have been illustrated and described herein, many modifications and changes will occur to those skilled in the art and it is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the invention.

[0148] The technology shown and claimed herein refers to and applies to tangible objects and specific examples of a practical nature that will materially improve the art, and thus are not abstract, intangible, or purely theoretical. Furthermore, if any claim appended at the end of this specification contains one or more elements designated as "means for (performing) ... (function)" or "step for (performing) ... (function)," such elements are to be construed under 35 U.S.C. 112(f). Conversely, for any claim containing elements designated in any other manner, such elements are not to be construed under 35 U.S.C. 112(f).

Claims

1. An amusement park attraction design system, comprising: a display surface having a first projection surface and a first tracker coupled to the first projection surface; an object token having a second projection surface and a second tracker coupled to the second projection surface; an image sensor configured to detect the first tracker and the second tracker and generate location data based on the detected first tracker and second tracker; communicatively coupled to the image sensor; receiving the location data provided by the image sensor; Identifying the object token based on the second tracker; receiving image content based on the identified object token; transmitting an indication of image content to be projected onto the second projection surface based on the location data; a controller configured to: communicatively coupled to the controller; receiving the indication of the image content from the controller; projecting the image content onto the second projection surface; a projector configured as described above; An amusement park attraction design system comprising:

2. the controller is configured to determine a current position and a current orientation of the second projection surface based on the location data. The amusement park attraction design system according to claim 1 .

3. The controller identifying the display surface based on the first tracker; receiving second image content based on the identified display surface; generating second indications of second image content to be projected onto the first projection surface based on the location data; 2. The amusement park attraction design system according to claim 1, configured to:

4. The projector includes: receiving the second indication of the second image content from the controller; projecting the second image content onto the first projection surface; 4. The amusement park attraction design system according to claim 3, configured to:

5. the controller is configured to determine a current position and a current orientation of the first projection surface of the display surface based on the location data. The amusement park attraction design system according to claim 3 .

6. The object token is placed on the display surface. The amusement park attraction design system according to claim 1 .

7. The object token is placed on the first projection surface. The amusement park attraction design system according to claim 1 .

8. the first tracker is one of a first set of trackers and the second tracker is one of a second set of trackers, and each tracker of the first and second sets of trackers is configured to emit an infrared signal; The amusement park attraction design system according to claim 1 .

9. the image sensor includes an infrared camera configured to detect the infrared signal; 9. The amusement park attraction design system according to claim 8.

10. 1. A method for displaying image content, comprising: receiving, via a processing circuit, location data and configuration data associated with a first object token and a second object token located on the display surface; identifying, via the processing circuitry, the first object token and the second object token based on the configuration data; receiving, via the processing circuitry, image content based on the identified first object token; generating, via the processing circuitry, position data associated with the image content based on the location data; and generating, via the processing circuitry, an indication of image content to be projected onto the display surface based on the position data; A method comprising:

11. receiving, via the processing circuitry, updated location data associated with the first object token, the second object token, or both; generating, via the processing circuitry, updated position data associated with the image content based on the updated location data; and generating, via the processing circuitry, a second indication of image content to be projected onto the display surface based on the updated position data; and The method of claim 10, comprising:

12. receiving, via the processing circuitry, updated location data associated with the first object token; generating, via the processing circuitry, second position data associated with the second object token based on the updated location data; and generating, via the processing circuitry, instructions to actuate the second object token based on the second position data; The method of claim 10, comprising:

13. receiving second location data and second configuration data associated with a third object token located on the display surface; identifying the third object token based on the second configuration data; receiving second image content based on the identified third object token; generating a second indication of second image content to be displayed on the electronic display based on the second location data; and The method of claim 10, comprising:

14. the third object token corresponds to a camera object token; The method of claim 13.

15. the first object token corresponds to a projector object token and the second object token corresponds to a reflective material object token; The method of claim 10.

16. An amusement park attraction design system, comprising: an object token having a projection surface and a set of trackers coupled to the projection surface; a display surface configured to receive the object token; an image sensor configured to detect the set of trackers and to generate location data and configuration data based on the set of trackers; communicatively coupled to the image sensor; receiving the location data and the configuration data from the image sensor; identifying the object token based on the configuration data; receiving image content corresponding to features of the amusement park attraction based on the identified object token; generating an indication of image content to be projected onto the projection surface based on the location data; a controller configured to: An amusement park attraction design system comprising:

17. the amusement park attraction features include at least one of a ride vehicle, a structure, scenery, a ride track, guests, a path, or any combination thereof; 17. The amusement park attraction design system of claim 16.

18. a visualization tool having a second set of trackers, the image sensor configured to detect the second set of trackers and generate second location data based on the second set of trackers; The controller determining an interaction between the object token and the visualization tool based on the location data and the second location data; modifying attributes associated with the object token based on the interaction; generating second instructions of second image content to be projected onto the projection surface based on the modified attributes; 17. The amusement park attraction design system of claim 16, configured to:

19. an effect tile having a second set of trackers, the image sensor configured to detect the second set of trackers and to generate second configuration data based on the second set of trackers; The controller receiving the second configuration data from the image sensor; identifying the effect tile based on the configuration data; receiving second image content based on the effect tile; generating a second indication of second image content to be projected onto the display surface; 17. The amusement park attraction design system of claim 16, configured to:

20. the controller is configured to generate a second indication of image content to be displayed on the electronic display based on the location data.

17. The amusement park attraction design system of claim 16.

Images