Drop detection system and method

Abstract

A detection system (50) is configured to detect improper manipulation of a wearable visualization device (12). The detection system (50) includes a sensor (40) coupled to the wearable visualization device (12), a light emitter (42) coupled to the wearable visualization device (12), and a processor (54) configured to receive a signal from the sensor (40). The processor (54) is further configured to determine whether the signal indicates improper manipulation of the wearable visualization device (12), and direct illumination of the light emitter (42) in response to determining that the signal indicates improper manipulation of the wearable visualization device (12).

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to and the benefit of U.S. Provisional Application No. 62 / 791,735, filed on January 11, 2019, entitled “AUGMENTED REALITY (AR) HEADSETFOR HIGH THROUGHPUT ATTRACTIONS,” which is hereby incorporated by reference in its entirety for all purposes. Background Art

[0003] This section is intended to introduce the reader to various aspects of the art that may be related to various aspects of the present technology described and / or claimed below. It is believed that this discussion helps to provide background information to the reader to promote a better understanding of various aspects of the present disclosure. Therefore, it should be understood that these statements are to be read from this perspective and are not intended to be an admission of the prior art.

[0004] Amusement parks and / or theme parks are designed to provide entertainment to visitors. Areas of an amusement park may have different themes specifically targeted at certain audiences. For example, some areas may include themes that are traditionally of interest to children, while other areas may include themes that are traditionally of interest to more mature audiences. Typically, such areas with themes may be referred to as landscapes or themed landscapes. It is recognized that it may be desirable to increase the immersive experience of visitors in such landscapes, such as by enhancing the themes with virtual features. Summary of the invention

[0005] The following describes an overview of certain embodiments disclosed herein. It should be understood that these aspects are presented only to provide the reader with a brief overview of these certain embodiments, and these aspects are not intended to limit the scope of this disclosure. In fact, this disclosure may cover various aspects that may not be described below.

[0006] In one embodiment, a detection system is configured to detect incorrect manipulation of a wearable visualization device. The detection system includes a sensor coupled to the wearable visualization device, a light emitter coupled to the wearable visualization device, and a processor configured to receive a signal from the sensor. The processor is further configured to determine whether the signal indicates incorrect manipulation of the wearable visualization device, and direct illumination of the light emitter in response to determining that the signal indicates incorrect manipulation of the wearable visualization device.

[0007] In one embodiment, a wearable visualization device includes a shell, a sensor supported by the shell and configured to detect movement of the wearable visualization device, a light emitter supported by the shell, and a processor configured to receive a signal from the sensor, determine whether the signal indicates that the wearable visualization device has been dropped or thrown based on the detected movement of the wearable visualization device, and direct illumination of the light emitter in response to determining that the signal indicates that the wearable visualization device has been dropped.

[0008] In one embodiment, a method for detecting improper manipulation of a wearable visualization device using a detection system includes receiving a signal from a sensor coupled to the wearable visualization device at a processor. The method also includes determining, using the processor, that the signal indicates improper manipulation of the wearable visualization device. The method also includes counting, using the processor, a number of events of improper manipulation of the wearable visualization device over time. The method also includes directing, using the processor, illumination of a light emitter in response to determining that the number of events exceeds a count threshold.

[0009] Various improvements may be made to the above features with respect to various aspects of the present disclosure. Additional features may also be incorporated into these various aspects. These improvements and additional features may exist alone or in any combination. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] These and other features, aspects and advantages of the present disclosure will become better understood when the following detailed description is read with reference to the accompanying drawings, in which like characters refer to like parts throughout the several views, and in which:

[0011] Figure 1 is a perspective view of a wearable visualization device and an interface device of an augmented reality (AR), virtual reality (VR), and / or mixed reality (a combination of AR and VR) system (AR / VR system) in an engaged configuration according to the present embodiment;

[0012] Figure 2 According to this embodiment, in a split configuration Figure 1 A perspective view of a wearable visualization device and an interface device;

[0013] Figure 3 According to this embodiment, Figure 1 A schematic diagram of components of a detection system of a wearable visualization device;

[0014] Figure 4 According to this embodiment, it can be used Figure 1 A perspective view of a portion of a ride landscape of an AR / VR system;

[0015] Figure 5 According to the use of this embodiment Figure 1 AR / VR system method; and

[0016] Figure 6 According to this embodiment, Figure 1 Schematic diagram of a question presented by a wearable visualization device, wherein the wearable visualization device enables a user to respond to the question with gesture input. DETAILED DESCRIPTION

[0017] One or more specific embodiments will be described below. In order to provide a concise description of these embodiments, not all features of the actual implementation are described in the specification. It should be understood that in the development of any such actual implementation, as in any engineering or design project, many implementation-specific decisions must be made to achieve the developer's specific goals, such as compliance with system-related and business-related constraints, which may vary from implementation to implementation. In addition, it should be understood that such development work may be complex and time-consuming, but it will nevertheless be a routine task of design, fabrication, and manufacturing for those of ordinary skill who benefit from this disclosure.

[0018] When introducing elements of various embodiments of the present disclosure, the articles "a," "an," and "the" are intended to mean that there are one or more elements. The terms "comprising," "including," and "having" are intended to be inclusive, and mean that there may be additional elements other than the listed elements. Additionally, it should be understood that reference to "one embodiment" or "an embodiment" of the present disclosure is not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the described features.

[0019] The amusement park may include an augmented reality (AR), virtual reality (VR), and / or mixed reality (a combination of AR and VR) system (e.g., an AR / VR system) configured to increase the visitor experience of the amusement park landscape by providing the visitor with an AR / VR experience (e.g., an AR experience, a VR experience, or both). In practice, a combination of certain hardware configurations, software configurations (e.g., an algorithmic structure and / or a modeled response), and certain landscape features may be utilized to provide the visitor with an AR / VR experience that may be customizable, personalized, and / or interactive. For example, the AR / VR system may include a wearable visualization device, such as a head-mounted display (e.g., an electronic goggle or display, an eyepiece), which may be worn by the visitor and may be configured to enable the visitor to view virtual features. In particular, the wearable visualization device may be used to increase the visitor experience by overlaying virtual features onto the real-world environment of the amusement park, by providing an adjustable virtual environment to provide different experiences in the landscape, and the like.

[0020] Advantageously, the disclosed embodiments provide a detection system (e.g., a drop detection system) configured to monitor whether a wearable visualization device has been improperly manipulated (e.g., experienced an adverse or potentially damaging event, such as being dropped or thrown). In particular, the detection system may include a sensor (e.g., an inertial measurement unit [IMU]) coupled to the wearable visualization device and configured to monitor one or more parameters (e.g., acceleration and / or deceleration) indicative of the wearable visualization device being improperly manipulated. The sensor may provide a signal indicative of the parameter to a controller (e.g., an electronic controller), the controller may process the signal to determine whether the wearable visualization device has been improperly manipulated, and may cause one or more actions in response to determining that the wearable visualization device has been improperly manipulated. For example, the controller may cause illumination of a light (e.g., a light emitter; light emitting diode [LED]) on the wearable visualization device, on a ride vehicle of an attraction, at an operator station of the attraction, or otherwise provide notification that the wearable visualization device has been improperly manipulated. In some embodiments, the controller may count the number of times the wearable visualization device has been manipulated incorrectly over time (e.g., the number of times the acceleration of the wearable visualization device has exceeded an acceleration threshold, as indicated by a signal from a sensor), and the controller may cause one or more actions in response to the number of times the wearable visualization device has been manipulated incorrectly exceeding the count threshold. Thus, the detection system may facilitate the effective removal of any wearable visualization device that may be damaged due to being manipulated incorrectly, and may facilitate the operation of the AR / VR system so that the visitor can experience the landscape with a functioning wearable visualization device.

[0021] Considering the foregoing, Figure 1 1 is a perspective view of an embodiment of an AR / VR system 10 (e.g., a wearable visualization system) that is configured to enable a user (e.g., a guest, an amusement park employee, an operator of an attraction, a passenger of a ride vehicle) to experience an AR / VR scene (e.g., view an AR / VR scene, interact with an AR / VR scene). As shown, the AR / VR system 10 includes a wearable visualization device 12 (e.g., a head mounted display) and a guest interface device 14, which may be removably couplable to each other to facilitate use of the AR / VR system 10.

[0022] In the illustrated embodiment, the wearable visualization device 12 includes a lens portion 16 coupled to a housing 18 of the wearable visualization device 12. The lens portion 16 may include one or more lenses 20 (e.g., a display; transparent, translucent, or opaque). In some embodiments, the lenses 20 may enable a user to view a real-world environment 22 (e.g., a physical structure in a landscape) through the lenses 20, with certain virtual features 24 (e.g., AR features) overlaid onto the lenses 20 such that the user perceives the virtual features 24 as integrated into the real-world environment 22. That is, the lens portion 16 may at least partially control the user's field of view by overlaying the virtual features 24 onto the user's line of sight. To this end, the wearable visualization device 12 may enable a user to visualize and perceive a hyper-reality environment 26 (e.g., a gaming environment) having certain virtual features 24 overlaid onto the real-world environment 22 that are viewable by the user through the lenses 20.

[0023] By way of non-limiting example, lens 20 may include a transparent (e.g., see-through) light emitting diode (LED) display or a transparent (e.g., see-through) organic light emitting diode (OLED) display. In some embodiments, lens portion 16 may be formed of a single-piece construction across a distance so as to display an image to both eyes of the user. That is, in such an embodiment, lens 20 (e.g., first lens 28, second lens 30) may be formed of a single, continuous piece of material, wherein first lens 28 may be aligned with a first eye of the user, and second lens 30 may be aligned with a second eye of the user. In other embodiments, lens portion 16 may be a multi-piece construction formed of two or more separate lenses 20.

[0024] In some embodiments, the wearable visualization device 12 may fully control the user's field of view (e.g., using an opaque viewing surface). That is, the lens 20 may include an opaque or non-transparent display configured to display virtual features 24 (e.g., VR features) to the user. Thus, the hyper-realistic environment 26 that can be viewed by the user may be, for example, a real-time video that includes a real-world image of the real-world environment 22 electronically merged with one or more virtual features 24. Thus, while wearing the wearable visualization device 12, the user may feel completely surrounded by the hyper-realistic environment 26, and may perceive the hyper-realistic environment 26 as a real-world environment 22 that includes certain virtual features 24. In some embodiments, the wearable visualization device 12 may include features such as a light projection feature that is configured to project light into one or both eyes of the user so that certain virtual features 24 are superimposed on real-world objects that can be viewed by the user. Such a wearable visualization device 12 may be considered to include a retinal display.

[0025] Thus, it should be understood that the hyper-reality environment 26 may include an AR experience, a VR experience, a mixed reality experience, a computer-mediated reality experience, a combination thereof, or other similar hyper-reality environments. Furthermore, it should be understood that the wearable visualization device 12 may be used alone or in combination with other features to create the hyper-reality environment 26. Indeed, as discussed below, a user may wear the wearable visualization device 12 throughout the duration of a ride attraction in an amusement park or during another time period (such as during a game, throughout a particular area or attraction of an amusement park, during a ride to a hotel associated with an amusement park, at a hotel, etc.). In some embodiments, the wearable visualization device 12 may be physically coupled (e.g., tethered via a cable 32) to a structure (e.g., a ride vehicle) to prevent separation of the wearable visualization device 12 from the structure and / or may be electronically coupled (e.g., via a cable 32) to a computing system to facilitate operation of the wearable visualization device 12 (e.g., to display virtual features 24; to monitor whether the wearable visualization device 12 has been improperly manipulated and provide related notifications).

[0026] As shown, the wearable visualization device 12 is removably coupleable (e.g., tool-less coupleable; coupleable without tools; coupleable without threaded fasteners (such as bolts); detachable without tools and without damaging the visitor interface device 14 or components of the wearable visualization device 12) to the visitor interface device 14 so that the wearable visualization device 12 can be moved between an engaged configuration 34 (in which the wearable visualization device 12 is coupled to the visitor interface device 14) and a disengaged configuration 36 (see, e.g., FIG. 1 ). Figure 2 ) (in the disengaged configuration 36, the wearable visualization device 12 is decoupled from the guest interface device 14). In the illustrated embodiment, the guest interface device 14 is configured to attach to the user's head and, therefore, enable the user to comfortably wear the wearable visualization device 12 throughout various attractions or while traversing certain amusement park environments. For example, the guest interface device 14 may include a head strap assembly 38 that is configured to span around the circumference of the user's head and is configured to tighten (e.g., constrict) on the user's head. In this manner, the head strap assembly 38 facilitates attaching the guest interface device 14 to the user's head so that the guest interface device 14 can be used to retain the wearable visualization device 12 on the user (e.g., when the wearable visualization device 12 is in the engaged configuration 34).

[0027] Such a configuration can enable a user or another person (e.g., an operator, a maintenance technician) to effectively couple and decouple the wearable visualization device 12 to the visitor interface device 14 (e.g., when it is determined that the wearable visualization device 12 should be repaired, such as due to being improperly manipulated). However, it should be understood that the wearable visualization device 12 and / or the visitor interface device 14 can have any of a variety of forms or structures that enable the wearable visualization device 12 to function in the manner described herein. For example, the wearable visualization device 12 can be used without a separate visitor interface device 14 and / or the wearable visualization device 12 can be formed integrally with the visitor interface device 14. As shown, the wearable visualization device 12 can include a sensor 40 (e.g., an IMU) and / or one or more lights 42 (e.g., LEDs). As discussed in more detail below, the sensor 40 can be configured to monitor one or more parameters (e.g., acceleration and / or deceleration) that indicate the wearable visualization device 12 has been improperly manipulated, and the light 42 can be configured to illuminate, such as in response to determining (e.g., by the controller) that the wearable visualization device 12 has been improperly manipulated. In this way, even if the wearable visualization device 12 does not appear to be damaged (e.g., upon visual inspection), the wearable visualization device 12 can be identified as potentially damaged and can be flagged for maintenance operations.

[0028] Figure 2 is a perspective view of an embodiment of the AR / VR system 10, illustrating the wearable visualization device 12 and the visitor interface device 14 in a disassembled configuration 36. In some embodiments, the housing 18 may be assembled from a plurality of plates (e.g., housing segments; molded and / or machined plates) such as a cover 44, a base plate 46, and a lens mount 48 (e.g., a plate configured to support the lens portion 16), which may collectively form the housing 18. As discussed below, some or all of the plates may include component mating features (e.g., machined and / or molded features on a surface of the plate) configured to receive and / or couple to various subcomponents of the wearable visualization device 12 (e.g., sensors 40; lights 42; other electronic components, such as a controller).

[0029] As discussed below, after the subcomponents are assembled on one or more of the plates, the plates can be assembled (e.g., coupled to each other via fasteners, adhesives, and / or other techniques) to form the housing 18. Thus, the housing 18 can support the subcomponents and / or encapsulate the subcomponents to substantially seal (e.g., hermetically seal) at least a portion of the subcomponents within the housing 18 to shield the subcomponents from direct exposure to ambient environmental elements (e.g., moisture) surrounding the wearable visualization device 12. It is to be understood that in other embodiments, the housing 18 can be assembled from additional or fewer plates than the cover 44, the base plate 46, and the lens mount 48. Indeed, in certain embodiments, the housing 18 can include 1, 2, 3, 4, 5, 6, or more than six separate plates that, in an assembled configuration, can collectively form the housing 18.

[0030] It should also be understood that the sensor 40 may be positioned at any location of the wearable visualization device 12 and / or any number (e.g., 1, 2, 3, 4, or more) of sensors 40 may be provided. As non-limiting examples, the sensor 40 may be a position sensor and / or an impact sensor, such as an accelerometer, a magnetometer, a gyroscope, a global positioning system receiver, a motion tracking sensor, an electromagnetic and solid-state motion tracking sensor, and / or an IMU. When the sensor 40 is an IMU, the IMU may include a nine-degree-of-freedom system on a chip equipped with an accelerometer, a gyroscope, a magnetometer, and a processor for executing a sensor fusion algorithm. Thus, signals from the IMU may be used to determine the acceleration and / or orientation of the wearable visualization device 12 (e.g., relative to a gravity vector). The wearable visualization device 12 may include different types of sensors 40, such as different types of sensors 40 that detect different parameters (e.g., an IMU that detects acceleration of the wearable visualization device 12 and one or more impact sensors that detect the location of an impact on the wearable visualization device 12).

[0031] Similarly, the lights 42 may be positioned at any location on the wearable visualization device 12 and / or any number (e.g., 1, 2, 3, 4, or more) of lights 42 may be provided. The lights 42 may be positioned to be visible when the wearable visualization device 12 is coupled to the guest interface device 14, to be visible when the wearable visualization device 12 is docked (e.g., coupled to or stored on a structure, such as a ride vehicle), to be visible to a user when the user is wearing the wearable visualization device 12, and / or to be visible to an operator (e.g., a person other than the user) to facilitate visualization of the lights 42 when illuminated.

[0032] Figure 3is a schematic diagram of components of a detection system 50 (e.g., a drop detection system) for a wearable visualization device 12. As shown, the detection system 50 may include the sensor 40 and the light 42 of the wearable visualization device 12. The detection system 50 may also include a controller 52 having a processor 54 and a memory device 56. As shown, the controller 52 is located on the wearable visualization device 12; however, it should be understood that the controller 52 may be located off-site from the wearable visualization device 12, such as on a ride vehicle or on a system located remote from the wearable visualization device 12. In addition, the functions and processing steps described herein as being performed by the controller 52 may be distributed between the controller 52 and any other suitable controller or processing system (e.g., the sensor 40, the ride vehicle, a system located remote from the wearable visualization device 12; the controller 52 may be or may be part of a distributed control system having multiple processors). For example, sensor 40 may be an IMU having a first processor that is configured to count the number of accelerations above an acceleration threshold, and sensor 40 may provide the number to a second processor for further processing and / or enable the second processor to perform some action, such as illuminating light 42. Thus, processor 54 may include one or more processors positioned in any suitable location, and memory device 56 may include one or more memory devices positioned in any suitable location.

[0033] The memory device 56 may include one or more tangible, non-transitory, computer-readable media that stores instructions executable by the processor 54 and / or data to be processed by the processor 54 (e.g., parameters; number of events). For example, the memory device 56 may include a random access memory (RAM), a read-only memory (ROM), a rewritable non-volatile memory (such as flash memory), a hard drive, an optical disk, and / or the like. In addition, the processor 54 may include one or more general-purpose microprocessors, one or more application-specific processors (ASICs), one or more field programmable gate arrays (FPGAs), or any combination thereof. In addition, the memory device 56 may store instructions executable by the processor 54 to perform the methods and control actions described herein. The controller 52 may also include a communication device 58 that enables communication with other devices or systems (such as an operator system 60 (e.g., a computing system with a processor and a memory device) and / or a landscape system 62 (e.g., a computing system with a processor and a memory device)) via a communication network.

[0034] The sensor 40 may be configured to detect one or more parameters that indicate that the wearable visualization device 12 is being manipulated improperly. For example, if the user drops the wearable visualization device 12 (e.g., in free fall toward the ground / along the gravity vector), the sensor 40 may detect acceleration (e.g., a sudden acceleration or deceleration). The sensor 40 may provide a signal to the processor 54, which may process the signal by comparing the acceleration (e.g., a maximum acceleration value) to an acceleration threshold (e.g., an acceleration threshold value). The processor 54 may be configured to determine that the wearable visualization device 12 has been dropped in response to determining that the acceleration exceeds the acceleration threshold. It should be understood that acceleration is a broad term that encompasses various ways of detecting a drop and / or throw, and thus, the acceleration may be negative, and the acceleration threshold may be a negative acceleration threshold (e.g., due to falling), or the acceleration threshold may be considered a deceleration threshold (e.g., due to a sudden stop due to impact). The processor 54 may also be considered to determine and analyze acceleration and / or other parameters (e.g., acceleration patterns or signatures) over time to determine whether the wearable visualization device 12 has been improperly manipulated (e.g., and to characterize an event, as discussed below).

[0035] An acceleration above an acceleration threshold may generally indicate that the severity (e.g., severity level) of the drop exceeds the severity threshold (e.g., the movement of the wearable visualization device 12 is sufficient to be considered a drop, which may potentially damage the wearable visualization device 12). Thus, the acceleration threshold may represent a severity threshold. In some embodiments, the processor 54 may compare the acceleration to a plurality of acceleration thresholds, each of which may represent a different severity threshold and may enable the processor to more accurately determine the severity of the drop. For example, if the acceleration is above a first acceleration threshold and below a second acceleration threshold, the processor 54 may determine that a drop has occurred and has a first, lower severity level. And if the acceleration is above both the first acceleration threshold and the second acceleration threshold, the processor 54 may determine that a drop has occurred and has a second, higher severity level. The processor 54 may be configured to determine that the wearable visualization device 12 has been thrown and determine the severity of the throw in a similar manner (e.g., by comparison with one or more acceleration thresholds). It should be understood that the sensor 40 may additionally or alternatively detect various other parameters, such as the orientation, angular rate, and / or deceleration of the wearable visualization device 12 (e.g., relative to the gravity vector). The processor 54 may process the signals from the sensor 40 in a similar manner (e.g., compared to one or more thresholds) to determine whether the wearable visualization device 12 has been dropped or otherwise improperly manipulated and the associated severity level.

[0036] In some embodiments, regardless of the parameters and regardless of the number of parameters, the processor 54 can process the signals from the sensor 40 to determine characteristics of the motion of the wearable visualization device 12 (e.g., to characterize an event and / or improper manipulation, such as to characterize the event as a drop or a throw). For example, the processor 54 can determine that the signal indicates that the wearable visualization device 12 was dropped, the speed of the wearable visualization device 12 during the drop, the time and / or distance traveled during the drop, an indication that the wearable visualization device 12 was thrown, the speed at which the wearable visualization device 12 was thrown, the time and / or distance of the throw, the location of the impact, etc. A drop can generally have a lower acceleration than a throw, as well as other parameters that are different from a throw. Therefore, the processor 54 can characterize the event as a drop or a throw based on a comparison of the parameter(s) with known parameters about drops or throws (e.g., stored in the memory device 56).

[0037] As described above, in some embodiments, the processor 54 can be configured to compare the parameter(s) and / or the characteristic(s) to corresponding thresholds (e.g., one or more acceleration thresholds, one or more speed thresholds, one or more time thresholds, one or more distance thresholds) to determine the severity of the improper manipulation and / or event. For example, a short drop with a lower acceleration may be less severe than a high-speed throw with a higher acceleration. In some cases, the processor 54 can be configured to input the parameter(s) and / or the characteristic(s) into a model that is configured to output a severity or otherwise classify (e.g., categorize) the event and / or improper manipulation based on the parameter(s) and / or the characteristic(s). For example, the model may account for certain combinations of parameters that have historically resulted in damage or impairment of the operation of similar wearable visualization devices 12. In some embodiments, the processor 54 can interpret the location of the impact (e.g., based on a signal from an impact sensor) to determine the severity, as an impact at the lens 20 may be more severe than an impact at the housing 18 ( Figure 1) is more severe and may be more likely to cause damage. The processor 54 may also be configured to determine the movement of the wearable visualization device 12 relative to the ride vehicle (e.g., to decouple the movement of the wearable visualization device 12 from the movement of the ride vehicle, such as from expected or known movement or acceleration of the ride vehicle during the ride's progress, and / or from the movement or acceleration of the ride vehicle during the ride's progress as detected by ride vehicle sensors configured to monitor the ride vehicle's movement). In this manner, sudden movement or acceleration of the ride vehicle (e.g., at a portion of the ride designed to move the ride vehicle in this manner) may be ignored or not counted as improper maneuvering by the processor 54.

[0038] In response to determining that the wearable visualization device 12 has been dropped or otherwise improperly manipulated (e.g., with a severity exceeding a severity threshold), the processor 54 may then cause one or more actions, such as illumination of at least one of the lights 42. Illumination of at least one of the lights 42 may prompt a user or operator to perform a maintenance operation, such as inspecting the wearable visualization device 12, performing a test of the wearable visualization device 12, detaching the wearable visualization device 12 from the visitor interface device 14, detaching the wearable visualization device 12 from any structure (e.g., a ride vehicle), replacing the wearable visualization device 12, and / or sending the wearable visualization device 12 to a maintenance technician for repair. In some cases, the controller 52 may direct the lights 42 to illuminate in a particular color based on the parameters, characteristics, and / or severity of the event. For example, a short drop with a relatively low acceleration may cause the lights 42 to illuminate in a yellow color, while a high-speed throw with a relatively high acceleration may cause the lights 42 to illuminate in a red color. Any number of colors may be utilized to convey various types of events (e.g., yellow indicates a drop; red indicates a throw) and / or severity (e.g., yellow indicates an acceleration below a first acceleration threshold; red indicates an acceleration above the first acceleration threshold). In some embodiments, light 42 may be capable of illuminating in different colors and / or may provide a variety of different lights.

[0039] In some embodiments, the processor 54 may be configured to count the number of events (e.g., the number of events in which the wearable visualization device 12 has been improperly manipulated) over time. For example, once a certain number of drops or throws (e.g., each having an acceleration above an acceleration threshold; each having a severity above a severity threshold) is reached, the processor 54 may direct at least one of the lights 42 to illuminate. In some cases, the processor 54 may direct one light 42 to illuminate for each event. For example, the wearable visualization device 12 may include five lights, a first light may illuminate upon a first drop of the wearable visualization device 12, a second light may illuminate upon a second drop of the wearable visualization device 12, a third light may illuminate upon a throw of the wearable visualization device 12, and so on. In some embodiments, the processor 54 may direct one or more lights 42 to illuminate for each event, and the number of lights 42 may be based on the severity of each event. For example, the wearable visualization device 12 may include five lights, a first light may illuminate upon a first brief drop of the wearable visualization device 12, a second light and a third light may illuminate upon a high-speed throw of the wearable visualization device 12, and so on. Then, when a certain number (e.g., all) of the lights 42 of the wearable visualization device 12 illuminate, the operator may be notified (e.g., by viewing the lights 42) to take action. In some embodiments, the wearable visualization device 12 may include a speaker, and one or more actions may include providing an audible output via the speaker.

[0040] In addition to or as an alternative to illumination of the at least one light 42, the processor 54 may take one or more other actions, such as sending a notification to the operator system 60 and / or the landscape system 62. Various actions (e.g., automated actions) are contemplated. For example, upon determining that an event has occurred (e.g., an event has a severity above a severity threshold; a certain number of such events have occurred), the processor 54 may turn off the wearable visualization device 12 or at least some features of the wearable visualization device 12 (e.g., turn off the lens 20; prevent display of virtual features on the lens 20). In some embodiments, the processor 54 may prevent display of virtual features on the lens 20 in response to determining that the event has a first, higher severity (e.g., high-speed throw; first, higher acceleration), but the processor 54 may continue to enable display of virtual features on the lens 20 in response to determining that the event has a second, lower severity (e.g., short-term drop; second, lower acceleration).

[0041] In some embodiments, the wearable visualization device 12 can be coupled (e.g., removably coupled; temporarily locked) to the visitor interface device 14 and / or to a structure such as a ride vehicle. For example, the wearable visualization device 12 can be locked to the visitor interface device 14 via an electromagnetic system. In this case, in response to determining that an event has occurred, power to the electromagnetic system can be blocked (e.g., the electromagnet can be deactivated), thereby achieving the separation of the wearable visualization device 12 from the visitor interface device 14. In some such cases, power to the electromagnetic system can be blocked only when the ride vehicle is in a loading / unloading area and / or when the ride vehicle is stationary. Similarly, the locking device that couples the wearable visualization device 12 to the ride vehicle can be unlocked in response to determining that an event has occurred and / or when the ride vehicle is in a loading / unloading area and / or when the ride vehicle is stationary. The wearable visualization device 12 can then be coupled to the visitor interface device 14 and / or to the structure only via a mechanical connection (e.g., a hook, key / slot interface) that can be quickly and manually disconnected. For example, such techniques may enable a wearable visualization device 12 that has experienced an event to be quickly removed for maintenance operations and replaced with another wearable visualization device 12 without slowing down throughput at the landscape (e.g., unloading and loading of users). As another example, the processor 54 may be configured to initiate (e.g., run) a test (e.g., a health test) in response to determining that an event has occurred. The test may include displaying an image (e.g., a pattern, a line) on a lens 20 of the wearable visualization device 12, and using a camera 64 of the wearable visualization device 12 to determine that the image is properly displayed on the lens 20. The processor 54 may receive the image from the camera 64, and may process the image (e.g., via template or pattern matching) to determine whether the wearable visualization device 12 functions properly after the event. The test may include providing information (e.g., questions and / or images) on the lens 20 for visualization by a user, and then receiving gesture input from the user (e.g., a nod of the user's head) detected by the sensor 40, as described below with respect to Figure 6 As discussed in more detail.

[0042] In some embodiments, the processor 54 may be configured to send an indication (e.g., via the communication device 58) to an operator system 60, which may be located remotely from the wearable visualization device 12 (e.g., a tablet computer held by an operator of the attraction, a computer accessed by an operator overseeing the operation of the amusement park). The indication may include a text message or other notification (e.g., illumination of a light) that the wearable visualization device 12 has been improperly manipulated. The indication may also include data related to the parameters, characteristics, and / or severity of the event.

[0043] It should be understood that data related to the number of events and data related to the parameters, characteristics, and / or severity of each event can be used to generate an event report (e.g., a table) for each wearable visualization device 12 and / or can enable an operator of an amusement park to maintain abreast of the reliability and / or durability of the wearable visualization device 12. For example, if a wearable visualization device 12 used in an attraction typically experiences impaired functionality after only a few minor drops, the operator may be able to focus on improving reliability and / or durability (even in the presence of drops) and / or taking measures to reduce drops. If the wearable visualization device 12 experiences multiple severe drops and / or throws, the operator may be able to focus on taking measures to reduce drops and / or throws. In addition, if the wearable visualization device 12 experiences impaired functionality without any drops, the operator may be able to focus on improving other features of the wearable visualization device 12 and / or seeking a replacement under warranty.

[0044] In some embodiments, the processor 54 may be configured to send instructions to the landscape system 62 (e.g., via the communication device 58) to cause the landscape system 62 to illuminate lights (e.g., on the ride vehicle) and / or adjust the operation of features of the landscape, such as adjusting the path or movement of the ride vehicle. For example, in response to determining that an event has occurred, the landscape system 62 may divert the ride vehicle (e.g., to a maintenance bay and / or loading / unloading area) to facilitate maintenance operations. The diversion may occur during the ride in order to avoid the user from experiencing the ride with a potentially malfunctioning wearable visualization device 12. Thus, the user or operator may inspect, repair, and / or replace the wearable visualization device 12 and / or the user may be unloaded from the ride vehicle and reloaded into another ride vehicle with a properly functioning wearable visualization device 12, so that the user can enjoy the AR / VR experience throughout the remainder of the ride. The diversion may occur after the ride so that the wearable visualization device 12 can be inspected, repaired, and / or replaced between ride cycles and / or between users to avoid the user from experiencing the ride with a potentially malfunctioning wearable visualization device 12. The diversion may include preventing the ride vehicle from moving forward out of the loading / unloading area until the wearable visualization device 12 is inspected or otherwise processed. In some embodiments, in response to determining that an event has occurred, the attraction system 62 may be configured to add physical features on the ride vehicle and / or within the attraction, such as displays, animatronics, light shows, etc. (e.g., enabling users to view text or images, such as on a display, and generally enjoy the attraction, even without a properly functioning wearable visualization device 12).

[0045] Figure 4 7 is a perspective view of a landscape 70 in which an AR / VR system 10 may be employed. As shown, a user 72 is positioned within a ride vehicle 74 that travels along a path 76. At least at some times during the ride, the user 72 may be able to view physical structures 78 in the real-world environment 22 through the lenses of the wearable visualization device 12. At least at some times during the ride, the user 72 may be able to view virtual features 24 on the lenses of the wearable visualization device 12. Figure 4 , the virtual features 24 may be overlaid onto the real-world environment 22 so that the user can view both the physical structures 78 in the real-world environment 22 and the virtual features 24 simultaneously. Each user 72 may be presented with a different virtual feature 24 so that each user 72 has a different experience on the ride. The user 72 may board the ride vehicle 74 in a loading area and exit the ride vehicle 74 in an unloading area (e.g., loading / unloading area 80). However, in the excitement of the ride, it is possible that the user 72 may drop the wearable visualization device 12, or that the wearable visualization device 12 may otherwise fall from the user 72. It is also possible that the user 72 may throw the wearable visualization device 12 and / or that the wearable visualization device 12 may be improperly manipulated in other ways.

[0046] refer to Figure 3 and Figure 4 Each wearable visualization device 12 may include a component as part of a detection system 50 that can monitor whether the wearable visualization device 12 is improperly manipulated during a ride. In some embodiments, during a ride, the detection system 50 may illuminate at least one light 42, provide notifications to the operator system 60, and / or cause actions to be taken by the landscape system 62. Additionally or alternatively, the detection system 50 may count or record events in the memory device 56. Additionally or alternatively, the detection system 50 may illuminate at least one light 42, provide notifications to the operator system 60, and / or cause actions to be taken by the landscape system 62 only after the ride ends (e.g., in the loading / unloading area 80) so as not to interrupt the ride.

[0047] In some embodiments, the processor 54 may count a total number of events and / or may cause one or more actions based on the event(s) periodically, such as after a period of time (e.g., hourly, daily, weekly), whenever the wearable visualization device 12 is coupled to or decoupled from the visitor interface device 14, whenever the wearable visualization device 12 is docked to a structure (e.g., docked to a ride vehicle 74, which may be detected via a positioning sensor), whenever the ride vehicle 74 is in a loading / unloading area 80 (e.g., after each ride cycle), and / or in response to a request by a user or other person (e.g., an operator, a maintenance technician). Although Figure 4 The landscape 70 is illustrated with a ride vehicle 74, but it should be understood that the landscape 70 may not include a ride vehicle 74. Alternatively, the landscape 70 may include a path on which the user 72 walks while wearing the wearable visualization device 12, a theater in which the user 72 sits or stands while wearing the wearable visualization device 12, or any other suitable type of landscape. In addition, the landscape 70 may be configured such that the user 72 wears and / or carries the wearable visualization device 12 outside of the ride vehicle 74 (such as while queuing to board the ride vehicle 74, after unloading from the ride vehicle 74, etc.). Thus, it may be possible for the user 72 or another person (e.g., an operator, a maintenance technician) to drop the wearable visualization device 12 at other locations relative to the ride vehicle 74 and / or at other times outside of the ride. The detection system 50 may be configured to detect events, count events, and / or cause one or more actions disclosed herein when the wearable visualization device 12 is at other locations relative to the ride vehicle 74 and / or at other times outside of the ride.

[0048] Figure 5 The present invention is a method 90 for monitoring events (e.g., improper manipulation) of a wearable visualization device 12 using a detection system 50. The method 90 disclosed herein includes various steps represented by boxes. It should be noted that at least some of the steps in the method 90 can be performed as an automated procedure by a system (such as any of the detection systems 50 disclosed herein). Although the flowchart illustrates the steps in a certain order, it should be understood that the steps can be performed in any suitable order and that certain steps can be performed simultaneously where appropriate. In addition, steps can be added to the method 90 or steps can be omitted from the method 90.

[0049] As shown, in step 92, the method 90 may begin by receiving (e.g., from the sensor 40, at the processor 54) a signal indicating an event on the wearable visualization device 12. As discussed above, the processor 54 may be configured to receive and process the signal to determine that an event has occurred and / or to characterize the event (e.g., type, time, distance, speed, severity, location of impact). In step 94, the processor 54 may count the number of events over time. For example, data related to the parameters, characteristics, severity, and / or number of events may be stored in the memory device 56.

[0050] In step 96, the processor 54 may direct at least one light 42 on the wearable visualization device 12 to illuminate. For example, the processor 54 may direct at least one light 42 to illuminate in response to detection of a fall having a severity above a severity threshold and / or in response to detection of a number of falls above a count threshold. In step 98, the processor 54 may provide a notification to the operator system 60, which may be located remotely from the wearable visualization device 12. In step 100, the processor 54 may communicate with the landscape system 62, which may cause the landscape system 62 to adjust features of the landscape, such as illuminating lights on a ride vehicle, adjusting a path of a ride vehicle, etc.

[0051] The sensors 40 of the wearable visualization device 12 may enable the user to provide gesture input. With this in mind, Figure 6 is a schematic diagram of a question that may be presented on the lens 20 of the wearable visualization device 12. For example, the question may be “Can you see the following image? ”, and the image can be a geometric shape or other image. The user can shake their head up and down to answer “yes”, and the user can shake their head left and right to answer “no”.

[0052] refer to Figure 3 and Figure 6Both, when the wearable visualization device 12 is worn by the user, the sensor 40 may be able to detect movement of the user's head. The sensor 40 may provide a signal indicative of the movement to the processor 54, which may determine a response or answer from the user based on the signal. In this case, the processor 54 may characterize the response based on a comparison of (one or more) parameters with known parameters (e.g., stored in the memory device 56) associated with a "yes" or "no" movement. The illustrated example may be used as part of a test to test whether the wearable visualization device 12 functions, such as after being manipulated incorrectly. In response to determining that the wearable visualization device has been manipulated incorrectly, the test may be automatically initiated by the processor 54. For example, if the user responds "yes", the processor 54 may determine that the wearable visualization device 12 functions after being manipulated incorrectly. However, if the user responds "no", the processor 54 may determine that the wearable visualization device 12 does not function correctly after being manipulated incorrectly. In such a case, the processor 54 may take one or more actions, including one or more actions disclosed herein (e.g., illuminating the light 42; notifying the operator system 60 and / or the landscape system 62). It should be understood that the test may be initiated in response to input (e.g., by a user or operator), or may be initiated at any other time (e.g., in response to coupling the wearable visualization device 12 to the guest interface device 14), prior to leaving the loading area of ​​the ride, etc.

[0053] The gesture input may be used to provide various responses to various questions or other prompts, the gesture input may be used as part of a game, and / or the gesture input may be used to control wearable visualization device 12 and / or other aspects of the landscape. In practice, different movements of the user's head may correspond to different responses or inputs. For example, moving the user's head in one way may be one input (e.g., to brighten an image on lens 20 to cause display of one image as part of a game, to adjust the movement of a ride vehicle in one way), and moving the user's head in another way may be another input (e.g., to darken an image on lens 20 to cause display of another image as part of a game, to adjust the movement of a ride vehicle in another way).

[0054] Gesture input can also be used to enable an operator and / or maintenance technician to unlock certain features of the wearable visualization device 12 (e.g., by moving the wearable visualization device 12 in a certain manner and / or in a certain pattern of movement). Gesture input can enable an operator and / or maintenance technician to interact with the wearable visualization device 12 and / or an attraction (e.g., a game) to diagnose problems and / or see information not available to visitors. Gesture input can enable an operator and / or maintenance technician to access menus (e.g., menus visible on the lens 20 of the wearable visualization device 12; menus visible on a display connected to the wearable visualization device 12 (such as a display on a ride vehicle)), move through menus, make selections on menus, and / or perform maintenance tests and / or procedures using gesture input (e.g., gesture input and movement of the wearable visualization device 12 only; no auxiliary devices, such as a mouse or keyboard). In some cases, gesture input may enable an operator and / or maintenance technician to perform maintenance and / or provide input to a computing system coupled to the wearable visualization device 12, such as a computing system of a ride vehicle (e.g., Figure 3 The landscape system 62) provides input to adjust the operation of the computing system.

[0055] The sensors 40 of the wearable visualization device 12 may also enable other operations, such as head tracking of the user's head. The sensors 40 (e.g., IMUs) may be used to obtain data indicating the manner in which the user's head travels through space. However, in some settings, the user may be positioned on a moving ride vehicle (e.g., translating and / or rotating relative to the ground). Therefore, the AR / VR system 10 may include additional features and / or be configured to perform processing steps to separate the movement of the user's head from the movement of the ride vehicle. For example, the AR / VR system 10 may use a solid-state cabin tracking system and may use the sensors 40 a second time (e.g., if desired) for additional input to a prediction algorithm (e.g., a Kalman filter).

[0056] The sensor 40 can also be used for off-board development (e.g., desktop development) because it provides a low-cost way to have head tracking in a wearable visualization device 10. Developers can use the basic tracking provided by the sensor 40 to look around the virtual scene; however, the developer may not be able to align the virtual scene with the real world in order to create the virtual scene. Therefore, the developer can avoid using a ride vehicle / cabin tracking system, which can be more expensive, use a lot of equipment, and be time-consuming to set up compared to the sensor 40, which can operate to obtain data indicating the movement of the user's head when plugged into a cable (e.g., a USB cable; cable 32).

[0057] As explained above, embodiments of the present disclosure may provide one or more technical effects useful for facilitating the execution of maintenance activities on a wearable visualization device and for facilitating the integration of a wearable visualization device in an amusement park. It should be understood that the technical effects and technical problems in the specification are examples rather than limitations. In fact, it should be noted that the embodiments described in the specification may have other technical effects and may solve other technical problems.

[0058] Although the embodiments set forth in the present disclosure may be susceptible to various modifications and alternative forms, specific embodiments have been shown by way of example in the accompanying drawings and have been described in detail herein. However, it should be understood that the present disclosure is not intended to be limited to the particular forms disclosed. The present disclosure will cover all modifications, equivalents, and alternatives that fall within the spirit and scope of the present disclosure as defined by the following appended claims.

[0059] The technology presented and claimed herein is cited and applied to physical and specific examples of a practical nature that significantly improve the art, and is therefore not abstract, intangible, or purely theoretical. In addition, if any claim attached to the end of this specification contains one or more elements designated as "means for [performing] ... [function]" or "steps for [performing] ... [function]", it is intended that such elements be interpreted in accordance with 35 USC 112 (f). However, for any claim containing elements designated in any other manner, it is intended that such elements not be interpreted in accordance with 35 USC § 112 (f).

Claims

1. A detection system configured to detect improper manipulation of a wearable visualization device, the detection system comprising: a sensor coupled to the wearable visualization device; as well as A processor configured to: receiving a signal from the sensor, wherein the signal indicates a total acceleration of the wearable visualization device while the wearable visualization device is carried by a ride vehicle during a ride cycle; receiving data indicative of acceleration of the ride vehicle during the ride cycle; using the total acceleration of the wearable visualization device and the acceleration of the ride vehicle to separate individual accelerations of the wearable visualization device from the total acceleration of the wearable visualization device, wherein the individual accelerations of the wearable visualization device indicate an acceleration of the wearable visualization device relative to the ride vehicle; responsive to the individual acceleration of the wearable visualization device exceeding an acceleration threshold, determining that the signal indicates improper manipulation of the wearable visualization device; as well as In response to determining that the signal indicates improper manipulation of the wearable visualization device, an attractions system having the ride vehicle is directed to adjust a path of movement of the ride vehicle during the ride cycle.

2. The detection system of claim 1 , comprising a light emitter coupled to the wearable visualization device, wherein the processor is configured to determine a number of events of incorrect manipulation of the wearable visualization device over time and to direct illumination of the light emitter in response to determining that the number of events exceeds a count threshold. 3 . The detection system of claim 1 , wherein the processor is configured to determine a severity of the improper manipulation based on the signal.

4. The detection system of claim 3, comprising a light emitter coupled to the wearable visualization device, wherein the processor is configured to direct the light emitter to illuminate with a first color in response to determining that the severity is a first level, and to direct the light emitter to illuminate with a second color in response to determining that the severity is a second level. 5 . The detection system of claim 3 , wherein the processor is configured to determine the severity by comparing a parameter of the signal to one or more parameter thresholds.

6. The detection system of claim 1, comprising the wearable visualization device, wherein the processor is configured to cease operation of at least one component of the wearable visualization device in response to determining that the signal indicates incorrect manipulation of the wearable visualization device, and wherein the at least one component comprises one or more lenses of the wearable visualization device configured to provide an augmented reality (AR), virtual reality (VR) and / or mixed reality experience to the user. 7 . The detection system of claim 1 , wherein the processor is configured to determine a type of improper manipulation of the wearable visualization device based on the signal.

8. The detection system of claim 7, comprising a light emitter coupled to the wearable visualization device, wherein the processor is configured to direct the light emitter to illuminate with a first color in response to determining that the type is associated with the wearable visualization device being dropped, and to direct the light emitter to illuminate with a second color in response to determining that the type is associated with the wearable visualization device being thrown.

9. The detection system of claim 1, wherein the processor is configured to provide a notification to a remote system located remotely from the wearable visualization device in response to determining that the signal indicates improper manipulation of the wearable visualization device.

10. The detection system of claim 9, wherein the remote system comprises the landscaping system, and the notification is configured to cause the landscaping system to adjust a feature of the landscaping.

11. The detection system of claim 1 , wherein the processor is configured to generate an indication to adjust operation of a light emitter on the ride vehicle in response to determining that the signal indicates improper manipulation of the wearable visualization device.

12. The detection system of claim 1, comprising a light emitter coupled to the wearable visualization device, wherein the processor is configured to direct illumination of the light emitter in response to determining that the signal indicates improper manipulation of the wearable visualization device.

13. A wearable visualization device, comprising: a housing configured to be coupled to a user's head via an interface device; one or more lenses coupled to the housing and configured to overlay augmented reality (AR), virtual reality (VR), and / or mixed reality features onto the user's line of sight; a sensor supported by the housing and configured to detect movement of the wearable visualization device; as well as a processor configured to receive a signal from the sensor, determine whether the signal indicates that the wearable visualization device has been dropped or thrown based on the detected movement of the wearable visualization device, and in response to determining that the signal indicates that the wearable visualization device has been dropped or thrown, direct an attraction system having a ride vehicle and the wearable visualization device to prevent the ride vehicle from moving out of a loading / unloading area, wherein the signal generated by the sensor indicates a total acceleration of the wearable visualization device while the wearable visualization device is carried by the ride vehicle during a ride cycle, and the processor is configured to: receiving data indicative of acceleration of the ride vehicle during the ride cycle; using the total acceleration of the wearable visualization device and the acceleration of the ride vehicle to separate individual accelerations of the wearable visualization device from the total acceleration of the wearable visualization device, wherein the individual accelerations of the wearable visualization device indicate an acceleration of the wearable visualization device relative to the ride vehicle; as well as Responsive to the individual acceleration of the wearable visualization device exceeding an acceleration threshold, it is determined that the signal indicates that the wearable visualization device has been dropped or thrown.

14. A wearable visualization device according to claim 13, comprising a light emitter supported by the shell, wherein the processor is configured to determine the number of times the wearable visualization device has been dropped or thrown over time, and to direct the illumination of the light emitter in response to determining that the number exceeds a count threshold.

15. The wearable visualization device of claim 13, comprising a light emitter supported by the housing, wherein the processor is configured to: determining a severity of dropping or throwing the wearable visualization device based on the signal; and Illumination of the light emitter at a first color is directed in response to determining that the severity is a first level, and illumination of the light emitter at a second color is directed in response to determining that the severity is a second level.

16. The wearable visualization device of claim 13, comprising the interface device, wherein the interface device is configured to be coupled to the head of the user via a head strap assembly.

17. A method of using a detection system to detect improper manipulation of a wearable visualization device, the method comprising: receiving, at a processor, a signal from a sensor coupled to the wearable visualization device, wherein the signal indicates a total acceleration of the wearable visualization device while the wearable visualization device is carried by a ride vehicle during a ride cycle; determining, via the processor, an acceleration of the ride vehicle during the ride cycle based on a known acceleration profile of the ride vehicle, wherein the known acceleration profile includes data indicative of expected values ​​of the acceleration of the ride vehicle repeated between loading / unloading operations of the ride vehicle during sequential progression of the ride cycle; separating, via the processor, individual accelerations of the wearable visualization devices from the total acceleration of the wearable visualization device using the total acceleration of the wearable visualization device and the acceleration of the ride vehicle, wherein the individual accelerations of the wearable visualization devices indicate an acceleration of the wearable visualization device relative to the ride vehicle; determining, with the processor, that the signal indicates improper manipulation of the wearable visualization device in response to the individual acceleration of the wearable visualization device exceeding an acceleration threshold; counting, with the processor, a number of events of incorrect manipulation of the wearable visualization device over time; as well as In response to determining that the number of events exceeds a count threshold, directing illumination of a light emitter using the processor.

18. The method of claim 17, comprising, in response to determining that the signal indicates improper manipulation of the wearable visualization device, ceasing, via the processor, display of augmented reality (AR), virtual reality (VR), and / or mixed reality features on one or more lenses of the wearable visualization device.

19. The method of claim 17, in response to determining that the signal indicates improper manipulation of the wearable visualization device, providing a notification via the processor to a remote system located remotely from the wearable visualization device.

Images