Head-mounted display testing system and method

Abstract

A head mounted display testing system can include a vehicle motion simulator that simulates motion of an entertainment vehicle and a head mounted display attached to the vehicle motion simulator that displays a virtual image. The vehicle motion simulator includes one or more outward facing cameras configured to capture the virtual image and the physical markers when the head mounted display is present on the vehicle motion simulator. A controller is configured to receive images of the head mounted display screen captured by the one or more cameras and generate an indication of head mounted display quality based on deviations from an expected image.

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to and the benefit of U.S. Provisional Patent Application No. 63 / 312,491, filed February 22, 2022, and entitled "HEAD-MOUNTED STEREOSCOPIC DISPLAY TESTING SYSTEM AND METHOD," which is incorporated herein by reference in its entirety for all purposes.

[0002] The present disclosure relates generally to the field of amusement park entertainment. In particular, embodiments of the present disclosure relate to a system for testing the durability of head-mounted augmented reality / virtual reality displays worn during amusement rides. [Background technology]

[0003] This section is intended to introduce the reader to various aspects of art that may be related to various aspects of the present disclosure, which are described and / or claimed below. This discussion is believed to be helpful in providing the reader with background to facilitate a better understanding of the various aspects of the present disclosure. As such, it should be understood that these statements are to be read in this light, and not as admissions of prior art.

[0004] Amusement and / or theme parks are designed to provide entertainment for guests. Areas of an amusement park may have different themes that are specifically targeted to certain audiences. For example, some areas may include themes that traditionally interest children, while other areas may include themes that traditionally interest a more mature audience. Generally, such themed areas may be referred to as attractions or themed attractions. In such attractions, it has been recognized that it is desirable to enhance the immersive experience of guests, such as by augmenting the theme with virtual features. Such virtual features may be provided to guests via an augmented reality (AR) / virtual reality (VR) head-mounted display. Summary of the Invention [Means for solving the problem]

[0005] Below, we present an overview of some embodiments disclosed herein. It should be understood that these aspects are merely intended to provide the reader with a summary of some of these embodiments and are not intended to limit the scope of the present disclosure. In fact, the present disclosure may include various aspects that may not be presented below.

[0006] In one embodiment, a head mounted display testing system includes a mount configured to receive a head mounted display including a display screen, and at least one camera coupled to the mount and positioned to capture the display screen when the head mounted display is present on the mount. The head mounted display testing system also includes an actuator coupled to the mount, and a vehicle motion simulator actuator controller that causes motion of the mount to cause the mount to simulate motion of the vehicle according to a motion pattern. The head mounted display testing system also includes a controller that receives a signal from the at least one camera including a captured image of the display screen of the head mounted display, and identifies deviations from an expected display on the display screen based on the signal.

[0007] In one embodiment, a method for testing a head mounted display includes receiving an indication that a head mounted display is present on a vehicle motion simulator, controlling the vehicle motion simulator to operate according to a vehicle motion pattern, and detecting a display screen on the head mounted display using at least one camera of the vehicle motion simulator during operation in the vehicle motion pattern. The method also includes identifying deviations from an expected appearance on the display screen based on signals received from the at least one camera, and generating an indication of head mounted display quality based on the identified deviations.

[0008] In one embodiment, a method of testing a head mounted display includes receiving an indication that a head mounted display is present on a vehicle motion simulator, controlling the vehicle motion simulator to operate according to a vehicle motion pattern, and detecting a display screen of the head mounted display using at least one camera of the vehicle motion simulator during operation in the vehicle motion pattern. The method also includes identifying a deviation from an expected display on the display screen based on signals received from the at least one camera while the vehicle motion simulator is operating, and generating a failure time for the head mounted display in response to identifying the deviation.

[0009] These and other features, aspects and advantages of the present invention will be better understood when the following detailed description is read in conjunction with the accompanying drawings, in which like elements are designated with like reference characters throughout. [Brief description of the drawings]

[0010] [Figure 1]1 is a head mounted display testing system including a vehicle motion simulator for simulating the motion of an entertainment vehicle in which a head mounted display can be utilized according to the present embodiment. [Diagram 2] 1 is a perspective view of a vehicle motion simulator according to an embodiment of the present invention; [Diagram 3] FIG. 2 is a perspective view of a vehicle motion simulator during head mounted display testing, according to the present embodiments. [Figure 4] FIG. 2 is a perspective view of a housing and screen of a head mounted display featuring a displayed image and markers according to the present embodiments. [Diagram 5] 1 is a flowchart of a process for testing the quality of a head mounted display according to an embodiment. [Figure 6] FIG. 1 is a block diagram of a head mounted display testing system including a head mounted display, a vehicle motion simulator, and a controller according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] One or more specific embodiments are described below. In order to describe these embodiments concisely, not all of the features of the implementations are described herein. It is to be understood that in the development of any such implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developer's particular objectives, such as adhering to system-related and business-related constraints that may vary from implementation to implementation. Moreover, it is to be understood that such a development effort may be complex and time-consuming, but would be a routine undertaking of design, fabrication and manufacture for those of ordinary skill in the art having the benefit of this disclosure.

[0012] When introducing elements of various embodiments of the disclosure, the articles "a," "an," and "the" are intended to mean that there are one, two, or more of the elements. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there may be additional elements other than the listed elements. It should also be understood that references to "one embodiment" or "an embodiment" of the disclosure are not intended to be interpreted as excluding the existence of additional embodiments that also contain the recited features.

[0013] Amusement parks can include AR, VR, and / or mixed reality (combined AR and VR) systems (e.g., AR / VR systems) to enhance the guest experience of the amusement park attractions by providing guests with an augmented reality (AR) / virtual reality (VR) experience (e.g., an AR experience, a VR experience, or both). For example, an AR / VR system can include a head-mounted display (e.g., electronic goggles or displays, glasses) that a guest can wear to view virtual reality features or augmented reality features. In particular, the head-mounted display can be utilized to enhance the guest experience by overlaying virtual features on the real-world environment of the amusement park, providing a virtual environment that can be adjusted to provide different experiences within the attraction, and the like. In some instances, a head-mounted display is provided to a guest and returned after each ride cycle for use by the next guest. Thus, each individual head-mounted display is subject to the normal wear and tear of vigorous, repeated use, as well as specific stresses associated with the motion patterns of the associated amusement ride. For example, when a guest turns or leans their head during a ride based on the movement of the ride vehicle, the cable connecting the head mounted display to the ride vehicle may be stretched, compressed, or otherwise mechanically stressed, and because this cable transmits data to the head mounted display, repeated stress on the cable may cause the operation of the head mounted display to deteriorate over time.

[0014] The disclosed embodiments provide a head mounted display testing system that monitors the motion of a head mounted display to evaluate the relationship between vehicle motion and the resulting malfunction of the head mounted display due to use in a high-motion environment such as an entertainment vehicle (e.g., the image displayed by the head mounted display screen is not visible, blurred, choppy, or otherwise impaired). Specifically, the head mounted display testing system can include a ride motion simulator that includes an actuator and a robotic arm attached to a mount. The mount receives and holds the head mounted display during testing. In an embodiment, the mount can have a size and shape generally similar to a human head. For example, the mount can be a three-dimensional (3D) printed humanoid mannequin head. The head mounted display can thus be held on the ride motion simulator via the mount. An actuator controller can receive instructions to actuate the mount based on the entertainment vehicle motion pattern. As a result, a controller of the ride motion simulator can drive the robotic arm and the actuator according to the vehicle motion pattern, thus simulating the entertainment vehicle.

[0015] The mount of the vehicle motion simulator can include one or more sensors, such as outward-facing cameras that can be positioned generally as eyes on a face. Thus, when the head mounted display is on the mount, the outward-facing cameras can capture (e.g., record, photograph) the active display screen of the head mounted display. During testing of the head mounted display, the display screen of the head mounted display displays a desired image in coordination with the vehicle motion of the amusement vehicle. In some embodiments, the head mounted display can also include markers or fiducials that are captured by one or more sensors to ensure that the head mounted display remains securely attached during testing.

[0016] During testing of the head mounted display and during execution of the motion pattern, a camera captures the screen of the head mounted display. A controller receives the information captured by the camera, detects the display image, and determines the operational state of the head mounted display based on the correspondence or deviation of the display image from the expected display. For example, if a marker is detected on the display screen of the head mounted display but no display image is detected, this indicates that the screen of the head mounted display may be broken or otherwise damaged. If neither the display image nor the marker is detected, the head mounted display may be displaced or dislodged from the mount. If a display image is detected but deviates from the corresponding expected image (e.g., a stored reference image), the head mounted display may be flagged as non-operating. Conversely, the correspondence between the detected display image and the expected image may also be used to mark the head mounted display as in normal operation. A flagged head mounted display may be further evaluated for identification of failure modes and / or maintenance or cable replacement.

[0017] The operating conditions can be used to determine parameters such as the average lifespan of a head mounted display in an amusement park environment (e.g., number of ride cycles before image quality degrades). Additionally, by testing different ride operating patterns, certain patterns can be identified as being associated with reduced usage lifespan. Thus, future entertainment rides that use head mounted displays can be designed to include less disruptive operating patterns and to avoid operating patterns associated with malfunctions and reduced lifespan of head mounted displays.

[0018] With this in mind, Figure 1 is a representation of a head mounted display test system 10. The head mounted display test system 10 includes a vehicle motion simulator 12. The vehicle motion simulator 12 receives vehicle motion pattern information that enables testing with specific vehicle motion patterns. In one embodiment, the vehicle motion patterns executed by the system 10 are received from or generated based on predicted vehicle motion of the amusement vehicles as caused by the ride controllers 32 of the individual amusement vehicles 14.

[0019] The entertainment vehicle 14 includes a ride vehicle 18 that travels along a ride path 20, which moves the ride vehicle 18 according to a particular vehicle motion pattern. As shown in FIG. 1, a passenger 16 is disposed within the ride vehicle 18. In an AR implementation, the passenger 16 can view a physical structure 22 of a real-world environment 24 through a display screen of a head-mounted display 26, at least at certain times during the ride, as well as a virtual feature 28 that is displayed. As shown in the exemplary embodiment of FIG. 1, the virtual feature 28 can be overlaid on the real-world environment 24 such that the passenger 16 can simultaneously view both the physical structure 22 of the real-world environment 24 and the virtual feature 28. Additionally or alternatively, the head-mounted display can be used in a fully immersive VR configuration in which the passenger 16 sees the display image on the head-mounted display 26 in an immersive manner and is unable to view the real-world environment through the lenses of the head-mounted display 26. However, it should be understood that the display image can also include an image of the physical structure 22 captured by a camera and further provided as a display image on the head-mounted display 26. In some embodiments, each passenger 16 may be presented with a different virtual feature 28 such that each passenger 16 has a different experience on the vehicle 14 .

[0020] The ride vehicle 18 on the ride path 20 may dip, roll, pitch, and yaw so that the passengers 16 of the entertainment vehicle 14 experience ride forces. Such vehicle forces may cause the head mounted display 26 to reach the end of its life sooner than under normal use conditions (e.g., the head mounted display 26 is worn by a standing or walking user). For example, a cable 30 tethered to the head mounted display 26 on one end and to the ride vehicle 18 on the other end may cause the internal leads to fray or stretch prematurely due to sudden movements in response to the vehicle forces. The cable 30 connects the head mounted display 26 to a controller responsible for providing signals that cause the display of the virtual features 28 through the cable 30. Thus, damage to the cable 30 may impair the quality of the displayed image of the head mounted display 26. For example, the virtual features 28 or image may become distorted or otherwise altered. Vehicle forces may also cause the head mounted display 26 to shift above the passenger's head, causing the display screen to move out of the passenger's field of view, or vehicle forces associated with high operating environments may cause the head mounted display to become dislodged or fall off the passenger's head during the ride.

[0021] The vehicle motion simulator 12 places the head mounted display 26 in a high motion environment external to the entertainment vehicle 14. The vehicle motion simulator 12 includes a mount 36 that holds the head mounted display 26 (e.g., via a guest interface device) and a robotic arm 34 and actuators 44 that move the mount 36 according to the vehicle motion patterns of the vehicle controller 32. During head mounted display testing, the head mounted display 26 is placed on the mount 36 and the vehicle motion simulator 12 moves the mount 36 according to the motion patterns of the entertainment vehicle 14.

[0022] The ride controller 32, during operation, can generate ride control signals that guide the ride vehicle 18 along the ride path 20 according to a ride motion pattern. The ride controller 32 can drive the ride vehicle 18 according to one or more different motion patterns. Based on the ride control signals, the ride motion simulator 12 can simulate the motion (e.g., drop, pitch, yaw, roll) of the ride vehicle 18 and passenger 16 in the entertainment vehicle 14. In one embodiment, the ride control signals of the ride controller 32 are used to generate simulation signals that translate the motion of the ride vehicle into predicted head motion of the passenger in the ride vehicle 18. The simulation signals are then used to drive the vehicle motion simulator 12 to execute the motion pattern. In one embodiment, the signals that drive the motion pattern can be provided to the controller of the vehicle motion simulator 12 directly from the ride controller 32 or from another source. Thus, the vehicle motion simulator 12 can execute the vehicle motion patterns to test the head mounted display 26 under high motion conditions that simulate the motion of the entertainment vehicle 14.

[0023] 2 is a perspective view of the components of the vehicle motion simulator 12. In the illustrated example, the vehicle motion simulator 12 does not have an associated head mounted display 26. The vehicle motion simulator 12 includes a robotic arm 34 connected to a mount 36. In some embodiments, the mount 36 can be implemented as a three-dimensional (3D) humanoid mannequin head. The mount 36 can include one or more sensors, shown here as outward-facing cameras 40. The camera(s) 40 are generally positioned to correspond to eye locations on the face. However, it should be understood that other implementations of the mount 36 that position the camera(s) 40 in appropriate spatial relationship to the head mounted display 26 are possible.

[0024] In some embodiments, the robotic arm 34 can include one or more joints 42 that increase the range of motion of the mount 36. The robotic arm 34 also includes an actuator 44 coupled to the mount 36 and / or the robotic arm 34. Movement of the actuator 44 and the robotic arm 34 can enable the ride motion simulator 12 to replicate the movement of the head mounted display 26 within the ride vehicle 18 in the entertainment vehicle 14.

[0025] 3 is a perspective view of the vehicle motion simulator 12. As shown in FIG. 3, the head mounted display 26 rests on the mount 36 in such a manner that when attached to the vehicle motion simulator 12, it is present on the head of the passenger 16 of the ride vehicle 18 during the entertainment vehicle 14 and / or aligns one or more cameras 40 with the display of the head mounted display 26. Additionally, the cable 30 of the head mounted display 26 is coupled at a first end 45 to the fixed structure 43 and at a second end 47 to the head mounted display 26. The coupling at one or both of the first end 45 or the second end 47 can be a reversible coupling so that the head mounted display 26 or the cable can be replaced based on the identification of a malfunction. The head mounted display 26 is provided with an image for display via the cable 30.

[0026] In some embodiments, the head mounted display 26 is a one-piece assembly that includes a display screen and a band, strap, or other feature that holds the head mounted display 26 during use. In another embodiment, the head mounted display 26 can be a two-part assembly that includes a display portion and a headband or head interface portion. The two parts of the assembly can be coupled and separated from one another. Thus, the head mounted display 26 can be secured onto the mount 36 using a guest interface device. The guest interface device is designed to allow the display portion of the head mounted display 26 to transition quickly between being attached to the passenger's head and being detached after the ride. The guest interface device is configured to be attached to the passenger's head and thus allow the passenger to comfortably wear the head mounted display 26 throughout various attractions or while traversing a particular amusement park environment. For example, the guest interface device can include a head strap assembly that is configured to extend around the passenger's head and be fastened (e.g., strapped) onto the passenger's head. In this manner, the head strap assembly facilitates attachment of the guest interface device to the passenger's head such that the guest interface device can be utilized to hold the head mounted display 26 to the passenger. Similarly, a head strap assembly and guest interface device may be used to secure the guest interface device to the mount 36 .

[0027] Regardless of how the head mounted display 26 is coupled to the mount 36, when the head mounted display 26 is in operation, the display screen is within the field of view of one or more outward facing cameras 40 (see FIG. 2). During head mounted display testing, the mount 36 moves according to the motion pattern of the amusement vehicle 14. As described above, in some embodiments, the robotic arm 34 can move about one or more joints 42 to assist the actuators 44 in executing the vehicle motion pattern. The resulting lateral and longitudinal movement of the mount 36, as indicated by double headed arrows 46 and 48, can enable the head mounted display 26 to experience a high motion environment as found in the amusement vehicle 14. Footage (e.g., recorded, filmed) captured by the one or more cameras 40 during the motion simulation (e.g., images and / or videos displayed on the head mounted display 26) is processed to identify image features associated with degradation of the function of the head mounted display 26. Because both ends of the cable 30 are fixed, the simulated motion induces cable stresses similar to an actual amusement vehicle. Thus, the effect of movement on the integrity of the cable can be evaluated: since the image for display is provided by the cable 30, any degradation in image quality can be related to damage to the cable caused by movement.

[0028] FIG. 4 is a perspective view of a housing 50 and a display screen 52 of a head mounted display 26 configured for head mounted display testing. As described above, the head mounted display 26 includes a screen 52 coupled to a head mounted display housing 50. The screen 52 can include one or more (e.g., transparent, translucent, or opaque) screens, lenses, or displays. As a non-limiting example, the screen 52 can include a transparent (e.g., see-through) light emitting diode (LED) display, or a transparent (e.g., see-through) organic light emitting diode (OLED) display. In some embodiments, the display screen 52 can be formed from a single-piece construction spanning a distance to display an image (e.g., virtual feature 28) to both eyes of a user. That is, in such an embodiment (e.g., the embodiment shown in FIG. 4), the screen 52 can be formed from a single continuous piece of material, with a first screen, lens, or display aligned to a first eye of a user, and a second screen, lens, or display aligned to a second eye of a user. In other embodiments, screen 52 may be a multi-piece structure formed from two or more separate screens, lenses or display screens, In another embodiment, screen 52 may be implemented as two separate screens corresponding to a left eye screen and a right eye screen.

[0029] During head mounted display testing, the screen 52 may display an image 54 (e.g., a virtual image), such as an image of a vehicle in the illustrated embodiment. Markers 56 (e.g., physical markers) may also be attached to the display screen 52 and / or housing 50 at locations within the field of view of the one or more cameras 40 but that do not obstruct the displayed image 54. In some embodiments, the markers may be pieces of stickers, printed markers, fiducial markers, or the like. As discussed above, the markers 56 may be used in conjunction with images captured by the camera(s) 40 to determine the quality or operational status of the head mounted display 26.

[0030] If the display image 54 is detected on the display screen 52 during testing, the head mounted display 26 is attached and operational. On the other hand, if the display image 54 is not detected on the display screen 52, this may indicate that the head mounted display 26 is not functioning properly (e.g., due to cable damage) or that the head mounted display 26 has been displaced or separated from the mount 36. The markers 56 may help distinguish between these two scenarios. If the markers 56 are detected without the display image 54 being detected by one or more cameras 40, the head mounted display 26 may be considered secured to the mount 36 but not functional. On the other hand, if neither the display image 54 nor the markers 56 are detected by one or more cameras 40, it may be that the head mounted display 26 has been displaced or otherwise separated from the mount 36 such that the screen 52 is no longer within the field of view of the one or more cameras 40.

[0031] 5 is a flow chart of a process for verifying the quality of the head mounted display 26, according to an embodiment. The process begins with receiving an indication that the head mounted display 26 is present on the vehicle motion simulator (block 62). As described above, this may involve one or more cameras 40 capturing markers 56 in their field of view and relaying the captured footage (e.g., images and / or video) to a processor that executes instructions to process the camera footage (e.g., captured images) to detect the presence or absence of the markers 56 in the captured images. For example, image recognition algorithms may be used to detect the markers 56 in the camera footage. To aid in identifying the markers 56, the markers 56 may be selected to include images or text that are unlikely to be duplicated in the images displayed on the head mounted display 26.

[0032] Once the head mounted display 26 is attached, the vehicle motion simulator is controlled to move according to a vehicle motion pattern (block 64). As described above, the motion pattern may be selected from a variety of different motion patterns of the amusement vehicle 14. Additionally, the motion pattern executed by the vehicle motion simulator may include movements 46, 48 that resemble or simulate movements (e.g., dropping, pitching, yaw, rolling, etc.) of the ride vehicle 18 and its passengers 16 in the amusement vehicle 14. Additionally, the motion pattern may be obtained from the amusement vehicle controller 32.

[0033] During operation in the vehicle motion pattern, one or more cameras 40 of the vehicle motion simulator are used to detect an image to be displayed on the head mounted display screen 52 (block 66). The image displayed on the head mounted display 26 may include both the markers 56 and the displayed image 54.

[0034] After the image displayed on the head mounted display is detected, deviations in the detected image (e.g., the displayed image 54 and the markers 56) from the expected display are identified (block 68). As discussed above, possible deviations from the expected display can include the absence of the displayed image 54, the display image 54 being fully or partially displaced outside the field of view of one or more of the cameras 40, the displayed image 54 being blurred or cut off, the absence of the markers 56, and the markers 56 being fully or partially displaced outside the field of view of one or more of the cameras 40. Deviations from the expected display can be detected by image recognition algorithms in the processor. In one embodiment, deviations can be detected by comparison with a signal provided to the head mounted display 26 that is intended to cause the image to be displayed. This signal can be used as a reference image set, and the captured image can be compared to the reference images to identify any deviations.

[0035] In one embodiment, the comparison between the captured image and the reference image may be time-aligned such that the comparison occurs at corresponding points in time relative to the beginning of the display (e.g., according to the same point in time of the video display). Additionally, the identification of deviations may be based on a frame-by-frame comparison.

[0036] The system may use image differencing techniques, such as pixel-by-pixel comparison, to determine which individual frames are different from the corresponding reference frames and generate an image distance score between each compared set. The system 10 may extract characteristics of each captured image and represent them as a multidimensional feature vector. The similarity between the two images is quantified by a distance measure D defined in the multidimensional feature space. As shown herein, the system 10 may use global or local similarity measures. In one embodiment, a global similarity value may be generated and, if outside a predefined range, the frame may be identified as deviating from the reference image. If the global similarity is within a predefined range, the frame may be identified as conforming or non-deviant. Based on the total number of deviating frames, the operational state of the head mounted display may be characterized. In an embodiment, the head mounted display may be identified as operating normally or malfunctioning. If an individual frame differs from its time-aligned reference frame, the system 10 can begin a counter of identified display and capture frames having deviations. If the counter reaches a threshold (e.g., at least 10 identified frames), the system 10 can flag the head mounted display 26 as being in a malfunctioning state. Below the threshold, the head mounted display 26 is classified as operating normally, and the system 10 can provide appropriate instructions.

[0037] After a deviation from the expected display in the detected image is identified, an indication of head mounted display quality based on the identified deviation is generated (block 70). For example, if both the display image 54 and the markers 56 are detected by the at least one camera 40, the indication of head mounted display quality may convey that the head mounted display is operational. On the other hand, if the display image 54 exhibits a reduced quality (e.g., the display image 54 is missing, blurred, or interrupted) but the markers 56 are detected, the indication of head mounted display quality may convey that the screen 52 of the head mounted display 26 is malfunctioning (e.g., due to a frayed cable 30). If the head mounted display 26 is determined to be malfunctioning, the system 10 may generate a flag. Alternatively, if both the display image 54 and the markers 56 are not detected, the indication may convey that the head mounted display 26 may be displaced or separated from the mount 36.

[0038] The indication of the quality of the head mounted display can be used to determine a quantity such as the mean time to failure of the head mounted display. In one embodiment, the system 10 can test the head mounted display 26 by repeating a motion pattern associated with an amusement vehicle for multiple cycles until a change in motion condition is detected. For example, the image displayed by the head mounted display 26 can match the expected display (e.g., show a high correspondence with the reference image) for cycles 1-1000 during the test. During subsequent cycles, the captured images of one or more cameras 40 can show increasing deviations and decreasing conformance with the reference image. If the deviation is greater than a threshold, the mean time to failure can be marked as being associated with the cycle number where the deviation exceeded the threshold. Thus, in some embodiments, the mean time to failure can be indicated by the number of ride cycles to failure. In other embodiments, the mean time to failure can be the overall test time to failure.

[0039] It should be understood that the operational state of the head mounted display may change over time and over testing. Thus, the head mounted display 26 may be deemed to be operating normally at a first time and malfunctioning at a second time thereafter. The evaluation of the operational state may be performed substantially in real time such that the system 10 flags the malfunction as it occurs. Additionally, in one embodiment, the system 10 may command the vehicle motion simulator 12 to cease operation once a malfunction of the head mounted display 26 is identified. In another embodiment, the evaluation is performed retroactively. In one embodiment, testing may be performed using a predetermined number (e.g., 500) of vehicle cycle simulations to determine whether the head mounted display 26 is robust enough to operate normally over a predetermined number of cycles.

[0040] Additionally, the disclosed testing methods can be used to test different motion patterns against each other. In some embodiments, certain motion patterns may have a faster time to failure than other motion patterns. Such motion patterns can be flagged and the vehicle can be tuned to change its motion characteristics to avoid the flagged motion patterns and / or to include motion patterns with a longer time to failure in order to preserve the life of the head mounted display. Thus, the disclosed technology can be used in the design of recreational vehicles that use head mounted displays.

[0041] 6 is a block diagram of a head mounted display test system 10 incorporating a head mounted display 26, a vehicle motion simulator 12, and a controller 96 according to the present embodiment. The head mounted display 26, the vehicle motion simulator 12, and the controller 96 can be independent components that are used together to test the quality of the head mounted display.

[0042] As shown, the head mounted display 26 may include a controller 74, such as a central controller including one or more processors 78 and one or more memory devices 76. The one or more processors 78 may execute software programs and / or instructions to adjust the displayed image, such as the virtual features 28, displayed on the head mounted display screen 52. Additionally, the processor(s) 78 may include multiple microprocessors, one or more "general purpose" microprocessors, one or more special purpose microprocessors, and / or one or more application specific integrated circuits (ASICS), and / or one or more reduced instruction set (RISC) processors. The memory device(s) 76 may include one or more storage devices and store machine readable and / or processor executable instructions (e.g., firmware or software) for execution by the processor(s) 78, such as instructions related to adjusting the display of virtual objects. Thus, the memory device(s) 76 may store, for example, control software, look-up tables, configuration data, and the like, that facilitate adjusting the display of virtual objects. In some embodiments, the processor(s) 78 and the memory device(s) 76 may be external to the controller 74. The memory device(s) 76 may include a tangible, non-transitory, machine-readable medium, such as volatile memory (e.g., random access memory (RAM)) and / or non-volatile memory (e.g., read-only memory (ROM), flash memory, a hard drive, and / or any other suitable optical, magnetic, or solid-state storage medium).

[0043] The head mounted display 26 may include a microphone 80, a speaker 82, a receiver 84, and a transmitter 86. The receiver 84 picks up audio output so that a wearer of the head mounted display 26 can hear the audio through the speaker 82. The microphone 80 receives audio input from a head mounted display wearer, and the transmitter 86 transmits the audio input to another head mounted display wearer. The head mounted display 26 may also include a number of sensors 88 (e.g., a camera, an eye tracking sensor, a heart rate sensor, an equipment monitoring sensor, a hand tracking sensor, etc.).

[0044] As shown, the vehicle motion simulator 12 includes one or more cameras 40, actuators 44, and an actuator controller 90, such as a central controller including one or more processors 92 and one or more memory devices 94. In some embodiments, the processor(s) 92 and memory device(s) 94 may be external to the actuator controller 90. The actuator controller 90 receives a vehicle motion pattern (e.g., from the ride controller 32) and causes movement of the actuators 44 according to the motion pattern to simulate the motion of the amusement vehicle 14. For example, the memory device(s) 94 may store machine-readable and / or processor-executable instructions for executing the vehicle motion pattern. Meanwhile, the processor(s) 92 may execute software programs and / or instructions to direct movement of the robotic arm 34 and the actuators 44 to move the mount 36 according to the motion pattern.

[0045] The controller 96 receives video captured by the camera(s) 40 for processing (e.g., image detection). The controller 96 includes a processor(s) 98, a memory device(s) 100, an input / output (I / O) port 102, and a user interface 104. The I / O port 102 can receive video from the camera(s) 40. The processor(s) 98 can execute software programs and / or instructions to receive signals from one or more of the camera(s) 40 and identify deviations from an expected appearance on the display screen 52 based on the signals. For example, the processor 98 can execute image recognition algorithms to identify the displayed image 54 and the markers 56 on the display screen 52. The memory device(s) 100 can include one or more storage devices and can store machine-readable and / or processor-executable instructions (e.g., firmware or software) for execution by the processor(s) 98, such as instructions related to receiving camera signals and identifying deviations from an expected appearance. The controller 96 may then generate an indication of the quality of the head mounted display based on the identified deviations.

[0046] The user interface 104 (e.g., a graphical user interface (GUI)) may be used to configure the controller 96 to process the camera signal. For example, the user interface 104 may be used to set an expected display (e.g., expected image 54 and markers 56) so that deviations from the expected display in the detected image (e.g., detected image 54 and markers 56) may be identified as described in block 68. In another embodiment, the user interface 104 may be used to communicate an indication of head mounted display quality to a user. For example, the user interface 104 may display a notification indicating that the head mounted display 26 is malfunctioning. In another embodiment, the user interface 104 may display a notification indicating that the head mounted display 26 is present on the vehicle motion simulator 12 prior to the start of a head mounted display test.

[0047] As described herein, the head mounted display 26 can display images provided to the controller 74 of the head mounted display 26 via the cable 30. These images are provided to the controller 96 as reference images 110, which can be used to identify deviations. For example, the reference images 110 can be compared to images captured from the camera(s) 40. If the head mounted display is operating as intended, the images displayed on the display screen 52 of the head mounted display 26 and captured by the camera(s) 40 should have a high degree of match with the reference images 110.

[0048] While only certain features of the invention have been illustrated and described herein, many modifications and changes will occur to those skilled in the art and it is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the invention.

[0049] The technology presented and claimed herein refers to and applies to tangible objects and specific examples of a practical nature that positively improve the art and are therefore not abstract, intangible, or purely theoretical. Moreover, if any claim appended at the end of this specification contains one or more elements designated as "means for [performing] ... [function]" or "step for [performing] ... [function]," such elements are to be construed pursuant to 35 U.S.C. 112(f). On the other hand, for any claim containing an element designated in any other manner, such elements are not to be construed pursuant to 35 U.S.C. 112(f). [Explanation of symbols]

[0050] 10 Head-mounted display test system 14 Amusement rides 16 passengers 18 Vehicles 20 Vehicle Routes 24 Real World Environments 26 Head-mounted display 28 Virtual Features 30 Cable 32 Vehicle Controller 34 Robot Arm 36 Mount 42 Joints 44 Actuator

Claims

1. A head mounted display test system, comprising: a mount configured to receive a head mounted display including a display screen; at least one camera coupled to the mount and positioned to capture the display screen when the head mounted display is present on the mount; an actuator coupled to the mount; an actuator controller configured to cause movement of the actuators to cause the mount to simulate movement of a vehicle according to a movement pattern; associated with the head mounted display and positioned within the field of view of the at least one camera when the head mounted display is present on the mount; A controller; wherein the controller receiving a captured image of the display screen of the head mounted display from the at least one camera; identifying deviations from an expected appearance on the display screen based on the captured image; determining that the head mounted display is secured to the mount based on identifying the presence of the feature in the captured image; The system is configured as follows:

2. The system of claim 1 , comprising the head-mounted display, and wherein the display screen includes a left-eye display screen and a right-eye display screen.

3. 3. The system of claim 2, wherein the at least one camera includes a left-eye camera positioned to capture the left-eye display screen and a right-eye camera positioned to capture the right-eye display screen.

4. The system of claim 1 , wherein the mount comprises a humanoid mannequin head.

5. The system of claim 1 , comprising a cable having one end coupled to the head-mounted display and another end coupled to a stationary structure.

6. The system of claim 1 , wherein the controller is configured to generate an indication of a display quality of the head-mounted display based on the deviation from the expected display on the display screen.

7. The system of claim 6 , wherein the controller is configured to generate a notification when a change in the display quality is detected.

8. The system of claim 1 , wherein the controller uses image recognition algorithms and comparison of the captured image with a reference image to identify deviations from the expected appearance.

9. The system of claim 1 , comprising a robotic arm configured to move the mount according to the movement pattern.

10. The system of claim 1 , wherein the actuator controller is configured to select the motion pattern from a plurality of motion patterns.

11. The system of claim 1 , wherein the features include markers disposed on the head-mounted display.

12. The system of claim 11 , wherein the marker comprises a sticker, a printed marker, a fiducial marker, or any combination thereof.

13. A test method for a head-mounted display, comprising: receiving an indication that the head mounted display is present on the vehicle motion simulator; controlling the vehicle motion simulator to operate in accordance with a vehicle motion pattern; capturing data from a display screen on the head mounted display using at least one camera of the vehicle motion simulator while moving through the vehicle motion pattern; identifying deviations from an expected display on the display screen based on the data captured by the at least one camera; generating a failure time for the head mounted display in response to identifying the deviation, the failure time being determined based on a number of repeated cycles of the vehicle motion pattern executed by the vehicle motion simulator; A method comprising:

14. generating a notification that the head mounted display quality has changed based on the identified deviation. The method of claim 13.

15. 14. The method of claim 13, comprising generating a notification that the head mounted display is not installed correctly based on a marker on the head mounted display not being indicated by the data.

16. 14. The method of claim 13, comprising comparing the data to reference image data to identify deviations from the expected display, the reference image data also being provided to the head-mounted display for display as an associated image on the display screen.

17. 17. The method of claim 16, wherein identifying deviations from the expected display on the display screen based on the data captured by the at least one camera includes generating an image similarity for one or more image frames within the data.

18. 14. The method of claim 13, wherein the indication of the head mounted display quality is associated with a malfunction condition of the head mounted display, and includes controlling the vehicle motion simulator to deactivate upon identification of the malfunction condition.

19. The method of claim 13 , wherein the data captured by the at least one camera includes markers positioned on the head-mounted display.

20. The method of claim 19 , wherein the marker comprises a sticker, a printed marker, a fiducial marker, or any combination thereof.

21. A test method for a head-mounted display, comprising: receiving an indication that the head mounted display is present on the vehicle motion simulator; controlling the vehicle motion simulator to operate in accordance with a vehicle motion pattern; monitoring a display screen on the head-mounted display using at least one camera of the vehicle motion simulator while moving through the vehicle motion pattern; identifying deviations from an expected display on the display screen based on data captured by the at least one camera while the vehicle performance simulator is operating; generating a failure time for the head mounted display in response to identifying the deviation; and Including, the failure time is determined based on the number of repeated cycles of the vehicle motion pattern executed by the vehicle motion simulator; method.

Images