A direction tag to provide direction information

Abstract

An orientation tag provides orientation information, and attaching the orientation tag to an object provides orientation information of the object. The orientation tag displays different orientation information based on viewing the orientation tag at different angles. In particular, the orientation tag displays the angle and direction the orientation tag is rotated about a horizontal axis relative to the viewer and the angle and direction the orientation tag is rotated about a vertical axis relative to the viewer. Viewing the orientation tag makes it possible to determine the angle and direction the orientation tag is rotated about a depth axis relative to the viewer (e.g., depth information). The orientation and depth information facilitate determining the three-dimensional orientation of the orientation tag. An output device outputs a user interactive experience based on the orientation and depth information provided by the orientation tag.

Description

[Technical Field]

[0001] This section is intended to introduce the reader to various aspects of art that may be related to various aspects of the present disclosure, which are described below and / or claimed. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present disclosure. Accordingly, it should be understood that these statements are to be read in this light, and not as admissions of prior art.

[0002] In entertainment venues, user interactive devices, including handheld objects, head-mounted devices, clothing, etc., can be used in conjunction with other system components to enable interactive experiences. For example, a system can determine the orientation of the user interactive device using a gyroscope or accelerometer in the user interactive device, and the system can generate a user interactive experience based on the determined orientation. In a theme park setting, a patron can hold a toy sword, and in response to determining the orientation of the toy sword, the system can display (e.g., on a display near the patron, on a virtual reality or augmented reality display) a fireball that appears to be emanating from the toy sword. Currently, there is a recognized need for improved systems and methods for determining the orientation of a user interactive device to facilitate providing an appropriate response to the orientation of the user interactive device and / or data associated with the user interactive device. Summary of the Invention

[0003] Certain embodiments within the scope of the originally claimed invention are summarized below. These embodiments are not intended to limit the scope of the disclosure; rather, these embodiments are intended only to provide a brief summary of certain disclosed embodiments. Indeed, the disclosure may encompass a variety of forms that may be similar to or different from the embodiments set forth below.

[0004] In one embodiment, an orientation detection system includes an orientation detector having an image sensor and image processing circuitry. The orientation detection system also includes an orientation tag configured to be coupled to a user interaction device. The orientation tag includes a first layer of visual data and a second layer of visual alignment features disposed on the first layer. The visual alignment features reveal and obscure portions of the visual data relative to a viewpoint of the image sensor. Different patterns of the visual data are observable by the image sensor, each different pattern corresponding to a relative orientation of the orientation tag with respect to the viewpoint. The image processing circuitry determines an orientation of the orientation tag based on one of the different patterns of visual data observed by the image sensor.

[0005] In one embodiment, the entertainment system includes an orientation tag for a user interactive device. The orientation tag includes visual patterns and visual alignment features that limit visibility of the visual patterns based on a viewing orientation of the orientation tag. The entertainment system also includes a camera that captures an image of the orientation tag for the user interactive device. The entertainment system further includes a controller having processing circuitry and memory, the memory storing machine-readable instructions that cause the processing circuitry to identify the orientation tag for the user interactive device in the image and determine an orientation of the orientation tag based on orientation information associated with the visual pattern captured in the image.

[0006] In one embodiment, the user interactive device includes an orientation tag having a first layer including patterns, each pattern representing a set of orientation information, and a second layer disposed on the first layer including elements that allow corresponding patterns corresponding to a viewpoint of the orientation tag to be viewed from a viewpoint and block patterns that do not correspond to the viewpoint of the orientation tag from being viewed from a viewpoint.

[0007] These and other features of embodiments of the present disclosure will be better understood when the following detailed description is read in conjunction with the accompanying drawings, in which like reference numerals refer to like elements throughout. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a schematic diagram of a front perspective view of a theme park attraction system including a user interactive device having an orientation tag in a first orientation according to one embodiment of the present disclosure. [Figure 2] 2 is a schematic diagram of a side perspective view of a portion of the theme park attraction system of FIG. 1 including a user interactive device having an orientation tag in a first orientation according to one embodiment of the present disclosure. [Figure 3]2 is a schematic diagram of a top perspective view of a portion of the theme park attraction system of FIG. 1 including a user interactive device having an orientation tag in a first orientation, according to one embodiment of the present disclosure. [Figure 4] 2 is a schematic diagram of a front perspective view of the theme park attraction system of FIG. 1 including a user interactive device having an orientation tag in a second orientation according to one embodiment of the present disclosure. [Figure 5] 2 is a schematic diagram of a side perspective view of a portion of the theme park attraction system of FIG. 1 including a user interactive device having an orientation tag in a second orientation, according to one embodiment of the present disclosure. [Figure 6] 2 is a schematic diagram of a top perspective view of a portion of the theme park attraction system of FIG. 1 including a user interactive device having an orientation tag in a second orientation, according to one embodiment of the present disclosure. [Figure 7] 2 is a schematic diagram of the orientation tag of FIG. 1 that provides different orientation information based on different angles from which the orientation tag is viewed, according to one embodiment of the present disclosure. [Figure 8] 2 is a schematic diagram of the orientation tag of FIG. 1 using a mask layer to provide different orientation information based on different angles from which the orientation tag is viewed, according to one embodiment of the present disclosure. [Figure 9] 2 is a schematic diagram of the orientation tag of FIG. 1 using a lenticular layer to provide different orientation information based on different angles from which the orientation tag is viewed, according to one embodiment of the present disclosure. [Figure 10] FIG. 2 is a block diagram of the theme park attraction system of FIG. 1 according to one embodiment of the present disclosure. [Figure 11] FIG. 1 is a flow diagram of a process for determining the orientation and position of a user interactive device according to one embodiment of the present disclosure. [Figure 12] 2 is a schematic diagram of the user interactive device of FIG. 1 in the form of a handheld device and an output device in the form of an electronic display and speaker, according to one embodiment of the present disclosure. [Figure 13]2 is a schematic diagram of the user interactive device of FIG. 1 in the form of a mobile device and an output device in the form of an electronic display and speaker, according to one embodiment of the present disclosure. [Figure 14] 2 is a schematic diagram of the user interaction device of FIG. 1 in the form of a head-mounted device and an output device in the form of an electronic display of the head-mounted device, according to one embodiment of the disclosure. [Figure 15] 2 is a schematic diagram illustrating the user interaction device of FIG. 1 in the form of a flexible wearable material and an output device in the form of an electronic display of a head-mounted device, according to one embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0009] One or more specific embodiments are described below. In the interest of providing a concise description of these embodiments, not all features of an actual implementation will be described herein. It will be understood that, as with any engineering or design project, the development of any such actual implementation will require numerous implementation-specific decisions to be made to achieve the developer's particular goals, which may vary from implementation to implementation, including compliance with system- and business-related constraints. It will further be appreciated that such a development effort, while potentially complex and time-consuming, would be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill in the art having the benefit of this disclosure.

[0010] When introducing elements of various embodiments of the invention, the articles "a," "an," and "the" are intended to mean that there are one or more of the elements. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there may be additional elements other than the listed elements. In addition, it should be understood that references to "one embodiment" or "one embodiment" of the invention are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the recited features.

[0011] In entertainment venues, user interactive devices, including handheld objects, head-mounted devices, clothing, etc., can be used in conjunction with other system components to enable interactive experiences. For example, the interactive device can include an image of a pattern or code (e.g., a Quick Response (QR) code), which can be detected to identify orientation information (e.g., horizontal and vertical orientation information) based on the pattern or code in a captured image view. For example, a QR code includes three finder patterns and an alignment pattern that can be used to determine how the QR code is rotated. An output device (e.g., a display) can then output a user interactive experience (e.g., video data) based on the orientation information (e.g., where the user interactive device is aimed). However, the pattern or code may be prone to errors due to partial occlusion, lighting changes, excessive distance from the image capture device (e.g., a camera), small angle changes, etc.

[0012] The present disclosure generally relates to orientation tags or markers that display orientation information (e.g., corresponding to an angular orientation) of an orientation tag based on a viewer's viewpoint. That is, the orientation tag displays different orientation information at different viewer viewpoints so that a detection system can determine the orientation of the orientation tag. The orientation tag can also block or prevent the viewer from viewing other orientation information (e.g., that corresponds to other viewpoints). The detection aspect of the orientation tag can provide orientation information about the orientation tag itself, and by binding or attaching the orientation tag to an object, the orientation information of the object can be similarly detected. The orientation information can include the angle by which the orientation tag is rotated about a horizontal axis relative to the viewer and the angle by which the orientation tag is rotated about a vertical axis relative to the viewer. For example, when the orientation tag is viewed "straight on" (e.g., such that the orientation tag is rotated 0° about the horizontal axis relative to the viewer and 0° about the vertical axis relative to the viewer), the orientation tag can display orientation information indicating a rotation of 0° about the horizontal axis and 0° about the vertical axis. As another example, if the orientation tag is viewed as rotating 20° clockwise around a horizontal axis relative to the viewer and 70° counterclockwise around a vertical axis relative to the viewer, the orientation tag may display orientation information indicating a rotation of 20° clockwise around the horizontal axis and 70° counterclockwise around the vertical axis.

[0013] Additionally, viewing the orientation tag may allow the angle by which the orientation tag is rotated about a depth axis relative to the viewer to be determined. For example, pattern and / or image recognition techniques may be used to identify the orientation tag in an image and determine the angle by which the orientation tag is rotated about a depth axis. The orientation and depth information facilitates determining the orientation of the orientation tag in three dimensions (e.g., six degrees of freedom).

[0014] The orientation tag can display different orientation information at different viewer viewpoints due to field printing technology, where the base layer is composed of multiple patterns, each pattern representing a set of orientation information. A mask layer can be disposed on top of the base layer to block or prevent other orientation information (e.g., corresponding to other viewpoints) from being seen by the viewer. Based on viewing the orientation tag at specific horizontal and vertical rotation angles, the mask layer and base layer can make specific patterns representing respective sets of orientation information corresponding to the specific horizontal and vertical rotation angles visible. In some embodiments, the mask layer can include blocking elements that block the view of patterns other than the specific patterns, thus enabling the view of the specific patterns representing the sets of orientation information corresponding to the specific horizontal and vertical rotation angles. In alternative or additional embodiments, the orientation tag can include a lens layer having lens elements that refract the specific patterns representing the sets of orientation information corresponding to the specific horizontal and vertical rotation angles toward the viewer, while refracting patterns other than the specific patterns away from the viewer at the specific horizontal and vertical rotation angles.

[0015] Because the orientation information is encoded into the pattern rather than derived from perspective warping of the pattern, the orientation tag can reduce the likelihood of errors due to partial occlusion, lighting changes, excessive distance from the camera, small angle changes, etc. Thus, the present embodiment can provide a more effective and efficient method for providing orientation information than simply using perspective warping. Furthermore, because the orientation tag conveys orientation information passively (e.g., via static rather than dynamic components), the passive nature of the orientation tag avoids or reduces the use of complex elements (e.g., electronic displays, communication circuitry), and thus can provide orientation information in a cost-effective manner. Indeed, the orientation tag can include an adhesive surface for conveniently attaching orientation to any number of user-interactive devices, thereby enabling customers, for example, to purchase an orientation tag and attach it to the user-interactive device of their choice. Note that the present embodiment can employ layered patterns of orientation tags in conjunction with perspective warping and communication circuitry.

[0016] According to embodiments of the present disclosure, a system may include a camera, a processor, a memory device, and / or an output device cooperatively programmed to provide a response to the orientation of an orientation tag associated with use of a user interaction device. As one example, the user interaction device may be shaped like a sword with an orientation tag attached, and a user may point the user interaction device at an animated object (e.g., a robot or other animated figure) in an attraction; in response to determining that the orientation tag, and thus the user interaction device, is pointed at the animated object, the animated object may output a user interactive experience (e.g., falling). As another example, the user interaction device may be a virtual reality headset with an orientation tag attached, and a user may wear the user interaction device and move their head (e.g., side to side). In response, a display of the virtual reality headset may display video data corresponding to the user's head movement (e.g., creating the illusion that the user is looking around in a virtual world). As yet another example, the user interactive device can be a user's mobile communication device (e.g., a smartphone, cell phone, tablet, wearable device) with an orientation tag attached (e.g., to the back of the user's mobile device or to the cover of the user's mobile device). An electronic display (e.g., a wall-mounted or augmented reality display) can display a virtual object (e.g., a baseball bat) that correlates to the user's mobile device, and shaking the mobile device can cause the virtual object to shake due to movement of the orientation tag.

[0017] 1 is a schematic diagram of a front perspective view of a theme park attraction or entertainment system 10 including a user interactive device 12 having an orientation tag 14 in a first orientation, according to one embodiment of the present disclosure. In particular, the orientation tag 14 displays orientation information (e.g., corresponding to an angular orientation) of the orientation tag 14 based on a viewer's viewpoint, while blocking or preventing the viewer from viewing other orientation information (e.g., corresponding to other viewpoints). The user interactive device 12 can be any suitable device that requires tracking (e.g., to provide a user interactive experience). For example, the user interactive device 12 can include a handheld device (e.g., a sword, a gun, a mug, a cup), a head-mounted device (e.g., a helmet, a hat, goggles), an article of clothing (e.g., a vest, a jacket, a sleeve, a glove, a scarf), a wrist-mounted device (e.g., a watch), and the like. In some embodiments, the user interactive device 12 can be fixed or attached (albeit operable) to a predetermined position. For example, the user interactive device 12 may include a theme park animatronic figure with actuatable features (e.g., a mouth that opens and closes, arms that move around). The orientation tag 14 may be coupled to the animatronic figure (e.g., a head or appendage of the animatronic figure) to, for example, track the position of the animatronic figure (e.g., determine the direction the animatronic figure is facing). As another example, tracking the orientation tag 14 may track the animatronic figure (e.g., a head or appendage of an animatronic feature) to determine if the animatronic figure has moved over time (e.g., due to wear and tear) beyond an acceptable amount of error.

[0018] The orientation tag 14 can be affixed or attached to the user interactive device. For example, the orientation tag 14 can include an adhesive layer or backing that allows the orientation tag 14 to be adhered to the user interactive device 12. In this manner, the orientation tag 14 can be provided or sold separately from the user interactive device 12 and then attached to any user interactive device 12 of a user's choosing. In some embodiments, the orientation tag 14 can be removably or temporarily affixed to the user interactive device 12, allowing the orientation tag 14 to be reattached to another user interactive device 12. For example, the orientation tag 14 can be affixed and reattached using a magnetic backing, a removable vinyl backing, Velcro®, or the like, to a magnetic portion or plate of the user interactive device 12. As another example, the user interactive device 12 can include a clear or transparent sleeve into which the orientation tag 14 can be placed. While the orientation tag 14 is illustrated as flat, in some embodiments, the orientation tag 14 can be curved or angled. In some embodiments, the orientation tag 14 may follow the curve of a portion of the user interactive device 12 to which it is attached.

[0019] The orientation tag 14 can provide orientation information for the orientation tag 14, and adding the orientation tag 14 to the user interactive device 12 can provide orientation information for the user interactive device 12. The orientation tag 14 can include a light field that displays different orientation information based on viewing the orientation tag 14 at different angles. In particular, the orientation tag 14 can indicate the angle (e.g., horizontal rotation angle) by which the orientation tag 14 is rotated relative to a viewer, such as an image sensor or image capture device (e.g., camera 20), about a horizontal axis (e.g., along or parallel to x-axis 18 shown on coordinate axes 16). The orientation tag 14 can also indicate the angle (e.g., vertical rotation angle) by which the orientation tag 14 is rotated relative to the camera 20 about a vertical axis (e.g., along or parallel to y-axis 21 shown on coordinate axes 16). For reference, a front perspective view of the theme park attraction system 10 is shown along a depth axis (e.g., along or parallel to z-axis 22 shown on coordinate axes 16) relative to the camera 20. In this manner, the orientation tag 14 can display orientation information of the orientation tag 14 based on the viewpoint of the camera 20 (eg, corresponding to an angular orientation).

[0020] As shown, the orientation tag 14 provides orientation information in the form of a Quick Response (QR) code 23; however, in additional or alternative embodiments, the orientation information can be provided in any form, such as a barcode, pattern, text, or the like, captured by the camera 20 in one or more images and suitable for recognition by the controller 24 or control system. The controller 24 can include processing circuitry, such as one or more processors (shown and referred to herein as a single processor 26), and one or more memory or storage devices (shown and referred to herein as a single memory device 28). The processor 26 can execute software programs and / or instructions stored in the memory device 28 that facilitate determining the orientation of the orientation tag 14 and / or the user interactive device 12. Furthermore, the processor 26 can include multiple microprocessors, one or more “general-purpose” microprocessors, one or more special-purpose microprocessors, and / or one or more application-specific integrated circuits (ASICs). For example, the processor 26 can include one or more reduced instruction set computer (RISC) processors. Additionally, processor 26 may include image processing and / or pattern recognition circuitry specifically designed to efficiently process and / or recognize images (including orientation tag 14) and / or data (including orientation information) provided by orientation tag 14 (e.g., in the form of text, barcode, QR code 23). Memory device 28 may store information such as control software, look-up tables, configuration data, etc. Memory device 28 may include tangible, non-transitory, machine-readable media, such as volatile memory (e.g., random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM)), flash memory, one or more hard drives, and / or any other suitable optical, magnetic, or solid-state storage medium. Memory device 28 may store a variety of information and may be used for a variety of purposes, such as instructions that facilitate determining the orientation of orientation tag 14 and / or user interactive device 12.

[0021] In particular, the processor 26 can execute image recognition techniques stored in the memory device 28 to identify the orientation tag 14 in an image of the user interactive device 12 captured by the camera 20. This may include comparing the image of the user interactive device 12 to a table of information or running an algorithm (e.g., stored in the memory device 28) based on the image of the orientation tag 14 to identify the correlated location and identity information of the orientation tag 14. The processor 26 can then execute pattern recognition techniques (e.g., decoding techniques, text recognition techniques, object recognition techniques) stored in the memory device 28 to determine the orientation information provided by the orientation tag 14. For example, the orientation tag 14 may be a particular shape (e.g., square, circle, rectangle) with a particular color (e.g., white, black, blue), and the processor 26 can use image recognition techniques to identify the particular shape and particular color of the orientation tag 14. As another example, the orientation tag 14 may include a QR code 23 having one or more position and / or alignment markers. In this manner, the processor 26 can use pattern recognition techniques (e.g., QR Code® 23 recognition techniques) stored in the memory device 28 to identify the orientation tag 14 by identifying the orientation tag 14.

[0022] In some embodiments, the theme park attraction or orientation detection system 10 includes an orientation detector having an image sensor (e.g., camera 20) and image processing circuitry. The image processing circuitry may implement image and / or pattern recognition techniques to identify the orientation tag 14 in an image of the user interactive device 12 detected by the image sensor and / or determine the orientation information provided by the orientation tag 14. The image processing circuitry may execute instructions stored in a memory device 28 and / or may be part of or separate from the controller 24.

[0023] As shown, the camera 20 views the orientation tag 14 affixed to the user interaction device 12 "straight on," such that the orientation tag 14 is rotated 0° about a horizontal axis 18 (e.g., horizontal rotation angle) relative to the camera 20 and 0° about a vertical axis 21 (e.g., vertical rotation angle) relative to the camera 20. For clarity, FIG. 2 is a schematic diagram of a side perspective view of a portion of the theme park attraction system 10 of FIG. 1 including a user interaction device 12 with the orientation tag 14 in a first orientation, according to one embodiment of the present disclosure. In particular, the side perspective view is shown along the horizontal axis 18 relative to the camera 20. To better illustrate, the orientation tag 14 is rotated 0° about the horizontal axis 18 relative to the camera 20 (e.g., horizontal rotation angle 30). Similarly, FIG. 3 is a schematic diagram of a top perspective view of a portion of the theme park attraction system 10 of FIG. 1 including a user interaction device 12 with the orientation tag 14 in a first orientation, according to one embodiment of the present disclosure. In particular, the top perspective view is shown along the vertical axis 21 relative to the camera 20. As shown, the orientation tag 14 is rotated 0° about the vertical axis 21 (e.g., vertical rotation angle 32) relative to the camera 20.

[0024] Returning to FIG. 1 , the orientation tag 14 displays a QR code 23 that encodes orientation information 34, which may include a horizontal rotation angle 30 ( FIG. 2 ) and a vertical rotation angle 32 ( FIG. 3 ) corresponding to the camera's field of view. In some embodiments, the orientation information 34 may also encode the horizontal and vertical rotation direction (e.g., clockwise or counterclockwise). The camera 20 may capture an image of the orientation tag 14 and transmit it to the controller 24. The processor 26 may identify and read the QR code 23 in the orientation tag 14 using pattern recognition technology (e.g., QR code recognition technology) stored in the memory device 28 to determine the orientation information 34. As shown, the processor 26 determines the orientation information 34, which includes the horizontal rotation angle 30 being 0° and the vertical rotation angle 32 being 0°.

[0025] In some embodiments, memory device 28 may store different sets of orientation information (e.g., QR codes 23) corresponding to different horizontal rotation angles (e.g., 30) and vertical rotation angles (e.g., 32), and processor 26 may compare the image of orientation information 34 with the different sets of orientation information to determine the horizontal and vertical rotation angles. Additionally or alternatively, orientation information 34 may be provided "directly" in numeric and / or text format by orientation tag 14, such that no decoding needs to be performed by processor 26. In this manner, processor 26 may perform numeric and / or text recognition techniques to determine the horizontal and vertical rotation angles.

[0026] Additionally, by viewing the orientation tag 14, it may be possible to determine the angle (e.g., depth rotation angle) by which the orientation tag 14 is rotated about a depth axis (e.g., illustrated on coordinate axes 16 as z-axis 22) relative to the camera 20. For example, pattern and / or image recognition techniques can be employed to identify the orientation tag in an image and determine the angle by which the orientation tag is rotated about depth axis 22. As shown, the camera 20 views the orientation tag 14 affixed to the user interaction device 12 "straight on," such that the orientation tag 14 is rotated 0° about the depth axis 22 (e.g., depth rotation angle 36).

[0027] The orientation information (e.g., horizontal and vertical rotation angles 30, 32) and depth information (e.g., including depth rotation angle 36) facilitate determining the orientation of the orientation tag 14 in three dimensions (e.g., six degrees of freedom). For example, as described above, the processor 26 determines the orientation information 34, including a horizontal rotation angle 30 of 0° and a vertical rotation angle 32 of 0°, based on an image of the orientation tag 14 captured by the camera 20. The processor 26 can also determine the depth rotation angle 36 based on identifying the orientation tag 14 in the image (e.g., using image recognition techniques). In this manner, the processor 26 can determine the orientation of the orientation tag 14 using the horizontal, vertical, and depth rotation angles 30, 32, 36 (e.g., corresponding to the pitch, yaw, and roll of the orientation tag 14). Additionally, the processor 26 can determine the size (e.g., width 38 and length 40) of the orientation tag 14 in the image (e.g., the number of pixels in the image that correlate with the width 38 and length 40 of the orientation tag 14). Based on the known width 38 and length 40 of the orientation tag 14 and the corresponding number of pixels, the processor 26 can determine the distance the camera 20 is away from the orientation tag 14 (e.g., a depth measurement that can be part of the depth information) to facilitate determining both the orientation and position of the orientation tag 14, and thus the orientation and position of the user interactive device 12.

[0028] As another illustrative example, Figure 4 is a schematic diagram of a front perspective view of the theme park attraction system 10 of Figure 1 including a user interactive device 12 having an orientation tag 14 in a second orientation, in accordance with one embodiment of the present disclosure. As shown, the user interactive device 12, and thus the orientation tag 14, is rotated relative to the camera 20 in a counterclockwise direction (e.g., depth rotation direction 49) about the depth axis 22 through a depth rotation angle 36 of 45°. As described above, the processor 26 may determine the depth rotation angle 36 based on identifying the orientation tag 14 in an image of the user interactive device 12 having the orientation tag 14 captured by the camera 20 (e.g., using image recognition techniques). In some embodiments, the processor 26 may determine the depth rotation angle 36 of the orientation tag 14 based on one or more reference features of the orientation tag 14 by comparing the reference features with the features of the orientation tag 14 when rotated 0° about the depth axis 22. 4, the orientation tag 14 is provided in the form of a QR code 23. In this manner, the processor 26 can identify the locations of the three position markers 50 and / or alignment markers 52 of the QR code 23 and determine how the orientation tag 14 is rotated relative to when the orientation tag 14 is rotated 0° about the depth axis 22. The processor 26 can use pattern and / or image recognition techniques to identify such reference features of the orientation tag 14.

[0029] Additionally, Figure 5 is a schematic diagram of a side perspective view of a portion of the theme park attraction system 10 of Figure 1 including a user interactive device 12 having an orientation tag 14 in a second orientation, in accordance with one embodiment of the present disclosure. In particular, the side perspective view is shown along a horizontal axis 18 relative to the camera 20. As shown, the orientation tag 14 is rotated 30 degrees in a clockwise direction (e.g., horizontal rotation direction 54) about the horizontal axis 18 (e.g., horizontal rotation angle 30) relative to the camera 20. Similarly, Figure 6 is a schematic diagram of a top perspective view of a portion of the theme park attraction system 10 of Figure 1 including a user interactive device 12 having an orientation tag 14 in a second orientation, in accordance with one embodiment of the present disclosure. In particular, the top perspective view is shown along a vertical axis 21 relative to the camera 20. As better shown, the orientation tag 14 is rotated 45 degrees counterclockwise (e.g., vertical rotation direction 56) about the vertical axis 21 (e.g., vertical rotation angle 32) relative to the camera 20. The orientation information (eg, horizontal and vertical rotation angles 30, 32) and depth information (eg, including depth rotation angle 36) facilitate determining the three-dimensional (eg, six degrees of freedom) orientation of the orientation tag 14.

[0030] In this manner, the orientation tag 14 may display different orientation information (e.g., corresponding to different angular orientations) at different viewer viewpoints, enabling a detection system to determine the orientation of the orientation tag 14. That is, the orientation tag 14 may display information indicative of the relative orientation of the orientation tag 14 (e.g., relative orientation to the viewer's viewpoint). The orientation tag 14 may be fabricated using any suitable material, format, and / or technique that allows for providing or displaying different information or images depending on the different angles from which the orientation tag 14 is viewed. While this disclosure discusses orientation tags 14 fabricated using light field printing techniques, it should be understood that other suitable techniques are also applicable, such as lenticular printing techniques, the use of a series of baffles that allow and block the viewing of different images, etc. Furthermore, while Figures 1-6 illustrate the camera 20 viewing one orientation tag 14 on one user interactive device 12 and the controller 24 determining orientation information 34 for one orientation tag 14 and / or one user interactive device 12, in additional or alternative embodiments, the camera 20 may view multiple orientation tags 14 on multiple user interactive devices 12 and the controller 24 may determine orientation information 34 for multiple orientation tags 14 and / or multiple user interactive devices 12.

[0031] FIG. 7 is a schematic diagram of the orientation tag 14 of FIG. 1 that provides different orientation information 34 based on different angles from which the orientation tag 14 is viewed, according to one embodiment of the present disclosure. In particular, the orientation tag 14 can include a base layer 70 that includes different visual data, such as in the form of multiple patterns (e.g., visual patterns) 72A-C (collectively referred to as elements 72). Each pattern 72 can display a graphic or image that conveys the orientation information 34. For example, each pattern 72 can be a barcode, pattern, text, etc. suitable for capture by the camera 20 and identification by the controller 24. The patterns 72 can be interspersed, alternating, or positioned on the base layer 70 such that one pattern 72 conveying the orientation information 34 is viewable from a viewing angle that corresponds to the orientation information 34. Patterns that do not correspond to the orientation information 34 can be blocked or prevented from being visible to a viewer (e.g., using a visual blocking structure, refraction of visible light, a baffle structure, or a collimated backlight).

[0032] For example, while patterns 72A-C are shown in FIG. 7 , it should be understood that any suitable number of patterns 72 can be included on the orientation tag. In practice, the number of patterns 72 can depend on the resolution of the printer printing the orientation tag 14 and the size or surface area of ​​the orientation tag 14. For example, with an orientation tag 14 that is 8 centimeters (cm) wide and 8 centimeters long and a printer with a resolution of 200 dots per cm (dpcm), the orientation tag 14 can provide approximately 1600 x 1600 (2,560,000) patterns, each corresponding to a different set of orientation information 34. The orientation tag 14 can be any suitable size that is convenient for addition to the user interaction device 12, such as between 0.25 cm x 0.25 cm and 20 cm x 20 cm, including 8 cm x 8 cm, 5 cm x 8 cm, 5 cm x 5 cm, 3 cm x 3 cm, 10 cm x 8 cm, 10 cm x 10 cm, etc. Additionally, printer resolution may include inkjet printer resolution (eg, 120-285 dpcm), laser printer resolution (235-945 dpcm), or better.

[0033] As shown, orientation tag 14 provides or displays a first pattern 72A when viewed by camera 20 from a first position 74. For example, first position 74 may be viewed with orientation tag 14 rotated 15° clockwise about a horizontal axis of rotation and 170° clockwise about a vertical axis of rotation. In this manner, first pattern 72A may provide orientation information 34 with a horizontal rotation angle 30 of 15°, a horizontal rotation direction 54 of clockwise, a vertical rotation angle 32 of 170°, and a vertical rotation direction 56 of clockwise.

[0034] When viewed by camera 20 from second position 76, orientation tag 14 provides or displays second pattern 72B. For example, second position 76 may view orientation tag 14 rotated 5° counterclockwise about a horizontal axis of rotation and 20° clockwise about a vertical axis of rotation. In this manner, second pattern 72B may provide orientation information 34 with a horizontal rotation angle 30 of 5°, a horizontal rotation direction 54 counterclockwise, a vertical rotation angle 32 of 20°, and a vertical rotation direction 56 clockwise.

[0035] When viewed by camera 20 from third position 78, orientation tag 14 provides or displays third pattern 72C. For example, third position 78 may view orientation tag 14 rotated 60° clockwise about a horizontal rotation axis and 140° counterclockwise about a vertical rotation axis. In this manner, third pattern 72C may provide orientation information 34 with horizontal rotation angle 30 of 60°, horizontal rotation direction 54 clockwise, vertical rotation angle 32 of 140°, and vertical rotation direction 56 counterclockwise. In this manner, orientation tag 14 may display orientation information of orientation tag 14 corresponding to the viewer viewpoint (e.g., corresponding to the relative orientation of orientation tag 14 with respect to the viewer viewpoint) to the viewer, while blocking or preventing other orientation information (e.g., corresponding to other viewpoints) from being viewed by the viewer.

[0036] In some embodiments, the orientation tag 14 may include a light source 80 (e.g., collimated lighting) disposed below the base layer 70 to provide better visibility for the camera 20 to view the pattern 72. The light source 80 may include a light-reflecting device such as a retroreflective material (e.g., retroreflective sheeting, retroreflective fabric, retroreflective glass beads, microprisms, encapsulated lenses on a fabric or plastic substrate, and / or metal tape). In this manner, light entering the orientation tag 14 may be reflected by the light source 80, such that the reflected light illuminates the pattern 72 in the base layer 70. In additional or alternative embodiments, the light source 80 may be any suitable light-generating device that emits light to illuminate the pattern 72. For example, the light source 80 may include a light bulb, such as a liquid crystal display (LCD), a light-emitting diode (LED), or an organic LED (OLED). In some embodiments, the light source 80 may include directional or collimated light that directs the pattern 72 corresponding to the viewer's viewpoint toward the viewer while directing other patterns 72 corresponding to other viewpoints away from the viewer (e.g., so that the other patterns 72 are not visible by the viewer). The light source 80 may be battery-powered and / or rechargeable. In some embodiments, the orientation tag 14 and / or the user interaction device 12 may include a power source 82 (e.g., a battery, a capacitor, an energy-harvesting circuit) for this purpose. In some embodiments, the light source 80 may be a wirelessly powered light (e.g., using ultra-high frequency (UHF) power harvesting).

[0037] Although the illustrated light source 80 emits light in the visible spectrum, in some embodiments, the light source 80 can emit light in the non-visible spectrum (e.g., infrared or ultraviolet spectrum), such that the camera 20 can use light in the non-visible spectrum to capture images of the orientation tag 14. Using a light source 80 that emits light in the non-visible spectrum can, for example, prevent other theme park patrons from being distracted by the orientation tag 14, thereby maintaining a good theme park experience.

[0038] In some embodiments, the pattern 72 itself can be provided by a light-emitting device (e.g., LCD, LED, OLED). In additional or alternative embodiments, the orientation tag 14 and / or the user interactive device 12 can include light-emitting devices that emit light in two or more different spectrums. For example, a first set of light-emitting devices can emit light in the visible spectrum, and a second set of light-emitting devices can emit light in the non-visible spectrum (e.g., infrared). This allows for the use of multiple sets of light-emitting devices to transfer more data. For example, a first set of light-emitting devices can provide a pattern indicating the horizontal rotation angle 30 and the horizontal rotation direction 54, and a second set of light-emitting devices can provide a pattern indicating the vertical rotation angle 32 and the vertical rotation direction 56. As another example, a first set of light-emitting devices can provide a pattern indicating the orientation information 34, and a second set of light-emitting devices can provide a pattern indicating identification information (e.g., an identification number for the user interactive device 12, an account number, user profile information, etc.).

[0039] In some embodiments, the pattern 72 and / or the base layer 70 may allow light from the light source 80 to pass through. For example, the pattern 72 may be printed on the base layer 70, and / or the base layer 70 may include a filter or screen (e.g., a pass-through filter). In this manner, an image of the orientation tag 14 captured by the camera 20 may include an image of the pattern 72 as printed on the filter and backlit by the light source 80. In additional or alternative embodiments, certain elements of each pattern 72 may be “offset” (e.g., aligned or oriented differently) relative to other elements. In particular, as the viewing angle changes from a first perspective to a second perspective, a first set of elements of the pattern 72 may be visible at the first perspective (while a second set of elements of the pattern 72 may not be visible), and the second set of elements of the pattern 72 may be visible at the second perspective (while the first set of elements of the pattern 72 may not be visible). This allows for higher fidelity or angular resolution for camera 20 without increasing the fidelity or angular resolution (eg, number of elements) of pattern 72 .

[0040] In some embodiments, the orientation tag 14 may include a mask layer or visual alignment feature disposed on the base layer 70. The mask layer may reveal or expose a pattern indicative of orientation information 34 corresponding to a particular horizontal and vertical rotation angle 30, 32 based on viewing the orientation tag 14 at that particular horizontal and vertical rotation angle 30, 32. The mask layer may also, for example, block or limit the visibility of other patterns (e.g., patterns corresponding to other viewpoints) from the camera 20. FIG. 8 is a schematic diagram of the orientation tag 14 of FIG. 1 using a mask layer 100 to provide different orientation information 34 based on different angles from which the orientation tag 14 is viewed, according to one embodiment of the present disclosure. As shown, the mask layer 100 may include a blocking element 102 that blocks (e.g., physically blocks) the visibility of patterns (e.g., 72B, 72C) other than the particular pattern (e.g., 72A) corresponding to the camera's viewpoint, thereby allowing the particular pattern indicative of orientation information 34 corresponding to the camera's viewpoint to be visible.

[0041] For example, blocking element or visual alignment element 102A can block pattern 72B from camera viewpoint 104 (e.g., when camera 20 is in first position 74 as shown in FIG. 7), and blocking element 102B can block pattern 72C from camera viewpoint 104 while allowing camera viewpoint 104 to access pattern 72A. Similarly, blocking element 102A can block pattern 72A from camera field of view 106 (e.g., when camera 20 is in second position 76 as shown in FIG. 7), and blocking element 102B can block pattern 72C from camera field of view 106 while allowing camera field of view 106 to access pattern 72B. Additionally, blocking element 102A can block pattern 72A from camera view 108 (e.g., when camera 20 is in a third position), and blocking element 102B can block pattern 72B from camera view 108, while allowing camera view 108 to access pattern 72C. In this manner, blocking element 102 can allow viewing of patterns that convey orientation information of orientation tags 14 to a viewer that corresponds to the viewer's viewpoint, while blocking the viewer from viewing other orientation information (e.g., corresponding to other viewpoints).

[0042] In alternative or additional embodiments, the orientation tag 14 may include a lens or visual alignment layer disposed over the base layer 70 that enables viewing or revealing a pattern indicative of orientation information 34 corresponding to particular horizontal and vertical rotation angles 30, 32 based on viewing the orientation tag 14 at particular horizontal and vertical rotation angles 30, 32. The lens layer may also refract visible light from other patterns (e.g., patterns corresponding to other viewpoints) away from the camera 20, for example, to prevent or block the camera 20 from viewing the other patterns. Figure 9 is a schematic diagram of the orientation tag 14 of Figure 1 using a lens layer 120 to provide different orientation information 34 based on different angles from which the orientation tag 14 is viewed, according to one embodiment of the present disclosure. The lens layer 120 may include lenses or visual alignment elements 122 that refract the particular pattern indicating the orientation information 34 toward the camera 20 while refracting the visibility of patterns (e.g., 72B, 72C) other than the particular pattern (e.g., 72A) away from the camera 20.

[0043] For example, lens element 122 can refract the view of pattern 72A into the camera's field of view 104 while refracting the view of patterns 72B, 72C from the camera's field of view 104 (e.g., when camera 20 is in first position 74 as shown in FIG. 7 ). Similarly, lens element 122 can refract the line of sight of pattern 72B into the camera's field of view 106 while refracting the view of patterns 72A, 72C into the camera's field of view 106 (e.g., when camera 20 is in second position 76 as shown in FIG. 7 ). Furthermore, lens element 122 can refract the view of pattern 72C into the camera's field of view 108 while refracting the view of patterns 72A, 72B from the camera's field of view 108 (e.g., when camera 20 is in third position 78 as shown in FIG. 7 ). In this way, the lens element 122 can enable the viewer to see a pattern that conveys orientation information of the orientation tag 14 corresponding to the viewer's viewpoint, while blocking other orientation information (e.g., corresponding to other viewpoints) from being seen by the viewer.

[0044] Lens elements 122 may include any suitable material, shape, and / or size to refract the view of pattern 72 as desired. For example, lens elements 122 may be made from glass, plastic, polycarbonate, and the like. Lens elements 122 may be convex, concave, spherical, hemispherical, etc.

[0045] FIG. 10 is a block diagram of the theme park attraction system 10 of FIG. 1 according to one embodiment of the present disclosure. Certain components of the theme park attraction system 10 (e.g., the user interface device 12, the camera 20, and / or the controller 24) can be referred to as an orientation detection system. As shown, the camera 20, which can be communicatively coupled to the controller 24, can capture an image of the user interactive device 12. The image can include an orientation tag 14. The controller 24 can identify the orientation tag 14 in the image using, for example, image recognition technology. The controller 24 can then determine the orientation information 34 provided by the orientation tag 14. For example, the orientation tag 14 can encode the orientation information 34 in a QR code 23. Thus, the controller 24 can decode the QR code 23 using pattern recognition technology (e.g., QR code recognition technology) to determine the orientation information 34, including the horizontal rotation angle 30, the horizontal rotation direction 54, the vertical rotation angle 32, and the vertical rotation direction 56. In some embodiments, the theme park attraction system 10 may include image processing circuitry to decode the orientation tag 14 (e.g., in the form of text, a barcode, a QR code 23). Additionally, the controller 24 may determine the size (e.g., width 38 and length 40) of the orientation tag 14 in the image (e.g., the number of pixels in the image that correlate with the width 38 and length 40 of the orientation tag 14). Based on the known width 38 and length 40 of the orientation tag 14 and the correlating number of pixels, the controller 24 may determine the distance the camera 20 is from the orientation tag 14 (e.g., a depth measurement that may be part of the depth information) to facilitate determining both the orientation and position of the orientation tag 14 and, therefore, the orientation and position of the user interactive device 12.

[0046] The controller 24 is also communicatively coupled to an output device 130 (e.g., an animated figure, an electronic display, a speaker) and can instruct the output device 130 to output a user interactive experience (e.g., actions, images, video, audio data, etc.) based on the orientation information 34. Although the output device 130 is shown as separate from the user interactive device 12, in some embodiments the output device 130 may be part of the user interactive device 12 (e.g., a speaker, an electronic display, an optical output device, or an actuator of the user interactive device 12). As an example, the output device 130 may be an electronic display (e.g., a wall-mounted or augmented reality display) that displays one or more virtual objects (e.g., one or more swords) that correlate to one or more orientation tags 14 of one or more user interactive devices 12, such that moving the one or more user interactive devices 12 causes the displayed one or more virtual objects to move around due to the movement of the one or more orientation tags 14. As another example, the output device 130 may be an animated object of the attraction (e.g., a robot or other animated figure), and in response to determining that the user interactive device 12 is pointed at the output device 130 via the orientation of the orientation tag 14, the animated object may perform a user interactive action (e.g., wagging its tail, falling over, waving its hands, etc.). As yet another example, the user interactive device 12 may be a virtual reality headset with an attached orientation tag 14, and the output device 130 may be the display of the virtual reality headset. The user wears the user interactive device 12 and moves their head (e.g., from side to side), and in response, the display may show video data corresponding to the user's head movements (e.g., providing the illusion that the user is looking around in a virtual world).

[0047] The controller 24 may be communicatively coupled to the camera 20 and / or output device 130 by any suitable means, such as via wired communication or via a communication network using a wireless communication protocol or technology (e.g., wireless, Bluetooth, WiFi, infrared, Ethernet, Thread, ZigBee, Z-Wave, KNX, mobile, and / or microwave).

[0048] With the foregoing in mind, FIG. 11 is a flow diagram of a process 160 for determining the orientation and position of a user interactive device 12, according to one embodiment of the present disclosure. Process 160 can be performed by any suitable system capable of identifying an orientation tag 14 in an image of a user interactive device 12 and determining the orientation information in the orientation tag 14. For example, the camera 20, controller 24, processor 26, and / or output device 150 of the theme park attraction system 10 can perform process 160. While process 160 is described with steps in a particular order, it should be understood that the present disclosure contemplates that the described steps may be performed in an order different from the illustrated order, and that certain described steps may be skipped or not performed entirely. In some embodiments, process 160 can be implemented by using a processor, such as processor 26, to execute instructions stored on a tangible, non-transitory computer-readable medium, such as memory device 28.

[0049] As shown, in process block 162, the processor 26 receives an image of the user interactive device 12. In particular, the camera 20 may capture an image of the user interactive device 12 (e.g., as held by the user 42) and transmit the image to, among other things, the controller 24 and the processor 26. Thus, the processor 26, which may be resident in the controller 24, may receive the image (e.g., data indicative of the captured image).

[0050] At process block 164, the processor 26 identifies the orientation tag 14 of the user interactive device 12 within the image. In particular, the processor 26 may use pattern and / or image recognition techniques (e.g., stored as instructions in the memory device 28) to detect characteristics of the orientation tag 14 (e.g., shape, color, other identifiable features).

[0051] At process block 166, processor 26 determines orientation information 34 of orientation tag 14 by reading the orientation information 34 made visible by orientation tag 14. In particular, processor 26 may determine orientation information 34 of orientation tag 14 using image, pattern, and / or text recognition techniques (e.g., stored as instructions in memory device 28). For example, orientation information 34 may be provided in text (e.g., for a 15° horizontal rotation angle 30, a clockwise horizontal rotation direction 54, a 170° vertical rotation angle 32, and a counterclockwise vertical rotation direction 56, the text may include "15° CW; 170° CCW"). In this manner, processor 26 may determine orientation information 34 using text recognition techniques. As another example, orientation information 34 may be in the form of a QR code 23, and thus processor 26 may determine orientation information 34 using pattern recognition techniques (e.g., QR code 23 recognition techniques).

[0052] At process block 168, the processor 26 determines an orientation of the user interactive device 12 and / or the orientation tag 14 based on the orientation information 34. In particular, the processor 26 determines the orientation of the orientation tag 14 using the orientation information 34, such as by determining the horizontal rotation angle 30, the horizontal rotation direction 54, the vertical rotation angle 32, and the vertical rotation direction 56 of the orientation tag 14. In some embodiments, the processor 26 may apply the orientation of the orientation tag 14 to the user interactive device 12. For example, the processor 26 may assume that the orientation of the user interactive device 12 is the same as the orientation of the orientation tag 14. In some embodiments, the processor 26 may apply known dimensions of the user interactive device 12 to the orientation information 34 provided by the orientation tag 14 to determine the orientation of the user interactive device 12. For example, if the user interactive device 12 is a mobile device that is 7.5 cm wide by 18 cm long, and the orientation tag 14 is known to be applied to the center of the back of the mobile device and align with the mobile device, the processor 26 may determine that the orientation of the user interactive device 12 is 7.5 cm wide by 18 cm long, at the center of the orientation tag 14, and aligned with the orientation tag 14.

[0053] At process block 170, the processor 26 determines the location of the user interactive device 12 and / or the orientation tag 14 based on the image. In particular, the processor 26 may determine the location of the orientation tag 14 based on correlating pixels in the image with the orientation tag 14. Additionally, the processor 26 may determine depth information for the orientation tag 14. In particular, the processor 26 may determine the size (e.g., width 38 and length 40 as shown in FIG. 1 ) of the orientation tag 14 in the image (e.g., the number of pixels in the image that correlate with the width 38 and length 40 of the orientation tag 14). Based on the known width 38 and length 40 of the orientation tag 14 and the number of correlated pixels, the processor 26 may determine the distance the camera 20 is from the orientation tag 14 (e.g., a depth measurement that may be part of the depth information).

[0054] At process block 172, the processor 26 adjusts or provides a user interactive experience based on the orientation and / or position of the user interactive device 12 and / or orientation tag 14. In particular, the memory device 28 can store instructions for adjusting or outputting a user interactive experience in response to the user interactive device 12 and / or orientation tag 14 being at a particular orientation and / or position. The processor 26 can determine whether the orientation and / or position of the user interactive device 12 and / or orientation tag 14 correlates to any stored orientations and / or positions, and if so, the processor 26 can adjust or instruct the output device 150 to output a user interactive experience corresponding to the orientation and / or position of the user interactive device 12 and / or orientation tag 14.

[0055] 1 in the form of a handheld device 180 (e.g., a toy sword) and an output device 150 in the form of an electronic display 182 and a speaker 184 that outputs video data 186 and audio data 188 based on the orientation and / or location of the handheld device 180 and / or orientation tag 14, according to one embodiment of the present disclosure. In particular, the orientation tag 14 is affixed to the handheld device 180, and the processor 26 can determine the orientation and / or location of the handheld device 180 and / or orientation tag 14, as described above. If processor 26 determines that the orientation and / or position of handheld device 180 and / or orientation tag 14 correlates to outputting video data 186 and / or audio data 188 (e.g., as stored in memory device 28), processor 26 instructs display 182 to emit video data 186 (e.g., playing a video of a fireball 190 appearing to emerge from the handheld device) and / or instructs speaker 184 to output audio data 188 (e.g., the sound effect of a fireball).

[0056] Further, in some embodiments, processor 26 may determine to output particular video data based on a partial orientation tag 14. For example, if handheld device 180 is a toy gun, pulling the trigger may partially obstruct orientation tag 14, while not pulling the trigger may leave orientation tag 14 unobstructed. Thus, if processor 26 first receives an image of an unobstructed orientation tag 14 and then receives an image of an obstructed orientation tag 14, processor 26 may instruct display 182 and speaker 184 to output video and audio data corresponding to the firing of the toy gun. In some embodiments, display 182 and / or speaker 184 may be part of a virtual or augmented reality head-mounted device and output video data 186 and / or audio data 188 as part of the virtual or augmented reality experience provided by the head-mounted device.

[0057] 13 is a schematic block diagram illustrating the user interactive device 12 of FIG. 1 in the form of a mobile device 200 and an output device 150 in the form of an electronic display 202 and speaker 204 that outputs video data 206 and audio data 208 based on the orientation and / or location of the mobile device 200 and / or the orientation tag 14, in accordance with one embodiment of the present disclosure. In particular, the orientation tag 14 is affixed to the mobile device 200, and the processor 26 can determine the orientation and / or location of the mobile device 200 and / or the orientation tag 14, as described above. If processor 26 determines that the orientation and / or position of mobile device 200 and / or orientation tag 14 correlates to outputting video data 206 and / or audio data 208 (e.g., as stored in memory device 28), processor 26 instructs display 202 to output video data 206 (e.g., a fishing rod 210 extending from mobile device 200, a fishing line 212 extending from fishing rod 210, and a fish 214 caught on fishing line 212) and / or instructs speaker 204 to output audio data 208 (e.g., a sound effect of fishing line 212 being pulled by fish 214). In some embodiments, display 202 and / or speaker 204 may be part of a virtual or augmented reality head-mounted device that outputs video data 206 and / or audio data 208 as part of a virtual or augmented reality experience provided by the head-mounted device.

[0058] 14 is a schematic diagram illustrating how user interactive device 12 of FIG. 1 in the form of a head-mounted device 220 and output device 150 in the form of an electronic display of head-mounted device 220 output video data based on the orientation and / or position of head-mounted device 220 and / or orientation tag 14, according to one embodiment of the disclosure. In particular, orientation tag 14 is affixed to head-mounted device 220, and processor 26 can determine the orientation and / or position of head-mounted device 220 and / or orientation tag 14, as described above. If processor 26 determines that the orientation and / or position of head-mounted device 220 and / or orientation tag 14 correlates to outputting video data (e.g., as stored in memory device 28), processor 26 instructs the display of head-mounted device 220 to output the video data (e.g., looking around a virtual world).

[0059] 15 is a schematic diagram of the user interactive device 12 of FIG. 1 in the form of a flexible wearable material 230 and an output device 150 in the form of an electronic display of a head-mounted device 232 that outputs video data based on the orientation and / or position and / or orientation tags (e.g., 14A-F) of the wearable material 230, according to one embodiment of the present disclosure. In particular, the orientation tags 14 (including 14A-F) are affixed to the wearable material 230 and can be displaced along with the wearable material 230 as a wearer 234 moves their arm. The wearable material 230 can be any suitable material to which the orientation tags 14 can be affixed and worn by the wearer 234, such as cloth, polyester, cotton, wool, denim, etc. The processor 26 can determine the orientation and / or position of the orientation tags 14A-F as described above, and map or determine the orientation and / or position of the wearable material 230 based on the orientation and / or position of the orientation tags 14A-F. If processor 26 determines that the orientation and / or position of wearable material 230 and / or orientation tags 14A-F correlates to outputting video data (e.g., stored in memory device 28), processor 26 instructs the display of head-mounted device 232 to output the video data (e.g., a virtual arm of wearer 234).

[0060] In this aspect, process 160 may enable processor 26 to determine the orientation and position of user interactive device 12 and / or orientation tag 14 and output a user interactive experience based on the orientation and position of user interactive device 12 and / or orientation tag 14.

[0061] While the embodiments described in this disclosure are susceptible to various modifications and alternative forms, specific embodiments have been shown by way of example in the drawings and tables and are described in detail herein. It should be understood, however, that these embodiments are not limited to the particular forms disclosed. While the present disclosure has been described with reference to specific embodiments for illustrative purposes only, other objects and advantages of the present disclosure will become apparent from the following description of the drawings according to the present disclosure.

[0062] The approaches presented and claimed herein refer to and apply substantial objects and specific embodiments of a practical nature that clearly improve the art of the present invention, and are therefore not abstract, intangible, or theoretical in nature. Furthermore, to the extent that any claim appended to the end of this specification contains one or more elements designated as "means for 'performing' a "function"" or "steps for 'performing' a "function," such elements shall be construed in accordance with 35 U.S.C. §112(f). However, for any claim containing elements designated in any other manner, such elements shall not be construed in accordance with 35 U.S.C. §112(f). [Explanation of symbols]

[0063] 10 Theme park attractions or entertainment systems 12 User Interactive Devices 14. Orientation Tag 16 Coordinate Axes 18 x-axis 20 Camera 21 y-axis 22 z-axis 24 Controller 26 processors 28 memory 34 Direction information 38 width 40 length 50 Position Marker 52 Alignment Marker

Claims

1. 1. An orientation detection system, comprising: an orientation detector including an image sensor and an image processing circuit; an orientation tag configured to be coupled to a user interaction device; and the orientation tag comprises: a first layer of visual data comprising a plurality of different patterns; a second layer of visual alignment features disposed over the first layer of visual data; each pattern of the plurality of different patterns corresponds to one of the relative orientations of the orientation tag with respect to a viewpoint of the image sensor; the visual alignment feature is configured to reveal and obscure a portion of the visual data relative to a viewpoint of the image sensor such that one of the plurality of different patterns is observable to the image sensor at one of the relative orientations of the orientation tag; the image processing circuitry is configured to identify an orientation of the orientation tag based on one of the different patterns of the visual data observed by the image sensor. Orientation finding system.

2. 2. The orientation detection system of claim 1, wherein the visual alignment feature is configured to physically block different patterns in the visual data from being seen by the image sensor that do not correspond to a relative orientation of the orientation tag to the viewpoint.

3. The visual alignment feature comprises: providing, via refraction, different patterns of the visual data for observation by the image sensor from the viewpoint; blocking, via refraction, distinct patterns of the visual data that do not correspond to the relative orientation of the orientation tag with respect to the viewpoint from being seen by the image sensor; The orientation detection system according to claim 1 , configured as follows:

4. 2. The orientation detection system of claim 1, wherein each of the different patterns comprises a barcode or a quick response (QR) code decodable by the image processing circuitry that represents a horizontal rotation angle and a vertical rotation angle of the orientation tag.

5. The orientation detection system of claim 1 , wherein each of the different patterns includes text indicating a horizontal rotation angle and a vertical rotation angle of the orientation tag.

6. 1. An entertainment system comprising: a camera configured to capture an image; an orientation tag of a user interactive device, the orientation tag comprising: a first layer of visual data comprising a plurality of distinct visual patterns; and a second layer of visual alignment features disposed on the first layer of visual data comprising visual alignment features, each visual pattern of the plurality of distinct visual patterns corresponding to one of the relative orientations of the orientation tag with respect to a viewpoint of the camera, the visual alignment features configured to reveal and occlude a portion of the visual data with respect to a viewpoint of the camera such that one visual pattern of the plurality of distinct visual patterns is observable by the camera at a relative orientation of one of the relative orientations of the orientation tag; a controller having processing circuitry and memory; the memory includes, identifying an orientation tag of the user interactive device within the image; determining an orientation of the orientation tag based on one of orientation information associated with one of the plurality of different visual patterns captured in the image; storing machine-readable instructions configured to: Entertainment system.

7. The entertainment system of claim 6 , wherein the orientation information includes a horizontal rotation angle and a vertical rotation angle of the orientation tag.

8. 8. The entertainment system of claim 7, wherein the machine-readable instructions are configured to cause the processing circuit to determine an orientation of the orientation tag by applying the horizontal rotation angle and the vertical rotation angle to the orientation tag in the image.

9. The entertainment system of claim 6 , wherein the machine-readable instructions are configured to cause the processing circuitry to determine a location of the orientation tag within the image.

10. 10. The entertainment system of claim 9, including an output device, wherein the machine-readable instructions are configured to cause the processing circuit to instruct the output device to output a user interactive experience based on the orientation and position of the orientation tag.

11. 11. The entertainment system of claim 10, wherein the output device includes an electronic display, the memory stores data correlating the orientation of the orientation tag to video data, and the machine-readable instructions are configured to direct the processing circuitry to instruct the electronic display to display the video data based on the orientation of the orientation tag.

12. 11. The entertainment system of claim 10, wherein the output device includes a speaker, the memory stores data correlating the orientation of the orientation tag to audio data, and the machine-readable instructions are configured to direct the processing circuit to instruct the speaker to output the audio data based on the orientation of the orientation tag.

13. The entertainment system of claim 6 , wherein the user interactive device includes a mobile device, and the orientation tag is affixed to the mobile device.

14. 1. A user interactive device including an orientation tag, The orientation tag includes: a first layer of visual data including a plurality of different patterns, each pattern of the plurality of different patterns corresponding to one of the orientation tags relative to a viewpoint; a second layer of visual alignment features disposed over the first layer of visual data, the second layer including visual alignment features configured to reveal and obscure a portion of the visual data relative to the viewpoint such that one of the plurality of different patterns is observable from the viewpoint at a relative orientation of one of the relative orientations of the orientation tag; Including, User interactive devices.

15. 15. The user interactive device of claim 14, comprising a handheld device.

16. The user interaction device of claim 14 comprising a head-mounted device.

17. 17. The user interaction device of claim 16, wherein the head-mounted device includes a display, the display configured to output video data based on the relative orientation of the orientation tag indicated by the corresponding pattern.

18. The user interaction device of claim 14 , comprising a wearable material, the wearable material comprising a plurality of orientation tags, the plurality of orientation tags comprising the orientation tag.

19. The user interaction device of claim 14 , comprising a light source configured to emit light that illuminates the plurality of patterns.

20. 20. The user interaction device of claim 19, wherein the light source comprises a liquid crystal display, a light emitting diode, or an organic light emitting diode.

21. The user interaction device of claim 19 , wherein the light source comprises a reflective material.

Images