Orientation label for providing orientation information

Abstract

An orientation tag provides orientation information and provides orientation information of an object by attaching the orientation tag to the object. The orientation tag displays different orientation information based on viewing the orientation tag at different angles. In particular, the orientation tag displays an angle and a direction of the orientation tag rotating around a horizontal axis relative to a viewer and an angle and a direction of the orientation tag rotating around a vertical axis relative to the viewer. Viewing the orientation tag enables determining an angle and a direction of the orientation tag rotating around a depth axis relative to the viewer (e.g., depth information). The orientation information and the depth information facilitate determining an orientation of the orientation tag in three dimensions. An output device outputs a user interactive experience based on the orientation information and the depth information provided by the orientation tag.

Description

Background Technology

[0001] This section aims to introduce the reader to various technical aspects that may relate to the various aspects of this disclosure, which are described and / or claimed below. This discussion is intended to help provide the reader with background information to facilitate a better understanding of the various aspects of this disclosure. Therefore, it is understood that these statements will be read from this perspective, rather than as an admission of prior art.

[0002] In entertainment venues, user interaction devices (including handheld objects, head-mounted devices, clothing, etc.) can be used in coordination with other system components to initiate interactive experiences. For example, a system can use a gyroscope or accelerometer in the user interaction device to determine its orientation, and the system can generate a user interaction experience based on the determined orientation. In a theme park setting, a visitor can hold a toy sword, and in response to determining the orientation of the toy sword, the system can display (e.g., on a display near the visitor, or on a virtual reality or augmented reality display) what appears to be a fireball leaving the toy sword. It is now recognized that there is a need for improved systems and methods for determining the orientation of user interaction devices to facilitate an appropriate response to the orientation of the user interaction device and / or data associated with the user interaction device. Summary of the Invention

[0003] Certain embodiments corresponding in scope to the originally claimed subject matter are summarized below. These embodiments are not intended to limit the scope of this disclosure, but rather are intended only to provide a brief overview of some of the disclosed embodiments. In fact, this disclosure may include a wide variety of forms that may be similar to or different from the embodiments set forth below.

[0004] In one embodiment, an orientation detection system includes an orientation detector having an image sensor and an image processing circuitry. The orientation detection system also includes an orientation label configured to be coupled to a user interaction device. The orientation label includes: visual data of a first layer; and visual alignment features of a second layer disposed on the first layer. The visual alignment features reveal and obstruct portions of the visual data relative to the viewpoint of the image sensor. Different patterns of the visual data are observable to the image sensor, and each of the different patterns corresponds to the relative orientation of the orientation label relative to the viewpoint. The image processing circuitry identifies the orientation of the orientation label based on patterns in the different patterns of the visual data observed by the image sensor.

[0005] In one embodiment, an entertainment system includes an orientation label for a user interaction device. The orientation label includes a visual pattern and a visual alignment feature, the visual alignment feature restricting the viewing of the visual pattern based on the viewing orientation of the orientation label. The entertainment system also includes a camera that captures an image of the orientation label of the user interaction device. The entertainment system further includes a controller having processing circuitry and a memory storing machine-readable instructions that cause the processing circuitry to: identify the orientation label of the user interaction device in the image; and determine the orientation of the orientation label based on orientation information associated with the visual pattern captured in the image.

[0006] In one embodiment, a user interaction device includes an orientation label having a first layer comprising patterns. Each pattern indicates a set of orientation information. The orientation label also has a second layer disposed on the first layer, the second layer including elements that enable viewing from a viewpoint a corresponding pattern to the viewpoint of the orientation label, and prevent viewing from a viewpoint a pattern that does not correspond to the viewpoint of the orientation label. Attached Figure Description

[0007] These and other features, aspects, and advantages of this disclosure will become better understood when the following detailed description is read with reference to the accompanying drawings, in which the same characters denote the same parts throughout the drawings, wherein:

[0008] Figure 1 This is a schematic diagram of a front perspective view of a theme park attraction system including a user interaction device according to an embodiment of the present disclosure, wherein the user interaction device has an orientation label in a first orientation.

[0009] Figure 2 According to embodiments of this disclosure Figure 1 A schematic diagram of a side perspective view of a part of a theme park attraction system, including user interaction devices, with orientation labels in a first orientation.

[0010] Figure 3 According to embodiments of this disclosure Figure 1 A schematic diagram of a top-down perspective view of a part of a theme park attraction system, including user interactive devices, with orientation labels in a first orientation.

[0011] Figure 4 According to embodiments of this disclosure Figure 1 A schematic diagram of a frontal perspective view of a theme park attraction system including user interaction devices, wherein the user interaction devices have orientation labels in a second orientation.

[0012] Figure 5 According to embodiments of this disclosure Figure 1A schematic diagram of a side perspective view of a part of a theme park attraction system, including user interaction devices, with orientation labels in a second orientation.

[0013] Figure 6 According to embodiments of this disclosure Figure 1 A schematic diagram of a top-down perspective view of a part of a theme park attraction system, including user interactive devices, with orientation labels in a second orientation.

[0014] Figure 7 According to embodiments of this disclosure Figure 1 A schematic diagram of an orientation label, which provides different orientation information based on the different angles from which the label is viewed;

[0015] Figure 8 According to embodiments of this disclosure Figure 1 The diagram illustrates the orientation label, which provides different orientation information based on the different angles at which the orientation label is viewed using a mask layer;

[0016] Figure 9 According to embodiments of this disclosure Figure 1 A schematic diagram of an orientation label, which provides different orientation information based on the different angles at which the orientation label is viewed using a lens layer;

[0017] Figure 10 According to embodiments of this disclosure Figure 1 A diagram of a theme park attraction system;

[0018] Figure 11 This is a flowchart of a process for determining the orientation and position of a user interaction device according to embodiments of the present disclosure;

[0019] Figure 12 It is in the form of a handheld device according to embodiments of the present disclosure. Figure 1 A schematic diagram of a user interaction device and an output device in the form of an electronic display and a speaker;

[0020] Figure 13 It is in the form of a mobile device according to embodiments of the present disclosure. Figure 1 A schematic diagram of a user interaction device and an output device in the form of an electronic display and a speaker;

[0021] Figure 14 It is in the form of a head-mounted device according to embodiments of the present disclosure. Figure 1 A schematic diagram of a user interaction device and an output device in the form of an electronic display in the form of a head-mounted device; and

[0022] Figure 15It is in the form of a flexible wearable material according to embodiments of this disclosure. Figure 1 A schematic diagram of a user interaction device and an output device in the form of an electronic display for a head-mounted device. Detailed Implementation

[0023] One or more specific embodiments will be described below. For the purpose of providing a concise description of these embodiments, not all features of the actual implementation are described in the specification. It should be appreciated that, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developer's specific goals, which may vary depending on the implementation, such as compliance with system-related constraints and business-related constraints. Furthermore, it should be appreciated that such development efforts may be complex and time-consuming, but for those skilled in the art who benefit from this disclosure, such development efforts will be nothing more than routine tasks of design, fabrication, and manufacturing.

[0024] When describing elements of various embodiments of this disclosure, the articles “a,” “an,” and “the” are intended to mean the presence of one or more of the elements. The terms “comprising,” “including,” and “having” are intended to be inclusive and mean that additional elements may be present in addition to those listed. Furthermore, it should be understood that references to “an embodiment” or “an embodiment” in this disclosure are not intended to be construed as excluding the existence of additional embodiments incorporating the described features.

[0025] In entertainment venues, user interaction devices (including handheld objects, head-mounted devices, clothing, etc.) can be used in conjunction with other system components to initiate an interactive experience. For example, the interaction device may include an image of a pattern or code (e.g., a Quick Response (QR) code®) that can be detected to identify orientation information (e.g., horizontal and vertical orientation information) based on the pattern or code in a captured image view. For example, a QR code® includes an alignment pattern and three viewfinder patterns that can be used to determine how the QR code® is rotated. An output device (e.g., a display) can then output the user interaction experience (e.g., video data) based on the orientation information (e.g., where the user interaction device is aimed). However, patterns or codes can be prone to errors due to partial occlusion, changes in lighting, excessive distance from the image capturing device (e.g., a camera), small angular changes, etc.

[0026] This disclosure generally relates to an orientation label or marker that displays orientation information (e.g., corresponding to angular orientation) based on an observer's viewpoint. That is, the orientation label displays different orientation information at different observer viewpoints, enabling a detection system to determine the orientation of the orientation label. The orientation label may also block or prevent the observer from seeing other orientation information (e.g., corresponding to other viewpoints). The detected aspects of the orientation label can provide orientation information about the orientation label itself, and similarly, the orientation information of an object can be detected by coupling or affixing the orientation label to an object. The orientation information may include the angle of rotation of the orientation label relative to the observer about a horizontal axis and the angle of rotation of the orientation label relative to the observer about a vertical axis. For example, if the orientation label is viewed "straight on" (e.g., such that the orientation label is rotated 0° relative to the observer about a horizontal axis and 0° relative to the observer about a vertical axis), the orientation label may display orientation information indicating rotation of 0° about both the horizontal and vertical axes. As another example, if an orientation label is viewed such that it is rotated 20° clockwise around the horizontal axis and 70° counterclockwise around the vertical axis relative to the viewer, the orientation label can display orientation information indicating rotation 20° clockwise around the horizontal axis and 70° counterclockwise around the vertical axis.

[0027] Furthermore, examining orientation labels can enable the determination of the angle of rotation of the orientation label relative to the viewer around the depth axis. For example, pattern and / or image recognition techniques can be used to identify orientation labels in an image and determine the angle of rotation of the orientation label around the depth axis. Orientation and depth information facilitate the determination of the orientation of the orientation label in three dimensions (e.g., with six degrees of freedom).

[0028] Originating from light field printing technology, orientation labels can display different orientation information from different viewpoints. The base layer consists of multiple patterns, each indicating a set of orientation information. A mask layer can be disposed on the base layer, blocking or preventing the viewer from seeing other orientation information (e.g., corresponding to other viewpoints). Based on viewing the orientation label at certain horizontal and vertical rotation angles, the mask layer and base layer can enable the viewing of certain patterns indicating a corresponding set of orientation information corresponding to those angles. In some embodiments, the mask layer may include blocking elements that prevent the viewing of patterns other than a specific pattern, thus enabling the viewing of a particular pattern indicating a set of orientation information corresponding to those angles. In alternative or additional embodiments, the orientation label may include a lens layer having lens elements that refract the view of patterns other than a pattern away from the viewer by a certain horizontal and vertical rotation angle, while refracting a pattern that indicates to the viewer a set of orientation information corresponding to a certain horizontal and vertical rotation angle.

[0029] Because orientation information is encoded within the pattern, rather than derived from the perspective warp of the pattern, orientation labels are less prone to errors due to partial occlusion, changes in lighting, excessive distance from the camera, small angle changes, etc. Therefore, the current embodiments provide a more efficient and effective way of providing orientation information than simply using perspective warp. Furthermore, since the orientation label passively conveys orientation information (e.g., via static components rather than dynamic components), its passive nature avoids or reduces the use of complex components (e.g., electronic displays, communication circuitry), thus providing a cost-effective way of providing orientation information. In practice, the orientation label may include an adhesive side for easy attachment to any number of user interaction devices, allowing customers to, for example, purchase orientation labels and attach them to their chosen user interaction devices. It should be noted that the current embodiments can employ layered patterning of the orientation label in conjunction with perspective warp and communication circuitry.

[0030] According to embodiments of this disclosure, a system may include a camera, a processor, a memory device, and / or an output device, which are coordinated and programmed to provide a response to the orientation of an orientation tag associated with the use of a user interaction device. As an example, the user interaction device may be shaped like a sword, with an orientation tag attached to it, and the user can point the user interaction device at an animated object (e.g., a robot or other animated character) at a location, and in response to determining that the orientation tag and therefore the user interaction device is pointing at the animated object, the animated object can output a user interaction experience (e.g., falling). As another example, the user interaction device may be a virtual reality headset, with an orientation tag attached to it, and the user can wear the user interaction device and move their head (e.g., left and right). In response, the display of the virtual reality headset can display video data corresponding to the user's head movements (e.g., providing the illusion that the user is looking around in a virtual world). As another example, the user interaction device may be a user's mobile communication device (e.g., a smartphone, cellular phone, tablet computer, wearable device), with an orientation tag attached to the mobile communication device (e.g., on the back of the user's mobile device or on the cover of the user's mobile device). An electronic display (e.g., mounted on a wall or augmented reality display) may display a virtual object (e.g., a baseball bat) associated with the user's mobile device, and swinging the mobile device back and forth may cause the virtual object to swing back and forth due to the movement of the orientation tag.

[0031] Through introduction, Figure 1This is a schematic front perspective view of a theme park attraction or entertainment system 10 according to an embodiment of the present disclosure. The theme park attraction or entertainment system 10 includes a user interaction device 12 having an orientation label 14 in a first orientation. Specifically, the orientation label 14 can display orientation information (e.g., corresponding to an angular orientation) based on the viewer's viewpoint, while blocking or preventing the viewer from seeing other orientation information (e.g., corresponding to other viewpoints). The user interaction device 12 can be any suitable device for which tracking (e.g., to provide a user interactive experience) is desired. For example, the user interaction device 12 can include a handheld device (e.g., a sword, gun, mug, cup), a head-mounted device (e.g., a helmet, hat, goggles), clothing (e.g., a vest, jacket, sleeves, gloves, scarf), a wrist-worn device (e.g., a watch), etc. In some embodiments, the user interaction device 12 can be fixed in place or mounted (but can be actuated). For example, user interaction device 12 may include an animated character from a theme park, the character having actuable features (e.g., an open and closed mouth, arms that move around). Orientation tag 14 may be coupled to the animated character (e.g., the head or appendages of the animated character) to, for example, track the position of the animated character (e.g., to determine which direction the animated character is facing). As another example, tracking orientation tag 14 may enable tracking of the animated character (e.g., the head or appendages of animated features) to determine whether the animated character has moved over time beyond an acceptable amount of error (e.g., due to wear and tear).

[0032] Orientation label 14 may be attached to or affixed to user interaction device 12. For example, orientation label 14 may include an adhesive layer or backing that allows orientation label 14 to adhere to user interaction device 12. In this way, orientation label 14 may be offered or sold separately from user interaction device 12 and subsequently attached to any user interaction device 12 of the user's choice. In some embodiments, orientation label 14 may be removably or temporarily attached to user interaction device 12, allowing orientation label 14 to be reattached to another user interaction device 12. For example, orientation label 14 may be attached and reattached using a magnetic backing for a magnetic portion or plate of user interaction device 12, a removable vinyl backing, Velcro®, etc. As another example, user interaction device 12 may include a clear or transparent sleeve in which orientation label 14 may be placed. While orientation label 14 is depicted as flat, in some embodiments, orientation label 14 may be curved or angled. In some embodiments, orientation label 14 may follow the curve of the portion of user interaction device 12 to which orientation label 14 is attached.

[0033] Orientation label 14 can provide orientation information and, by attaching orientation label 14 to user interaction device 12, provides orientation information to user interaction device 12. Orientation label 14 may include a light field that displays different orientation information based on viewing orientation label 14 from different angles. Specifically, orientation label 14 may display the angle (e.g., horizontal rotation angle) of rotation of orientation label 14 relative to the viewer (such as an image sensor or image capturing device (e.g., camera 20)) about a horizontal axis (e.g., along or parallel to the x-axis 18 illustrated on coordinate axis 16). Orientation label 14 may also display the angle (e.g., vertical rotation angle) of rotation of orientation label 14 relative to camera 20 about a vertical axis (e.g., along or parallel to the y-axis 21 illustrated on coordinate axis 16). For reference, a frontal perspective view of theme park attraction system 10 is illustrated along a depth axis relative to camera 20 (e.g., along or parallel to the z-axis 22 illustrated on coordinate axis 16). Accordingly, the orientation label 14 can display orientation information (e.g., corresponding to angular orientation) based on the viewpoint of the camera 20.

[0034] As illustrated, while orientation label 14 provides orientation information in the form of a Quick Response (QR) code® 23, in additional or alternative embodiments, the orientation information may be provided in any format suitable for capture by camera 20 in one or more images and recognized by controller 24 or control system (such as barcodes, patterns, text, etc.). Controller 24 may include processing circuitry, such as one or more processors (described herein and referred to as a single processor 26) and one or more memories or storage devices (described herein and referred to as a single memory device 28). Processor 26 may execute software programs and / or instructions stored in memory device 28 that facilitate the determination of the orientation of orientation label 14 and / or user interaction device 12. Furthermore, processor 26 may include multiple microprocessors, one or more "general purpose" microprocessors, one or more application-specific microprocessors, and / or one or more application-specific integrated circuits (ASICs). For example, processor 26 may include one or more Reduced Instruction Set Computer (RISC) processors. Additionally, processor 26 may include image processing circuitry and / or pattern recognition circuitry specifically designed to efficiently process and / or recognize images (including orientation label 14) and / or data (including orientation information) provided by orientation label 14 (e.g., in the form of text, barcode, QR code® 23). Memory device 28 may store information such as control software, lookup tables, configuration data, etc. Memory device 28 may include tangible, non-transitory machine-readable media, such as volatile memory (e.g., random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM)), flash memory, one or more hard disk drives, and / or any other suitable optical, magnetic, or solid-state storage media. Memory device 28 may store a wide variety of information and may be used for a variety of purposes, such as facilitating instructions for determining the orientation of orientation label 14 and / or user interaction device 12.

[0035] Specifically, processor 26 may implement image recognition techniques stored in memory device 28 to identify orientation labels 14 in images of user interaction devices 12 captured by camera 20. This may include comparing images of user interaction devices 12 with information tables or running algorithms (e.g., stored in memory device 28) based on the image of orientation labels 14 to identify relevant location and identity information for orientation labels 14. Processor 26 may then implement pattern recognition techniques (e.g., decoding techniques, text recognition techniques, objection recognition techniques) stored in memory device 28 to determine the orientation information provided by orientation labels 14. For example, orientation labels 14 may be a shape (e.g., square, circle, rectangle) of a certain color (e.g., white, black, blue), and processor 26 may use image recognition techniques to identify the shape and color of orientation labels 14. As another example, orientation labels 14 may include QR codes® 23 with one or more location markers and / or alignment markers. Accordingly, the processor 26 can use pattern recognition technology (e.g., QR code® 23 recognition technology) stored in the memory device 28 to identify the orientation label 14 by identifying the orientation label 14.

[0036] In some embodiments, the theme park attraction or orientation detection system 10 includes an orientation detector having an image sensor (e.g., camera 20) and an image processing circuitry. The image processing circuitry can implement image recognition and / or pattern recognition techniques to identify orientation tags 14 in images detected by the image sensor from the user interaction device 12, and / or determine the orientation information provided by the orientation tags 14. The image processing circuitry can execute instructions stored in a memory device 28, and / or be part of or separate from the controller 24.

[0037] As described, camera 20 views the orientation label 14 attached to user interaction device 12 "straight ahead," such that orientation label 14 is rotated 0° relative to camera 20 about horizontal axis 18 (e.g., horizontal rotation angle) and 0° relative to camera 20 about vertical axis 21 (e.g., vertical rotation angle). For clarity, Figure 2 According to embodiments of this disclosure Figure 1 This is a schematic side perspective view of a portion of a theme park attraction system 10, which includes a user interaction device 12 having an orientation label 14 in a first orientation. Specifically, the side perspective view is illustrated relative to a camera 20 along a horizontal axis 18. As better illustrated, the orientation label 14 is rotated 0° relative to the camera 20 about the horizontal axis 18 (e.g., a horizontal rotation angle of 30°). Similarly, Figure 3 According to embodiments of this disclosure Figure 1This is a schematic top-view perspective view of a portion of a theme park attraction system 10, which includes a user interaction device 12 having an orientation label 14 in a first orientation. Specifically, the top-view perspective view is illustrated relative to a camera 20 along a vertical axis 21. As illustrated, the orientation label 14 is rotated 0° (e.g., vertical rotation angle 32) relative to the camera 20 about the vertical axis 21.

[0038] Return to Figure 1 The orientation label 14 displays a QR code® 23, which encodes orientation information 34, which may include a horizontal rotation angle 30 corresponding to the view of the camera. Figure 2 ) and vertical rotation angle 32 ( Figure 3 In some embodiments, the orientation information 34 may also encode the horizontal and vertical rotation directions (e.g., clockwise or counterclockwise). The camera 20 may capture an image of the orientation label 14 and send it to the controller 24. The processor 26 may use pattern recognition technology (e.g., QR code® recognition technology) stored in the memory device 28 to identify and read the QR code® 23 in the orientation label 14 to determine the orientation information 34. As illustrated, the processor 26 determines the orientation information 34, which includes a horizontal rotation angle of 0° 30 and a vertical rotation angle of 0° 32.

[0039] In some embodiments, memory device 28 may store various orientation information sets (e.g., QR code 23) corresponding to various horizontal rotation angles (e.g., 30) and vertical rotation angles (e.g., 32), and processor 26 may compare an image of orientation information 34 with the various orientation information sets to determine the horizontal and vertical rotation angles. Alternatively or additionally, orientation information 34 may be provided by orientation label 14 in a “straight-forward” format, such that decoding does not need to be performed by processor 26. Accordingly, processor 26 may implement digital and / or text recognition techniques to determine the horizontal and vertical rotation angles.

[0040] Furthermore, viewing the orientation label 14 can enable the determination of the angle (e.g., depth rotation angle) of the orientation label 14 relative to the camera 20 about the depth axis (e.g., illustrated as the z-axis 22 on coordinate axis 16). For example, pattern and / or image recognition techniques can be used to identify the orientation label in the image and determine the angle of rotation of the orientation label about the depth axis 22. As illustrated, the camera 20 views the orientation label 14 attached to the user interaction device 12 "straight ahead," causing the orientation label 14 to rotate 0° (e.g., depth rotation angle 36) about the depth axis 22.

[0041] Orientation information (e.g., horizontal rotation angle 30 and vertical rotation angle 32) and depth information (e.g., including depth rotation angle 36) facilitate the determination of the orientation of the orientation label 14 in three dimensions (e.g., having six degrees of freedom). For example, as mentioned above, processor 26 determines orientation information 34 based on an image of the orientation label 14 captured by camera 20, the orientation information 34 including a horizontal rotation angle 30 of 0° and a vertical rotation angle 32 of 0°. Processor 26 can also determine the depth rotation angle 36 based on identifying the orientation label 14 in the image (e.g., using image recognition technology). Accordingly, processor 26 can use the horizontal rotation angle 30, the vertical rotation angle 32, and the depth rotation angle 36 (e.g., corresponding to the pitch, yaw, and roll of the orientation label 14) to determine the orientation of the orientation label 14. Furthermore, processor 26 can determine the dimensions of the orientation label 14 in the image (e.g., width 38 and length 40) (e.g., the number of pixels in the image related to the width 38 and length 40 of the orientation label 14). Based on the known width 38 and length 40 of the orientation label 14 and the number of associated pixels, the processor 26 can determine the distance of the camera 20 from the orientation label 14 (e.g., a depth measurement that may be part of the depth information) to facilitate the determination of both the orientation and position of the orientation label 14, and thus the orientation and position of the user interaction device 12.

[0042] As another illustrative example, Figure 4 According to embodiments of this disclosure Figure 1 A schematic front perspective view of a theme park attraction system 10, which includes a user interaction device 12 having an orientation label 14 in a second orientation. As illustrated, the user interaction device 12, and thus the orientation label 14, rotates relative to the camera 20 about the depth axis 22 in a counterclockwise direction (e.g., depth rotation direction 49) by a depth rotation angle 36 of 45°. As noted above, the processor 26 can determine the depth rotation angle 36 based on the orientation label 14 in an image of the user interaction device 12 with the orientation label 14 captured by the camera 20 (e.g., using image recognition technology). In some embodiments, the processor 26 can determine the depth rotation angle 36 of the orientation label 14 based on one or more reference features of the orientation label 14, and compare the reference features with those reference features of the orientation label 14 when rotating 0° about the depth axis 22. For example, in Figure 4In this embodiment, the orientation label 14 is provided in the form of a QR code® 23. Accordingly, the processor 26 can identify the positioning of the three position marks 50 and / or alignment marks 52 of the QR code® 23 to determine how the orientation label 14 is rotated relative to the depth axis 22 when the orientation label 14 is rotated 0° about the depth axis 22. The processor 26 can use pattern and / or image recognition techniques to identify such reference features of the orientation label 14.

[0043] also, Figure 5 According to embodiments of this disclosure Figure 1 This is a schematic side perspective view of a portion of a theme park attraction system 10, which includes a user interaction device 12 having an orientation label 14 in a second orientation. Specifically, the side perspective view is illustrated relative to a camera 20 along a horizontal axis 18. As illustrated, the orientation label 14 is rotated 30° clockwise (e.g., horizontal rotation direction 54) relative to the camera 20 about the horizontal axis 18 (e.g., horizontal rotation angle 30). Similarly, Figure 6 According to embodiments of this disclosure Figure 1 This is a schematic top-view perspective view of a portion of a theme park attraction system 10, which includes a user interaction device 12 having an orientation label 14 in a second orientation. Specifically, the top-view perspective view is illustrated relative to a camera 20 along a vertical axis 21. As better illustrated, the orientation label 14 is rotated 45° counterclockwise (e.g., vertical rotation direction 56) relative to the camera 20 about the vertical axis 21 (e.g., vertical rotation angle 32). Orientation information (e.g., horizontal rotation angle 30 and vertical rotation angle 32) and depth information (e.g., including depth rotation angle 36) facilitate determining the orientation of the orientation label 14 in three dimensions (e.g., having six degrees of freedom).

[0044] In this way, the orientation label 14 can display different orientation information (e.g., corresponding to different angular orientations) at different viewer viewpoints, enabling the detection system to determine the orientation of the orientation label 14. That is, the orientation label 14 can display information indicating the relative orientation of the orientation label 14 (e.g., relative to the viewer's viewpoint). The orientation label 14 can be made using any suitable material, format, and / or technology capable of providing or displaying different information or images depending on the viewing angle of the orientation label 14. While this disclosure discusses the orientation label 14 being made using light field printing technology, it should be understood that other suitable technologies may also be applicable, such as lens printing technology, using a series of baffles to enable and block the viewing of different images, etc. Furthermore, although... Figure 1-6The camera 20 observes an orientation label 14 of a user interaction device 12, and the controller 24 determines orientation information 34 for an orientation label 14 and / or a user interaction device 12. However, in additional or alternative embodiments, the camera 20 may observe multiple orientation labels 14 of multiple user interaction devices 12, and the controller 24 may determine orientation information 34 for multiple orientation labels 14 and / or multiple user interaction devices 12.

[0045] Figure 7 According to embodiments of this disclosure Figure 1 A schematic diagram of orientation label 14, which provides different orientation information 34 based on the viewing angle of the orientation label 14. Specifically, orientation label 14 may include a base layer 70 made of different visual data, such as in the form of multiple patterns (e.g., visual patterns) 72A-C (collectively referred to as elements 72). Each pattern 72 may display a graphic or image conveying orientation information 34. For example, each pattern 72 may be a barcode, pattern, text, etc., suitable for capture by camera 20 and identification by controller 24. Patterns 72 may be distributed, alternating, or arranged in the base layer 70 in a manner that allows individual patterns 72 conveying orientation information 34 to be viewed from the viewing angle corresponding to the orientation information 34. Patterns not corresponding to the orientation information 34 may be blocked or prevented from being visible to the viewer (e.g., using visual blocking structures, refraction of visible light, baffle structures, collimated backlighting).

[0046] For example, in Figure 7 While patterns 72A-C are described, it should be understood that any suitable number of patterns 72 can be included in the orientation label 14. In practice, the number of patterns 72 can depend on the resolution of the printer printing the orientation label 14 and the size or surface area of ​​the orientation label 14. For example, for an orientation label 14 8 cm wide and 8 cm long, and a printer with a resolution of 200 dots per centimeter (dpcm), the orientation label 14 can provide approximately 1600 x 1600 (2,560,000) patterns, where each pattern corresponds to a different orientation information set 34. The orientation label 14 can be any suitable size for easy attachment to the user interaction device 12, such as between 0.25 cm x 0.25 cm and 20 cm x 20 cm, including 8 cm x 8 cm, 5 cm x 8 cm, 5 cm x 5 cm, 3 cm x 3 cm, 10 cm x 8 cm, 10 cm x 10 cm, and so on. The resolution of a printer can include that of an inkjet printer (e.g., 120-285 dpcm), a laser printer (235-945 dpcm), or better.

[0047] As explained, when viewed by camera 20 from first position 74, orientation label 14 provides or displays first pattern 72A. For example, first position 74 can be viewed while rotating 15° clockwise about a horizontal rotation axis and 170° clockwise about a vertical rotation axis. Accordingly, first pattern 72A can provide orientation information 34 of a 15° horizontal rotation angle 30, a clockwise horizontal rotation direction 54, a 170° vertical rotation angle 32, and a clockwise vertical rotation direction 56.

[0048] When viewed from the second position 76 by the camera 20, the orientation label 14 provides or displays the second pattern 72B. For example, the second position 76 can be viewed while rotating 5° counterclockwise around the horizontal rotation axis and 20° clockwise around the vertical rotation axis. Accordingly, the second pattern 72B can provide orientation information 34 of the 5° horizontal rotation angle 30, the counterclockwise horizontal rotation direction 54, the 20° vertical rotation angle 32, and the clockwise vertical rotation direction 56.

[0049] When viewed from a third position 78 by camera 20, orientation label 14 provides or displays a third pattern 72C. For example, the third position 78 can be viewed while rotating 60° clockwise around a horizontal rotation axis and 140° counterclockwise around a vertical rotation axis. Accordingly, the third pattern 72C can provide orientation information 34 of a 60° horizontal rotation angle 30, a clockwise horizontal rotation direction 54, a 140° vertical rotation angle 32, and a counterclockwise vertical rotation direction 56. In this way, orientation label 14 can display to the viewer the orientation information of orientation label 14 corresponding to the viewer's viewpoint (e.g., corresponding to the relative orientation of orientation label 14 with respect to the viewer's viewpoint), while blocking or preventing the viewer from seeing other orientation information (e.g., corresponding to other viewpoints).

[0050] In some embodiments, the orientation label 14 may include a light source 80 (e.g., collimated illumination) disposed beneath the substrate 70, which provides better visibility for the camera 20 to view the pattern 72. The light source 80 may include light-reflecting devices, such as retroreflective materials (e.g., retroreflective sheets, retroreflective fabrics, retroreflective glass beads, microprisms, encapsulated lenses sealed to a fabric or plastic substrate, and / or metal strips). In this way, light entering the orientation label 14 can be reflected back by the light source 80, causing the reflected light to illuminate the pattern 72 in the substrate 70. In additional or alternative embodiments, the light source 80 may be any suitable light-generating device that emits light to illuminate the pattern 72. For example, the light source 80 may include a light bulb, such as a liquid crystal display (LCD), a light-emitting diode (LED), or an organic LED (OLED). In some embodiments, the light source 80 may include directional or collimated light that directs the pattern 72 corresponding to the viewer's viewpoint toward the viewer while directing other patterns 72 corresponding to other viewpoints away from the viewer (e.g., making other patterns 72 invisible to the viewer). The light source 80 may be battery powered and / or rechargeable. In some embodiments, for this purpose, the orientation tag 14 and / or user interaction device 12 may include a power source 82 (e.g., a battery, capacitor, power harvesting circuitry). In some embodiments, the light source 80 may be a wirelessly powered lamp (e.g., using ultra-high frequency (UHF) power harvesting).

[0051] While the illustrated light source 80 emits light in the visible spectrum, in some embodiments, the light source 80 may emit light in a non-visible spectrum (e.g., infrared or ultraviolet spectrum), and in this way, the camera 20 may use light in the non-visible spectrum to capture an image of the orientation label 14. Using a light source 80 that emits light in the non-visible spectrum can prevent other visitors to a theme park from being distracted by the orientation label 14, thereby maintaining a superior theme park experience.

[0052] In some embodiments, pattern 72 itself may be provided by a light-emitting device (e.g., LCD, LED, OLED). In additional or alternative embodiments, orientation label 14 and / or user interaction device 12 may include light-emitting devices that emit light in two or more different spectra. For example, a first set of light-emitting devices may emit light in the visible spectrum, and a second set of light-emitting devices may emit light in a non-visible spectrum (e.g., infrared). This can enable the use of multiple sets of light-emitting devices to transmit more data. For example, the first set of light-emitting devices may provide a pattern indicating a horizontal rotation angle 30 and a horizontal rotation direction 54, and the second set of light-emitting devices may provide a pattern indicating a vertical rotation angle 32 and a vertical rotation direction 56. As another example, the first set of light-emitting devices may provide a pattern indicating orientation information 34, and the second set of light-emitting devices may provide a pattern indicating identification information (e.g., the identification number, account number, user profile information, etc. of user interaction device 12).

[0053] In some embodiments, pattern 72 and / or substrate 70 may allow light from light source 80 to pass through pattern 72 and / or substrate 70. For example, pattern 72 may be printed on substrate 70, and / or substrate 70 may include a filter or screen (e.g., a through-filter). Accordingly, the image of orientation label 14 captured by camera 20 may include an image of pattern 72, such as printed on a filter and illuminated from behind by light source 80. In additional or alternative embodiments, certain elements of each pattern 72 may be “offset” relative to other elements (e.g., aligned or guided differently). Specifically, when the viewing angle changes from a first viewpoint to a second viewpoint, a first set of elements of pattern 72 may be viewed at the first viewpoint (while a second set of elements of pattern 72 may not be viewed), and a second set of elements of pattern 72 may be viewed at the second viewpoint (while a first set of elements of pattern 72 may not be viewed). This may allow for higher fidelity or angular resolution relative to camera 20 without increasing the fidelity or angular resolution of pattern 72 (e.g., the number of elements).

[0054] In some embodiments, the orientation label 14 may include a mask layer or visual alignment feature disposed on the base layer 70. The mask layer may be able to reveal, based on viewing the orientation label 14 at certain horizontal rotation angles 30 and vertical rotation angles 32, a pattern indicating orientation information 34 corresponding to those rotation angles. The mask layer may also block or limit the viewing of other patterns (e.g., corresponding to other viewpoints) from, for example, a camera 20. Figure 8 According to embodiments of this disclosure Figure 1A schematic diagram of orientation label 14 is provided, which provides different orientation information 34 based on the different angles at which the orientation label 14 is viewed using mask layer 100. As illustrated, mask layer 100 may include blocking element 102 that blocks (e.g., physically blocks) the viewing of patterns (e.g., 72B, 72C) other than a pattern (e.g., 72A) corresponding to the camera's viewpoint, thus enabling the viewing of a pattern indicating the orientation information 34 corresponding to the camera's viewpoint.

[0055] For example, the blocking or visual alignment element 102A can block the pattern 72B from the view 104 of the camera (e.g., when the camera 20 is in a certain position). Figure 7 As shown in the first position 74), the blocking element 102B can block the pattern 72C from the view 104 of the camera, while enabling the view 104 of the camera to access the pattern 72A. Similarly, the blocking element 102A can block the pattern 72A from the view 106 of the camera (e.g., when the camera 20 is in the first position 74). Figure 7 As shown in the second position 76, the blocking element 102B can block the pattern 72C from the view 106 of the camera, while allowing the view 106 of the camera to access the pattern 72B. Furthermore, the blocking element 102A can block the pattern 72A from the view 108 of the camera (e.g., when the camera 20 is in the third position), and the blocking element 102B can block the pattern 72B from the view 108 of the camera, while allowing the view 108 of the camera to access the pattern 72C. In this way, the blocking element 102 can enable the viewing of a pattern that transmits orientation information of the orientation label 14 corresponding to the viewer's viewpoint to the viewer, while preventing the viewer from viewing other orientation information (e.g., corresponding to other viewpoints).

[0056] In alternative or additional embodiments, the orientation label 14 may include a lens or visual alignment layer disposed on the base layer 70, which enables viewing or displaying patterns indicating orientation information 34 corresponding to the horizontal rotation angle 30 and vertical rotation angle 32 based on viewing the orientation label 14 at certain horizontal rotation angles 30 and 32. The lens layer may also refract visible light from other patterns (e.g., corresponding to other viewpoints) away from, for example, the camera 20, thus preventing or blocking the camera 20 from viewing other patterns. Figure 9 According to embodiments of this disclosure Figure 1A schematic diagram of orientation label 14, which provides different orientation information 34 based on the different angles at which the orientation label 14 is viewed using lens layer 120. Lens layer 120 may include a lens or visual alignment element 122 that refracts the view of a pattern (e.g., 72B, 72C) other than a pattern (e.g., 72A) away from camera 20, while refracting a pattern indicating orientation information 34 toward camera 20.

[0057] For example, lens element 122 can cause the viewing patterns 72B, 72C from the view 104 of the camera to be refracted (e.g., when the camera 20 is in a certain position). Figure 7 As shown in the first position 74), the view of pattern 72A is simultaneously refracted into the view 104 of the camera. Similarly, lens element 122 can refract the view of patterns 72A, 72C from the view 106 of the camera (e.g., when the camera 20 is in the first position 74). Figure 7 As shown in the second position 76), the view of pattern 72B is simultaneously refracted into the view 106 of the camera. Furthermore, the lens element 122 can refract the view of patterns 72A, 72B from the view 108 of the camera (e.g., when the camera 20 is in the second position 76). Figure 7 As shown in the third position 78), the viewing of pattern 72C is simultaneously refracted to the view 108 of the camera. In this way, lens element 122 can realize the viewing of the pattern by transmitting the orientation information of the orientation label 14 corresponding to the viewer's viewpoint to the viewer, while preventing the viewer from seeing other orientation information (e.g., corresponding to other viewpoints).

[0058] Lens element 122 may include any suitable material, shape, and / or size to refract the view of pattern 72 as desired. For example, lens element 122 may be made of glass, plastic, polycarbonate, etc. Lens element 122 may be convex, concave, spherical, hemispherical, etc.

[0059] Figure 10 According to embodiments of this disclosure Figure 1A block diagram of a theme park attraction system 10 is provided. Certain components of the theme park attraction system 10 (e.g., user interface device 12, camera 20, and / or controller 24) may be referred to as an orientation detection system. As illustrated, camera 20, communicatively coupled to controller 24, can capture images of user interface device 12. This image may include an orientation label 14. Controller 24 may use, for example, image recognition technology to identify the orientation label 14 in the image. Controller 24 may then determine orientation information 34 provided by the orientation label 14. For example, the orientation label 14 may encode the orientation information 34 in a QR code® 23. Controller 24 may thus use pattern recognition technology (e.g., QR code® recognition technology) to decode the QR code® 23 to determine the orientation information 34, which includes a horizontal rotation angle 30, a horizontal rotation direction 54, a vertical rotation angle 32, and a vertical rotation direction 56. In some embodiments, theme park attraction system 10 may include an image processing circuitry system for decrypting the orientation label 14 (e.g., in the form of text, a barcode, or a QR code® 23). Furthermore, the controller 24 can determine the dimensions (e.g., width 38 and length 40) of the orientation label 14 in the image (e.g., the number of pixels in the image associated with the width 38 and length 40 of the orientation label 14). Based on the known width 38 and length 40 of the orientation label 14 and the associated number of pixels, the controller 24 can determine the distance of the camera 20 from the orientation label 14 (e.g., a depth measurement that may be part of the depth information) to facilitate the determination of both the orientation and position of the orientation label 14, and thus the orientation and position of the user interaction device 12.

[0060] The controller 24 may also be communicatively coupled to the output device 130 (e.g., an animated character, an electronic display, a speaker) and instruct the output device 130 to output a user interactive experience (e.g., motion, images, video, audio data, etc.) based on the orientation information 34. While the output device 130 is described as separate from the user interaction device 12, in some embodiments, the output device 130 may be part of the user interaction device 12 (e.g., a speaker, electronic display, light output device, or actuator of the user interaction device 12). As an example, the output device 130 may be an electronic display (e.g., mounted on a wall or augmented reality display) that displays, for example, one or more virtual objects (e.g., one or more swords) associated with one or more orientation tags 14 of one or more user interaction devices 12, such that moving one or more user interaction devices 12 can cause the displayed one or more virtual objects to move due to the movement of one or more orientation tags 14. As another example, output device 130 can be an animated object of a location (e.g., a robot or other animated character), and in response to determining that user interaction device 12 is pointing towards output device 130 via orientation label 14, the animated object can perform user interaction actions (e.g., wagging its tail, falling down, waving a greeting). As yet another example, user interaction device 12 can be a virtual reality headset to which orientation label 14 is attached, and output device 130 can be the display of the virtual reality headset. A user can wear user interaction device 12, move their head (e.g., to the left and right), and in response, the display can show video data corresponding to the user's head movement (e.g., providing the illusion that the user is looking around in a virtual world).

[0061] The controller 24 can be communicatively coupled to the camera 20 and / or the output device 130 by any suitable means, such as via wired communication or via a communication network using wireless communication protocols or technologies (e.g., radio, Bluetooth, WiFi, infrared, Ethernet, Thread, ZigBee, Z-Wave, KNX, mobile and / or microwave).

[0062] Considering the preceding text, Figure 11This is a flowchart of a process 160 for determining the orientation and position of a user interaction device 12 according to embodiments of the present disclosure. Process 160 can be implemented by any suitable system that can identify orientation labels 14 in an image of the user interaction device 12 and determine orientation information in the orientation labels 14. For example, a camera 20, controller 24, processor 26, and / or output device 150 of a theme park attraction system 10 can implement process 160. While process 160 is described using steps performed in a specific sequence, it should be understood that the present disclosure contemplates that the described steps may be performed in a different sequence than described, and that some described steps may be skipped or not performed in full. In some embodiments, process 160 can be implemented by using a processor (such as processor 26) to execute instructions stored in a tangible, non-transitory computer-readable medium (such as memory device 28).

[0063] As illustrated, in process block 162, processor 26 receives images from user interaction device 12. Specifically, camera 20 can capture images of user interaction device 12 (e.g., as held by user 42) and specifically send the images to controller 24 and processor 26. Processor 26, which may reside in controller 24, can thus receive images (e.g., data indicating the captured images).

[0064] In process block 164, processor 26 identifies orientation label 14 of user interaction device 12 in the image. In particular, processor 26 may use pattern and / or image recognition technology (e.g., stored as instructions in memory device 28) to detect characteristics of orientation label 14 (e.g., shape, color, other identifiable characteristics).

[0065] In process block 166, processor 26 determines the orientation information 34 of orientation label 14 by reading the orientation information 34 that can be viewed through orientation label 14. Specifically, processor 26 can determine the orientation information 34 of orientation label 14 using image, pattern, and / or text recognition techniques (e.g., stored as instructions in memory device 28). For example, the orientation information 34 can be provided as text (e.g., for a 15° horizontal rotation angle 30, a clockwise horizontal rotation direction 54, a 170° vertical rotation angle 32, and a counterclockwise vertical rotation direction 56, the text could include “15°CW; 170°CCW”). Accordingly, processor 26 can use text recognition techniques to determine the orientation information 34. As another example, the orientation information 34 can be in the form of a QR code® 23, and accordingly, processor 26 can use pattern recognition techniques (e.g., QR code® 23 recognition techniques) to determine the orientation information 34.

[0066] In process block 168, processor 26 determines the orientation of user interaction device 12 and / or orientation label 14 based on orientation information 34. Specifically, processor 26 uses orientation information 34 (e.g., by determining the horizontal rotation angle 30, horizontal rotation direction 54, vertical rotation angle 32, and vertical rotation direction 56 of orientation label 14) to determine the orientation of orientation label 14. In some embodiments, processor 26 may apply the orientation of orientation label 14 to user interaction device 12. For example, processor 26 may assume that the orientation of user interaction device 12 is the same as the orientation of orientation label 14. In some embodiments, processor 26 may apply the known dimensions of user interaction device 12 to the orientation information 34 provided by orientation label 14 to determine the orientation of user interaction device 12. For example, if the user interaction device 12 is a mobile device that is 7.5cm wide by 18cm long, and it is known that the orientation label 14 is applied to the center of the back of the mobile device and aligned with the mobile device, then the processor 26 can determine that the orientation of the user interaction device 12 is 7.5cm wide by 18cm long, centered on the center of the orientation label 14, and aligned with the orientation label 14.

[0067] In process block 170, processor 26 determines the position of user interaction device 12 and / or orientation label 14 based on the image. Specifically, processor 26 can determine the position of orientation label 14 by associating pixels in the image with orientation label 14. Furthermore, processor 26 can determine the depth information of orientation label 14. Specifically, processor 26 can determine the size of orientation label 14 in the image (e.g., as shown in the image). Figure 1 The width 38 and length 40 shown (e.g., the number of pixels in the image associated with the width 38 and length 40 of the orientation label 14). Based on the known width 38 and length 40 of the orientation label 14 and the associated number of pixels, the processor 26 can determine the distance of the camera 20 from the orientation label 14 (e.g., a depth measurement that can be used as part of depth information).

[0068] In process block 172, processor 26 adjusts or provides a user interaction experience based on the orientation and / or position of user interaction device 12 and / or orientation label 14. Specifically, memory device 28 may store instructions for adjusting or outputting a user interaction experience in response to user interaction device 12 and / or orientation label 14 being in certain orientations and / or positions. Processor 26 may determine whether the orientation and / or position of user interaction device 12 and / or orientation label 14 is related to any stored orientation and / or position, and if so, processor 26 may adjust or instruct output device 150 to output a user interaction experience corresponding to the orientation and / or position of user interaction device 12 and / or orientation label 14.

[0069] For example, Figure 12 It is in the form of a handheld device 180 (e.g., a toy sword) according to an embodiment of this disclosure. Figure 1 A schematic diagram of a user interaction device 12 and an output device 150 in the form of an electronic display 182 and a speaker 184 is provided. The output device 150 outputs video data 186 and audio data 188 based on the orientation and / or position of the handheld device 180 and / or the orientation tag 14. Specifically, the orientation tag 14 is attached to the handheld device 180, and the processor 26 can determine the orientation and / or position of the handheld device 180 and / or the orientation tag 14 as described above. If the processor 26 determines that the orientation and / or position of the handheld device 180 and / or the orientation tag 14 is related to the output of video data 186 and / or audio data 188 (e.g., as stored in the memory device 28), then the processor 26 instructs the display 182 to output video data 186 (e.g., playing a video of a fireball 190 appearing to be fired from the handheld device 180) and / or the speaker 184 to output audio data 188 (e.g., a fireball sound effect).

[0070] Furthermore, in some embodiments, the processor 26 may determine the output of certain video data based on a portion of the orientation label 14. For example, if the handheld device 180 is a toy gun, pulling the trigger may partially block the orientation label 14, while not pulling the trigger may leave the orientation label 14 unblocked. Accordingly, if the processor 26 first receives an image of the unblocked orientation label 14 and then receives an image of the blocked orientation label 14, the processor 26 may instruct the display 182 and speaker 184 to output video and audio data corresponding to shooting the toy gun. In some embodiments, the display 182 and / or speaker 184 may be part of a virtual or augmented reality head-mounted device, and output video data 186 and / or audio data 188 as part of a virtual or augmented reality experience provided by the head-mounted device.

[0071] As another example, Figure 13 It is in the form of a mobile device 200 according to an embodiment of the present disclosure. Figure 1The schematic diagram shows a user interaction device 12 and an output device 150 in the form of an electronic display 202 and a speaker 204. The output device 150 outputs video data 206 and audio data 208 based on the orientation and / or position of the mobile device 200 and / or the orientation tag 14. Specifically, the orientation tag 14 is attached to the mobile device 200, and the processor 26 can determine the orientation and / or position of the mobile device 200 and / or the orientation tag 14 as described above. If the processor 26 determines that the orientation and / or position of the mobile device 200 and / or orientation tag 14 are related to the output video data 206 and / or audio data 208 (e.g., as stored in memory device 28), then the processor 26 instructs the display 202 to output video data 206 (e.g., fishing rod 210 extending from the mobile device 200, fishing line 212 extending from the fishing rod 210, and fish 214 being caught on fishing line 212) and / or the speaker 204 to output audio data 208 (e.g., the sound effect of fishing line 212 being pulled by fish 214). In some embodiments, the display 202 and / or speaker 204 may be part of a virtual or augmented reality head-mounted device, and the output video data 206 and / or audio data 208 are part of a virtual or augmented reality experience provided by the head-mounted device.

[0072] As yet another example, Figure 14 It is in the form of a head-mounted device 220 according to an embodiment of the present disclosure. Figure 1 A schematic diagram of a user interaction device 12 and an output device 150 in the form of an electronic display of a head-mounted device 220, wherein the output device 150 outputs video data based on the orientation and / or position of the head-mounted device 220 and / or the orientation tag 14. Specifically, the orientation tag 14 is attached to the head-mounted device 220, and the processor 26 can determine the orientation and / or position of the head-mounted device 220 and / or the orientation tag 14 as described above. If the processor 26 determines that the orientation and / or position of the head-mounted device 220 and / or the orientation tag 14 is related to output video data (e.g., as stored in memory device 28), the processor 26 instructs the display of the head-mounted device 220 to output video data (e.g., looking around in a virtual world).

[0073] As another example, Figure 15 It is in the form of a flexible wearable material 230 according to an embodiment of the present disclosure. Figure 1A schematic diagram of a user interaction device 12 and an output device 150 in the form of an electronic display of a head-mounted device 232, wherein the output device 150 outputs video data based on the orientation and / or position of wearable material 230 and / or orientation tags (e.g., 14A-F). Specifically, orientation tags 14 (including 14A-F) are attached to wearable material 230, and the orientation tags 14 can shift along with wearable material 230 when the wearer 234 moves their arm. Wearable material 230 can be any suitable material to which orientation tags 14 can be attached and worn by the wearer 234, such as cloth, polyester, cotton, wool, denim, etc. Processor 26 can determine the orientation and / or position of orientation tags 14A-F as described above, and map or determine the orientation and / or position of wearable material 230 based on the orientation and / or position of orientation tags 14A-F. If the processor 26 determines that the orientation and / or position of the wearable material 230 and / or orientation tags 14A-F are related to the output video data (e.g., as stored in memory device 28), the processor 26 instructs the display of the head-mounted device 232 to output video data (e.g., the virtual arm of the wearer 234).

[0074] In this way, process 160 enables processor 26 to determine the orientation and position of user interaction device 12 and / or orientation label 14, and output user interaction experience based on the orientation and position of user interaction device 12 and / or orientation label 14.

[0075] While the embodiments set forth in this disclosure may be susceptible to various modifications and alternatives, specific embodiments have been shown by way of example in the accompanying drawings and have been described in detail herein. However, it should be understood that this disclosure is not intended to be limited to the particular forms disclosed. This disclosure will cover all modifications, equivalents, and alternatives falling within the spirit and scope of this disclosure as defined by the following appended claims.

[0076] The techniques proposed and claimed herein are referenced and applied to substantial objects and specific examples of practical nature that can arguably improve the technical field and are therefore not abstract, intangible, or purely theoretical. Furthermore, if any claim appended to this specification contains one or more elements designated as “component for [implementing]…[function]” or “step for [implementing]…[function]”, such elements are intended to be interpreted in accordance with 35 USC 112(f). However, for any claim containing elements designated in any other way, such elements are not intended to be interpreted in accordance with 35 USC §112(f).

Claims

1. An orientation detection system, comprising: An orientation detector, which includes an image sensor and an image processing circuit system; as well as An orientation label configured to be coupled to a user interaction device, the orientation label comprising: The visual data of the first layer; and A second layer of visual alignment features is disposed on the visual data of the first layer, wherein the visual alignment features are configured to reveal and block portions of the visual data relative to a viewpoint of the image sensor, wherein different patterns of the visual data are observable to the image sensor, wherein each of the different patterns corresponds to the relative orientation of the orientation label relative to the viewpoint, and wherein the image processing circuitry is configured to identify the orientation of the orientation label based on patterns in the different patterns of the visual data observed by the image sensor.

2. The orientation detection system according to claim 1, wherein, The visual alignment feature is configured to physically block patterns in the different patterns of the visual data that do not correspond to the relative orientation of the orientation label, so as to prevent them from being detected by the image sensor.

3. The orientation detection system according to claim 1, wherein, The visual alignment features are configured to: The pattern is one of different patterns that provides the visual data via refraction, so that it can be observed from the viewpoint by the image sensor; as well as By refraction relative to the viewpoint, patterns in the different patterns of the visual data that do not correspond to the relative orientation of the orientation label are blocked from being seen by the image sensor.

4. The orientation detection system according to claim 1, wherein, Each of the different patterns includes a barcode or quick response (QR) code that can be decrypted by the image processing circuitry system to indicate the horizontal and vertical rotation angles of the orientation label.

5. The orientation detection system according to claim 1, wherein, Each of the different patterns includes text indicating the horizontal and vertical rotation angles of the orientation label.

6. An entertainment system, comprising: The orientation label of the user interaction device includes a visual alignment feature and multiple visual patterns, wherein the visual alignment feature restricts the viewing of the multiple visual patterns based on the viewing orientation of the orientation label. A camera configured to capture an image of the orientation label on the user interaction device; as well as The controller has a processing circuitry and a memory that stores machine-readable instructions configured to cause the processing circuitry to: The orientation label identifying the user interaction device in the image; and The orientation of the orientation label is determined based on orientation information associated with the visual patterns among the plurality of visual patterns captured in the image.

7. The entertainment system according to claim 6, wherein, The orientation information includes the horizontal and vertical rotation angles of the orientation label.

8. The entertainment system according to claim 7, wherein, The machine-readable instructions are configured to cause the processing circuitry to determine the orientation of the orientation label by applying the horizontal rotation angle and the vertical rotation angle to the orientation label in the image.

9. The entertainment system according to claim 6, wherein, The machine-readable instructions are configured to cause the processing circuitry system to determine the location of the orientation label in the image.

10. The entertainment system according to claim 9, comprising an output device, wherein, The machine-readable instructions are configured to cause the processing circuitry to instruct the output device to output a user interaction experience based on the orientation and position of the orientation label.

11. The entertainment system according to claim 10, wherein, The output device includes an electronic display, wherein the memory stores data that associates the orientation of the orientation tag with video data, and wherein the machine-readable instructions are configured to cause the processing circuitry system to instruct the electronic display to display the video data based on the orientation of the orientation tag.

12. The entertainment system according to claim 10, wherein, The output device includes a speaker, and wherein the memory stores data that associates the orientation of the orientation label with audio data, and wherein the machine-readable instructions are configured to cause the processing circuitry system to instruct the speaker to output the audio data based on the orientation of the orientation label.

13. The entertainment system according to claim 6, wherein, The user interaction device includes a mobile device, and the orientation label is attached to the mobile device.

14. A user interaction device, comprising: Orientation labels, which include: The first layer comprises multiple patterns, wherein each of the multiple patterns indicates a set of orientation information; and A second layer is disposed on top of the first layer, wherein the second layer includes a plurality of elements configured to: It is capable of realizing corresponding patterns among the plurality of patterns, wherein the corresponding pattern corresponds to the viewpoint from which the orientation label is to be viewed; and To prevent non-corresponding patterns among the plurality of patterns, wherein the non-corresponding pattern does not correspond to the viewpoint of the orientation label as viewed from the viewpoint.

15. The user interaction device according to claim 14, including a handheld device.

16. The user interaction device according to claim 14, comprising a head-mounted device.

17. The user interaction device according to claim 16, wherein, The head-mounted device includes a display, wherein the display is configured to output video data based on the orientation information set indicated by the corresponding pattern.

18. The user interaction device of claim 14, comprising wearable material, wherein, The wearable material includes a plurality of orientation tags, wherein the plurality of orientation tags include the orientation tags.

19. The user interaction device according to claim 14, comprising a light source, wherein, The light source is configured to emit light to illuminate the plurality of patterns.

20. The user interaction device according to claim 19, wherein, The light source includes a liquid crystal display, a light-emitting diode, or an organic light-emitting diode.

21. The user interaction device according to claim 19, wherein, The light source includes a reflective material.

Images