Alignment system

Abstract

This system provides a positioning system that can reduce the time and effort required for hygiene management of wearable displays, and also reduce the time required for positioning. [Solution] The alignment system is a system for aligning the position of a wearable display between the real space and the virtual space, and comprises a base on which the wearable display is placed, and a coordinate input unit provided on the wearable display, wherein the coordinate input unit is configured to receive coordinate information for alignment according to the position of the base.

Description

Technical Field

[0001] The present invention relates to an alignment system for aligning a real space and a virtual space in a wearable display.

Background Art

[0002] Patent Document 1 discloses a system for aligning a wearable display based on the position of a sticker provided in a real space.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in Patent Document 1, since the user wears the wearable display for alignment, there are problems that hygiene management of the wearable display is required and alignment takes time.

[0005] The present invention solves the above problems, and aims to provide an alignment system capable of reducing the work and time of hygiene management of a wearable display and reducing the alignment time.

Means for Solving the Problems

[0006] The alignment system according to the present invention is an alignment system for performing alignment between real space and virtual space in a wearable display, comprising a base on which the wearable display is placed and a coordinate input unit provided on the wearable display, wherein the coordinate input unit is configured to receive coordinate information for the alignment according to the placement position of the base.

[0007] According to the present invention, by placing the wearable display on a base, the wearable display can be positioned in a stable state, thereby reducing the positioning time. Furthermore, since the positioning is performed with the wearable display placed on the base, it is not necessary to wear the wearable display on the user for positioning, thus reducing the time and effort required for hygiene management such as disinfection. In addition, since the coordinate information acquired according to the placement position of the base is input to the coordinate input section of the wearable display, accurate positioning between the real space and the virtual space on the wearable display can be performed.

[0008] In one embodiment of the present invention, the wearable display has a wearable sensor that switches between an active state and a sleep state of the wearable display, and the base has a shielding member that shields the wearable sensor and activates the wearable display.

[0009] According to one aspect of the present invention, by shielding the attached sensor with a shielding member, a state in which a wearable display is attached can be simulated, and the wearable display can be activated. Therefore, by shielding the attached sensor with a shielding member, the wearable display can be activated and alignment can be performed while the wearable display is placed on a base.

[0010] In one embodiment of the present invention, the alignment system described above further comprises a storage unit provided on the wearable display or the base for storing the coordinate information, and the coordinate input unit is configured to receive the coordinate information from the storage unit.

[0011] According to one aspect of the present invention, the coordinate input unit can read the coordinate information stored in the memory unit, eliminating the need to acquire coordinate information again. Therefore, the time required for aligning the wearable display can be reduced. [Effects of the Invention]

[0012] According to the present invention, it is possible to provide an alignment system that can reduce the work and time required for hygienic management of wearable displays and reduce the time required for alignment. [Brief explanation of the drawing]

[0013] [Figure 1] This is a schematic perspective view showing an example of a wearable display and base in an alignment system according to an embodiment of the present invention. [Figure 2] This is a schematic front view showing an example of the display section of a wearable display according to an embodiment of the present invention. [Figure 3] This is a schematic perspective view showing an example of a pedestal according to an embodiment of the present invention. [Figure 4] Figure 3 is an enlarged perspective view of a portion of the base. [Figure 5] Figure 3 is a magnified perspective view of another part of the pedestal. [Figure 6] This is a schematic perspective view showing an example of an input device used in an alignment system according to an embodiment of the present invention. [Figure 7] This is a functional block diagram showing an example of an alignment system according to an embodiment of the present invention. [Figure 8] This is a functional block diagram showing another example of the alignment system according to an embodiment of the present invention. [Figure 9]It is a flowchart showing an example of alignment processing in an alignment system according to an embodiment of the present invention.

Mode for Carrying Out the Invention

[0014] Hereinafter, the alignment system 100 according to the embodiment related to the present disclosure will be described with reference to the accompanying drawings. In the accompanying drawings, the same members or parts or members or parts having the same function are denoted by the same reference numerals or the reference numerals are omitted. Further, the following embodiments are examples, and the content of the present disclosure should not be construed in a limited manner by the description of the embodiments.

[0015] FIG. 1 is a perspective view schematically showing a wearable display 1 and a pedestal 2 in an alignment system 100 according to an embodiment. In FIG. 1 and FIGS. 1 to 5 below, for convenience of explanation, the X-axis, Y-axis, and Z-axis are defined as examples of position coordinates, but the positions and directions of the actual wearable display 1 and pedestal 2 are not limited to specific position coordinates and directions.

[0016] As shown in FIG. 1, the alignment system 100 includes a wearable display 1. The wearable display 1 is an augmented reality (AR) device or a mixed reality (MR) device that is worn on the user's head and superimposes information in a virtual space on information in the real space in front of the line of sight and displays it to the user. Here, the "real space" refers to a physical space visible to the user. The "virtual space" refers to a space based on digital information artificially created by a digital device such as a computer. The wearable display 1 is formed, for example, as a goggle-type device such as a head-mounted display or a glasses-type device such as smart glasses. A goggle-type device is illustrated in FIG. 1.

[0017] The wearable display 1 has a display unit 10. The display unit 10 overlays the information of the virtual space on the information of the real space and displays it to the user, allowing the user to experience the augmented reality world. When the wearable display 1 is worn, the display unit 10 is disposed at a position covering the front of the user's eyes. Details of the display unit 10 will be described later using FIG. 2.

[0018] The wearable display 1 has a mounting unit 15. The mounting unit 15 is connected to the display unit 10 and is arranged to sandwich the sides of the user's head near the upper parts of both ears so that the display unit 10 disposed at a position covering the front of the user's eyes does not shift when the wearable display 1 is worn. The mounting unit 15 may be formed of, for example, a rubber band or may be formed of a resin such as plastic, although not limited thereto. As shown in FIG. 1, the mounting unit 15 may be integrally formed with the housing 10a of the display unit 10 or may be formed as a separate mounting member from the housing 10a. Also, in FIG. 1, the mounting unit 15 is a U-shaped member formed to surround the back of the user's head when the wearable display 1 is worn, but is not limited thereto and may be formed as a pair of mounting members such as the temples of glasses.

[0019] Also, as shown in FIG. 1, the alignment system 100 includes a pedestal 2 on which the wearable display 1 is placed. The pedestal 2 can be formed of any material and any combination of materials. Although not limited, for example, it may be made of metal such as stainless steel, may be made of resin such as plastic, or may be made of wood such as MDF. Details of the pedestal 2 will be described later using FIGS. 3 to 5.

[0020] Furthermore, as shown in Figure 1, the wearable display 1 may be provided with a terminal 1a for charging and / or communication with external devices. The base 2 may also be provided with a terminal 2a for charging and / or communication with external devices. Terminals 1a and 2a are formed as, for example, USB terminals. In the alignment system 100, bidirectional communication between the wearable display 1 and the base 2 is possible by connecting terminals 1a and 2a with a wire.

[0021] Furthermore, bidirectional communication between the wearable display 1 and the base 2 can also be performed wirelessly, for example, by Bluetooth® or Wi-Fi connection. In this case, terminals 1a and 2a can be used only for charging, or they can be omitted. In addition, bidirectional communication between the wearable display 1 and the base 2 may employ both wired and wireless connections, or only one of them may be employed.

[0022] Generally, with wireless connections, software operation is required to accurately connect from the source device to the destination device. However, with wired connections, physical visual confirmation is easy, ensuring a reliable one-to-one connection with the correct device, and eliminating the need for software operation. Furthermore, when terminals 1a and 2a are connected via a wired connection, it is possible to make one of terminals 1a or 2a a magnetic connection terminal, as illustrated by terminal 2a in Figure 1. For example, as shown in Figure 1, if terminal 2a is a magnetic connection terminal, one connector on the connection cable (not shown) becomes a magnetic connector, making it easy to attach and detach terminal 2a. Note that in Figure 1, the wearable display 1 is provided with only one terminal 1a, and the base 2 is also provided with only one terminal 2a, but both terminals 1a and 2a may be multiple.

[0023] Next, in addition to Figure 1 mentioned above, the display unit 10 of the wearable display 1 will be described using Figure 2. Figure 2 is a schematic front view showing an example of the display unit 10 of the wearable display according to the embodiment.

[0024] A front panel 10a1 is provided on the front of the housing 10a of the display unit 10. The display unit 10 is configured to allow the user to see the real world through a pair of lenses 10e provided inside the housing 10a. The front panel 10a1 may be transparent so that the pair of lenses 10e can be seen from the outside, or it may be colored so that they cannot be seen, or it may be a perforated panel with holes that expose the pair of lenses 10e to the outside.

[0025] Furthermore, a recess 10a2 is provided in the center of the lower part of the housing 10a. The recess 10a2 is formed to conform to the shape of the user's nose and to prevent the housing 10a from shifting away from the nose. The recess 10a2 is formed, but is not limited to, a flexible rubber pad.

[0026] The display unit 10 is equipped with numerous sensors to improve the integration of the real and virtual spaces or to enhance user operability.

[0027] Multiple tracking sensors 10b are arranged around the outer periphery of the housing 10a. The tracking sensors 10b are sensors that measure the position coordinates and orientation of the wearable display 1 in real space. The multiple tracking sensors 10b are arranged to ensure the accuracy of the measurement of the position coordinates and orientation of the wearable display 1. For example, in Figure 2, tracking sensors 10b are arranged on the upper right, lower right, upper left, and lower left of the housing 10a. The tracking sensors 10b are not limited to any particular type, but for example, image sensors such as cameras can be used.

[0028] In Figure 2, a total of four tracking sensors 10b are arranged, but this is not limited to this. Any number of tracking sensors 10b can be arranged as long as the measurement accuracy of the position coordinates and orientation of the wearable display 1 can be ensured. For example, the total number of tracking sensors 10b may be four or more, or less than four. Furthermore, the tracking sensors 10b can be placed at any position on the housing 10a as long as the measurement accuracy of the position coordinates and orientation of the wearable display 1 can be ensured. For example, the tracking sensors 10b may be provided on the right and left sides of the housing 10a, or on the back side of the front panel 10a1.

[0029] Furthermore, a depth sensor 10c is positioned in the housing 10a. The depth sensor 10c is a sensor that measures the distance between the wearable display 1 and an object in real space. The depth sensor 10c is positioned to ensure accuracy in measuring the distance between the wearable display 1 and an object in real space. For example, in Figure 2, the depth sensor 10c is positioned on the front panel 10a1 so as viewed from outside the housing 10a, it is located in the center of the front panel 10a1. Depending on the application or purpose, a laser-type sensor or a stereo camera-type sensor may be used as the depth sensor 10c. As a laser-type sensor, for example, an optical sensor such as LiDAR (Light Detection and Ranging) may be used. As a stereo camera-type sensor, although not limited to this, an image sensor such as a camera may be used.

[0030] In Figure 2, only one depth sensor 10c is shown, but this is not limited to this configuration. Multiple depth sensors 10c may be arranged to ensure accurate distance measurement between the wearable display 1 and objects in real space. Furthermore, the depth sensors 10c can be placed at any position on the housing 10a to ensure accurate distance measurement between the wearable display 1 and objects in real space. For example, two depth sensors 10c may be placed on the front panel 10a1 so as to be located near a pair of lenses 10e.

[0031] By equipping the display unit 10 with a tracking sensor 10b and a depth sensor 10c, the position of the wearable display 1 can be measured using only the display unit 10, eliminating the need for external sensors. Therefore, users can easily align the wearable display 1 between the real and virtual spaces, improving the operability of the wearable display 1. Furthermore, by equipping the display unit 10 with a tracking sensor 10b and a depth sensor 10c, it becomes unnecessary to place markers such as alignment stickers in the real space, thus preventing a decrease in the aesthetic appeal of the real space due to the placement of markers.

[0032] In the alignment system 100, coordinate information is calculated by image analysis based on data measured by the tracking sensor 10b and the depth sensor 10c. Details will be described later using Figures 7 to 9.

[0033] A mounting sensor 10d is positioned on the housing 10a. The mounting sensor 10d is a sensor that detects when a user puts on the wearable display 1. The mounting sensor 10d is positioned at any location where it is possible to detect when a user puts on the wearable display 1, for example, a position corresponding to the user's brow or forehead, although this is not limited to this position. For example, in Figure 2, the mounting sensor 10d is positioned on the back side and upper center of the front panel 10a1. The mounting sensor 10d can be an optical sensor such as an infrared sensor, although this is not limited to this position. In Figure 2, there is only one mounting sensor 10d, but this is not limited to this position. For example, the wearable display 1 may have multiple mounting sensors 10d, provided that they are positioned in a location where it is possible to detect when a user puts on the wearable display 1.

[0034] By placing the mounting sensor 10d on the housing 10a, the wearable display 1 can be automatically switched between active and sleep states, thereby improving the power saving of the wearable display 1. Here, the "active state" of the wearable display 1 refers to the state in which the wearable display 1 is usable, and the "sleep state" refers to the state in which the wearable display 1 is waiting to be used.

[0035] Furthermore, the wearable display 1 may be configured to include sensors other than the tracking sensor 10b, depth sensor 10c, and mounting sensor 10d, such as an accelerometer, depending on the application or purpose.

[0036] Next, in addition to Figures 1 and 2 mentioned above, the base 2 will be described using Figures 3 to 5. Figure 3 is a schematic perspective view showing an example of a base according to the embodiment. Figure 4 is an enlarged perspective view of a part of the base in Figure 3. Figure 5 is an enlarged perspective view of another part of the base in Figure 3. As described above using Figure 1, in the alignment system 100 of the embodiment, the base 2 is formed so that the wearable display 1 can be placed on it.

[0037] Since the wearable display 1 is placed on the base 2, the wearable display 1 can be positioned stably, thus reducing the positioning time.

[0038] In particular, when a user unfamiliar with operating the wearable display 1 attempts to align it while wearing it, it may be difficult to align it in a stable position, and an experienced assistant may need to perform the alignment for them. However, by placing the wearable display 1 on the base 2, even unfamiliar users can align the wearable display 1 in a stable position, thus reducing the time required for alignment. Furthermore, since operations such as attaching the wearable display 1 to the head are unnecessary when aligning the wearable display 1, multiple wearable displays 1 can be set up in a short time, enabling multiple users to experience augmented reality or mixed reality. In addition, complex operations and explanations for aligning the wearable display 1 are unnecessary, eliminating the need for assistants and explainers to perform the alignment. Therefore, the human cost associated with using the wearable display 1 can be reduced. Moreover, even when no one is present in the space where the wearable display 1 is used, such as an art museum, museum, or demonstration venue, users can still perform the alignment. Furthermore, since the user can adjust the position of the wearable display 1 at their own pace or timing, the user's comfort level when using the wearable display 1 can be improved.

[0039] Furthermore, in the alignment system 100 of this embodiment, since the wearable display 1 is placed on the base 2, alignment can be performed with the wearable display 1 placed on the base 2, thus reducing the time and effort required for hygiene management such as disinfection.

[0040] In particular, when an experienced caregiver wears the wearable display 1 to perform the alignment task, the wearable display 1 comes into contact with the caregiver's face and head, making it easy for the caregiver's sweat or bodily fluids to adhere to the wearable display 1. Therefore, hygiene management such as disinfection to prevent infectious diseases such as COVID-19 becomes essential. However, in the alignment system 100 of this embodiment, it is not necessary to wear the wearable display 1 for alignment, thus reducing the work and time required for hygiene management such as disinfection.

[0041] Furthermore, if the wearable display 1 is placed directly on the floor or a desk surface, the detection range of the tracking sensor 10b may be obstructed by the floor or desk surface if the tracking sensor 10b is located on the underside of the housing 10a. If the detection range of the tracking sensor 10b is obstructed by the floor or desk surface, accurate image analysis of the real space may be hindered, potentially reducing the accuracy of measuring the position coordinates in the real space. However, in the alignment system 100 of this embodiment, the wearable display 1 is placed on a base 2, and the wearable display 1 is positioned at a distance from the floor or desk surface. Therefore, by placing the wearable display 1 on the base 2, a state in which the user is wearing the wearable display 1 is simulated, preventing a decrease in the accuracy of measuring the position coordinates in the real space and reducing the error between the real space and the virtual space.

[0042] The base 2 has a base 21. Although not shown, the base 21 is placed on a surface such as a floor or a desk. In Figure 3, the base 21 is formed as a plate-shaped member with both sides formed in a flattened shape. Also in Figure 3, the base 21 is formed in a rectangular shape with four semicircular corners. Note that the base 21 is not limited to the shape shown in Figure 3, and can be any shape as long as it can be placed on a surface such as a floor or a desk.

[0043] The base 2 has a support column 23. The support column 23 extends vertically in the direction away from the base 21 (the positive direction of the Z-axis in Figure 3). The support column 23 may be formed as a separate component from the base 21 and connected to the base 21 by screws or the like, or it may be integrally formed with the base 21.

[0044] The base 2 includes a connecting member 24, a first beam section 25, and a second beam section 27.

[0045] The connecting member 24 is provided at the tip of the support column 23, and a portion of it is housed inside the support column 23. By housing a portion of the connecting member 24 inside the support column 23, the length of the portion extending away from the tip of the support column 23 can be extended or retracted. The length of the portion of the connecting member 24 extending away from the tip of the support column 23 is kept constant so as not to change with external forces below a predetermined level. The extension or retraction of the length of the portion of the connecting member 24 extending away from the tip of the support column 23 is limited, for example, by hydraulic or frictional force acting on the connecting member 24, by a ratchet mechanism, or by fastening members such as screws fixing the connecting member 24 to the support column 23. In Figures 3 and 4, the connecting member 24 is formed as a pair of plate-like members.

[0046] The first beam section 25 extends in a direction perpendicular to the extension direction of the support column 23 (the X direction in Figures 3 and 4). The central part of the first beam section 25 is located at the tip of the connecting member 24. The first beam section 25 is formed to support the mounting portion 15 of the wearable display 1, as will be described later.

[0047] The second beam section 27 is a rod-shaped member that extends in a direction perpendicular to the extension direction of the support column 23 and also perpendicular to the extension direction of the first beam section 25 (the Y direction in Figures 3 and 4). The second beam section 27 penetrates the support column 23 and is supported by the support column 23. The second beam section 27 is formed to support the display section 10 of the wearable display 1, as will be described later.

[0048] In Figures 3 and 4, the connecting member 24 is formed as a pair of plate-like members, but it can be any shape as long as the length of the portion extending away from the tip of the support column 23 is expandable and contractible, and it does not interfere with the second beam portion 27. For example, the connecting member 24 may be a rod-shaped member provided near the center of the tip of the support column 23.

[0049] Furthermore, although the first beam section 25 and the second beam section 27 are formed as rod-shaped members, they are not limited to this. The first beam section 25 and the second beam section 27 can be formed in any shape, provided that no part of them is included in the detection area of ​​the tracking sensor 10b and depth sensor 10c provided on the wearable display 1 shown in Figure 2.

[0050] The first beam section 25 includes a first support member 25a, a pair of position adjustment members 25b, and a pair of first locking members 25c.

[0051] The first support member 25a is fixed at its central portion by a connecting member 24, and the position of the first support member 25a from the base portion (coordinate in the Z direction) is adjusted to any height by the expansion and contraction of the connecting member 24. The first support member 25a is formed in a cylindrical shape, and at least a portion of a pair of position adjustment members 25b are housed from both ends of the first support member 25a toward the interior of the first support member 25a.

[0052] The pair of position adjustment members 25b are formed as rod-shaped members. The pair of position adjustment members 25b are partially housed inside the first support member 25a, allowing the length of the portion extending away from both ends of the first support member 25a to be extended or retracted. Although not shown, the first support member 25a is equipped with multiple gears, and is configured so that when one of the pair of position adjustment members 25b is extended or retracted by a predetermined distance, the other is also extended or retracted by the same distance. The length of the portion of the pair of position adjustment members 25b extending away from both ends of the support column 23 is kept constant so as not to change with external forces below a predetermined value. The extension or retraction of the pair of position adjustment members 25b is limited, for example, by frictional force acting on the pair of position adjustment members 25b, by a ratchet mechanism, or by fastening members such as pins fixing the pair of position adjustment members 25b to the first support member 25a.

[0053] The pair of first locking members 25c are positioned on the tip side of the pair of position adjusting members 25b, at a certain distance from the tip of each member. The pair of first locking members 25c are formed as plate-shaped members and extend in a direction away from the pair of position adjusting members 25b and the base 21 (the positive Z-axis direction in Figures 3 and 4).

[0054] Of the mounting portion 15 of the wearable display 1 shown in Figure 2, the portion that contacts both sides of the head near the upper part of the user's ears is placed on a pair of position adjustment members 25b at a position outside the pair of first locking members 25c. Furthermore, of the mounting portion 15 of the wearable display 1 shown in Figure 2, the portion that contacts both sides of the head near the upper part of the user's ears contacts the outer surfaces of the pair of first locking members 25c, restricting the movement of the wearable display 1 along the extension direction of the first beam portion 25. Therefore, by providing a pair of first locking members 25c on the first beam portion 25, it is possible to fix the mounting portion 15 of the wearable display 1. In addition, since the height of the first beam portion 25 can be adjusted by adjusting the extension and retraction of the connecting member 24, the overall height of the wearable display 1 can be fixed.

[0055] The second beam section 27 includes a second support member 27a and an extension member 27b.

[0056] The second support member 27a is formed as a rod-shaped member. The second support member 27a penetrates the support column 23 and is formed to be movable in the extension direction of the second support member 27a via the support column 23. The movement of the second support member 27a is restricted, for example, by frictional force acting on the second support member 27a, or by fixing the second support member 27a to the support column 23 with fastening members such as screws.

[0057] The extension member 27b is formed as a rod-shaped member. It is connected to one end of the second support member 27a and extends downward diagonally and forward from the second support member 27a (along the YZ plane in Figure 5, i.e., the W direction in Figure 5). The extension member 27b may be integrally formed with the second support member 27a, or it may be formed as a separate member and fixed by screws or the like.

[0058] A second locking member 29 is positioned on the stretching member 27b. The second locking member 29 is fitted into a slit provided on the front edge of the stretching member 27b and is formed to slide along the front edge of the stretching member 27b. The recessed portion 10a2 of the display portion 10 of the wearable display 1 shown in Figure 2 is placed on the stretching member 27b.

[0059] By providing a second support member 27a on the second beam portion 27, the distance from the support column 23 to the extension member 27b can be adjusted so that the extension member 27b contacts the recessed portion 10a2 of the display portion 10. Furthermore, by placing a second locking member 29 on the extension member 27b, the second locking member 29 can be slid to adjust the vertical tilt of the display portion 10 to any desired tilt. The vertical tilt of the display portion 10 is not limited, but may be horizontal, for example, or tilted in a specific direction in real space.

[0060] Furthermore, with the configuration of the first beam section 25 and the second beam section 27 described above, the wearable display 1 can be adjusted to the position and direction desired by the user, regardless of the type of wearable display 1, thereby improving the user's workability in measuring position coordinates.

[0061] Furthermore, with the configuration of the first beam section 25 and the second beam section 27 described above, the wearable display 1 can be placed on the base without obstructing the front of the front panel 10a1 of the wearable display 1 or the outer periphery of the housing 10a. Therefore, when the wearable display 1 is placed on the base, a decrease in the measurement accuracy of the position coordinates in real space can be prevented, and the error between real space and virtual space can be reduced.

[0062] The base 2 has a shielding member 20. The shielding member 20 is formed to shield the mounting sensor 10d of the display unit 10 which is placed on the second locking member 29, thereby simulating an active state of the wearable display 1.

[0063] The shielding member 20 can be positioned, for example, on the second support member 27a. The shielding member 20 has a shielding portion 20a and a connecting portion 20b. The shielding portion 20a is hinged to the second support member 27a via the connecting portion 20b. By hinged connecting the connecting portion 20b to the second support member 27a, the shielding portion 20a becomes rotatable about the connection point between the second support member 27a and the connecting portion 20b. For example, the shielding portion 20a can rotate in a direction from a state where the shielding portion 20a is in contact with the second support member 27a to a state where the shielding portion 20a is standing upright from the second support member 27a, or in the opposite direction (i.e., the θ direction in Figure 5). By rotating the shielding portion 20a from a state in contact with the second support member 27a to a state where the shielding portion 20a is raised away from the second support member 27a, the attached sensor 10d is shielded. Therefore, the wearable display 1 can be switched from a sleep state to a pseudo-active state.

[0064] Furthermore, by rotating the shielding portion 20a from a position where it is upright relative to the second support member 27a to a position where it is in contact with the second support member 27a, the wearable display 1 can be returned from a pseudo-active state to a sleep state. Therefore, by providing the shielding portion 20 on the base 2, the wearable display 1 can be switched to a pseudo-active state, making it possible to measure coordinates in real space using the wearable display 1 while the wearable display 1 is placed on the base 2. In addition, since the wearable display 1 can be returned from a pseudo-active state to a sleep state, power consumption in the wearable display 1 can be reduced.

[0065] Furthermore, when the shielding portion 20a is standing upright from the second support member 27a, it is preferable that the connecting portion 20b is movable in the vertical direction (the Z-axis direction in Figures 3 and 5). The vertical movement of the connecting portion 20b can be achieved by shaping it so that the connecting portion 20b can be accommodated in the second support member 27a when the shielding portion 20a is standing upright from the second support member 27a. By making the connecting portion 20b movable in the vertical direction, the position of the shielding portion 20a can be adjusted vertically, making it possible to set the wearable display 1 to a pseudo-active state regardless of the type of wearable display 1.

[0066] In Figures 3 and 5, the shielding member 20 is positioned on the second support member 27a, but it can be positioned anywhere on the base 2, as long as it satisfies the condition that it can shield the mounted sensor 10d. For example, the shielding member 20 may be positioned on the first beam 25. Also, in Figures 3 and 5, the shielding part 20a is shown to be rotatable and movable in the vertical direction, but it is not limited to this, as long as it satisfies the condition that it can switch between the active state and the sleep state of the mounted sensor 10d. For example, the shielding part 20a may be rotatable only, or movable only in the vertical direction, or the active state and sleep state of the mounted sensor 10d may be switched by other operating modes.

[0067] Next, the input device 5 for operating the alignment system 100 will be described using Figure 6. Figure 6 is a schematic perspective view showing an example of the input device 5 used in the alignment system 100 according to this embodiment.

[0068] Figure 6 illustrates an input device 5 for operating the wearable display 1. The input device 5 is connected to the wearable display 1 via a wireless connection such as Bluetooth® or a wired connection such as USB.

[0069] The input device 5 includes, for example, an operation unit 50, a sensor unit 55, and a gripping unit 58. The operation unit 50 is used, for example, to operate an object in augmented reality or mixed reality displayed on the wearable display 1. The operation unit 50 includes, but is not limited to, a plurality of buttons 50a for specifying or deselecting an object to operate, and a stick 50b for moving an object. The plurality of buttons 50a and the stick 50b are arranged so that the user can operate the operation unit 50 while gripping the gripping unit 58. The sensor unit 55 includes, for example, a distance sensor that detects the movement of the input device 5.

[0070] The alignment system 100 can be executed by the operation unit 50. For example, the input device 5 is configured so that the alignment system 100 is executed when the user presses button 50a. By enabling the alignment system 100 to be executed by pressing button 50a, the user can easily execute the alignment system 100 with a single touch without having to perform complex actions.

[0071] Furthermore, the input device 5 can employ any other input means other than the input device 5 in Figure 6, as long as it satisfies the condition that the alignment system 100 can be easily executed. For example, an input button may be provided on the housing 10a of the wearable display 1, or an input button may be provided on the base 2 if the base 2 satisfies the condition that it can communicate with the wearable display 1.

[0072] Next, the alignment process in the alignment system 100 according to the embodiment will be explained using Figures 7 to 9. Figure 7 is a functional block diagram showing an example of the alignment system 100 according to the embodiment. Figure 8 is a functional block diagram showing another example of the alignment system 100 according to the embodiment. Figure 9 is a flowchart showing an example of the alignment process in the alignment system 100 according to the embodiment.

[0073] As shown in Figures 7 and 8, the alignment system 100 has a coordinate output unit 60, a storage unit 70, and a coordinate input unit 80 as functional blocks. In Figure 7, the coordinate output unit 60, the storage unit 70, and the coordinate input unit 80 are all provided on the wearable display 1. According to the configuration in Figure 7, the alignment system 100 can be executed using only the wearable display 1. In Figure 8, however, each of the functional blocks, the coordinate output unit 60, the storage unit 70, and the coordinate input unit 80, is provided on a separate device. In the example in Figure 8, the coordinate output unit 60 is provided on an external device 90, the storage unit 70 is provided on the base 2, and the coordinate input unit 80 is provided on the wearable display 1. According to the configuration in Figure 8, distributed processing is possible because the functional blocks are provided on separate devices, and it becomes easy to share and utilize information when setting the position coordinates of multiple wearable displays 1.

[0074] The external device 90 can be any device as long as it is capable of communication, is a device, and is capable of performing calculations. For example, the external device 90 may be a computer such as a cloud computer, a mobile terminal such as a smartphone, or another wearable display 1.

[0075] The coordinate output unit 60 is incorporated as a module into the coordinate input software 65 and is implemented by executing the program of the coordinate input software 65 on the CPU or MPU (Micro Processing Unit) of the wearable display 1 or external device 90. The coordinate input software 65 is software programmed to perform calculations such as image analysis based on data measured by the tracking sensor 10b and depth sensor 10c, and to calculate coordinate information. The coordinate information is acquired according to the placement position of the base 2. The calculated coordinate information is transmitted to the storage unit 70 or the coordinate input unit 80. Furthermore, if the external device 90 is provided with the coordinate output unit 60, the calculated coordinate information may be temporarily stored in the external device 90 for a certain period of time, or it may be deleted after being transmitted to the storage unit 70 or the coordinate input unit 80. In addition, the coordinate output unit 60 may be provided in both the wearable display 1 and the external device 90.

[0076] The memory unit 70 is formed as a non-volatile or volatile semiconductor memory such as RAM, ROM, flash memory, EPROM, or EEPROM. As described above, the memory unit 70 is provided on the wearable display 1 or the base 2. The memory unit 70 receives and stores coordinate information transmitted from the coordinate output unit 60. The memory unit 70 also transmits the stored coordinate information to the coordinate input unit 80. By providing the memory unit 70 in the alignment system 100, the coordinate input unit 80 can read the coordinate information stored in the memory unit 70, eliminating the need to acquire coordinate information again. Therefore, by providing the memory unit 70 in the alignment system 100, the alignment time for the wearable display 1 can be reduced.

[0077] The memory unit 70 may be omitted depending on the application or purpose of the alignment system 100, or it may be provided on both the wearable display 1 and the base 2.

[0078] The coordinate input unit 80 is incorporated as a module into the content software 85 and is implemented by executing the program of the content software 85 on the MPU of the wearable display 1. The content software 85 is software programmed to align the real space and virtual space based on the input coordinates, enabling the experience of augmented reality or mixed reality. The coordinate input unit 80 is configured to receive coordinate information from the coordinate output unit 60 or the storage unit 70.

[0079] By providing a coordinate input unit 80 on the wearable display 1, coordinate information acquired according to the placement position of the base 2 is input to the coordinate input unit 80, thereby enabling accurate alignment between the real space and the virtual space on the wearable display 1.

[0080] The alignment process shown in Figure 9 is generally performed when the user experiences augmented reality or mixed reality. Note that the alignment process in Figure 9 assumes that the coordinate input software 65 and content software 85 are installed and in a state where they can be launched. Furthermore, the alignment process in Figure 9 can be started when the wearable display 1 is in sleep mode; if the main power is off or the battery is low, it will be executed after the power is turned on or the battery is no longer low.

[0081] As shown in Figure 9, in the alignment system 100, in step S1, it is determined whether or not the wearable display 1 is in an active state. As mentioned above, whether or not the wearable display 1 is in an active state is determined based on the detection signal from the attached sensor 10d, and the switching between the active state and the sleep state of the wearable display 1 is performed by the shielding member 20. If the wearable display 1 is not in an active state, i.e., in a sleep state ("No" in step S1), the monitoring state continues until the wearable display 1 becomes active.

[0082] In step S1, if it is determined that the wearable display 1 is in an active state ("Yes" in step S1), the coordinate input software 65 is started in step S2. By starting and running the coordinate input software 65, calculation processing such as image analysis is performed based on the data measured by the tracking sensor 10b and the depth sensor 10c, and coordinate information is calculated. When using the coordinate input software 65 installed on the external device 90, the coordinate input software 65 may be started as a trigger for data transmission from the tracking sensor 10b and the depth sensor 10c, or it may be started manually in advance.

[0083] In step S3, the coordinate information calculated in step S2 is written to the storage unit 70. If coordinate information is stored in the storage unit 70, and the real space and its coordinate information that are the target of augmented reality or mixed reality have not been changed, and the model of the wearable display 1 is substantially the same, the coordinate information stored in the storage unit 70 can be used. Therefore, as described above, if the coordinate information stored in the storage unit 70 can be used, the processing in steps S1 and S2 can be omitted.

[0084] In step S4, the content software 85 is started, and then in step S5, the content software 85 reads coordinate information from the storage unit 70. In step S5, by reading the coordinate information from the storage unit 70, the content software 85 performs alignment between the real space and the virtual space. As described above, steps S4 and S5 can be performed with a single touch, for example, by operating the input device 5.

[0085] Furthermore, in any of steps S1 to S4 while the wearable display 1 is active, the software such as content software or firmware for the wearable display 1 may be added or updated. The addition and updating of software or firmware may be performed automatically or by operating the input device 5. If the addition and updating of the software for the wearable display 1 is performed in any of steps S1 to S4, it can be done simultaneously with the positioning while the wearable display 1 is placed on the base 2, thus reducing the time required to bring the wearable display 1 to the latest and most optimal state.

[0086] In step S5, after the alignment between the real and virtual spaces is performed, the wearable display 1 is removed from the base 2 by the user and attached to the user's head. Once the wearable display 1 is attached to the user's head, the wearable display 1 automatically becomes active.

[0087] In step S6, when the content software 85 is executed, the user can experience augmented reality or mixed reality.

[0088] The execution of the content software 85 in step S6 continues until the wearable display 1 enters a sleep state in step S7 ("No" in step S7). Once the wearable display 1 enters a sleep state, the series of processes ends, the alignment process starts again, and in step S1, the system waits for the wearable display 1 to become active.

[0089] When the wearable display 1 is used for an extended period or frequently, a discrepancy may occur between the real space and the virtual space. However, according to the alignment process of this embodiment, the real space and the virtual space are aligned in the content software 85 each time the display is used. Therefore, according to the alignment process of this embodiment, the user can experience high-precision augmented reality or mixed reality. [Explanation of Symbols]

[0090] 1 Wearable display, 1a Terminal, 2 Base, 2a Terminal, 5 Input device, 10 Display unit, 10a Housing, 10a1 Front panel, 10a2 Recessed part, 10b Tracking sensor, 10c Depth sensor, 10d Mounting sensor, 10e Lens, 15 Mounting part, 20 Shielding member, 20a Shielding part, 20b Connecting part, 21 Base, 23 Support column, 24 Connecting member, 25 First beam unit, 25a First support member, 25b Position adjustment member, 25c First locking member, 27 Second beam unit, 27a Second support member, 27b Extension member, 29 Second locking member, 50 Operation unit, 50a Button, 50b Stick, 55 Sensor unit, 58 Gripping part, 60 Coordinate output unit, 65 Coordinate input software, 70 Memory unit, 80 Coordinate input unit, 85 Content software, 90 External devices, 100 Alignment system.

Claims

1. A positioning system for a wearable display that aligns the real space with the virtual space, A base on which the wearable display is placed, The coordinate input unit provided in the wearable display and Equipped with, The coordinate input unit is configured to receive coordinate information for alignment, corresponding to the placement position of the base. Alignment system.

2. The wearable display has a wearable sensor that switches between an active state and a sleep state. The base has a shielding member that shields the attached sensor and activates the wearable display. The alignment system according to claim 1.

3. A storage unit provided in the wearable display or the base for storing the coordinate information. Furthermore, The coordinate input unit is configured to receive the coordinate information from the storage unit. The alignment system according to claim 1 or 2.

Images