Controller

Abstract

This controller includes: a body attached to a hand of a user; an operation part attached to the body and operated by a finger of the user; and a holding part attached to the body and removably holding the operation part in such a manner as to enable the operation part to move by magnetic force between a first region operable by the finger of the user and a second region outside the first region.

Description

controller

[0001] The present invention relates to a controller.

[0002] A controller is used as a device for inputting commands to an object. A controller may be used to operate a device in physical space. A controller may also be used to operate an object in cyberspace. For example, a controller may be used to move a character in a game (see, for example, Patent Document 1). A controller may be used to move a character or a device in a learning or training simulator. Such controllers may require improved operability. For example, in fields such as virtual reality (VR), augmented reality (AR), and mixed reality (MR), improving the operability of the controller is expected to increase the sense of immersion and improve the quality of the experience provided to the user.

[0003] JP 2023-68664 A

[0004] According to one aspect of the present invention, there is provided a controller comprising: a body to be worn on a user's hand; an operating unit attached to the body and operated by the user's fingers; and a holding unit attached to the body and movably and detachably holding the operating unit by magnetic force between a first area operable by the user's fingers and a second area outside the first area.

[0005] According to an aspect of the present invention, there is provided a controller comprising: a body to be worn on a user's hand; an operating unit attached to the body and operated by the user's finger; a holding unit attached to the body and holding the operating unit movably between a first area operable by the user's finger and a second area outside the first area; and a positioning unit that regulates the position of the operating unit located at a first position in the first area.

[0006] According to an aspect of the present invention, there is provided a controller comprising: a body worn on a user's hand; an operation unit attached to the body and operated by the user's finger; a holding unit attached to the body and holding the operation unit movably between a first area operable by the user's finger and a second area outside the first area; and a processing unit that compares the detection result, detected by a sensor, of the position of the user's finger operating the operation unit with a preset position of the operation unit.

[0007] In the controller of the above aspect, the positioning unit may include a first positioning member that restricts movement of the operation unit located at a first position in the first region. The positioning unit may also include a second positioning member that restricts movement of the operation unit located at a second position in the second region. The controller may also include a guide that guides movement of the operation unit between the first region and the second region. The operation unit may rotate around a predetermined axis to move between the first region and the second region, and the guide may allow movement of the operation unit in a direction parallel to the predetermined axis and restrict movement of the operation unit in a direction perpendicular to the predetermined axis. The positioning unit may also be configured to restrict the position of the operation unit located at the first position in the first region using magnetic force. The controller may also be configured to include a detection unit that detects whether the operation unit is located in the first region. The holding unit may also be configured to be located on the back of the user's hand, the first region being a region between the user's thumb and fingers other than the thumb, and the second region being a region on the back of the user's hand. The holding unit may be configured to hold the operation unit rotatably around a predetermined axis. The controller may be configured to include a connecting member that maintains a distance between the operation unit and the holding unit at or below a predetermined value and connects the operation unit to the body. The controller may be configured to include an adjustment unit that adjusts the relative position between the body and the holding unit. The controller may also be configured to include a sensor provided on the body that detects the position of the user's finger, and the operation unit may be configured to accept input that changes content displayed in cyberspace using the detection result of the sensor.

[0008] According to an aspect of the present invention, a novel controller can be provided. This controller contributes to improving operability in, for example, XR. This aspect of the present invention can be used, for example, in learning experiences using XR, and contributes to achieving Goal 4 of the United Nations-led Sustainable Development Goals (SDGs): "Ensure inclusive and equitable quality education and promote lifelong learning opportunities for all."

[0009] Fig. 1 is a diagram showing an experience system according to an embodiment. Fig. 2 is a diagram showing a controller according to an embodiment. Fig. 3 is a diagram showing a connection between an operation unit and a holding unit according to an embodiment. Fig. 4 is a diagram showing a controller according to an embodiment. Fig. 5 is a diagram showing an operation unit and a holding unit in a detached state according to an embodiment. Fig. 6 is a diagram showing a controller according to an embodiment.

[0010] [Explanation of the Invention] [Explanation of the Invention] Fig. 1 is a diagram showing an experience system to which a controller according to an embodiment is applied. The experience system SYS includes a controller 1, a display device 2, and an information processing device 3.

[0011] The information processing device 3 includes, for example, a computer. The information processing device 3 provides image data to the display device 2. The display device 2 includes, for example, a head-mounted display. The display device 2 presents an image to the user 5 in real space using the image data provided from the information processing device 3. The controller 1 is operated by the user 5. The controller 1 detects that the controller 1 has been operated, and provides the detection result to the information processing device 3. The information processing device 3 generates an image using the detection result provided by the controller 1, and provides the image data to the display device 2.

[0012] For example, the user 5 can operate the controller 1 while viewing an image displayed on the display device 2, thereby making changes to the image. For example, content including an object 10 (e.g., an avatar or character of the user 5) is displayed on the display device 2. The user 5 can move the object 10 displayed on the display device 2 by operating the controller 1.

[0013] The controller 1 includes a body 6 and an operation unit 9. The body 6 is worn on the hand of a user 5 in real space. The body 6 has, for example, a shape that covers at least a portion of the hand of the user 5 (appropriately referred to as a glove shape). The operation unit 9 is attached to the body 6. The operation unit 9 is operated, for example, by the fingers of the user 5. The operation unit 9 includes, for example, a joystick and button switches, and detects that the device itself has been operated. For example, the operation unit 9 detects that the joystick has been moved, the direction in which the joystick has been moved, and that the button switch has been pressed.

[0014] The controller 1 outputs the detection result of the operation unit 9 to the outside. The detection result of the operation unit 9 is, for example, pre-associated with a command that causes the information processing device 3 to execute a predetermined process. The controller 1 may process the detection result of the operation unit 9 and output the processing result to the outside. For example, the controller 1 may convert the detection result of the operation unit 9 into a signal (for example, a command) and output the converted signal to the information processing device 3.

[0015] The controller 1 of this embodiment includes a sensor 8. The sensor 8 constitutes, for example, a finger tracker. The sensor 8 repeatedly detects physical quantities related to the position of the finger of the user 5. For example, the body 6 deforms in accordance with the movement of the finger of the user 5, and the sensor 8 detects the movement of the finger of the user 5 by detecting the deformation of the body 6. For example, the sensor 8 detects the bending of the joints of the finger of the user 5. The controller 1 calculates the position of the finger using the detection result of the sensor 8. For example, the controller 1 detects the movement of the finger by deriving the change over time in the position of the finger calculated from the detection result of the sensor 8.

[0016] The controller 1 provides the calculation result of the finger position to the information processing device 3. The information processing device 3 generates image data using the finger position provided by the controller 1. For example, when a user in real space bends their finger, the information processing device 3 generates image data including an avatar with their finger bent. The information processing device 3 provides image data based on the finger position to the display device 2. The display device 2 displays an image using the image data provided by the information processing device 3. For example, when the user 5 bends their finger, the display device 2 presents the user 5 with an image including an avatar with their finger bent.

[0017] The sensor 8 includes a deformable member whose electrical characteristics (e.g., resistance value) change with deformation. The deformable member is, for example, a strain gauge. The deformable member is attached to the body 6 so that it deforms in response to finger movement (e.g., bending of a joint). The sensor 8 detects finger movement as the electrical characteristics of the deformable member change with finger movement.

[0018] The detection result of the sensor 8 is used, for example, as input to an external device. For example, a predetermined finger movement (e.g., a gesture) is associated in advance with a predetermined command. In the following description, a command associated with the detection result of the sensor 8 is referred to as a gesture command, as appropriate. When the detection result of the sensor 8 indicates a predetermined finger movement, the controller 1 outputs a gesture command associated with this finger movement to the external device.

[0019] The gesture command may be the same as the command associated with an operation on the operation unit 9. In the following description, a command associated with a detection result of the operation unit 9 will be referred to as an operation command as appropriate. A predetermined process executed by the experience system SYS may be associated with a predetermined gesture command and also associated with a predetermined operation command. For example, when the function of the operation unit 9 is enabled (e.g., the operation unit 9 is on), the operation command may be enabled and the gesture command may be disabled. For example, when the function of the operation unit 9 is disabled (e.g., the operation unit 9 is off), the operation command may be disabled and the gesture command may be enabled.

[0020] Gesture commands may be associated with commands in a different category from operation commands. Gesture commands are commands for operating operation targets including, for example, one or both of objects in real space and objects in cyberspace, and the operation targets of gesture commands may be different from those of operation commands. For example, gesture commands may be associated with commands for images displayed on the display device 2 (e.g., switching the rendering viewpoint or switching between display and non-display), and operation commands may be associated with commands for objects included in the images displayed on the display device 2 (e.g., movement or action of an avatar).

[0021] The sensor 8 may not include a deformable member. For example, the sensor 8 may analyze an image of the finger of the user 5 and detect changes in the shape of the finger (e.g., bending of the finger), or may use other measurement principles. The controller 1 may not include the sensor 8. The sensor 8 may be an external device to the controller 1. The controller 1 may not calculate the position of the finger, and may output the detection result of the sensor 8 to an external device (e.g., the information processing device 3). This external device may calculate the position of the finger using the detection result of the sensor.

[0022] The controller 1 of this embodiment includes an actuator 7. The actuator 7 constitutes, for example, a haptic device. The haptic device presents a tactile sensation to the user 5. For example, when the user's avatar touches an object in cyberspace, the actuator 7 applies a force to the finger of the user 5 in real space, presenting the user 5 with a tactile sensation corresponding to touching the object in cyberspace. Cyberspace is a space represented by data (referred to as a virtual space as appropriate). Cyberspace may also include a space modeled after physical space (referred to as a real space or actual space as appropriate).

[0023] When the controller 1 presents a haptic sensation, the information processing device 3 determines whether or not the object 10 and the object 11 in cyberspace have come into contact. If the information processing device 3 determines that the object 10 and the object 11 in cyberspace have come into contact, the information processing device 3 generates a control signal for operating the actuator 7 and provides this control signal to the controller 1. The controller 1 drives the actuator 7 using the control signal provided from the information processing device 3. The actuator 7 applies a force to the hand of the user 5, for example, by bringing a part of the body 6 into contact with the hand of the user 5. This force presents the user 5 with a haptic sensation corresponding to the state of touching the object 11. The user 5 can experience, for example, the sensation of touching the object 11 in cyberspace.

[0024] First Embodiment Next, a controller according to the first embodiment will be described. Fig. 2 is a view of the controller 1 as seen from the back of the hand. The back of the hand is the surface that faces outward when the hand is clenched, and the palm is the surface that faces inward when the hand is clenched. In this embodiment, when the hand is open with fingers extended, the palm and back of the hand are each considered to be flat surfaces, and the palm and back of the hand are considered to be parallel to each other.

[0025] In the following description, an XYZ Cartesian coordinate system shown in FIG. 2 and the like will be referenced as appropriate. In this XYZ Cartesian coordinate system, the X direction is the width direction of the finger, the Y direction is the length direction of the finger, and the Z direction is the thickness direction of the finger. The length direction of the finger is a direction parallel to the line connecting the base and tip of the middle finger when the finger is stretched out and touching the adjacent fingers. The width direction of the finger is a direction parallel to the palm and perpendicular to the length direction of the fingers. The width direction of the finger corresponds to the direction in which the index finger, middle finger, ring finger, and little finger are lined up when the finger is stretched out and touching the adjacent fingers. The thickness direction of the hand is a direction perpendicular to the palm. The thickness direction of the hand corresponds to the direction perpendicular to the length direction of the fingers and perpendicular to the width direction of the fingers.

[0026] The controller 1 shown in Fig. 2 is a device that receives input from a user 5. The controller 1 is a device that is operated by the user 5 to input commands to an operation target. The target investigated by the controller 1 is arbitrary and may include an object in real space, or at least a portion of content in cyberspace (e.g., an avatar, a character, or a tool).

[0027] The controller 1 comprises a body 6, an operation unit 9, a holding unit 12, and a processing unit 14. The body 6 is worn on the hand of the user 5. At least some of the components of the controller 1 are attached to the body 6. The body 6 supports at least some of the components of the controller 1. The body 6 is, for example, glove-shaped and covers at least part of the hand of the user 5. The position of at least part of the controller 1 relative to the hand of the user 5 is determined by wearing the body 6 on the hand of the user 5. The body 6 does not have to be glove-shaped, and the shape of the body 6 is arbitrary.

[0028] The processing unit 14 is disposed, for example, in a region on the back of the hand on the body 6. The processing unit 14 is disposed, for example, between the base of the finger (for example, the position of the MP joint of a finger other than the thumb) and the wrist in the lengthwise direction of the finger. The processing unit 14 is disposed, for example, between the index finger and the little finger in the widthwise direction of the finger. For example, the processing unit 14 is disposed in the center between the index finger and the little finger in the widthwise direction of the finger (for example, a region including the center). The controller 1 is used with the processing unit 14 fixed to the body 6. The processing unit 14 may be detachable from the body 6 or may not be detachable from the body 6. The processing unit 14 may be replaceably provided on the body 6.

[0029] The processing unit 14 appropriately processes data output from each part of the controller 1 and outputs the data to an external device. For example, the processing unit 14 processes the detection results of the operation unit 9 and outputs the processing results to the information processing device 3. For example, the processing unit 14 outputs data defining one or both of the position and shape of the finger of the user 5 as the detection result of the operation unit 9 to the information processing device 3. The processing unit 14 appropriately processes information input from an external device and outputs the data to each part of the controller 1. For example, the processing unit 14 acquires, from the information processing device 3, a control signal defining a tactile sensation to be presented to the user 5, generates a drive signal for the actuator 7 based on this control signal, and outputs this drive signal to the actuator 7. The processing unit 14 includes a memory unit that stores information required for processing executed in the controller 1. The processing unit 14 includes a communication unit that communicates with external devices.

[0030] 3 is a diagram of the controller 1 viewed from the thumb side of the hand with the operation unit 9 arranged in the first region R1. As shown in FIG. 3, the operation unit 9 is a device (appropriately referred to as an input device) that accepts input from the user 5. The operation unit 9 includes at least one input unit (appropriately referred to as an input member), such as a joystick, a button, a cross key, a touchpad, a wheel, or a dial. The input member of the operation unit 9 is operated by the fingers of the user 5. For example, the operation unit 9 is supported by the index finger and operated by the thumb. The operation unit 9 may be operated by a finger other than the thumb, or may be operated by multiple fingers.

[0031] The operation unit 9 outputs a signal when operated by the user 5. The operation unit 9 detects the movement of an input member. For example, the operation unit 9 detects the displacement of a joystick (e.g., the tilt from a reference position). For example, the operation unit 9 detects whether a button is pressed down or not. The operation unit 9 outputs the detection result of the detected movement of the input member to the processing unit 14. For example, the operation unit 9 is connected to the processing unit 14 by a cable (e.g., a connection member 26) and provides the detection result to the processing unit 14 via the cable. The operation unit 9 may be connected to the processing unit 14 so as to be able to communicate wirelessly, and may provide the detection result to the processing unit 14 via this communication.

[0032] The operation unit 9 is attached directly or indirectly to the body 6. In this embodiment, the operation unit 9 is attached indirectly to the body 6 via the holding unit 12, the adjustment unit 15, and the processing unit 14. In this embodiment, the operation unit 9 is supported by the body 6 via the holding unit 12, the adjustment unit 15, and the processing unit 14. The adjustment unit 15 is attached to the processing unit 14 fixed to the body 6, for example. The holding unit 12 is attached to the adjustment unit 15 fixed to the processing unit 14, for example. The operation unit 9 is attached to the holding unit 12 fixed to the adjustment unit 15, for example. For example, the holding unit 12, the adjustment unit 15, and the processing unit 14 are assembled in advance and integrated with the body 6.

[0033] The holding unit 12 is attached to the body 6. The holding unit 12 is attached to the processing unit 14 via an adjustment unit 15 (see FIG. 2 ). For example, the adjustment unit 15 is supported by the processing unit 14 at its end on the wrist side in the finger length direction. For example, the adjustment unit 15 protrudes from the processing unit 14 toward the thumb side in the finger width direction, and supports the holding unit 12 at its end on the thumb side in the finger width direction. The adjustment unit 15 adjusts the relative position between the holding unit 12 and the body 6. The adjustment unit 15 adjusts the relative position between the holding unit 12 and the body 6 in at least one of the finger width direction, the finger length direction, and the hand thickness direction. The adjustment unit 15 is sometimes called a spacer or adapter. For example, the adjustment unit 15 is attached to the processing unit 14 in an exchangeable manner, and multiple members of different sizes are provided as the adjustment unit 15. The user can adjust the relative position between the holding unit 12 and the processing unit 14 by selecting an adjustment unit 15 from multiple members.

[0034] The adjustment unit 15 does not have to be replaceable, and may be movable relative to the processing unit 14 using a mechanism such as a slider. For example, the adjustment unit 15 and the processing unit 14 may be switchable between a locked state in which their relative positions are fixed and an unlocked state in which their relative positions are variable. A user can adjust the relative positions of the processing unit 14 and the adjustment unit 15 in the unlocked state and set the relative positions of the processing unit 14 and the adjustment unit 15 by switching to the locked state. The adjustment unit 15 may be fixed in its relative position to the processing unit 14 and adjustable in its relative position to the holding unit 12. The method for adjusting the relative positions of the holding unit 12 and the adjustment unit 15 may utilize, for example, the above-described locked state and unlocked state.

[0035] The holding unit 12 is attached to the body 6, for example, via the processing unit 14 and the adjustment unit 15. The holding unit 12 is, for example, arranged outside the range of motion of the fingers. The holding unit 12 is, for example, arranged in a position that does not come into contact with the thumb and index finger. For example, the holding unit 12 is arranged in an area on the back of the hand. For example, the holding unit 12 is arranged closer to the wrist than the third joint of the index finger.

[0036] The holding unit 12 holds the operation unit 9 rotatably around a predetermined axis AX1, for example. Fig. 4 is a diagram showing a connection between the operation unit 9 and the holding unit 12. Fig. 4(A) is a diagram showing the operation unit 9 and the holding unit 12 connected to each other (see Fig. 2). Fig. 4(B) is a diagram showing the operation unit 9 and the holding unit 12 in a disconnected state. The connection between the operation unit 9 and the holding unit 12 includes, for example, a hinge structure. The operation unit 9 includes a connection unit 19 that contacts the holding unit 12. The holding unit 12 includes a connection unit 20 that contacts the operation unit 9.

[0037] The connecting portion 19 and the connecting portion 20 have shapes that allow them to fit together. For example, the connecting portion 19 is a cylindrical shape with a bottom and a recess, and the connecting portion 20 is a columnar shape that fits into the recess of the connecting portion 19. The inner wall 19A of the connecting portion 19 has a shape that is rotationally symmetrical about the axis AX1. The outer wall 20A of the connecting portion 20 has a shape that is rotationally symmetrical about the axis AX1. The diameter of the inner circumference of the connecting portion 19 in a plane perpendicular to the axis AX1 and the diameter of the outer circumference of the connecting portion 20 in a plane perpendicular to the axis AX1 are set, for example, so that the operating portion 9 can rotate without getting caught when the operating portion 9 and the holding portion 12 are fitted together.

[0038] FIG. 5 is a view of the controller 1 from the thumb side of the hand, with the operation unit 9 positioned in the second region R2. The holding unit 12 holds the operation unit 9 movably between a first region R1 (see FIG. 3 ) operable by the fingers of the user 5 and a second region R2 outside the first region R1. The first region R1 is, for example, the region between the thumb and fingers other than the thumb of the user 5. For example, the first region R1 is the region between the thumb and index finger of the user 5. For example, the first region R1 is the region operable by at least the thumb of the user 5. The second region R2 is, for example, the region on the back of the hand of the user 5. The operation unit 9 rotates around the axis AX1 as described in FIG. 4 to move between the first region R1 and the second region R2. The axis AX1 is, for example, a direction parallel to the width direction of the fingers.

[0039] In this embodiment, the inner wall 19A (see FIG. 4 ) of the connection portion 19 constitutes a guide. The guide guides the movement of the operating unit 9 between the first region R1 and the second region R2. In this embodiment, the operating unit 9 rotates around a predetermined axis AX1 to move between the first region R1 (see FIG. 3 ) and the second region R2, and the guide allows the operating unit 9 to move in a direction parallel to the axis AX1 and restricts the movement of the operating unit 9 in a direction perpendicular to the predetermined axis AX1. The guide defines the movement path of the operating unit 9 when the operating unit 9 is engaged with the holding portion 12 and rotates.

[0040] The inner wall 19A (see FIG. 4 ) does not hinder (or, as appropriate, allows) the relative movement between the connection portion 19 and the connection portion 20 in a direction parallel to the axis AX1. The inner wall 19A limits the relative movement between the connection portion 19 and the connection portion 20 in a direction perpendicular to the axis AX1 (or, as appropriate, a radial direction of the axis AX1). For example, when the operation unit 9 moves relative to the holding unit 12 in the radial direction of the axis AX1, the inner wall 19A comes into contact with the outer wall 20A, and the relative movement is limited beyond the gap between the inner wall 19A and the outer wall 20A. The gap between the inner wall 19A and the outer wall 20A is set so as to suppress the misalignment between the center of the inner periphery of the recess of the connection portion 19 and the center of the outer periphery of the connection portion 20 in a plane perpendicular to the axis AX1 to within a predetermined tolerance.

[0041] In this embodiment, the holding unit 12 detachably holds the operation unit 9. In the following description, the state in which the operation unit 9 is held by the holding unit 12 will be referred to as an attached state, and the state in which the operation unit 9 is released from the attached state will be referred to as a detached state. In this embodiment, the ability to switch between the attached state and the detached state is referred to as detachable.

[0042] FIG. 6 is a diagram showing the operation unit and the holder in a detached state. The holder 12, for example, attracts and holds the operation unit 9 by magnetic force. As shown in FIG. 4, the connection portion 19 of the operation unit 9 includes a magnet 19B. The connection portion 20 of the holder 12 includes a magnet 20B. The magnets 19B and 20B are arranged so that the magnets 19B and 20B attract each other when the operation unit 9 and the holder 12 are in a predetermined positional relationship. For example, the magnets 19B and 20B are arranged so that they overlap each other when viewed from the direction of the axis AX1 when the operation unit 9 is positioned in the first region R1 as shown in FIG. 3.

[0043] The magnet 19B is disposed, for example, at the bottom including the bottom surface of the recess in the connection portion 19. The magnet 19B is, for example, embedded in the bottom of the connection portion 19 so as not to protrude from the bottom surface of the connection portion 19. For example, a plurality of magnets 19B are provided and are disposed discretely in the connection portion 19. The number of magnets 19B is arbitrary and may be one.

[0044] The magnet 20B is arranged, for example, at an end including the end face of the connection part 20. The end face of the connection part 20 is, for example, a surface perpendicular to the axis AX1. The end face of the connection part 20 is a surface arranged opposite the bottom surface of the recess of the connection part 20. The magnet 20B is, for example, embedded in the end of the connection part 20 so as not to protrude from the end face of the connection part 20. For example, multiple magnets 20B are provided and arranged discretely in the connection part 20. The number of magnets 20B is arbitrary and may be one.

[0045] The operating unit 9 is attracted to the holding unit 12 by the attractive force between the magnets 19B and 20B and is held by the holding unit 12. When the distance between the magnets 19B and 20B becomes equal to or greater than a threshold, the attractive force between the magnets 19B and 20B falls below the force required to support the operating unit 9, and the operating unit 9 enters a detached state. Note that instead of the magnet 19B or the magnet 20B, an object that sticks to the magnet may be provided. One or both of the magnets 19B and 20B may be a permanent magnet or an electromagnet.

[0046] In this embodiment, magnet 19B and magnet 20B constitute a positioning portion. The positioning portion regulates the position of the operation unit 9 disposed in the first region R1 (see FIG. 3). In the following description, the state in which the operation unit 9 is disposed at the first position P1 in the first region R1 (see FIG. 3) will be referred to as the operable state, as appropriate. Magnets 19B and 20B according to this embodiment are each discretely disposed, and are disposed so as to overlap each other when viewed from the direction of axis AX1 in the operable state in which the operation unit 9 is disposed in the first region R1. In the following description, magnet 20B, which overlaps with magnet 19B when viewed from the direction of axis AX1 in the operable state, will be referred to as the first magnet 20B, as appropriate.

[0047] The attractive force between magnet 19B and first magnet 20B is maximized in the operable state. When the angle at which operation unit 9 rotates from the operable state is less than a first angle, operation unit 9 rotates to return to the operable state due to the attractive force between magnet 19B and first magnet 20B, and the relative position of operation unit 9 with respect to holding unit 12 becomes stable in the operable state. In this way, magnet 19B and first magnet 20B constitute a first positioning member that restricts movement of operation unit 9 disposed at first position P1 in first region R1.

[0048] The first angle is an angle (e.g., a small angle) at which the attractive force between the magnet 19B and the first magnet 20B becomes a restoring force that returns the controller 9 to the operable state. In the following description, angles equal to or greater than the first angle are referred to as second angles. When the operation unit 9 is rotated by the second angle from the operable state, the attractive force between the magnet 19B and the first magnet 20B falls below the force required to return the controller 9 to the operable state, and the restriction on the position of the operation unit 9 is released. In this state, the restriction on movement of the operation unit 9 is released, and the operation unit 9 can move from the first region R1 toward the second region R2. For example, the user 5 can move the operation unit 9 from the first region R1 by waving the hand wearing the controller 1. The user 5 may also move the operation unit 9 with the hand opposite the hand wearing the controller 1.

[0049] When the operation unit 9 is rotated from the operable state by a third angle greater than the second angle, the operation unit 9 is disposed at a second position P2 in the second region R2 (see FIG. 5 ). In the following description, the state in which the operation unit 9 is disposed at the second position P2 in the second region R2 (see FIG. 5 ) is referred to as an inoperable state as appropriate. When viewed from the direction of the axis AX1 in the inoperable state, the magnet 19B is disposed at a position overlapping with a magnet 20B (referred to as a second magnet 20B) that is different from the first magnet 20B among the multiple magnets 20B.

[0050] In this embodiment, the magnet 19B and the magnet 20B regulate the position of the operation unit 9 disposed in the second region R2 (see FIG. 5 ). The attractive force between the magnet 19B and the second magnet 20B is maximized in the inoperable state. When the operation unit 9 rotates from the inoperable state by less than the first angle, the attractive force between the magnet 19B and the second magnet 20B causes the operation unit 9 to rotate back to the inoperable state, and the relative position of the operation unit 9 with respect to the holding unit 12 becomes stable in the inoperable state. In this way, the magnet 19B and the second magnet 20B constitute a second positioning member that regulates the movement of the operation unit 9 disposed in the second position P2 in the second region R2.

[0051] When the operation unit 9 is rotated by the second angle from the inoperable state, the attractive force between the magnet 19B and the second magnet 20B falls below the force required to return the operation unit 9 to the inoperable state, and the restriction on the position of the operation unit 9 is released. In this state, the restriction on movement of the operation unit 9 is released, and the operation unit 9 can move from the second region R2 toward the first region R1. For example, the user 5 can move the operation unit 9 from the second region R2 by waving the hand wearing the controller 1. The user 5 may also move the operation unit 9 with the hand opposite the hand wearing the controller 1.

[0052] In this embodiment, the controller 1 includes a detection unit 22 that detects information related to the position of the operation unit 9. The detection unit 22 detects, for example, one or both of an attached state and a detached state. The detection unit 22 detects, for example, whether the operation unit 9 is located in the first region R1. The detection unit 22 detects, for example, whether the operation unit 9 is located in the second region R2. The detection unit 22 is, for example, a sensor that detects the position of an object.

[0053] The detection unit 22 includes, for example, a magnetic sensor 22A shown in FIG. 4B . The magnetic sensor 22A detects the magnetic force of a magnet 19B provided on the connection portion 19 of the operation unit 9. FIG. 4B corresponds to the state in which the operation unit 9 is disposed in the first region R1 (see FIG. 3 ). In this state, the magnet 19B is positioned so as not to overlap with the magnetic sensor 22A when viewed from the direction of the axis AX1. In this state, the strength of the magnetic force detected by the magnetic sensor 22A is less than the threshold value. In the state in which the operation unit 9 is disposed in the second region R2 (see FIG. 5 ), the magnet 19B rotates around the axis AX1 from the position shown in FIG. 4B and is positioned so as to overlap with the magnetic sensor 22A when viewed from the direction of the axis AX1. In this state, the strength of the magnetic force detected by the magnetic sensor 22A is greater than or equal to the threshold value. The detection unit 22 detects the position of the operation unit 9, for example, based on the strength of the detected magnetic force.

[0054] Note that the magnetic sensor 22A may be disposed in place of one magnet 20B. In this case, the magnetic force detected by the magnetic sensor 22A is equal to or greater than the threshold when the operation unit 9 is disposed in the first region R1 (see FIG. 3 ), and is less than the threshold when the operation unit 9 is not disposed in the first region R1. The state in which the operation unit 9 is not disposed in the first region R1 includes, for example, a state in which the user 5 cannot operate the operation unit 9 with their fingers. The state in which the operation unit 9 is not disposed in the first region R1 includes, for example, a state in which the operation unit 9 is disposed in the second region R2 (see FIG. 5 ) and a state in which the operation unit 9 is detached from the holder 12.

[0055] As shown in FIG. 5 , the controller 1 according to this embodiment includes a processing unit 24. The processing unit 24 executes a preset process based on the detection result of the detection unit 22. For example, if the detection unit 22 detects that the operation unit 9 is not located in the first region R1, the processing unit 24 invalidates the signal output from the operation unit 9. For example, if the detection unit 22 detects that the operation unit 9 is not located in the first region R1, the processing unit 24 prohibits the processing unit 14 from providing the detection result of the operation unit 9 to the outside. If the detection unit 22 detects that the operation unit 9 is located in the second region R2, the processing unit 24 may invalidate the signal output from the operation unit 9.

[0056] If the experience system SYS shown in FIG. 1 includes a finger tracker (e.g., sensor 8), the processing unit 24 may compare the position of the user's 5 finger estimated from the detection result of the detection unit 22 with the position of the user's 5 finger detected by the tracker. For example, the processing unit 24 uses the detection result of the operation unit 9 to determine whether the operation unit 9 is being operated. If it is determined that the operation unit 9 is being operated by the user 5 and the detection unit 22 detects that the operation unit 9 is located at the first position P1 (see FIG. 3 ) in the first region R1, it is estimated that the user's 5 finger is located at the position of the input member of the operation unit 9. In this case, the processing unit 24, for example, compares the finger position detected by the tracker with a set value for the position of the input member.

[0057] The processing unit 24 outputs an alert, for example, when the difference between the finger position detected by the tracker and the set value of the position of the input member exceeds an allowable range. When the processing unit 24 outputs an alert, the experience system SYS (e.g., the information processing device 3) may notify the user 5 of the abnormality or may restrict the function of a part of the experience system SYS (e.g., the tracker, the controller 1). When the processing unit 24 outputs an alert, the experience system SYS (e.g., the information processing device 3) may perform calibration of a part of the experience system SYS (e.g., the tracker, the controller 1). For example, the information processing device 3 may adjust parameters used to calculate the finger position in the tracker so that the detection result of the tracker matches the finger position of the user 5 estimated from the detection result of the detection unit 22.

[0058] The controller 1 according to this embodiment includes a connecting member 26, as shown in FIG. 5 and other figures. The connecting member 26 directly or indirectly connects the operation unit 9 to the body 6. The connecting member 26 maintains the distance between the operation unit 9 and the holding unit 12 at or below a predetermined value. The connecting member 26 is, for example, string-like and regulates the distance between the operation unit 9 and a connection destination (e.g., the body 6) to be equal to or less than the length of the connecting member 26. The connecting member 26 connects the operation unit 9 to the body 6 while allowing the operation unit 9 to move between the first region R1 and the second region R2. The connecting member 26 has flexibility that allows it to deform in response to the movement of the operation unit 9 between the first region R1 and the second region R2. By maintaining the distance between the operation unit 9 and the holding unit 12 at or below a predetermined value, the connecting member 26 reduces the probability that the detached operation unit 9 will collide with an object. For example, the operation unit 9 may become detached due to a collision force, and the connecting member 26 prevents the operation unit 9 from flying into a wall or floor.

[0059] The connection member 26 is, for example, a cable having a conductive portion therein, and is connected to the processing unit 14 fixed to the body 6. The connection member 26 may include wiring that transmits power supplied to the operation unit 9. The connection member 26 may include signal lines that transmit input / output signals of the operation unit 9. The connection member 26 does not have to be a cable, and a cable that electrically connects the processing unit 14 and the operation unit 9 may be provided separately from the connection member 26.

[0060] As described above, a controller according to an embodiment includes a body worn on a user's hand, an operation unit attached to the body and operated by the user's finger, and a holder attached to the body that magnetically holds the operation unit between a first region operable by the user's finger and a second region outside the first region in a movable and detachable manner. Because the operation unit is movable between the first region and the second region and detachably held by magnetic force, this controller can easily switch between a state in which the user can operate the operation unit and a state in which the operation unit does not interfere with the movement of the user's finger, contributing to improved operability. The controller does not need to include a positioning unit that restricts the position of the operation unit located in the first region, which still contributes to improved operability. The controller does not need to include a processing unit that compares the position of the user's finger operating the operation unit, detected by a sensor, with a preset position of the operation unit, which still contributes to improved operability.

[0061] As described above, a controller according to an embodiment includes a body worn on a user's hand, an operation unit attached to the body and operated by the user's finger, a holding unit attached to the body and configured to movably hold the operation unit between a first region operable by the user's finger and a second region outside the first region, and a positioning unit configured to restrict the position of the operation unit located in the first region. This controller contributes to improved operability because the operation unit is movable between the first region and the second region and the position of the operation unit located in the first region is restricted. The operation unit does not need to be detachably held in the controller, and this also contributes to improved operability. The controller does not need to include a processing unit that compares the detection result, obtained by a sensor, of the position of the user's finger operating the operation unit with a preset position of the operation unit, and this also contributes to improved operability.

[0062] As described above, a controller according to an embodiment includes a body worn on a user's hand, an operation unit attached to the body and operated by the user's finger, a holding unit attached to the body and configured to movably hold the operation unit between a first region operable by the user's finger and a second region outside the first region, and a processing unit that compares a detection result, detected by a sensor, of the position of the user's finger operating the operation unit with a preset position of the operation unit. Because this controller compares a detection result, detected by the sensor, of the position of the user's finger operating the operation unit with a preset position of the operation unit, it is possible to perform, for example, positional calibration, thereby contributing to improved operability through improved positional accuracy. The operation unit does not need to be detachably held on the controller, and this still contributes to improved operability. The controller does not need to include a positioning unit that restricts the position of the operation unit located in the first region, and this still contributes to improved operability.

[0063] The controller may include a positioning unit that restricts the position of the operation unit disposed in the first region, and the positioning unit may include a first positioning member that restricts movement of the operation unit disposed at a first position in the first region. This restricts movement of the operation unit when the user is able to operate the operation unit, thereby stabilizing the state in which the operation unit is operable, for example, contributing to improved operability. The controller may include a positioning unit that restricts the position of the operation unit disposed in the second region, and the positioning unit may include a second positioning member that restricts movement of the operation unit disposed at a second position in the second region. This restricts movement of the operation unit when the user is unable to operate the controller, thereby avoiding the operation unit interfering with other user operations, for example, contributing to improved operability. The controller may include a positioning unit that restricts the position of the operation unit disposed in the first region, and the positioning unit may restrict the position of the operation unit disposed at the first position in the first region using magnetic force. This controller, for example, can achieve both stability in attachment / detachment and stability in movement, contributing to improved operability.

[0064] The controller may include a guide that guides movement of the operating unit between the first region and the second region. The operating unit may rotate around a predetermined axis to move between the first region and the second region, and the guide may allow movement of the operating unit in a direction parallel to the predetermined axis and restrict movement of the operating unit in a direction perpendicular to the predetermined axis. This controller, for example, can stably switch between an operable state and an inoperable state, contributing to improved operability. Furthermore, if the operating unit is detachably held, for example, stability in attachment and detachment and stability in movement can be achieved at the same time, contributing to improved operability.

[0065] The controller may include a detection unit that detects whether the operation unit is located in the first area. For example, if the operation unit is not located in the first area where the operation unit is operable, the controller can limit the function of the operation unit to avoid unexpected operations, thereby contributing to improved operability.

[0066] In the controller, the holding unit may be located on the back of the user's hand, the first region may be a region between the user's thumb and fingers other than the thumb, and the second region may be a region on the back of the user's hand. Because the holding unit is located on the back of the user's hand, the holding unit does not interfere with the movement of the user's hand, contributing to improved operability. Because the first region is a region between the user's thumb and fingers other than the thumb, the thumb generally has a wider range of motion than the other fingers, allowing the operation unit to be operated with the thumb, contributing to improved operability. Because the second region is a region on the back of the user's hand, the operation unit located in the second region does not interfere with the movement of the user's hand, contributing to improved operability.

[0067] Second Embodiment A second embodiment will now be described. FIG. 7 is a diagram showing a controller according to this embodiment. This controller 1 includes a positioning unit 30. In this embodiment, the same components as those in the above-described embodiments are denoted by the same reference numerals, and their description will be omitted or simplified. Matters described in other embodiments described in this specification may be applied to this embodiment as appropriate.

[0068] The positioning unit 30 regulates the relative position of the operating unit 9 and the holding unit 12. The positioning unit 30 regulates the position of the operating unit 9 disposed at the first position P1 in the first region R1. The positioning unit 30 regulates (e.g., positions) the position of the operating unit 9 disposed at the first position P1 in the first region R1, for example, by magnetic force. The positioning unit 30 includes a positioning member 31 and a positioning member 32. The positioning member 31 is fixed to the operating unit 9. The positioning member 32 is fixed to the body 6. The positioning members 31 and 32 are members that attract each other by magnetic force. For example, the positioning members 31 and 32 each include a magnet. The magnet may be a permanent magnet or an electromagnet. The positioning member 31 or the positioning member 32 may be an object that attracts a magnet (e.g., a metal that attracts a magnet).

[0069] The position of the operation unit 9 relative to the body 6 is regulated by a positioning member 31 fixed to the operation unit 9 being attracted to a positioning member 32 fixed to the body 6. In the body 6, the positioning member 32 is pre-positioned at a position corresponding to the first position P1 in the first region R1. For example, the positioning member 32 is positioned on a part of the body 6 that corresponds to a finger other than the thumb (for example, the index finger). For example, the positioning member 32 is positioned on the opposite side of the operation unit 9 from the thumb when the operation unit 9 is positioned at the first position P1 in the first region R1.

[0070] In the controller described above, the relative position between the operation unit 9, which is located at the first position P1 in the first region R1, and the body 6 is restricted. This controller contributes to improved operability, for example, because the operation unit 9 is stably located in a predetermined position in the first region R1 where the user can operate the operation unit 9. For example, the controller 1 can hold the operation unit 9 in a predetermined position even if the holding unit 12 is flexible.

[0071] The technical scope of the present invention is not limited to the aspects described in the above-mentioned embodiments. One or more of the requirements described in the above-mentioned embodiments may be omitted. The requirements described in the above-mentioned embodiments may be combined as appropriate. Furthermore, to the extent permitted by law, the disclosures of all documents cited in the above-mentioned embodiments are incorporated by reference into this specification.

[0072] In the above-described embodiment, an example in which the body 6 is glove-shaped is described, but this is not a limitation. For example, the body 6 may have any configuration (e.g., shape, size) as long as it is configured to be wearable on the hand of the user 5. In the above-described embodiment, an example in which the holding unit 12 holds the operation unit 9 by magnetic force is described, but this is not a limitation. For example, the holding unit 12 may have any configuration for holding the operation unit 9. For example, the holding unit 12 may hold the operation unit 9 by fitting the operation unit 9 to the operation unit 9. In the above-described embodiment, an example in which the holding unit 12 detachably holds the operation unit 9 is described, but this is not a limitation. The controller 1 may have a configuration in which the holding unit 12 and the operation unit 9 are fixed to each other in an undetachable manner. The configuration in which the operation unit 9 is moved between the first region R1 and the second region R2 may be a configuration in which an actuator is used. In the above-described embodiment, an example in which the operation unit 9 moves around a predetermined axis AX1 between the first region R1 and the second region R2 is described, but this is not a limitation. For example, the operation unit 9 may be configured to slide and move between the first region R1 and the second region R2. In the above-described embodiment, an example of a configuration in which the controller 1 includes a body 6 worn on the hand of the user 5 has been described, but the present invention is not limited to this example. For example, the controller 1 may be configured to be attached externally to an object worn on the hand of the user 5. In other words, the controller may be an external controller attached to a body worn on the user's hand, and may include the operation unit 9 of the above-described embodiment and the holder 12 of the above-described embodiment.

[0073] 1: Controller, 2: Display device, 3: Information processing device, 5: User, 6: Body, 7: Actuator, 8: Sensor, 9: Operation unit, 12: Holding unit, 14: Processing unit, 15: Adjustment unit, 19: Connection unit, 20: Connection unit, 22: Detection unit, 24: Processing unit, 26: Connection member, 30: Positioning unit, 31: Positioning member, 32: Positioning member, P1: First position, P2: Second position, R1: First region, R2: Second region, SYS: Experience system

Claims

1. A controller comprising: a body worn on a user's hand; an operation unit attached to the body and operated by the user's finger; and a holding unit attached to the body, magnetically moving the operation unit between a first region operable by the user's finger and a second region outside the first region, and removably holding the operation unit.

2. A controller comprising: a body worn on a user's hand; an operation unit attached to the body and operated by the user's finger; a holding unit attached to the body, movably holding the operation unit between a first region operable by the user's finger and a second region outside the first region; and a positioning unit for restricting the position of the operation unit disposed in the first region.

3. A controller comprising: a body worn on a user's hand; an operation unit attached to the body and operated by the user's finger; a holding unit attached to the body, movably holding the operation unit between a first region operable by the user's finger and a second region outside the first region; and a processing unit for comparing a detection result of a sensor detecting the position of the user's finger operating the operation unit with a preset position of the operation unit.

4. The controller according to any one of claims 1 to 3, further comprising a positioning unit for restricting the position of the operation unit disposed in the first region, wherein the positioning unit includes a first positioning member for restricting the movement of the operation unit disposed at a first position in the first region.

5. The controller according to any one of claims 1 to 3, further comprising a positioning unit for restricting the position of the operation unit disposed in the second region, wherein the positioning unit includes a second positioning member for restricting the movement of the operation unit disposed at a second position in the second region.

6. The controller according to any one of claims 1 to 3, further comprising a positioning unit for restricting the position of the operation unit disposed in the first region, wherein the positioning unit magnetically restricts the position of the operation unit disposed at a first position in the first region.

7. The controller according to any one of claims 1 to 3, further comprising a guide for guiding the movement of the operation unit between the first region and the second region.

8. The operation unit rotates around a predetermined axis and moves between the first region and the second region, and the guide allows the movement of the operation unit in a direction parallel to the predetermined axis and restricts the movement of the operation unit in a direction perpendicular to the predetermined axis. The controller according to claim 6.

9. The controller according to any one of claims 1 to 3, further comprising a detection unit that detects whether the operation unit is disposed in the first region.

10. The holding unit is disposed on the back of the user's hand, the first region is a region between the user's thumb and fingers other than the thumb, and the second region is a region on the back of the user's hand. The controller according to any one of claims 1 to 3.

11. The holding unit holds the operation unit rotatable around a predetermined axis. The controller according to any one of claims 1 to 3.

12. The controller according to any one of claims 1 to 3, further comprising a connecting member that keeps the distance between the operation unit and the holding unit at a predetermined value or less and connects the operation unit and the body.

13. The controller according to any one of claims 1 to 3, further comprising an adjustment unit that adjusts the relative position between the body and the holding unit.

14. The controller according to any one of claims 1 to 3, further comprising a sensor provided on the body that detects the position of the user's finger, and the operation unit receives an input for changing the content represented in the cyber space using the detection result of the sensor.

Images