Head-mounted device, control method and control program for head-mounted device

Abstract

To provide a head-mounted device that, even when receiving an unexpected input signal in a scene in which the device is assumed not to perform output operations, for example, during a non-use period, can appropriately deal with the reception of the signal.SOLUTION: A head-mounted device comprises: an attachment member 100p that is attached to the head of a user; a sensor unit SE being a detector that detects the attitude of the attachment member 100p; a control unit CR that switches a control mode according to the attitude detection performed by the sensor unit SE; and a video output device DD and an audio output device EP as output devices that perform output operations according to the control mode in the control unit CR.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a head-mounted device such as a head-mounted display, and a control method and control program for a head-mounted device. [Background technology]

[0002] A head-mounted display device is known that has a detection unit that detects at least one of an impact and a displacement to the head-mounted display device, and generates different commands depending on the direction and number of impacts detected by the detection unit (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-195867 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the head-mounted display device of Patent Document 1 mentioned above, for example, if the wearer stops using the device and places it on a desk opposite to when it is in use (upside down), the impact caused by placing it down may be recognized as an input from an unexpected direction to the head-mounted display device, and a command (e.g., a mute function) may be executed. [Means for solving the problem]

[0005] A head-mounted device according to one aspect of the present invention includes a mounting member that is mounted on a user's head; An impact applied to the mounting member; and Attitude of the mounting member and, A detection device for detecting the Based on the impact applied to the mounting member, Control Mode of switching Accepts input signals related to Control device and , the control mode and an output device that performs an output operation according to the control device, The detection device The attachment member detected by The aboveDepending on the posture, Vertical When an axis parallel to a virtual plane perpendicular to the axis of rotation is taken as a rotation axis, the rotation angle of the mounting member with respect to the virtual plane is and the control device determines, based on the determined rotation angle, Determines whether the input signal is valid or not The output device performs an output operation according to the switched control mode when the input signal is valid. . [Brief description of the drawings]

[0006] [Figure 1] FIG. 1 is an external perspective view illustrating an example of a head-mounted device according to a first embodiment. [Diagram 2] 11A and 11B are diagrams for explaining an input operation to a mounting member of a head-mounted device. [Diagram 3] FIG. 2 is a side view illustrating a state in which the head-mounted device is worn. [Figure 4] FIG. 1 is a diagram for explaining a usage mode of a head-mounted device. [Diagram 5] FIG. 2 is a conceptual diagram for explaining the posture of the head-mounted device. [Figure 6] FIG. 2 is a block diagram for explaining a configuration example of a head-mounted device. [Figure 7] 11 is a data table showing an example of types of input signals. [Figure 8] 10 is a flowchart for explaining an example of the operation of the head-mounted device. [Figure 9] FIG. 11 is an external perspective view illustrating an example of a head-mounted device according to a second embodiment. [Figure 10] FIG. 11 is an external perspective view illustrating an example of a head-mounted device according to a third embodiment. [Figure 11] FIG. 2 is a block diagram for explaining a configuration example of a head-mounted device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] [First embodiment] Hereinafter, with reference to FIG. 1 etc., a structure and the like of an image display device as an example of a head-mounted device according to the present invention will be described.

[0008] Fig. 1 is an external view showing a head-mounted image display device 100 as an example of a head-mounted device, and Fig. 2 shows a mounting member 100p, which is a main body part of the image display device 100 that displays images and is mounted on the user's head during use, and shows an example of an input operation to the mounting member 100p. Fig. 3 is a conceptual side view showing an example of a user, that is, an observer or wearer US, mounting the image display device 100 on his / her head.

[0009] As shown in FIG. 1 and other figures, the image display device 100 is a glasses-type head mounted display (HMD), and is a virtual image display device that allows an observer or wearer US (see FIG. 3) wearing the image display device to recognize an image as a virtual image. The image display device 100 also allows the observer or wearer US to recognize an image as a virtual image and to visually recognize or observe an external image in a see-through manner. In FIG. 1 and other figures, X, Y, and Z are an orthogonal coordinate system, and the +X direction corresponds to the lateral direction in which the eyes of the observer or wearer US wearing the image display device 100 are aligned, the +Y direction corresponds to the upward direction perpendicular to the lateral direction in which the eyes are aligned for the wearer US, and the +Z direction corresponds to the forward direction or front direction for the wearer US. The ±Y directions are parallel to the vertical axis or vertical direction.

[0010] As described above, the image display device 100 includes the mounting member 100p, which is the main body of the device having a glasses-like shape, as well as the control device CR and the cable (connection section) 40 that connects these together.

[0011] From a functional perspective, the mounting member 100p includes a first display device 100A for the right eye and a second display device 100B for the left eye as a video output device DD. The first display device 100A is composed of, for example, an image forming main body 105A and a light guide device 20A. Of these, the image forming main body 105A is composed of, for example, a display element having various panels or the like to form image light, a projection lens for projecting the image light, and the like housed in a housing. The light guide device 20A is composed of, for example, a prism member, etc., and is connected to the image forming main body 105A, and guides the image light from the image forming main body 105A to the eye as a virtual image for the right eye. Similarly, the second display device 100B is composed of the image forming main body 105B and a light guide device 20B, and guides the formed image light to the eye as a virtual image for the left eye. In the illustrated example, the light guide device 20A and the light guide device 20B are connected at the center to form an integrated configuration, but the present invention is not limited to this, and the light guide device 20A and the light guide device 20B may be configured separately. Furthermore, in the above configuration, the image light is guided in the horizontal direction (±X direction), but it is also possible to configure the image light to be guided in the vertical direction (for example, -Y direction).

[0012] The wearing member 100p also includes a first earphone (right-ear earphone) EPA and a second earphone (left-ear earphone) EPB as the audio output device EP.

[0013] In addition to the above, the wearing member 100p is provided with various parts such as temples TM that are ear hooks, as members for enabling wearing.

[0014] The control device CR is composed of a CPU, a storage device (storage unit), an input device, etc., which perform various arithmetic processing. The control device CR also functions as a controller that has a touch panel portion, a button portion, etc. as an input device and receives instructions for various operations from the observer. The control device CR transmits various signals, such as a video signal and an audio signal, for displaying a desired image on the image display device 100 to the wearing member 100p by performing various arithmetic processing. In other words, it can be said that the video output device DD and the audio output device EP of the wearing member 100p, which is the main body portion, function as output devices that perform display operations and audio output operations according to instructions from the control device CR. The control device CR can be composed of various things, and in addition to being composed of a dedicated controller device, it can be considered that the above-mentioned various operations can be made possible by installing an app (application software) on a smartphone, for example. The control device CR is provided with an operation unit 130 as the above-mentioned input device in order to receive instructions for various operations from the wearer US (see FIG. 3).

[0015] The cable (connection part) 40 is a member that connects the mounting member 100p and the control device CR via the connecting member CN, and in the illustrated example, has a first cable 40a that connects between the mounting member 100p and the connecting member CN, and a second cable 40b that connects between the connecting member CN and the control device CR. For example, the second cable 40b is composed of a USB Type-C connector or the like, and can be connected to the control device CR composed of various devices such as the above-mentioned smartphone. Note that the cables that make up the first cable 40a and the second cable 40b can be made of metal cables, optical fibers, or the like.

[0016] In the above embodiment, a sensor unit SE is provided inside the mounting member 100p. The sensor unit SE is composed of various sensors such as a three-axis acceleration sensor, and is capable of three-dimensionally detecting the posture of the mounting member 100p, the impact applied to the mounting member 100p, or the displacement of the mounting member 100p. In particular, as described above, the sensor unit SE functions as a detection device that detects the posture of the mounting member 100p, and in the image display device 100, when controlling various operations such as a display operation based on the processing in the control device CR, whether or not to validate an input signal received as a signal related to switching of the control mode is determined according to the result of the posture detection of the mounting member 100p. Note that a detailed example of the configuration of the sensor unit SE will be described later with reference to the block diagram of FIG. 6.

[0017] Hereinafter, with reference to FIG. 2, one mode of receiving the input signal based on the impact on the mounting member 100p will be described. In the image display device 100, different commands are generated according to the direction of the impact, as illustrated by arrows IM1 to IM3 in the areas AR1 to AR3 constituting FIG. 2. That is, when an impact is received from the -X direction as indicated by arrow IM1 in the area AR1, when an impact is received from the -Y direction as indicated by arrow IM2 in the area AR2, and when an impact is received from the +X direction as indicated by arrow IM3 in the area AR3, the sensor unit SE detects the difference in the generated impact, and the control device CR, which receives this, handles it as a different command being generated and switches the display mode and sound in the operation mode of the content according to the detection mode of the impact that is determined in advance. That is, the control device CR receives the above-mentioned impact as an input signal related to switching of the control mode.

[0018] Here, the impacts from each of the above directions correspond to the wearer US (see FIG. 3) tapping lightly on any part of the wearing member 100p with his / her finger. That is, when the wearer US taps the wearing member 100p lightly in a certain direction with his / her fingertip, the sensor unit SE detects the impact caused by tapping the wearing member 100p, and the control device CR generates various commands associated in advance based on the detection data from the sensor unit SE (see FIG. 7), and various operation processes associated with the commands are performed. The wearer US can make the control device CR perform the operation he / she intends (change the operation) by tapping the wearing member 100p in a specific direction and number of times associated in advance. From another perspective, at least a part of the operations equivalent to the operation by the operation unit 130 can be performed by tapping lightly on any part of the wearing member 100p with his / her finger.

[0019] Furthermore, in this embodiment, as described above, the sensor unit SE detects the posture of the attachment member 100p in addition to detecting the above-mentioned impact, and when the above-mentioned impact is received, that is, when an input signal related to switching of the control mode is received, a determination is made based on the detected posture as to whether or not to switch the display mode and audio output mode accordingly.

[0020] For example, when the use of the image display device 100 is temporarily stopped and the mounting member 100p is placed on a desk in a state in which it is inverted from the state in use (for example, see the area CR4 in FIG. 5), the moment the mounting member 100p is placed on the desk, the sensor unit SE attached to the mounting member 100p detects that it has received impacts from multiple directions including the -Y direction, and if the impact includes an impact in the direction for which a command is set, an operation according to the setting may start. In order to avoid such a situation, in this embodiment, it is possible to accept an input signal via impact detection in the sensor unit SE in the control device CR as described above, and then it is determined whether or not to validate the input signal accepted by the control device CR depending on the posture of the mounting member 100p detected by the sensor unit SE as a detection device. Specifically, when it is found from the posture detection of the mounting member 100p that it is in a state in which it is inverted from the state in use, even if an impact is detected in the sensor unit SE, it is not considered to be valid but is treated as invalid, and the operation corresponding to the impact is not switched.

[0021] In addition, the sensor unit SE may be configured to perform sensing by using, for example, a three-axis acceleration sensor. In such a case, of the impact detection and posture detection in the sensor unit SE, the impact detection is detected as a large value (acceleration value) in a specific direction in a short time. In contrast, the posture detection detects the acceleration value when a person moves their head, so the detected change is slower, the value is smaller, and the detection time is longer than in the case of a motion such as a tap with a fingertip, which is the impact detection. Therefore, due to the difference in these characteristics, the detection of the impact motion and the detection of the posture change can be extracted separately by analyzing the sensing result in the sensor unit SE. In other words, the control device CR can acquire information on both the reception of an input signal based on the impact detection from the sensor unit SE and the posture detection of the wearer US by appropriately performing an analysis process of the sensing result (data).

[0022] A specific example of posture detection will be described below with reference to Fig. 3. Here, the state shown in Fig. 3 is taken as the standard posture of the attachment 100p during use. To explain more specifically, first, assume that a plane perpendicular to the vertical direction, i.e., the direction of gravity G, is defined as a virtual plane VP, and directions parallel to the virtual plane VP and perpendicular to each other are defined as the u direction and the v direction. Also, a direction perpendicular to the u direction and the v direction and opposite to the direction of gravity G is defined as the w direction.

[0023] On the other hand, in the figure, the wearer US is wearing the wearing member 100p and facing forward with his / her neck straight, and the XZ plane of the wearing member 100p is horizontal, that is, the XZ plane and the virtual plane VP (uv plane) are parallel to each other. In this state, the X direction and the u direction are parallel to each other, and the Y direction and the v direction are parallel to each other. The above state is the standard posture of the wearing member 100p when in use. In contrast, it is considered that the wearer US changes his / her posture (moves his / her neck) within a certain range during actual use. As a specific example of the range of posture change during use, it is considered that the expected posture change range is from a state of looking straight down as shown in region BR1 in FIG. 4 to a state of looking straight up as shown in region BR2. In addition, in the above embodiment, as the posture of the mounting member 100p changes, the relative relationship between the XYZ directions and the uvw directions changes, while the sensor unit SE provided on the mounting member 100p always detects a direction along the gravity direction G indicated by the arrow AA, and detects the posture of the mounting member 100p based on this.

[0024] In the following, to simplify the explanation, the change in posture by the wearer US is targeted for the upward to downward movement as shown in Fig. 4, and the explanation of the case where the wearer US tilts his / her head left or right is omitted. That is, the change in posture is targeted for the change in posture about the u direction (X direction) of the axes parallel to the virtual plane VP in the figure. In this case, the sensor unit SE as a detection device detects the posture about the axis along the direction in which the first display device 100A and the second display device 100B are aligned as the rotation axis.

[0025] In consideration of the characteristics of the change in posture in the example shown in FIG. 4, in this embodiment, whether or not to validate the input signal is determined according to the rotation angle of the mounting member 100p with respect to the virtual plane VP. That is, as illustrated in FIG. 3, the mounting member 100p is determined to be within a range corresponding to the state shown in FIG. 4 when the mounting member 100p is parallel to the virtual plane VP (horizontal) as a reference (rotation angle 0°) and an axis parallel to the virtual plane VP is set as the rotation axis. FIG. 5 shows the state of the change in posture of the mounting member 100p and the change in the rotation angle θ at that time. For example, in the region CR1 corresponding to the state (reference state) of FIG. 3, the rotation angle θ is θ=0°. In the change in posture that is the subject here, the rotation angle θ can be specified by the angle between the v direction and the Z direction as shown in the figure, and whether or not to validate the input signal is determined depending on whether or not the rotation angle θ is within a range of ±90°. That is, if the rotation angle is within a range of ±90°, the input signal is validated, and if it is not within the range, the input signal is invalid. Specifically, among the regions CR1 to CR4 shown in FIG. 5, when the rotation angle θ=0° as shown in region CR1, or when the rotation angle θ=+45° corresponding to the state in which the mounting member 100p is facing slightly upward as shown in region CR2, the input signal based on the impact is treated as valid in the control device CR.

[0026] On the other hand, when the rotation angle θ exceeds +90° and the rotation angle θ=+135° as shown in the region CR3, or when the mounting member 100p is inverted and placed on the desk TB as shown in the region CR4, that is, when the rotation angle θ=+180°, the control device CR treats the input signal based on the impact as invalid. As described above, in the head-mounted device as the image display device 100 according to this embodiment, when the posture of the mounting member 100p assumed to be when not in use as shown in the region CR3 or region CR4 is detected, the input signal based on the impact is not accepted, so that unintended operation can be avoided or suppressed. In the above cases, the control device CR accepts the impact received by the mounting member 100p as an input signal, and when the rotation angle θ is within a predetermined range, the control device CR treats the input signal as a valid signal. In the above cases, when the rotation angle θ is outside the predetermined range, the control device CR treats the input signal as an invalid signal and maintains the control mode in the state before the mounting member 100p receives the impact.

[0027] Hereinafter, with reference to a block diagram of an example of the image display device 100 shown in FIG. 6, each unit constituting the image display device 100 will be described from a functional standpoint.

[0028] As shown in the figure, the control device CR of the image display device 100 includes a CPU (main control unit) 110, a storage unit 120, an operation unit 130, and transmission units (Tx) 191 and 192. For example, the CPU (main control unit) 110 and the storage unit 120 may be collectively configured as an MCU 180.

[0029] The storage unit 120 is configured with a ROM, a RAM, etc., and stores various computer programs and various data.

[0030] The CPU 110 reads out and executes computer programs and data from the storage unit 120, thereby functioning as a display control unit (image processing unit) 150 and an audio control unit 160. Furthermore, the CPU 110 functions as a posture analysis unit 141 that performs analysis processing based on information from a sensor unit SE provided in the wearing member 100p in order to detect the posture of the wearing member 100p and whether or not it has received an impact corresponding to an input signal, and an action switching determination unit 142 that determines whether or not to switch actions based on the posture detection result by the posture analysis unit 141, i.e., whether or not to validate an input signal.

[0031] As described above, the CPU 110 functions as a main control unit that performs various types of arithmetic processing and that is responsible for the overall control of the image display device 100.

[0032] As described above, the operation unit 130 is an external input receiving device (input device) operated by the wearer US (see FIG. 3), and is composed of, for example, various menu keys, a track pad, etc., and acquires a signal according to an operation input by an observer or user. However, here, as described above, in addition to the operation by the operation unit 130, various operations are also possible by capturing an impact on the above-mentioned wearing member 100p as an input signal.

[0033] The transmitting units 191 and 192 transmit various data VV1 and VV2 including the video signal generated in the CPU 110 to the first and second display devices 100A and 100B constituting the mounting member 100p, respectively. That is, the transmitting units 191 and 192 function as transceivers for serial transmission between the control device CR and the first and second display devices 100A and 100B.

[0034] Next, of the image display device 100, the wearing member 100p includes, as already described, a pair of first and second display devices 100A, 100B on the left and right that constitute the video output device DD, a pair of first and second earphones EPA, EPB on the left and right that constitute the audio output device EP, and a sensor unit SE.

[0035] In addition to the above, as shown in the figure, receiving units 193, 194 are provided which function as receivers for serial transmission between the control device CR and the first and second display devices 100A, 100B. That is, the first and second display devices 100A, 100B form images based on right eye image data and left eye image data contained in various data VV1, VV2 from the transmitting units 191, 192 (Tx) received by the receiving units (Rx) 193, 194, respectively.

[0036] The first and second earphones EPA and EPB output audio in accordance with the audio signal AS1 from the audio control unit 160.

[0037] The sensor unit SE is configured by combining, for example, an acceleration sensor SE1, a gyro sensor (angular velocity sensor) SE2, a geomagnetic sensor SE3, and a GPS (Global Positioning System) receiver SS, and functions as a motion sensor that enables impact detection and position detection as described above. Note that it is not necessary for the sensor unit SE to have all of the above-mentioned various sensors, and the sensor unit SE may be configured with some of these. For example, if the acceleration sensor SE1 of the sensor unit SE is configured as a three-axis acceleration sensor, it becomes possible to detect impacts in any of the +X-axis direction, -X-axis direction, +Y-axis direction, -Y-axis direction, +Z-axis direction, and -Z-axis direction, and the posture analysis unit 141 can detect the number and direction of impacts detected by the sensor unit SE based on the detection data from the sensor unit SE, and generate different commands depending on the detection result.

[0038] Moreover, by applying a three-axis acceleration sensor or the like as the acceleration sensor SE1 of the sensor unit SE and sensing a value indicating the attitude in the Y direction (direction relative to gravity), attitude detection corresponding to the detection of the value of the rotation angle θ illustrated in Fig. 5 becomes possible. In this case, as an analysis process in the attitude analysis unit 141, for example, in Fig. 4 and Fig. 5, when the w direction corresponding to the gravity direction G is compared with the Y direction, the above value is set to 0 when the w direction and the Y direction are perpendicular (when the rotation angle θ = ± 90 °), and this is used as a boundary, when the above value in the Y direction is positive (when the w direction and the Y direction are in the same direction), it is within the valid range, and when it is negative (when the w direction and the Y direction are in the opposite direction), it is outside the valid range (within the invalid range). Note that the above value in the Y direction is a maximum value of 1 when the rotation angle θ = 0 °, and a minimum value of -1 when the rotation angle θ = 180 °.

[0039] The action switching determination unit 142 determines whether or not to validate an input signal based on an impact, i.e., an input signal assumed to have been received by a tapping action of the wearer US, who is the user, depending on the analysis result in the posture analysis unit 141 obtained as described above.

[0040] FIG. 7 is an example showing the type of command according to the direction and number of times of impact (i.e., the direction and number of times of what is assumed to be the tapping action of the wearer US) when an impact is detected as described above. The action switching determination unit 142 determines whether or not to perform these actions according to the posture of the wearing member 100p illustrated in FIG. 5. In the illustrated example, for example, when the CPU 110 detects one impact in the +X axis direction based on the detection data from the sensor unit SE, it executes "fast forward" in video / audio playback, and when it detects one impact in the -X axis direction, it executes "rewind". That is, the user can perform a desired operation by lightly tapping each part of the wearing member 100p as illustrated in FIG. 2.

[0041] Hereinafter, an example of the operation of the image display device 100 having the above-mentioned configuration will be described with reference to the flowchart in Fig. 8. More specifically, an example will be described of the detection of an impact motion in the image display device 100, i.e., the reception of a tapping motion (including a motion estimated to be a tapping motion) by the wearer US, and the detection of a change in posture, i.e., the reception of a tap associated with the detection of the raising and lowering state of the wearer US's neck.

[0042] Here, when a change in posture is detected (the value of the rotation angle θ changes significantly), it is possible to immediately switch between valid and invalid reception of the input signal, but depending on the situation, it may be preferable to wait a predetermined time before switching between valid and invalid. As a typical example, in the process of turning over (turning over) the mounting member 100p from a non-use state (a state in which the rotation angle is outside a predetermined range) to a use state (a state in which the rotation angle is within a predetermined range), if the input signal is treated as valid the moment it enters the predetermined range, the momentum of turning over the mounting member 100p is detected as an impact, i.e., an input signal, and at the same time when the mounting member 100p is turned over and returned to a use state (returned and stopped), an operation may be started based on the input signal corresponding to the impact detected by stopping (i.e., an operation unintended by the user may be started automatically). Conversely, the same thing may occur when the rotation angle changes from within the predetermined range to outside the predetermined range. To avoid such a situation, one example that can be considered is to not switch between enabled and disabled for a predetermined period of time (e.g., about one second) that is assumed to be a short period of time between when the attachment member 100p is flipped over and when the tapping action to start use is started, that is, until the predetermined period of time has elapsed, and then to switch between enabled and disabled after the predetermined period of time has elapsed.

[0043] Therefore, in one example here, when determining whether to validate reception of an impact caused by a user tapping or an equivalent impact (an input signal associated with the impact), consideration is given to whether the mounting member 100p has been maintained within a predetermined range or outside the predetermined range for a predetermined time or more (e.g., one second or more). Note that, hereinafter, the above-mentioned validity or invalidity will be expressed as whether the tap reception state is valid or invalid.

[0044] 8, first, the CPU 110 of the image display device 100, functioning as the posture analysis unit 141, reads out various data from the sensor unit SE (step S101). Specifically, as step S101, for example, the acceleration data for three axes is read out by the acceleration sensor (three-axis acceleration sensor) SE1 constituting the sensor unit SE, and it is confirmed whether or not the tap acceptance state is valid (step S102). That is, when a tap action or an action equivalent thereto by the wearer US is detected, it is confirmed whether or not the state is set to treat this as valid.

[0045] In step S102, if the tap acceptance state is valid (step S102: Yes), CPU 110, as operation switching determination unit 142, determines whether the Y-axis data among the acceleration data for three axes has remained negative for one second, that is, whether the rotation angle θ has remained outside the range of ±90 degrees (in the tap invalid zone) for one second or more (step S103).

[0046] If it is determined in step S103 that the Y-axis data has remained negative for one second (step S103: Yes), CPU 110 updates the tap acceptance state to invalid, i.e., switches to invalid (step S104), and returns to the operation from step S101. On the other hand, if it is not determined in step S103 that the Y-axis data has remained negative for one second (step S103: No), CPU 110 maintains the tap acceptance state as valid.

[0047] In step S102, if the tap acceptance state is not valid (invalid) (step S102: No), CPU 110, as operation switching determination unit 142, determines whether the Y-axis data among the acceleration data for three axes has remained positive for one second, that is, whether the rotation angle θ has remained within the range of ±90 degrees (a state in the tap valid zone) for one second or more (step S105).

[0048] If it is determined in step S105 that the Y-axis data has not maintained a positive value for one second (step S105: No), CPU 110 leaves the tap acceptance state as invalid and returns to the operation from step S101. If it is determined in step S105 that the Y-axis data has maintained a positive value for one second (step S105: Yes), CPU 110 updates the tap acceptance state to valid, i.e., switches to valid (step S106).

[0049] As described above, only when the process of step S106 has been performed or when it has not been determined in step S103 that the Y-axis data has remained negative for one second (step S103: No), CPU 110 treats the tap reception state as valid. In other words, when CPU 110 determines that the tap reception state is invalid, even if a tap operation or an operation equivalent thereto is detected, it will not perform the operation process equivalent thereto.

[0050] If step S106 is passed, or if it is not determined in step S103 that the Y-axis data continues to have a negative value for one second (step S103: No), the CPU 110 detects whether or not there is an action corresponding to a tap action by the wearer US (step S107). That is, the CPU 110 detects whether or not there is an input signal based on an impact from the sensor unit SE. If it is determined from the detection in step S105 that there is an action corresponding to a tap action (step S108: Yes), the CPU 110 further checks whether or not the Y-axis data of the acceleration data for three axes at the current time point is a positive value (step S109). If it is determined in step S109 that it is a positive value, the CPU 110 determines that a tap action has been detected, and the CPU 110, as the display control unit 150 or the audio control unit 160, performs various processes (for example, mute switching, etc.) according to this determination result (step S110). After completing the process in step S110, the CPU 110 repeats the operations from step S101.

[0051] On the other hand, if no action corresponding to a tap action is detected in step S108 (step S108: No), or if it is determined in step S109 that the axis data is not a positive value (step S109: No), the CPU 110 determines that there was no impact-based input signal from the sensor unit SE or that the input signal is invalid, and repeats the operations from step S101 without performing any special processing.

[0052] As described above, the image display device 100 as a head-mounted device according to this embodiment includes a mounting member 100p mounted on the head of a wearer US, a sensor unit SE as a detection device that detects the posture of the mounting member 100p, a control device CR that switches the control mode in response to posture detection by the sensor unit SE, and a video output device DD and a sound output device EP as output devices that perform an output operation in accordance with the control mode in the control device CR, and the control device CR receives an input signal related to the switching of the control mode and determines whether or not to enable the received input signal in response to the posture of the mounting member 100p detected by the sensor unit SE. In this case, in the image display device 100, the control device CR that switches the control mode in response to posture detection by the sensor unit SE as a detection device is made capable of receiving an input signal related to the switching of the control mode, and then determines whether or not to enable the input signal in response to the posture of the mounting member 100p, so that even if an unexpected input signal is received in a situation where it is assumed that no output operation will be performed, such as when not in use, an appropriate response can be made to the received input signal.

[0053] In the above example, the mounting member 100p and the control device CR are connected by a cable (connection section) 40, but the present invention is not limited to this. For example, it is also possible to use a configuration in which signals can be exchanged between the mounting member 100p and the control device CR by various wireless communications (near-field wireless communications). Alternatively, it is also possible to use a configuration in which a device equivalent to the control device CR including the operation section 130 is built into the mounting member 200p. That is, as one embodiment of the image display device 100, the control device CR may be wirelessly connected, or the control device CR may be provided inside the mounting member 100p and integrated therewith.

[0054] Second Embodiment Hereinafter, the head-mounted device according to the second embodiment will be described with reference to Fig. 9. Note that the image display device as an example of the head-mounted device according to this embodiment is a partially modified version of the image display device according to the first embodiment, and other configurations are similar except for the detection of the input signal. Therefore, detailed illustrations and explanations will be omitted for components with the same reference numerals as in other drawings in the overall configuration, and matters explained with reference to other drawings will be used as necessary.

[0055] Fig. 9 is an external view showing an image display device 100 according to this embodiment, and corresponds to Fig. 1. In the case of the first embodiment illustrated in Fig. 1, the sensor unit SE not only functions as a detection device for detecting the attitude of the wearing member 100p, but also receives an impact such as a tapping action by the wearer US as an input signal. In contrast, the example of Fig. 9 is different from the first embodiment in that, as shown by hatching, a touch panel sensor TP is provided in one area on the upper surface of the wearing member 100p, and a signal corresponding to the input signal is generated when the wearer performs various actions such as tapping and swiping on the surface of the touch panel sensor TP.

[0056] In other words, in the above embodiment, the touch panel sensor TP not only functions as a substitute for the sensor unit SE that detects the impact associated with the operation of lightly tapping the mounting member 100p in a certain direction with a finger in the first embodiment, but also functions to handle part of the operation by the operation unit 130.

[0057] In this embodiment as well, the sensor unit SE detects the attitude of the mounting member 100p, for example, whether the rotation angle θ is within the range of ±90°, and based on this, it is determined whether the input signal received by the touch panel sensor TP, that is, the input signal related to switching the control mode, is valid or not. As a result, even if an unexpected input signal is received in a situation where it is assumed that no output operation will be performed, such as when not in use, an appropriate response can be taken.

[0058] Third Embodiment Hereinafter, the head-mounted device according to the third embodiment will be described with reference to Fig. 10 etc. The head-mounted device according to this embodiment is a pair of glasses-type headphones (audio output device) and differs from the image display device according to the first embodiment etc. in that it does not have each unit that performs a display operation.

[0059] Fig. 10 is an external view showing glasses-type headphones 200 as an example of a head-mounted device according to this embodiment, and corresponds to Fig. 1 etc. Fig. 11 is a block diagram for explaining an example of the configuration of the glasses-type headphones 200, and corresponds to Fig. 6.

[0060] 10, the eyeglass-type headphones 200 are configured in an eyeglass-like configuration, such as sunglasses, and a pair of left and right speakers SP (a first speaker SPA and a second speaker SPB) are provided as audio output devices at temples TM that are located near the wearer's ears when in use. The first speaker SPA and the second speaker SPB can be small and of various types, and may be configured to transmit audio by bone conduction, for example.

[0061] The glasses-type headphones 200 are composed of a wearing member 200p, which is a main body part of a glasses-type member such as sunglasses, and a control device CR. Of these, the wearing member 200p is provided with a sensor unit SE, similar to the head-mounted device exemplified in the first embodiment, and is capable of detecting the posture of the wearing member 200p. Also, as described above, a speaker (audio output device) SP is provided on the temple TM of the wearing member 200p.

[0062] In addition, in the example shown in the figure, signals can be exchanged between the attachment member 200p and the control device CR, for example, via various types of wireless communication (short-range wireless communication). As illustrated in FIG. 11, information on the sensing results at the sensor unit SE is transmitted to the posture analysis unit 141 of the control device CR, and various command signals from the control device CR are transmitted to the attachment member 200p side.

[0063] In the present embodiment, the sensor unit SE detects the attitude of the attachment member 200p, for example, whether the rotation angle θ is within the range of ±90°, and based on this, it is determined whether to validate an input signal related to switching of the control mode. This makes it possible to take an appropriate response even if an unexpected input signal is received in a situation where it is assumed that no output operation will be performed, such as when not in use.

[0064] In this embodiment, the reception of the input signal may be performed using the touch panel sensor TP (see FIG. 9) as exemplified in the second embodiment in addition to the mode of detecting an impact in the sensor unit SE as exemplified in the first embodiment, that is, detecting a tapping operation on the wearable member 200p. Alternatively, a device equivalent to the control device CR including the operation unit 130 may be built into the wearable member 200p.

[0065] [Variations and Others] The present invention has been described above with reference to each embodiment, but the present invention is not limited to the above embodiments and can be embodied in various forms without departing from the spirit of the invention. For example, the following modifications are also possible.

[0066] In the above, for example, the image display device 100 according to the first embodiment is configured as a see-through type that allows a user to recognize an image as a virtual image and to visually recognize or observe an outside world image, but it is also possible to apply the present invention to a configuration that does not involve visual recognition of an outside world image (a so-called closed type).

[0067] In the above, the detection device that detects the posture of the attachments 100p, 200p is the sensor unit SE, but it is also possible to consider the detection device to include the posture analysis unit 141 in addition to the sensor unit SE. Also, it is conceivable to provide an analysis function equivalent to the posture analysis unit 141 on the sensor unit SE side, and to configure the sensor unit SE to transmit the analysis results to the attachments 100p, 200p side.

[0068] In the above, the range (effective range) of the rotation angle θ is set to ±90°, but various ranges can be set according to the manner of use of the device. For example, the range of the rotation angle θ may be set by the wearer US when using the device. Furthermore, although not described above, it is also possible to configure the effective range to be determined taking into consideration the case where the user, i.e., the wearer US, tilts his / her head. In this case, for example, it is conceivable to use the value for the Y direction described above.

[0069] Although the above describes the image display device 100 as being for both eyes, it is possible to omit one of the parts for the right eye or the left eye of the image display device 100, in which case it becomes a monocular head-mounted display.

[0070] In the above, the first and second embodiments are exemplified with respect to the configuration of a head-mounted device having both a video output device DD and an audio output device EP, while the third embodiment is exemplified with respect to the configuration of a head-mounted device having only a speaker SP as an audio output device. In addition to these, for example, a head-mounted device having only a video output device (for example, the video output device DD exemplified in the first embodiment, etc.) may be configured as in the present application, that is, may be configured to determine whether or not to enable an input depending on the inclination of the posture.

[0071] In a specific embodiment, the head-mounted device comprises a mounting member to be mounted on a user's head, a detection device which detects the posture of the mounting member, a control device which switches control modes in response to the posture detection by the detection device, and an output device which performs output operations in accordance with the control mode in the control device, and the control device receives an input signal related to switching of the control mode and determines whether or not to enable the received input signal in response to the posture of the mounting member detected by the detection device.

[0072] In the head-mounted device, the control device, which switches the control mode in response to posture detection by the detection device, is capable of receiving an input signal related to switching the control mode, and determines whether or not to enable the input signal in response to the posture of the mounting member.This allows appropriate action to be taken even if an unexpected input signal is received in a situation where it is expected that no output operation will be performed, such as when the device is not in use.

[0073] In a specific aspect, when an axis parallel to a virtual plane perpendicular to the vertical direction is set as a rotation axis, the control device determines whether to validate an input signal according to a rotation angle of the mounting member relative to the virtual plane. In this case, an angle range based on the vertical direction can be defined as a criterion for determination based on attitude detection.

[0074] In a specific aspect, the control device receives the impact on the mounting member as an input signal, and treats the input signal as a valid signal when the rotation angle is within a predetermined range. In this case, the control device can use the impact on the mounting member as an input signal, i.e., a trigger for switching the control mode, and determine whether to adopt it based on the range of the rotation angle.

[0075] In a specific aspect, when the rotation angle is outside a predetermined range, the control device treats the input signal as an invalid signal and maintains the control mode in the state before the attachment member receives the impact. In this case, by treating the input signal as an invalid signal depending on the conditions, it is possible to avoid and suppress the occurrence of unintended operations.

[0076] In a specific aspect, when the detection device detects that the rotation angle has gone from outside a predetermined range to within the predetermined range, the control device invalidates the reception of an input signal before a predetermined time has elapsed since the detection, and enables the reception of an input signal after the predetermined time has elapsed. In this case, for example, when the mounting member is inverted (turned over) in the process of going from a non-use state to a use state, the momentum of the inversion can be detected to prevent unintended operation from starting.

[0077] In a specific aspect, the detection device includes an acceleration sensor, and the control device handles the impact from a specific direction detected by the acceleration sensor as an input signal. In this case, it becomes possible to receive an input signal using the impact detected by the acceleration sensor.

[0078] In a specific aspect, the output device includes a display device that displays an image. In this case, appropriate switching of the control mode regarding the image display becomes possible.

[0079] In a specific aspect, the display device includes a first display device and a second display device, and the detection device detects the attitude of the display device with an axis along which the first display device and the second display device are aligned as a rotation axis. In this case, an image is displayed to the left and right eyes of the user, and the detection device determines whether or not to validate an input signal according to the degree of rotation based on the direction in which the eyes are aligned.

[0080] In a specific aspect, the output device includes an audio output device. In this case, appropriate switching of the control mode related to audio becomes possible.

[0081] A control method for a head-mounted device in a specific embodiment detects the posture of a mounting member mounted on a user's head, switches a control mode in response to the detected posture of the mounting member, and performs an output operation in accordance with the control mode, receives an input signal related to switching of the control mode, and determines whether or not to enable reception of the input signal in response to the detected posture of the mounting member.

[0082] In a specific embodiment, the control program of a head-mounted device detects the posture of a mounting member mounted on a user's head, switches a control mode in response to the detected posture of the mounting member, and performs an output operation in accordance with the control mode, accepts an input signal related to switching of the control mode, and determines whether or not to enable acceptance of the input signal in response to the detected posture of the mounting member. [Explanation of symbols]

[0083] 20A, 20B...light guide device, 40...cable (connection section), 40a...second cable, 40b...second cable, 100...image display device, 100A...first display device, 100B...second display device, 100p...mounting member, 105A, 105B...image forming main body, 110...CPU (main control section), 120...storage section, 130...operation section, 141...posture analysis section, 142...action switching determination section, 150...display control section, 160...audio control section, 191, 192...transmission section, 193, 194...reception section, 200...glasses-type headphones, 200p...mounting member, AA...arrow, AS1...audio Signal, CN...connecting member, CR...control device, DD...video output device, EP...audio output device, EPA...first earphone, EPB...second earphone, G...gravity direction, IM1~IM3...arrow, SE...sensor unit, SE1...acceleration sensor, SE2...gyro sensor (angular velocity sensor), SE3...geomagnetic sensor, SP...speaker (audio output device), SPA...first speaker, SPB...second speaker, SS...receiver, TB...desk, TM...temple, TP...touch panel sensor, US...wearer, VP...virtual plane, VV1,VV2...data, θ...rotation angle

Claims

1. A mounting member to be mounted on the user's head; A detection device that detects an impact applied to the mounting member and a posture of the mounting member; a control device that receives an input signal related to switching of a control mode based on the impact applied to the mounting member; an output device that performs an output operation according to the control mode, the control device determines a rotation angle of the attachment member with respect to a virtual plane perpendicular to a vertical direction, in accordance with the posture of the attachment member detected by the detection device, when an axis parallel to the virtual plane perpendicular to a vertical direction is set as a rotation axis; The control device determines whether or not to validate the input signal based on the determined rotation angle; The output device performs an output operation according to the switched control mode when the input signal is valid.

2. The head-mounted device according to claim 1 , wherein the control device receives an impact received by the mounting member as the input signal, and treats the input signal as a valid signal when the rotation angle is within a predetermined range.

3. The head-mounted device of claim 2 , wherein the control device treats the input signal as an invalid signal when the rotation angle is outside the predetermined range, and maintains the control state in a state before the mounting member receives an impact.

4. The head-mounted device of claim 3, wherein when the detection device detects that the rotation angle has moved from outside the specified range to within the specified range, the control device invalidates acceptance of the input signal before a specified time has elapsed since the detection, and enables acceptance of the input signal after the specified time has elapsed.

5. the detection device includes an acceleration sensor that detects the impact applied to the mounting member from a specific direction, The head-mounted device according to any one of claims 1 to 4, wherein the control device handles the impact detected by the acceleration sensor as the input signal.

6. The head-mounted device according to any one of claims 1 to 5, wherein the output device includes a display device for displaying an image.

7. The display device includes a first display device and a second display device, The head-mounted device according to claim 6 , wherein the detection device detects the attitude of the device with an axis along a direction in which the first display device and the second display device are aligned as a rotation axis.

8. The head-mounted device according to any one of claims 1 to 7, wherein the output device includes an audio output device.

9. Detecting an impact applied to a mounting member that is mounted on the user's head and a posture of the mounting member; receiving an input signal regarding switching of a control mode based on the impact applied to the mounting member; determining a rotation angle of the mounting member with respect to a virtual plane perpendicular to a vertical direction, when the rotation axis is an axis parallel to the virtual plane according to the detected attitude of the mounting member; determining whether or not to validate the input signal based on the determined rotation angle; A method for controlling a head-mounted device, comprising the steps of: when the input signal is valid, causing an output device to perform an output operation in accordance with the switched control mode.

10. Detecting an impact applied to a mounting member that is mounted on the user's head and a posture of the mounting member; receiving an input signal regarding switching of a control mode based on the impact applied to the mounting member; determining a rotation angle of the mounting member with respect to a virtual plane perpendicular to a vertical direction, when the rotation axis is an axis parallel to the virtual plane according to the detected attitude of the mounting member; A control program for a head-mounted device that determines whether or not to enable the input signal based on the determined rotation angle, and, if the input signal is enabled, causes an output device to perform an output operation in accordance with the switched control mode.

Images