Operation support device, system, program, and method for adjusting visibility of a specified target

Abstract

To provide a motion support device which can support a motion by adjusting the visibility of an object for a mover who can visually recognize the prescribed object during a certain motion.SOLUTION: A motion support device comprises: visibility control means which generates visibility adjustment information including an instruction of extinguishing or reducing the visibility of a prescribed object or the visibility of a visible portion including the prescribed object for a prescribed time related to a motion; and a visual field provision unit which provides a visual field related to an environment where a motion is performed to the mover and extinguishes or reduces at least partial visibility related to the visibility adjustment information in the visual field for the prescribed time on the basis of the visibility adjustment information. It is preferable that the motion support device further comprises adjustment time determination means which determines the prescribed time on the basis of sound information, image information and the like related to the mover, the prescribed object and the like. The visual field provision unit may include a transmission type or non-transmission type display or a window part whose transmissivity can be adjusted.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a technique for assisting an action performed by an actor performing the action.

Background Art

[0002] As various sports competitions become popular, many devices and systems for evaluating actions in competitions and assisting in improving these actions have been proposed.

[0003] For example, Patent Document 1 discloses a virtual golf device that provides a plurality of play modes and a virtual golf system using the same. This device and system include a control unit that calculates the trajectory of an actual golf ball that has been struck, and a display unit that displays a virtual golf ball that moves along the trajectory calculated on a virtual golf course. In addition, the user can play in either a first mode or a second mode that are different from each other.

[0004] Also, Patent Document 2 discloses a golf lesson system that can easily evaluate a player's swing without the player being subject to physical constraints. Specifically, based on a first image when the player swings a golf club, a first analysis device that generates swing data indicating the result of analyzing the position of at least one predetermined part of the player's body and the golf club, a second analysis device that generates trajectory data regarding the trajectory of a golf ball hit by the player with the golf club, and an evaluation device that generates evaluation data indicating the result of evaluating the swing of a predetermined player based on the swing data and the trajectory data.

[0005] Furthermore, Patent Document 3 discloses a competitive practice support device that enables a competitor to objectively grasp their own state in which they can perform the best competitive actions. Specifically, this device includes a sensor that is attached to the user's body to detect and output the user's biological information, a detection means for detecting that the user has performed a competitive action, and data recording means for extracting, upon this detection, data during the period from the preparation stage of the competitive action until the competitive action is performed from the output data of the sensor and writing it to a storage device. Furthermore, it has a determination means for comparing the output data of the sensor with the stored content of the storage device to determine whether or not the competitive action can be performed well, and a notification means for performing a notification according to the determination result given by the determination means.

[0006] In addition, Patent Document 4 discloses a golf practice tool including a spherical aiming body arranged so that a ball is hidden on the line of sight of a golf player to the golf ball, a flexible wire for suspending the aiming body, a cylindrical suspension height adjustment arm through which the wire is inserted and that supports the wire so as to be slidable in the longitudinal direction, and a support body that supports the suspension height adjustment arm substantially parallel to the ground and above the aiming body. Furthermore, Patent Document 5 proposes golf sunglasses that create areas that are not visible and areas that are visible in glasses or plastic sunglasses for the purpose of hitting the core of a golf ball while concentrating on the golf ball and hardly moving the face so that only the area near the golf ball is visible.

Prior Art Documents

Patent Documents

[0007]

Patent Document 1

Patent Document 2

Patent Document 3

Patent Document 4

Patent Document 5

Non-Patent Literature

[0008]

Non-Patent Literature 1

Summary of the Invention

Problems to be Solved by the Invention

[0009] In sports competitions and the like, it has been pointed out that there are cases where, due to a strong focus of consciousness on a certain object related to the competition, it becomes impossible to perform the correct movements in that competition. For example, in golf, where the mental state of the competitor strongly affects the result, it is said that "if one looks at the golf ball too much, it is likely to enter a negative mental state such as tension, and conversely, it becomes impossible to perform a correct swing (stroke)." In this regard, there are also survey results showing that, among experienced players, the actual shot tends to be a larger swing compared to the shadow swing (see Non-Patent Literature 1). Also, based on this, as an effective practice method, it has been proposed to swing without looking at the golf ball.

[0010] However, the conventional devices and systems for supporting competitive movements as described above are not designed to eliminate the negative psychological effects caused by such visual information of "having an object." Specifically, for example, it is not even assumed that the golf ball will be made to disappear from the competitor's field of vision.

[0011] Furthermore, specifically, although the virtual golf system of Patent Document 1 does present the virtual reality of a golf competition environment, for example, it does not control the appearance of virtual reality for a real golf course according to the player's actions at all. Also, although the golf lesson system of Patent Document 2 acquires the position information of a golf club, for example, it does not use this information as a factor for determining the appearance timing of virtual reality. Additionally, although the competition practice support device of Patent Document 3 does acquire the biological information of a user, this information is only used for determining whether the competition actions can be performed well, and it is not used at all for eliminating negative psychological impacts.

[0012] Also, in the golf practice tool of Patent Document 4, in order to prevent the head from shaking during the swing, a sighting body is arranged on the line of sight of the player to the golf ball. Although the ball is indeed hidden from the field of view, instead, the sighting body is visible, so it is clearly not for eliminating negative psychological impacts. Furthermore, although the golf sunglasses of Patent Document 5 do limit the field of view, conversely, they cannot hide the ball. As a result, rather, it enhances the concentration on the ball, and some players may be strongly affected by negative psychological impacts when taking a swing.

[0013] Therefore, an object of the present invention is to provide an operation support device, system, program, and method that can support an operation by adjusting the visibility of a predetermined object for an operator who can visually recognize the predetermined object during a certain operation.

Means for Solving the Problem

[0014] According to the present invention, during a certain operation, where the action acts on or affects or can respond to the destination for an operator who can visually recognize a predetermined object, where it is recognized or determined that the operation itself may be hindered if the consciousness strongly turns towards the object, a device for supporting the operation, Visibility control means for generating visibility adjustment information including an instruction to eliminate or reduce the visibility of the predetermined object or the visibility of the visible portion including the predetermined object for a predetermined time related to the operation. A visual field providing unit that provides a visual field related to the environment in which the operation is performed for the operator, and based on the visibility adjustment information, eliminates or reduces the visibility of at least a part related to the visibility adjustment information in the visual field for the predetermined time. An operation support device having the above is provided.

[0015] This According to the invention then, there is also a device that supports the action for an operator who can visually recognize a predetermined object during a certain action, Based on at least one of the acquired voice information related to the operator, the predetermined object, or the environment, the image information related to the operator, the predetermined object, or the environment, the physical measurement information obtained by performing physical measurement on the operator or the predetermined object, and the biological measurement information obtained by performing biological measurement on the operator. related to the action Adjustment time determination means for determining a predetermined time. related to the action and visibility control means for generating visibility adjustment information including an instruction to eliminate or reduce the visibility of the predetermined object or the visibility of the visual part including the predetermined object for a predetermined time; a field of view providing unit that provides a field of view related to the environment for the operator and eliminates or reduces the visibility of at least a part related to the visibility adjustment information in the field of view for the predetermined time based on the visibility adjustment information and an operation support device is provided Having .

[0016] Further, the adjustment time determination means preferably determines the predetermined time for a shorter time as the degree of improvement of the operation is higher based on the information related to the degree of improvement of the acquired operation, and / or determines the predetermined time for a shorter time as the number of times of the operation is larger based on the information related to the number of times of the operation.

[0017] This then, further, there is a device that supports the action for an operator who can visually recognize a predetermined object during a certain action, According to the invention and Object identification means for identifying the predetermined object from the image information related to the visual field of the operator and determining the identification information of the predetermined object within the visual field. ​Based on the determined identification information, the visibility of the predetermined object related to the identification information or the visibility of the visible part including the predetermined object is related to the action Generate visibility adjustment information with an instruction content to disappear or decrease during the predetermined time visibility control means; a field of view providing unit that provides a field of view related to the environment in which the operator performs the action and eliminates or reduces the visibility of at least a part related to the visibility adjustment information in the field of view for the predetermined time based on the visibility adjustment information an operation support device having the above is provided 。

[0018] In addition, the field of view providing unit according to the present invention includes a display capable of visually recognizing the environment by transmitted light or displaying a camera image of the environment, and based on the visibility adjustment information, the visual characteristics in the display part or the display image part related to the visibility adjustment information appearing on the display disappear, decrease, or are adjusted to match or approach the surrounding visual characteristics during the predetermined time. It is also preferable to perform the display.

[0019] Furthermore, the field of view providing unit according to the present invention includes a window unit that is visible through transmitted light and whose transmittance can be adjusted, and based on the visibility adjustment information, the transmittance of the part related to the visibility adjustment information in the window unit, the transmittance of a preset part in the window unit, or the transmittance of the entire window unit is set to zero or reduced during the predetermined time. It is also preferable.

[0020] In addition, according to the present invention, there is provided an apparatus for assisting an operator in visually recognizing a predetermined object during a certain operation, The visibility of the predetermined object or the visibility of the visible part including the predetermined object is continuously or stepwise decreased within the predetermined time related to the operation for Instruction including Visibility control means for generating visibility adjustment information, Providing a field of view related to the environment in which the operator performs the operation, and based on the visibility adjustment information, continuously or stepwise decreasing the visibility of at least a part related to the visibility adjustment information in the field of view within the predetermined time. A field of view providing unit An operation support apparatus having is provided.

[0021] Furthermore, during or before the visibility of the predetermined object or the visibility of the visible portion including the predetermined object according to the present invention is extinguished or reduced, the visibility control means according to the present invention maintains the visibility of a predetermined portion of the predetermined object, superimposes a predetermined figure, symbol or character on the predetermined object or the range, and / or generates the visibility adjustment information including instructions to change the color, shape or size of the predetermined object. It is also preferable that the visual field providing unit performs the display of the instruction content of the visibility adjustment information for the predetermined object or the range during or before the visibility of the predetermined object or the visibility of the range is extinguished or reduced.

[0022] Also, the present invention according to The swing of swinging the club a device that supports the swing action for an operator who can visually recognize a golf ball during the action, visibility control means for generating visibility adjustment information including an instruction to eliminate or reduce the visibility of the golf ball or the visibility of the visual part including the golf ball for a predetermined time related to the swing action; providing a field of view related to the environment in which the operator performs the swing action, Based on the visibility adjustment information, during the predetermined time related to the swing operation by the operator, the During the predetermined time related to the swing operation, eliminating or reducing at least the visibility of the golf ball related to the visibility adjustment information in the field of view, Perform a display in which the golf ball becomes invisible or difficult to see. a field of view providing unit an operation support device having the above is provided 。

[0023] According to the present invention, also, during a certain operation, where the action acts on or affects or can respond to the destination A system for assisting an operation for an operator who can visually recognize a predetermined object that is considered or determined to be likely to interfere with the operation itself when the consciousness strongly turns to the object, including: Visibility control means for generating visibility adjustment information including an instruction to extinguish or reduce the visibility of the predetermined object or the visibility of the visible portion including the predetermined object during a predetermined time related to the operation; A visual field providing unit that provides a visual field related to the environment in which the operator performs the operation, and extinguishes or reduces at least a part of the visibility related to the visibility adjustment information in the visual field during the predetermined time based on the visibility adjustment information. An operation support system having [the following features] is provided.

[0024] According to the present invention, further, during a certain operation, where the action acts on or affects or can respond to the destination A program that causes a computer installed in a device or system that supports an operation for an operator who can visually recognize a predetermined target, which is a predetermined target that is recognized or determined to have a possibility of hindering the operation itself when the operator strongly focuses on the target, to function, This program causes the computer to function as visibility control means that generates visibility adjustment information including an instruction to eliminate or reduce the visibility of the predetermined target or the visibility of a visible part including the predetermined target for a predetermined time related to the operation, The above-described device or system provides a visual field related to the environment in which the operator performs the operation, and has a visual field providing unit that eliminates or reduces the visibility of at least a part related to the visibility adjustment information in the visual field for the predetermined time based on the visibility adjustment information. An operation support program characterized by the above is provided.

[0025] According to the present invention, also, during a certain operation, where the action acts on or affects or can respond to the destination An operation support method implemented by a computer installed in a device or system that supports an operation for an operator who can visually recognize a predetermined target, which is a predetermined target that is recognized or determined to have a possibility of hindering the operation itself when the operator strongly focuses on the target, The above-described device or system provides a visual field related to the environment in which the operator performs the operation, and has a visual field providing unit capable of eliminating or reducing the visibility of at least a part in the visual field based on the received visibility adjustment information. This operation support method includes a step of generating the visibility adjustment information including an instruction to eliminate or reduce the visibility of the predetermined target or the visibility of a visible part including the predetermined target for a predetermined time related to the operation, Output or transmit the generated visibility adjustment information to the visual field providing unit, and cause the visual field providing unit to perform a display in which at least a part of the visibility related to the visibility adjustment information in the visual field disappears or decreases during the predetermined time. There is provided an operation support method characterized by having the above.

Effect of the Invention

[0026] According to the operation support device, system, program, and method of the present invention, for an operator who can visually recognize a predetermined object during a certain operation, the operation can be supported by adjusting the visibility of the object.

Brief Description of the Drawings

[0027]

Figure 1

Figure 2

Figure 3

Mode for Carrying Out the Invention

[0028] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0029] [Operation Support Device / System] FIG. 1 is a functional block diagram showing a functional configuration in an embodiment of an operation support device according to the present invention.

[0030] As an embodiment of the operation support device according to the present invention shown in FIG. 1, the AR (Augmented Reality) glasses 1 are devices that adjust the visibility of a "predetermined object" or a visible portion including the "predetermined object" for an operator who can visually recognize the "predetermined object" during a certain "operation", and support this "operation". In this embodiment, for example, it is a device that adjusts the visibility of a golf ball that can be visually recognized when a golfer makes a shot, and supports the swing (stroke) operation.

[0031] The operator wearing the AR glasses 1 of this embodiment can visually recognize the environment for performing the actual "operation" through the transmissive display 122, and can also enjoy seeing the virtual display image portion projected on the display 122 within the visual field of this environment. Alternatively, as a modified aspect, the display 122 may be non-transmissive, display the camera image of the environment for performing the "operation" generated by the camera 101, and further be capable of displaying a virtual image accordingly.

[0032] In any case, in order for the AR glasses 1 to perform the operation support function as described above, specifically, (A) A visibility control unit 113 that generates visibility adjustment information including an instruction to eliminate or reduce the visibility of a "predetermined object" or a visible portion including the "predetermined object" for a predetermined time related to the "operation", (B) A visual field providing unit 12 that provides a visual field related to the environment for performing the "operation" to the operator, and based on the generated visibility adjustment information, eliminates or reduces the visibility of at least a part related to the visibility adjustment information in this visual field for the above-mentioned predetermined time It is characterized by having.

[0033] Here, in sports competitions and the like, it has been pointed out that there are cases where, due to a strong focus on the "predetermined object" related to the competition, it becomes impossible to perform the correct "movement" in that competition. For example, in golf where the mental state of the competitor (golfer) strongly affects the result, it is said that "if one looks at the golf ball too much, it is likely to enter a negative mental state such as tension, and conversely, it becomes impossible to perform a correct swing." In this regard, there are also survey results indicating that in the case of experienced players, the actual shot tends to be larger compared to the practice swing (see Non-Patent Document 1). Also, from this, as an effective practice method, it has been proposed to perform a swing without looking at the golf ball.

[0034] In response to such circumstances, since the AR glasses 1 have the above-described configurations (A) and (B), for example, when a golfer takes a shot as in the present embodiment, the visibility of the golf ball is eliminated or reduced during a predetermined time within the period related to the swing (the period of one shot including a predetermined time before and after the swing). As a result, it is possible to avoid a situation where the golfer falls into a negative mental state such as tension due to strongly focusing on the golf ball, and it becomes possible to encourage a more favorable swing motion for the golfer. That is, for an operator who can visually recognize a "predetermined object" during a certain "movement", by adjusting the visibility of the "predetermined object", this "movement" can be supported.

[0035] As will be described later, the AR glasses 1 incorporate the camera 101 and the microphone 102 in this embodiment, but at least one of them may be installed externally. In this case, the AR glasses 1 can acquire camera image information and / or audio information via, for example, a wireless communication network. Further, the biometric information measurement device 3, the camera 101 and / or the microphone 102, and the AR glasses 1, which will also be described later, can be connected by, for example, a wireless communication network to constitute the operation support system according to the present invention. On the other hand, the AR glasses 1 may incorporate the function of the biometric information measurement device 3, like the camera 101 and the microphone 102, as an operation support device.

[0036] Furthermore, at least one of the above-described visibility control unit 113, the adjustment time determination unit 112 to be described later, and the target identification unit 111 to be described later, which are functional components of the AR glasses 1, is a functional component of another external device, and an embodiment may be adopted in which control information is transmitted from the other device to the AR glasses having the visual field providing unit 12 via, for example, a wireless communication network. In this case, the other device and the AR glasses having the visual field providing unit 12 constitute the operation support system according to the present invention.

[0037] Of course, the operation support device / system according to the present invention is not limited to a glass / spectacle-type device (including a system) as in this embodiment. As will be described later, the present invention is applicable to various fields, and depending on the application field, for example, it can be a display device / system (transparent or non-transparent) installed in an environment where "operations" are performed. Alternatively, it can be another wearable terminal equipped with a display, or a simulator device / system equipped with a display. That is, any device / system that can provide a visual field including a "predetermined target" to an operator in a state during or before and after "operation" can be adopted as the operation support device / system according to the present invention.

[0038] Also, even when assisting a golf swing operation, the "predetermined target" that is the object of visibility adjustment is not naturally limited to a golf ball. For example, when performing a bunker shot, the visibility of the "jaw (step) of the bunker" can be eliminated or reduced by making it invisible or making it look like the same turf as the surroundings. Also, hazards such as "ponds" can be made invisible or made to look like the same turf as the surroundings. In this regard, some golfers have conventionally trained to "exclude the memory of the environment in the head assuming they are at the practice range during important shots." However, according to the operation support device and system of the present invention, it is possible to support or eliminate such training.

[0039] Furthermore, as described above, the operation support device and system according to the present invention is of course not limited to those that assist a golf swing operation. For example, it is also possible to realize the following specific examples (a) to (e). (a) In baseball, from the pitcher's field of view, for example, during the period from the start of the pitching motion to the release of the ball, the display portion (the portion visible as transmitted light) or the display image portion of the batter is erased to eliminate or reduce the negative psychological impact on the pitching motion (due to the batter being visible). (b) In the scenes of a free kick or a penalty kick in soccer, from the kicker's field of view, for example, during the period from setting the ball to the moment of kicking the ball, the display portion or the display image portion of the goalkeeper is erased so as not to be affected by the pressure (negative psychological impact) caused by the presence and movement of the goalkeeper.

[0040] (c) In the scene of a free kick in soccer, from the kicker's field of view, for example, during the period from setting the ball to the moment of kicking the ball, the visibility of the wall formed by the opposing players is eliminated or reduced (for example, the display portion or the display image portion of the wall of the opposing players is replaced with the image portion of the practice wall normally used), and the negative psychological impact from the opposing players is eliminated or reduced. (d) In land-based, swimming, speed skating, and other competitions, during the period from the start to the goal, eliminate the display part or display image part of the adjacent lane or surrounding competitors from the field of vision of the competitor, so as not to be affected by the presence and movement of competitors (negative psychological impact).

[0041] (e) In fields where "actions" are performed in front of audiences such as theater, concert, street performance, and even all sports competitions, eliminate the display part or display image part of the audience, making it difficult for the actor (such as an actor) to fall into a negative mental state such as nervousness.

[0042] [Device Configuration, Motion Support Program·Method] As also shown in the functional block diagram of FIG. 1, as an embodiment of the motion support device according to the present invention, the AR glasses 1 include a camera 101, a microphone 102, an acceleration·angular velocity sensor 103, a communication interface (IF) 104, data storage units M1, M2, and M3 capable of buffering and storing data, a vision providing unit 12 including a display control unit 121 and a display 122, and a processor·memory. Here, the processor·memory stores the motion support program according to the present invention, and also has computer functions, and implements motion support processing by executing this motion support program.

[0043] Also, from this, the motion support device according to the present invention is not limited to the AR glasses 1 as described above, and it is also possible to use other wearable terminals (equipped with a display) equipped with an embodiment of the motion support program according to the present invention, various display devices, and simulator devices.

[0044] Also, the processor - memory has, as functional components, an object identification unit 111 equipped with a learned object identification model, an adjustment time determination unit 112, and a visibility control unit 113. Note that these functional components can be regarded as functions embodied by an embodiment of the operation support program according to the present invention stored in the processor - memory. Also, the flow of processing shown by connecting the functional components of the AR glasses 1 (operation support device) in the functional block diagram of FIG. 1 with arrows can also be understood as an embodiment of the operation support method according to the present invention.

[0045] Also in FIG. 1, the object identification unit 111 identifies a golf ball (predetermined object) from the image information (in the sense of including video information) related to the golfer's (operator's) field of view, and determines the identification information of the golf ball (predetermined object) within this field of view. Here, in this embodiment, the above - mentioned image information can be the real - time camera image data generated by the camera 101 and buffered by the data storage unit M1.

[0046] Specifically, the object identification unit 111 (a) For the real - time camera image data, using a known learned object identification model (such as an object detector or a CNN image feature extractor), for example, using an object detector such as SSD (Single Shot multibox Detector), identifies a golf ball as a predetermined object, (b) The information on the position or position range of the golf ball (bounding box) within the moment - by - moment field - of - view image (image data representing the field of view) can be used as the identification information. Furthermore, (b’) The image feature amount of the golf ball within the moment - by - moment image data (field of view) may also be included in the identification information.

[0047] Also, in the present embodiment, the target identification unit 111 also generates adjustment time determination information used in the adjustment time determination process by the adjustment time determination unit 112 described later. Specifically, from the identification information of the club at each moment determined in the same manner as the identification information of the golf ball described above, at least one of information regarding the presence or absence of the club in the field of view image, information regarding the acceleration of the club, and information regarding the distance between the golf ball and the club is generated, and this may be used as the adjustment time determination information. Further, similarly, from the identification information of the golf ball at each moment, at least one of information regarding the presence or absence of the golf ball in the field of view image, information regarding the acceleration of the golf ball, and information regarding whether the golf ball and the club are in contact is generated, and this may be used as the adjustment time determination information.

[0048] Also in FIG. 1, the adjustment time determination unit 112 acquires the (a) voice information related to the golfer (the actor), the golf ball (the predetermined target), or the surrounding environment in which the swing operation is performed, (b) image information related to the golfer (the actor), the golf ball (the predetermined target), or the surrounding environment in which the swing operation is performed, (c) physical measurement information obtained by physically measuring the golfer (the actor) and the golf ball (the predetermined target), and (d) biological measurement information obtained by biologically measuring the golfer (the actor) Based on at least one of these, a "predetermined time" for adjusting (eliminating or reducing) the visibility of the golf ball (the predetermined target) or the visibility of the visible part including the golf ball (the predetermined target) is determined.

[0049] Here, in this embodiment, the audio information in (a) above can be real-time audio data generated by the microphone 102 and buffered by the data storage unit M2. Further, in this embodiment, the physical measurement information in (c) above may be information related to the "orientation of the golf head" and the "movement of the golf head (acceleration, speed)" generated by the acceleration / angular velocity sensor 103, which is a known six-axis sensor, and buffered by the data storage unit M3. It is also possible to use the ball speed measurement information of the golf ball measured by a known ball speed measuring device.

[0050] Furthermore, in this embodiment, the biological measurement information in (d) above is transmitted from a known biological information measurement device 3 attached to the body of the golfer (for example, the wrist or chest), received by the communication interface 104, and buffered by the data storage unit M3, and can be information related to "at least one of the heart rate, blood pressure, and respiratory state of the golfer" in real time. It is also possible to use the electromyogram signal information of the golfer measured by a known electromyogram signal measuring device.

[0051] In this embodiment, the adjustment time determination unit 112 that has received the information as described above (A) determines that the current time is the "start time" in the visibility adjustment of the "predetermined time", and (B) determines that the current time is the "end time" in the visibility adjustment of the "predetermined time" and notifies the visibility control unit 113 of these facts in real time. First, the determination of the "start time" in (A) above can be carried out, for example, in the following methods (a) to (e). Here, it is possible to set the time point when one or more of the conditions in methods (a) to (e) are satisfied as the "start time".

[0052] (a) Using the known voice recognition technology, when a voice indicating the start of an action such as "Start!" by the golfer or people around is detected from the acquired voice information, that point in time is defined as the "start time point". Here, applicable voice recognition technologies include, for example, technologies that recognize predetermined words, phrases, or sentences from voice information using an acoustic model and a language model constructed by a deep learning algorithm such as the LSTM (Long Short-Term Memory) algorithm and a pronunciation dictionary.

[0053] (b) After activating the operation support function of the AR glasses 1, based on the information related to the presence or absence of the club in the field of view image (adjustment time determination information) received from the target identification unit 111, the time point when it is determined that the club (the display part (the part visible as transmitted light) or the display image part) has gone out of the field of view image, that is, the time point when it has disappeared from the field of view image, is defined as the "start time point". (c) After activating the operation support function of the AR glasses 1, based on the information related to the acceleration of the club in the field of view image (adjustment time determination information) received from the target identification unit 111, the time point when it is determined that the acceleration of the club (the display part or the display image part) has exceeded a predetermined threshold value is defined as the "start time point". (d) After activating the operation support function of the AR glasses 1, based on the information related to the distance between the golf ball and the club in the field of view image (adjustment time determination information) received from the target identification unit 111, the time point when it is determined that this distance has exceeded a predetermined threshold value is defined as the "start time point".

[0054] (e) After activating the operation support function of the AR glasses 1, the time point when it is determined that any of the "data values or their change amounts of the electromyogram signal (such as of the upper arm muscle), respiratory state (including, for example, the time of holding breath or the start time point of inhalation), heart rate, and blood pressure" of the golfer is within the data value range or change amount range set by a previous experiment (as data at the start of the golfer's swing) is defined as the "start time point".

[0055] Next, the determination of the "end point" in the above (a) can be carried out, for example, in the following methods (f) to (j). Here, it is possible to set the time point when one or more of the conditions in methods (f) to (j) are satisfied as the "end point". (f) Using a known voice recognition technology, the time point when the hitting sound of the golf ball is detected from the acquired voice information is set as the "end point". (g) From the information (adjustment time determination information) regarding the presence or absence of the golf ball in the field of view image received from the target identification unit 111, the time point when it is determined that the golf ball (the display part (the part visible as transmitted light) or the display image part) has exited the field of view image, that is, the time point when it has disappeared from the field of view image, is set as the "end point".

[0056] (h) From the information (adjustment time determination information) regarding the acceleration of the golf ball in the field of view image received from the target identification unit 111, the time point when it is determined that the acceleration of the golf ball (the display part or the display image part) has exceeded a predetermined threshold value is set as the "end point". (i) From the information (adjustment time determination information) regarding whether or not the golf ball and the club are in contact in the field of view image received from the target identification unit 111, the time point when it is determined that the two are in contact, that is, when an impact has occurred, is set as the "end point".

[0057] (j) After activating the operation support function of the AR glasses 1, the time point when it is determined that any of the "data values or the amount of change thereof of the myoelectric signal (e.g., of the upper arm muscle), the respiratory state (including, for example, the start time point of breathing and the elapsed time from the start), the heart rate, and the blood pressure" of the golfer is within the data value range or the amount of change range set by a previous experiment (as the data at the end of the golfer's swing) is set as the "end point".

[0058] Also in FIG. 1, as a preferred embodiment, the adjustment time determination unit 112 preferably determines a "predetermined time" of a shorter time as the degree of improvement of the motion (swing) is higher, based on the acquired "information related to the degree of improvement of the motion (e.g., swing)". For example, the "starting point" determined as described above may be delayed more as the degree of improvement of the motion (swing) is higher, or before determining the "ending point" as described above, the time point when a lapse of an adjustment time (shorter as the degree of improvement of the motion (swing) is higher) from the "starting point" is set as the "ending point". Thereby, even if a golf ball is visible, it is possible to guide the golfer to a state where an ideal motion (swing) can be performed.

[0059] Further, the adjustment time determination unit 112 preferably determines a "predetermined time" of a shorter time as the number of motions (swings) is larger, based on the "information related to the number of motions (swings)". Here, the method for determining the "predetermined time" of a shorter time can be performed in the same manner as described above. Furthermore, the adjustment time determination unit 112 can also determine the "predetermined time" of a shorter time as described above, based on both the "information related to the degree of improvement of the motion (swing)" and the "information related to the number of motions (swings)".

[0060] Note that the "information related to the degree of improvement of the motion (swing)" and the "information related to the number of motions (swings)" can be information input or transmitted to the AR glasses 1 by the golfer himself / herself or others (such as a coach). Alternatively, the AR glasses 1 may have a function of counting the number of motions (swings) using the acceleration / angular velocity sensor 103 and generating the "information related to the number of motions (swings)".

[0061] Also in FIG. 1, the visibility control unit 113 generates visibility adjustment information including an instruction to eliminate or reduce the visibility of the golf ball (predetermined object) or the visibility of the visible portion including the golf ball (predetermined object) during the "predetermined time" related to the swing (motion).

[0062] More specifically, in the present embodiment, the visibility control unit 113 receives identification information of a golf ball (predetermined object) within the field of view from the object identification unit 111, and based on this identification information, generates visibility adjustment information including an instruction to disappear or reduce the visibility of a position range of the golf ball (bounding box) or a predetermined range including its position on the screen (display image) of the display 122 of the field of view providing unit 12 described later for a "predetermined time". Here, in the present embodiment, the visibility control unit 113 has (knows) information on the correspondence relationship between the position coordinates in the camera image and the position coordinates in the screen (display image) of the display.

[0063] For example, the visibility control unit 113 detects information related to the color and / or texture around the golf ball (bounding box) from the captured camera image, (a) When the display 122 is a transmissive type, visibility adjustment information with an instruction content to superimpose a (virtual) image portion having the detected surrounding color and / or texture on the display portion of the golf ball (the portion visible as transmitted light) can be generated. Also, (b) When the display 122 is a non-transmissive type, visibility adjustment information with an instruction content to change the color and / or texture of the display image portion of the golf ball (bounding box) to the same (or similar) ones as the detected surrounding color and / or texture may be generated.

[0064] Furthermore, as a modified aspect, the visibility control unit 113 acquires pixel values around the golf ball (bounding box) from the captured camera image, (a’) When the display 122 is a transmissive type, visibility adjustment information with an instruction content to superimpose a (virtual) image portion having pixel values determined by performing interpolation processing from the detected surrounding pixel values on the display portion of the golf ball (the portion visible as transmitted light) may be generated. Also, When the display 122 is a non-transmissive type, it is also possible to generate visibility adjustment information for an instruction to change the pixel value of the display image portion of the golf ball (the bounding box thereof) to a pixel value determined by interpolation processing from the surrounding pixel values detected from the camera image.

[0065] Here, in the present embodiment, the visibility control unit 113 outputs the above-described visibility adjustment information to the visual field providing unit 12 (the display control unit 121 thereof) at the timing when it receives a notification of the "start time" from the adjustment time determination unit 112. On the other hand, at the timing when it receives a notification of the "end time" from the adjustment time determination unit 112, it outputs visibility adjustment information for an instruction to end the above-described visibility adjustment process (return to the original screen display or display image) to the visual field providing unit 12 (the display control unit 121 thereof). Incidentally, a series of output information to the visual field providing unit 12 including the timing of outputting in this way can be regarded as "visibility adjustment information" including an instruction to adjust the visibility of the golf ball (predetermined target) for a "predetermined time".

[0066] As another modification, it is also preferable that the visibility control unit 113 generates visibility adjustment information for an instruction to continuously or stepwise decrease the visibility of the golf ball (predetermined target) or the visibility of the visible portion including the golf ball (predetermined target) within a "predetermined time". That is, the visibility control unit 113 appropriately outputs such visibility adjustment information to the visual field providing unit 12 (the display control unit 121 thereof), and it is also preferable to cause the visual field providing unit 12 to continuously or stepwise decrease the visibility of at least a part (the part related to the golf ball) in the visual field within a "predetermined time". For example, the color of the golf ball may be continuously or stepwise approximated to the surrounding color from the "start time" and adjusted to be the same as the surrounding color after a certain set time has elapsed. Also, it is preferable that the transparency of the golf ball is displayed so as to continuously or stepwise increase.

[0067] As a more preferable modification, while or before the visibility control unit 113 extinguishes or reduces the visibility of the golf ball (predetermined object) or the visible part including the golf ball (predetermined object), (a) Process of maintaining the visibility of a predetermined part of the golf ball (predetermined object) (b) Process of superimposing a predetermined figure, symbol or character on the golf ball (predetermined object) or the visible part including it, and (c) Process of changing the color, shape or size of the golf ball (predetermined object) It is also preferable to generate visibility adjustment information with an instruction content for performing at least one of the above and output it to the visual field providing unit 12 (display control unit 121 thereof). In this case, the visual field providing unit 12 performs the display of the instruction content of the visibility adjustment information received for the golf ball or the visible part including it while or before extinguishing or reducing the visibility of the golf ball or the visible part including it.

[0068] Specifically, for example, the golf ball may be continuously or stepwise reduced in size and finally displayed so as to disappear. Also, after first changing the color of the golf ball to a predetermined different color, the visibility of the golf ball may be extinguished or reduced. Further, while leaving the contour line of the equator of the golf ball (in the visible state), other parts of this golf ball may be made invisible. Also, by determining the impact point (position) of the golf ball and superimposing a predetermined mark image on this impact point (position), the golf ball may be made invisible.

[0069] Here, it is also preferable that the impact point (position) is determined by the visibility control unit 113 according to, for example, the degree of rotation applied by the golfer to the golf ball specified and input to the AR glasses 1 or the inclination of the ground on which the golf ball is placed. Also, the display timing and display time of a predetermined figure, symbol or character such as the mark image indicating the above impact point may be capable of being specified and input to the AR glasses 1 by the golfer, for example.

[0070] Also in FIG. 1, based on the visibility adjustment information received from the visibility control unit 113, the display control unit 121 of the view providing unit 12 causes the display 122 (which provides a view related to the environment in which the swinging operation is performed to the golfer) to perform a display such that at least a part of the visibility related to the visibility adjustment information in the view disappears or decreases for a "predetermined time".

[0071] Specifically, in the present embodiment, the display control unit 121 (a) When the display 122 is a transmissive type that can visually recognize the environment by transmitted light, for this display 122, the visual characteristics in the display portion (the portion visible as transmitted light) related to the received visibility adjustment information are made to disappear, or be reduced, or be matched or approximated to the surrounding visual characteristics for a "predetermined time". For example, in accordance with the visibility adjustment information, for the display portion where the golf ball is visible as transmitted light, it is also preferable to perform a display in which a virtual image portion having the same color and texture as the surrounding color and texture, or a virtual image portion having pixel values that interpolate the surrounding pixel values, is superimposed for a "predetermined time".

[0072] On the other hand, the display control unit 121 (b) When the display 122 is a non-transmissive type that can display a camera image of the environment, for this display 122, the visual characteristics in the display image portion related to the received visibility adjustment information are made to disappear, or be reduced, or be matched or approximated to the surrounding visual characteristics for a "predetermined time". For example, in accordance with the visibility adjustment information, a display may be performed in which the display image portion of the golf ball is changed to an image portion having the same color and texture as the surrounding color and texture, or an image portion having pixel values that interpolate the surrounding pixel values for a "predetermined time".

[0073] Furthermore, the display control unit 121 is as described above · "Visibility adjustment information for instructing to continuously or stepwise decrease the visibility of a golf ball or the visible part including the golf ball within a "predetermined time"" When receiving , it is also preferable to cause the display 122 to perform a display for continuously or stepwise decreasing the visibility of at least a part (display part or display image part) related to the visibility adjustment information in the field of view provided to the golfer within a "predetermined time".

[0074] Furthermore, the display control unit 121 · "Visibility adjustment information for instructing to (a) maintain the visibility of a predetermined part of the golf ball, (b) superimpose a predetermined figure, symbol or character on the golf ball or the visible part including it, and / or (c) change the color, shape or size of the predetermined object while or before eliminating or decreasing the visibility of the golf ball or the visible part including the golf ball as described above" When receiving , it is also preferable to cause the display 122 to perform a display of the above instructions ((a) to (c), at least one of them) in the visibility adjustment information received for the golf ball or the visible part including it while or before eliminating or decreasing the visibility of the golf ball or the visible part including it.

[0075] [Operation Support Method] FIG. 2 is a schematic diagram for explaining an embodiment of the operation support method according to the present invention. Here, in this embodiment, while the golfer wears the AR glasses 1 equipped with the transmissive display 122 and views the environment including the tee ground through the glasses, swings the club, and hits and launches the golf ball (predetermined object), the golfer receives support (visibility adjustment) from the AR glasses 1 so that his / her swing motion becomes good.

[0076] First, as shown in FIG. 2(A), the target identification unit 111 identifies a golf ball placed (teed up) on the teeing ground, and outputs identification information related to its position or position range to the visibility control unit 113. Also, when it is determined that the club has gone out of the field of view image (the time when it has disappeared from the field of view image) due to the golfer swinging the club upward, the adjustment time determination unit 112 immediately notifies the visibility control unit 113 that "the current time is the start time", taking this time point as the "start time".

[0077] Next, as shown in FIG. 2(B), based on the received identification information and the notification related to the "start time", the visibility control unit 113 generates visibility adjustment information with the instruction content of "from the current time, superimpose a virtual image portion (having interpolated pixel values) on the display portion related to the golf ball", and outputs it to the visual field providing unit 12. Here, upon receiving such visibility adjustment information, the visual field providing unit 12 immediately superimposes the specified virtual image portion on the display portion related to the golf ball on the display 122, and as a result, implements a display such that the golf ball cannot be seen.

[0078] After that, the target identification unit 111 continues to identify (track) the golf ball, and continues to output identification information related to its position or position range to the visibility control unit 113. Also, based on the visibility adjustment information sequentially received from the visibility control unit 113, the visual field providing unit 12 implements a display such that the golf ball cannot be seen continuously (the virtual image portion continues to be superimposed on the display portion of the golf ball). Next, as shown in FIG. 2(C), when it is determined that the golf ball hit by the swung club has gone out of the field of view image (the time when it has disappeared from the field of view image), the adjustment time determination unit 112 immediately notifies the visibility control unit 113 that "the current time is the end time", taking this time point as the "end time".

[0079] Next, as shown in FIG. 2(D), based on the received identification information and the notification regarding the "end point in time", the visibility control unit 113 generates visibility adjustment information with the instruction content of "ending the superposition of the virtual image portion on the display portion related to the golf ball from the current time (returning to the display of the environment by the original transmitted light)" and outputs it to the visual field providing unit 12. Here, upon receiving such visibility adjustment information, the visual field providing unit 12 immediately ends the display of the virtual image portion superimposed on the display portion related to the golf ball on the display 122. As a result, a display is implemented such that the (flying) golf ball can be seen.

[0080] As described above, according to the operation support method of the present embodiment described with reference to FIGS. 2(A) to 2(D), a golfer wearing the AR glasses 1 cannot see the golf ball during the "predetermined time" in one swing operation, that is, from the start of swinging the club until hitting and flying the golf ball with the club swung down. As a result, it is possible to avoid a situation where a negative mental state such as tension (by seeing the golf ball) causes the golfer to fall into a state where they cannot perform a correct swing, and thus it becomes possible to perform or acquire a good swing operation. Further, outside the "predetermined time" when visibility adjustment is required for swing support, the golf ball is visible, so the golfer can, for example, track the trajectory of the hit golf ball.

[0081] [Other Embodiments of the Operation Support Device] FIG. 3 is a functional block diagram showing the functional configuration in another embodiment of the operation support device according to the present invention.

[0082] According to FIG. 3, the variable transmittance glasses 2, which are the operation support device of the present embodiment, are the same as the AR glasses 1 (FIG. 1) and adjust the visibility of a predetermined object or a visible portion including the predetermined object for an operator who can visually recognize a predetermined object during a certain operation, and is a device that supports this operation. In the present embodiment, it is a device that adjusts the visibility of the golf ball that can be visually recognized when a golfer makes a shot and supports the improvement of the swing operation.

[0083] Specifically, the transparency-variable glass 2 includes a camera 201, a microphone 202, an acceleration / angular velocity sensor 203, a communication interface (IF) 204, data storage units M1 to M3, an object identification unit 211, an adjustment time determination unit 212, and a visibility control unit 213. These (functional) components have the same structure and function as the corresponding (functional) components in the AR glasses 1 (Fig. 1). Also, the object identification unit 211, the adjustment time determination unit 212, and the visibility control unit 213 can be regarded as functions implemented by an embodiment of the operation support program according to the present invention and stored in a processor / memory.

[0084] However, the vision providing unit 22 of the transparency-variable glass 2 is different from the vision providing unit 12 (Fig. 1). It includes (a) a window unit 222 that enables the environment where the operation is performed to be visible through transmitted light and whose transparency can be adjusted, and (b) a display control unit 221 that outputs an instruction to set the transparency of the window portion related to the visibility adjustment information in the window unit 222 to zero or reduce it for a "predetermined time" based on the visibility adjustment information received from the visibility control unit 213. It is configured to have these components.

[0085] Also, the visibility control unit 213 receives the identification information from the object identification unit 211 and the notification related to the start / end time from the adjustment time determination unit 212, generates visibility adjustment information specifying the "position range of the window portion" for which the visibility adjustment as in (b) above should be performed, and outputs it to the display control unit 221.

[0086] Here, the window portion 222 in (a) above may be configured using, for example, a liquid crystal dimming film such as the "Liquid Crystal Dimming Film LC MAGIC" disclosed in [online], [searched on January 16, 2022], Internet <URL: https: / / www.toppan.co.jp / electronics / device / lc_magic / >. Also, in this case, the window portion 222 may have liquid crystal dimming film pieces provided (for example, in a form attached to a transparent substrate) in each of one or more "position ranges of the window portion" within the window portion 222, and the transparency (transparency) of each position range can be adjusted individually.

[0087] The display control unit 221 performs control on such a window portion 222 to set the transparency (transparency) of the "position range of the window portion" specified by the received visibility adjustment information to zero, decrease it, or continuously or stepwise decrease it, or even return it to the original state according to the instruction content of the visibility adjustment information.

[0088] According to the variable transmittance glass 2 as described above, when a golfer makes a shot, during the "predetermined time" in the swing motion, the transparency (transparency) of the window portion where the golf ball can be seen is set to zero or decreased, eliminating the negative psychological impact caused by the visibility of the golf ball, and thereby making it possible to assist in improving the swing motion.

[0089] As a modification, the window portion 222 may (a) have liquid crystal dimming film pieces attached to a preset window portion (usually as the position range where the golf ball can be seen), and the transmittance of the window portion may be variable, or (b) have a single liquid crystal dimming film attached to the entire window portion 222, and the transmittance of the entire portion may be variable.

[0090] In this case, the display control unit 221 receives visibility adjustment information from the visibility control unit 213 and performs control to set the transparency (transparency) of the set window portion or (b) the transparency (transparency) of the entire window unit 222 to zero or decrease it for the window unit 222 for a "predetermined time". Even with such control, it is possible to make the visibility of the golf ball (predetermined target) disappear or decrease for the "predetermined time". In this case, the target identification unit 211 can be omitted. As a result, it is not necessary to perform a process with a large burden such as an image recognition process, and it becomes possible to more easily perform real-time display control.

[0091] As described in detail above, according to the present invention, it is possible to assist an operation by adjusting the visibility of a predetermined target for an operator who can visually recognize the predetermined target during a certain operation. Here, the fields in which operation support can be performed by the present invention are not limited to the field of sports competitions such as golf, but include various fields related to life involving various operations. Therefore, the present invention can also contribute to assisting in improving a predetermined operation in a life scene and proposing and providing a more comfortable or enjoyable lifestyle.

[0092] Also, in classes related to predetermined sports operations in schools and private sports schools, in the scene of practicing or training predetermined operations in professional sports, and further in the scene of practicing or training a job involving a predetermined operation, by applying the operation support according to the present invention, it is also possible to promote the improvement of predetermined operations in sports and jobs for more children and adults. That is, according to the present invention, it is also possible to contribute to the achievement of Goal 4 of the Sustainable Development Goals (SDGs) led by the United Nations, "Provide inclusive and equitable quality education for all people and promote lifelong learning opportunities", and Goal 8, "Promote inclusive and sustainable economic growth, employment and decent work for all people".

[0093] Regarding the various embodiments of the present invention described above, various changes, modifications, and omissions within the scope of the technical idea and perspective of the present invention can be easily made by those skilled in the art. The foregoing description is merely an example and is not intended to impose any restrictions. The present invention is limited only by the claims and their equivalents.

Explanation of Reference Numerals

[0094] 1 AR Glass (Operation Support Device) 101, 201 Camera 102, 202 Microphone 103, 203 Acceleration and Angular Velocity Sensor 104, 204 Communication Interface (IF) 111, 211 Object Identification Unit 112, 212 Adjustment Time Determination Unit 113, 213 Visibility Control Unit 12, 22 Field of View Provision Unit 121, 221 Display Control Unit 122 Display 2 Transmittance Variable Glass (Operation Support Device) 222 Window Unit 3 Biometric Information Measurement Device

Claims

1. During a certain operation, for an operator who can visually recognize a predetermined object that is the destination of the operation or is affected by the operation or can respond to the operation, and for which it is recognized or determined that strong attention directed towards the object may cause an obstacle to the operation itself, a device for assisting the operation, comprising: Visibility control means for generating visibility adjustment information including an instruction to eliminate or reduce the visibility of the predetermined object or the visibility of a visible part including the predetermined object for a predetermined time related to the operation; A field-of-view providing unit that provides a field of view related to the environment for the operator to perform the operation, and based on the visibility adjustment information, eliminates or reduces the visibility of at least a part of the visibility adjustment information in the field of view for the predetermined time; An operation support device characterized by comprising the above.

2. A device for assisting an operation for an operator who can visually recognize a predetermined object during a certain operation, comprising: Adjustment time determination means for determining a predetermined time related to the operation based on at least one of the acquired voice information related to the operator, the predetermined object, or the environment of the operation, the image information related to the operator, the predetermined object, or the environment, the physical measurement information obtained by physically measuring the operator or the predetermined object, and the biological measurement information obtained by biologically measuring the operator; Visibility control means for generating visibility adjustment information including an instruction to eliminate or reduce the visibility of the predetermined object or the visibility of a visible part including the predetermined object for the predetermined time; A field-of-view providing unit that provides a field of view related to the environment for the operator, and based on the visibility adjustment information, eliminates or reduces the visibility of at least a part of the visibility adjustment information in the field of view for the predetermined time; An operation support device characterized by comprising the above.

3. A device for assisting an operation for an operator who can visually recognize a predetermined object during a certain operation, comprising: Object identification means for identifying the predetermined object from the image information related to the field of view of the operator and determining the identification information of the predetermined object within the field of view; Visibility control means for generating visibility adjustment information with an instruction content to eliminate or reduce the visibility of the predetermined object related to the identification information or the visibility of a visible part including the predetermined object for a predetermined time related to the operation based on the determined identification information; A vision providing unit that provides a vision related to an environment in which the operation is performed for the operator, and based on the visibility adjustment information, causes at least a part of the visibility related to the visibility adjustment information in the vision to disappear or decrease during the predetermined time An operation support device characterized by comprising the same. **Claim 4** An apparatus for assisting an operation for an operator who can visually recognize a predetermined object during a certain operation, Visibility control means for generating visibility adjustment information including an instruction to continuously or stepwise decrease the visibility of the predetermined object or the visibility of a visible part including the predetermined object within a predetermined time related to the operation, A vision providing unit that provides a vision related to an environment in which the operation is performed for the operator, and based on the visibility adjustment information, continuously or stepwise decreases at least a part of the visibility related to the visibility adjustment information in the vision within the predetermined time An operation support device characterized by comprising the same. **Claim 5** An apparatus for assisting a swinging operation for an operator who can visually recognize a golf ball during a swinging operation of swinging a club, Visibility control means for generating visibility adjustment information including an instruction to disappear or decrease the visibility of the golf ball or the visibility of a visible part including the golf ball during a predetermined time related to the swinging operation, A vision providing unit that provides a vision related to an environment in which the swinging operation is performed for the operator, and based on the visibility adjustment information, during the predetermined time related to the swinging operation by the operator, causes at least the visibility of the golf ball related to the visibility adjustment information in the vision to disappear or decrease, and performs a display that makes the golf ball invisible or difficult to visually recognize An operation support device characterized by comprising the same. **Claim 6** The adjustment time determination means determines the predetermined time of a shorter time as the degree of improvement of the operation is higher based on the information related to the degree of improvement of the obtained operation, and / or determines the predetermined time of a shorter time as the number of times of the operation is larger based on the information related to the number of times of the operation. The operation support device according to claim 2, characterized in that. **Claim 7** The visual field providing unit includes a display capable of visually recognizing the environment through transmitted light or displaying a camera image of the environment, and based on the visibility adjustment information, the visual features in the display portion or the display image portion related to the visibility adjustment information appearing on the display are made to disappear, reduced, adjusted to match the surrounding visual features, or brought closer during the predetermined time. The operation support device according to any one of claims 1 to 6, characterized in that.

8. The visual field providing unit includes a window unit that is visible through transmitted light in the environment and whose transmittance can be adjusted, and based on the visibility adjustment information, the transmittance of the portion related to the visibility adjustment information in the window unit, the transmittance of a preset portion in the window unit, or the transmittance of the entire window unit is set to zero or reduced during the predetermined time. The operation support device according to any one of claims 1 to 6, characterized in that.

9. The visibility control means generates the visibility adjustment information having an instruction content of maintaining the visibility of a predetermined portion of the predetermined object, superimposing a predetermined figure, symbol, or character on the predetermined object or the visual portion including the predetermined object, and / or changing the color, shape, or size of the predetermined object while or before making the visibility of the predetermined object or the visual portion including the predetermined object disappear or decrease. The visual field providing unit performs the display of the instruction content of the visibility adjustment information for the predetermined object or the visual portion including the predetermined object while or before making the visibility of the predetermined object or the visual portion including the predetermined object disappear or decrease. The operation support device according to claim 1, 2, 3, 4, or 6, characterized in that.

10. A system for assisting an operator in performing an operation, where during a certain operation, a predetermined object that is the destination of the operation or can react to the operation and is recognized or determined to have a possibility of obstructing the operation itself when the operator strongly directs their consciousness towards the object is made visible, Visibility control means for generating visibility adjustment information including an instruction to make the visibility of the predetermined object or the visual portion including the predetermined object disappear or decrease during a predetermined time related to the operation. Providing a field of view related to the environment in which the operation is performed for the operator, and based on the visibility adjustment information, causing at least a part of the visibility related to the visibility adjustment information in the field of view to disappear or decrease during the predetermined time; a field of view providing unit An operation support system characterized by comprising the same.

11. A program for causing a computer mounted on a device or system that supports an operation for an operator who can visually recognize a predetermined object that is a destination where the operation acts or has an impact during a certain operation or that can react to the operation and where there is a possibility that the operation itself may be hindered if the operator strongly directs his / her consciousness to the object, The program causes the computer to function as visibility control means for generating visibility adjustment information including an instruction for causing the visibility of the predetermined object or the visibility of a visible part including the predetermined object to disappear or decrease during a predetermined time related to the operation, The device or system has a field of view providing unit that provides a field of view related to the environment in which the operation is performed for the operator, and based on the visibility adjustment information, causes at least a part of the visibility related to the visibility adjustment information in the field of view to disappear or decrease during the predetermined time An operation support program characterized by the above.

12. An operation support method implemented by a computer mounted on a device or system that supports an operation for an operator who can visually recognize a predetermined object that is a destination where the operation acts or has an impact during a certain operation or that can react to the operation and where there is a possibility that the operation itself may be hindered if the operator strongly directs his / her consciousness to the object, The device or system has a field of view providing unit that provides a field of view related to the environment in which the operation is performed for the operator and that can cause at least a part of the visibility in the field of view to disappear or decrease based on the received visibility adjustment information, The operation support method includes a step of generating the visibility adjustment information including an instruction for causing the visibility of the predetermined object or the visibility of a visible part including the predetermined object to disappear or decrease during a predetermined time related to the operation, Output or transmit the generated visibility adjustment information to the visual field providing unit, and cause the visual field providing unit to perform a display in which at least a part of the visibility related to the visibility adjustment information in the visual field disappears or decreases during the predetermined time. An operation support method characterized by comprising the above.

Images