Information processing device, control method thereof, and program

Abstract

To reduce a risk of collision between a user wearing an information processing device so as to cover a field of vision and people around the user by giving an appropriate warning to the people around the user.SOLUTION: An information processing device 100, which is worn by a user so as to cover a field of vision of the user, acquires a result of detecting people around the user (S202), and issues a warning to at least the people in the vicinity based on a distance between the user and the people in the vicinity (S204 to S206).SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an information processing device, a control method thereof, and a program. [Background technology]

[0002] A head-mounted display, which is a type of information processing device, does not allow a user to see the surroundings while wearing it (as it is worn in a way that covers the user's field of vision), so there is a risk that the user may collide with an obstacle. In this regard, Patent Document 1 describes a technology that displays a warning on the head-mounted display to alert the user when there is a possibility that the user wearing the head-mounted display may collide with an obstacle. Furthermore, Patent Document 2 describes a technology that detects actions by persons other than the user wearing the head-mounted display, and warns the user when there is a possibility that the user may be harmed. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6539351 [Patent Document 2] Patent Publication No. 2022-22223 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technologies described in Patent Documents 1 and 2 above provide a warning to the user wearing the head mounted display, but do not provide a warning to people around the user. In this regard, people around the user cannot know how much the user wearing the head mounted display is aware of the surrounding situation, or how the user wearing the head mounted display sees the surroundings. Therefore, people around the user cannot judge how far away they should be from the user wearing the head mounted display, whether there is a risk of collision with the user wearing the head mounted display, etc.

[0005] The present invention has been made in consideration of such problems, and aims to provide an appropriate warning to people around a user who is wearing an information processing device so that it covers the user's field of vision, thereby reducing the risk of collision between the user and those people. [Means for solving the problem]

[0006] The information processing device of the present invention is an information processing device that is worn so as to cover the user's field of vision, and is equipped with an acquisition means for acquiring the results of detecting people around the user, and a warning means for issuing a warning to at least the surrounding people based on the distance between the user wearing the information processing device and the surrounding people. In addition, the information processing device of the present invention is an information processing device that is worn so as to cover the user's field of vision, and is equipped with an acquisition means for acquiring the results of detecting people around the user, and a warning means for issuing a warning to at least the surrounding people based on the distance between a virtual boundary line indicating the movement range of the user wearing the information processing device and the surrounding people. Effect of the Invention

[0007] According to the present invention, it is possible to provide appropriate warnings to people around a user who is wearing an information processing device so as to cover their field of vision, thereby reducing the risk of collision between the user and people around them. [Brief description of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating an example of a schematic configuration of an information processing device according to a first embodiment. [Diagram 2] 4 is a sequence diagram showing an example of a processing procedure in a control method of the information processing device according to the first embodiment. FIG. [Diagram 3] 5 is a flowchart showing an example of a processing procedure in a control method for the information processing device according to the first embodiment. [Figure 4] FIG. 11 is a diagram illustrating an example of a schematic configuration of an information processing system according to a second embodiment. [Diagram 5] FIG. 11 is a diagram illustrating an example of a communication connection form between an information processing device and an input device according to a second embodiment. [Figure 6] FIG. 11 is a sequence diagram showing an example of a processing procedure in a control method for an information processing device and an input device according to a second embodiment. [Figure 7] 10 is a flowchart showing an example of a processing procedure in a control method for an information processing device according to a second embodiment. [Figure 8] 10 is a flowchart showing an example of a processing procedure in a control method for an input device according to a second embodiment. [Figure 9] FIG. 11 is a diagram illustrating an example of a schematic configuration of an information processing system according to a third embodiment. [Figure 10] FIG. 11 is a diagram showing an example of a communication connection form between an information processing device according to a third embodiment and a measurement device and a surrounding person portable terminal device. [Figure 11] FIG. 11 is a sequence diagram showing an example of a processing procedure in a control method for an information processing device, a measurement device, and a surrounding person mobile terminal device according to a third embodiment. [Figure 12] 13 is a flowchart showing an example of a processing procedure in a control method of an information processing device according to a third embodiment. [Figure 13] 13 is a flowchart showing an example of a processing procedure in a control method for a measurement apparatus according to a third embodiment. [Figure 14] 13 is a flowchart showing an example of a processing procedure in a control method for a nearby person mobile terminal device according to a third embodiment. [Figure 15] 13 is a flowchart showing an example of a processing procedure in a control method for an information processing device according to a fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0010] (First embodiment) First, the first embodiment will be described.

[0011] The first embodiment is a form in which a degree of danger is calculated based on the distance between a user wearing an information processing device such as a head mounted display so as to cover the field of view and people around him / her, and a warning is issued to the user and people around him / her according to the degree of danger. At this time, there are various methods for issuing a warning, but in the first embodiment, a method of emitting light of a color, generating (or playing) a warning sound, and displaying a warning will be described.

[0012] 1 is a diagram showing an example of a schematic configuration of an information processing device 100 according to a first embodiment. In the first embodiment, a description will be given assuming that the information processing device 100 is a head mounted display worn by a user so as to cover the user's field of vision.

[0013] As shown in FIG. 1, the information processing device 100 includes a control unit 101, a storage unit 102, a memory 103, an input unit 104, an output unit 105, a detection unit 106, and a communication unit 107.

[0014] The control unit 101 controls each component (102 to 107) of the information processing device 100 to comprehensively control the operation of the information processing device 100 and perform various processes. Note that instead of the control unit 101 controlling the overall operation of the information processing device 100, the overall operation of the information processing device 100 may be controlled by multiple hardware components sharing the processing.

[0015] The storage unit 102 is an electrically erasable and recordable non-volatile storage medium such as an SSD (Solid State Drive) or a flash memory. The storage unit 102 stores programs executed by the control unit 101, databases of various data, user setting information, etc. The storage unit 102 also stores various information and data obtained by the control and processing executed by the control unit 101.

[0016] The memory 103 is, for example, a random access memory (RAM), and is used as a buffer memory that temporarily stores various types of information and data, a working area for the control unit 101, and the like.

[0017] The input unit 104 is used for inputting instructions from a user to the information processing device 100. The input unit 104 includes, for example, a power button for instructing ON / OFF of the power supply of the information processing device 100, a screen transition operation button for instructing screen transition, an operation mode operation button for instructing the operation mode of the information processing device 100, and the like. Note that the input unit 104 does not necessarily need to be built into the information processing device 100.

[0018] The output unit 105 includes, for example, a GUI (Graphical User Interface) display device for interactive operations, a light emitting device such as an LED (Light Emitting Diode), a sound output device such as a speaker, etc. Note that the output unit 105 does not necessarily need to be built into the information processing device 100.

[0019] The detection unit 106 includes, for example, an imaging sensor that captures surrounding images, and sensors such as LiDAR (Light Detection And Ranging) and ToF (Time of Flight) that measure surrounding conditions. Furthermore, the detection unit 106 includes, for example, an IMU (Inertial Measurement Unit) and a geomagnetic sensor for measuring attitude and position. Note that the detection unit 106 does not necessarily need to be built into the information processing device 100.

[0020] The communication unit 107 includes, for example, a connector (RJ45) for connecting to Ethernet, a NIC (Network Interface Card) incorporating a communication IC, etc. Furthermore, the communication unit 107 includes, for example, a communication unit such as Wi-Fi or Bluetooth for wireless communication with an external device including a controller. Note that the communication unit 107 does not necessarily need to be built into the information processing device 100.

[0021] Here, a method for calculating the risk level in the first embodiment will be described. In the first embodiment, the possibility of a collision between a user wearing a head mounted display applied as the information processing device 100 and a person around the user is defined as a risk level x as follows.

[0022] In the first embodiment, the distance between the user and the surrounding people is defined as α, and the danger level x is defined as x=1÷α. In this calculation formula of the danger level x, when the distance between the user and the surrounding people becomes closer and the value of the distance α becomes smaller, the possibility of the user colliding with the surrounding people increases, and the value of the danger level x becomes larger. That is, in the first embodiment, the value of the danger level x becomes larger as the distance α between the user and the surrounding people becomes smaller. In addition, when there are multiple people (n) around the user, the values ​​of the distances α1 to αn between the user and each of the surrounding people are used to calculate the danger levels x1 to xn for each of the surrounding people. Note that the calculation method of the danger level x described here is merely an example, and the definition and calculation formula of the danger level x may be different.

[0023] Next, a method for warning a user and people around the user will be described in the first embodiment. In the first embodiment, a first threshold t1 and a second threshold t2 (t2>t1), which are two thresholds, are set for a risk level calculated based on a distance between a user wearing a head mounted display applied as the information processing device 100 and people around the user.

[0024] In the first embodiment, when the risk level is less than the first threshold value t1, it is determined that the risk level of a collision between the user and people around is low and the situation is safe. In this case, an LED mounted on the outside of the head mounted display used as the information processing device 100 is made to emit blue light in order to inform people around the user that it is safe.

[0025] In the first embodiment, when the risk level is equal to or higher than the first threshold value t1 and lower than the second threshold value t2, it is determined that the risk level of a collision between the user and people nearby is medium and caution (warning) is required. In this case, to inform people nearby that caution is required, an LED mounted on the outside of the head mounted display used as the information processing device 100 is caused to emit yellow light to warn the people nearby.

[0026] In the first embodiment, when the risk level is equal to or higher than the second threshold value t2, it is determined that the risk of collision between the user and surrounding people is high and the situation is dangerous. In this case, in order to inform surrounding people of the danger, an LED mounted on the outside of the head-mounted display used as the information processing device 100 is caused to emit red light to warn the surrounding people. In addition, a warning sound is generated from a speaker to warn the surrounding people and the user. Furthermore, a warning is displayed on the head-mounted display used as the information processing device 100 to the effect that there is a possibility of collision with surrounding people, to warn the user.

[0027] Furthermore, in the case where there are multiple people around the user, for example, a warning is given to the person with the highest risk level x among the multiple people around. Note that the method of warning the user and the people around him / her described here is merely an example, and other different warning methods may be used.

[0028] Fig. 2 is a sequence diagram showing an example of a processing procedure in a control method of the information processing device 100 according to the first embodiment. Specifically, Fig. 2 shows a flow of processing performed by the information processing device 100 when a person in the vicinity approaches while a user is wearing a head mounted display applied as the information processing device 100.

[0029] When the process of the sequence diagram shown in FIG. 2 starts, first, in step S201, the user wears the information processing device 100 so as to cover his or her field of vision.

[0030] Next, in step S202, the control unit 101 of the information processing device 100 measures the situation around the information processing device 100 (around the user) via the detection unit 106, and performs processing to detect people in the vicinity.

[0031] Next, in step S203, the control unit 101 of the information processing device 100 calculates the degree of danger to the surrounding people detected in step S202. Here, in the first embodiment, as described above, the distance between the user and the surrounding people is set to α, and the degree of danger x is calculated as x=1÷α.

[0032] Next, in step S204, the control unit 101 of the information processing device 100 performs light emission processing via the output unit 105 in accordance with the degree of danger calculated in step S203.

[0033] Next, in step S205, the control unit 101 of the information processing device 100 generates an alarm sound via the output unit 105 according to the degree of danger calculated in step S203.

[0034] Subsequently, in step S206, the control unit 101 of the information processing device 100 displays a warning in the information processing device 100 (head mounted display: HMD) via the output unit 105 according to the degree of danger calculated in step S203.

[0035] Next, a detailed process procedure of a control method of the information processing device 100 for implementing the sequence diagram shown in FIG. 2 will be described with reference to FIG.

[0036] Fig. 3 is a flowchart showing an example of a processing procedure in the control method of the information processing device 100 according to the first embodiment. The processing of the flowchart shown in Fig. 3 is started when the user wears the information processing device 100 so as to cover the field of view and the information processing device 100 is started.

[0037] 3 starts, first, in step S301, the control unit 101 of the information processing device 100 determines whether or not to end the processing based on the state of each component of the information processing device 100. For example, the control unit 101 determines to end the processing when a stop operation is performed via the input unit 104 or when the control unit 101 detects via the detection unit 106 that the user has detached the information processing device 100.

[0038] As a result of the determination in step S301, if the process is not to be ended (the process is to be continued) (S301 / NO), the process proceeds to step S302. When the process proceeds to step S302, the control unit 101 determines whether or not a surrounding person has been detected via the detection unit 106. The process of step S302 corresponds to the process of step S202 shown in Fig. 2. As a result of the determination in step S302, if a surrounding person has not been detected (S302 / NO), the process returns to the process of step S301.

[0039] Also, if it is determined in step S302 that a person in the vicinity has been detected (S302 / YES), the process proceeds to step S303. In step S303, the control unit 101 initializes the maximum value x' of the degree of risk (x'=0).

[0040] Next, in step S304, the control unit 101 acquires the distance between the user wearing the information processing device 100 (which may be the information processing device 100) and the surrounding people detected in step S302.

[0041] Next, in step S305, the control unit 101 calculates the value of the danger level x based on the distance between the user (which may be the information processing device 100) and people around the user, which was acquired in step S304.

[0042] Subsequently, in step S306, the control unit 101 determines whether or not the value of the risk level x calculated in step S305 is greater than the maximum risk level x'.

[0043] If it is determined in step S306 that the value of the risk level x calculated in step S305 is greater than the maximum risk level x' (S306 / YES), the process proceeds to step S307. In step S307, the maximum value x' of the risk level is updated with the value of the risk level x calculated in step S305 (x'=x).

[0044] Also, if it is determined in step S306 that the value of the risk level x calculated in step S305 is not greater than the maximum risk level x' (S306 / NO), the process proceeds to the next step.

[0045] Here, the above-mentioned processes of steps S304 to S307 are performed for all surrounding people detected in step S302. That is, the above-mentioned processes of steps S304 to S307 are repeatedly performed the same number of times as the number of surrounding people detected in step S302. Also, the above-mentioned processes of steps S303 to S307 correspond to the process of step S203 shown in FIG. 2.

[0046] Subsequently, in step S308, the control unit 101 determines whether or not the maximum value x' of the degree of risk is less than the first threshold value (less than the first threshold value t1).

[0047] If it is determined in step S308 that the maximum value x' of the risk level is less than the first threshold value t1 (S308 / YES), the process proceeds to step S309. In step S309, the control unit 101 causes the LED mounted on the information processing device 100 to emit blue light via the output unit 105. The process of step S309 corresponds to the process of step S204 shown in FIG.

[0048] Next, in step S310, the control unit 101 stops the warning sound when a warning sound is being generated from a speaker mounted on the information processing device 100 via the output unit 105. Furthermore, when a warning sound is not being generated from the speaker, the control unit 101 performs processing to maintain this state.

[0049] Next, in step S311, if a warning is being displayed on the internal display of the information processing device 100 via the output unit 105, the control unit 101 makes the warning invisible. If no warning is being displayed on the display, the control unit 101 performs processing to maintain this state. Then, when the processing of step S311 ends, the process returns to step S301.

[0050] Also, if it is determined in step S308 that the maximum value x' of the risk level is not less than the first threshold value t1 (is equal to or greater than the first threshold value) (S308 / NO), the process proceeds to step S312. In step S312, the control unit 101 determines whether or not the maximum value x' of the degree of risk is less than a second threshold value (less than a second threshold value t2) that is greater than the first threshold value t1.

[0051] As a result of the determination in step S312, if the maximum value x' of the risk level is less than the second threshold value t2 (S312 / YES), the process proceeds to step S313. Note that the process proceeds to step S313 when the maximum value x' of the risk level is equal to or greater than the first threshold value (equal to or greater than the first threshold value t1) and less than the second threshold value (less than the second threshold value t2). In step S313, the control unit 101 issues a warning to people in the vicinity by causing an LED mounted on the information processing device 100 to emit yellow light via the output unit 105. The process of step S313 corresponds to the process of step S204 shown in FIG.

[0052] Next, in step S314, the control unit 101 stops the warning sound when a warning sound is being generated from a speaker mounted on the information processing device 100 via the output unit 105. Furthermore, when a warning sound is not being generated from the speaker, the control unit 101 performs processing to maintain this state.

[0053] Next, in step S315, if a warning is being displayed on the internal display of information processing device 100 via output unit 105, control unit 101 hides the warning. If no warning is being displayed on the display, control unit 101 performs processing to maintain this state. Then, when the processing of step S315 ends, the process returns to step S301.

[0054] Also, if it is determined in step S312 that the maximum value x' of the risk level is not less than the second threshold value t2 (is equal to or greater than the second threshold value) (S312 / NO), the process proceeds to step S316. In step S316, the control unit 101 issues a warning to people in the vicinity by causing an LED mounted on the information processing device 100 to emit red light via the output unit 105. The process of step S316 corresponds to the process of step S204 shown in FIG.

[0055] Next, in step S317, the control unit 101 generates a warning sound from a speaker mounted on the information processing device 100 via the output unit 105 to warn people in the vicinity (and further, the user wearing the information processing device 100). The process of this step S317 corresponds to the process of step S205 shown in FIG.

[0056] Next, in step S318, the control unit 101 displays a warning on the internal display of the information processing device 100 via the output unit 105 to warn the user wearing the information processing device 100. The process of this step S318 corresponds to the process of step S206 shown in Fig. 2. Then, when the process of step S318 ends, the process returns to step S301.

[0057] Also, as a result of the determination in step S301, if the process is to be ended (S301 / YES), the process of the flowchart shown in FIG. 3 is ended.

[0058] In the information processing device 100 according to the first embodiment described above, the control unit 101 performs a process of acquiring the results of detecting people around the user who wears the information processing device 100 so as to cover the field of vision (S202, S302). The control unit 101 performing this acquiring process corresponds to an acquiring means. Then, in the first embodiment, the control unit 101 issues a warning to at least the people around the user who wears the information processing device 100 based on the distance between the user and the people around them (S304, S313, S316 to S318). The control unit 101 issuing this warning corresponds to a warning means. According to the information processing device 100 of the first embodiment, it is possible to provide appropriate warnings to people around a user who is wearing the information processing device 100 so as to cover the user's field of vision, thereby reducing the risk of collision between the user and people around the user.

[0059] Specifically, when the degree of danger, which increases as the distance between the user and people around him / her decreases, is equal to or greater than a predetermined threshold (equal to or greater than second threshold t2), the control unit 101 issues a warning to the user and people around him / her (S316 to 318).

[0060] Furthermore, the control unit 101 issues a warning to people in the vicinity when the degree of danger, which increases as the distance between the user and people in the vicinity decreases, is equal to or greater than the first threshold value t1 and less than the second threshold value t2 (S313). According to this configuration, when the danger level is medium, a warning is only given to people around, but if the people around avoid the dangerous environment, the user can also avoid the dangerous environment without being warned. As a result, the user can enjoy a sense of immersion without losing the sense of immersion when using the head mounted display applied as the information processing device 100.

[0061] Furthermore, the control unit 101 performs control to emit light of different colors to people in the vicinity when the risk level is less than the first threshold value t1, when the risk level is equal to or greater than the first threshold value t1 and less than the second threshold value t2, and when the risk level is equal to or greater than the second threshold value t2 (S309, S313, S316). The control unit 101 that performs control to emit light of different colors corresponds to a light emission control means.

[0062] Second embodiment Next, a second embodiment of the present invention will be described. In the following description of the second embodiment, matters common to the first embodiment will be omitted, and only matters different from the first embodiment will be described.

[0063] The above-described first embodiment is a form in which the degree of danger is calculated based on the distance between a user (which may be the information processing device 100) wearing the information processing device 100 and surrounding people. The second embodiment is a form in which a virtual boundary line indicating a movement range of the user wearing the information processing device 100 is set, and the degree of danger is calculated based on the distance between the virtual boundary line and surrounding people.

[0064] Furthermore, when the information processing device 100 (head mounted display) is used in a see-through mode that allows the surrounding situation to be seen, the risk of colliding with people in the vicinity is considered to be low because the surrounding situation can be confirmed through the information processing device 100. Therefore, in the second embodiment, the risk level is calculated taking into consideration whether the see-through mode is being used or not.

[0065] FIG. 4 is a diagram showing an example of a schematic configuration of an information processing system 10-2 according to a second embodiment. As shown in FIG. 4, the information processing system 10-2 includes an information processing device 100 and an input device 200. In the second embodiment, a description will be given assuming that the information processing device 100 is a head-mounted display worn to cover the user's field of vision, and that the input device 200 is a controller operated by the user. In FIG. 4, the same components as those shown in FIG. 1 are denoted by the same reference numerals, and detailed description thereof will be omitted. That is, the schematic configuration of the information processing device 100 according to the second embodiment shown in FIG. 4 is the same as the schematic configuration of the information processing device 100 according to the first embodiment shown in FIG. 1.

[0066] As shown in FIG. 4, the input device 200 includes a control unit 201, an input unit 202, an output unit 203, a detection unit 204, and a communication unit 205.

[0067] The control unit 201 controls each component (202 to 205) of the input device 200, thereby generally controlling the operation of the input device 200 and performing various processes. Note that instead of the control unit 201 controlling the overall operation of the input device 200, the overall operation of the input device 200 may be controlled by multiple hardware components sharing the processing.

[0068] The input unit 202 is used to input instructions from a user to the information processing device 100 and the input device 200. The input unit 202 includes, for example, a power button for instructing ON / OFF of the power of the input device 200, operation buttons for instructing operations on the information processing device 100 (including an operation mode operation button for instructing an operation mode), a joystick, etc.

[0069] The output unit 203 includes, for example, a light emitting device such as an LED (Light Emitting Diode) for providing feedback to the user, a sound output device such as a speaker, a vibration generating device such as a motor, and the like.

[0070] The detection unit 204 includes, for example, an IMU (Inertial Measurement Unit) for measuring posture and position, a geomagnetic sensor, etc. It is not necessary for the detection unit 204 to be built into the input device 200.

[0071] The communication unit 205 includes, for example, a communication unit such as Wi-Fi or Bluetooth for wirelessly communicating with the information processing device 100 or other input devices (other controllers).

[0072] Fig. 5 is a diagram showing an example of a communication connection form of an information processing device 100 and an input device 200 according to the second embodiment. In Fig. 5, the same components as those shown in Fig. 4 are denoted by the same reference numerals, and detailed description thereof will be omitted.

[0073] As shown in Fig. 5, the information processing device 100 and the input device 200 are communicatively connected by close proximity wireless such as Bluetooth. At this time, input information (input information by the input unit 202) input by pressing a button on the input device 200 or by using a joystick is transmitted from the input device 200 to the information processing device 100 via the communication units 205 and 107. In addition, in order to control the output unit 203 (such as an LED or a speaker) mounted on the input device 200, an instruction can also be transmitted from the information processing device 100 to the input device 200 via the communication units 107 and 205. Note that the communication connection form shown in Fig. 5 is merely an example, and the communication connection method and the communication connection configuration may be different.

[0074] Here, a method for calculating the risk level in the second embodiment will be described. In the second embodiment, the possibility of a collision between a user wearing a head mounted display applied as the information processing device 100 and a person around the user is defined as a risk degree x as follows.

[0075] In the second embodiment, the movement range of a user wearing the information processing device 100 is set in advance as a virtual boundary line, and the distance between this virtual boundary line and surrounding people is set as α. In the second embodiment, this distance α is used to define the risk level x as x=1÷α. In this calculation formula for the risk level x, when surrounding people approach the virtual boundary line based on the movement range of the user and the value of the distance α decreases, the possibility of a collision between the user and surrounding people increases, and therefore the value of the risk level x increases. That is, in the second embodiment, the value of the risk level x increases as the distance α between the virtual boundary line and surrounding people decreases.

[0076] Furthermore, in the second embodiment, the risk level x is determined taking into consideration whether or not the information processing device 100 is in a see-through mode, in which the user can see the surrounding situation through the information processing device 100. Specifically, in the second embodiment, if the information processing device 100 is in the see-through mode, the user who wears the information processing device 100 can see the surrounding situation, so it is determined that the risk level is the same as when the information processing device 100 is not worn, and the risk level x is set to x=0.

[0077] Furthermore, when there are multiple (n) people around the user, the distances α1 to αn between the virtual boundary line and each of the surrounding people are used to calculate the danger levels x1 to xn for each of the surrounding people. Note that the calculation method for the danger level x described here is merely an example, and the definition and calculation formula for the danger level x may be different.

[0078] Next, a method of warning a user and people around the user will be described in the second embodiment. In the second embodiment, a first threshold t1 and a second threshold t2 (t2>t1), which are two thresholds, are set for a risk level calculated based on a virtual boundary line indicating a movement range of a user wearing the information processing device 100 and a distance between the people around the user.

[0079] In the second embodiment, when the risk level is less than the first threshold value t1, it is determined that the risk level of a collision between the user and people nearby is low and the situation is safe. In this case, the LED mounted on the input device 200 (controller) is made to emit blue light to inform people nearby that it is safe.

[0080] In the second embodiment, when the risk level is equal to or higher than the first threshold value t1 and lower than the second threshold value t2, it is determined that the risk level of a collision between the user and people nearby is medium and caution (warning) is required. In this case, to inform people nearby that caution is required, an LED mounted on the input device 200 (controller) is caused to emit yellow light to warn the people nearby.

[0081] In the second embodiment, when the risk level is equal to or higher than the second threshold value t2, it is determined that the risk of collision between the user and surrounding people is high and the situation is dangerous. In this case, in order to inform surrounding people of the danger, an LED mounted on the input device 200 (controller) is caused to emit red light to warn the surrounding people. In addition, a warning sound is generated from a speaker mounted on the outside of the head-mounted display used as the information processing device 100 to warn the surrounding people and the user. Furthermore, a warning is displayed on the head-mounted display used as the information processing device 100 to the effect that there is a possibility of collision with surrounding people, to warn the user.

[0082] In addition, when there are multiple people around the user, for example, a warning is given to the person who is the most dangerous among the multiple people around the user. Note that the method of warning the user and the people around the user described here is merely an example, and other different warning methods may be used.

[0083] Fig. 6 is a sequence diagram showing an example of a processing procedure in a control method for the information processing device 100 and the input device 200 according to the second embodiment. Specifically, Fig. 6 shows a flow of processing performed by the information processing device 100 and the input device 200 when a person in the vicinity approaches while a user is wearing a head mounted display applied as the information processing device 100. Note that in Fig. 6, the same step numbers are assigned to processing steps similar to those shown in Fig. 2, and detailed descriptions thereof will be omitted.

[0084] The process of the sequence diagram shown in FIG. 6 starts, and when the user wears the information processing device 100 so as to cover his / her field of vision in step S201, the process proceeds to step S601. In step S601, the control unit 101 of the information processing device 100 sets a movement range of the user wearing the information processing device 100 as a virtual boundary line.

[0085] Thereafter, in the information processing device 100, the same processes as in step S202 and step S203 in Fig. 2 are performed to detect people in the vicinity and calculate the degree of danger. In the second embodiment, as described above, in step S203 in Fig. 6, the distance between the virtual boundary line and the people in the vicinity is set to α, and the degree of danger x is calculated as x = 1 ÷ α.

[0086] Next, in step S602, the control unit 101 of the information processing device 100 transmits a light emission instruction to the input device 200 based on the degree of danger calculated in step S203.

[0087] Next, in step S603, the control unit 201 of the input device 200 performs light emission processing via the output unit 203 built in the input device 200 in accordance with the light emission instruction transmitted from the information processing device 100.

[0088] Furthermore, in the information processing device 100, the same processes as in steps S205 and S206 in FIG. 2 are performed, and a warning sound is generated and a warning display is performed according to the degree of danger calculated in step S203.

[0089] Next, detailed processing procedures in a control method for the information processing device 100 and the input device 200 for implementing the sequence diagram shown in FIG. 6 will be described with reference to FIGS. 7 and 8, respectively.

[0090] Fig. 7 is a flowchart showing an example of a processing procedure in a control method for the information processing device 100 according to the second embodiment. The processing of the flowchart shown in Fig. 7 is started when a user wears the information processing device 100 so as to cover the field of view and starts up the information processing device 100. In Fig. 7, the same processing steps as those shown in Fig. 3 are given the same step numbers, and detailed descriptions thereof will be omitted.

[0091] When the process of the flowchart shown in FIG. 7 is started, first, in step S701, the control unit 101 of the information processing device 100 sets a virtual boundary line indicating a movement range of the user wearing the information processing device 100. For example, the control unit 101 receives the position, attitude, and button state of the information processing device 100 via the input unit 104 and the detection unit 106, and sets a virtual boundary line indicating the movement range of the user based on that information. Also, for example, the control unit 101 receives the position, attitude, and button state of the input device 200 via the communication unit 107, and sets a virtual boundary line indicating the movement range of the user based on that information. The process of step 701 corresponds to the process of step S601 shown in FIG. 6.

[0092] After that, the same processes as steps S301 to S303 shown in FIG. 3 are performed, and then the process proceeds to step S702. When the process proceeds to step S702, the control unit 101 determines whether or not the information processing device 100 is in a see-through mode in which the user can see the surroundings while wearing the information processing device 100. Here, the control unit 101 determines whether or not the information processing device 100 is in the see-through mode based on the state of an operation mode operation button included in the input unit 104 or an operation mode operation button included in the input unit 202 of the input device 200, for example.

[0093] If the result of the determination in step S702 is that the see-through mode is not selected (S702 / NO), the process proceeds to step S703. In step S703, the control unit 101 acquires the distance between the virtual boundary line set in step S701 and the surrounding people detected in step S302.

[0094] Next, in step S704, the control unit 101 calculates the value of the danger level x based on the distance between the virtual boundary line and the surrounding people acquired in step S703. After that, the same processes as those in steps S306 and S307 shown in FIG. 3 are performed.

[0095] Also, if the result of the determination in step S702 is that the mode is the see-through mode (S702 / YES), the process proceeds to the next step.

[0096] Here, the above-mentioned processes of steps S702 to S704 and steps S306 to S307 are performed for all surrounding people detected in step S302. That is, the above-mentioned processes of steps S702 to S704 and steps S306 to S307 are repeatedly performed the same number of times as the number of surrounding people detected in step S302. Also, the processes of steps S303 to S307 shown in Fig. 7 correspond to the process of step S203 shown in Fig. 6.

[0097] When the processes in steps S702 to S704 and steps S306 to S307 described above are completed, the process proceeds to step S308. In step S308, the control unit 101 determines whether or not the maximum value x' of the degree of risk is less than the first threshold value (less than the first threshold value t1).

[0098] If it is determined in step S308 that the maximum value x' of the risk level is less than the first threshold value t1 (S308 / YES), the process proceeds to step S705. In step S705, the control unit 101 transmits a light emission instruction to the input device 200 via the communication unit 107 to cause the LED to emit blue light. This light emission instruction includes at least color information of the LED to emit light. After that, the same processes as those in steps S310 and S311 in FIG. 3 are performed, and the process returns to step S301.

[0099] Also, if it is determined in step S308 that the maximum value x' of the risk level is not less than the first threshold value t1 (is equal to or greater than the first threshold value) (S308 / NO), the process proceeds to step S312. In step S312, the control unit 101 determines whether or not the maximum value x' of the degree of risk is less than a second threshold value (less than a second threshold value t2) that is greater than the first threshold value t1.

[0100] As a result of the determination in step S312, if the maximum value x' of the risk level is less than the second threshold value t2 (S312 / YES), the process proceeds to step S706. Note that the process proceeds to step S706 when the maximum value x' of the risk level is equal to or greater than the first threshold value (equal to or greater than the first threshold value t1) and less than the second threshold value (less than the second threshold value t2). In step S706, the control unit 101 transmits a light emission instruction to the input device 200 via the communication unit 107 to cause the LED to emit yellow light. This light emission instruction includes at least color information of the LED to emit light. After that, the same processes as those in steps S314 and S315 in FIG. 3 are performed, and the process returns to step S301.

[0101] Also, if it is determined in step S312 that the maximum value x' of the risk level is not less than the second threshold value t2 (is equal to or greater than the second threshold value) (S312 / NO), the process proceeds to step S707. In step S707, the control unit 101 transmits a light emission instruction to the input device 200 via the communication unit 107 to cause the LED to emit red light. This light emission instruction includes at least color information of the LED to emit light. After that, the same processes as those in steps S317 and S318 in FIG. 3 are performed, and the process returns to step S301.

[0102] The processes in steps S705 to S707 in FIG. 7 correspond to the process in step S602 shown in FIG.

[0103] Fig. 8 is a flowchart showing an example of a processing procedure in a control method for the input device 200 according to the second embodiment. The processing of the flowchart shown in Fig. 8 is started when the input device 200 is started.

[0104] 8 starts, first, in step S801, the control unit 201 of the input device 200 determines whether or not to end the process based on the state of each component of the input device 200. For example, the control unit 201 determines to end the process when a stop operation is performed via the input unit 202 or when the control unit 201 detects via the communication unit 205 that the user has detached the information processing device 100.

[0105] As a result of the determination in step S801, if the process is not to be ended (the process is to be continued) (S801 / NO), the process proceeds to step S802. In step S802, the control unit 201 determines whether or not a light emission instruction has been received from the information processing device 100 via the communication unit 205. If the result of this determination is that a light emission instruction has not been received from the information processing device 100 (S802 / NO), the process returns to step S801.

[0106] Also, if it is determined in step S802 that a light emission instruction has been received from the information processing device 100 (S802 / YES), the process proceeds to step S803. In step S803, the control unit 201 determines whether or not the color information of the LED to be illuminated, which is included in the light emission instruction received in step S802, is blue.

[0107] If it is determined in step S803 that the color information of the LED to be illuminated, contained in the light emission instruction received in step S802, is blue (S803 / YES), the process proceeds to step S804. In step S804, the control unit 201 causes the LED included in the output unit 203 to emit blue light. Then, the process returns to step S801.

[0108] Also, if it is determined in step S803 that the color information of the LED to be illuminated, which is included in the light emission instruction received in step S802, is not blue (S803 / NO), the process proceeds to step S805. In step S805, the control unit 201 determines whether the color information of the LED to be illuminated, which is included in the light emission instruction received in step S802, is yellow.

[0109] If it is determined in step S805 that the color information of the LED to be illuminated, which is included in the light emission instruction received in step S802, is yellow (S805 / YES), the process proceeds to step S806. In step S806, the control unit 201 causes the LED included in the output unit 203 to emit yellow light. Then, the process returns to step S801.

[0110] Also, if it is determined in step S805 that the color information of the LED to be illuminated, which is included in the light emission instruction received in step S802, is not yellow (S805 / NO), the process proceeds to step S807. In step S807, the control unit 201 determines whether the color information of the LED to be illuminated, which is included in the light emission instruction received in step S802, is red.

[0111] If it is determined in step S807 that the color information of the LED to be illuminated, which is included in the light emission instruction received in step S802, is red (S807 / YES), the process proceeds to step S808. In step S808, the control unit 201 causes the LED included in the output unit 203 to emit red light. Then, the process returns to step S801.

[0112] Also, if it is determined in step S807 that the color information of the LED to be illuminated, which is included in the light emission instruction received in step S802, is not red (S807 / NO), the process returns to step S801.

[0113] Also, as a result of the determination in step S801, if the process is to be ended (S801 / YES), the process of the flowchart shown in FIG. 8 is ended.

[0114] The processes in steps S803 to S808 in FIG. 8 correspond to the process in step S603 shown in FIG.

[0115] In the information processing device 100 according to the second embodiment described above, the control unit 101 acquires the distance between the virtual boundary line indicating the movement range of the user wearing the information processing device 100 so as to cover the field of view and the surrounding people (S703). Then, the control unit 101 issues a warning to at least the surrounding people based on the acquired distance between the virtual boundary line and the surrounding people (S706, S707 to 318). The control unit 101 that issues this warning corresponds to a warning means. In addition, the control unit 101 judges whether the user wearing the information processing device 100 can see the surrounding situation (S702). The control unit 101 that makes this judgment corresponds to a first judgment means. In this case, the control unit 101 issues a warning to at least the surrounding people based on the acquired distance between the virtual boundary line and the surrounding people and the result of the judgment of whether the user wearing the information processing device 100 can see the surrounding situation (S706, S707 to 318). The control unit 101 that issues this warning corresponds to a warning means. According to the information processing device 100 of the second embodiment, since it is possible to provide an appropriate warning to people around a user who wears the information processing device 100 so as to cover the field of view, it is possible to reduce the risk of collision between the user and people around him / her. In addition, by providing a warning based on the result of determining whether or not the user can see the surrounding situation, if the user can see the surrounding situation, it is less likely that the user will collide with people around him / her, and therefore it is possible to suppress unnecessary warnings.

[0116] Note that the determination of whether or not the see-through mode is in step S702 in Fig. 7 can also be applied to the processing of the flowchart in Fig. 3 in the first embodiment. That is, the form in which a warning is issued based on the result of the determination of whether or not the user wearing the information processing device 100 can see the surrounding situation can also be applied to the above-mentioned first embodiment.

[0117] (Third embodiment) Next, a third embodiment of the present invention will be described. In the following description of the third embodiment, matters common to the first and second embodiments will be omitted, and only matters different from the first and second embodiments will be described.

[0118] In the first and second embodiments described above, the distance between the user and the surrounding people and the distance between the virtual boundary line and the surrounding people are measured via the detection unit 106 of the information processing device 100. However, the function of measuring these distances does not necessarily need to be installed in the information processing device 100, and for example, the distances may be measured using a measuring device arranged around the user. For example, the information processing device 100 and the surrounding people can be detected by installing a camera as a measuring device around the user and performing image recognition on the image captured by the camera. In addition, it is also possible to measure the distance between the information processing device 100 (user) and the surrounding people by comparing the feature points of the image with a LiDAR, ToF sensor, or the like.

[0119] In the first and second embodiments, the information processing device 100 or the input device 200 serving as a controller thereof issues a warning to people in the vicinity. For example, the information processing device 100 may simply issue warning information to people in the vicinity by close proximity wireless communication or the like, and leave the method of issuing the warning to the device that receives the warning. For example, by transmitting warning information from the information processing device 100 using a BLE (Bluetooth Low Energy) beacon, it is possible to issue a warning to people in the vicinity without knowing the configuration of the terminal device that receives the warning information.

[0120] FIG. 9 is a diagram showing an example of a schematic configuration of an information processing system 10-3 according to a third embodiment. As shown in FIG. 9, the information processing system 10-3 includes an information processing device 100, a measurement device 300, and a surrounding person mobile terminal device 400. In the third embodiment, as in the first and second embodiments described above, a head-mounted display worn to cover the user's field of vision is assumed as the information processing device 100. Furthermore, in the third embodiment, a camera arranged around the user is assumed as the measurement device 300, and a smartphone carried by a surrounding person is assumed as the surrounding person mobile terminal device 400. In addition, in FIG. 9, the same reference numerals are assigned to configurations similar to those shown in FIG. 1 and FIG. 4, and detailed description thereof will be omitted. That is, the schematic configuration of the information processing device 100 according to the third embodiment shown in FIG. 9 is similar to the schematic configuration of the information processing device 100 according to the first embodiment shown in FIG. 1 and the second embodiment shown in FIG. 4.

[0121] As shown in FIG. 9, the measuring device 300 includes a control unit 301, a storage unit 302, a memory 303, an input unit 304, a detection unit 305, and a communication unit 306.

[0122] The control unit 301 controls each component (302 to 306) of the measuring device 300 to comprehensively control the operation of the measuring device 300 and perform various processes. Note that instead of the control unit 301 controlling the overall operation of the measuring device 300, the overall operation of the measuring device 300 may be controlled by multiple hardware components sharing the processing.

[0123] The storage unit 302 is, for example, an electrically erasable and recordable non-volatile storage medium such as a flash memory. The storage unit 302 stores programs executed by the control unit 301, a database of various data, user setting information, etc. The storage unit 302 also stores various information and data obtained by the control and processing executed by the control unit 301.

[0124] The memory 303 is, for example, a random access memory (RAM). The memory 303 is used as a buffer memory that temporarily stores various types of information and data, and as a working area for the control unit 301.

[0125] The input unit 304 is used to input instructions to the measuring device 300. The input unit 304 includes, for example, a power button for instructing ON / OFF of the power supply of the measuring device 300 and operation buttons for instructing screen transitions.

[0126] The detection unit 305 includes, for example, an imaging sensor that captures surrounding images, a LiDAR (Light Detection And Ranging) sensor that measures the surrounding conditions, a ToF (Time of Flight) sensor, etc. Furthermore, the detection unit 305 includes, for example, an IMU (Inertial Measurement Unit) and a geomagnetic sensor for measuring the attitude and position.

[0127] The communication unit 306 includes, for example, a connector (RJ45) for connecting to Ethernet, a NIC (Network Interface Card) incorporating a communication IC, etc. Furthermore, the communication unit 306 includes, for example, a communication unit such as Wi-Fi or Bluetooth for wireless communication with an external device including the information processing device 100 or a controller.

[0128] As shown in FIG. 9, the surrounding person portable terminal device 400 includes a control unit 401, a storage unit 402, a memory 403, an input unit 404, an output unit 405, and a communication unit 406.

[0129] The control unit 401 controls each component (402 to 406) of the surrounding person mobile terminal device 400, thereby generally controlling the operation of the surrounding person mobile terminal device 400 and performing various processes. Note that instead of the control unit 401 controlling the overall operation of the surrounding person mobile terminal device 400, the overall operation of the surrounding person mobile terminal device 400 may be controlled by multiple hardware components sharing the processing.

[0130] The storage unit 402 is an electrically erasable and recordable non-volatile storage medium such as a hard disk drive (HDD), a solid state drive (SSD), a flash memory, etc. The storage unit 402 stores programs executed by the control unit 401, databases of various data, user setting information, etc. The storage unit 402 also stores various information and data obtained by the control and processing executed by the control unit 401.

[0131] The memory 403 is, for example, a random access memory (RAM), and is used as a buffer memory for temporarily storing various types of information and data, a working area for the control unit 401, and the like.

[0132] The input unit 404 is used to input instructions from surrounding people to the surrounding person mobile terminal device 400. The input unit 404 includes, for example, a power button for instructing ON / OFF of the power of the surrounding person mobile terminal device 400 and an operation button for instructing screen transition.

[0133] The output unit 405 includes, for example, a GUI (Graphical User Interface) display device for interactive operations, a light emitting device such as an LED (Light Emitting Diode), a sound output device such as a speaker, and the like.

[0134] The communication unit 406 includes, for example, a communication unit such as Wi-Fi or Bluetooth for wireless communication with the information processing device 100 and external devices including a controller.

[0135] Fig. 10 is a diagram showing an example of a communication connection form between the information processing device 100 according to the third embodiment, the measuring device 300, and the surrounding person mobile terminal device 400. In Fig. 10, the same components as those shown in Fig. 9 are denoted by the same reference numerals, and detailed description thereof will be omitted.

[0136] As shown in FIG. 10, the information processing device 100 and the measurement device 300 are communicatively connected by wireless such as Wi-Fi. In the third embodiment, information on the detection result of the surrounding person detected by the measurement device 300 is transmitted from the measurement device 300 to the information processing device 100 via the communication unit 306 and the communication unit 107. Also, as shown in FIG. 10, the information processing device 100 and the surrounding person mobile terminal device 400 are communicatively connected using a proximity wireless such as a BLE beacon. In the third embodiment, warning information issued from the information processing device 100 is transmitted from the information processing device 100 to the surrounding person mobile terminal device 400 via the communication unit 107 and the communication unit 406. Note that the communication connection form shown in FIG. 10 is merely an example, and the communication connection method and the communication connection configuration may be different.

[0137] The method of calculating the risk in the third embodiment is the same as the method of calculating the risk in the first embodiment described above, and therefore the explanation will be omitted. Note that the method of calculating the risk in the second embodiment described above may be applied as the method of calculating the risk in the third embodiment.

[0138] Next, a method of warning a user and people around the user in the third embodiment will be described. In the third embodiment, as in the first embodiment, a first threshold t1 and a second threshold t2 (t2>t1), which are two thresholds, are set for a risk level calculated based on a distance between a user wearing the information processing device 100 and people around the user.

[0139] In the third embodiment, when the risk level is less than the first threshold value t1, it is determined that the risk level of a collision between the user and people around is low and the situation is safe. In this case, an LED mounted on the outside of the head mounted display used as the information processing device 100 is made to emit blue light in order to inform people around the user that it is safe.

[0140] In the third embodiment, when the risk level is equal to or higher than the first threshold value t1 and lower than the second threshold value t2, it is determined that the risk level of a collision between the user and surrounding people is medium and caution (warning) is required. In this case, in order to inform surrounding people that caution is required, an LED mounted on the outside of the head-mounted display applied as the information processing device 100 is caused to emit yellow light to warn the surrounding people. Furthermore, in this case, warning information is transmitted to the surroundings from the information processing device 100 using a BLE beacon. Then, the surrounding people's mobile terminal device 400 that has received the warning information by the BLE beacon warns surrounding people who are carrying it by displaying on a display that there is a possibility of a collision with the user wearing the information processing device 100.

[0141] In the third embodiment, when the risk level is equal to or higher than the second threshold value t2, it is determined that the risk of collision between the user and surrounding people is high and the situation is dangerous. In this case, in order to inform surrounding people of the danger, an LED mounted on the outside of the head-mounted display used as the information processing device 100 is caused to emit red light to warn the surrounding people. In addition, a warning sound is generated from a speaker to warn the surrounding people and the user. Furthermore, a warning is displayed on the head-mounted display used as the information processing device 100 to the effect that there is a possibility of collision with surrounding people, to warn the user.

[0142] Furthermore, in the case where there are multiple people around the user, for example, a warning is given to the person with the highest risk level x among the multiple people around. Note that the method of warning the user and the people around him / her described here is merely an example, and other different warning methods may be used.

[0143] Fig. 11 is a sequence diagram showing an example of a processing procedure in a control method for the information processing device 100, the measurement device 300, and the surrounding person mobile terminal device 400 according to the third embodiment. Specifically, Fig. 11 shows a flow of processing performed by the information processing device 100, the measurement device 300, and the surrounding person mobile terminal device 400 when a surrounding person approaches while the user is wearing a head mounted display applied as the information processing device 100. Note that in Fig. 11, the same step numbers are assigned to processing steps similar to those shown in Fig. 2, and detailed descriptions thereof will be omitted.

[0144] 11 starts, and in step S201 the user wears the information processing device 100 so as to cover his or her field of vision. Then, in step S1101, the control unit 301 of the measuring device 300 detects the information processing device 100 via the detection unit 305.

[0145] Next, in step S1102, the control unit 301 of the measuring device 300 measures the situation around the information processing device 100 (around the user) via the detection unit 305, and performs processing to detect people in the vicinity.

[0146] Next, in step S1103, the control unit 301 of the measuring device 300 transmits information on the detection results of the surrounding people detected in step S1102 to the information processing device 100 via the communication unit 306. The transmitted information on the detection results of the surrounding people includes at least information on the distance between the user and the surrounding people and information on their positions, etc., so that the degree of danger to the surrounding people can be calculated in step S1104, which will be described later. In this step S1103, the control unit 101 of the information processing device 100 acquires the information on the detection results of the surrounding people transmitted from the measuring device 300 via the communication unit 107.

[0147] Next, in step S1104, the control unit 101 of the information processing device 100 calculates a degree of danger to the surrounding people based on the information of the detection result of the surrounding people acquired in step S1103. Here, in the third embodiment, the distance between the user and the surrounding people is set to α, and the degree of danger x is calculated as x=1÷α.

[0148] Next, in step S1105, the control unit 101 of the information processing device 100 transmits warning information to the surrounding person mobile terminal device 400 via the communication unit 107 in accordance with the degree of danger calculated in step S1104. In this step S1105, the surrounding person mobile terminal device 400 acquires the warning information transmitted from the information processing device 100 via the communication unit 406.

[0149] Next, in step S1106, the control unit 401 of the nearby person portable terminal device 400 displays a warning via the output unit 405 based on the warning information acquired in step S1105.

[0150] Furthermore, in the information processing device 100, the same processes as in steps S204 to S206 in FIG. 2 are performed, and light is emitted in a color according to the degree of danger calculated in step S203, and a warning sound is generated and a warning display is displayed.

[0151] Next, detailed processing procedures in the control method of the information processing device 100, the measurement device 300, and the surrounding person mobile terminal device 400 for realizing the sequence diagram shown in FIG. 11 will be described with reference to FIGS. 12, 13, and 14, respectively.

[0152] Fig. 12 is a flowchart showing an example of a processing procedure in a control method for the information processing device 100 according to the third embodiment. The processing of the flowchart shown in Fig. 12 is started when the user wears the information processing device 100 so as to cover the field of view and starts up the information processing device 100. In Fig. 12, the same processing steps as those shown in Fig. 3 are given the same step numbers, and detailed descriptions thereof will be omitted.

[0153] When the process of the flowchart shown in FIG. 12 starts, first, in step S301, the control unit 101 of the information processing device 100 determines whether or not to end the process based on the state of each component of the information processing device 100.

[0154] Then, if the result of the determination in step S301 is that the process is not to be ended (the process is to be continued) (S301 / NO), the process proceeds to step S1201. In step S1201, the control unit 101 judges whether or not information on the detection result of surrounding people has been received from the measurement device 300 via the communication unit 107. The process of step S1201 corresponds to the process of step S1103 shown in Fig. 11. As a result of the judgment in step S1201, if information on the detection result of surrounding people has not been received from the measurement device 300 (S1201 / NO), the process returns to step S301.

[0155] Furthermore, if the determination result in step S1201 is that information on the detection result of surrounding people has been received from the measuring device 300 (S1201 / YES), the process proceeds to step S303. Thereafter, as in the first embodiment, the maximum value x' of the risk level is initialized in step S303, and then the distance between the user (which may be the information processing device 100) wearing the information processing device 100 and the surrounding people is acquired in step S304. At this time, in step S304, the distance between the user and the surrounding people included in the information on the detection result of surrounding people received in step S1201 is acquired.

[0156] Next, in step S1202, the control unit 101 calculates the value of the danger level x based on the distance between the user (which may be the information processing device 100) and people around the user, which was acquired in step S304. The process of step S1202 corresponds to the process of step S1104 shown in FIG.

[0157] Thereafter, similarly to the first embodiment, the processes of steps S306 to S307 are carried out.

[0158] Next, in step S308, the control unit 101 determines whether the maximum value x' of the risk level is less than the first threshold value (less than the first threshold value t1). If the result of this determination is that the maximum value x' of the risk level is less than the first threshold value t1 (S308 / YES), the process proceeds to step S309. Then, similarly to the first embodiment, the processes of steps S309 to S311 are performed.

[0159] Also, if it is determined in step S308 that the maximum value x' of the risk level is not less than the first threshold value t1 (is equal to or greater than the first threshold value) (S308 / NO), the process proceeds to step S312. In step S312, the control unit 101 determines whether or not the maximum value x' of the degree of risk is less than a second threshold value (less than a second threshold value t2) that is greater than the first threshold value t1.

[0160] As a result of the determination in step S312, if the maximum value x' of the risk level is less than the second threshold value t2 (S312 / YES), the process proceeds to step S1203. Note that the process proceeds to step S1203 when the maximum value x' of the risk level is equal to or greater than the first threshold value (equal to or greater than the first threshold value t1) and less than the second threshold value (less than the second threshold value t2). In step S1203, the control unit 101 transmits warning information to the surroundings by using a BLE beacon via the communication unit 107. The process of step S1203 corresponds to the process of step S1105 shown in FIG.

[0161] When the process of step S1203 ends, the processes of steps S313 to S315 are carried out in the same manner as in the first embodiment.

[0162] Furthermore, if the result of the determination in step S312 is that the maximum value x' of the risk level is not less than the second threshold value t2 (is equal to or greater than the second threshold value) (S312 / NO), the process proceeds to step S316. Then, similarly to the first embodiment, the processes in steps S316 to S318 are performed.

[0163] Fig. 13 is a flowchart showing an example of a processing procedure in a control method for the measuring device 300 according to the third embodiment. The processing of the flowchart shown in Fig. 13 is started, for example, when the measuring device 300 is started.

[0164] 13 starts, first, in step S1301, the control unit 301 of the measuring device 300 determines whether or not to end the process based on the state of each component of the measuring device 300. For example, the control unit 301 determines to end the process when a stop operation is performed via the input unit 304.

[0165] As a result of the determination in step S1301, if the process is not to be ended (the process is to be continued) (S1301 / NO), the process proceeds to step S1302. In step S1302, the control unit 301 determines whether or not the information processing device 100 has been detected via the detection unit 305. The process of step S1302 corresponds to the process of step S1101 shown in Fig. 11. If the result of the determination in step S1302 is that the information processing device 100 has not been detected (S1302 / NO), the process returns to step S1301.

[0166] Also, if it is determined in step S1302 that the information processing device 100 has been detected (S1302 / YES), the process proceeds to step S1303. In step S1303, the control unit 301 determines whether or not a surrounding person has been detected via the detection unit 305. The process of step S1303 corresponds to the process of step S1102 shown in FIG.

[0167] As a result of the determination in step S1303, if a person in the vicinity has been detected (S1303 / YES), the process proceeds to step S1304. In step S1304, the control unit 301 transmits, via the communication unit 306 to the information processing device 100, information on the detection result of the surrounding people detected in step S1303.

[0168] Also, if it is determined in step S1303 that no surrounding people have been detected (S1303 / NO), the process proceeds to step S1305. In step S1305, the control unit 301 transmits, to the information processing device 100 via the communication unit 306, information on the detection result indicating that the number of detected surrounding people is zero.

[0169] The processes in steps S1304 and S1305 described above correspond to the process in step S1103 shown in Fig. 11. Then, when the process in step S1304 or step S1305 ends, the process returns to step S1301.

[0170] Also, as a result of the determination in step S1301, if the process is to be ended (S1301 / YES), the process of the flowchart shown in FIG. 13 is ended.

[0171] Fig. 14 is a flowchart showing an example of a processing procedure in a control method for the surrounding person mobile terminal device 400 according to the third embodiment. The processing of the flowchart shown in Fig. 14 is started, for example, when the surrounding person mobile terminal device 400 is started.

[0172] 14 is started, first, in step S1401, the control unit 401 of the surrounding person mobile terminal device 400 judges whether or not to end the processing based on the state of each component of the surrounding person mobile terminal device 400. For example, the control unit 401 judges to end the processing when a stop operation is performed via the input unit 404.

[0173] As a result of the determination in step S1401, if the process is not to be ended (the process is to be continued) (S1401 / NO), the process proceeds to step S1402. In step S1402, the control unit 401 determines whether or not warning information has been received from the information processing device 100 via the communication unit 406. If the result of this determination is that warning information has not been received from the information processing device 100 (S1402 / NO), the process returns to step S1401.

[0174] Also, if it is determined in step S1402 that warning information has been received from the information processing device 100 (S1402 / YES), the process proceeds to step S1403. In step S1403, the control unit 401 displays a warning on the display of the nearby person's mobile terminal device 400 via the output unit 405 based on the warning information received in step S1402. Then, the process returns to step S1401.

[0175] Also, as a result of the determination in step S1401, if the process is to be ended (S1401 / YES), the process of the flowchart shown in FIG. 14 is ended.

[0176] The processes in steps S1402 and S1403 described above correspond to the process in step S1105 shown in FIG.

[0177] In the information processing device 100 according to the third embodiment described above, the control unit 101 receives information on the detection result of the surrounding people from the measurement device 300 via the communication unit 107 (S1103, S1201). Then, the control unit 101 calculates the value of the danger level based on the information on the detection result of the surrounding people received from the measurement device 300 (S1104, S1202). Furthermore, when the maximum value x' of the danger level is equal to or greater than the first threshold value t1 and less than the second threshold value t2, the control unit 101 transmits warning information to the surrounding people (S1105, S1203). As a result, when the surrounding person mobile terminal device 400 receives the warning information, a warning display is performed based on the received warning information (S1106, S1403), so that a warning can be issued to the surrounding people who carry the surrounding person mobile terminal device 400. According to the third embodiment, even if the information processing device 100 does not have a function for detecting people in the vicinity, it is possible to issue a warning to people in the vicinity of a user wearing the information processing device 100. Moreover, by the information processing device 100 transmitting warning information to the surroundings by close-proximity wireless communication or the like, it is possible to issue a warning to people in the vicinity without knowing the configuration of the terminal device that receives the warning information.

[0178] (Fourth embodiment) Next, a fourth embodiment of the present invention will be described. In the following description of the fourth embodiment, matters common to the first to third embodiments will be omitted, and only matters different from the first to third embodiments will be described.

[0179] In the first and second embodiments described above, when the danger level is medium (when the maximum danger level x' is equal to or greater than the first threshold value t1 and less than the second threshold value t2) and it is determined that the situation requires vigilance, the LED is made to emit yellow light to warn the user. In this case, if the surrounding people do not notice the warning caused by the LED being made to emit yellow light, it is considered that the warning by light alone is insufficient. Therefore, in the third embodiment, for example, after the warning by light is given, if it is determined that the surrounding people do not notice the warning light, a warning by generating a warning sound is also given. This makes it possible to make the surrounding people aware that a warning has been issued, and to reduce the possibility of a collision between the user and the surrounding people. In addition, it is possible to determine whether the surrounding people notice the warning light by performing image recognition on the video captured by the camera mounted on the information processing device 100, for example.

[0180] The method of calculating the risk in the fourth embodiment is the same as the method of calculating the risk in the first embodiment described above, and therefore the explanation will be omitted. Note that the method of calculating the risk in the second embodiment described above may be applied as the method of calculating the risk in the fourth embodiment.

[0181] Next, a method of warning a user and people around the user in the fourth embodiment will be described. In the fourth embodiment, as in the first embodiment, a first threshold t1 and a second threshold t2 (t2>t1), which are two thresholds, are set for a risk level calculated based on a distance between a user wearing the information processing device 100 and people around the user.

[0182] In the fourth embodiment, when the risk level is less than the first threshold value t1, it is determined that the risk level of a collision between the user and people around is low and the situation is safe. In this case, an LED mounted on the outside of the head mounted display used as the information processing device 100 is made to emit blue light in order to inform people around the user that it is safe.

[0183] In the fourth embodiment, when the risk level is equal to or higher than the first threshold value t1 and lower than the second threshold value t2, it is determined that the risk level of a collision between the user and people in the vicinity is medium and vigilance (warning) is required. In this case, in order to inform the people in the vicinity that vigilance is required, an LED mounted on the outside of the head mounted display used as the information processing device 100 is caused to emit yellow light to warn the people in the vicinity. Furthermore, when it is determined that the people in the vicinity have not noticed the warning light, a warning sound is generated from a speaker mounted on the head mounted display used as the information processing device 100. When it is determined that the people in the vicinity have noticed the warning sound, the warning sound generated from the speaker is stopped.

[0184] In the fourth embodiment, when the risk level is equal to or higher than the second threshold value t2, it is determined that the risk of collision between the user and surrounding people is high and the situation is dangerous. In this case, in order to inform surrounding people of the danger, an LED mounted on the outside of the head-mounted display used as the information processing device 100 is caused to emit red light to warn the surrounding people. In addition, a warning sound is generated from a speaker to warn the surrounding people and the user. Furthermore, a warning is displayed on the head-mounted display used as the information processing device 100 to the effect that there is a possibility of collision with surrounding people, to warn the user.

[0185] Furthermore, in the case where there are multiple people around the user, for example, a warning is given to the person with the highest risk level x among the multiple people around. Note that the method of warning the user and the people around him / her described here is merely an example, and other different warning methods may be used.

[0186] Fig. 15 is a flowchart showing an example of a processing procedure in a control method for the information processing device 100 according to the fourth embodiment. The processing of the flowchart shown in Fig. 15 is started when a user wears the information processing device 100 so as to cover the field of view and starts up the information processing device 100. In Fig. 15, the same processing steps as those shown in Fig. 3 are given the same step numbers, and detailed descriptions thereof will be omitted.

[0187] When the process of the flowchart shown in Fig. 15 is started, first, the processes of steps S301 to S313 are performed in the same manner as in the first embodiment shown in Fig. 3. Specifically, in step S313, if the maximum value x' of the risk level is equal to or greater than the first threshold value t1 and less than the second threshold value t2, an LED mounted on the information processing device 100 is caused to emit yellow light to warn people in the vicinity.

[0188] When the process of step S313 ends, in step S1501, the control unit 101 of the information processing device 100 determines via the detection unit 106 whether or not there is a person in the vicinity who has not noticed the warning.

[0189] As a result of the determination in step S1501, if there is a person nearby who has not noticed the warning (S1501 / YES), the process proceeds to step S1502. In step S1502, the control unit 101 generates a warning sound from a speaker mounted on the information processing device 100 via the output unit 105. The process of step S1502 corresponds to the process of step S205 shown in FIG.

[0190] Also, if it is determined in step S1501 that there is no person in the vicinity who has not noticed the warning (S1501 / NO), the process proceeds to step S314. When the process proceeds to step S314, the control unit 101 stops the warning sound if a warning sound is being generated from a speaker mounted on the information processing device 100 via the output unit 105. Furthermore, if a warning sound is not being generated from the speaker, the control unit 101 performs processing to maintain this state.

[0191] When the process of step S1502 is completed, or when the process of step S314 is completed, the process proceeds to step S315, where the same process as in the first embodiment shown in FIG. 3 is performed.

[0192] The information processing device 100 according to the above-described fourth embodiment performs the following processes. When the risk level is equal to or greater than the first threshold value t1 and less than the second threshold value t2, the control unit 101 judges whether or not people in the vicinity have noticed the yellow light emission (S1501). The control unit 101 that makes this judgment corresponds to the second judgment means. Then, when the control unit 101 judges that people in the vicinity have not noticed the yellow light emission, it issues a warning by emitting a warning sound (S1502). According to the information processing device 100 of the fourth embodiment, when it is determined that the surrounding people are not aware of the warning by the light, the information processing device 100 can make the surrounding people aware of the warning by issuing a warning sound. This can reduce the possibility of collision between the user and the surrounding people.

[0193] (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions. This program and a computer-readable storage medium storing the program are included in the present invention.

[0194] It should be noted that the above-mentioned embodiments of the present invention are merely illustrative examples of the implementation of the present invention, and the technical scope of the present invention should not be interpreted as being limited by these. In other words, the present invention can be implemented in various forms without departing from its technical concept or main features.

[0195] The disclosure of the embodiments of the present invention includes the following configurations, methods, and programs. [Configuration 1] An information processing device that is worn so as to cover a user's field of vision, An acquisition means for acquiring a result of detecting people around the user; a warning means for issuing a warning to at least the surrounding people based on a distance between the user wearing the information processing device and the surrounding people; An information processing device comprising: [Configuration 2] An information processing device that is worn so as to cover a user's field of vision, An acquisition means for acquiring a result of detecting people around the user; a warning means for issuing a warning to at least the surrounding people based on a distance between a virtual boundary line indicating a movement range of the user wearing the information processing device and the surrounding people; An information processing device comprising: [Configuration 3] a first determination means for determining whether or not the user wearing the information processing device can see a surrounding situation; The warning means issues the warning based on the distance and the result of the determination by the first determination means. 3. The information processing device according to configuration 1 or 2. [Configuration 4] The warning means issues a warning to the people around the user and the user when the degree of danger, which increases as the distance decreases, is equal to or exceeds a predetermined threshold. 4. The information processing device according to any one of configurations 1 to 3. [Configuration 5] The warning means issues a warning to people in the vicinity when the degree of danger is equal to or greater than a first threshold value that is smaller than the predetermined threshold value and is less than a second threshold value that is the predetermined threshold value. 5. The information processing device according to configuration 4. [Configuration 6] The risk level is a light emission control means for emitting light of different colors to the surrounding people when the light is less than a first threshold value that is smaller than the predetermined threshold value, when the light is less than a second threshold value that is equal to or greater than the first threshold value and is the predetermined threshold value, and when the light is equal to or greater than the second threshold value. 6. The information processing device according to configuration 4 or 5. [Configuration 7] a second determination means for determining whether or not the surrounding people are aware of the light emission of the color by the light emission control means when the degree of danger is equal to or greater than the first threshold and less than the second threshold, The warning means issues a warning by emitting a warning sound when the second judgment means judges that the surrounding people are unaware of the light emission of the color by the light emission control means. 7. The information processing device according to configuration 6. [Configuration 8] The warning by the warning means includes at least one of a warning display and a warning sound. 8. The information processing device according to any one of configurations 1 to 7. [Method 1] A method for controlling an information processing device that is worn to cover a user's field of vision, comprising: An acquisition step of acquiring a result of detecting people around the user; a warning step of issuing a warning to at least the surrounding people based on a distance between the user wearing the information processing device and the surrounding people; 13. A method for controlling an information processing device, comprising: [Method 2] A method for controlling an information processing device that is worn to cover a user's field of vision, comprising: An acquisition step of acquiring a result of detecting people around the user; a warning step of issuing a warning to at least the surrounding people based on a distance between a virtual boundary line indicating a movement range of the user wearing the information processing device and the surrounding people; 13. A method for controlling an information processing device, comprising: [Program 1] A program for causing a computer to function as each of the means of the information processing device according to any one of configurations 1 to 8. [Explanation of symbols]

[0196] 100: information processing device, 101: control unit, 102: storage unit, 103: memory, 104: input unit, 105: output unit, 106: detection unit, 107: communication unit, 200: input device, 300: measurement device, 400: surrounding person portable terminal device

Claims

1. An information processing device that is mounted so as to cover the user's field of vision, An acquisition means for obtaining the results of detecting people in the vicinity of the user, A warning means that, based on the distance between the user wearing the information processing device and the surrounding persons, issues a warning to at least the surrounding persons, An information processing device characterized by comprising:

2. The warning means, when there are multiple people in the vicinity, calculates a risk level for each of the surrounding people based on the distance between the user and each of the surrounding people, determines whether the calculated risk level is greater than the maximum risk level, updates the maximum risk level with the calculated risk level if the calculated risk level is greater than the maximum risk level, and issues a warning that matches the updated maximum risk level. The information processing apparatus according to feature 1.

3. An information processing device that is mounted so as to cover the user's field of vision, An acquisition means for obtaining the results of detecting people in the vicinity of the user, A warning means that provides a warning to at least the surrounding person based on the distance between a virtual boundary line indicating the range of movement of the user wearing the information processing device and the surrounding person, An information processing device characterized by comprising:

4. The warning means, when there are multiple people in the vicinity, calculates a risk level for each of the surrounding people based on the distance between the virtual boundary line and each of the surrounding people, determines whether the calculated risk level is greater than the maximum risk level, updates the maximum risk level with the calculated risk level if the calculated risk level is greater than the maximum risk level, and issues a warning that matches the updated maximum risk level. The information processing apparatus according to claim 3.

5. The device further comprises a first determination means for determining whether the user wearing the information processing device can see the surrounding environment, The warning means issues the warning based on the distance and the result of the determination by the first determination means. The information processing apparatus according to claim 1 or 3.

6. The warning means issues a warning to the surrounding people and the user when the degree of danger, which increases as the distance decreases, exceeds a predetermined threshold. The information processing apparatus according to claim 1 or 3.

7. The warning means issues a warning to the person in the vicinity when the degree of danger is greater than or equal to a first threshold which is less than the predetermined threshold, and less than a second threshold which is the predetermined threshold. The information processing apparatus according to feature 6.

8. The system further includes a light emission control means that emits different colors of light towards the surrounding person depending on whether the risk level is less than a first threshold which is smaller than the predetermined threshold, greater than or equal to the first threshold but less than a second threshold which is the predetermined threshold, or greater than or equal to the second threshold. The information processing apparatus according to feature 6.

9. The system further includes a second determination means for determining whether the person in the vicinity is aware of the color emission from the light emission control means when the risk level is greater than or equal to the first threshold and less than the second threshold. The warning means, when the second determination means determines that the person in the vicinity has not noticed the colored light emitted by the light emission control means, will issue a warning by generating a warning sound. The information processing apparatus according to feature 8.

10. A method for controlling an information processing device that is mounted so as to cover the user's field of vision, The acquisition step involves obtaining the results of detecting people in the vicinity of the user, A warning step that, based on the distance between the user wearing the information processing device and the surrounding person, issues a warning to at least the surrounding person, A control method for an information processing device, characterized by comprising the following:

11. A method for controlling an information processing device that is mounted so as to cover the user's field of vision, The acquisition step involves obtaining the results of detecting people in the vicinity of the user, A warning step that provides a warning to at least the surrounding person based on the distance between a virtual boundary line indicating the range of movement of the user wearing the information processing device and the surrounding person, A control method for an information processing device, characterized by comprising the following:

12. A program for causing a computer to function as each of the means of the information processing apparatus described in claim 1 or 3.

Images