Information processing device, information processing method, program and storage medium

Abstract

To give a further appropriate warning to a user viewing a virtual reality video.SOLUTION: A CPU 101 of an HMD 100 acquires three-dimensional coordinates of a surrounding physical space from a video captured by an imaging unit 104, sets a viewing area in the acquired physical space, determines a warning distance according to the size of the set viewing area, determines whether or not the HMD 100 or a part of a user wearing the HMD 100 is located in a warning area, ranging from an outer edge of the viewing area to a length of the warning distance toward the inside, and issues a warning to the user if it is located therein.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, a program, and a storage medium. [Background technology]

[0002] In recent years, head-mounted displays that are worn on the user's head to cover the user's field of vision and display various images in front of the user's eyes have become more widely used. Head-mounted displays can provide users with a highly immersive video experience by displaying images that are different from the real world in the user's entire field of vision.

[0003] On the other hand, a user viewing a virtual reality image may accidentally collide with an obstacle because the user cannot see the situation in front of the user in the real world. To address this problem, Patent Document 1 discloses a technology that issues a warning when the user approaches the edge of a specified area in the real world. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 6292686 Summary of the Invention [Problem to be solved by the invention]

[0005] In the technology disclosed in Patent Document 1, depending on the timing of the warning, it may be difficult for the user to avoid danger, and conversely, the user's sense of immersion in the virtual reality may be reduced.

[0006] The present invention has been made in consideration of the above circumstances, and aims to provide a technology that can more appropriately warn a user without reducing the sense of immersion in virtual reality. [Means for solving the problem]

[0007] The information processing device of the present invention is characterized by comprising an acquisition means for acquiring three-dimensional coordinates of the physical space surrounding the information processing device, a setting means for setting a predetermined area in the physical space, a determination means for determining a warning distance based on the size of the predetermined area, and a warning means for issuing a warning when a part of the information processing device or a part of a user wearing the information processing device is located in a warning area that extends from the outer edge of the predetermined area inward to the length of the warning distance. Effect of the Invention

[0008] According to the present invention, it is possible to provide a more appropriate warning to a user without reducing the sense of immersion in virtual reality. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram showing a schematic configuration of a head mounted display (HMD). [Diagram 2] 10 is a flowchart showing one embodiment of control and operation executed by the HMD. [Diagram 3] 1 is a schematic diagram illustrating the positional relationship between a user and a warning area in a physical space. FIG. [Figure 4] 13 is a flowchart showing an example of the process of S204. [Diagram 5] 5 is a schematic diagram for explaining the relationship between the viewing area and the warning distance and warning area set by the flow of FIG. 4. [Figure 6] 13 is a flowchart showing another example of the process of S204. [Figure 7] 7 is a schematic diagram for explaining the relationship between the viewing area and the warning distance and warning area set by the flow of FIG. 6. FIG. [Figure 8] FIG. 13 is a schematic diagram illustrating one aspect of the warning notification in S207. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. In this embodiment, a head mounted display (hereinafter, referred to as "HMD") will be taken up as an example of an information processing device according to the present invention.

[0011] 1 is a block diagram showing a schematic configuration of a head mounted display 100 (hereinafter, referred to as "HMD 100"). The HMD 100 has a CPU 101, a memory 102, a non-volatile memory 103, an imaging unit 104, a posture detection unit 105, an operation unit 106, a display unit 107, an audio output unit 108, an external I / F 109, and a communication I / F 110. These units constituting the HMD 100 are connected to each other via an internal bus 150, and can exchange data with each other via the internal bus 150.

[0012] The CPU 101 has at least one processor or circuit, and is responsible for the overall control of the HMD 100. The memory 102 is, for example, a RAM. The non-volatile memory 103 is, for example, a flash memory, a ROM, or the like, and stores image data, audio data, other data, various programs for the operation of the CPU 101, and the like. The CPU 101 performs overall control of each unit of the HMD 100 by executing the programs stored in the non-volatile memory 103 using the memory 102 as a work memory.

[0013] The imaging unit 104 has an optical system constituted by lenses etc., and an image sensor such as a CCD or CMOS that converts an optical image formed by the optical system into an electrical signal, and captures an image of the surroundings of the HMD 100 according to a command from the CPU 101. Note that a depth sensor configured to detect the physical distance of an object may be used as the imaging unit 104.

[0014] The attitude detection unit 105 detects the attitude of the HMD 100 with respect to the direction of gravity and the inclination of the HMD 100 with respect to each of the yaw / roll / pitch axes. From the detection result by the attitude detection unit 105, it is possible to determine whether the HMD 100 is facing upward (whether the user wearing the HMD 100 is looking toward the ceiling), facing downward, or at an angle. As the attitude detection unit 105, at least one of an acceleration sensor, a gyro sensor, a geomagnetic sensor, a direction sensor, an altitude sensor, etc. is used, but a combination of two or more sensors is often used.

[0015] The operation unit 106 is not limited to various buttons (switches) provided on the main body of the HMD 100, but includes other devices such as a remote controller separate from the main body, and accepts user operations. Examples of the operation unit 106 include buttons (switches), dials, joysticks, touch sensors, touch pads, character information input devices such as keyboards, pointing devices such as mice and touch panels, and the like.

[0016] The display unit 107 is a liquid crystal display or an organic EL display that displays images, a GUI screen that constitutes a GUI (Graphical User Interface), etc. The CPU 101 generates a display control signal according to a predetermined program, controls each part of the HMD 100 to generate a video signal to be displayed on the display unit 107, and outputs the video signal to the display unit 107 according to the display control signal. As a result, an image is displayed on the display unit 107.

[0017] The audio output unit 108 includes an audio output terminal for connecting earphones or the like, and a speaker, and outputs the sound of video and music data, operation sounds, ringtones, various notification sounds, and the like. The audio output unit 108 may output audio via wireless communication or the like. The external I / F 109 is an interface for connecting the HMD 100 to an external device via a wired cable or wireless communication, and inputting and outputting video signals and audio signals. The communication I / F 110 is an interface for connecting to the Internet or the like, and transmitting and receiving various data such as files and commands to and from the external device via the Internet or the like.

[0018] The HMD 100 may have a configuration in which a mounting unit having at least the display unit 107 and mounted on the head and a control unit that controls display on the display unit 107 are separate.

[0019] 2 is a flowchart showing one aspect of the control and operation executed by the HMD 100, specifically, a flowchart explaining the process up to issuing a warning notification. Each process (step) indicated by an S number in this flowchart is realized by the CPU 101 loading a predetermined program stored in the non-volatile memory 103 into the memory 102 and comprehensively controlling the operation of each part of the HMD 100.

[0020] In addition, the menu for performing various settings of the HMD 100, which can be activated from the operation unit 106, is provided with an item for selecting whether or not to set a warning area. This is because, for example, when a user wears the HMD 100 to watch a 3D movie, it is assumed that the user will hardly move from the spot, and in such a case, it is considered that there is no high need to set a warning area. The process of S201 is started when the setting of the warning area is enabled.

[0021] In S201, the CPU 101 calculates three-dimensional coordinates of the physical space around the user, using information about the physical space acquired by the imaging unit 104 (information about the real space around the user wearing the HMD 100).

[0022] In S202, CPU 101 determines a predetermined area in the three-dimensional coordinates of the physical space calculated in S201 as the viewing area. The viewing area may be specified by a user inputting an arbitrary coordinate area in the three-dimensional coordinates by operating operation unit 106, or may be determined by CPU 101 automatically determining a position in the physical space where there is no object based on information about the physical space acquired via imaging unit 104.

[0023] In S203, the CPU 101 calculates the size of the viewing area determined in S202.

[0024] In S204, CPU 101 determines a warning distance based on the size of the viewing area calculated in S203, and sets the range from the outer edge of the viewing area (the outermost periphery of the viewing area) to the length of the warning distance inwardly to the viewing area. In other words, the warning area is set along the outer edge of the viewing area and inside it (on the outer periphery of the viewing area).

[0025] In S205, the CPU 101 estimates the positions of the HMD 100 and the user's body on the three-dimensional coordinate system based on the information of the physical space acquired by the imaging unit 104. Here, for example, SLAM (Simultaneous Localization And Mapping) can be used to estimate the position of the HMD 100. The present invention is not limited to this, and the positions of the HMD 100 and the user's body can be estimated using an estimation method that tracks feature points in an image acquired by the imaging unit 104 or an estimation method that detects a known index image in the image. In addition, if the HMD 100 includes an optical sensor or a magnetic sensor, an estimation method that uses these sensors can be used.

[0026] In S206, the CPU 101 determines whether or not the HMD 100 or a part of the user's body estimated in S205 is located within the warning area determined in S204. If the CPU 101 determines that the HMD 100 or a part of the user's body is located within the warning area (Yes in S206), it executes the process of S207, and if the CPU 101 determines that the HMD 100 or a part of the user's body is not within the warning area (No in S206), it executes the process of S205.

[0027] In S207, the CPU 101 notifies the user of a warning and ends this process. Although not shown, if the CPU 101 detects that the HMD 100 or a part of the user's body has gone out of the warning area after issuing the warning in S207, the CPU 101 executes the process of S205.

[0028] 3 is a schematic diagram illustrating the positional relationship between a user and a warning area in a physical space. In a physical space 300, a user 301 wears an HMD 100 so as to cover his or her field of vision, and therefore the user 301 cannot directly see physical objects in the physical space 300.

[0029] The CPU 101 of the HMD 100 calculates the three-dimensional coordinates of the physical space 300 (S201). Here, the imaging unit 104 of the HMD 100 is equipped with various sensors such as an image sensor and a depth sensor, and the CPU 101 calculates the three-dimensional coordinates of the physical space 300 using an inside-out method. However, without being limited to this, an outside-in method may be used in which the three-dimensional coordinates of the physical space 300 are calculated by linking with a device that is physically different from the HMD 100 and equipped with various sensors.

[0030] 3, the user is located approximately in the center of the physical space 300, but the physical space 300 is determined regardless of the user's position in the physical space 300. For example, in a situation where the user wears the HMD 100 in a room, the physical space of the room is determined. If the process of S201 is started by the user being near some object in the room and wearing the HMD 100, a situation may arise where the user is already in the warning area that is determined later.

[0031] The CPU 101 of the HMD 100 determines the viewing area 303 by specifying a predetermined coordinate position from the measured three-dimensional coordinates (S202). The viewing area 303 may be determined by the user 301 specifying an arbitrary coordinate position from the three-dimensional coordinates, or may be determined by detecting the positions of various objects in the physical space 300 based on the image acquired by the imaging unit 104 and determining a coordinate position where no object is present. For example, in a state where the user is wearing the HMD 100 in a room to enjoy a video game, an area (space) in which the user can move while playing the game is determined. The movable space can be said to be a space in which the user does not come into contact with objects (desk, bed, etc.) in the room.

[0032] The CPU 101 of the HMD 100 determines the warning distance 304 based on the size of the determined viewing area 303 (S203). For example, the warning distance 304 can be determined by measuring the arm length of the user 301 based on information acquired by various sensors such as an image sensor and a depth sensor mounted on the HMD 100, and setting the measured length as the warning distance 304. Alternatively, the arm length and stride length of the user may be registered in the non-volatile memory 103 in advance, and the registered value may be used as the warning distance 304.

[0033] The CPU 101 of the HMD 100 sets a range from the outer edge of the viewing area 303 toward the inside of the viewing area 303 to the length of a predetermined warning distance 304 as a warning area 305 (S204). Here, the viewing area 303 and the warning area 305 are expressed as a plane on the floor surface on which the user 301 stands in Fig. 3, but more precisely, they include a space in the vertical direction from the plane on the floor surface. Once the warning area 305 is determined, the HMD 100 may be configured to present the position of the warning area 305 to the user by displaying it on the display unit 107.

[0034] The CPU 101 of the HMD 100 estimates the current three-dimensional coordinate positions of the HMD 100 and the user's body in the physical space 300. The estimation of the coordinate positions of the HMD 100 and the user's body in the physical space 300 can be performed using an inside-out method in which various sensors such as an image sensor and a depth sensor are mounted on the HMD 100. Alternatively, an outside-in method can be used in which a device that is physically different from the HMD 100 and is equipped with various sensors is linked to the HMD 100.

[0035] The CPU 101 of the HMD 100 determines whether the HMD 100 or a part of the user's body is located in the warning area 305 (S206), and if it is determined that the HMD 100 is located in the warning area 305, it notifies the user of a warning (S207). In a situation where the user is wearing the HMD 100 in a room and enjoying a game as in the above example, the user's position may move without the user's knowledge in a sports game, action game, or the like. In that case, if the user gets too close to the outer edge of the viewing area 303, there is a risk of contacting an object outside the viewing area 303 in real space and being injured. Therefore, when the HMD 100 or a part of the user's body enters the warning area 305 set inside the outer edge of the viewing area 303, a warning is issued. This allows the user to recognize that he or she is approaching the viewing area 303 and that there is a possibility of injury if he or she continues moving, and to take evasive action.

[0036] In this manner, in this embodiment, by setting the warning area 305 based on the warning distance 304 for the viewing area 303, it becomes possible to notify the user of a warning at a more appropriate position.

[0037] Next, a specific example of the process of S204 (a method for setting a warning distance and a warning area based on the size of the viewing area) will be described. Fig. 4 is a flowchart showing an example of the process of S204.

[0038] In S401, the CPU 101 receives the size of the viewing area determined in S203.

[0039] In S402, CPU 101 determines whether the size of the viewing area received in S401 is smaller than the size set by the first threshold. If CPU 101 determines that the size of the viewing area is smaller than the first threshold (Yes in S402), it executes the process of S403, and if it determines that the size of the viewing area is equal to or larger than the first threshold (No in S402), it executes the process of S404.

[0040] In S403, the CPU 101 sets the warning distance to a value greater than the initial value, and then executes the process of S407.

[0041] In S404, CPU 101 determines whether the size of the viewing area is larger than the size set by the second threshold. The second threshold is necessarily a value larger than the first threshold. If CPU 101 determines that the size of the viewing area is larger than the second threshold (Yes in S404), it executes the process of S405, and if it determines that the size of the viewing area is equal to or smaller than the second threshold (No in S404), it executes the process of S406.

[0042] In S405, the CPU 101 sets the warning distance to a value smaller than the initial value, and then executes the process of S407.

[0043] In S406, the CPU 101 sets the warning distance to an initial value, and then executes the process of S407.

[0044] In S407, the CPU 101 sets a warning area using the warning distance set in any one of S403, S405, and S406, and then ends this process.

[0045] FIG. 5 is a schematic diagram illustrating the warning distance and warning area that are set according to the size of the viewing area by the process shown in the flowchart of FIG.

[0046] 5A is a schematic diagram showing an example of a warning distance 504 and a warning area 505 set in S403 and S407 for a viewing area 503. A user 501 is standing at a predetermined position in a physical space 500 while wearing an HMD 100. The CPU 101 of the HMD 100 determines the viewing area 503 in S202, calculates the size of the viewing area 503 in S203, and determines that the size of the viewing area 503 is smaller than the size set by the first threshold value (Yes in S402). In this case, the CPU 101 of the HMD 100 sets the warning distance 504 to a value larger than the initial value, and sets a warning area 505 inside the viewing area 503 along the outer edge of the viewing area 503 with the set value.

[0047] 5B is a schematic diagram showing an example of the warning distance 514 and warning area 515 set in S405 and S407 for the viewing area 513. A user 501 is standing at a predetermined position in the physical space 500 while wearing an HMD 100. It is assumed that the CPU 101 of the HMD 100 determines that the size of the viewing area 513 is equal to or larger than the size set by the first threshold value (No in S402) and is larger than the size set by the second threshold value (Yes in S404). In this case, the CPU 101 of the HMD 100 sets the warning distance 514 to a value smaller than the initial value, and sets a warning area 515 inside the outer edge of the viewing area 513 with the set value.

[0048] Here, in Fig. 5, the viewing areas 503, 513 and the warning areas 505, 515 are expressed as a plane on the floor surface on which the user 501 stands, but more precisely, they include a space in the vertical direction from the plane on the floor surface. The first threshold value, the second threshold value, and the initial values ​​of the warning distance may be stored in the non-volatile memory 103 in advance, or may be set by the user each time by inputting them from the operation unit 106. As described above, examples of the initial values ​​include the arm length and stride length of the user. Here, the warning distance is changed by setting two threshold values ​​for the size of the viewing area, but the present invention is not limited to this, and a method of changing the warning distance linearly in proportion to the size of the viewing area may also be used.

[0049] Setting the warning area according to the flowchart in Fig. 4 has the following effects. That is, when the viewing area is small and the user is likely to go outside the viewing area, setting the warning distance large allows the user to be warned earlier, making it easier for the user to recognize the danger and avoid it. Also, when the viewing area is large and the user is unlikely to go outside the viewing area, setting the warning distance small allows the user to watch the video without being hindered by the warning.

[0050] It is desirable to use different methods of setting the warning distance and warning area based on the size of the viewing area in S204 depending on the use case, and next, an example of a case where the use case of the process of S204 differs will be described. Fig. 6 is a flowchart showing another example of the process of S204.

[0051] The process of S601 is the same as the process of S401 in the flowchart of FIG.

[0052] In S602, CPU 101 determines whether the size of the viewing area received in S601 is smaller than the size set by the third threshold. The third threshold may be the same value as the first threshold used in S402 in Fig. 4, or may be a different value. If CPU 101 determines that the size of the viewing area is smaller than the third threshold (Yes in S602), it executes the process of S603, and if it determines that the size of the viewing area is equal to or larger than the third threshold (No in S602), it executes the process of S604.

[0053] In S603, the CPU 101 sets the warning distance to a value smaller than the initial value, and then executes the process of S607.

[0054] In S604, CPU 101 determines whether the size of the viewing area is larger than the size set by the fourth threshold. The third threshold may be the same as the second threshold used in S404 of FIG. 4, or may be a different value. The fourth threshold is necessarily larger than the third threshold. If CPU 101 determines that the size of the viewing area is larger than the fourth threshold (Yes in S604), it executes the process of S605, and if it determines that the size of the viewing area is equal to or smaller than the fourth threshold (No in S604), it executes the process of S606.

[0055] In S605, the CPU 101 sets the warning distance to a value greater than the initial value, and then executes the process of S607.

[0056] The processes in S606 and S607 are equivalent to the processes in S406 and S407 in the flowchart of FIG.

[0057] FIG. 7 is a schematic diagram illustrating the warning distance and warning area that are set according to the size of the viewing area by the process shown in the flowchart of FIG.

[0058] 7A is a schematic diagram showing an example of the warning distance 704 and warning area 705 set in S603 and S607 for the viewing area 703. A user 701 is standing at a predetermined position in the physical space 700 while wearing an HMD 100. The CPU 101 of the HMD 100 determines the viewing area 703 in S202, calculates the size of the viewing area 703 in S203, and determines that the size of the viewing area 703 is smaller than the size set by the third threshold (Yes in S602). In this case, the CPU 101 of the HMD 100 sets the warning distance 704 to a value smaller than the initial value, and sets a warning area 705 along the outer edge of the viewing area 703 and inside the outer edge with the length of the warning distance 704.

[0059] 7B is a schematic diagram showing an example of the warning distance 714 and warning area 715 set in S605 and S607 for the viewing area 713. The user 701 is standing at a predetermined position in the physical space 700 while wearing the HMD 100. The CPU 101 of the HMD 100 determines the viewing area 713 in S202, calculates the size of the viewing area 713 in S203, and determines that the size of the viewing area 713 is equal to or larger than the third threshold (No in S602) and larger than the fourth threshold (Yes in S704). In this case, the CPU 101 of the HMD 100 sets the warning distance 714 to a value larger than the initial value, and sets a warning area 715 along the outer edge of the viewing area 713 and inside the outer edge with the length of the warning distance 714.

[0060] Here, in Fig. 7, the viewing areas 703, 713 and the warning areas 705, 715 are expressed as a plane on the floor surface on which the user 701 stands, but more precisely, they include a space in the vertical direction from the plane on the floor surface. The third threshold value, the fourth threshold value, and the initial values ​​of the warning distance may be stored in the non-volatile memory 103 in advance, or may be set by the user each time by inputting them from the operation unit 106. As described above, examples of the initial values ​​include the arm length and stride length of the user. Here, the warning distance is changed by setting two threshold values ​​for the size of the viewing area, but the present invention is not limited to this, and a method of linearly changing the warning distance in proportion to the size of the viewing area may also be used.

[0061] Setting the warning area according to the flowchart in Fig. 6 provides the following effects. That is, when the size of the viewing area is small but the user's movements are small, such as when the user is watching a movie, the warning distance can be set small so that the user can watch the video without being hindered by the warning. On the other hand, when the viewing area is large and the user's movements are likely to be large, the warning distance can be set large so that the user can recognize the warning early and avoid danger.

[0062] FIG. 8 is a schematic diagram for explaining an example of a state in which a warning is issued in S207. FIG. 8(a) shows a state in which a user 801 is moving in a physical space 800 while wearing an HMD 100. When the CPU 101 of the HMD 100 determines that the HMD 100 or a part of the body of the user 801 has entered the warning area 805 (Yes in S206), the CPU 101 of the HMD 100 displays a warning mark superimposed on an image such as a virtual reality image displayed on the display unit 107 of the HMD 100. FIG. 8(b) shows a state in which a warning image 811 (attention mark) is superimposed on a virtual reality image 810 being viewed by the user 801. The warning image 811 is superimposed on the virtual reality image 810, so that the user 801 can recognize that there is a risk of colliding with some obstacle if he or she proceeds any further forward.

[0063] Here, the method of displaying the warning image 811 on the display unit 107 of the HMD 100 has been described, but the present invention is not limited to this, and the following first to fourth methods may be used, or each method may be used in combination. The first method is to display a virtual wall at a position indicating the outer edge (outermost periphery) of the viewing area 804 on the display unit 107. The second method is to output a warning sound from the audio output unit 108 of the HMD 100. The third method is to vibrate the HMD 100 by driving an actuator unit, if the HMD 100 includes an actuator unit. The fourth method is to vibrate another electronic device connected to the HMD 100 via the communication I / F 110.

[0064] The disclosure of this embodiment includes the following configurations and methods. (Configuration 1) An information processing device comprising: an acquisition means for acquiring three-dimensional coordinates of a physical space surrounding the information processing device; a setting means for setting a predetermined area in the physical space; a determination means for determining a warning distance based on the size of the predetermined area; and a warning means for issuing a warning when a part of the information processing device or a part of a user wearing the information processing device is located in a warning area that is within a range from the outer edge of the predetermined area inward to the length of the warning distance. (Configuration 2) The information processing device according to configuration 1, wherein the setting means sets an object-free area around the information processing device and the user in the physical space as the predetermined area. (Configuration 3) The information processing apparatus according to configuration 1, wherein the setting means has a designation means for accepting designation by the user as the predetermined area. (Configuration 4) The information processing device according to any one of configurations 1 to 3, further comprising a notification means for notifying the user of the warning distance when the warning distance is determined by the determination means. (Configuration 5) The information processing device according to any one of configurations 1 to 3, wherein the determination means sets the warning distance to a length equal to the user's arm length or the user's stride length. (Configuration 6) An information processing device as described in any one of configurations 1 to 4, further comprising a memory means for storing an initial value of the warning distance or an input means for inputting the initial value of the warning distance, wherein the determination means determines the warning distance to be a value larger than the initial value when the size of the specified area is smaller than a predetermined first threshold value. (Configuration 7) The information processing device according to configuration 6, wherein the determination means determines the warning distance to be a value smaller than the initial value when the size of the specified area is equal to or larger than the first threshold and is greater than a predetermined second threshold. (Configuration 8) The information processing device according to configuration 7, wherein the determination means determines the warning distance to be the initial value when the size of the specified area is equal to or greater than the first threshold and equal to or less than the second threshold. (Configuration 9) An information processing device described in any one of configurations 1 to 4, further comprising a memory means for storing an initial value of the warning distance or an input means for inputting the initial value of the warning distance, wherein the determination means determines the warning distance to be a value smaller than the initial value when the size of the specified area is smaller than a predetermined third threshold value. (Configuration 10) The information processing device according to configuration 9, wherein the determination means determines the warning distance to be a value greater than the initial value when the size of the specified area is greater than or equal to the third threshold and greater than a predetermined fourth threshold. (Configuration 11) The information processing device according to configuration 10, wherein the determination means determines the warning distance to be the initial value when the size of the specified area is greater than or equal to the third threshold and less than or equal to the fourth threshold. (Configuration 12) The information processing device according to any one of configurations 1 to 4, wherein the determining means determines the warning distance in proportion to the size of the predetermined area. (Configuration 13) The information processing device according to any one of configurations 1 to 12, further comprising a display device, wherein the warning means displays a warning image on the display device. (Configuration 14) The information processing device according to any one of configurations 1 to 13, further comprising a sound output means, wherein the warning means outputs a warning sound from the sound output means. (Configuration 15) The information processing device according to any one of configurations 1 to 14, further comprising a vibration means for vibrating the information processing device, and the warning means drives the vibration means. (Configuration 16) The information processing device according to any one of configurations 1 to 15, characterized in that the information processing device is a head-mounted display. (Configuration 17) A program for causing a computer to function as each of the means of the information processing device according to any one of configurations 1 to 16. (Configuration 18) A computer-readable storage medium storing a program for causing a computer to function as each of the means of the information processing device according to any one of configurations 1 to 16. (Method 1) An information processing method executed by an information processing device, comprising the steps of: acquiring three-dimensional coordinates of a physical space surrounding the information processing device; setting a predetermined area in the physical space; determining a warning distance based on the size of the predetermined area; and issuing a warning when a part of the information processing device or a part of a user wearing the information processing device is located in a warning area that extends from the outer edge of the predetermined area inward to the length of the warning distance.

[0065] Although the present invention has been described in detail above based on the preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-mentioned embodiments merely shows one embodiment of the present invention, and each embodiment can be appropriately combined.

[0066] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions. [Explanation of symbols]

[0067] 100 HMD 101 CPU 104 Imaging unit 105 Attitude detection unit 106 Operation section 107 Display section 303 Viewing Area 304 Warning distance 305 Warning area

Claims

1. An information processing device, An acquisition means for acquiring three-dimensional coordinates of a physical space around the information processing device; A setting means for setting a predetermined area in the physical space; A determination means for determining a warning distance according to the size of the predetermined area; and a warning means for issuing a warning when a part of the information processing device or a part of a user wearing the information processing device is located in a warning area extending inward from the outer edge of the specified area to the length of the warning distance.

2. The information processing apparatus according to claim 1 , wherein the setting unit sets, as the predetermined area, an area in the physical space that is free of objects around the information processing apparatus and the user.

3. 2. The information processing apparatus according to claim 1, wherein the setting means includes a designation means for accepting a designation by the user as the predetermined area.

4. 3. The information processing apparatus according to claim 1, further comprising a notification unit that notifies the user of the warning distance when the warning distance is determined by the determination unit.

5. 3 . The information processing apparatus according to claim 1 , wherein the determining means sets the warning distance to a length equal to an arm length of the user or a stride length of the user.

6. a storage means for storing an initial value of the warning distance or an input means for inputting an initial value of the warning distance, 3 . The information processing apparatus according to claim 1 , wherein the determining means determines the warning distance to be a value greater than the initial value when the size of the predetermined area is smaller than a first threshold value that is set in advance. 4 .

7. 7. The information processing device according to claim 6, wherein the determination means determines the warning distance to be a value smaller than the initial value when the size of the specified area is equal to or larger than the first threshold value and is also larger than a predetermined second threshold value.

8. 8. The information processing apparatus according to claim 7, wherein the determining means determines the warning distance to be the initial value when the size of the predetermined area is equal to or larger than the first threshold value and equal to or smaller than the second threshold value.

9. a storage means for storing an initial value of the warning distance or an input means for inputting an initial value of the warning distance, 3 . The information processing apparatus according to claim 1 , wherein the determining means determines the warning distance to be a value smaller than the initial value when the size of the predetermined area is smaller than a third threshold value that is set in advance. 4 .

10. 10. The information processing device according to claim 9, wherein the determination means determines the warning distance to be a value greater than the initial value when the size of the specified area is equal to or greater than the third threshold and is greater than a predetermined fourth threshold.

11. 11. The information processing apparatus according to claim 10, wherein the determining means determines the warning distance to be the initial value when the size of the predetermined area is equal to or larger than the third threshold value and equal to or smaller than the fourth threshold value.

12. 3. The information processing apparatus according to claim 1, wherein the determining means determines the warning distance in proportion to the size of the predetermined area.

13. A display device is provided, 3. The information processing apparatus according to claim 1, wherein the warning means displays a warning image on the display device.

14. A voice output means is provided, 3. The information processing apparatus according to claim 1, wherein the warning means outputs a warning sound from the sound output means.

15. a vibration means for vibrating the information processing device, 3. The information processing apparatus according to claim 1, wherein the warning means drives the vibration means.

16. 3. The information processing apparatus according to claim 1, wherein the information processing apparatus is a head mounted display.

17. An information processing method executed by an information processing device, acquiring three-dimensional coordinates of a physical space around the information processing device; setting a predetermined area in the physical space; determining a warning distance according to the size of the predetermined area; and issuing a warning when a part of the information processing device or a part of a user wearing the information processing device is located in a warning area that extends inward from the outer edge of the specified area to the length of the warning distance.

18. 2. A program for causing a computer to function as each of the means of the information processing device according to claim 1.

19. 2. A computer-readable storage medium storing a program for causing a computer to function as each of the means of the information processing device according to claim 1.

Images