Information processing device, information processing system, display device, information processing method, display device control method, and program

Abstract

To provide a technique that, when a specific user sees an image according to another user, can notify the specific user of the possibility of contact with a person and objects.SOLUTION: An information processing apparatus has: acquisition means that acquires a first image based on an attitude of a first display unit used by a first user; determination means that determines the possibility of contact of a second user; display control means that controls a second display unit used by the second user to display the first image; and control means that, when the possibility of contact of the second user is determined to be higher than a threshold, controls the second display unit to notify the second user of the possibility of contact of the second user in a form of notification different from a case where the second user is notified of the possibility of contact of the first user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing system, a display device, an information processing method, A method for controlling a display device; Regarding the program. [Background technology]

[0002] In recent years, XR (X Reality) technology has become known, which combines the virtual world and the real world in real time to create a new space (experience). Devices that present images using XR technology to users include head-mounted displays (HMDs), tablets, and smartphones.

[0003] Patent Document 1 describes a technology for a game device that allows a user viewing XR images (having an XR experience) as part of a game to understand dangerous situations. First, when the user approaches (or reaches) a specific area, the game device displays a message urging the user to stop moving. Then, when the user enters the specific area, the game device performs a process to discourage the user from viewing the XR images (at least one of a process to change the displayed image, a process to change the game's progress, and a process to end the game).

[0004] Patent Document 2 describes a technology that transmits an XR image viewed by a specific user to a device of another user and presents the XR image to the other users. This allows multiple users to view the XR image viewed by a specific user and give discussions and instructions. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-119031 [Patent Document 2] Japanese Patent Application Laid-Open No. 2002-132487 [Patent Document 3] Japanese Patent Application Laid-Open No. 2016-224809 Summary of the Invention [Problem to be solved by the invention]

[0006] However, in Patent Document 2, there is a possibility (risk) that a certain user may come into contact with a person or object by moving their body while viewing an XR image on another user's display device. Using the technology of Patent Document 1, a warning indicating the possibility of contact can be displayed on the XR image, thereby discouraging the user from continuing the experience. However, even with the technology of Patent Document 1, a certain user may view an XR image that includes a warning for other users, and therefore may not be able to correctly determine whether or not the certain user is in danger.

[0007] Therefore, an object of the present invention is to provide a technique that can appropriately notify a specific user of the possibility of contact when the specific user views an image corresponding to another user. [Means for solving the problem]

[0008] One aspect of the present invention is a method for producing a medicament for the treatment of a pulmonary arthritis. an acquisition means for acquiring a first image based on a posture of a first display device used by a first user; a determination means for determining a possibility of a collision of a second user; controlling a second display device used by the second user to display the first image; a control means for controlling the and When it is determined that the possibility of a collision of the second user is high, the control means determines that the possibility of a collision of the first user is high. It is common It is different from when it is known Ru shape Depending on the situation, there is a possibility of collision of the second user. Through and controlling the second display device to notify the The information processing device is characterized by the above.

[0009] One aspect of the present invention is a method for producing a medicament for the treatment of a pulmonary arthritis. A display device, a display means for displaying a first image based on the posture of a first display device used by a first user; If there is a high probability of a collision of a second user using the display device, there is a possibility of a collision of the first user. It is common It is different from when it is known Ru shape Depending on the situation, there is a possibility of collision of the second user. Through a control means for controlling the display means so as to notify the user of the display; The display device is characterized by having: One aspect of the present invention is a method for producing a medicament for the treatment of a pulmonary arthritis. A display device, a display means for displaying an image; a selection means for selecting a display mode from a plurality of display modes; and The plurality of display modes include a first display mode in which a first image in which a virtual object is arranged based on an attitude of a first display device used by a first user is displayed on the display means, and a second display mode in which a second image in which a virtual object is arranged based on an attitude of the display device used by a second user is displayed on the display means. The display device is characterized by the above.

[0010] One aspect of the present invention is a method for producing a medicament for the treatment of a pulmonary arthritis. A computer-implemented information processing method, comprising: an acquisition step of acquiring a first image based on a posture of a first display device used by a first user; determining a collision probability of a second user; controlling a second display device used by the second user to display the first image; If it is determined that the second user has a high probability of collision, it is determined that the first user has a high probability of collision. It is common It is different from when it is known Ru shape Depending on the state, the second user's collision There is a possibility of a collision Through controlling the second display device to notify the The information processing method is characterized by comprising: One aspect of the present invention is a method for producing a medicament for the treatment of a pulmonary arthritis. A computer-implemented method for controlling a display device having a display means, comprising: a step of displaying a first image based on a posture of a first display device used by a first user on the display means; When a possibility of a collision of a second user using the display device is high, controlling the display means to notify the second user of the possibility of a collision in a manner different from that when the possibility of a collision of the first user is notified; The control method is characterized by having the following. One aspect of the present invention is a method for producing a medicament for the treatment of a pulmonary arthritis. A computer-implemented method for controlling a display device having a display means, comprising: selecting a display mode from a plurality of display modes; The plurality of display modes include a first display mode in which a first image in which a virtual object is arranged based on an attitude of a first display device used by a first user is displayed on the display means, and a second display mode in which a second image in which a virtual object is arranged based on an attitude of the display device used by a second user is displayed on the display means. The control method is characterized by the above. [Effects of the Invention]

[0011] According to the present invention, when a specific user views an image corresponding to another user, the specific user can be appropriately notified of the possibility of contact. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a configuration diagram of an information processing system according to a first embodiment. [Figure 2] FIG. 2 is a hardware configuration diagram of a first device and a second device according to the first embodiment. [Figure 3] 4 is a flowchart of a display control process according to the first embodiment. [Figure 4] FIG. 2 is a diagram illustrating a display control process according to the first embodiment. [Figure 5] FIG. 10 is a diagram illustrating a warning according to the first embodiment. [Figure 6] FIG. 10 is a diagram illustrating a warning according to the first embodiment. [Figure 7] FIG. 10 is a configuration diagram of an information processing system according to a second embodiment. [Figure 8] FIG. 10 is a diagram illustrating a display control process according to the second embodiment. [Figure 9] 10 is a flowchart of a display control process according to the second embodiment. [Figure 10] FIG. 10 is a diagram illustrating a warning according to the second embodiment. [Figure 11] 10 is a flowchart of a display control process according to Modification 2. [Figure 12] FIG. 10 is a diagram illustrating a warning according to Modification 2. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Note that the configurations described in the following embodiments are representative examples, and the scope of the present invention is not necessarily limited to these specific configurations. In addition, the distance between two objects below is the length between the center positions of the two objects. Alternatively, it may be the length of the gap between two objects.

[0014] <Embodiment 1> 1 is a configuration diagram of an information processing system 1 according to embodiment 1. The information processing system 1 according to embodiment 1 includes a first device 100, a second device 200, a display device 120 used by a first user, and a display device 220 used by a second user. Note that, because the first device 100 and the second device 200 control the display device 120 and the display device 220, the first device 100 and the second device 200 may be collectively considered as a control system.

[0015] The first device 100 and the second device 200 can communicate with each other. The first device 100 and the display device 120 can communicate with each other. The second device 200 and the display device 220 can communicate with each other. Communication between each component may be wired or wireless.

[0016] Here, when multiple users are experiencing an XR experience, the information processing system 1 allows one user to select whether or not to share the display image they are viewing with other users. Such a user who shares the display image is referred to as an "other-viewpoint shared user." One method for selecting an "other-viewpoint shared user" is to set (assign) an ID or name to each of multiple users and select the "other-viewpoint shared user" in response to an operation by any of the users. Another method for selecting an "other-viewpoint shared user" is to select the "other-viewpoint shared user" using a real image, as in Patent Document 3. In the first embodiment, the "other-viewpoint shared user" is assumed to be the first user who uses (wears) the display device 120.

[0017] (Regarding the internal configuration of the first device 100) The internal configuration of first device 100 will be described with reference to Fig. 1. First device 100 is a control device (information processing device; electronic device) that controls display device 120. First device 100 has image acquisition unit 101, measurement unit 102, data acquisition unit 103, warning determination unit 104, data storage unit 106, image generation unit 107, and shared image transmission unit 110.

[0018] The image acquisition unit 101 acquires a real image from the imaging unit 121 of the display device 120. The real image is an image captured by the imaging unit 121 of the range (space) in front of the display device 120. The image acquisition unit 101 outputs the real image to the measurement unit 102 and the image generation unit 107.

[0019] The measurement unit 102 performs image processing on the real image to extract characteristic information (feature information) such as points and lines in the real image. The measurement unit 102 measures the position and orientation (position and orientation) of the display device 120 based on the feature information. The measurement unit 102 then determines the position and orientation of the first user from the position and orientation of the display device 120. The measurement unit 102 outputs the information on the position and orientation of the first user to the warning determination unit 104 and the image generation unit 107.

[0020] In the first embodiment, the measurement unit 102 measures the position and orientation of the display device 120 based on the result of image processing. However, the measurement unit 102 may also measure the position and orientation of the display device 120 mechanically. The measurement unit 102 may measure the position and orientation using infrared light or ultrasonic waves, or may measure the position and orientation using a magnetic sensor. Furthermore, the measurement unit 102 may measure the position and orientation of the display device 120 using a depth sensor. These sensors may be included in the display device 120, or may be included in the first device 100 if the display device 120 and the first device 100 are located in the same position.

[0021] The data acquisition unit 103 acquires information on the position, orientation, and shape of a real object (an object or a person arranged in real space). Here, the real object is an object (an object other than a person) or a person for which it is determined whether or not there is a possibility of contact (collision) with the first user. The real object also includes users other than the first user (such as a second user). The data acquisition unit 103, for example, The information on the position and orientation of the second user may be acquired by the measurement unit 202 of the second device 200, or may be acquired from values ​​measured by a sensor included in the display device 120. The data acquisition unit 103 may also assume that the shape of the second user is, for example, a predetermined shape or a cylindrical shape. The data acquisition unit 103 outputs information on the position and orientation and shape of the real object to the warning determination unit 104 as real object data.

[0022] Furthermore, the data acquisition unit 103 acquires information on the position, orientation, and shape of a real object based on the results of scanning the real space in advance using a known 3D reconstruction technique, for example. Alternatively, the data acquisition unit 103 may acquire information on the position, orientation, and shape of a real object by acquiring multiple real images captured from multiple positions (viewpoints) and measuring the depth of the real object based on the parallax between the multiple real images.

[0023] The user may register information about the position, orientation, and shape of the real object in advance. In this case, the user may set a three-dimensional model (for example, a cubic or cylindrical model) that includes a space that includes the real object. The data acquisition unit 103 may then acquire the position where the three-dimensional model set by the user is placed as the position of the real object, and acquire the shape of the three-dimensional model as the shape of the real object. Alternatively, the user may set a plane (two-dimensional space) where the real object is placed as the position of the real object.

[0024] The warning determination unit 104 determines the possibility (risk) of contact (collision) based on the position and posture of the first user and the real object data. Then, the warning determination unit 104 determines whether to issue a warning (notification) that there is a high possibility of contact. The warning determination unit 104 outputs the result of the determination of whether to issue a warning that there is a high possibility of contact (first determination result) to the image generation unit 107. In the first embodiment, the warning determination unit 104 determines whether to issue a warning that there is a high possibility of contact (possibility of contact) depending on whether the distance between the first user and the real object is within a threshold Th1. Here, the warning determination unit 104 can calculate the distance between the first user and the real object, for example, by calculating the coordinate difference between the position of the first user and the position of the real object indicated by the real object data. The warning determination unit 104 may measure the distance between the first user and the real object using a distance sensor included in the display device 120. Furthermore, when the second user is a real object, the warning determination unit 104 may receive radio waves emitted by the display device 220 and measure the distance between the second user and the first user according to the strength of the received radio waves. Note that the warning determination unit 104 may use another determination method as long as it can detect the possibility of the user coming into contact with a real object.

[0025] For example, as in Patent Document 3, the warning determination unit 104 estimates the area where the first user exists from the position and orientation of the first user. Then, the warning determination unit 104 may determine whether to issue a warning that there is a high possibility of contact, depending on whether the distance between the area where the first user exists and the real object is within a threshold Th1.

[0026] The warning determination unit 104 may further determine whether to issue a warning that there is a high possibility of contact, depending on whether the first user is looking at the display device 120, in addition to the distance between the first user and the real object. That is, the warning determination unit 104 may determine not to issue a warning that there is a high possibility of contact if the first user is not looking at the display device 120. In this case, the image generation unit 107 controls the display device 120 not to issue a warning (notification) that there is a high possibility of contact by the first user (by not superimposing a warning item on the XR image). If the display device 120 is a device held in the hand, such as a tablet, when the first user is immersed in the XR experience, there is a high possibility that the first user is not checking the surroundings, and therefore there is a high need to issue a warning that there is a high possibility of contact. On the other hand, when the first user is not immersed in the XR experience, there is a high possibility that the first user is checking the surroundings, and therefore there is a low need to issue a warning that there is a high possibility of contact. That is, when the first user is not looking at the display device 120, In this case, there is little need to issue a warning that there is a high possibility of contact. Whether or not the first user is looking at display device 120 can be determined by acquiring an image with the internal camera of display device 120 and performing line of sight detection.

[0027] That is, the warning determination unit 104 may determine to issue a warning (notification) that there is a high possibility of contact when the distance between the first user and the real object is within the threshold Th1 and the first user is looking at the display device 120. On the other hand, in other cases, the warning determination unit 104 may determine not to issue a warning that there is a high possibility of contact.

[0028] The data storage unit 106 stores data of the virtual space. The data storage unit 106 outputs the data of the virtual space to the image generation unit 107. The data of the virtual space includes data on virtual objects that configure the virtual space (information on the shape and position and orientation of the virtual objects), data on a light source that irradiates light in the virtual space, and the like.

[0029] The image generation unit 107 generates an XR image (mixed reality image) based on the position and orientation of the first user (or the display device 120), the virtual space data, and the real image. Specifically, the image generation unit 107 places a virtual object indicated by the virtual space data in the real space indicated by the real image, based on the orientation (or position and orientation) of the display device 120. In this way, the image generation unit 107 generates an XR image in which the virtual object appears to be placed in real space. Furthermore, when the warning determination unit 104 determines that a warning is to be issued that there is a high possibility of contact (according to the first determination result), the image generation unit 107 generates a display image by superimposing a first warning item (warning mark) on the XR image. When it is determined that there is no possibility of contact, the image generation unit 107 treats the XR image as a display image as is. The image generation unit 107 outputs the display image to the display unit 122 (display device 120). In this way, the image generation unit 107 controls the display on the display unit 122. The image generating unit 107 further outputs the display image to the shared image transmitting unit 110 .

[0030] The shared image transmission unit 110 transmits the display image as a "different-viewpoint image" to the second device 200. At this time, the shared image transmission unit 110 may transmit an image obtained by changing the image quality or frame rate of the display image, or an image obtained by cutting out a part of the display image, to the second device 200 as the "different-viewpoint image."

[0031] (Regarding the internal configuration of the second device 200) The internal configuration of second device 200 will be described with reference to Fig. 1. Second device 200 is a control device (electronic device; information processing device) that controls display device 220. Second device 200 has image acquisition unit 201, measurement unit 202, data acquisition unit 203, warning determination unit 204, shared image acquisition unit 205, and display control unit 206.

[0032] The image acquisition unit 201 acquires a real image of the real space (the space in front of the display device 220) captured by the imaging unit 221. The image acquisition unit 201 outputs the acquired real image to the measurement unit 202.

[0033] The measurement unit 202, like the measurement unit 102, measures the position and orientation of the display device 220. Then, the measurement unit 202 determines the position and orientation of the second user from the position and orientation of the display device 220. The measurement unit 202 outputs information about the position and orientation of the second user to the warning determination unit 204.

[0034] The data acquisition unit 203 acquires information on the position, orientation, and shape of a real object, similar to the data acquisition unit 103. Here, the real object includes a user (first user) other than the second user. The data acquisition unit 203 outputs the information on the position, orientation, and shape of the real object to the warning determination unit 204 as real object data.

[0035] The warning determination unit 204, like the warning determination unit 104, determines the possibility of contact (collision) by the second user based on the position and orientation of the second user and the real object data. Like the warning determination unit 104, the warning determination unit 204 determines the possibility of contact by the second user based on the distance between the second user and the real object or whether the second user is looking at the display device 120. Then, the warning determination unit 204 determines whether to issue a warning (notification) that the second user is likely to contact (collision). The warning determination unit 204 outputs the result of the determination of whether to issue a warning that the possibility of contact is high (second determination result) to the display control unit 206.

[0036] The shared image acquisition unit 205 requests the first device 100 associated with the first user, who is the "other-viewpoint shared user," to transmit the "other-viewpoint image" (XR image). Upon acquiring the "other-viewpoint image," the shared image acquisition unit 205 outputs the acquired "other-viewpoint image" to the display control unit 206.

[0037] The display control unit 206 is a control unit that controls the display of the display unit 222. The display control unit 206 controls the display image to be displayed on the display unit 222 based on the second determination result in the warning determination unit 204 and the "other viewpoint image." The control of the display image is realized by executing processing in accordance with the flowchart in FIG. 3B, which will be described later. The display control unit 206 outputs the display image to the display unit 222 (display device 220).

[0038] (Regarding the internal structure of the display device) The internal configuration of the display device 120 will be described with reference to Fig. 1. Since the display device 120 and the display device 220 have similar configurations, a description of the internal configuration of the display device 220 will be omitted. The display device 120 has an imaging unit 121 and a display unit 122.

[0039] The imaging unit 121 captures an image of the real space to obtain a captured image, and outputs the captured image as a real image to the first device 100. The display unit 122 displays the display image obtained from the first device 100.

[0040] The display device 120 and the display device 220 according to the first embodiment will be described as being HMDs (head-mounted displays), but are not limited thereto. The display device may be any device (for example, a smartphone, a digital camera, or a tablet terminal) that includes an imaging unit and a display unit. Furthermore, the HMD will be described as being a video see-through HMD (an HMD that displays an XR image generated based on an image captured by an imaging unit on a display unit). However, the display device 120 and the display device 220 may also be an optical see-through HMD (an HMD that displays an image of a virtual space superimposed on a display medium that allows observation through real space).

[0041] Note that the display device 120 may include the first device 100. The display device 220 may include the second device 200. Furthermore, the display device 120 may include the first device 100 and the second device 200. The display device 220 may include the first device 100 and the second device 200.

[0042] 2 is a hardware configuration diagram of the first device 100 and the second device 200 for realizing the configurations shown in FIG. 1. The CPU 11 performs overall control of each device (each hardware configuration) connected via the bus 10. The CPU 11 reads out and executes information on processing steps and programs stored in a read-only memory (ROM 12). The ROM 12 stores information such as an operating system (OS), programs related to the first embodiment, and device drivers. The CPU 11 expands (temporarily stores) the information stored in the ROM 12 into a random access memory (RAM 13) and executes it. Furthermore, input interface 14 (input I / F) acquires an input signal in a format that can be processed by first device 100 and second device 200 from an external device. Furthermore, output interface 15 (output I / F) outputs an output signal in a format that can be processed by the external device to the external device.

[0043] (Display control processing) 3A and 3B, a process (display control process) for controlling the display of first device 100 and second device 200 will be described. Fig. 3A shows the process performed by first device 100. Fig. 3B shows the process performed by second device 200.

[0044] In explaining the display control process, it is assumed that a first user 402 wears the display device 120 on his head, and a second user 404 wears the display device 220 on his head, as shown in FIG. 4. The first user 402 is viewing an XR image 406 displayed on the display device 120. Here, the XR image 406 is an image of a virtual space including a real object 400 and a virtual object 401. The second user 404 is viewing an XR image 407 displayed on the display device 220. The content of the XR image 407 is the same as that of the XR image 406, except for warning items (display items). Note that the XR image 407 may have a different image quality or frame rate from the XR image 406, or may be an image of a partial range of the XR image 406.

[0045] First, with reference to the flowchart in Fig. 3A, a description will be given of the processing executed by the first device 100. The processing of the flowchart in Fig. 3A starts every time the image acquisition unit 101 acquires a real image corresponding to one frame.

[0046] In step S300, the measurement unit 102 acquires a real image from the image acquisition unit 101. Then, the measurement unit 102 measures (estimates) the position and orientation of the first user 402 based on the real image.

[0047] In step S301, the image generation unit 107 generates an XR image based on the orientation of the display device 120. Specifically, the image generation unit 107 generates an XR image in which a virtual object is placed at a position based on the orientation (position) of the display device 120 in the real space indicated by the real image.

[0048] In step S302, the warning determination unit 104 determines whether the possibility of contact between the first user 402 and the real object 400 is higher than a threshold Th. Specifically, the warning determination unit 104 determines whether the distance between the first user 402 and the real object 400 is within a threshold Th1 (performs a first warning determination). If it is determined that the distance between the first user 402 and the real object 400 is within the threshold Th1, it is determined that the possibility of contact between the first user 402 and the real object 400 is higher than the threshold Th, and the process proceeds to step S303. If it is determined that the distance between the first user 402 and the real object 400 is greater than the threshold Th1, the process proceeds to step S304.

[0049] In step S303, the image generation unit 107 generates a display image by superimposing a first warning item onto the XR image (the XR image based on the attitude of the display device 120) to warn that there is a high possibility of contact by the first user 402. Fig. 5A shows an example of the XR image after the processing of step S303, in which a triangular first warning item 501 is superimposed on the XR image 500.

[0050] In step S304, the shared image transmission unit 110 transmits the display image generated by the image generation unit 107 to the second device 200 as a "different viewpoint image." If the distance between the first user 402 and the real object 400 is within the threshold Th1 (YES in step S302), the displayed image is an image in which the first warning item is superimposed on an XR image based on the attitude of the display device 120. On the other hand, if the distance between the first user 402 and the real object 400 is greater than the threshold Th1 (NO in step S302), the displayed image is an XR image based on the attitude of the display device 120 (an XR image in which the first warning item is not superimposed).

[0051] In step S305, the image generation unit 107 transmits a display image to the display device 120 (first display device), whereby the image generation unit 107 controls the display unit 122 to display the display image.

[0052] Next, a description will be given of the processing executed by second device 200 with reference to the flowchart in Fig. 3B. The processing of the flowchart in Fig. 3B starts every time image acquisition unit 201 acquires a real image corresponding to one frame.

[0053] In step S310, the shared image acquisition unit 205 determines whether or not the "other-viewpoint image" has been acquired from the first device 100. If it is determined that the "other-viewpoint image" has been acquired, the process proceeds to step S311. If it is determined that the "other-viewpoint image" has not been acquired, the process of step S310 is repeated. If it is determined that the "other-viewpoint image" has not been acquired, the shared image acquisition unit 205 may further request the shared image transmission unit 110 to transmit the "other-viewpoint image".

[0054] In step S311, the measurement unit 202 acquires a real image from the image acquisition unit 201. The measurement unit 202 measures the position and orientation of the second user 404 based on the real image.

[0055] In step S312, the warning determination unit 204 determines whether or not the possibility of contact between the second user 404 and the real object 400 is higher than a threshold value Th. Specifically, the warning determination unit 204 determines whether or not the distance between the second user 404 and the real object 400 is within a threshold value Th2 (a predetermined distance) (performs a second warning determination). If it is determined that the distance between the second user 404 and the real object 400 is within the threshold value Th2, it is determined that the possibility of contact between the second user 404 and the real object 400 is higher than the threshold value Th, and the process proceeds to step S313. If it is determined that the distance between the second user 404 and the real object 400 is greater than the threshold value Th2, it is determined that the possibility of contact between the second user 404 and the real object 400 is equal to or less than the threshold value Th, and the process proceeds to step S314.

[0056] In step S312, the warning determination unit 204 only needs to determine whether the possibility of contact between the second user 404 and the real object 400 is higher than the threshold value Th. Therefore, the above-mentioned "distance between the second user 404 and the real object 400" may be interpreted as "a value obtained by dividing the distance between the second user 404 and the real object 400 by the speed at which the second user 404 and the real object 400 approach each other (approach speed)." This is because the faster the approach speed, the higher the possibility of contact. In other words, by interpreting it in this way, the warning determination unit 204 can determine the possibility of contact with even higher accuracy. Note that this interpretation can also be applied to determining the possibility of contact between the first user 402 and the real object 400 (step S302).

[0057] In step S313, the display control unit 206 superimposes a second warning item on the "other-viewpoint image" acquired by the shared image acquisition unit 205 to warn that there is a high possibility of contact by the second user. Here, the second warning item is a warning item different from the first warning item. The second warning item is, for example, a warning item that is more noticeable than the first warning item.

[0058] If the possibility of contact by the first user 402 is higher than a predetermined value, the shared image acquisition unit 5A, the "other-viewpoint image" acquired by the display device 220 is an XR image including a first warning item 501. In such a case, the display control unit 206 superimposes a second warning item 502 on the XR image 500 so as to cover the entire first warning item 501, as shown in FIG. 5B. This allows the second user 404 to recognize only the second warning item 502 in the XR image displayed on the display device 220.

[0059] In step S314, the display control unit 206 transmits the "other-viewpoint image" as a display image to the display device 220 (second display device). As a result, the display control unit 206 controls the display unit 222 to display the display image.

[0060] According to the first embodiment, the information processing system 1 displays a first warning item for warning "other viewpoint shared users" and a second warning item for warning the specific user in different display formats on a display device viewed by a specific user. This allows the user, when viewing an XR image based on a display device held by another user, to understand who the warning is directed to.

[0061] In the first embodiment, the information processing system 1 uses different icons for the first warning item and the second warning item, as shown in FIGS. 5A and 5B. However, any display format of the warning item (display item) can be used as long as it allows the user to understand whether there is a possibility of contact with the user or with a "different viewpoint sharing user." For example, the first warning item and the second warning item may be message windows containing different wording. One of the first warning item and the second warning item may be an icon, and the other may be a message window.

[0062] Furthermore, the display control unit 206 may change the display format (notification format) of the warning item depending on whether the possibility of the second user coming into contact with an object (an object other than a person) is higher than the threshold value Th or whether the possibility of the second user coming into contact with a person is higher than the threshold value Th. Specifically, contact between people may cause greater damage. For this reason, for example, the display control unit 206 may make the second warning item larger and brighter in color when the possibility of the second user coming into contact with a person is higher than the threshold value Th2 than when the possibility of the second user coming into contact with an object is higher than the threshold value Th. Note that the display format of the warning item may be different not between an object and a person, but between a specific user and the second user and a person other than the specific user, depending on whether the possibility of the second user coming into contact with a person other than the specific user is higher than the threshold value Th. Here, the specific user may be the first user or a user using a display device for viewing XR images (a display device capable of acquiring “other-viewpoint images” from the first device).

[0063] (Variation 1) In the first embodiment, even if the "other-viewpoint image" transmitted from the shared image transmission unit 110 includes a first warning item, the display control unit 206 superimposes a second warning item, which is different from the first warning item, on the "other-viewpoint image." This allows the second user to understand whether there is a possibility of contact with the first user, who is the "other-viewpoint shared user," or with the second user himself (the second user). However, when the "other-viewpoint image" transmitted from the shared image transmission unit 110 includes the first warning item, the display control unit 206 may overwrite the first warning item to clearly indicate that there is a possibility of contact with the "other-viewpoint shared user." In this case, the display control unit 206 may change the display form of the first warning item or superimpose another warning item on the first warning item.

[0064] For example, the shared image transmission unit 110 transmits the XR image and the first determination result in association with each other. Then, the shared image acquisition unit 205 acquires the XR image and the first determination result. The display control unit 206 determines whether to issue a warning that there is a high possibility of contact based on the first determination result. When it is determined that there is a high possibility of contact, the display control unit 206 displays a warning item 600 that indicates in text to the "other viewpoint sharing user" that there is a high possibility of contact, as shown in FIG.

[0065] As a result, when a user is viewing an XR image based on a display device held by another user, the user can more accurately determine whether there is a possibility of contact between the user himself or herself or a "different viewpoint shared user."

[0066] <Embodiment 2> In the first embodiment, an information processing system 1 was described that warns a second user that there is a high possibility of contact when the second user is viewing an XR image based on a display device held by a first user (is experiencing an XR experience using the XR image). In the second embodiment, an information processing system 2 is described that can switch whether the second user views an XR image based on a display device held by the second user or an XR image based on a display device held by the first user.

[0067] Fig. 7 is a configuration diagram of an information processing system 2 according to embodiment 2. In Fig. 7, only the configuration that differs from embodiment 1 (Fig. 1) will be described in detail, and a description of the other configurations will be omitted.

[0068] The information processing system 2 includes a display device 120, a first device 100, and a display device 700. The first device 100 and the display device 700 are connected so as to be able to communicate with each other.

[0069] The internal configuration of the display device 700 will be described with reference to FIG. 7. The display device 700 has an imaging unit 221, a display unit 222, and a second device 710. In the second embodiment, the display device 700 is assumed to be a tablet terminal. The display device 700 may be any device provided with the imaging unit 221, the display unit 222, and an information processing unit (second device 710). The display device 700 may be, for example, a mobile terminal such as a smartphone, or a standalone HMD.

[0070] 8A and 8B are diagrams showing an example in which a second user 404 is viewing an XR image based on a display device 700 (a display device held by the second user 404), and an example in which the second user 404 is viewing an XR image based on a display device 120 held by the first user 402. In FIGS. 8A and 8B, the same components as those in FIG. 4 are assigned the same numbers, and descriptions of those components will be omitted.

[0071] 8A shows an example in which a second user 404 is viewing an XR image based on the display device 700. The XR image 802 displayed on the display device 700 is an XR image in which an image of a virtual object 401 is superimposed on a real image acquired by the imaging unit 221 of the display device 700.

[0072] 8B shows an example in which a second user 404 is viewing an XR image based on the display device 120 held by a first user 402. The XR image 803 displayed on the display device 700 is an XR image in which an image of a virtual object 401 is superimposed on a real image acquired by the imaging unit 121 of the display device 120.

[0073] The data storage unit 711 stores the data of the virtual space, similar to the data storage unit 106. The data storage unit 711 outputs the data of the virtual space to the image generation unit 712.

[0074] Similar to the image generation unit 107, the image generation unit 712 generates an XR image based on a real image captured by the imaging unit 221 of the real space. In the following, the XR image generated by the image generation unit 712 will be referred to as The image generated by the image generator 712 is called a “self-viewpoint image.” The image generator 712 outputs the “self-viewpoint image” to the display controller 714.

[0075] The mode selection unit 713 selects a display mode of the display device 700. Specifically, the mode selection unit 713 selects either a display mode that displays the "own-viewpoint image" generated by the image generation unit 712, or a display mode that displays the "other-viewpoint image" (XR image) generated by the first device 100. Hereinafter, the display mode that displays the "own-viewpoint image" generated by the image generation unit 712 will be referred to as the "own-viewpoint mode." The display mode that displays the "other-viewpoint image" generated by the first device 100 will be referred to as the "other-viewpoint mode." The mode selection unit 713 outputs information about the selected display mode to the display control unit 714.

[0076] When the mode selection unit 713 selects the other-viewpoint mode, it then selects an "other-viewpoint shared user." At this time, the users who can be selected as the "other-viewpoint shared user" are only users linked to the information processing device (display device) for which the own-viewpoint mode is selected. In this case, the mode selection unit 713 outputs information on the "other-viewpoint shared user" to the display control unit 714.

[0077] The display control unit 714 controls the display image according to the display mode information acquired from the mode selection unit 713. The display control unit 714 makes a request to the image generation unit 712 or the shared image acquisition unit 205 according to the display mode of the display device 700, and acquires a "self-viewpoint image" or an "other-viewpoint image". Then, the display control unit 714 generates a display image based on the acquired image. The generation of the display image is realized by executing processing in accordance with a flowchart described below (see FIG. 9B). The display control unit 714 outputs the display image to the display unit 222.

[0078] A process (display control process) for first device 100 and second device 710 to control display will be described with reference to the flowcharts of Figures 9A and 9B. Figure 9A shows the process performed by first device 100. Figure 9B shows the process performed by second device 710. In the following, a description of the same steps as in Figures 3A and 3B will be omitted.

[0079] First, with reference to the flowchart in Fig. 9A, a description will be given of the processing executed by the first device 100. The processing in the flowchart in Fig. 9A starts every time the image acquisition unit 101 acquires a real image corresponding to one frame.

[0080] In step S900, shared image transmission unit 110 determines the display mode of display device 700 based on the display mode notification from shared image acquisition unit 205. If it is determined that the display mode of display device 700 is the same viewpoint mode, the process proceeds to step S305. If it is determined that the display mode of display device 700 is the different viewpoint mode, the process proceeds to step S304.

[0081] Next, a description will be given of the processing executed by second device 710 with reference to the flowchart in Fig. 9B. The processing of the flowchart in Fig. 9B starts every time image acquisition section 201 acquires a real image corresponding to one frame.

[0082] In step S910, shared image acquisition unit 205 notifies first device 100 of the display mode selected by mode selection unit 713 (the display mode of display device 700). If the display mode of display device 700 is the other-viewpoint mode, shared image acquisition unit 205 can be said to be requesting shared image transmission unit 110 to transmit an "other-viewpoint image" by notifying the display mode.

[0083] In step S911, the display control unit 714 determines the display mode selected by the mode selection unit 713. If it is determined that the mode selection unit 713 has selected the self-viewpoint mode, If so, the process proceeds to step S912. If it is determined that the mode selection unit 713 has selected the other viewpoint mode, the process proceeds to step S310.

[0084] In step S912, the display control unit 714 requests the image generation unit 712 to generate a "self-viewpoint image." In response to the request from the display control unit 714, the image generation unit 712 generates a "self-viewpoint image" (XR image) based on the real image acquired by the imaging unit 221.

[0085] In step S913, the measurement unit 202 measures the position and orientation of the second user, similarly to step S311.

[0086] In step S914, the warning determination unit 204 determines whether the distance between the second user and the real object is within threshold Th2, as in step S312. If it is determined that the distance between the second user and the real object is within threshold Th2 (that is, if it is determined that the possibility of contact between the second user and the real object is higher than threshold Th), the process proceeds to step S915. If it is determined that the distance between the second user and the real object is greater than threshold Th2, the process proceeds to step S916.

[0087] In step S915, the display control unit 714 superimposes a third warning item onto the "self-viewpoint image" to warn that there is a high possibility of contact by the second user. For example, as shown in FIG. 10, a third warning item 1001 is superimposed onto an XR image 1000. The third warning item 1001 is a display item in a form different from the first warning item 501 and the second warning item 502 shown in FIGS. 5A and 5B.

[0088] In step S916, the display control unit 714 transmits a display image to the display unit 222. Here, if the display mode of the display device 700 is the own viewpoint mode, the display image is a "own viewpoint image," and if the display mode of the display device 700 is the other viewpoint mode, the display image is a "other viewpoint image."

[0089] In the second embodiment, the first warning item, the second warning item, and the third warning item are warning items having different predetermined forms. However, for example, the form of the warning item may be arbitrarily determined by the user. For example, a setting unit (not shown) of the first device 100 or a setting unit (not shown) of the second device 710 may set the form of each warning item in response to a user operation.

[0090] The setting unit calls a GUI for setting information about the warning item (a GUI to be displayed as the warning item and the placement of the warning item). The setting unit then sets the information about the warning item in response to a user operation. The image generation unit 107 superimposes the first warning item on the XR image based on the GUI and placement information of the first warning item. The setting unit of the second device 710 outputs the GUI and placement information of the second and third warning items to the display control unit 714. When the display mode is the own-viewpoint mode, the display control unit 714 superimposes the third warning item on the "own-viewpoint image" based on the acquired information. When the display mode is the other-viewpoint mode, the display control unit 714 superimposes the second warning item on the "other-viewpoint image" based on the acquired information.

[0091] In this way, by making the first warning item, second warning item, and third warning item have different forms, the user can accurately grasp whether there is a possibility of contact between themselves or a ``different viewpoint sharing user,'' as well as the display mode of the display device 700.

[0092] (Variation 2) In the second modification, the information processing system 2 determines whether the second user will touch the real object. The image displayed on the display unit 222 is switched accordingly. When the display mode is the other-viewpoint mode, the second user cannot see the surroundings in real space, increasing the possibility of contact with a real object. For this reason, the information processing system 2 may use a "self-viewpoint image" (an XR image based on a real image acquired by the imaging unit 221) as the display image when the distance between the second user and the real object is within a threshold (within a predetermined distance).

[0093] A display control process executed by the second device 710 according to Modification 2 will be described with reference to the flowchart shown in Fig. 11. In the following, the same steps as those in Fig. 3B or 9B are assigned the same reference numbers, and their description will be omitted.

[0094] The process of step S1100 starts when it is determined in step S911 that the display mode of display device 700 is the other viewpoint mode. In step S1100, measurement unit 202 measures the position and orientation of the second user, similarly to steps S311 and S913.

[0095] In step S1101, the warning determination unit 204 determines whether the distance between the second user and the real object is within threshold Th2. If it is determined that the distance between the second user and the real object is within threshold Th2 (that is, if it is determined that the possibility of contact between the second user and the real object is higher than threshold Th), the process proceeds to step S1103. If it is determined that the distance between the second user and the real object is greater than threshold Th2, the process proceeds to step S1102.

[0096] In step S1102, the display control unit 714 determines whether the shared image acquisition unit 205 has acquired an "other-viewpoint image." If it is determined that an "other-viewpoint image" has been acquired, the process proceeds to step S313. If it is determined that an "other-viewpoint image" has not been acquired, the process of step S1102 is repeated.

[0097] In step S1103, similarly to step S912, the display control unit 714 requests the image generation unit 712 to generate a "self-viewpoint image." In response to the request from the display control unit 714, the image generation unit 712 generates a "self-viewpoint image" based on the real image acquired by the imaging unit 221.

[0098] As described above, when the second user is viewing an XR image based on the display device held by the first user and there is a possibility that the second user may come into contact with a real object, the information processing system 2 switches to an XR image based on the display device held by the second user. This allows the second user to understand the situation around them, and therefore whether or not there is a possibility of contact with the second user.

[0099] In the second modification, the information processing system 2 uses only the "self-viewpoint image" as the display image when the display mode of the display device 700 is the other-viewpoint mode and the distance between the second user and the real object is within threshold Th2. However, the information processing system 2 may also use the "other-viewpoint image." That is, when the display mode is the other-viewpoint mode and the distance between the second user and the real object is within threshold Th2, the information processing system 2 may superimpose the "other-viewpoint image" and a warning item on a portion of the "self-viewpoint image." For example, as shown in FIG. 12 , the display control unit 714 may superimpose a warning item 1201 and an XR image 1202 that is the "other-viewpoint image" on a portion of an XR image 1200 that is the "self-viewpoint image." This can be achieved by the display control unit 714 acquiring the "other-viewpoint image" from the shared image acquisition unit 205 and further performing a process of superimposing the "other-viewpoint image" on the display image.

[0100] (Variation 3) In the second modification, the information processing system 2 is configured to display the image when the display mode of the display device 700 is the other-viewpoint mode. If the distance between the second user and the real object is within a threshold Th2, the display image of the display device 700 is switched from the "other-viewpoint image" to the "own-viewpoint image." However, the information processing system 2 may change the display mode in such a case.

[0101] If the display mode of display device 700 is the other-viewpoint mode and the distance between the second user and the real object is within threshold Th2, mode selection unit 713 switches the display mode to the own-viewpoint mode.

[0102] In this way, when the second user is looking at the "other-viewpoint image," if there is a high possibility of contact with the second user, the image displayed on the display device 700 can be switched to the "own-viewpoint image." This allows the second user to know whether there is a high possibility of contact with himself or herself.

[0103] In addition, in each of the above-described embodiments and modifications, the information processing system warns of a high possibility (risk) of contact by displaying a warning item. Here, the information processing system may warn of a high possibility (risk) of contact by sound or vibration in addition to (or instead of) displaying the warning item. That is, the display control unit may warn of a high possibility of contact between the user and a real object by outputting (emitting) sound from a sound output unit of the display device or by vibrating the display device. The information processing system may further vary the sound or vibration pattern depending on the display mode.

[0104] In addition, in each of the above-described embodiments and modifications, the XR image is an image in which virtual objects represented by virtual space data are arranged in relation to the real space represented by the real image. However, the XR image may also be a VR image as long as it is an image based on the orientation of the display device. In other words, the XR image may be an image in which virtual objects are arranged based on the orientation of the display device, regardless of whether it is a real image.

[0105] Furthermore, in the above, "If A is equal to or greater than B, proceed to step S1; if A is smaller (lower) than B, proceed to step S2" may be read as "If A is larger (higher) than B, proceed to step S1; if A is equal to or less than B, proceed to step S2." Conversely, "If A is larger (higher) than B, proceed to step S1; if A is equal to or less than B, proceed to step S2" may be read as "If A is larger (higher) than B, proceed to step S1; if A is smaller (lower) than B, proceed to step S2." Therefore, unless a contradiction arises, the expression "equal to or greater than A" may be read as "A or larger than A (high; long; many)" or "larger than A (high; long; many)." On the other hand, the expression "equal to or less than A" may be read as "A or smaller than A (low; short; few)" or "smaller than A (low; short; few)." And, "larger than A (high; long; many)" is may be read as "A or more," and "smaller (lower; shorter; fewer) than A" may be read as "A or less."

[0106] While the present invention has been described in detail above based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Parts of the above-described embodiments may be combined as appropriate.

[0107] Each functional unit in each of the above embodiments (variations) may or may not be individual hardware. The functions of two or more functional units may be realized by common hardware. Each of multiple functions of one functional unit may be realized by individual hardware. Two or more functions of one functional unit may be realized by common hardware. Furthermore, each functional unit may or may not be realized by hardware such as an ASIC, FPGA, DSP, etc. For example, if a device is configured with a processor and a control processor, The device may have a memory (storage medium) in which a control program is stored, and the functions of at least some of the functional units of the device may be realized by a processor reading and executing the control program from the memory.

[0108] (Other embodiments) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0109] The disclosure of the above embodiments includes the following configurations, methods, and programs. (Configuration 1) an acquisition means for acquiring a first image based on a posture of a first display device used by a first user; A determination means for determining the possibility of contact by a second user; a display control means for controlling a second display device used by the second user to display the first image; a control means for controlling the second display device to notify the second user of the possibility of contact by the second user in a manner different from that in the case where the second user is notified of the possibility of contact by the first user when it is determined that the possibility of contact by the second user is higher than a threshold value; An information processing device comprising: (Configuration 2) the first image includes a first display item if the second user is notified of a possible contact of the first user; when it is determined that the possibility of contact by the second user is higher than the threshold, the control means controls the second display device to display a second display item different from the first display item together with the first image. 2. The information processing device according to configuration 1, (Configuration 3) when it is determined that the possibility of contact by the second user is higher than the threshold value and the first image includes the first display item, the control means controls the second display device to display an image in which the second display item is superimposed on the first image so as to cover the entire first display item. 3. The information processing device according to configuration 2. (Configuration 4) the control means controls the second display device to notify the second user of the possibility of contact by emitting a sound from the second display device or vibrating the second display device. 2. The information processing device according to configuration 1, (Configuration 5) the determination means determines the possibility of contact between the object and the second user. 5. The information processing device according to any one of configurations 1 to 4. (Configuration 6) the control means changes the form of notification to notify the second user of the possibility of contact with the second user between a case where the possibility of contact between a user using a specific display device and the second user is higher than the threshold and a case where the possibility of contact between the second user and a user other than the user using the specific display device is higher than the threshold; 6. The information processing device according to configuration 5. (Configuration 7) The determination means: 1) determines that the possibility of contact by the second user is higher than the threshold value if the distance between the object and the second user is shorter than a predetermined distance; and 2) determines that the possibility of contact by the second user is lower than the threshold value if the distance between the object and the second user is longer than the predetermined distance. 7. The information processing device according to configuration 5 or 6. (Configuration 8) the control means controls the second display device so as not to notify the second user of the possibility of contact by the second user when the second user is not looking at the second display device. 8. The information processing device according to any one of configurations 1 to 7. (Configuration 9) further comprising a selection means for selecting a display mode of the second display device; the display control means controls the second display device to display a second image based on the attitude of the second display device when the selection means selects a specific display mode. 9. The information processing device according to any one of configurations 1 to 8. (Configuration 10) the second display device acquires a captured image by capturing an image of a space in front of the second display device; the information processing device includes a generation means for generating the second image based on the captured image. 10. The information processing device according to configuration 9. (Configuration 11) when the selection means has not selected the specific display mode and it is determined that the possibility of contact by the second user is higher than the threshold, the display control means controls the second display device to switch the image to be displayed from the first image to the second image. 11. The information processing device according to configuration 10. (Configuration 12) when the selection means has not selected the specific display mode and it is determined that the possibility of contact by the second user is higher than the threshold, the display control means controls the second display device to display an image in which the first image is superimposed on a partial range of the second image. 11. The information processing device according to configuration 10. (Configuration 13) the selection means switches the display mode to the specific display mode when the selection means has not selected the specific display mode and it is determined that the possibility of contact by the second user is higher than the threshold value. 11. The information processing device according to configuration 10. (Configuration 14) When it is determined that the possibility of contact by the second user is higher than the threshold, the control means controls the second display device to notify the second user of the possibility of contact by the second user in a form of notification that differs depending on the display mode selected by the selection means. 13. The information processing device according to any one of configurations 9 to 12. (Configuration 15) the first display device and the second display device are head-mounted displays; 15. The information processing device according to any one of configurations 1 to 14. (Configuration 16) 16. The information processing device according to any one of configurations 1 to 15, wherein the first image is an image having the same content as an image displayed on the first display device. (System 1) The information processing device according to any one of configurations 1 to 16, and second control means for controlling the first display device to notify the first user of the possibility of contact by the first user when the possibility of contact by the first user is higher than the threshold value. An information processing system comprising: (Second Configuration 1) A display device, a display means for displaying a first image based on the posture of a first display device used by a first user; a control means for controlling the display means to notify the second user of the possibility of contact by the second user using the display device in a manner different from that in the case where the second user is notified of the possibility of contact by the first user, when the possibility of contact by the second user using the display device is higher than a threshold value; A display device comprising: (Method 1) an acquisition step of acquiring a first image based on a posture of a first display device used by a first user; a determining step of determining the possibility of contact by a second user; a display control step of controlling a second display device used by the second user to display the first image; a control step of controlling the second display device to notify the second user of the possibility of contact by the second user in a manner different from that in the case where the second user is notified of the possibility of contact by the first user when it is determined that the possibility of contact by the second user is higher than a threshold value; An information processing method comprising: (Program 1) A program for causing a computer to function as each means of the information processing device described in any one of configurations 1 to 16. [Explanation of symbols]

[0110] 1: information processing system, 100: first device, 200: second device, 120: display device, 220: display device, 204: warning determination section, 205: Shared image acquisition unit, 206: Display control unit

Claims

1. an acquisition means for acquiring a first image based on a posture of a first display device used by a first user; a determination means for determining a possibility of a collision of the second user; a control means for controlling a second display device used by the second user to display the first image; and When it is determined that the possibility of a collision of the second user is high, the control means controls the second display device to notify the second user of the possibility of a collision in a manner different from that in the case where the possibility of a collision of the first user is notified.

1. An information processing device comprising:

2. the first image includes a first display item if the first user is notified of a possible collision; when it is determined that there is a high possibility of a collision of the second user, the control means controls the second display device to display a second display item different from the first display item together with the first image.

2. The information processing apparatus according to claim 1, wherein:

3. when it is determined that there is a high possibility of a collision of the second user and the first image includes the first display item, the control means controls the second display device to display an image in which the second display item is superimposed on the first image so as to cover the entire first display item.

3. The information processing apparatus according to claim 2, wherein:

4. the control means controls the second display device to notify the second user of the possibility of a collision by emitting a sound from the second display device or vibrating the second display device.

2. The information processing apparatus according to claim 1, wherein:

5. the determination means determines a possibility of a collision between an object and the second user.

5. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

6. the control means changes the manner in which the notification of the possibility of a collision of the second user is given depending on whether there is a high possibility of a collision between a user using a specific display device and the second user or whether there is a high possibility of a collision between a user other than the user using the specific display device and the second user.

6. The information processing apparatus according to claim 5,

7. The determination means determines that there is a high possibility of a collision of the second user with the object if the distance between the object and the second user is shorter than a predetermined distance.

6. The information processing apparatus according to claim 5,

8. the control means controls the second display device so as not to notify the second user of a possibility of a collision when the second user is not looking at the second display device.

5. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

9. further comprising a selection means for selecting a display mode of the second display device; the control means controls the second display device to display a second image based on the attitude of the second display device when the selection means selects a specific display mode.

5. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

10. the second display device acquires a captured image by capturing an image of a space in front of the second display device; the information processing device further includes a generation unit that generates the second image based on the captured image.

10. The information processing apparatus according to claim 9,

11. the control means controls the second display device to switch the image to be displayed from the first image to the second image when the selection means has not selected the specific display mode and it is determined that there is a high possibility of a collision of the second user.

11. The information processing apparatus according to claim 10,

12. When the selection means has not selected the specific display mode and it is determined that the second user is highly likely to collide with the second user, the control means controls the second display device to display an image in which the first image is superimposed on a part of the second image.

11. The information processing apparatus according to claim 10,

13. the selection means switches the display mode to the specific display mode when the selection means has not selected the specific display mode and it is determined that there is a high possibility of a collision with the second user.

11. The information processing apparatus according to claim 10,

14. When it is determined that the second user is highly likely to collide, the control means controls the second display device to notify the second user of the possibility of a collision in a manner that differs depending on the display mode selected by the selection means.

10. The information processing apparatus according to claim 9,

15. the first display device and the second display device are head-mounted displays; 5. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

16. 5. The information processing apparatus according to claim 1, wherein the first image is an image having the same content as an image displayed on the first display device.

17. An information processing device according to any one of claims 1 to 4; and second control means for controlling the first display device to notify the first user of the possibility of a collision when the possibility of a collision of the first user is high. An information processing system comprising:

18. A display device, a display means for displaying a first image based on the posture of a first display device used by a first user; a control means for controlling the display means to notify the second user of the possibility of a collision in a manner different from that for notifying the first user of the possibility of a collision when the possibility of a collision of the second user using the display device is high; and A display device comprising:

19. A display device, a display means for displaying an image; a selection means for selecting a display mode from a plurality of display modes; and The plurality of display modes include a first display mode in which a first image in which a virtual object is arranged based on an attitude of a first display device used by a first user is displayed on the display means, and a second display mode in which a second image in which a virtual object is arranged based on an attitude of the display device used by a second user is displayed on the display means. A display device characterized by:

20. The display device further includes a control unit that controls the image displayed on the display unit to be switched from the first image to the second image when the selection unit selects the first display mode and it is determined that the possibility of a collision with the second user is high.

20. The display device according to claim 19.

21. The first display device is a head-mounted display.

20. The information processing apparatus according to claim 19,

22. A computer-implemented information processing method, comprising: acquiring a first image based on a posture of a first display device used by a first user; determining a collision probability of a second user; controlling a second display device used by the second user to display the first image; When it is determined that the second user has a high possibility of a collision, controlling the second display device to notify the second user of the possibility of a collision in a manner different from that in the case where the first user has been notified of the possibility of a collision; An information processing method comprising:

23. A computer-implemented method for controlling a display device having a display means, comprising: displaying a first image based on a posture of a first display device used by a first user on the display means; controlling the display means to notify the second user of the possibility of a collision in a manner different from that for when the possibility of a collision of the first user is high, when the possibility of a collision of the second user using the display device is high; A control method comprising:

24. A computer-implemented method for controlling a display device having a display means, comprising: selecting a display mode from a plurality of display modes; The plurality of display modes include a first display mode in which a first image in which a virtual object is arranged based on an attitude of a first display device used by a first user is displayed on the display means, and a second display mode in which a second image in which a virtual object is arranged based on an attitude of the display device used by a second user is displayed on the display means. A control method comprising:

25. A program for causing a computer to execute the steps of the method according to any one of claims 22 to 24.

Images