Information processing apparatus, information processing method, and information processing system

Abstract

To allow a terminal displaying a two-dimensional image to notify a user using another terminal of a position in a three-dimensional space.SOLUTION: An information processing apparatus 1 according to the present invention has an image display unit 152 for displaying a two-dimensional image on a display unit 12, an operation receiving unit 153 for receiving an operation for designating a depth position which is a depth-direction position corresponding to a selected position selected in the two-dimensional image, and a data transmitting unit 154 for associating selected position data indicating the selected position and depth position data indicating the depth-direction position with each other to transmit them to an information terminal 2 which allows a user to visibly recognize a three-dimensional space corresponding to the two-dimensional image.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, a program, an information processing method, and an information processing system for displaying an image.

Background Art

[0002] Conventionally, a system that can display a common image among a plurality of terminals has been known. Patent Document 1 discloses a technique for also displaying a mouse pointer image that moves by the operation of a user of a first terminal on a second terminal, overlaid on the image to be commonly displayed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the conventional technology, it was assumed that the image that the user can view is a two-dimensional image. However, there are cases where a two-dimensional image is displayed on the first terminal on the side that performs an operation for designating a position in the image, and a three-dimensional space or a three-dimensional image corresponding to the three-dimensional space can be viewed on the second terminal that communicates with the first terminal.

[0005] In such a case, the user of the first terminal cannot specify the position in the depth direction in the three-dimensional space that the user of the second terminal is viewing. Therefore, even if an instruction position image indicating the position specified by the user of the first terminal is displayed on the second terminal in order to convey the position specified by the user of the first terminal to the user of the second terminal, there is a problem that the user of the second terminal cannot grasp the position in the three-dimensional space intended by the user of the first terminal.

[0006] Therefore, the present invention has been made in view of these points, and an object thereof is to enable a user using another terminal to be informed of a position in a three-dimensional space in a terminal that displays a two-dimensional image.

Means for Solving the Problems

[0007] An information processing apparatus according to a first aspect of the present invention includes an image display unit that causes a display unit to display a two-dimensional image, an operation reception unit that receives an operation for designating a depth position that is a position in the depth direction corresponding to a selection position selected in the two-dimensional image, and a data transmission unit that associates selection position data indicating the selection position and depth position data indicating the depth position and transmits the data to an information terminal capable of visually recognizing a three-dimensional space corresponding to the two-dimensional image.

[0008] The image display unit may cause the display unit to display a depth setting image for designating the depth position, and the operation reception unit may receive the position selected in the depth setting image as the designated depth position.

[0009] The image display unit may cause the display unit to display, together with the depth setting image, an image indicating a reference position in the depth direction in the two-dimensional image and information indicating a distance from the reference position.

[0010] The image display unit may cause the display unit to display an other viewpoint image showing a state in which a subject included in the two-dimensional image is viewed from a direction different from the depth direction.

[0011] The image display unit may display, superimposed on the other viewpoint image, an image indicating a position corresponding to the designated depth position.

[0012] The program according to the second aspect of the present invention causes a computer to function as an image display unit that displays a two-dimensional image on a display unit, an operation reception unit that receives an operation for designating a depth position that is a position in the depth direction corresponding to a selected position in the two-dimensional image, and a data transmission unit that associates selection position data indicating the selected position and depth position data indicating the depth position and transmits the data to an information terminal capable of visually recognizing a three-dimensional space corresponding to the two-dimensional image.

[0013] The information processing method according to the third aspect of the present invention includes steps in which a computer displays a two-dimensional image on a display unit, receives an operation for designating a depth position that is a position in the depth direction corresponding to a selected position in the two-dimensional image, and associates selection position data indicating the selected position and depth position data indicating the depth position and transmits the data to an information terminal capable of visually recognizing a three-dimensional space corresponding to the two-dimensional image.

[0014] The information processing system according to the fourth aspect of the present invention includes an information terminal that displays an image, and an information processing apparatus that displays a two-dimensional image corresponding to a three-dimensional space that can be visually recognized by a user who uses the information terminal. The information processing apparatus includes an image display unit that displays the two-dimensional image on a display unit, an operation reception unit that receives an operation for designating a depth position that is a position in the depth direction corresponding to a selected position in the two-dimensional image, and a data transmission unit that associates selection position data indicating the selected position and depth position data indicating the depth position and transmits the data to the information terminal. The information terminal includes a data reception unit that receives the selection position data and the depth position data, and a display processing unit that displays a predetermined image at a position specified by the selection position data and the depth position data in the three-dimensional space.

Advantages of the Invention

[0015] According to the present invention, there is an effect that in a terminal that displays a two-dimensional image, a user who uses another terminal can be informed of a position in a three-dimensional space.

Brief Description of the Drawings

[0016]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Embodiments for Carrying Out the Invention

[0017] [Overview of Information Processing System S] FIG. 1 is a diagram showing an overview of an information processing system S. The information processing system S includes an information processing apparatus 1 and an information terminal 2, and the information processing apparatus 1 and the information terminal 2 can transmit and receive data via a network N. The network N includes, for example, the Internet and a mobile phone communication network. The information processing apparatus 1 and the information terminal 2 are, for example, a computer, a smartphone, a tablet, or a glasses-type terminal. In the present embodiment, a case where the information processing apparatus 1 is a computer and the information terminal 2 is a glasses-type terminal is illustrated. The information terminal 2 accesses the network N via, for example, a wireless channel W.

[0018] The information processing apparatus 1 displays a two-dimensional image corresponding to the three-dimensional space that the user U2 using the information terminal 2 is viewing. The information processing apparatus 1 displays, for example, a two-dimensional image based on imaging data created by being photographed by the information terminal 2.

[0019] The information processing apparatus 1 and the information terminal 2 receive, for example, an operation of the user U1 who uses the information processing apparatus 1 or the user U2 who uses the information terminal 2, and simultaneously display a predetermined image according to the operation of the user U1 or the user U2. The images to be simultaneously displayed may be pointer images indicating the operation positions, or may be augmented reality images (hereinafter referred to as "AR images") that are displayed superimposed on the captured images generated by the information terminal 2 taking pictures.

[0020] The information processing apparatus 1 according to the present embodiment can display two-dimensional images, but cannot display three-dimensional images. On the other hand, the information terminal 2 can allow the user U2 to visually recognize a three-dimensional space or display a three-dimensional image corresponding to the three-dimensional space. A two-dimensional image is an image composed of a plurality of pixels corresponding to a plurality of (X, Y) coordinates defined by two axes, an X-axis and a Y-axis, that are orthogonal to each other. A three-dimensional image is an image composed of a plurality of pixels corresponding to a plurality of (X, Y, Z) coordinates defined by three axes, an X-axis, a Y-axis, and a Z-axis, that are orthogonal to each other.

[0021] The information processing apparatus 1 displays, for example, a two-dimensional image corresponding to the three-dimensional space (that is, the three-dimensional space visible to the user U2) photographed by the user U2 who uses the information terminal 2 using the information terminal 2. When the information terminal 2 is a glasses-type terminal, the information processing apparatus 1 displays a two-dimensional image based on the captured image data generated by the information terminal 2 photographing a subject in the surrounding three-dimensional space and receives a position designation by the user U1. The information terminal 2 displays an AR image corresponding to the operation content of the user U1 at a position corresponding to the position operated by the user U1 in the three-dimensional space that the user U2 is looking at through the lens of the information terminal 2 or in the three-dimensional image corresponding to the three-dimensional space photographed by the information terminal 2.

[0022] By the way, as described above, in the information terminal 2, the user U2 can visually recognize a three-dimensional space or a three-dimensional image, but in the information processing apparatus 1, the user U1 can only see two-dimensional images. In this case, the user U1 cannot specify a specific position in the three-dimensional space that the user U2 is looking at.

[0023] Therefore, in a state where the information processing apparatus 1 displays the image captured by the information terminal 2, the user U1 superimposes an image for depth setting for specifying a position in the depth direction on the two-dimensional image displayed on the screen of the information processing apparatus 1, which is a feature. As a result, the user U1 can specify a specific position in the three-dimensional space where the two-dimensional image displayed on the information processing apparatus 1 was captured (that is, a specific position in the three-dimensional space where the user U2 exists).

[0024] FIG. 2 and FIG. 3 are diagrams for explaining the operation of the information processing apparatus 1. FIG. 2(a) shows an example of a screen on which a two-dimensional image is displayed on the information processing apparatus 1. In FIG. 2(a), the horizontal direction is the X direction, the vertical direction is the Y direction, and the depth direction is the Z direction. FIG. 2(b) is a view of the three-dimensional space where the two-dimensional image displayed in FIG. 2(a) was captured, seen from above. In FIG. 2(b), the horizontal direction is the X direction, the vertical direction is the Z direction, and the depth direction is the Y direction.

[0025] In FIG. 2(a), there are displayed main images T1 to T4, which are images captured by the user U2 using the information terminal 2 facing in the Z direction from the position shown in FIG. 2(b), and AR images A to C displayed superimposed. After the user U1 performs an operation to display the AR image C and then touches the hand H at the position of the AR image A, the AR image C is displayed in the vicinity of the AR image A.

[0026] In this state, when the user U1 wants to move the AR image C toward the AR image B, it is assumed that an operation of touching the AR image B is performed. At this time, the information processing apparatus 1 cannot recognize at which position in the Z direction the user U1 is trying to move the AR image C. Specifically, as shown by arrow images C1, C2, and C3 in FIG. 2(b), there are a plurality of directions as the direction toward the position of the AR image B in the two-dimensional image, so the information processing apparatus 1 cannot recognize in which of the plurality of directions the user U1 wants to move the AR image C.

[0027] FIG. 3 is a diagram showing an example of a screen for enabling user U1 to specify a position in the depth direction. On the left side of the screen shown in FIG. 3, a slider image SL, which is an example of an image for depth setting, is displayed. The slider image SL includes a cursor image CS shown in black. User U1 can specify the position on the back side in the Z direction by moving the cursor image CS above the slider image SL. Also, user U1 can specify the position on the front side in the Z direction by moving the cursor image CS below the slider image SL.

[0028] User U1 can specify the (X, Y, Z) coordinates in the three-dimensional space by touching a desired position in the two-dimensional image to specify the (X, Y) coordinates of the target position and moving the cursor image CS in the slider image SL to specify the Z coordinate in the depth direction. For example, user U1 may move the cursor image CS after touching the AR image B to specify the target position (the position indicated by the target position image G in FIG. 3), or may touch the AR image B to specify the target position after moving the cursor image CS to specify the position in the Z direction.

[0029] If the (X, Y) coordinates of the AR image B are (X1, Y1) and the Z coordinate corresponding to the position of the cursor image CS shown in FIG. 3(a) is Z1, the position specified by user U1 is (X1, Y1, Z1). This position corresponds to, for example, the tip position of the arrow image C1 in FIG. 2(b). If the Z coordinate corresponding to the position of the cursor image CS shown in FIG. 3(b) is Z2, the position specified by user U1 is (X1, Y1, Z2). This position corresponds to, for example, the tip position of the arrow image C2 in FIG. 2(b). If the Z coordinate corresponding to the position of the cursor image CS shown in FIG. 3(c) is Z3, the position specified by user U1 is (X1, Y1, Z3). This position corresponds to, for example, the tip position of the arrow image C1 in FIG. 2(b).

[0030] The information processing apparatus 1 transmits coordinate data indicating the coordinates corresponding to the position designated by the user U1 in this manner to the information terminal 2. By the information terminal 2 displaying an AR image at the position corresponding to the received coordinate data, the user U2 who views the three-dimensional space or the three-dimensional image corresponding to the three-dimensional space via the information terminal 2 can view the AR image at the position in the three-dimensional space designated by the user U1. The information processing system S operating in this way can be applied to various uses, such as when the users U1 and U2 play a game while looking at the same screen, and when the user U1 remotely views an image captured by the information terminal 2 worn by the user U2 who is performing an assembly operation in a factory, and gives an instruction regarding the position in the three-dimensional space to the user U2, etc. Hereinafter, the configurations of the information processing apparatus 1 and the information terminal 2 will be described in detail.

[0031] [Configuration of Information Processing Apparatus 1] FIG. 4 is a diagram showing the configuration of the information processing apparatus 1. The information processing apparatus 1 includes a communication unit 11, a display unit 12, an operation unit 13, a storage unit 14, and a control unit 15. The control unit 15 includes a data acquisition unit 151, an image display unit 152, an operation reception unit 153, and a data transmission unit 154.

[0032] The communication unit 11 has a communication interface for connecting to the network N. The communication unit 11 transmits and receives various data to and from the information terminal 2 via the network N. The communication unit 11 inputs the data received via the network N to the data acquisition unit 151, and transmits the data input from the data transmission unit 154 toward the information terminal 2.

[0033] The display unit 12 has a display for displaying various information. The display unit 12 displays an image based on, for example, the image data input from the image display unit 152. Specifically, the display unit 12 displays a main image, a sub-image, and a slider image SL as shown in FIG. 3.

[0034] The operation unit 13 is a device for the user U1 to perform various operations, and includes, for example, a mouse and a keyboard. The operation unit 13 inputs operation data corresponding to the operations of the user U1 to the operation reception unit 153. The operation data is, for example, data indicating the movement amount of the mouse, data indicating that the mouse has been clicked, and data indicating the key pressed on the keyboard.

[0035] The storage unit 14 has storage media such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The storage unit 14 stores the programs executed by the control unit 15. Also, the storage unit 14 temporarily stores the image data to be displayed on the display unit 12.

[0036] The control unit 15 has, for example, a CPU (Central Processing Unit). By executing the programs stored in the storage unit 14, the control unit 15 functions as a data acquisition unit 151, an image display unit 152, an operation reception unit 153, and a data transmission unit 154.

[0037] The data acquisition unit 151 receives the image data transmitted by the information terminal 2 via the communication unit 11. The data acquisition unit 151 receives, for example, imaging image data including a subject photographed by the user U2 using the information terminal 2. The image data acquired by the data acquisition unit 151 is, for example, two-dimensional image data, but the data acquisition unit 151 may acquire three-dimensional image data. The data acquisition unit 151 inputs the received image data to the image display unit 152.

[0038] The data acquisition unit 151 may acquire the image data stored in the storage unit 14. The image data acquired by the data acquisition unit 151 from the storage unit 14 is the screen data to be displayed on the display unit 12 by executing application software, and is, for example, game image data.

[0039] The image display unit 152 causes the display unit 12 to display a two-dimensional image based on the image data input from the data acquisition unit 151. When the image data input from the data acquisition unit 151 is two-dimensional image data, the image display unit 152 causes the display unit 12 to display a two-dimensional image based on a plurality of pixel values included in the two-dimensional image data. When the image data input from the data acquisition unit 151 is three-dimensional image data, the image display unit 152 causes the display unit 12 to display a two-dimensional image based on a plurality of pixel values corresponding to the (X, Y) coordinates corresponding to a specific Z coordinate among the plurality of pixel values included in the three-dimensional image data. For example, the image display unit 152 causes the display unit 12 to display a two-dimensional image (for example, an image with a Z coordinate of 0) corresponding to the direction of the line of sight of the user U2 at the time when the information terminal 2 transmits the image data.

[0040] In addition, the image display unit 152 causes the display unit 12 to display a depth setting image for specifying a depth position. The depth setting image is, for example, a slider image SL as shown in FIG. 3. However, as long as the depth position can be specified, the form of the depth setting image is arbitrary and is not limited to a rectangle such as the form illustrated in FIG. 3, and may be other shapes. Further, the depth setting image may be an image for inputting a numerical value corresponding to the coordinates in the depth direction.

[0041] By the way, if only the depth setting image is displayed on the display unit 12, it is assumed that it is difficult for the user U1 to grasp to what extent it is appropriate to set the depth position. Therefore, the image display unit 152 may display an image indicating a reference position in the depth direction in the two-dimensional image, and display information indicating the distance from the reference position together with the depth setting image on the display unit 12.

[0042] FIG. 5 is a diagram showing an example of display of an image indicating a reference position. In FIG. 5, text images indicating the depth directions of the image T1, the image T4, the AR image A, and the AR image B are displayed on the left side of the slider image SL. By the image display unit 152 displaying such an image, it becomes easier for the user U1 to grasp around which position in the depth direction he or she wants to specify.

[0043] The image display unit 152 may further cause the display unit 12 to display an other-viewpoint image showing a state in which a subject included in the two-dimensional image is viewed from a direction different from the depth direction. The other-viewpoint image data is, for example, image data corresponding to an image obtained by viewing the space corresponding to the three-dimensional image from a direction orthogonal to the depth direction of the three-dimensional image that can be visually recognized on the information terminal 2. The other-viewpoint image data may be image data corresponding to an image obtained by viewing the space corresponding to the three-dimensional image from above.

[0044] The other-viewpoint image data is, for example, an image based on other-viewpoint captured image data created by capturing the space where the user U2 is located with another camera. The other-viewpoint captured image data may be image data created by being captured while the information processing apparatus 1 is receiving the captured image data from the information terminal 2, or may be image data captured and created in advance.

[0045] The other-viewpoint image may be image data stored in advance in the storage unit 14. For example, when the control unit 15 executes game application software, the game producer may create, in advance, a plurality of image data corresponding to a plurality of viewpoints as the other-viewpoint image data, and the storage unit 14 may store these plurality of other-viewpoint image data.

[0046] FIG. 6 is a diagram showing an example of the other-viewpoint image. FIG. 6 shows a state in which the other-viewpoint image D is displayed at the lower right of the screen shown in FIG. 3. The other-viewpoint image D shown in FIG. 6 shows a state in which the space corresponding to the two-dimensional image shown in FIG. 6 is viewed from the right side of FIG. 6. By viewing the other-viewpoint image D, the user U1 can grasp the positional relationship in the depth direction of each subject in the two-dimensional image, so that it becomes easier to specify the depth direction using the slider image SL.

[0047] Note that, in order for the user U1 to easily grasp which position in the depth direction is being specified when the user U1 moves the cursor image CS on the slider image SL, the image display unit 152 may superimpose and display an image indicating the position corresponding to the depth position specified by the user U1 on the other-viewpoint image.

[0048] Figure 6(b) shows a state in which a marker image M indicating a position corresponding to the position of the cursor image CS is displayed on the other viewpoint image D. The image display unit 152 displays the marker image M such that, for example, the position of the marker image M in the left-right direction of the other viewpoint image D corresponds to the position of the cursor image CS in the slider image SL. The mode of the marker image M is not limited to the mode shown in FIG. 6(b) and may be any mode, and the image display unit 152 may display the position corresponding to the cursor image CS in the other viewpoint image D in a color or brightness different from other positions.

[0049] The operation reception unit 153 receives an operation for designating a depth position that is a position in the depth direction corresponding to the selected position in the two-dimensional image. In the case of the examples shown in FIGS. 3, 5, and 6, the operation reception unit 153 receives the position selected in the slider image SL (that is, the position of the cursor image CS) as the designated depth position. For example, when the cursor image CS is at the same position for a predetermined time (e.g., 1 second) or more, the operation reception unit 153 receives the position as the position in the depth direction designated by the user U1 and specifies the coordinates in the depth direction corresponding to the received position. The operation reception unit 153 notifies the data transmission unit 154 of the coordinates of the selected position in the two-dimensional coordinate space and the coordinates in the depth direction.

[0050] The data transmission unit 154 creates selection position data indicating the coordinates of the selected position input from the operation reception unit 153 and depth position data indicating the coordinates in the depth direction. The data transmission unit 154 associates the selection position data indicating the selected position and the depth position data indicating the depth position and transmits them to the information terminal 2 that displays the three-dimensional image corresponding to the two-dimensional image. The data transmission unit 154 may transmit the selection position data and the depth position data as different data, or may transmit them as integrated data. The integrated data of the selection position data and the depth position data is data indicating coordinates in the three-dimensional space, such as (X0, Y0, Z0), for example.

[0051] [Configuration of Information Terminal 2] FIG. 7 is a diagram showing the configuration of information terminal 2. Information terminal 2 includes a communication unit 21, a display unit 22, an operation unit 23, a storage unit 24, a control unit 25, and an imaging unit 26.

[0052] Each of the communication unit 21, the display unit 22, the operation unit 23, the storage unit 24, and the control unit 25 corresponds to the communication unit 11, the display unit 12, the operation unit 13, the storage unit 14, and the control unit 15 shown in FIG. 4. Each of the communication unit 21, the display unit 22, the operation unit 23, the storage unit 24, and the control unit 25 may have functions equivalent to those of the communication unit 11, the display unit 12, the operation unit 13, the storage unit 14, and the control unit 15, or may have other functions.

[0053] However, when information terminal 2 is a glasses-type terminal, the display unit 22 may have an element that projects an image onto the area of the lens of the glasses, unlike the display unit 12. Also, the operation unit 23, unlike the operation unit 13, has an element that detects the line of sight of user U2, and detects the operation content of user U2 based on at least one of the position or movement of the line of sight of user U2.

[0054] The imaging unit 26 is a device that generates imaging image data by photographing a subject around information terminal 2 in response to an operation by user U2, and is, for example, a camera. The imaging unit 26 is, for example, a stereo camera having a plurality of imaging elements, and can generate three-dimensional image data. When information terminal 2 is a glasses-type terminal, the plurality of imaging elements included in the imaging unit 26 are provided, for example, at positions above two lenses. The imaging unit 26 inputs the generated three-dimensional image data to the data transmission unit 254.

[0055] The data transmission unit 254 transmits the three-dimensional image data input from the imaging unit 26 to the information processing apparatus 1 via the communication unit 21 in response to an instruction from user U2 input via, for example, the operation reception unit 253. The data transmission unit 254 may continuously transmit the three-dimensional image data after receiving an instruction from user U2. That is, the data transmission unit 254 may transmit three-dimensional moving image data.

[0056] The data receiving unit 251 receives the selected position data and the depth position data transmitted by the information processing apparatus 1 via the communication unit 21. The data receiving unit 251 inputs the received selected position data and depth position data to the display processing unit 252.

[0057] The display processing unit 252 causes a predetermined image to be displayed at the position specified by the selected position data and the depth position data received from the information processing apparatus 1 in the three-dimensional image. The predetermined image is, for example, an AR image selected from a plurality of AR images based on the operation of the user U1 received by the operation receiving unit 153. The data receiving unit 251 may receive operation data indicating the content of the operation performed by the user U1 from the information processing apparatus 1, and the display processing unit 252 may select one or more AR images from the plurality of AR images stored in the storage unit 24 as the predetermined image based on the operation data.

[0058] FIG. 8 is a diagram showing an example of an image displayed on the display unit 22. The image shown in FIG. 8 is an image displayed on the display unit 22 when the user U1 who uses the information processing apparatus 1 performs the operation shown in FIG. 3 on the information processing apparatus 1.

[0059] In FIG. 3, the user U1 specified the position of the AR image B in a state where the AR image C was displayed. As a result, in FIG. 8, the AR image C is displayed at the position of the AR image B. Such a function is suitable for a case where the users U1 and U2 play a game of moving the AR image C while looking at the same screen. It is also suitable for a case where the user U1 wants to indicate a position to the user U2 while looking at an image taken while the user U2 is working.

[0060] [Effect by the information processing system S] As described above, in the information processing system S, the information processing apparatus 1 receives an operation for designating a depth position, which is a position in the depth direction corresponding to a selected position in the two-dimensional image, and associates the selection position data indicating the selected position with the depth position data indicating the depth position, and transmits the data to the information terminal 2. Then, in the information terminal 2, with the user U2 viewing the three-dimensional space or the three-dimensional image corresponding to the three-dimensional space, a predetermined image is displayed at the position designated by the user U1 in the information processing apparatus 1. With the above configuration, even when the user U1 can only view a two-dimensional image on the information processing apparatus 1, the user U1 can indicate an appropriate position in the three-dimensional space viewed by the user U2, or display an image at the position intended by the user U1.

[0061] As described above, the present invention has been described using embodiments. However, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist. For example, all or part of the apparatus can be configured by functionally or physically dispersing and integrating it in any unit. Also, new embodiments generated by any combination of a plurality of embodiments are included in the embodiments of the present invention. The effects of the new embodiments generated by the combination have the effects of the original embodiments combined.

Explanation of Reference Numerals

[0062] 1 Information processing apparatus 2 Information terminal 11 Communication unit 12 Display unit 13 Operation unit 14 Storage unit 15 Control unit 21 Communication unit 22 Display unit 23 Operation unit 24 Storage unit 25 Control unit 26 Imaging unit 151 Data acquisition unit 152 Image display unit 153 Operation reception unit 154 Data transmission unit 251 Data receiving unit 252 Display processing unit 253 Operation reception unit 254 Data transmission unit

Claims

An information processing apparatus that displays a two-dimensional image corresponding to a three-dimensional space visible to a user who uses an information terminal that displays an image, comprising: an image display unit that causes a first display unit connected to the information processing apparatus to display a two-dimensional image; an operation reception unit that, after receiving an operation to display an AR image at a first position in the two-dimensional image, receives a selection of a second position different from the first position, and receives an operation to specify a depth position that is a position in the depth direction corresponding to the selected second position; a data transmission unit that associates first coordinate data corresponding to the first position in the two-dimensional image, second coordinate data corresponding to the second position in the two-dimensional image, and depth position data indicating the depth position at the second position, and transmits the associated data to the information terminal; An information processing apparatus having the above.

2. The image display unit causes the first display unit to display a depth setting image for specifying the depth position; The operation reception unit receives the position selected in the depth setting image as the specified depth position; The information processing apparatus according to claim 1.

3. The image display unit causes the first display unit to display, together with the depth setting image, an image indicating a reference position in the depth direction in the two-dimensional image and information indicating a distance from the reference position; The information processing apparatus according to claim 2.

4. The image display unit causes the first display unit to display a different viewpoint image showing a state in which a subject included in the two-dimensional image is viewed from a direction different from the depth direction; The information processing apparatus according to any one of claims 1 to 3.

5. The image display unit superimposes and displays an image indicating a position corresponding to the specified depth position on the different viewpoint image; The information processing apparatus according to claim 4.

6. A computer, comprising: a step of causing a first display unit connected to the computer to display a two-dimensional image; a step of, after receiving an operation to display an AR image at a first position in the two-dimensional image, receiving a selection of a second position different from the first position, and receiving an operation to specify a depth position that is a position in the depth direction corresponding to the selected second position; Associating the first coordinate data corresponding to the first position in the two-dimensional image, the second coordinate data corresponding to the second position in the two-dimensional image, and the depth position data indicating the depth position at the second position, and transmitting the data to an information terminal capable of communicating with the computer; Executing; The information terminal; Receiving the first coordinate data, the second coordinate data, and the depth position data; After displaying the AR image at a first position corresponding to the first coordinate data in a three-dimensional space visible to a user using the information terminal, causing the second display unit of the information terminal to display the AR image so as to move from the first position to a position specified by the second coordinate data and the depth position data; An information processing method for executing.

7. An information processing system comprising an information terminal for displaying an image and an information processing apparatus for displaying a two-dimensional image corresponding to a three-dimensional space visible to a user using the information terminal; The information processing apparatus; An image display unit for displaying a two-dimensional image on a first display unit connected to the information processing apparatus; An operation reception unit that, after receiving an operation to display an AR image at a first position in the two-dimensional image, receives a selection of a second position different from the first position and receives an operation to specify a depth position that is a position in the depth direction corresponding to the selected second position; A data transmission unit that associates the first coordinate data corresponding to the first position in the two-dimensional image, the second coordinate data corresponding to the second position in the two-dimensional image, and the depth position data indicating the depth position at the second position, and transmits the data to the information terminal; Having; The information terminal; A data reception unit that receives the first coordinate data, the second coordinate data, and the depth position data; A display processing unit that, after displaying the AR image at a first position corresponding to the first coordinate data in the three-dimensional space, causes the second display unit of the information terminal to display the AR image so as to move from the first position to a position specified by the second coordinate data and the depth position data; An information processing system having.

Images