Information processing system, information processing method, and program

Abstract

[Problem] To enable a further improvement in the user experience of communication via video. [Solution] This information processing system includes a display control unit that generates a display screen including a display of an object that moves in accordance with motion data, wherein the display control unit performs data processing including placement processing for placing the object at a second position that is spaced apart from a first position, indicated by the motion data, in a reference direction along a reference plane by a length corresponding to the distance from the reference plane to the first position, and generates the display screen by parallel-projecting the object after the data processing has been performed onto the reference plane.

Description

Information processing system, information processing method, and program

[0001] The present disclosure relates to an information processing system, an information processing method, and a program.

[0002] 2. Description of the Related Art Telecommunication technology is known for communicating with users in remote locations by transmitting and receiving video and audio.

[0003] Japanese Patent Application Laid-Open No. 2011-121662 discloses a device for communicating by displaying video of a remote location on a large-screen display device composed of a combination of multiple displays. In face-to-face communication, it is assumed that the user will make eye contact while speaking, and in video-based communication, it is natural for the user to view the other person's image on the display screen. However, if the position of the other person's face differs from the position of the imaging device, the user will not appear to the other person as if they are facing forward. Japanese Patent Application Laid-Open No. 2011-121662 discloses a device that constructs a real-life 3D model and generates a projection surface using a virtual imaging device. Specifically, it describes a method for performing parallel projection, which projects an image of a subject facing the display screen in the same direction within a certain distance from the projection surface, and a perspective projection, which projects an image with a sense of perspective within a certain distance or further.

[0004] JP 2014-96701 A

[0005] However, with the technology described in Patent Document 1, if a subject is in a position where the projection method switches, an image gap occurs, resulting in degradation of image quality. Furthermore, even if a subject in the range of perspective projection faces the display screen, the subject does not appear to be facing forward on the other side, and the other person does not appear to be paying attention to the subject.

[0006] Therefore, the present disclosure proposes an information processing system, an information processing method, and a program that can further improve the user experience in communication via video.

[0007] According to the present disclosure, there is provided an information processing system that includes a display control unit that generates a display screen including a display of an object that moves according to motion data, wherein the display control unit performs data processing including a placement process that places the object at a second position that is spaced apart from the first position in a reference direction along the reference surface by a length that corresponds to the distance from the reference surface to the first position indicated by the motion data, and generates the display screen by parallel projecting the object onto the reference surface after the data processing has been performed.

[0008] Furthermore, according to the present disclosure, an information processing method is provided in which a processor performs data processing including generating a display screen including a display of an object moving according to motion data, and further including a placement process of placing the object at a second position that is spaced apart from the first position in a reference direction along the reference surface by a length according to the distance from the reference surface to the first position indicated by the motion data, and generates the display screen by parallel projecting the object onto the reference surface after the data processing has been performed.

[0009] Furthermore, according to the present disclosure, there is provided a program that causes a computer to function as a display control unit that generates a display screen including a display of an object that moves according to motion data, wherein the display control unit performs data processing including a placement process that places the object at a second position that is spaced apart from the first position in a reference direction along the reference plane by a length that corresponds to the distance from the reference plane to the first position indicated by the motion data, and generates the display screen by parallel projecting the object onto the reference plane after the data processing has been performed.

[0010] 1 is an overall configuration diagram of an information processing system 1 according to an embodiment of the present disclosure. FIG. 1 is a diagram for explaining parallel projection. FIG. 2 is a diagram for explaining perspective projection. FIG. 3 is a diagram for explaining pseudo-perspective projection according to the present embodiment. FIG. 4 is a block diagram showing an example of the configuration of a server 20 according to the present embodiment. FIG. 5 is a block diagram showing an example of the configuration of a user PC 10 according to an embodiment of the present disclosure. FIG. 6 is a diagram for explaining placement processing included in the pseudo-perspective projection technique according to the present embodiment. FIG. 7 is a diagram for explaining orientation adjustment processing included in the pseudo-perspective projection technique according to the present embodiment. FIG. 8 is a diagram for explaining size adjustment processing included in the pseudo-perspective projection technique according to the present embodiment. FIG. 9 is a diagram showing movement of an avatar C before application of the pseudo-perspective projection technique. FIG. 10 is a diagram showing movement of an avatar C_j after application of the pseudo-perspective projection technique. FIG. 11 is a diagram for explaining deviation in orientation of an avatar C_j due to orientation adjustment processing. FIG. 12 is a diagram for explaining cancellation of orientation adjustment processing when an avatar C_j stops according to the present embodiment. FIG. 13 is a diagram for explaining orientation adjustment processing during movement of an avatar C_j according to the present embodiment. A flowchart showing an example of the flow of display processing according to the present embodiment. FIG. 14 is a diagram for explaining a modified example of the placement processing. FIG. 15 is a diagram for explaining another modified example of the placement processing. FIG. 1 is a diagram for explaining the case of an avatar C10 that can also move in the height direction. FIG. 2 is a diagram for explaining how the avatar appears when it turns around. FIG. 3 is a diagram for explaining an example of a guidance display according to a modified example. FIG. 4 is a diagram for explaining how the avatar appears on the viewer's side when the operator U1 moves according to the guidance display according to the modified example. FIG. 5 is a flowchart showing an example of the flow of a guidance display process according to a modified example.

[0011] Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant description will be omitted.

[0012] The explanation will be given in the following order: 1. Overview 2. Configuration 2-1. Configuration of the server 20 2-2. Configuration of the user PC 10 3. Details of pseudo-perspective projection 3-1. Placement process 3-2. Orientation adjustment process 3-3. Size adjustment process 3-4. Supplementary information on the orientation adjustment process 4. Operation process 5. Modified examples 5-1. Modified example of placement process 5-2. Objects that move in the height direction 5-3. Guidance display 6. Supplementary information

[0013] <1. Overview> As one embodiment of the present disclosure, a mechanism for further improving the user experience in communication via video will be described.

[0014] Fig. 1 is a diagram illustrating an overall configuration of an information processing system 1 according to an embodiment of the present disclosure. As shown in Fig. 1, the information processing system 1 includes user PCs 10 (10a, 10b) and a server 20. The user PCs 10 and the server 20 are connected for communication via a network 30.

[0015] In this embodiment, an avatar C operated by an operator U1 is presented to a viewer U2, and communication between the avatar C and the viewer U2 is realized. The avatar C is an example of an object, and is realized, for example, by 3DCG (Computer Graphics) that is rendered based on a 3D model.

[0016] The operating side is equipped with a user PC 10a, a screen 2, and a projector 3. The user PC 10a controls the projector 3 to project an image of the viewer U2 onto the screen 2. The image of the viewer U2 can be acquired from the viewing side via the server 20. The image projected onto the screen 2 may be a captured image including the viewer U2 captured by a camera 6 located on the viewing side, an image in which the viewer U2 is superimposed on a background image, or an image in which an avatar C operated by the operator U1 is superimposed. While FIG. 1 illustrates the screen 2 and the projector 3 as examples of display means used on the operator side, this embodiment is not limited thereto and may also be a display device consisting of a large display or a head-mounted display (HMD) worn on the head of the operator U1.

[0017] The user PC 10a acquires motion data of the operator U1 and transmits it to the server 20. The motion data of the operator U1 is detected by, for example, motion sensors 4 (head motion sensor 4a, wrist motion sensor 4b, ankle motion sensor 4c, etc.) attached to the operator U1, and transmitted to the user PC 10a.

[0018] The server 20 is an example of an information processing device. The server 20 may reflect motion data of the operator U1 received from the user PC 10a on the avatar C placed in the virtual space, generate an image of the virtual space to be presented on the viewer side (an image including the avatar C in the field of view), and control transmission of the image to the user PC 10b. The server 20 may also control transmission of a captured image of the viewer U2 received from the user PC 10b to the user PC 10a as an image to be presented on the operating side. Note that the server 20 may generate, as the image to be presented on the operating side, an image in which the avatar C is superimposed on the captured image of the viewer U2, or may generate an image in which an image of the viewer U2 extracted from the captured image is superimposed on an image of the virtual space including the avatar C in the field of view.

[0019] On the viewer side, a user PC 10b, a display device 5 consisting of a large display, and a camera 6 are arranged. The large display may be formed by arranging multiple flat displays. The camera 6 is installed, for example, in the center of the large display and captures an image of a viewer U2 standing in front of the large display. The image captured by the camera 6 is transmitted from the user PC 10b to the server 20.

[0020] The user PC 10b controls the display device 5 to display an image of the virtual space that includes the avatar C in its angle of view, received from the server 20. By using a large display device 5, a life-size avatar C can be presented to the viewer U2, and the viewer U2 can communicate with the life-size avatar C.

[0021] When viewer U2 communicates with avatar C, it is natural for viewer U2 to look at avatar C and make eye contact. In order for avatar C displayed on display device 5 to appear as if it is looking at viewer U2, avatar C needs to face forward (toward viewer U2) on the screen. This is because, when avatar C displayed on display device 5 faces forward, the so-called Mona Lisa effect causes viewer U2 in front of display device 5 to appear to be making eye contact with avatar C no matter what angle they view it from. Even when there are multiple viewers in front of display device 5, as long as avatar C displayed on display device 5 faces forward, all viewers will appear to be making eye contact with avatar C, allowing all viewers to enjoy communication with avatar C and enhancing the user experience. Thus, the orientation of avatar C is important in display control of avatar C for communication purposes.

[0022] On the other hand, it is also important to provide a sense of perspective, such as by expressing the depth of the virtual space displayed on the display device 5, in order to enhance the user experience in communicating with the life-size avatar C.

[0023] Here, the projection methods that can be used when generating an image of avatar C placed in the virtual space by server 20 (an image of the virtual space to be displayed on display device 5) include parallel projection and perspective projection. Server 20 can project an object in three-dimensional space onto a two-dimensional plane using a predetermined projection method.

[0024] Fig. 2 is a diagram for explaining parallel projection. Fig. 2 shows a schematic diagram of an avatar C placed in a virtual space as viewed from above. A projection surface 51 is an example of a reference surface in projection, and a two-dimensional image drawn on the projection surface 51 is displayed on the display device 5 and viewed by the viewer U2. In other words, the projection surface 51 corresponds to the display screen of the display device 5.

[0025] Parallel projection is a projection method in which parallel lines connect each point in three-dimensional space to the projection plane, and the intersection of these lines is the projection point. Projection using this method does not allow for a sense of perspective. That is, as shown in the upper part of FIG. 2, image 51a is drawn on projection plane 51 when avatar C is positioned farther from projection plane 51 (an example of a reference plane) (compared to the lower part of FIG. 2), while image 51b is drawn on projection plane 51 when avatar C is positioned closer to projection plane 51 (compared to the upper part of FIG. 2), as shown in the lower part of FIG. 2. The projected (drawn) avatar images C-i1 and C-i2 are drawn at the same size, and no sense of perspective is expressed.

[0026] 3 is a diagram for explaining perspective projection, which also shows a schematic diagram of an avatar C placed in a virtual space as seen from above.

[0027] Perspective projection is a projection method that connects each point in three-dimensional space with the viewpoint and uses the intersection with the projection plane as the projection point. When projected using this method, objects that are farther away appear relatively smaller, thereby creating a sense of perspective. In FIG. 3 , a virtual camera V1 is placed at the viewpoint. As shown in the upper part of FIG. 3 , image 51c is rendered on projection plane 51 (an example of a reference plane) when avatar C is farther from projection plane 51, whereas image 51d is rendered on projection plane 51 when avatar C is closer to projection plane 51, as shown in the lower part of FIG. 3 . The projected (rendered) avatar images C-i3 and C-i4 are different in size. Specifically, the farther away an object is, the smaller it is rendered, and the closer it is, the larger it is rendered, creating a sense of perspective.

[0028] However, when perspective projection is used as the projection method, although it is possible to express a sense of perspective, distortion may occur in the rendered avatar images C-i3 and C-i4. As shown in the lower part of Figure 3, the distortion of the rendered avatar image C-i4 becomes greater, particularly as avatar C moves further to the left or right from the center of virtual camera V1.

[0029] Therefore, this disclosure proposes a technique called pseudo-perspective projection, which combines parallel projection and perspective projection, making it possible to further improve the user experience in communication via video.

[0030] Fig. 4 is a diagram for explaining pseudo-perspective projection according to this embodiment. The examples shown in the upper and lower parts of Fig. 4 are both projection examples of pseudo-perspective projection, with the upper part showing a case where avatar C is far from the projection surface 51 and the lower part showing a case where avatar C is close to the projection surface 51.

[0031] In pseudo-perspective projection, the server 20 performs data processing such as moving (placement processing), rotating (orientation adjustment processing), and scaling (size adjustment processing) on ​​the avatar C (object), and generates a display screen by parallel projecting the data-processed avatar C_j onto the projection plane 51 (reference plane). As will be described in detail later, the server 20 first places (moves) the avatar C on a line perpendicular to the projection plane 51 at a position (intersection P3) where a line connecting the position of the virtual camera V2 (viewpoint position P1) and the position of the avatar C (avatar position P2) intersects with the projection plane 51. The avatar C after data processing including the placement processing is referred to as avatar C_j. Next, the server 20 adjusts the orientation of the avatar C_j according to the relationship between the avatar position P2 and the viewpoint position P1, and further scales the size of the avatar C_j according to the distance between the viewpoint position P1 and the intersection P3, i.e., the distance between the viewpoint position P1 and the avatar position P2. The server 20 then parallel projects the avatar C_j that has been subjected to the movement, rotation, and scaling processes onto the projection surface 51 .

[0032] This allows the distortion problematic with perspective projection to be eliminated while still providing a sense of perspective. Specifically, as shown in the upper half of Fig. 4, image 51e is rendered on projection surface 51 when avatar C is far from projection surface 51, whereas image 51f is rendered on projection surface 51 when avatar C is close to projection surface 51 as shown in the lower half of Fig. 3. The projected (rendered) avatars C-i5 and C-i6 have different sizes (smaller when farther away, and larger when closer), providing a sense of perspective while avoiding distortion, unlike avatars C-i3 and C-i4 shown in Fig. 3.

[0033] The following describes in detail an information processing system 1 that controls the display of objects using a pseudo-perspective projection technique that combines the advantages of perspective projection (perspective) and parallel projection (no distortion).

[0034] 2. Configuration The configuration of each device included in the information processing system 1 will be described.

[0035] 5 is a block diagram showing an example of the configuration of the server 20 according to this embodiment. As shown in FIG. 5, the server 20 includes a communication unit 210, a control unit 220, and a storage unit 230.

[0036] (Communication Unit 210) The communication unit 210 has a transmission unit that transmits data to an external device and a reception unit that receives data from an external device. The communication unit 210 according to this embodiment may be communicatively connected to an external device or the Internet using, for example, a wired or wireless LAN (Local Area Network), Wi-Fi (registered trademark), Bluetooth (registered trademark), a mobile communication network (LTE (Long Term Evolution), 4G (fourth generation mobile communication system), 5G (fifth generation mobile communication system)), or the like.

[0037] For example, the communication unit 210 is connected to the user PCs 10a and 10b via the network 30 for communication, and transmits and receives data.

[0038] (Control Unit 220) The control unit 220 functions as an arithmetic processing unit and a control device, and controls the overall operation of the server 20 in accordance with various programs. The control unit 220 is realized by an electronic circuit such as a CPU (Central Processing Unit) or a microprocessor. The control unit 220 may also include a ROM (Read Only Memory) that stores the programs to be used, arithmetic parameters, etc., and a RAM (Random Access Memory) that temporarily stores parameters that change as appropriate.

[0039] The control unit 220 has the function of a display control unit 221. The display control unit 221 controls the display screen (operating side display screen) of the user PC 10a and the display screen (viewing side display screen) of the user PC 10b.

[0040] More specifically, the display control unit 221 may implement the functions of the data processing unit 221a and the screen generation unit 221b. The data processing unit 221a performs various data processing on the avatar C placed in the virtual space. For example, the data processing unit 221a reflects motion data of the operator U1 received from the user PC 10a on the avatar C. The data processing unit 221a may also perform data processing for projection on the avatar C. Specifically, the data processing unit 221a may perform placement processing, orientation adjustment, and size adjustment processing on the avatar C for pseudo-perspective projection. The screen generation unit 221b projects (draws) the data-processed avatar C_j onto a projection surface (reference surface) to generate a display screen. The display control unit 221 transmits the generated screen to the user PC 10b (viewer side).

[0041] The screen generator 221b may also generate a display screen to be sent to the user PC 10a (operating side). Specifically, the screen generator 221b may use a captured image of the viewer U2 received from the user PC 10b as the display screen on the operating side. The screen generator 221b may also generate the display screen on the operating side by combining the captured image of the viewer U2 with a projected image of the avatar C (or avatar C_j).

[0042] (Storage Unit 230) The storage unit 230 is realized by a ROM that stores programs and calculation parameters used in the processing of the control unit 220, and a RAM that temporarily stores parameters that change as needed.

[0043] The storage unit 230 can store information about each object that constitutes the virtual space. The information about each object includes a 3D model of the avatar C.

[0044] The above has specifically described the basic configuration of the server 20. Note that the configuration of the server 20 according to the present disclosure is not limited to the example shown in Fig. 5. For example, the server 20 does not necessarily have to have all of the components shown in Fig. 5. Furthermore, the server 20 may be realized by multiple devices.

[0045] <<2-2. Configuration of User PC 10>> The user PC 10 (10a, 10b) can be realized by an information processing terminal such as a smartphone, a tablet terminal, a PC (personal computer), or an HMD (head mounted display). The basic configuration of the user PC 10 will be described below.

[0046] 6 is a block diagram showing an example of the configuration of a user PC 10 according to an embodiment of the present disclosure. As shown in FIG. 6, the user PC 10 includes a communication unit 110, an operation unit 120, a control unit 130, a storage unit 140, and a display unit 150.

[0047] (Communication Unit 110) The communication unit 110 has a transmission unit that transmits data to an external device and a reception unit that receives data from the external device. The communication unit 110 according to this embodiment may be communicatively connected to an external device or the Internet using, for example, a wired or wireless LAN, Wi-Fi (registered trademark), Bluetooth (registered trademark), a mobile communication network (LTE, 4G, 5G), or the like.

[0048] In the case of a user PC 10 used in an operating environment (specifically, in the case of user PC 10a), the communication unit 110 can be communicatively connected to a projector 3 and a motion sensor 4 that are arranged in the operating environment. In the case of a user PC 10 used in a viewing environment (specifically, in the case of user PC 10b), the communication unit 110 can be communicatively connected to a display device 5 consisting of a large display and a camera 6 that are arranged in the viewing environment.

[0049] (Operation Unit 120 and Display Unit 150) The operation unit 120 accepts operation input by the user and outputs the input information to the control unit 130. The display unit 150 functions as a display unit that displays various screens. The operation unit 120 and the display unit 150 may be configured as separate units, or may be configured as an integrated unit like a touch panel display.

[0050] (Control Unit 130) The control unit 130 functions as an arithmetic processing unit and a control device, and controls the overall operation of the user PC 10 in accordance with various programs. The control unit 130 is realized by an electronic circuit such as a CPU or a microprocessor. The control unit 130 may also include a ROM for storing the programs to be used, arithmetic parameters, etc., and a RAM for temporarily storing parameters that change as needed.

[0051] For example, the control unit 130 receives motion data of the operator U1 operating the avatar C from the motion sensor 4 and controls transmission of the data to the server 20. The control unit 130 also controls the projector 3 to project the display screen of the operator received from the server 20 onto the screen 2.

[0052] The control unit 130 also controls the display screen on the viewer side received from the server 20 to be displayed on the large display of the display device 5. The control unit 130 also controls the reception of captured images of the viewer U2 viewing the display device 5 from the camera 6 and the transmission of the captured images to the server 20.

[0053] (Storage Unit 140) The storage unit 140 is realized by a ROM that stores programs and calculation parameters used in the processing of the control unit 130, and a RAM that temporarily stores parameters that change as needed.

[0054] The basic configuration of the user PC 10 has been specifically described above. Note that the configuration of the user PC 10 according to the present disclosure is not limited to the example shown in Fig. 6. For example, the user PC 10 does not necessarily have to have all of the components shown in Fig. 6. Furthermore, the user PC 10 may be realized by multiple devices.

[0055] 3. Details of Pseudo-Perspective Projection Next, details of the pseudo-perspective projection according to this embodiment will be described with reference to the drawings.

[0056] <<3-1. Placement Processing>> Fig. 7 is a diagram for explaining the placement processing included in the pseudo-perspective projection technique according to this embodiment. As shown in Fig. 7, the data processing unit 221a places the avatar C on a line perpendicular to the projection surface 51 at a position (intersection P3) where a line connecting the position of the virtual camera V2 (viewpoint position P1) and the position of the avatar C (avatar position P2) intersects with the projection surface 51. For example, the data processing unit 221a may translate the avatar C relative to the projection surface 51 until the avatar C is on the line.

[0057] This placement process is an example of a placement process in which an object (corresponding to avatar C) is placed at a second position (corresponding to the position of avatar C_j) spaced apart from a first position (corresponding to avatar position P2) in a reference direction along the reference plane (corresponding to projection plane 51). Note that the distance of this translation varies depending on the distance of the first position from the reference plane, and the greater the distance of the first position from the reference plane, the longer the length of the translation.

[0058] As a result, for example, if avatar C walks straight towards the projection surface 51 from a distance, on the display screen (two-dimensional plane), avatar C is projected to move from the center of the screen outwards as it gets closer, thereby giving a sense of depth to the movement of objects in three-dimensional space.

[0059] <<3-2. Orientation Adjustment Process>> Figure 8 is a diagram for explaining the orientation adjustment process included in the pseudo-perspective projection technique according to this embodiment. As shown in Figure 8, the data processing unit 221a calculates the angle θ formed by the line connecting the viewpoint position P1 and the avatar position P2 and the line that passes through the avatar position P2 and is perpendicular to the projection plane 51, and rotates the orientation of the avatar C_j moved by the above-mentioned placement process clockwise by the angle θ. Note that when the virtual space is viewed from above, the data processing unit 221a rotates the avatar C_j clockwise when it is located on the left side of the viewpoint position P1, and rotates it counterclockwise when it is located on the right side.

[0060] This allows the orientation of the avatar C as seen from the virtual camera V2 to be reproduced in the moved avatar C_j.

[0061] <<3-3. Size Adjustment Process>> Fig. 9 is a diagram for explaining the size adjustment process included in the pseudo-perspective projection method according to this embodiment. As shown in Fig. 9, the data processing unit 221a adjusts the size of the avatar C_j to a size that corresponds to the ratio of the distance D1 between the viewpoint position P1 (virtual viewpoint) and the avatar position P2 (first position) to the distance D2 between the viewpoint position P1 and the intersection point P3. Specifically, the data processing unit 221a multiplies the size of the avatar C_j by distance D2 / distance D1.

[0062] As a result, even when the avatar C_j is parallel projected to eliminate distortion, the avatar C_j appears relatively smaller the farther it is from the projection surface 51, thereby expressing a sense of perspective.

[0063] Note that the above-mentioned size adjustment process (enlargement / reduction) is just one example, and is not limited to this method. The data processing unit 221a can express a sense of perspective by adjusting the size of the avatar C_j to a size that corresponds to the distance from the projection plane 51 (reference plane) of the avatar position P2 (first position).

[0064] After the data processing of the placement process, orientation adjustment process, and size adjustment process described above, the screen generation unit 221b parallel-projects the avatar C_j onto the projection surface 51 to generate an image (display screen). This allows for pseudo-perspective projection with distortion eliminated. The order in which the placement process, orientation adjustment process, and size adjustment process are performed is not particularly limited. While the placement process, orientation adjustment process, and size adjustment process are all performed as an example here, the present disclosure is not limited thereto. The screen generation unit 221b can also achieve pseudo-perspective projection with distortion eliminated by performing only the placement process, only the size adjustment process, the placement process and orientation adjustment process, or the placement process and size adjustment process, and then parallel-projecting the processed avatar C_j onto the projection surface 51.

[0065] Changes in the movement (position) of the avatar C when the pseudo-perspective projection technique according to this embodiment is applied will be described with reference to FIGS. 10 and 11 . FIG. 10 is a diagram showing the movement of the avatar C before the pseudo-perspective projection technique is applied. The movement of the avatar C may reflect the motion data of the operator U1. Here, it is assumed that the operator U1 walks in a square shape when viewed from above relative to the screen 2 located on the operating side. In this case, the motion data of the operator U1 is reflected, and as shown in FIG. 10 , the avatar C located in the virtual space is also controlled to walk in a square shape when viewed from above relative to the projection plane 51 (corresponding to the reference plane).

[0066] FIG. 11 is a diagram showing the movement of the avatar C_j after the pseudo-perspective projection technique is applied. Through the above-described placement process, the avatar C_j is translated so that the farther it is from the projection surface 51, the closer it is to the center of the screen (the center of the angle of view of the virtual camera V2). As a result, the movement path of the avatar C_j has a trapezoidal shape when viewed from above relative to the projection surface 51, as shown in FIG. 11 , and the movement of the avatar C_j can be given a sense of depth when parallel projected onto the projection surface 51. By also performing the above-described size adjustment process on the avatar C_j, the size of the avatar C_j becomes relatively smaller the farther it is from the projection surface 51, further enhancing the sense of perspective in the movement of the avatar C_j. The avatar C_j shown in FIG. 11 has been subjected to placement and size adjustment processes as data processing, but has not been subjected to orientation adjustment processes.

[0067] <<3-4. Supplementary Information Regarding Orientation Adjustment Processing>> As described above, by using a pseudo-perspective projection technique in which data processing such as placement processing is performed on the avatar C and the data-processed avatar C_j is parallel projected, it is possible to realize pseudo-perspective projection in which distortion is eliminated. On the other hand, as a result of performing the orientation adjustment processing described with reference to FIG. 8 on the avatar C, the orientation of the avatar C_j displayed on the display screen on the viewer side will be misaligned with the orientation of the avatar C in the virtual space (the orientation of the operator U1).

[0068] 12 is a diagram illustrating a shift in the orientation of avatar C_j due to the orientation adjustment process. As shown in the left side of FIG. 12, when avatar C is parallel-projected onto projection surface 51 while facing forward relative to projection surface 51, avatar image C-i7 displayed on the generated display screen faces forward and makes eye contact with viewer U2. However, when the orientation adjustment process is performed, as shown in the right side of FIG. 12, even though avatar C actually faces forward, avatar image C-i8 displayed on the generated display screen faces diagonally relative to projection surface 51, and therefore does not make eye contact with viewer U2.

[0069] However, if orientation adjustment processing is not performed on avatar C_j after placement processing, when the movement path of avatar C_j changes due to placement processing as shown in Figure 11, the movement direction of avatar C_j and the direction in which the feet are extended will not match, and the feet of avatar C_j will appear to be sliding on the ground.

[0070] Here, since it is considered that avatar C_j is most likely to communicate with viewer U2 when it is standing still (in a stopped state), the data processing unit 221a may cancel the orientation adjustment process (rotation process) of avatar C_j when avatar C_j is stopped, so that the orientation of avatar C_j is displayed appropriately.

[0071] 13 is a diagram for explaining the cancellation of the orientation adjustment process when the avatar C_j stops according to this embodiment, and shows a transition diagram of the projection result (display screen) of the avatar C_j.

[0072] 13, when the avatar C_j is moving, the data processing unit 221a performs an orientation adjustment process on the avatar C_j. This causes the direction of movement of the avatar C_j, which is also being placed, to coincide with the direction in which the feet are extended, preventing the feet of the avatar C_j from appearing to slide on the ground. Here, it is assumed that the operator U1 is walking straight toward the screen 2, and the avatar C, which reflects the motion data of the operator U1, is transformed by the placement process to appear as if it is moving diagonally relative to the projection surface 51, thereby expressing a sense of depth.

[0073] Next, as shown in the upper right of Fig. 13, when the avatar C_j stops, the data processing unit 221a cancels the orientation adjustment process for the avatar C_j (i.e., does not perform the orientation adjustment process for the avatar C_j). As a result, the avatar C_j returns to its original orientation, facing forward in this case, as shown in the lower right of Fig. 13. By displaying the avatar C_j facing forward on the large display of the viewer-side display device 5, the viewer U2 appears to be making eye contact with the avatar C_j from any angle, improving the user experience.

[0074] Furthermore, when the avatar C_j is moving, the data processing unit 221a may adjust only the head orientation to the same orientation as the original avatar C (i.e., cancel only the orientation adjustment process for the head of the avatar C_j). FIG. 14 is a diagram for explaining the orientation adjustment process for the avatar C_j while it is moving according to this embodiment. As shown in FIG. 14, when the avatar C_j is moving, the data processing unit 221a adjusts only the head orientation of the avatar C_j to the same orientation as the original avatar C. Here, it is assumed that the original avatar C was facing forward. This makes it possible to adjust the facial orientation of the avatar C_j to an appropriate orientation while preventing the feet of the avatar C_j from slipping on the floor, thereby facilitating communication with the viewer U2.

[0075] 4. Operation Processing FIG. 15 is a flowchart showing an example of the flow of display processing according to this embodiment.

[0076] As shown in FIG. 15, first, the server 20 acquires motion data of the operator U1 (step S103).

[0077] Next, the server 20 calculates the position of the avatar C in the virtual space (avatar position P2) based on the motion data (step S106). The motion data includes relative movement information (information indicating a change in position) of the operator U1. The server 20 may calculate the position of the avatar C in the virtual space from the relative movement information.

[0078] Next, the server 20 acquires the position (viewpoint position P1) of the virtual camera V2 (step S109).

[0079] Next, the server 20 performs data processing on the avatar C, including placement processing, orientation adjustment processing, and size adjustment processing (step S112).

[0080] Next, the server 20 determines whether the operator U1 is stopped (step S115).

[0081] If it has stopped (step S115 / Yes), the server 20 cancels the process of adjusting the orientation of the body of the avatar C_j after the data processing (step S118).

[0082] On the other hand, if the avatar C_j has not stopped (step S115 / No), the server 20 cancels the orientation adjustment process for only the head of the avatar C_j after data processing (step S121).

[0083] Next, the server 20 parallel projects the avatar C_j onto the projection surface 51 to generate a display screen (step S124).

[0084] Next, the server 20 performs display control on the user PC 10b so that the display screen is presented on the viewing side (step S127). Specifically, the server 20 performs control to transmit information on the generated display screen to the user PC 10b.

[0085] Then, steps S103 to S127 are repeated until the system is shut down (step S130 / No), and when the system is shut down (step S130 / Yes), this operation process is terminated.

[0086] The display process according to this embodiment has been described above. Note that the display process shown in Fig. 15 is an example, and this embodiment is not limited to this. The display process shown in Fig. 15 does not have to be performed entirely in the order shown in Fig. 15; for example, some processes may be skipped, the order of some processes may be reversed, or some processes may be performed in parallel.

[0087] 5. Modifications Next, modifications of this embodiment will be described.

[0088] <<5-1. Modified Example of Placement Processing>> FIG. 16 is a diagram illustrating a modified example of the placement processing. In the embodiment described above, as described with reference to FIG. 7 , the avatar C is translated relative to the projection surface 51, but the present disclosure is not limited to this. As shown in FIG. 16 , the data processing unit 221a may place the avatar C_j1 at any position, such as the position of the translated avatar C_j2, on a line 40 perpendicular to the projection surface 51 at a position (intersection P3) where a line connecting the position of the virtual camera V2 (viewpoint position P1) and the position of the avatar C (avatar position P2) intersects with the projection surface 51.

[0089] FIG. 17 is a diagram illustrating another modified example of the placement process. In the embodiment described above, as described with reference to FIG. 7 , the avatar C is moved toward the side where the virtual camera V2 is located. However, the present disclosure is not limited to this. As shown in FIG. 17 , the data processing unit 221a may move the avatar C to the side opposite the side where the virtual camera V2 is located in the reference direction along the reference plane 52. In this modified example, the reference plane 52 is provided behind the avatar C as seen from the virtual camera V2, and the avatar C is moved onto a line 42 that is perpendicular to the reference plane 52 at a position (intersection P4) where a line connecting the position of the virtual camera V2 (viewpoint position P1) and the position of the avatar C (avatar position P2) intersects with the reference plane 52. The data processing unit 221a then performs an orientation adjustment process on the moved avatar C_j by rotating it by an angle θ, and a size adjustment process (enlargement / reduction) according to the positional relationship between the viewpoint position P1, the avatar position P2, and the intersection P4. Specifically, the data processing unit 221a multiplies the size of the avatar C_j by distance D3 / distance D4. Distance D3 is the distance between viewpoint position P1 (virtual viewpoint) and intersection point P4. Distance D4 is the distance between viewpoint position P1 and avatar position P2 (first position). The screen generation unit 221b generates a display screen by parallel projection of the avatar C_j that has undergone various data processing.

[0090] <<5-2. Objects Moving in the Height Direction>> In the above-described embodiments and variants, only transformations on a two-dimensional plane are dealt with, and the height direction is not taken into consideration. However, the present disclosure is not limited to this, and the transformation may be extended to three dimensions. For example, in FIG. 13, the avatar C_j moves downward on the screen as it approaches the virtual camera. This is the case when the transformation is extended in the three-dimensional direction; when only a two-dimensional plane is dealt with, the height of the avatar C_j is not changed by the transformation. In other words, the height of the avatar C_j is always constant unless the avatar C_j actually moves in the height direction by jumping, etc. In other words, the avatar C_j is enlarged or reduced by the transformation, but the center point of this expansion or reduction is maintained at a constant height. For example, if the center point is set to the sole of the avatar C_j, the phenomenon of the avatar C_j floating above or sinking into the ground in the virtual space can be avoided, but the height of the sole of the foot is always constant. When the transformation is expanded to three dimensions, the height of the soles of the feet changes, so the ground in the virtual space may also be transformed based on the principle of perspective projection so that the further back the ground is located (the further away from the virtual camera in the depth direction), the higher (higher) it is, and then drawn by parallel projection. When the transformation is expanded to three dimensions, the data processing unit 221a only adds a height movement of the soles of the feet in addition to the transformations (movement, rotation, scaling) on ​​a two-dimensional plane, and does not need to add new rotations or scaling.

[0091] Furthermore, while the avatar C operated by the operator U1 is assumed to be a humanoid object that moves in a similar manner to a human, the present disclosure is not limited thereto and may also be an object that can move in a vertical direction. FIG. 18 is a diagram for describing the case of an avatar C10 that can move in a vertical direction. The avatar C10 may be, for example, a bird, a butterfly, or the like. The operator U1 operates the drone 8 using the controller 7, and motion data of the drone 8 is transmitted to the server 20 by a user PC 10a (not shown in FIG. 18 ) and reflected on the avatar C10 placed in the virtual space. An image of the avatar C10 generated by the server 20 and an image of the viewer U2 captured on the viewer side may be displayed on the screen 2 on the operating side. The avatar C10 is displayed on the display device 5 on the viewer side. Similarly, in the case of an avatar C10 that can move in a vertical direction, the server 20 may perform positioning, orientation adjustment, and size adjustment on the avatar C10 placed in the virtual space and then perform parallel projection, thereby achieving a pseudo-perspective projection with distortion eliminated.

[0092] <<5-3. Guidance Display>> Next, a guidance display for guiding the operator U1 as to where to stand will be proposed.

[0093] FIG. 19 is a diagram illustrating how an avatar appears when it turns around. As described above, an image of viewer U2 captured by the viewer-side camera 6 is displayed on the operating-side screen 2. It is assumed that the operator U1 stands in front of viewer U2 displayed on the screen 2 and communicates with viewer U2 by facing him (e.g., waving). On the viewing side, as shown on the left side of FIG. 19 , an avatar C_j that has undergone various data processing is displayed on the display device 5. Note that in the example shown on the left side of FIG. 19 , because the avatar C_j is stationary (standing still), the orientation adjustment process is canceled, and the avatar C_j is displayed in the orientation of the original avatar C, i.e., facing forward. This allows viewer U2 to make eye contact with the avatar C_j and communicate.

[0094] In such a situation, as shown on the right side of Figure 19, when a new viewer U3 appears (or when there are multiple viewers from the beginning), the operator U1 may switch the communication target from the viewer U2 in front to the viewer U3 to the side. In this case, if the operator U1 turns his / her head from the direction of viewer U2 (frontal to the screen 2) to the direction of viewer U3 beside him / her (diagonal to the screen 2), the face of the avatar C_j will be tilted as shown on the right side of Figure 19, and the operator C_j will not be able to make eye contact with viewer U3 or anyone else, making communication difficult.

[0095] Here, when switching communication targets, it is conceivable to have the operator U1 walk up to the front of the new communication target and communicate with the new communication target while facing forward toward the screen 2. By having the avatar C_j move away from the line of sight of the viewer U2, the intention to switch communication targets is conveyed to the viewer. Also, by moving the operator U1 up to the front of the new communication target, viewer U3, the operator U1 can naturally face the operator U1, and the viewer U3 and the avatar C_j can make eye contact.

[0096] FIG. 20 is a diagram showing an example of a guidance display according to a modified example. As shown in the upper left of FIG. 20 , viewers U2 and U3 are displayed on the operating-side screen 2, and the operator U1 can communicate with them while viewing the life-size viewers. Here, assume that the communication target changes, such as when the operator U1, who is standing in front of and communicating with viewer U2, next communicates with viewer U3. The communication target can be set by the server 20 based on any criteria. For example, based on captured images of the viewers, the server 20 may set as a new communication target a person gazing intently at the screen (the display screen of the display device 5), a person who seems most interested in the avatar, or a person who is within a certain distance from the screen. Furthermore, the server 20 may acquire gaze information of the operator U1 and set as a new communication target a viewer that the operator U1 is paying attention to. In the example shown in FIG. 20 , viewer U3 is set as the new communication target.

[0097] Next, the server 20 controls the screen 2 to display guidance for moving the operator U1 to the position of viewer U3, who is the new communication target (a position directly facing viewer U3), as shown in the upper right of Fig. 20. For example, a frame 56 is displayed on the screen 2 to surround viewer U3, instructing the operator U1 to stand in front of the viewer, and a gaze point icon 57 is displayed above the head of viewer U3 on the screen 2 to encourage the operator U1 to look at the frame 56. The operator U1 moves to the position in front of the frame 56 while looking at the gaze point icon 57.

[0098] As a result, as shown in the lower right of FIG. 20, the operator U1 can communicate with the viewer U3 while looking directly at him / her.

[0099] FIG. 21 is a diagram illustrating how the viewer sees the operator U1 when the operator U1 moves in accordance with the guidance display according to this modified example. As shown on the left side of FIG. 21 , for example, when avatar C_j, who was communicating with viewer U2, moves toward viewer U3, the intention to switch the communication target to viewer U3 is conveyed to each viewer. While moving, avatar C_j no longer faces forward and loses line of sight with the viewers. Then, as shown on the right side of FIG. 21 , avatar C_j stops and turns forward again, allowing it to make eye contact with viewer U3 and communicate with him. Note that when avatar C_j faces forward, it appears to viewer U2 that the avatar C_j and viewer U2 are making eye contact, but the action shown on the left side of FIG. 21 allows viewer U2 to recognize that the communication target has changed.

[0100] FIG. 22 is a flowchart showing an example of the flow of a guidance display process according to a modified example.

[0101] 22, first, the server 20 detects viewers using various sensors arranged on the viewing side (step S203) and acquires the position of each viewer (step S206). The various sensors arranged on the viewing side may be, for example, a camera 6, a depth sensor, an ultrasonic sensor, etc.

[0102] Next, the server 20 sets the communication target audience Q (step S209). The communication target can be set based on any of the criteria described above.

[0103] Next, the server 20 acquires the position q of the viewer Q (viewer position) on the operating side screen (the display screen projected onto the screen 2 by the projector 3) (step S212).

[0104] Next, the server 20 acquires the face position H of the operator (step S215). The face position H of the operator may be indicated by a three-dimensional position relative to the operating screen based on motion data detected from the motion sensor 4 worn by the operator. Alternatively, a camera, depth sensor, ultrasonic sensor, or the like may be provided on the operating side to detect the position and orientation of the operator relative to the operating screen. Alternatively, the face position H of the operator may be the head position of an avatar operated by the operator when the avatar is superimposed on the operating screen.

[0105] Next, the server 20 acquires the position (face position) h of the face position H on the operating screen (step S218). For example, the server 20 may determine the intersection point on the operating screen of a line extending perpendicularly from the face position H of the operator facing the operating screen to the operating screen as the face position h.

[0106] Next, the server 20 displays an image on the operating screen to guide the operator to the appropriate position, depending on the number and position of the viewer positions q (step S221). The guiding image may be a frame 56 surrounding the viewer who is the communication target, as shown in Fig. 20, or an image pointing to the viewer who is the communication target and including a comment such as "Please move to this position." Note that the number of viewer Q set as the communication target is not limited to one, and may be multiple.

[0107] The server 20 then displays a gaze point on the operating screen at the height of the face position h to encourage the operator to gaze, depending on the number and position of the viewer position q (step S224). By moving the operator in front of the viewer Q and having the operator gaze at the gaze point, the operator can be made to face the viewer Q displayed on the operating screen. Note that if the viewer Q is a child, for example, and the height difference between the viewer position q and the face position h is greater than a certain level, the server 20 may display the gaze point by setting the height of the operator's face when the operator is crouching as the face position h. The server 20 may also adjust the rendering position on the operator screen 2 so that the viewer's face and the gaze point are displayed directly in front of the operator's eyes. As described above, the gaze point is displayed at the height of the face position h corresponding to the operator's face position H, i.e., directly in front of the operator's eyes. If the height of the gaze point does not match the height of the viewer's face, the operator will need to tilt their face up or down, which will prevent them from appearing facing forward. Therefore, it is desirable that the gaze point be directly in front of the operator's face. Furthermore, if there is a significant difference between the height of the viewer's face displayed on the operator screen 2 and the height of the point of gaze, it becomes difficult for the operator to communicate with the viewer while checking their facial expression, so it is desirable that the height of the point of gaze and the viewer's face are close to each other. Therefore, the server 20 may adjust the viewer's face on the operator screen 2 so that it is drawn at approximately the height of the point of gaze. Specifically, the server 20 may adjust the viewer's drawing position to be approximately the height of the point of gaze by shifting the viewer's drawing position upward or downward on the screen, or by enlarging or reducing the size of the viewer.

[0108] Furthermore, when the operator is looking near the gaze point, the server 20 may correct the facial orientation of the avatar so that the avatar faces forward. Furthermore, when the operator is looking at the gaze point without moving to a standing position, the server 20 may generate a movement motion of the avatar to complement the movement.

[0109] <6. Supplementary Information> Although preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, the present technology is not limited to such examples. It is clear that a person skilled in the art of the present disclosure can conceive of various modified or altered examples within the scope of the technical idea described in the claims, and it is understood that these also naturally fall within the technical scope of the present disclosure.

[0110] For example, one or more computer programs can be created to cause the hardware, such as the CPU, ROM, and RAM, built into the above-described server 20 or user PC 10 to perform the functions of the server 20 or user PC 10. Also provided is a computer-readable storage medium storing the one or more computer programs.

[0111] Although the above-described embodiment does not refer to the exchange of voices, the voice of the operator U1 and the voice of the viewer may be transmitted and received via the server 20 and provided to the other party. The voice of the operator U1 may be converted into the character voice of the avatar C in the server 20 and output to the viewer.

[0112] Alternatively, the functions of the server 20 may be provided in the user PC 10, and the information processing system 1 may be formed by the user PC 10a and the user PC 10b. That is, the user PC 10a and the user PC 10b may transmit and receive data via the network 30, and the user PC 10b may control the display of the avatar C using a pseudo-perspective projection technique. The motion data is not limited to directly reflecting data acquired by a motion sensor. For example, the motion data may be generated from movement instructions input by a sensor or a controller.

[0113] Furthermore, the effects described herein are merely descriptive or exemplary and are not limiting. In other words, the technology according to the present disclosure may achieve other effects that will be apparent to those skilled in the art from the description of this specification, in addition to or in place of the above-described effects.

[0114] The present technology may also be configured as follows. (1) An information processing system including a display control unit that generates a display screen including a display of an object moving according to motion data, wherein the display control unit performs data processing including: arranging the object at a second position in a reference direction along a reference plane that is spaced from the first position by a length corresponding to a distance from the reference plane to a first position indicated by the motion data; and generating the display screen by parallel projecting the object after the data processing onto the reference plane. (2) The information processing device according to (1), wherein the length corresponding to the distance from the reference plane to the first position is longer as the distance from the reference plane to the first position is greater. (3) The information processing system according to (1) or (2), wherein the position of the second position in the reference direction is equal to the position in the reference direction of an intersection between the reference plane and a line connecting the first position and a virtual viewpoint position. (4) The information processing system according to any one of (1) to (3), wherein the data processing includes a size adjustment process that adjusts the size of the object to a size corresponding to the distance from the reference plane to the first position. (5) The information processing system according to (4), wherein the size adjustment process includes adjusting the size of the object to a size according to a ratio of a distance between the position of the virtual viewpoint and the first position and a distance between the position of the virtual viewpoint and the intersection point. (6) The information processing system according to any one of (1) to (5), wherein the data processing includes an orientation adjustment process that adjusts an orientation of the object according to a relationship between the first position and the position of the virtual viewpoint. (7) The information processing system according to (6), wherein the orientation adjustment process includes calculating an angle formed by a line connecting the position of the virtual viewpoint and the first position and a line passing through the first position and perpendicular to the reference plane, and rotating the orientation of the object to the angle. (8) The information processing system according to (6) or (7), wherein the display control unit performs a stop determination on whether the object is moving, and cancels the orientation adjustment process if it determines that the object is not moving and is stopped.(9) The information processing system according to (8), wherein the display control unit cancels the orientation adjustment process for only the head of the object when the object is moving. (10) The information processing system according to any one of (1) to (9), wherein the display control unit performs a process of presenting a captured image of viewers watching the display screen to an operator operating the object, and a process of displaying an image that guides the operator to a position where the operator can view a specific viewer from the front of one or more viewers shown in the captured image. (11) An information processing method, wherein a processor performs data processing including: generating a display screen including a display of an object moving according to motion data, and further including a placement process of placing the object at a second position that is spaced from a first position indicated by the motion data in a reference direction along the reference plane by a length corresponding to a distance from the first position to a reference plane; and generating the display screen by parallel projecting the object after the data processing onto the reference plane. (12) A program that causes a computer to function as a display control unit that generates a display screen including a display of an object moving according to motion data, wherein the display control unit performs data processing including a placement process that places the object at a second position that is spaced apart from the first position in a reference direction along the reference plane by a length that corresponds to the distance from the reference plane to the first position indicated by the motion data, and generates the display screen by parallel projecting the object onto the reference plane after the data processing.

[0115] REFERENCE SIGNS LIST 1 Information processing system 10 User PC 20 Server 210 Communication unit 220 Control unit 221 Display control unit 221a Data processing unit 221b Screen generation unit 230 Storage unit 2 Screen 3 Projector 4 Motion sensor 5 Display device 6 Camera 30 Network

Claims

1. An information processing system comprising a display control unit that generates a display screen including a display of an object that moves according to motion data, wherein the display control unit performs data processing including a placement process that places the object at a second position that is spaced apart from the first position indicated by the motion data in a reference direction along the reference plane by a length that corresponds to the distance from the reference plane to the first position indicated by the motion data, and generates the display screen by parallel projecting the object onto the reference plane after the data processing.

2. The information processing system according to claim 1, wherein the length according to the distance of the first position from the reference plane is longer as the distance of the first position from the reference plane is greater.

3. An information processing system according to claim 1, wherein the position of the second position in the reference direction is equal to the position in the reference direction of the intersection of the line connecting the first position and the virtual viewpoint position with the reference plane.

4. The information processing system according to claim 1, wherein the data processing includes a size adjustment process for adjusting the size of the object to a size according to the distance from a reference plane of the first position.

5. An information processing system as described in claim 4, wherein the size adjustment process includes adjusting the size of the object to a size according to the ratio of the distance between the position of a virtual viewpoint and the first position and the distance between the position of the virtual viewpoint and the intersection of a line connecting the position of the virtual viewpoint and the first position with the reference plane.

6. The information processing system according to claim 1, wherein the data processing includes an orientation adjustment process for adjusting an orientation of the object in accordance with a relationship between the first position and a virtual viewpoint position.

7. An information processing system as described in claim 6, wherein the orientation adjustment process includes determining an angle formed by a line connecting the position of the virtual viewpoint and the first position and a line passing through the first position and perpendicular to the reference plane, and rotating the orientation of the object to said angle.

8. The information processing system according to claim 6, wherein the display control unit performs a stop determination as to whether the object is moving or not, and if it determines that the object is not moving and is stopped, cancels the orientation adjustment process.

9. The information processing system according to claim 8, wherein the display control unit cancels the orientation adjustment process for only the head of the object when the object is moving.

10. The information processing system of claim 1, wherein the display control unit performs processing to present a captured image of viewers viewing the display screen to an operator operating the object, and to display an image that guides the operator to a position where a specific viewer from among one or more viewers shown in the captured image can be viewed from the front.

11. An information processing method in which a processor performs data processing including generating a display screen including a display of an object moving in accordance with motion data, and further performing a placement process to place the object at a second position in a reference direction along a reference plane that is spaced from the first position indicated by the motion data by a length corresponding to the distance from the reference plane to the first position, and generates the display screen by parallel projecting the object onto the reference plane after the data processing has been performed.

12. A program that causes a computer to function as a display control unit that generates a display screen including a display of an object that moves according to motion data, wherein the display control unit performs data processing including a placement process that places the object at a second position that is spaced from the first position indicated by the motion data in a reference direction along the reference plane by a length that corresponds to the distance from the reference plane to the first position, and generates the display screen by parallel projecting the object onto the reference plane after the data processing has been performed.

Images