Information processing apparatus, method for controlling information processing apparatus, and program

Abstract

To provide an information processing apparatus that allows browsing, with a sufficient degree of details, of a CG object designated by another user participating in AR / MR contents.SOLUTION: Information processing apparatuses 100a, 100b each draw a CG object in a virtual space in AR / MR contents that are virtual space experience contents in which a plurality of people can participate. The information processing apparatus 100a on a reception side receives browsing request data including information on a CG object designated by a transmission user who operates the information processing apparatus 100b on a transmission side, and draws the CG object indicated by the browsing request data at high resolution.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing device, a control method for an information processing device, and a program. [Background technology]

[0002] With the spread of Augmented Reality (AR) and Mixed Reality (MR) content, it is expected that the number of virtual space experience contents that can be played in multiple games (hereinafter referred to as "AR / MR content") will increase in the future. Many of the devices that execute AR / MR content, which is experienced while moving around in real space, have limited hardware resources, such as smartphones and standalone head-mounted displays. For this reason, real data for drawing CG objects is not generated by the device that executes the AR / MR content, but is provided from a server with high processing capabilities. In the device that executes the AR / MR content, the CG object is drawn based on the real data provided by the server, and the resolution of the CG object is adjusted based on, for example, the user's line of sight information (see, for example, Patent Document 1).

[0003] On the other hand, in multiplayer AR / MR content, the number of viewpoints increases with the number of participating users, which increases the number of CG objects to be rendered and increases the processing load on the server.One way to reduce this processing load on the server is to render distant CG objects at a lower resolution than other CG objects. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 7181293 Summary of the Invention [Problem to be solved by the invention]

[0005] However, when such a method is used in multi-playable AR / MR content, there is a concern that it may hinder the shared experience between users. For example, there are times when a user wants other users to see a CG object that the user is looking at. In such a situation, if the distance between the other users and the CG object is greater than a certain value, the CG object is rendered at a low resolution on the execution device of the other users' AR / MR content. As a result, the other users cannot view the CG object with sufficient detail.

[0006] The present invention aims to provide an information processing device, a control method thereof, and a program that enable a user to view, with a sufficient level of detail, a CG object specified by another user participating in AR / MR content. [Means for solving the problem]

[0007] In order to achieve the above-mentioned object, the information processing device of the present invention is an information processing device that draws CG objects in a virtual space in virtual space experience content in which multiple people can participate, and is equipped with a means for receiving viewing request data including information of a CG object specified by a user operating another information processing device, and a means for controlling the drawing of the CG object in the virtual space, wherein the means for controlling the drawing draws the CG object indicated by the received viewing request data at a second resolution higher than a first resolution. Effect of the Invention

[0008] According to the present invention, it is possible to view CG objects specified by another user participating in AR / MR content with a sufficient level of detail. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram illustrating a hardware configuration of an information processing device according to an embodiment of the present invention. [Diagram 2]FIG. 2 is a block diagram illustrating a schematic configuration of software modules of a transmitting information processing device in FIG. [Diagram 3] FIG. 2 is a block diagram illustrating a schematic configuration of software modules of a receiving information processing device in FIG. [Figure 4A] 1(b) is a flowchart showing the procedure of a browse request data transmission process executed by the transmitting information processing device of FIG. [Figure 4B] 1(a) is a flowchart showing the procedure of a browse request data receiving process executed by the receiving information processing device of FIG. [Diagram 5] FIG. 2 is a diagram showing an example of an image displayed on the display unit of FIG. [Figure 6] FIG. 2 is a diagram showing an example of an image displayed on the display unit of FIG. [Figure 7] FIG. 11 is a block diagram illustrating a schematic configuration of software modules of a receiving information processing device according to a second embodiment. [Figure 8] 13 is a flowchart showing a procedure of a browse request data receiving process executed by a receiving information processing device according to the second embodiment. [Figure 9] 9 is a diagram for explaining the control of S806, S807, and S808 in FIG. 8. [Figure 10] FIG. 9 is a diagram for explaining the control of S810 and S808 in FIG. 8. [Figure 11] 13 is a flowchart showing another procedure of the browse request data receiving process executed by the receiving information processing device in the second embodiment. [Figure 12] FIG. 12 is a diagram showing an example of a two-dimensional panel image displayed in S1104 of FIG. [Figure 13] FIG. 13 is a block diagram illustrating a schematic configuration of software modules of a receiving information processing device according to a third embodiment. [Figure 14] 13 is a flowchart showing a procedure of a browse request data receiving process executed by a receiving information processing device according to the third embodiment. [Figure 15]13A and 13B are diagrams illustrating an example of a content concentration score and a CG object interest score calculated by a receiving information processing device in the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In this embodiment, an information processing device capable of experiencing AR / MR content, which is a virtual space experience content that can be played in multiplayer, will be described. In the following, a wearable device that can be worn on the user's head, such as a head-mounted display or smart glasses, will be described as an example of the information processing device. Note that the information processing device is not limited to such a wearable device, and may be a smartphone, a tablet terminal, or the like. Also, in this embodiment, a configuration in which two information processing devices 100a and 100b participate in AR / MR content will be described as an example, but it is also possible for three or more information processing devices to participate in AR / MR content.

[0011] First, an information processing apparatus and a control method thereof according to a first embodiment of the present invention will be described.

[0012] 1(a) is a block diagram showing a schematic hardware configuration of a receiving information processing device 100a according to the present embodiment. The information processing device 100a includes a CPU 101a, a ROM 102a, a RAM 103a, an operation unit 105a, a sensor unit 106a, an image capturing unit 107a, a display unit 108a, and a communication I / F 109a. These are connected to each other via a bus 104a.

[0013] The CPU 101a is a computing device that controls the system as a whole, and executes programs stored in the ROM 102a and the like to perform various processes. The ROM 102a is a read-only non-volatile memory device that stores programs and parameters that do not require modification, such as image processing programs and initial data. The RAM 103a is a memory device that temporarily stores input information from various devices and calculation results in image processing, and also provides a working area for the CPU 101a. The operation unit 105a is a device that accepts user input operations such as switches and controllers. The sensor unit 106a is composed of a gyro sensor, a gaze sensor, and the like. The shooting unit 107a is an imaging device incorporated in the information processing device 100a, and is composed of a background display image camera for displaying the background of AR / MR content, and a tracking camera for estimating the self-position and orientation. The display unit 108a is a display device that displays a virtual space. The communication I / F 109a is an interface unit capable of transmitting and receiving data to and from the information processing device 100b, an AR / MR content management server (not shown), and the like via a network (not shown).

[0014] 1(b) is a block diagram showing a schematic hardware configuration of a transmitting information processing device 100b according to the present embodiment. The information processing device 100b includes a CPU 101b, a ROM 102b, a RAM 103b, an operation unit 105b, a sensor unit 106b, an image capturing unit 107b, a display unit 108b, and a communication I / F 109b. These are connected to each other via a bus 104b. The hardware configuration of the transmitting information processing device 100b is basically the same as that of the receiving information processing device 100a described above. Therefore, the hardware configuration of the transmitting information processing device 100b is the same as that of the receiving information processing device 100a described above, and therefore will not be described here.

[0015] Fig. 2 is a block diagram showing a schematic configuration of software modules of the information processing device 100b on the transmitting side in Fig. 1(b). The information processing device 100b includes, as software modules, a virtual space control unit 201, a user information acquisition unit 202, an operation information acquisition unit 203, a line of sight information acquisition unit 204, a background image acquisition unit 205, and a CG information acquisition unit 206. The information processing device 100b further includes a transmission destination determination unit 207, a position information acquisition unit 208, a browsing request data creation unit 209, and a browsing request data transmission unit 210. The processing of the above-mentioned software modules is realized by the CPU 101b of the information processing device 100b executing a program stored in the ROM 102b or the like.

[0016] The virtual space control unit 201 constructs a virtual space to be displayed on the display unit 108b of the information processing device 100b. A background image captured by the background display image camera of the photographing unit 107b is displayed as the background of the virtual space. Also, in the virtual space, avatars representing the avatars of users participating in the AR / MR content and three-dimensional CG objects provided by the AR / MR content are displayed.

[0017] The user information acquisition unit 202 acquires sending user information linked to the account of a user (hereinafter referred to as the "sending user") operating the information processing device 100b from the RAM 103b. The sending user information includes, for example, information indicating the relationship between the sending user and users participating in the AR / MR content and information indicating the sending user's hobbies and preferences. The operation information acquisition unit 203 acquires input information input by the sending user to the operation unit 105b. The gaze information acquisition unit 204 acquires gaze information of the sending user detected by the gaze sensor of the sensor unit 106b.

[0018] The background image acquisition unit 205 acquires a background image captured by the background display image camera of the photographing unit 107b. The CG information acquisition unit 206 acquires designated CG object information, which is information indicating a CG object designated by the sending user from among a plurality of CG objects in the virtual space.

[0019] A destination determination unit 207 determines a destination of the browsing request data based on the input information acquired by the operation information acquisition unit 203 and the gaze information acquired by the gaze information acquisition unit 204. A position information acquisition unit 208 estimates the position and posture of the sending user based on the background image acquired from the background image acquisition unit 205, and generates position and posture information indicating this position and posture.

[0020] The browsing request data creation unit 209 creates browsing request data. The browsing request data includes the designated CG object information acquired by the CG information acquisition unit 206, the transmitting user information acquired by the user information acquisition unit 202, and the position and orientation information generated by the position information acquisition unit 208. The browsing request data transmission unit 210 transmits the browsing request data created by the browsing request data creation unit 209 and the destination information indicating the destination determined by the destination determination unit 207 to the AR / MR content management server via the communication I / F 109b. The AR / MR content management server generates actual data for drawing a CG object indicated by the designated CG object information in the received browsing request data (hereinafter, referred to as "actual data of the CG object"). The AR / MR content management server performs a process of including the actual data of the CG object in the received browsing request data, and transmits the processed browsing request data to the destination indicated by the received destination information, for example, the information processing device 100a on the receiving side.

[0021] Fig. 3 is a block diagram showing a schematic configuration of software modules of the information processing device 100a on the receiving side in Fig. 1(a). The information processing device 100a includes, as software modules, a virtual space control unit 301, a user information acquisition unit 302, an operation information acquisition unit 303, a gaze information acquisition unit 304, a background image acquisition unit 305, and a CG information acquisition unit 306. The information processing device 100a further includes a position information acquisition unit 307, a browsing request receiving unit 308, a user preference acquisition unit 309, a determination unit 310, and a drawing control unit 311. The processing of the above-mentioned software modules is realized by the CPU 101a of the information processing device 100a executing a program stored in the ROM 102a or the like.

[0022] The virtual space control unit 301, the user information acquisition unit 302, the operation information acquisition unit 303, the gaze information acquisition unit 304, the background image acquisition unit 305, the CG information acquisition unit 306, and the position information acquisition unit 307 have functions similar to those of the virtual space control unit 201, the user information acquisition unit 202, the operation information acquisition unit 203, the gaze information acquisition unit 204, the background image acquisition unit 205, the CG information acquisition unit 206, and the position information acquisition unit 208 described above, respectively.

[0023] The browsing request receiving unit 308 controls reception of browsing request data transmitted from the AR / MR content management server. The received browsing request data is stored in the RAM 103a of the information processing device 100a.

[0024] The user preference acquisition unit 309 acquires the recipient user preference information set by the user (hereinafter, referred to as the "recipient user") who operates the information processing device 100a. The recipient user preference information includes, for example, information indicating attributes of CG objects of high interest to the recipient user.

[0025] The determination unit 310 determines whether or not to render the CG object indicated by the browsing request data at a high resolution (second resolution) based on the sending user information included in the browsing request data and the receiving user preference information set by the receiving user. The rendering control unit 311 controls the rendering of the CG object. For example, when the determination unit 310 determines that the CG object should be rendered at a high resolution, the rendering control unit 311 renders the CG object indicated by the browsing request data at a high resolution.

[0026] Fig. 4A is a flowchart showing the procedure of the browse request data transmission process executed by the transmitting information processing device 100b in Fig. 1(b). The browse request data transmission process is realized by the CPU 101b of the information processing device 100b executing a program stored in the ROM 102b etc. The browse request data transmission process is executed when the sending user specifies a CG object that he wants other users to see in the virtual space.

[0027] In FIG. 4A, first, the CPU 101b acquires designated CG object information indicating a CG object designated by the sending user (S (step) 401). Next, the CPU 101b acquires sending user information held in the RAM 103b (S402). Next, the CPU 101b acquires input information input by the sending user to the operation unit 105b (S403). Next, the CPU 101b acquires line-of-sight information of the sending user from the line-of-sight sensor of the sensor unit 106b (S404).

[0028] Next, CPU 101b acquires a background image captured by the background display image camera of image capturing unit 107b (S405). In this embodiment, image capturing unit 107b may be configured to include a plurality of background display image cameras that capture images at different angles of view, and to acquire background images with different angles of view from the plurality of background display image cameras in S405.

[0029] Next, the CPU 101b estimates the position and orientation of the sending user based on the acquired background image, and acquires position and orientation information indicating the estimated position and orientation (S406). In S406, for example, a marker whose position information is registered in advance is placed, and the position and orientation is estimated by a marker detection method. Note that the method of estimating the position and orientation is not limited to this method, and for example, a visual positioning system that detects feature points such as buildings from the background image and estimates the position and orientation may be used.

[0030] Next, the CPU 101b determines a user in the virtual space who is in the line of sight of the sending user detected by the line of sight sensor of the sensor unit 106b as a provisional destination candidate, and determines this user as the destination candidate according to an instruction input to a dedicated UI or the operation unit 105b. The CPU 101b specifies an identification ID of this destination candidate, and transmits a state information acquisition request including this identification ID to the management server of the AR / MR content. The management server of the AR / MR content acquires state information of this user from an information processing device operated by the user corresponding to the identification ID included in the state information acquisition request, and transmits the acquired state information to the information processing device 100b on the transmitting side. Note that the user's state information is, for example, information indicating whether or not the browsing request data can be transmitted to the information processing device operated by this user. Note that the management server of the AR / MR content may be configured to periodically acquire state information of users participating in the AR / MR content at a predetermined interval.

[0031] Next, CPU 101b displays destination status notification 500 of Fig. 5(a) indicating whether or not the view request data can be transmitted to this destination candidate based on the acquired status information (S407). From such destination status notification 500, the sending user can know whether or not the view request data can be transmitted to this destination candidate.

[0032] Next, the CPU 101b determines, as the destination, a user in the line of sight of the sending user detected by the line of sight sensor of the sensor unit 106b, according to a destination determination action such as an instruction input to a dedicated UI or the operation unit 105b (S408). In this embodiment, it is assumed that the information processing device 100a is determined as the destination.

[0033] Next, the CPU 101b creates viewing request data including the sending user information, the designated CG object information, and the position and orientation information of the sending user (S409). Next, the CPU 101b transmits the destination information indicating the destination determined in S408 and the viewing request data created in S409 to the management server of the AR / MR content (S410), and ends this process.

[0034] The AR / MR content management server generates actual data of a CG object for rendering a CG object indicated by the specified CG object information in the received viewing request data. The AR / MR content management server also performs processing to include the actual data of the CG object in the received viewing request data, and transmits the processed viewing request data to the receiving-side information processing device 100a, which is the destination indicated by the received destination information.

[0035] Fig. 4B is a flowchart showing the procedure of the browsing request data receiving process executed by the receiving information processing device 100a in Fig. 1(a). The browsing request data receiving process is realized by the CPU 101a of the information processing device 100a executing a program stored in the ROM 102a or the like.

[0036] In FIG. 4B, first, when the CPU 101a receives viewing request data from the management server of the AR / MR content (S411), the CPU 101a acquires actual data of the CG object from the viewing request data (S412). Next, the CPU 101a acquires the receiving user information held in the RAM 103a (S413). The receiving user information includes, for example, information indicating the relationship between the receiving user and the users participating in the AR / MR content. Next, the CPU 101a acquires input information input by the receiving user to the operation unit 105a (S414). Next, the CPU 101a acquires the receiving user's line of sight information from the line of sight sensor of the sensor unit 106a (S415).

[0037] Next, CPU 101a acquires a background image captured by the background display image camera of image capturing unit 107a (S416). In this embodiment, image capturing unit 107a may be configured to include a plurality of background display image cameras that capture images at different angles of view, and to acquire background images with different angles of view from the plurality of background display image cameras in S416.

[0038] Next, the CPU 101a estimates the position and orientation of the receiving user based on the acquired background image, and acquires position and orientation information indicating the estimated position and orientation (S417). In S417, as in the above-mentioned S406, for example, a marker whose position information is registered in advance is placed and the position and orientation is estimated by a marker detection method. Note that the method of estimating the position and orientation is not limited to this method, and for example, a visual positioning system that detects feature points such as buildings from a background image and estimates the position and orientation may be used.

[0039] Next, the CPU 101a acquires the recipient user preference information set by the recipient user (S418) Next, the CPU 101a determines whether or not to render the CG object indicated by the received view request data at high resolution (S419).

[0040] In S419, for example, if it is determined that the sending user is a specific user who has a close relationship with the receiving user, such as a friend of the receiving user, based on the sending user information included in the viewing request data, it is determined that the CG object is to be rendered in high resolution, allowing the receiving user to view the CG object designated by the user who has a close relationship with the receiving user, with a sufficient level of detail.

[0041] Also, if it is determined that the sending user is a specific user with similar tastes and preferences to the receiving user based on the sending user information and receiving user preference information included in the viewing request data, it is determined that the CG object is to be rendered in high resolution, allowing the receiving user to view the CG object specified by a user with similar tastes and preferences to the receiving user with a sufficient level of detail.

[0042] Furthermore, when it is determined that the CG object indicated by the received browsing request data is a CG object with attributes close to the preferences of the receiving user based on the receiving user preference information, it is also determined that the CG object is rendered in high resolution. This allows the receiving user to view the CG object designated by the user participating in the AR / MR content and with attributes close to the user's preferences with sufficient detail. If none of the above applies, it is determined that the CG object indicated by the received browsing request data is not rendered in high resolution. Note that when multiple browsing request data with different designated CG objects are received from the management server of the AR / MR content, only some of the multiple CG objects corresponding to the multiple browsing request data may be rendered in high resolution. For example, among the multiple CG objects corresponding to the multiple browsing request data, CG objects with a position similarity and / or attribute similarity of a predetermined value or more are rendered in high resolution. This reduces the rendering load on the information processing device 100a on the receiving side when multiple browsing request data are received.

[0043] If it is determined in S419 that the CG object indicated by the received view request data is to be rendered at high resolution, the CPU 101a renders the CG object indicated by the received view request data at high resolution (S420). Here, the rendering control in S420 will be described with reference to Figs. 5(b) and 5(c).

[0044] FIG. 5(b) is a diagram showing an example of an AR / MR image from the receiving user's viewpoint before receiving the browsing request data. 501 represents a CG object drawn at high resolution. In this embodiment, CG objects within the gaze range of the receiving user detected by the line-of-sight sensor of the sensor unit 106a of the information processing device 100a and CG objects relatively close to the receiving user are drawn at high resolution. 502 represents a sending user participating in the AR / MR content. 503 represents a CG object specified by the sending user 502. CG object 503 is drawn at a lower resolution (first resolution) than CG object 501 because it is relatively far from the receiving user.

[0045] Fig. 5(c) is a diagram showing an example of an AR / MR image from the receiving user's viewpoint after the process of S420 is performed. In S420, a CG object 503 is rendered at high resolution as shown in Fig. 5(b). When the process of S420 is completed, the rendering request data reception process ends.

[0046] If it is determined in S419 that the CG object indicated by the received view request data is not to be rendered at high resolution, the rendering request data receiving process ends without performing S420.

[0047] In this embodiment, the receiving information processing device 100a may be configured not to perform the determination of S419. In such a configuration, the receiving information processing device 100a receives view request data including information of a CG object specified by a sending user operating the sending information processing device 100b, and renders the CG object indicated by the view request data at high resolution. This allows the receiving user to view the CG object specified by the sending user participating in the AR / MR content at a sufficient level of detail.

[0048] Furthermore, in the above-described embodiment, if the sending user is a specific user, the CG object indicated by the received viewing request data is rendered in high resolution, allowing the receiving user to view the CG object designated by the specific user participating in the AR / MR content with sufficient detail.

[0049] In this embodiment, the drawing control in S420 is not limited to the above-mentioned process. For example, when the distance between the receiving user and the CG object indicated by the viewing request data is equal to or greater than a first threshold value set in advance, in S420, a two-dimensional image including an image of the CG object drawn in high resolution may be displayed in a position that is easy for the receiving user to view. Specifically, as shown in FIG. 6(a), a two-dimensional panel image 601 including an image of the CG object 503 drawn in high resolution is displayed near the receiving user. By controlling in this way, when a CG object that is relatively far from the receiving user is specified by the sending user, the receiving user can view the CG object with sufficient detail.

[0050] Furthermore, in this embodiment, if the CG object indicated by the viewing request data is outside the background image displayed on display unit 108a, an image indicating that this CG object is outside the background image may be displayed in S420. Specifically, as shown in Fig. 6(b), a two-dimensional panel image 602 including an image of CG object 503 rendered at high resolution and indicating that CG object 503 is outside the background image is displayed on display unit 108a. By controlling in this manner, the receiving user can know that the CG object specified by the sending user is outside the background image.

[0051] In addition, in this embodiment, in S420, the CG object indicated by the browsing request data may be rendered at a high resolution, and CG objects other than this CG object may be rendered at a low resolution, thereby relatively increasing the visibility of the CG object indicated by the browsing request data.

[0052] In addition, in this embodiment, the sending user may be highlighted on the display unit 108a of the receiving information processing device 100a, allowing the receiving user to know from which user participating in the AR / MR content the viewing request data has been sent.

[0053] Next, an information processing apparatus and a control method thereof according to a second embodiment of the present invention will be described.

[0054] The second embodiment is basically the same as the first embodiment in terms of configuration and operation, but differs from the first embodiment in that the rendering of a CG object is controlled by taking into account the position of a physical object ascertained from a background image. Therefore, a description of the overlapping configuration and operation will be omitted, and the different configuration and operation will be described below.

[0055] 7 is a block diagram showing a schematic configuration of software modules of the information processing device 100a on the receiving side in the second embodiment. The information processing device 100a includes, as software modules, the above-mentioned virtual space control unit 301, user information acquisition unit 302, operation information acquisition unit 303, line-of-sight information acquisition unit 304, background image acquisition unit 305, and CG information acquisition unit 306. The information processing device 100a also includes the above-mentioned position information acquisition unit 307, browsing request reception unit 308, user preference acquisition unit 309, determination unit 310, and drawing control unit 311. The information processing device 100a further includes a real space grasping unit 701. The processing of the above-mentioned software modules is realized by the CPU 101a of the information processing device 100a executing a program stored in the ROM 102a or the like.

[0056] The real space grasping unit 701 performs spatial depth estimation and object recognition based on a background image generated by shooting with the background display image camera of the shooting unit 107a and a tracking image generated by shooting with the tracking camera of the shooting unit 107a. The tracking image is an image with a wider angle of view than the background image. The real space grasping unit 701 recognizes physical objects existing in the real space by spatial depth estimation and object recognition, and acquires real space information including information indicating the shape, position, and type of the recognized physical object.

[0057] Fig. 8 is a flow chart showing the procedure of the browsing request data receiving process executed by the information processing device 100a on the receiving side in the second embodiment. The browsing request data receiving process in Fig. 8 is similar to the browsing request data receiving process in Fig. 4B described above, and the following will particularly explain the contents different from the browsing request data receiving process in Fig. 4B described above. The browsing request data receiving process in Fig. 8 is also realized by the CPU 101a of the information processing device 100a executing a program stored in the ROM 102a or the like, similar to the browsing request data receiving process in Fig. 4B described above.

[0058] 8, first, the CPU 101a performs the processes of S411 to S415 described above. Next, the CPU 101a acquires from the image capturing unit 107a a background image generated by capturing with the background display image camera and a tracking image generated by capturing with the tracking camera (S801). Next, the CPU 101a performs the process of S417 described above. Next, the CPU 101a performs space depth estimation and object recognition based on the background image and tracking image acquired in S801, and acquires real space information (S802).

[0059] Next, the CPU 101a judges whether or not to render the CG object indicated by the view request data received in S411 in high resolution (S803). In S803, for example, similar to the above-mentioned S419, if it is determined from the sending user information included in the view request data that the sending user is a specific user who has a close relationship with the receiving user, such as a friend of the receiving user, it is judged that the CG object is rendered in high resolution. On the other hand, if it is determined from the sending user information included in the view request data that the sending user is not a specific user, it is judged that the CG object is not rendered in high resolution. Note that, at least before the judgment in S803 is made, the above-mentioned S418 may be performed, and the judgment in S803 may be made using the sending user information and the receiving user preference information acquired in S418, similar to the above-mentioned S419.

[0060] If it is determined in S803 that the CG object indicated by the received view request data is not to be rendered at high resolution, the view request data reception process ends.

[0061] If it is determined in S803 that the CG object indicated by the received view request data is to be rendered at high resolution, the view request data reception process proceeds to S804. In S804, the CPU 101a determines whether or not a physical object exists in front of the CG object indicated by the view request data from the viewpoint of the receiving user in the virtual space, based on the real space information acquired in S802.

[0062] If it is determined in S804 that a physical object exists in front of the CG object indicated by the view request data from the receiving user's viewpoint in the virtual space, the CPU 101a determines whether the receiving user and the physical object are close to each other (S805).

[0063] In S805, if the distance between the receiving user and the physical object is less than a preset second threshold, it is determined that the distance between the receiving user and the physical object is short. In this case, the view request data reception process proceeds to S806. In S806, the CPU 101a displays on the display unit 108a a two-dimensional panel image including an image of the CG object indicated by the view request data, which is rendered at high resolution, in a position in front of the CG object indicated by the view request data, so as not to be hidden by the physical object. Here, the rendering control in S806 will be described with reference to FIG. 9(a) and FIG. 9(b).

[0064] Fig. 9(a) is a diagram showing an example of an AR / MR image from the receiving user's viewpoint before receiving the viewing request data. 502 represents a sending user participating in the AR / MR content. 503 represents a CG object specified by the sending user 502. 901 represents another user participating in the AR / MR content. In Fig. 9(a), a user 901, which is a physical object, exists in front of the CG object 503 from the receiving user's viewpoint, and part of the CG object 503 is hidden by the user 901.

[0065] Fig. 9(b) is a diagram showing an example of an AR / MR image from the receiving user's viewpoint after the process of S806 is performed. If it is determined in S805 that the receiving user is close to the user 901, which is a physical object, in S806, a two-dimensional panel image 902 including an image of a CG object 503 rendered at high resolution is displayed in a position where it is not hidden by the user 901, as shown in Fig. 9(b). By displaying such a two-dimensional panel image 902, the receiving user can know the whole image of the CG object 503 specified by the sending user 502. When the process of S806 is completed, the viewing request data receiving process ends.

[0066] In S805, if the distance between the receiving user and the physical object is equal to or greater than the second threshold, it is determined that the distance between the receiving user and the physical object is not close. In this case, the browse request data reception process proceeds to S807. In S807, the CPU 101a applies image processing to the background image to erase the physical object in front of the CG object indicated by the browse request data from the background image. Next, the CPU 101a draws the CG object indicated by the browse request data with high resolution on the background image from which the physical object has been erased (S808). Here, the control of S807 and S808 will be described with reference to FIG. 9(c). In S805, if it is determined that the distance between the receiving user and the user 901, which is a physical object, is not close, the CPU 101a applies image processing to the background image to erase the user 901 in front of the CG object 503 from the background image. In addition, the CPU 101a draws the CG object 503 with high resolution on this background image (see FIG. 9(c)). By performing such drawing control, the receiving user can view the CG object 503 specified by the sending user 502 with sufficient detail. Also, since the physical object that is erased from the background image by image processing does not exist at least near the receiving user, there is no risk of the receiving user bumping into the physical object without noticing it. When S808 is completed, the viewing request data receiving process ends.

[0067] If it is determined in S804 that no physical object exists in front of the CG object indicated by the view request data, the CPU 101a determines whether the receiving user is close to the physical object (S809).

[0068] In S809, if the distance between the receiving user and the physical object is, for example, less than the second threshold, it is determined that the receiving user is close to the physical object. In this case, the browsing request data receiving process proceeds to S808. That is, in this embodiment, if the distance between the receiving user and a physical object located behind the CG object indicated by the browsing request data is less than the second threshold, the CG object is rendered at a high resolution. Thereafter, the browsing request data receiving process ends.

[0069] In S809, if the distance between the receiving user and the physical object is, for example, equal to or greater than the second threshold, it is determined that the distance between the receiving user and the physical object is not close. In this case, the browsing request data receiving process proceeds to S810. In S810, the CPU 101a determines the displayable area searched based on the real space information as the drawing position of the CG object indicated by the browsing request data. The displayable area is an area that is easy for the receiving user to see, for example, an area where the CG object is not hidden by a physical object and the receiving user can visually recognize the CG object. Next, the browsing request data receiving process proceeds to S808, where the CPU 101a draws the CG object indicated by the browsing request data in the displayable area at high resolution. Here, the control of S810 and S808 will be described with reference to FIG. 10(a) and FIG. 10(b).

[0070] Fig. 10(a) is a diagram showing an example of an AR / MR image from the viewpoint of a receiving user before receiving the viewing request data. In Fig. 10(a), a CG object 503 specified by a sending user 502 is drawn at a position that is at least the second threshold away from the receiving user.

[0071] FIG. 10(b) is a diagram showing an example of an AR / MR image from the receiving user's viewpoint after the process of S810 is performed. In FIG. 10(b), the CG object 503 is rendered at high resolution in a displayable area 1001 searched for based on real space information. The displayable area 1001 is an area that is easy for the receiving user to see, specifically, an area in which the receiving user can visually recognize the CG object 503 without the CG object 503 being hidden by physical objects such as the sending user 502 and the user 1002. By rendering the CG object 503 in such a displayable area 1001, the receiving user can easily grasp the details of the CG object 503. When S808 is completed, the viewing request data reception process ends.

[0072] In the second embodiment, a tracking image may be used to render a CG object indicated by the viewing request data.

[0073] Fig. 11 is a flow chart showing another procedure of the browsing request data receiving process executed by the information processing device 100a on the receiving side in the second embodiment. The browsing request data receiving process in Fig. 11 is similar to the browsing request data receiving process in Fig. 8 described above, and the following will particularly explain the contents different from the browsing request data receiving process in Fig. 8 described above. The browsing request data receiving process in Fig. 11 is also realized by the CPU 101a of the information processing device 100a executing a program stored in the ROM 102a or the like, like the browsing request data receiving process in Fig. 8 described above.

[0074] In FIG. 11, first, the above-mentioned processes of S411 to S415, S801, S417, S802, and S803 are performed.

[0075] If it is determined in S803 that the CG object indicated by the received view request data is not to be rendered at high resolution, the view request data reception process ends.

[0076] If it is determined in S803 that the CG object indicated by the received view request data is to be rendered at a high resolution, the view request data reception process proceeds to S1101.

[0077] In S1101, the CPU 101a judges whether the drawing position of the CG object indicated by the browse request data is outside the background image. If it is judged in S1101 that the drawing position of the CG object indicated by the browse request data is not outside the background image but is inside the background image, the CPU 101a draws the CG object indicated by the browse request data at high resolution (S1102). Then, the browse request data reception process ends.

[0078] When it is determined in S1101 that the drawing position of the CG object indicated by the viewing request data is outside the background image, the CPU 101a determines whether or not the drawing position of the CG object indicated by the viewing request data is outside the tracking image (S1103). Note that in this embodiment, the determination in S1103 may be performed using a plurality of tracking images captured by a plurality of tracking cameras provided in the imaging unit 107a.

[0079] If it is determined in S1103 that the rendering position of the CG object indicated by the viewing request data is not outside the tracking image but is inside the tracking image, the viewing request data reception process proceeds to S1104. In S1104, the CPU 101a causes the display unit 108a to display a two-dimensional panel image 1201 including an image of the CG object 503 rendered at high resolution and a peripheral image of the CG object 503, as shown in Fig. 12. The peripheral image of the CG object 503 is, for example, an image cut out from the tracking image. Thereafter, the viewing request data reception process ends.

[0080] If it is determined in S1103 that the drawing position of the CG object indicated by the viewing request data is outside the tracking image, the viewing request data reception process proceeds to S1105. In S1105, CPU 101a causes display unit 108a to display two-dimensional panel image 602. Two-dimensional panel image 602 includes an image of CG object 503 drawn at high resolution, but does not include an image of the periphery of CG object 503. Thereafter, the viewing request data reception process ends.

[0081] In the above-described embodiment, when the drawing position of a CG object indicated by the received viewing request data is outside the background image and within the tracking image, a two-dimensional panel image 1201 is displayed. The two-dimensional panel image 1201 includes an image of the CG object drawn at high resolution and an image of the CG object's surroundings based on the tracking image. This allows the receiving user to check the surrounding environment of the CG object and details of the CG object when the drawing position of the specified CG object is outside the background image.

[0082] Next, an information processing device and a control method thereof according to a third embodiment of the present invention will be described.

[0083] The third embodiment is basically the same as the first and second embodiments in terms of configuration and operation, but differs from the first and second embodiments in that the rendering of a CG object is controlled based on the state of the receiving user. Therefore, a description of the overlapping configuration and operation will be omitted, and the different configuration and operation will be described below.

[0084] 13 is a block diagram showing a schematic configuration of software modules of the information processing device 100a on the receiving side in the third embodiment. The information processing device 100a includes the above-mentioned virtual space control unit 301, user information acquisition unit 302, operation information acquisition unit 303, gaze information acquisition unit 304, background image acquisition unit 305, and CG information acquisition unit 306 as software modules. The information processing device 100a also includes the above-mentioned position information acquisition unit 307, browsing request reception unit 308, user preference acquisition unit 309, determination unit 310, and drawing control unit 311. The information processing device 100a further includes a content concentration score calculation unit 1301, a CG object interest score calculation unit 1302, and a motion prediction unit 1303. The processing of the above-mentioned software modules is realized by the CPU 101a of the information processing device 100a executing a program stored in the ROM 102a or the like.

[0085] The content concentration score calculation unit 1301 calculates a content concentration score by scoring the degree of concentration of the receiving user on the AR / MR content. The CG object interest score calculation unit 1302 calculates a CG object interest score by scoring the degree of interest of the receiving user in the CG object. The movement prediction unit 1303 predicts the next movement of the receiving user based on the position and orientation information acquired from the position information acquisition unit 307 and the past movement information of the receiving user.

[0086] Fig. 14 is a flow chart showing the procedure of the browsing request data receiving process executed by the information processing device 100a on the receiving side in the third embodiment. The browsing request data receiving process in Fig. 14 is similar to the browsing request data receiving process in Fig. 4B described above, and the following will particularly explain the contents different from the browsing request data receiving process in Fig. 4B described above. The browsing request data receiving process in Fig. 14 is also realized by the CPU 101a of the information processing device 100a executing a program stored in the ROM 102a or the like, similar to the browsing request data receiving process in Fig. 4B described above.

[0087] 14, first, the above-mentioned processes of S411 to S418 are performed. Next, the CPU 101a predicts the next movement of the receiving user (S1401). In S1401, for example, the next movement of the receiving user is predicted using an extended Kalman filter or the like from the position and orientation information acquired in S417 and the past movement information of the receiving user.

[0088] Next, the CPU 101a calculates the content concentration score of the receiving user using the input information acquired in S414, the gaze information acquired in S415, and further the voice information of the receiving user (S1402). For example, as shown in FIG. 15(a), when the receiving user is operating a CG object or talking with another person, it is determined that the receiving user is currently working on the AR / MR content, and the content concentration score is set to "high". On the other hand, when the receiving user is viewing a CG object or taking a stroll, it is determined that the receiving user is not currently working on the AR / MR content, and the content concentration score is set to "low". Note that time information may be added to the content concentration score. For example, when the receiving user is not operating a CG object or talking with another person for a predetermined time, the content concentration score is set to "low".

[0089] Next, the CPU 101a calculates the receiving user's CG object interest score based on the viewing request data received in S411, the receiving user information acquired in S413, the position and orientation information acquired in S417, the receiving user preference information acquired in S418, etc. (S1403).

[0090] In S1403, the CG object interest score is calculated based on the positional relationship between the CG object indicated by the viewing request data and the receiving user. For example, as shown in Fig. 15(b), if the CG object indicated by the viewing request data is within the viewing field of the receiving user and is close to the receiving user, the CG object is easy for the receiving user to view. In such a case, the CG object interest score is set to the highest value, "high."

[0091] If the CG object indicated by the viewing request data is within the viewing field of the receiving user but is far from the receiving user, there is a concern that the CG object may be difficult for the receiving user to view. For this reason, the CG object interest score is set to "medium," which is lower than "high." Also, if the CG object indicated by the viewing request data is outside the viewing field of the receiving user but is close to the receiving user, the CG object interest score is set to "medium."

[0092] If the CG object indicated by the viewing request data is outside the field of view of the receiving user and is far away from the receiving user, the CG object will be difficult for the receiving user to view, and the CG object interest score will be set to the lowest "low" level.

[0093] In addition, in S1403, the CG object interest score is calculated based on the relationship between the receiving user and the sending user. For example, as shown in FIG. 15(c), if the receiving user and the sending user are friends, the relationship is easy to communicate with each other, so the CG object interest score is set to "high". If the receiving user and the sending user are not friends but have similar hobbies, the relationship is relatively easy to communicate with each other, so the CG object interest score is set to "medium". If the receiving user and the sending user are not friends but have different hobbies, the CG object interest score is set to "low". In this embodiment, weights indicating the importance of the positional relationship between the CG object and the receiving user indicated by the viewing request data and the relationship between the receiving user and the sending user are set, and it is possible to control which of these is more important in the calculation of the CG object interest score. For example, when a weight is set to increase the importance of the relationship between the receiving user and the sending user, the CG object interest score calculated based on the relationship between the receiving user and the sending user is used. The weights are set, for example, by the receiving user.

[0094] Next, the CPU 101a judges whether or not to render the CG object indicated by the browsing request data in high resolution based on the content concentration score calculated in S1402 and the CG object interest score calculated in S1403 (S1404). In S1404, for example, if the content concentration score is "high", the receiving user is working and is not in a state in which the CG object indicated by the browsing request data can be viewed, so it is judged that the CG object is not rendered in high resolution. Also, if the CG object interest score indicating the degree of interest of the receiving user in the CG object indicated by the browsing request data is "medium" or "high", it is judged that the CG object is rendered in high resolution. In this embodiment, weights indicating the importance of each of the content concentration score and the CG object interest score may be set, and it may be controlled which of these is to be given more importance in the judgment in S1404. In this embodiment, the weights may be set by the receiving user. Also, the weights may be controlled based on the predicted value of the next movement of the receiving user predicted in S1401. For example, if it is determined from a predicted value of the receiving user's next movement that the CG object indicated by the viewing request data will be within the receiving user's field of view, the weight is set to increase the importance of the CG object interest score.

[0095] If it is determined in S1404 that the CG object indicated by the view request data is not to be rendered at high resolution, the rendering request data receiving process ends.

[0096] If it is determined in S1404 that the CG object indicated by the view request data is to be rendered at high resolution, the CPU 101a renders the CG object indicated by the view request data at high resolution (S1405), and the rendering request data receiving process ends.

[0097] In the above-described embodiment, whether or not to render a CG object indicated by the browsing request data in high resolution is controlled based on the content concentration score and the CG object interest score. This makes it possible to appropriately control whether or not to render a CG object indicated by the browsing request data in high resolution using the scored content concentration score and CG object interest score.

[0098] In this embodiment, the receiving information processing device 100a may include a destination determination unit 207, a view request data creation unit 209, and a view request data transmission unit 210. This allows the receiving information processing device 100a to transmit view request data, thereby enabling the user operating the receiving information processing device 100a to convey to other users the CG objects that he or she would like to see.

[0099] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0100] The disclosure of this embodiment includes the following configurations and methods. (Configuration 1) An information processing device that draws CG objects in a virtual space in virtual space experience content in which multiple people can participate, comprising: a means for receiving viewing request data including information of a CG object specified by a user operating another information processing device; and a means for controlling the drawing of the CG object in the virtual space, wherein the means for controlling the drawing draws the CG object indicated by the received viewing request data at a second resolution higher than a first resolution. (Configuration 2) An information processing device as described in Configuration 1, further comprising: a means for creating viewing request data including information of a CG object specified by a user operating the information processing device; a means for determining a destination to which the created viewing request data is to be sent; and a means for sending the created viewing request data to the determined destination. (Configuration 3) An information processing device as described in Configuration 2, further comprising a means for acquiring information indicating the line of sight of a user operating the information processing device, wherein the means for determining the destination for sending the created browsing request data determines the destination for sending the created browsing request data based on the information indicating the line of sight of the user operating the information processing device. (Configuration 4) An information processing device as described in configuration 2 or 3, further comprising a means for estimating a position and posture of a user operating the information processing device, wherein the created browsing request data further includes information indicating a position and posture of the user operating the information processing device. (Configuration 5) An information processing device according to any one of configurations 2 to 4, further comprising a means for acquiring status information of a candidate destination for transmission of the created browsing request data, and a means for controlling the display of a notification indicating whether or not the created browsing request data can be transmitted to the candidate destination. (Configuration 6) An information processing device described in any one of configurations 1 to 5, further comprising a means for controlling the display of a two-dimensional image including an image of the CG object drawn at the second resolution when the distance between a user operating the information processing device and the CG object indicated by the received viewing request data is equal to or greater than a first threshold. (Configuration 7) The information processing device according to configuration 6, wherein the display control means displays the two-dimensional image in a position in the virtual space that is easy to view for a user operating the information processing device. (Configuration 8) An information processing device according to any one of configurations 1 to 7, further comprising: a means for capturing a background image that serves as the background of the virtual space; and a means for controlling, when a CG object indicated by the received viewing request data is outside the background image, to display a two-dimensional image including an image of the CG object rendered at the second resolution, the two-dimensional image indicating that the CG object is outside the background image. (Configuration 9) An information processing device described in any one of configurations 1 to 8, characterized in that the means for controlling the drawing draws a CG object indicated by the received viewing request data at the second resolution, and draws other objects other than the object at the first resolution. (Configuration 10) An information processing device described in any one of configurations 1 to 9, characterized in that the means for controlling the drawing draws a CG object indicated by the received viewing request data at the second resolution when the user operating the other information processing device is a specific user. (Configuration 11) The information processing device described in configuration 10, wherein the received viewing request data further includes information regarding a user operating the other information processing device, and it is determined whether the user operating the other information processing device is the specific user based on the information regarding the user operating the other information processing device. (Configuration 12) The information processing device described in Configuration 11, further comprising a means for acquiring user preference information indicating attributes of high interest to the user operating the information processing device, and determining whether the user operating the other information processing device is the specific user based on information regarding the user operating the other information processing device and the user preference information. (Configuration 13) An information processing device according to any one of configurations 1 to 12, characterized in that when multiple viewing request data are received in which the specified CG objects are different, the means for controlling the drawing draws, at the second resolution, CG objects among the multiple CG objects corresponding respectively to the multiple viewing request data, whose position similarity and / or attribute similarity is equal to or greater than a predetermined value. (Configuration 14) The information processing device according to any one of configurations 1 to 13, further comprising a control unit for highlighting in the virtual space a user who has instructed the transmission of the received browsing request data. (Configuration 15) An information processing device described in any one of configurations 1 to 14, further comprising: a means for capturing a background image that serves as the background of the virtual space; a means for capturing a tracking image having a wider angle of view than the background image; a means for recognizing a physical object based on the background image and the tracking image; and a means for controlling the display of a two-dimensional image including an image of the CG object indicated by the received viewing request data drawn at the second resolution at a position that does not overlap with the physical object when the physical object is present in front of a CG object indicated by the received viewing request data from the viewpoint of a user operating the information processing device in the virtual space and the distance between the user operating the information processing device and the physical object is less than a second threshold. (Configuration 16) An information processing device as described in configuration 15, characterized in that when the physical object is present in front of a CG object indicated by the received viewing request data from the viewpoint of a user operating the information processing device in the virtual space and the distance between the user operating the information processing device and the physical object is greater than or equal to the second threshold, the background image is processed to erase the physical object and the CG object is rendered in high resolution. (Configuration 17) An information processing device as described in configuration 15 or 16, characterized in that when the physical object is not present in front of the CG object indicated by the received viewing request data from the viewpoint of a user operating the information processing device in the virtual space and the distance between the user operating the information processing device and the physical object is greater than or equal to the second threshold, the means for controlling the drawing draws the CG object indicated by the received viewing request data at high resolution in an area that is easy to see for the user operating the information processing device. (Configuration 18) An information processing device described in any one of configurations 1 to 17, further comprising: a means for photographing a background image that serves as the background of the virtual space; a means for photographing a tracking image having a wider angle of view than the background image; and, when the drawing position of a CG object indicated by the received viewing request data is outside the background image and within the tracking image, a control means for controlling the display of a two-dimensional image including an image of the CG object indicated by the received viewing request data drawn at the second resolution and a peripheral image of the CG object based on the tracking image. (Configuration 19) An information processing device described in any one of configurations 1 to 18, further comprising a means for calculating a concentration score indicating the degree of concentration of a user operating the information processing device on the virtual space experience content, and a means for calculating an interest score indicating the degree of interest of a user operating the information processing device in a CG object indicated by the viewing request data, wherein the means for controlling the drawing controls whether or not to draw the CG object indicated by the viewing request data at the second resolution based on the concentration score and the interest score. (Configuration 20) The information processing device according to configuration 19, further comprising means for controlling the weights of the concentration score and the interest score. (Configuration 21) An information processing device as described in Configuration 20, further comprising a means for predicting the next movement of a user operating the information processing device, wherein the means for controlling the weight controls the weight based on a predicted value by the predicting means. [Explanation of symbols]

[0101] 100a Information processing device 101a CPU 106a Sensor section 107a Photography Department 108a Display section 109a Communication I / F 207 Destination Determination Unit 209 Viewing Request Data Creation Department 210 View request data transmission unit 301 Virtual space control section 302 User information acquisition unit 303 Operation information acquisition unit 304 Gaze information acquisition unit 305 Background image acquisition unit 306 CG information acquisition department 307 Location information acquisition unit 308 Viewing request receiving unit 309 User Preference Acquisition Unit 310 Judgment section 311 Drawing control unit 500 Destination status notification 503 CG Objects 601, 602, 902, 1201 2D panel images 701 Real Space Grasping Department 1301 Content concentration score calculation unit 1302 CG object interest score calculation unit 1303 Motion Estimation Unit

Claims

1. An information processing device that renders CG objects in a virtual space in virtual space experience content that can be participated in by multiple people, a means for receiving view request data including information on a CG object designated by a user who operates another information processing device; a means for controlling drawing of a CG object in the virtual space, The information processing apparatus, wherein the means for controlling rendering renders the CG object indicated by the received view request data at a second resolution higher than a first resolution.

2. a means for generating view request data including information on a CG object designated by a user who operates the information processing device; A means for determining a destination of the created browsing request data; 2. The information processing apparatus according to claim 1, further comprising: a means for transmitting the created browse request data to the determined destination.

3. The information processing device further includes a means for acquiring information indicating a line of sight of a user who operates the information processing device, 3. The information processing apparatus according to claim 2, wherein the means for determining the destination determines the destination of the created browse request data on the basis of information indicating a line of sight of a user operating the information processing apparatus.

4. The information processing device further includes a means for estimating a position and orientation of a user who operates the information processing device, The information processing apparatus according to claim 2 , wherein the created browsing request data further includes information indicating a position and orientation of a user who is operating the information processing apparatus.

5. means for acquiring status information of a candidate destination for the created browsing request data; 3. The information processing apparatus according to claim 2, further comprising a control unit for controlling display of a notification indicating whether the created browse request data can be transmitted to the candidate destination.

6. The information processing device according to claim 1, further comprising a means for controlling the display of a two-dimensional image including an image of the CG object drawn at the second resolution when a distance between a user operating the information processing device and the CG object indicated by the received viewing request data is equal to or greater than a first threshold value.

7. 7. The information processing apparatus according to claim 6, wherein said display control means displays said two-dimensional image at a position in said virtual space that is easily viewable by a user operating said information processing apparatus.

8. A means for taking a picture of a background image that forms a background of the virtual space; and a control unit for controlling the display of a two-dimensional image including an image of the CG object rendered at the second resolution when the CG object indicated by the received viewing request data is outside the background image, the two-dimensional image indicating that the CG object is outside the background image.

9. 2. The information processing apparatus according to claim 1, wherein the means for controlling drawing draws a CG object indicated by the received view request data at the second resolution, and draws objects other than the object at the first resolution.

10. The information processing device according to claim 1, characterized in that the means for controlling drawing draws the CG object indicated by the received viewing request data at the second resolution when the user operating the other information processing device is a specific user.

11. the received browsing request data further includes information regarding a user who operates the other information processing device, 11. The information processing apparatus according to claim 10, wherein it is determined whether or not a user operating the other information processing apparatus is the specific user based on information about a user operating the other information processing apparatus.

12. The information processing device further includes a means for acquiring user preference information indicating an attribute that is of high interest to a user who operates the information processing device, 12. The information processing apparatus according to claim 11, wherein it is determined whether or not the user operating the other information processing apparatus is the specific user based on information about the user operating the other information processing apparatus and the user preference information.

13. The information processing device according to claim 1, characterized in that when a plurality of viewing request data are received in which the specified CG objects are different, the means for controlling the drawing draws, at the second resolution, CG objects among the plurality of CG objects corresponding respectively to the plurality of viewing request data, whose position similarity and / or attribute similarity is equal to or greater than a predetermined value.

14. 2. The information processing apparatus according to claim 1, further comprising a control unit for controlling a display of the user who has instructed the transmission of the received browse request data in a highlighted manner in the virtual space.

15. A means for taking a picture of a background image that forms a background of the virtual space; a means for capturing a tracking image having a wider angle of view than the background image; means for recognizing a physical object based on the background image and the tracking image; The information processing device according to claim 1, further comprising a control means for controlling the display of a two-dimensional image including an image of the CG object indicated by the received viewing request data drawn at the second resolution in a position that does not overlap with the physical object when the physical object is present in front of the CG object indicated by the received viewing request data from the viewpoint of a user operating the information processing device in the virtual space and the distance between the user operating the information processing device and the physical object is less than a second threshold.

16. The information processing device of claim 15, characterized in that when the physical object is present in front of the CG object indicated by the received viewing request data from the viewpoint of a user operating the information processing device in the virtual space and the distance between the user operating the information processing device and the physical object is equal to or greater than the second threshold, image processing is applied to the background image to erase the physical object and the CG object is rendered at high resolution.

17. The information processing device described in claim 15, characterized in that when the physical object is not present in front of the CG object indicated by the received viewing request data from the viewpoint of the user operating the information processing device in the virtual space and the distance between the user operating the information processing device and the physical object is greater than or equal to the second threshold, the means for controlling drawing draws the CG object indicated by the received viewing request data at high resolution in an area that is easy to see for the user operating the information processing device.

18. A means for taking a picture of a background image that forms a background of the virtual space; a means for capturing a tracking image having a wider angle of view than the background image; The information processing device described in claim 1, further comprising a means for controlling the display of a two-dimensional image including an image of the CG object indicated by the received viewing request data drawn at the second resolution and a peripheral image of the CG object based on the tracking image when the drawing position of the CG object indicated by the received viewing request data is outside the background image and within the tracking image.

19. A means for calculating a concentration score indicating a degree of concentration of a user operating the information processing device on the virtual space experience content; a calculation unit for calculating an interest score indicating a degree of interest of a user who operates the information processing device in the CG object indicated by the browsing request data, 2. The information processing apparatus according to claim 1, wherein the means for controlling rendering controls whether or not to render the CG object indicated by the browsing request data at the second resolution based on the concentration score and the interest score.

20. 20. The apparatus of claim 19, further comprising means for controlling the weighting of each of the focus score and the interest score.

21. The information processing device further includes a predicting unit for predicting a next movement of a user who operates the information processing device, 21. The information processing apparatus according to claim 20, wherein said weight control means controls said weight based on a predicted value by said predicting means.

22. A method for controlling an information processing device that renders a CG object in a virtual space in virtual space experience content in which multiple people can participate, comprising: receiving a browsing request data including information of a CG object designated by a user who operates another information processing device; and controlling the rendering of a CG object in the virtual space, The control method for an information processing apparatus, wherein the step of controlling rendering comprises rendering the CG object indicated by the received view request data at a second resolution higher than a first resolution.

23. A program for causing a computer to execute a control method for an information processing device that renders a CG object in a virtual space in virtual space experience content in which multiple people can participate, comprising: The method for controlling the information processing device includes: receiving a browsing request data including information of a CG object designated by a user who operates another information processing device; and controlling the rendering of a CG object in the virtual space, The program, wherein the step of controlling rendering includes rendering the CG object indicated by the received view request data at a second resolution higher than the first resolution.

Images