Program, information processing device, and information processing method

Abstract

To provide a program, an information processing apparatus, and an information processing method capable of disclosing data recorded in a real space to a plurality of disclosure destinations in different disclosure modes, respectively, when the recorded data is used in a virtual space on a network.SOLUTION: A program causes a computer to implement: acquisition means which acquires first record data generated by recording the experience of a first user in a real space or a first virtual space; setting means which sets a plurality of disclosure destinations in the first virtual space; receiving means which receives, from a first user device of the first user, editing on the first record data for each of the multiple disclosure destinations; processing means which processes first virtual spatial data for generating the first virtual space, for each of the multiple disclosure destinations, on the basis of at least a part of the edited first record data; and output means which outputs the processed first virtual space to devices corresponding to the multiple disclosure destinations, respectively.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to a program, an information processing device, and an information processing method. [Background technology]

[0002] Conventionally, there is a technology for processing a user's virtual space based on image data such as a user's photograph or video recorded in real space, or data such as the user's position data (hereinafter also referred to as "recorded data") when displaying the virtual space. For example, Patent Document 1 listed below discloses a display control device that displays a virtual image by combining it with an image captured by a capturing means in real space, and processes the virtual image based on movement information related to the movement of the capturing means. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2018 / 179176 Summary of the Invention [Problem to be solved by the invention]

[0004] When a user makes his / her recorded data public on a network, it is required to use different modes of disclosure for each of multiple recipients, such as family, friends, the general public, etc., from the viewpoint of security or personal information protection, etc. However, with the above-mentioned conventional technology, in the virtual space, images taken in the real space and virtual images processed using movement information are disclosed in a uniform manner to multiple recipients.

[0005] Therefore, in order to solve the above problem, the present invention aims to provide a program, an information processing device, and an information processing method that can use different publishing modes for each of multiple publishing destinations when using recorded data from real space in a virtual space on a network. [Means for solving the problem]

[0006] A program according to one embodiment of the present invention causes a computer to implement an acquisition means for acquiring first recorded data that records a first user's experience in real space or a first virtual space; a setting means for setting multiple publication destinations in the first virtual space; a receiving means for receiving edits of the first recorded data from the first user device of the first user for each of the multiple publication destinations; a processing means for processing first virtual space data for each of the multiple publication destinations based on at least a portion of the edited first recorded data, the first virtual space data being used to generate the first virtual space; and an output means for outputting the processed first virtual space to a device corresponding to each of the multiple publication destinations.

[0007] An information processing device according to one embodiment of the present invention includes an acquisition unit that acquires first recorded data that records a first user's experience in real space or a first virtual space; a setting unit that sets multiple publication destinations in the first virtual space; a reception unit that receives edits of the first recorded data from the first user device of the first user for each of the multiple publication destinations; a processing unit that processes first virtual space data for each of the multiple publication destinations based on at least a portion of the edited first recorded data, the first virtual space data being for generating the first virtual space; and an output unit that outputs the processed first virtual space to a device corresponding to each of the multiple publication destinations.

[0008] An information processing method according to one embodiment of the present invention includes a computer acquiring first recorded data that records a first user's experience in real space or a first virtual space, setting multiple destinations in the first virtual space, accepting edits of the first recorded data for each of the multiple destinations from the first user device of the first user, processing first virtual space data for each of the multiple destinations based on at least a portion of the edited first recorded data, the first virtual space data being used to generate the first virtual space, and outputting the processed first virtual space to a device corresponding to each of the multiple destinations. [Effects of the Invention]

[0009] According to the present invention, when using recorded data from a real space in a virtual space on a network, it is possible to use different disclosure modes for each of a plurality of disclosure destinations. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram illustrating an example of the system configuration of a VR system according to an embodiment of the present invention. [Figure 2] FIG. 1 is a diagram for explaining an overview of a VR system according to an embodiment of the present invention. [Figure 3] FIG. 1 is a diagram for explaining an overview of a VR system according to an embodiment of the present invention. [Figure 4] FIG. 1 is a diagram for explaining an overview of a VR system according to an embodiment of the present invention. [Figure 5] FIG. 2 is a diagram illustrating an example of a functional configuration of a server device according to the present embodiment. [Figure 6] FIG. 10 is a diagram illustrating an example of the operation of the server device according to the embodiment. [Figure 7] FIG. 2 is a diagram illustrating an example of a hardware configuration of a server device according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] A preferred embodiment of the present invention (hereinafter referred to as "the present embodiment") will be described with reference to the accompanying drawings. In the drawings, components with the same reference numerals have the same or similar configurations.

[0012] In this invention, the terms "unit," "means," "device," or "system" do not simply mean physical means, but also include cases where the functions of the "unit," "means," "device," or "system" are realized by software. Furthermore, the functions of one "unit," "means," "device," or "system" may be realized by a combination of two or more physical means, devices, or software modules, and the functions of two or more "units," "means," "device," or "system" may be realized by a single physical means, device, or software module.

[0013] <1. System configuration> An example of the system configuration of a VR system 1 according to this embodiment will be described with reference to Fig. 1. The VR system 1 is a system for providing a user with a virtual space using VR (Virtual Reality) technology.

[0014] The VR system 1 allows a user to simulate an experience of a user in a real space or a virtual space in a virtual space on a network. Specifically, the VR system 1 allows data (hereinafter also referred to as "recorded data") that records a user's experience in a real space or a virtual space to be reflected in the virtual space, thereby reproducing (in other words, replaying) the user's experience in the virtual space. Data that records a first user's experience in a real space or a first virtual space is also referred to as "first recorded data." Data that records a second user's experience in a real space or a second virtual space is also referred to as "second recorded data." The second recorded data may be, for example, data different from the first recorded data. Even in this case, each of the first recorded data and the second recorded data may include, for example, data that records the experiences of both the first user and the second user. In other words, the first recorded data may include data that the first user experienced but the second user did not experience, while the second recorded data may not include this data.

[0015] The recorded data may include, for example, still images or moving images (hereinafter simply referred to as "images") such as a user's photograph, or two-dimensional or three-dimensional image data, or audio data such as the user's voice. The recorded data may also include information (hereinafter also referred to as "accompanying information") that accompanies the image data or audio data. The accompanying information may include date and time information indicating the date and time when the recorded data was recorded (hereinafter also referred to as "recording date and time") and / or location information indicating the recording location (hereinafter also referred to as "recording location"). In the case of image data, for example, the accompanying information may also include information related to image quality. The information related to image quality may be, for example, the color or brightness of the image. The accompanying information may also include comment information indicating comments (including annotations) added to the image data or audio data.

[0016] 1, the VR system 1 includes a server device 100 that provides a virtual space, a first user device 200 used by a first user who plays in the virtual space, and a second user device 300 used by a second user who plays in a virtual space different from the first user. The server device 100, the first user device 200, and the second user device 300 are connected to each other via a network N. Note that the first user device 200 and the second user device 300 are also collectively referred to as "user devices" unless there is a need to particularly distinguish between them.

[0017] The network N is composed of a wireless network and a wired network. Examples of the network N include a mobile phone network, a PHS (Personal Handy-phone System) network, a wireless LAN (including a local area network and communication conforming to IEEE802.11 (so-called Wi-Fi (registered trademark))), 3G (3rd Generation), LTE (Long Term Evolution), 4G (4th Generation), 5G (5th Generation), WiMax (registered trademark), infrared communication, visible light communication, Bluetooth (registered trademark), a wired LAN, a telephone line, a power line communication network, and a network conforming to IEEE1394, etc.

[0018] [Server device] The server device 100 is an information processing device capable of communicating with a user device and an external system 500. The server device 100 is, for example, a device used by a person who operates the VR system 1 (hereinafter simply referred to as the "operator"). The server device 100 executes a predetermined program to accept edits from a user to material data including recorded data, process the virtual space based on the edits, and output the processed virtual space to the user device. This virtual space may also enable multiplayer play between multiple users, which may be a so-called metaverse. This multiplayer play may also be, for example, multiplayer play in a virtual space (e.g., a cloud game) realized on a cloud including the server device 100. In the case of a virtual space realized on a cloud, the server device 100 may be realized using streaming distribution technology, as in a so-called cloud game. With this configuration, the user device can use the virtual space via a general-purpose viewer (e.g., a web browser).

[0019] [User device] The user device is, for example, an information processing device such as a smartphone, laptop, or head-mounted display, and is capable of outputting a menu for the virtual space or recorded data to the user (hereinafter also referred to as an "editing menu"), accepting edits from the user via the output editing menu, and communicating with the server device 100.

[0020] For example, an application program dedicated to the VR system 1 (hereinafter referred to as a "VR app") may be installed in the user device as a predetermined program. The VR app may be, for example, a native app that provides each user with a user interface for using the VR system 1. The user device uses the VR app by installing it from an application store, the server device 100, or the like.

[0021] The predetermined program may be, for example, a VR app, a web browser, or a third-party app implemented using a white label provided for the VR system 1. Also, for example, the VR system 1 may be configured to use both the VR app and the web browser as user interfaces.

[0022] [External System] The external system 500 is a so-called third-party system. The external system 500 may be, for example, a system that provides external information such as information about the environment of a real space or a virtual space (hereinafter also referred to as "environmental information"). The external system 500 may be, for example, an online storage service that manages users' recorded data, an SNS service in which users' recorded data is registered, or a system that provides a homepage / blog creation service in which users' recorded data is registered.

[0023] The environmental information is, for example, information about the surrounding environment in a specific area and at a specific time in real space or virtual space. This specific time may have a range, such as a specific era. The environmental information includes, for example, weather information around a specific location, map information, city information for configuring the surrounding city (including, for example, information about structures, buildings, and / or structures in the city), and / or event information.

[0024] The environmental information may include, for example, information about a specific region and a specific era in real space or virtual space. This information about the era may include, for example, images such as photographs or videos of people or scenery in the specific region and the specific era. This information about the era may also include, for example, information about events that occurred in the specific region and the specific era. For example, the specific era may be the Edo period and the specific region may be the Nihonbashi area. In this case, the information about the era may include so-called tips information from that time, such as information about the opening of the Echigoya Kimono Store, which was located in Nihonbashi at the time, images of merchants passing through Nihonbashi, and / or information about literary works published at the time (such as the titles and authors of the works) and information about what was popular at the time. The information about the opening of the Echigoya Kimono Store may include, for example, images of the Echigoya Kimono Store and its surrounding area.

[0025] <2. Overview> An overview of the VR system 1 according to this embodiment will be described with reference to FIGS.

[0026] <2-1. Editing recorded data and processing virtual space> Referring to FIG. 2, an example of the recording data editing function and virtual space processing function provided by the VR system 1 will be described. In this example, the recording data is a photographic image D taken in real space as a record of the first user's experience. A virtual space that the first user can log in to, in other words, a virtual space that the first user can use solely by himself or in collaboration with other users, is also referred to as a "first virtual space." More specifically, the first virtual space may be a virtual space for which the first user has operation authority. This operation authority may be, for example, a creation authority (Create), a viewing authority (Read), an update authority (Update), or a deletion authority (Delete) for material data including the recording data or virtual space data. A virtual space that a second user can log in to but the first user cannot log in to is also referred to as a "second virtual space." In other words, the second virtual space is a space that the second user can use solely by himself or in collaboration with a user other than the first user. This operation authority may be set for each user by the setting unit 112 and stored in the storage unit 130 as authority information.

[0027] (1) As shown in Figure 2, the first user uploads a photo image D, which was taken in real space when the first user visited the Skytree on July 3, 2021, from the first user device 200 to the server device 100. The server device 100 acquires this uploaded photo image D.

[0028] (2) The first user can edit the photo image D for each of multiple publication destinations. These publication destinations indicate the scope of publication in the virtual space. For example, publication destinations may be set according to the relationship between the first user and other users, such as (a) private (only the first user's account can view), (b) followers / friends (accounts of users who have registered the first user's account as a follower or friend can also view), (c) friends (only the first user's account and accounts of users who have registered the first user's account as a friend can view), and (d) general (accounts of all users can view). The difference between follower registration and friend registration may be, for example, that a follower registration can be unilaterally registered by another user without the first user's approval, whereas a friend registration can only be registered after the first user approves a registration request from another user. In this example, the relationship between the first user and the second user is assumed to be friend registration.

[0029] The recorded data may be edited in the following manners, for example: (A) the recorded data itself is edited and overwritten, or the edited recorded data is newly generated as different recorded data from the pre-editing data; (B) parameters for realizing a virtual space extracted by analyzing the recorded data are edited. The parameters for realizing this virtual space (hereinafter also referred to as "VR parameters") may be, for example, polygon data and texture data for realizing a 3D virtual space, action data for controlling the movements of objects including characters, etc. In this example, in (A) above, the photographic image D itself is edited to generate the photographic image D1. On the other hand, in (B) above, VR parameters extracted by image analysis of the photographic image D are edited.

[0030] (2a) The first user edits photo image D from first user device 200 in the first private virtual space described above in (a) via an edit / processing menu, which will be described later. In this example, the first user edits photo image D by changing the first user himself / herself in photo image D into a rabbit character (a so-called avatar) and adding a pet dog character. (3a) Server device 100 accepts this edit and processes the first private virtual space based on this edit. (4a) Server device 100 outputs this processed first private virtual space to first user device 200.

[0031] (2b) The first user edits the photo image D from the first user device 200 via the edit / processing menu for the first virtual space for friends described above in (a). In this example, the first user in the photo image D is changed to a rabbit character, an umbrella object is added, and the recording date and time is changed from July 3, 2021 to June 12, 2021. (2b') In addition, in conjunction with this change in the recording date and time, weather information for the changed recording date and time is acquired from the external system 500 and reflected, changing the weather from sunny to rainy. (3b) The server device 100 accepts this editing and processes the first virtual space for friends based on the edited photo image D2. (4b) The server device 100 outputs this edited first virtual space for friends to the first user device 200 and the second user device 300 of the second user.

[0032] With the above configuration, the VR system 1 can edit the recorded data for each of the first virtual spaces, private and friend, and process the edited recorded data. Therefore, in the VR system 1, for example, the recording date and time of the photo image D can be left unchanged for private use, while the recording date and time can be edited for friend use. Therefore, in the VR system 1, when using recorded data from the real space in a virtual space on a network, it is possible to use different publishing modes for each of multiple publishing destinations.

[0033] <2-2. Overall picture of the editing and processing process> An example of the editing and processing process of the virtual space executed by the entire VR system 1 will be described with reference to Fig. 3. In this example, a VR application is used as the user IF.

[0034] <User authentication> (1) As shown in FIG. 3, the first user starts a VR application from the first user device 200 to log in to the first virtual space, and requests user authentication for the first user's user account (hereinafter also referred to as the "first user account"). The server device 100 accepts this request and performs user authentication. If the user authentication is successful, the server device 100 allows the first user to log in based on the operation authority set for the first user account.

[0035] <Consent and permission management> (2) The first user requests, from the first user device 200, the setting of consent regarding the recorded data (before and after editing) and the operation authority of other users in the first virtual space. The server device 100 accepts this request and sets consent regarding the operation authority of other users. The content of the consent that has been set is stored in the storage unit 130 as consent information.

[0036] <Edit / Processing Menu> (3) The server device 100 generates output information for outputting an edit / process menu for editing the recorded data and processing the virtual space, based on the first user's operation authority and various data registered in association with the first user account. The various data registered in association with the first user account may include, for example, data of materials for constructing the first virtual space (hereinafter also referred to as "material data") and external information (e.g., environmental information) provided from the external system 500. (4) The server device 100 causes the VR app of the first user device 200 to output an edit / process menu, based on the generated output information.

[0037] Materials for constructing a virtual space (hereinafter also referred to as "materials") include, for example, materials (images) related to the background, materials (images and audio) related to characters such as avatars, and materials related to other objects. Material data may also include, for example, recorded data. Materials available to the first user (hereinafter also referred to as "first materials") may include, for example, materials used to construct an existing first virtual space and / or other materials (general-purpose materials) provided by the VR system 1 for a fee or free of charge. The first materials may also include, for example, recorded data of a second user and / or materials used to construct a second virtual space.

[0038] <Data editing and processing> (5) From the edit / processing menu output to first user device 200, the first user requests each of the multiple disclosure destinations (private and friends) to register and edit the recorded data and process the first virtual space using the edited recorded data. (6) Server device 100 edits the recorded data for each disclosure destination based on the request from the first user. (7) Server device 100 processes the first virtual space for each disclosure destination, i.e., the data for generating the first virtual space (hereinafter also referred to as "first virtual space data"), based on the edited recorded data.

[0039] <Space provision> (8) The server device 100 causes the VR app of the first user device 200 to output a first virtual space (for private use or friends) in response to an output request from the first user and the set operation authority. The first user operates this output first virtual space from the VR app of the first user device 200 based on the operation authority. (9) The server device 100 causes the VR app of the second user device 300 to output the first virtual space (for friends) or the second virtual space in response to a request from a second user and the set operation authority. The second user operates this output first virtual space (for friends) or the second virtual space from the VR app of the second user device 300 based on the operation authority.

[0040] <2-3. Editing and processing flow> An example of processing in the editing and processing process of the virtual space executed by the entire VR system 1 will be described with reference to FIG.

[0041] (1) As shown in Fig. 4, the first user uploads, i.e., transmits, from the first user device 200 to the server device 100, the first record data and the consent information related to the first record data. The acquisition unit 111 of the server device 100 acquires the transmitted first record data and consent information from the first user device 200.

[0042] (2) The acquisition unit 111 of the server device 100 stores the acquired first record data as the first material of the first virtual space in the material storage unit 133. (3) The setting unit 112 of the server device 100 sets the operation authority of the first user and / or the operation authority of other users including the second user based on the acquired consent information.

[0043] (3) The first user uses the first user device 200 to request each of the multiple publication destinations to edit the material data of the first material, including the first recording data. The reception unit 113 of the server device 100 receives this editing from the first user device 200. The editing unit 114a of the server device 100 reflects the received editing in the material data at each of the multiple publication destinations, within the scope of the set operation authority. Note that the material to be edited may be extracted from an existing first virtual space. Specifically, the editing unit 114a extracts the material data of the material to be edited from the first virtual space data and updates the extracted material data based on the editing from the first user.

[0044] (4) From first user device 200, the first user requests each of multiple publication destinations (for self-reference or disclosure to others) to process the edited material data to reflect it in the first virtual space. Reception unit 113 of server device 100 receives this processing request from first user device 200. Based on this request, processing unit 114 of server device 100 processes the first virtual space data stored in first virtual memory unit 131 within the scope of the set operation authority so as to reflect at least a portion of the edited material data.

[0045] (5) The output unit 115 of the server device 100 causes the first user device 200 to output the self-referential first virtual space based on the processed self-referential first virtual space data. The output unit 115 of the server device 100 also causes the first user device 200 and the second user device 300 to output the first virtual space for disclosure to others based on the processed first virtual space data for disclosure to others.

[0046] <3. Functional configuration> The functional configuration of the server device 100 according to this embodiment will be described with reference to Fig. 5. As shown in Fig. 5, the server device 100 includes a control unit 110, a communication unit 120, and a storage unit .

[0047] The control unit 110 includes an acquisition unit 111, a setting unit 112, a reception unit 113, a processing unit 114, and an output unit 115. The control unit 110 may also include a determination unit .

[0048] [Acquisition Department] The acquisition unit 111 acquires the first record data from the storage unit 130, the first user device 200, or an external system 500 (for example, an online storage system). The acquisition unit 111 may store the acquired first record data in the material storage unit 133 as a material for a virtual space.

[0049] The acquiring unit 111 may acquire second record data that records the experience of the second user from, for example, the storage unit 130, the second user device 300, or the external system 500.

[0050] The acquisition unit 111 may acquire, for example, from the storage unit 130 or the external system 500, environmental information related to a record of an experience of a first user or a second user in real space or a first virtual space. The acquisition unit 111 may, for example, search the environmental information stored in the storage unit 130 using the recording date and / or recording location included in the incidental information of the record data as a search key, and acquire matching environmental information, i.e., environmental information whose recording date and / or recording location matches the search key. A hit to this search key may be, for example, a partial match with the value of the search key, or a match with a rounded value of the search key (for example, if the recording date and time is in minutes, rounding it to days or hours).

[0051] Acquisition unit 111 may acquire, for example, environmental information corresponding to the recording date and time edited by the first user. With this configuration, environmental information corresponding to the date and time desired by the first user (including, for example, a date and time when the first user did not exist, such as the Edo period) can be acquired and the first virtual space data can be processed. This allows an environment that the first user cannot experience in reality to be incorporated into the virtual space. This also ensures the confidentiality of the actual recording date and time when the virtual space is made widely available, such as for public use as described in (d) above.

[0052] The acquisition unit 111 may acquire, for example, environmental information corresponding to the recording location edited by the first user. With this configuration, environmental information corresponding to a location desired by the first user (for example, within the grounds of a luxury resort hotel or overseas, in a location difficult for people to enter, such as the Arctic or Antarctic Circle) can be acquired and the first virtual space data can be processed. This allows an environment that the first user cannot experience in reality to be incorporated into the virtual space. This also ensures the confidentiality of the actual recording date and time when the virtual space is made widely available, for example, for public use as described in (d) above.

[0053] The acquisition unit 111 may acquire, for example, information indicating the access environment of a device (including a user device; the same applies hereinafter) corresponding to each of the multiple disclosure destinations (hereinafter also referred to as "access environment information"). This access environment information may include, for example, location information at the time when the second user device 300 accessed the first virtual space, or date and time information indicating the date and time of access.

[0054] The acquiring unit 111 may acquire, for example, information indicating the behavioral history of the user of the device corresponding to each of the multiple disclosure destinations (hereinafter also referred to as "behavior history information"). This behavioral history information may include, for example, the history of the second user's behavior, such as the date and time of the behavior, the location of the behavior, the history of operations on the second user device 300 associated with the behavior, and the details of the behavior. More specifically, if the second user's behavior is a trip taken one year ago, the behavioral history information may include the period of the trip, the locations of the trip, the history of operations on a map app and / or a travel site associated with the trip, and the steps of the trip.

[0055] [Settings section] The setting unit 112 sets multiple disclosure destinations in the first virtual space in response to a setting request from the first user or as parameters common to multiple users (e.g., default values). The setting unit 112 may set the relationships between the first user and other users as the disclosure destinations of the first user, such as (a) private, (b) followers / friends, (c) friends, and (d) general. As another example, the setting unit 112 may set any group consisting of multiple users designated by the first user as the disclosure destinations of the first user. For example, when registering a new user account, the setting unit 112 may set only the general disclosure destination (d) as the default, and then, in response to a registration request from the first user, may add users registered as friends (c) as the disclosure destinations. For example, when setting new disclosure destinations for the first user, the setting unit 112 may compare the results with the consent information and allow the setting if there is no inconsistency as a result of the comparison.

[0056] The setting unit 112 may, for example, accept a request from a first user and set consent to the operation authority of another user. The setting unit 112 may store the content of this set consent in the storage unit 130 as consent information. The setting unit 112 may also set operation authority for each user, for example. Furthermore, the setting unit 112 may set operation authority for each virtual space, for example. The setting unit 112 may store the content of this set operation authority in the storage unit 130 as authority information.

[0057] [Reception] The receiving unit 113 receives various types of information or various requests from the user device or the external system 500. The receiving unit 113 receives, from the first user device 200, editing of the first record data for each of the multiple disclosure destinations.

[0058] The receiving unit 113 may receive, for example, from the first user device 200, a selection of first virtual space data to be used as a reflection destination for the second recorded data, from among the first virtual space data of each of the multiple disclosure destinations.

[0059] When the first record data includes date and time information indicating the recording date and time when the experience of the first user was recorded, the receiving unit 113 may, for example, receive an edit of this date and time information from the first user device 200. When the second record data includes date and time information indicating the recording date and time when the experience of the second user was recorded, the receiving unit 113 may, for example, receive an edit of this date and time information from the first user device 200.

[0060] When the first record data includes location information indicating the recording location where the experience of the first user is recorded, the receiving unit 113 may receive, from the first user device 200, an edit of this location information.

[0061] [Processing department] The processing unit 114 processes the virtual space data based on the material data stored in the material storage unit 133 or external information provided by the external system 500.

[0062] The processing unit 114 processes the first virtual space data for each of the multiple disclosure destinations based on at least a part of the first recorded data edited by the first user. For example, the processing unit 114 may process the first virtual space data so that the first recorded data edited by the first user is reflected in the first virtual space.

[0063] For example, when the first recorded data is an image, the processing unit 114 may separate a foreground image, such as a person or a vehicle, from a background image, such as a building. The processing unit 114 may create a new object (including a character such as a user's avatar) in the first virtual space, update the parameters of the corresponding object, or delete the corresponding object, so as to reflect the separated foreground image in the first virtual space. The processing unit 114 may replace a character, for example, by creating a new object and deleting an existing object. Furthermore, the processing unit 114 may apply the separated background image to the corresponding space so as to reflect the separated background information in the first virtual space.

[0064] For example, when reflecting the recorded data in a virtual space, the processing unit 114 may anonymize the user's personal information included in the recorded data before reflecting it in the virtual space. The processing unit 114 may anonymize the personal information by, for example, deleting items or cells of the personal information, generalizing by abstracting, superseding, or abbreviating all or part of the personal information with numerical values, top (bottom) coding, data exchange, or adding noise (error), etc.

[0065] For example, the processing unit 114 may extract material data from second virtual space data that generates an existing second virtual space. The processing unit 114 may process the first virtual space based on the extracted material data. The processing unit 114 may extract material data from the second virtual space data based on consent information of the second user. This consent information of the second user may be information indicating the content of the second user's consent to the operation authority of other users, such as the first user. With this configuration, even materials included in a second virtual space that the first user cannot log in to can be used as materials for the first virtual space.

[0066] For example, the processing unit 114 may process the first virtual space data selected by the first user as the reflection destination based on at least a portion of the second recorded data acquired by the acquisition unit 111. With this configuration, the first virtual space can be processed using data recording the experiences of other users, rather than data recording the experiences of the first user. This allows a wider variety of processing to be performed on the virtual space.

[0067] For example, processing unit 114 may process the first virtual space data further based on the environmental information acquired by acquisition unit 111. For example, if the environmental information acquired by acquisition unit 111 is weather information related to the recording date and time and recording location of the recorded data, processing unit 114 may process the first virtual space data so that the weather indicated by the weather information (e.g., sunny or rainy weather) is reproduced in the first virtual space. Furthermore, for example, if the environmental information is event information about an event held at the recording date and time and recording location of the recorded data, processing unit 114 may process the first virtual space data so that the event indicated by the event information (e.g., a musician's live performance or a local festival) is reproduced in the first virtual space.

[0068] For example, if the recording medium is a camera, there is a limit to how much of the user's experience can fit in the camera frame, and it may not be possible to record the entire surrounding environment. With the above configuration, the surrounding environment that cannot be fully recorded in the first recording data that records the first user's experience can be reproduced in the first virtual space using environmental information. This makes it possible to realize a more realistic virtual space.

[0069] The processing unit 114 may include, for example, an editing unit 114a. The editing unit 114a reflects the edits accepted by the accepting unit 113 in the material data (including the recorded data) stored in the material storage unit 133 for each of the multiple publication destinations based on the consent information and / or the authority information.

[0070] [Output section] The output unit 115 causes the user device to output various information. For example, the output unit 115 may generate output information for outputting the virtual space on a screen and with sound, and transmit this output information to the user device. For example, if the server device 100 renders an image of the virtual space, the output information may be the rendered image. Furthermore, if the VR application of the user device renders the image, the output information may be VR parameters such as an object to be rendered by the VR application. The output unit 115 causes the processed first virtual space to be output to a device corresponding to each of the multiple publication destinations.

[0071] According to the above configuration, the VR system 1 can edit the recorded data for each of the multiple disclosure destinations and output the first virtual space processed with the edited recorded data. Therefore, each data item of the recorded data (including incidental information) can be edited or left as is to suit each of the multiple disclosure destinations. Therefore, when using recorded data of the real space in a virtual space on a network, it is possible to use different disclosure modes for each of the multiple disclosure destinations.

[0072] [Output section] The output unit 115 may cause the user device to output an edit / process menu for editing the recorded data and processing the virtual space. The output unit 115 may also cause the user device to output the edit / process menu based on consent information and / or authority information.

[0073] The edit / process menu may enable editing of material data using an editing template. The edit / process menu may also enable processing of a virtual space using a processing template. The edit / process menu may enable, for example, selection of a VR tone (e.g., game-style, monochrome movie, high image quality, etc.) and / or specification of collaboration with a VR platform different from the VR platform provided by VR system 1. Specifying collaboration with this different VR platform allows editing of recorded data and processing of the virtual space for each of multiple publishing destinations, in the same way as with the VR platform provided by VR system 1, for the virtual space of this specified VR platform.

[0074] For example, the output unit 115 may change the output mode of the first virtual space processed by the processing unit 114 in accordance with the access environment information acquired by the acquisition unit 111 in a device corresponding to each of the multiple publication destinations. For example, when the access environment of the second user device 300, which is one of the publication destinations of the first virtual space, is the United States, the output unit 115 may change the text and audio output in the first virtual space from Japanese, which is preset as a commonly used language, to the language most commonly used in the United States (English). For example, when the access environment of the second user device 300, which is one of the publication destinations of the first virtual space, is the United States, the output unit 115 may switch the mode indicating day and night in the first virtual space from the day and night mode indicated by the system time to a day and night mode corresponding to the time in the United States.

[0075] According to the above configuration, the output unit 115 can realize output that takes into account the access environment when the user to whom the information is to be released is accessing the first virtual space, thereby providing the user with a realistic space that is suited to the environment that the user is accessing.

[0076] For example, the output unit 115 may change the output mode of the first virtual space processed by the processing unit 114 to devices corresponding to each of the multiple disclosure destinations according to the behavioral history information. For example, if the behavioral history indicates that the second user traveled to Kyoto five years ago and the second user's avatar is also in (virtual) Kyoto in the first virtual space, the output unit 115 may cause the VR app of the second user device 300 to output a message indicating that the second user is in the same place in the virtual space as the place visited five years ago.

[0077] According to the above configuration, the output unit 115 can realize output based on the behavioral history of the user to whom the content is to be released, thereby providing the user with a realistic space that suits his or her behavioral tendencies or preferences.

[0078] [Communications Department] The communication unit 120 transmits and receives various types of information to and from the user device and / or the external system 500 via the network N.

[0079] [Storage] The storage unit 130 stores various types of information, such as consent information and / or authority information, processed by the VR system 1. The storage unit 130 may store these pieces of information in association with each other, for example. The storage unit 130 may store various types of information using a database management system (DBMS), or may store various types of information using a file system. When using a DBMS, a table may be provided for each piece of information, and the various pieces of information may be managed by associating these tables with each other. The storage unit 130 may include, for example, a first virtual storage unit 131, a second virtual storage unit 132, and a material storage unit 133.

[0080] The first virtual storage unit 131 stores first virtual space data for each of a plurality of disclosure destinations of the first user. The second virtual storage unit 132 stores second virtual space data for each of a plurality of disclosure destinations of the second user. The material storage unit 133 stores material data including recording data.

[0081] <4. Example of operation> An example of the operation of the server device 100 will be described with reference to Fig. 6. Note that the order of the processes shown below is an example and may be changed as appropriate.

[0082] As shown in FIG. 6, the acquisition unit 111 of the server device 100 acquires first record data that records the first user's experience in real space or the first virtual space (S10). The setting unit 112 sets multiple disclosure destinations in the first virtual space (S11). The reception unit 113 receives edits of the first record data for each of the multiple disclosure destinations from the first user device 200 of the first user (S12). The processing unit 114 processes, based on at least a portion of the edited first record data, first virtual space data for each of the multiple disclosure destinations, the first virtual space data being used to generate the first virtual space (S13). The output unit 115 outputs the processed first virtual space to a device corresponding to each of the multiple disclosure destinations (S14).

[0083] <5. Hardware Configuration> 7, an example of a hardware configuration in which the above-described server device 100 is realized by a computer 800 will be described. Note that the functions of each device can also be realized by dividing them into multiple devices.

[0084] As shown in FIG. 7, the computer 800 includes a processor 801, a memory 803, a storage device 805, an input I / F unit 807, a data I / F unit 809, a communication I / F unit 811, and a display device 813.

[0085] The processor 801 controls various processes in the computer 800 by executing programs stored in the memory 803. For example, each functional unit included in the control unit 110 of the server device 100 can be realized by the processor 801 executing a program temporarily stored in the memory 803.

[0086] The memory 803 is a storage medium such as a RAM (Random Access Memory), etc. The memory 803 temporarily stores the program code of the program executed by the processor 801 and data required when the program is executed.

[0087] The storage device 805 is a non-volatile storage medium such as a hard disk drive (HDD) or flash memory. The storage device 805 stores an operating system and various programs for implementing the above-mentioned configurations. In addition, the storage device 805 can also store tables that register various information such as recording data, consent information, authority information, or output information, and a DB that manages the tables. Such programs and data are loaded into the memory 803 as needed and can be referenced by the processor 801.

[0088] The input I / F unit 807 is a device for receiving input from a user. Specific examples of the input I / F unit 807 include a keyboard, a mouse, a touch panel, various sensors, and a wearable device. The input I / F unit 807 may be connected to the computer 800 via an interface such as a USB (Universal Serial Bus).

[0089] The data I / F unit 809 is a device for inputting data from outside the computer 800. A specific example of the data I / F unit 809 is a drive device for reading data stored in various storage media. The data I / F unit 809 may be provided outside the computer 800. In this case, the data I / F unit 809 is connected to the computer 800 via an interface such as a USB.

[0090] The communication I / F unit 811 is a device for performing data communication via a network N, either wired or wirelessly, with an external device of the computer 800. The communication I / F unit 811 may be provided outside the computer 800. In this case, the communication I / F unit 811 is connected to the computer 800 via an interface such as a USB.

[0091] The display device 813 is a device for displaying various types of information. Specific examples of the display device 813 include a liquid crystal display, an organic EL (Electro-Luminescence) display, and a display of a wearable device. The display device 813 may be provided outside the computer 800. In this case, the display device 813 is connected to the computer 800 via, for example, a display cable. Furthermore, when a touch panel is adopted as the input I / F unit 807, the display device 813 can be configured as an integral part of the input I / F unit 807.

[0092] The above-described embodiment is merely an example for explaining the present invention, and is not intended to limit the present invention to the embodiment. Furthermore, the present invention can be modified in various ways without departing from the spirit of the present invention. Furthermore, a person skilled in the art can adopt an embodiment in which the above-described elements are replaced with equivalent elements, and such an embodiment is also within the scope of the present invention.

[0093] The components of the server device described in the above embodiment are assumed to realize predetermined processing in cooperation with other hardware by the processor 801 executing a program stored in the storage device 805. In other words, these components are assumed to be software or firmware, as well as corresponding hardware, and in both concepts, they are also referred to as "functions," "means," "parts," "processing circuits," "units," or "modules," and can be interpreted as such.

[0094] [Variations] Although the present invention has been described based on the above embodiment, the following cases are also included in the present invention.

[0095] [Variation 1] In the above embodiment, a client-server system has been described as an example, but the VR system according to the present invention is not limited to this. The VR system according to the present invention may also adopt, for example, a P2P system (star type or full mesh type) implemented only by the user device on the edge side. In this case, all or part of the components of the server device 100 may be provided in the user device. The user device may, for example, implement the functions of the functional units provided in the control unit 110 of the server device 100 by executing an installed VR app.

[0096] [Variation 2] In the above embodiment, for ease of explanation, one VR platform has been described as an example, but the VR platform according to the present invention is not limited to this. For example, there may be a plurality of VR platforms with which the VR system according to the present invention cooperates. The first virtual space may be generated in each of the plurality of VR platforms. In this case, the first virtual space data may be stored in the first virtual storage unit 131 for each of the plurality of VR platforms. Furthermore, the reception unit according to the present invention may receive a request for editing of the recorded data for each of the plurality of VR platforms.

[0097] [Variation 3] In the above embodiment, an example was shown in which the storage unit of the server device 100 includes a first virtual storage unit that stores the first virtual space data and a second virtual storage unit that stores the second virtual space data, but the present invention is not limited to this. For example, at least a part of these storage units may be included in a device of the external system 500.

[0098] [Variation 4] Although not shown in the above embodiment, the editing / processing menu may include a method for editing recorded data and / or a method for processing virtual space (hereinafter also referred to as an "editing / processing method") performed by the user or another user. The editing / processing method may be, for example, the content of a user's operation performed on the editing / processing menu output to the user device when editing recorded data or processing virtual space. The editing / processing method may also include, for example, the subject of editing / processing, the material used for editing / processing, and / or the editing / processing procedure.

[0099] For example, in the case of a method for editing recorded data, the editing / processing method may include the recorded data to be edited (e.g., the recorded data itself or information for identifying the recorded data), the type of recorded data to be edited (e.g., a photographic image or an audio file), an image to be used as material for editing (e.g., an avatar image), and / or the editing procedure (e.g., pasting an avatar image onto a photographic image).

[0100] For example, in the case of a method for processing a virtual space, the editing / processing method may include the virtual space data to be processed (which may be, for example, the virtual space data itself or information for identifying the virtual space data), edited recorded data as material to be used for processing, and / or the processing procedure (for example, reflecting the recorded data in the virtual space).

[0101] The editing / processing method may be automatically recorded when a user performs editing or processing. For example, when a second user edits the second recorded data, the receiving unit 113 may receive the editing operation and record operation history information indicating the history of the received operation as the editing method performed by the second user in the storage unit 130. Next, the output unit 115 causes the first user device 200 to output the editing method performed by the second user based on the operation history information. Then, when the first user specifies the output editing method, the receiving unit 113 receives the specification, and the editing unit 114a edits the first recorded data using the edit method. Furthermore, when specifying the output editing method, it may be possible to specify a portion of the editing method. In this case, the editing unit 114a may edit the first recorded data using the editing method of the specified portion.

[0102] According to the above configuration, it is possible to edit recorded data and process virtual space using editing and processing methods that the user or other users have used in the past. This means that the user does not need to research or operate the editing and processing methods from scratch. This makes it possible to realize an editing and processing menu that is user-friendly, i.e., highly usable.

[0103] The receiving unit 113 may receive, for example, from a user device, user evaluations (hereinafter also referred to as "user evaluations") of editing and processing methods performed by other users. The user evaluations may be, for example, evaluations indicating a favorable impression of the editing and processing method, such as "good" or "like," or evaluations indicating an unfavorable impression, such as "not good" or "dislike." The output unit 115 may calculate statistical values ​​of the user evaluations (for example, totals, averages, or modes) and output the calculated statistical values ​​to the user device. With this configuration, it is also possible to check which editing and processing methods are popular or unpopular with other users.

[0104] [Variation 5] Although not shown in the above embodiment, the output unit 115 may cause the user device to prioritize output of each menu item in the editing / processing menu for each user or for multiple users in accordance with statistics regarding the use of each menu item. For example, the output unit 115 may output a menu item that is used more frequently in a unit period for each user, i.e., more frequently used, at the top of the editing / processing menu screen. Specifically, the output unit 115 may sort and display each menu item in descending order of frequency of use on the editing / processing menu screen. This configuration allows menu items that are frequently used by the user to be prioritized for output. This makes it possible to realize an editing / processing menu that is user-friendly, i.e., highly usable.

[0105] [Variation 6] Although not shown in the above embodiment, the output unit 115 may cause the user device to prioritize output of each menu item in the editing / processing menu, for each user or for multiple users in common, based on statistical values ​​regarding user ratings for each menu item. For example, the output unit 115 may output a menu item that has been rated "like" a greater number of times in a unit period across multiple users, so that it is positioned higher on the editing / processing menu screen. Specifically, the output unit 115 may sort and display each menu item on the editing / processing menu screen in descending order of frequency of use. This configuration allows menu items that are popular with users to be prioritized for output. This makes it possible to realize an editing / processing menu that is user-friendly, i.e., highly usable. [Explanation of symbols]

[0106] 1...VR system, 100...server device, 110...control unit, 111...acquisition unit, 112...setting unit, 113...reception unit, 114...processing unit, 115...output unit, 120...communication unit, 130...storage unit, 200...first user device, 300...second user device, 500...external system, 800...computer, 801...processor, 803...memory, 805...storage device, 807...input I / F unit, 809...data I / F unit, 811...communication I / F unit, 813...display device.

Claims

1. On the computer, an acquisition means for acquiring first record data that records an experience of a first user in a real space or a first virtual space; a setting means for setting a plurality of disclosure destinations in the first virtual space; a receiving unit configured to receive, from a first user device of the first user, editing of the first recorded data for each of the plurality of disclosure destinations; a processing means for processing first virtual space data for each of the plurality of disclosure destinations, the first virtual space data being used to generate the first virtual space, based on at least a part of the edited first record data; and an output means for outputting the processed first virtual space to a device corresponding to each of the plurality of disclosure destinations. program.

2. the acquiring means acquires second record data that records an experience of a second user in a real space or a second virtual space, the second record data being different from the first record data; the accepting means accepts, from the first user device, a selection of the first virtual space data to be reflected in the second recorded data from among the first virtual space data of each of the plurality of disclosure destinations; the processing means processes the selected first virtual space data based on at least a part of the second recorded data; The program according to claim 1.

3. the acquisition means acquires environmental information related to a record of an experience of the first user in a real space or the first virtual space; the processing means processes the first virtual space data further based on the environmental information. The program according to claim 1 or 2.

4. the first recorded data includes date and time information indicating a date and time when the experience of the first user was recorded; the accepting means accepts editing of the date and time information from the first user device; the acquiring means acquires the environmental information corresponding to the edited date and time. The program according to claim 3.

5. the first recorded data includes location information indicating a location where the experience of the first user was recorded; The accepting unit accepts editing of the location information from the first user device. the acquiring means acquires the environmental information corresponding to the edited position. The program according to claim 3.

6. the acquiring means acquires access environment information indicating an access environment of a device corresponding to each of the plurality of disclosure destinations; the output means changes an output mode of the processed first virtual space in accordance with the access environment information in a device corresponding to each of the plurality of disclosure destinations; The program according to claim 1 or 2.

7. the acquiring means acquires behavior history information indicating a behavior history of a user of a device corresponding to each of the plurality of disclosure destinations; the output means changes an output mode of the processed first virtual space to a device corresponding to each of the plurality of disclosure destinations in accordance with the behavior history information. The program according to claim 1 or 2.

8. an acquisition unit that acquires first record data that records an experience of a first user in a real space or a first virtual space; a setting unit that sets a plurality of disclosure destinations in the first virtual space; a receiving unit that receives an edit of the first record data from a first user device of the first user to each of the plurality of publication destinations; a processing unit that processes first virtual space data for each of the plurality of disclosure destinations based on at least a part of the edited first record data, the first virtual space data being used to generate the first virtual space; an output unit that outputs the processed first virtual space to a device corresponding to each of the plurality of disclosure destinations, Information processing device.

9. The computer acquiring first record data that records an experience of a first user in a real space or a first virtual space; setting a plurality of disclosure destinations in the first virtual space; accepting an edit of the first recorded data from a first user device of the first user to each of the plurality of disclosure destinations; processing first virtual space data for each of the plurality of disclosure destinations, the first virtual space data being used to generate the first virtual space, based on at least a portion of the edited first record data; outputting the processed first virtual space to a device corresponding to each of the plurality of disclosure destinations; Information processing methods.

Images