Information processing system, information processing method, and program

The information processing system addresses the limitation of lacking location-specific content in virtual experiences by integrating a virtual space display, content acquisition, and playback units, enabling customizable and interactive virtual tours and activities, thereby enhancing user engagement.

JP2026017646APending Publication Date: 2026-02-05SONY GROUP CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024118498
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-07-24
Publication Date
2026-02-05

AI Technical Summary

Technical Problem

Existing virtual experience technologies do not provide content related to specific locations within a virtual space, limiting user engagement and experience.

Method used

An information processing system that includes a virtual space display processing unit, a content acquisition unit, and a playback processing unit, which places virtual objects associated with identification information to provide content relevant to their location, allowing for enhanced user experiences through guided tours and special activities.

Benefits of technology

Enables the creation of customizable and interactive virtual experiences by associating content with specific locations, improving user engagement and allowing teams to update content easily, thus enhancing the overall virtual space experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026017646000001_ABST
    Figure 2026017646000001_ABST
Patent Text Reader

Abstract

To improve user experience in a virtual space.SOLUTION: An information processing system comprising: a virtual space display processing unit configured to arrange, in a virtual space, a virtual object associated with identification information for identifying content; a content acquisition unit configured to acquire the content on the basis of the identification information; and a reproduction processing unit configured to reproduce the content, wherein the content is related to a location where the virtual object is arranged.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to an information processing system, an information processing method, and a program. [Background technology]

[0002] In recent years, a variety of virtual experiences have been offered.

[0003] For example, in Patent Document 1 below, a virtual travel tour is created and provided to users by combining multiple videos that include movement, such as a video that includes movement from a departure point to a destination (for example, a video of movement on foot, by train, plane, car, etc.) and a video of movement on foot near the destination. By watching the combined shot videos, users can experience a virtual travel tour that travels from a departure point to a destination and sightsees at the destination. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2023-121967 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the technology described in Patent Document 1 is designed to sequentially provide videos taken while traveling or at a destination, and does not take into consideration the provision of content related to any location within a virtual space.

[0006] Therefore, the present disclosure proposes an information processing system, an information processing method, and a program that can further improve the user experience in virtual space. [Means for solving the problem]

[0007] According to the present disclosure, an information processing system is provided that includes a virtual space display processing unit that places virtual objects in a virtual space that are associated with identification information that identifies content, a content acquisition unit that acquires the content based on the identification information, and a playback processing unit that plays the content, wherein the content is content related to the location where the virtual object is placed.

[0008] Furthermore, according to the present disclosure, an information processing method is provided, which includes a processor placing a virtual object in a virtual space, the virtual object having associated identification information that identifies content, acquiring the content based on the identification information, and playing the content, wherein the content is content related to the location where the virtual object is placed.

[0009] Furthermore, according to the present disclosure, a program is provided that causes a computer to function as a virtual space display processing unit that places virtual objects associated with identification information that identifies content in a virtual space, a content acquisition unit that acquires the content based on the identification information, and a playback processing unit that plays the content, wherein the content is content related to the location where the virtual object is placed. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is an overall configuration diagram of an information processing system 1 according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a block diagram showing an example of the configuration of a server 20 according to the present embodiment. [Figure 3] 1 is a block diagram showing an example of a configuration of a client terminal 10 according to an embodiment of the present disclosure. [Figure 4] 10A and 10B are diagrams showing a display example of a guide playback object placed in a virtual space according to the present embodiment. [Figure 5] FIG. 10 is a diagram showing an example of playback of guide content according to the present embodiment. [Figure 6]10A and 10B are diagrams showing an example of an enlarged display of a guide video according to the present embodiment. [Figure 7] FIG. 10 is a diagram for explaining a game as an example of a special activity according to the present embodiment. [Figure 8] FIG. 10 is a diagram for explaining a commemorative photo event, which is an example of a special activity according to this embodiment. [Figure 9] FIG. 10 is a diagram for explaining a history video viewing event, which is an example of a special activity according to this embodiment. [Figure 10] FIG. 10 is a diagram illustrating a history quiz event, which is an example of a special activity according to this embodiment. [Figure 11] 10A and 10B are diagrams showing an example of a display of a cover of menu data using a passport motif according to the present embodiment. [Figure 12] 10A to 10C are diagrams showing examples of display of pages of each tour menu of menu data using a passport motif according to this embodiment. [Figure 13] FIG. 10 is a diagram showing an example of a display of a puzzle piece collection status confirmation page included in menu data with a passport motif according to this embodiment. [Figure 14] FIG. 10 is a diagram for explaining the rewards given when experiencing the events of the guided tour and collecting all the stamps according to this embodiment. [Figure 15] 10 is a flowchart showing an example of the flow of a tour event execution process according to the present embodiment. [Figure 16] FIG. 9 is a block diagram showing an example of a hardware configuration of an information processing device 900 according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0011] Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant description will be omitted.

[0012] The explanation will be given in the following order: 1. Overview 2. Configuration 2-1. Server 20 Configuration 2-2.Configuration of client terminal 10 3. Tour event details 3-1. Tour event experience flow 3-2. Special Activities 3-3. Displaying menu data 4. Operation processing 5. Variations 6. Hardware Configuration 7. Supplementary Information

[0013] <1. Overview> As one embodiment of the present disclosure, a mechanism for providing content related to any location within a virtual space and further improving the user experience in the virtual space will be described.

[0014] Fig. 1 is an overall configuration diagram of an information processing system 1 according to an embodiment of the present disclosure. As shown in Fig. 1, the information processing system 1 includes client terminals 10 (10a, 10b, etc.), a server 20, and a CDN (Contents Delivery Network) 30. The client terminal 10 can be communicatively connected to the server 20 and the CDN 30 via a network 40.

[0015] The server 20 is an information processing device that has a function of providing a virtual space to a user. For example, the server 20 transmits a virtual space image from each user's viewpoint to each client terminal 10 (10a, 10b, etc.). Alternatively, the server 20 transmits information for generating a virtual space (virtual space information) to each client terminal 10, and the virtual space image from each user's viewpoint is generated and provided in each client terminal 10.

[0016] Various virtual objects may be placed in the virtual space. The virtual object is, for example, a 3D object generated using a 3D model. The virtual object also includes an avatar associated with the user. An image from the avatar's perspective may be provided to the user as a virtual space image from the user's perspective. The user can freely move within the virtual space by operating the avatar associated with the user, and can also communicate with the avatars of other users (other avatars). The avatar is realized, for example, by 3DCG (Computer Graphics) that is rendered based on a 3D model. Furthermore, the virtual space may be a reproduction of a fictional world, or may be a reproduction of the real world, such as an existing facility.

[0017] The client terminal 10 is an information processing terminal that has a function of displaying a virtual space image from the user's viewpoint based on information received from the server 20. The client terminal 10 is realized by, for example, a smartphone, a tablet terminal, a PC (personal computer), an HMD (head mounted display) that covers the entire field of view, a glasses-type device, a projector, or the like.

[0018] The client terminal 10 receives, for example, information for generating a virtual space (virtual space information) from the server 20 and performs display processing of the virtual space. The virtual space information includes, for example, map information of the virtual space, a background image of the virtual space, information on various virtual objects arranged in the virtual space (e.g., 3D models of other avatars), control information of other avatars (e.g., information on positions, postures, facial expressions, etc.), and audio data of the virtual space. The server 20 may also continuously transmit time-dependent difference information of the virtual space (e.g., movement information of other avatars, etc.). The client terminal 10 also continuously transmits to the server 20 information input by the user and control information of avatars that move in response to user operations (e.g., information on positions, postures, facial expressions, etc.). The control information of each avatar in the virtual space is distributed to each client terminal 10 via the server 20 and shared.

[0019] The CDN 30 is a network that distributes various types of content such as video and audio data. The CDN 30 copies content from an origin server that stores the original content to a cache server, and distributes the content from the cache server in response to a request from a user. The CDN 30 controls the distribution of predetermined content in response to a request from, for example, a client terminal 10. Note that the CDN 30 is an example of a content distribution server, and the present embodiment is not limited to this.

[0020] One example of a user experience in a virtual space is the provision of content related to any location within the virtual space. The enjoyment of the virtual space is increased by allowing users to move around the virtual space using an avatar and have specific experiences when visiting specific locations.

[0021] For example, in a world where a virtual space is a replica of a real-world facility, it would be possible to offer a guided tour experience of that facility. Tours that allow users to walk around various sports facilities, such as soccer stadiums and baseball fields, with a guide and learn about behind-the-scenes events are popular in the real world as well. Tours that allow fans to see the players' gyms, locker rooms, press rooms, and other facilities at their favorite team's home stadiums are particularly popular. Therefore, it would be possible to offer such tours to fans who gather in virtual space to cheer on their teams.

[0022] However, since the content of the guided tour varies depending on the team and facility, in order to create an experience that exactly mimics a real-world stadium tour in a virtual space, it would be necessary to create a separate tour for each team, which would incur development costs.

[0023] Therefore, in the present disclosure, content that is desired to be provided at a specific location within the virtual space (for example, guide content such as a guide video explaining the gym or guide audio introducing anecdotes related to the locker room) is prepared, and by placing a virtual object that serves as a landmark at that specific location within the virtual space, it becomes possible to provide content related to any location within the virtual space, thereby further improving the user experience in the virtual space.

[0024] Even if teams or facilities are different, events such as guided tours can be realized by placing specific virtual objects at any location in the virtual space, making it possible to create event templates. Each team simply prepares the content they want to provide at any location. In addition, each team can add or change new tour content simply by updating data in the backend (for example, by specifying a new location and adding the corresponding content).

[0025] <2. Configuration> The configuration of each device included in the information processing system 1 will be described.

[0026] <<2-1. Server 20 Configuration>> 2 is a block diagram showing an example of the configuration of the server 20 according to this embodiment. As shown in FIG. 2, the server 20 includes a communication unit 210, a control unit 220, and a storage unit 230.

[0027] (Communication unit 210) The communication unit 210 has a transmitting unit that transmits data to an external device and a receiving unit that receives data from the external device. The communication unit 210 according to this embodiment may be communicatively connected to an external device or the Internet using, for example, a wired or wireless LAN (Local Area Network), Wi-Fi (registered trademark), Bluetooth (registered trademark), a mobile communication network (LTE (Long Term Evolution), 4G (fourth generation mobile communication system), 5G (fifth generation mobile communication system)), or the like.

[0028] For example, the communication unit 210 is connected to the client terminal 10 via the network 40 for communication, and transmits and receives data.

[0029] (control unit 220) The control unit 220 functions as an arithmetic processing unit and a control device, and controls the overall operation of the server 20 in accordance with various programs. The control unit 220 is realized by an electronic circuit such as a CPU (Central Processing Unit) or a microprocessor. The control unit 220 may also include a ROM (Read Only Memory) that stores the programs to be used, arithmetic parameters, etc., and a RAM (Random Access Memory) that temporarily stores parameters that change as appropriate.

[0030] The control unit 220 manages the virtual space. Specifically, the control unit 220 generates, acquires, adds, updates, and so on various information for constructing (generating) the virtual space. The various information includes, for example, virtual space information such as information on 3DCG models, which are virtual objects placed in the virtual space, color settings, images, map information, sound effects, and background music (BGM).

[0031] The virtual objects include user-operable objects, non-user-operable objects, background images, and dramatic effects. The virtual objects also include information about each avatar placed in the virtual space. The information about each avatar includes, for example, the avatar's appearance information, real-time location information, facial expressions, gesture information, and the associated user profile. The virtual objects also include objects placed in the virtual space and used during guide playback (hereinafter referred to as guide playback objects).

[0032] The control unit 220 transmits the virtual space information to the client terminal 10 as appropriate. The control unit 220 also receives information on user operations and real-time information on avatars from the client terminal 10, and transmits this as virtual space information to other client terminals 10. This synchronizes the status of the virtual space reproduced in each client terminal 10.

[0033] The control unit 220 also manages information related to the guided tour event experience (hereinafter also referred to as a tour event) provided in the virtual space. Specifically, the control unit 220 associates identification information for identifying guide content (such as guide audio and guide video; an example of guide data) with placement location information of a guide playback object, and stores the associated information in the storage unit 230. The identification information of the guide content may be information indicating the location where the guide content is saved (for example, a URL of the storage location in the CDN 30). The placement location information may be the type of location, such as a team locker room or gym, reproduced in the virtual space. The team manager prepares guide content such as a video generated by filming a guide giving an explanation in a team locker room or a scene of players talking in a stadium lounge in the real world, and uploads the guide content to the CDN 30. The team manager registers the storage location information of the guide content and information on the location of the guide target (corresponding to the placement location information of the guide playback object; for example, a locker room) in the server 20. Note that the uploading of the guide content to the CDN 30 and the acquisition of the storage location information may be performed by the server 20.

[0034] Guide content is prepared for each guided location. The guide content may be audio, photos (still images), video, or text. The control unit 220 may acquire multiple combinations of storage location information for each guide content and information on the corresponding guided location, and manage them as tour event data. The tour event data may also include information about the team. The tour event data may also include, as additional information, information about special activities that can be experienced at the guided location in addition to the guide data provided. Examples of special activities include games, quizzes, and commemorative photos with manager avatars and player avatars. The manager avatars and player avatars may be rendered using 3D models based on real-life images.

[0035] The control unit 220 may also generate tour menu data from the tour event data. The tour menu data may be, for example, a list of each event provided in the tour, more specifically, a list of locations to be guided. The tour menu data may be prepared in advance by the administrator of the virtual space or the team manager hosting the tour. The tour menu data may include information on items awarded for achieving events. The tour menu data may also include information on the display screen for the menu data. The display screen for the menu data may, for example, be based on a passport motif, with an introduction to the event displayed on each page. The tour menu data may also include information on team logos, team designs, etc., and these team logos, team designs, etc. may be used when displaying the menu data.

[0036] Furthermore, the control unit 220 manages user data including the user's tour completion status, etc. Specifically, the control unit 220 updates the user data in accordance with information on the tour completion status transmitted from the client terminal 10.

[0037] The information relating to the tour event described above (tour event data, tour menu data, and user data) can be transmitted to the client terminal 10 as one piece of virtual space information.

[0038] (Storage unit 230) The storage unit 230 is realized by a ROM that stores programs and calculation parameters used in the processing of the control unit 220, and a RAM that temporarily stores appropriately changing parameters, etc. The storage unit 230 stores virtual space information.

[0039] The configuration of the server 20 has been specifically described above. Note that the configuration of the server 20 according to the present disclosure is not limited to the example shown in Fig. 2. For example, the server 20 does not necessarily have to have all of the components shown in Fig. 2. Furthermore, the server 20 may be realized by a plurality of devices.

[0040] <<2-2. Configuration of the client terminal 10>> 3 is a block diagram showing an example of a configuration of the client terminal 10 according to an embodiment of the present disclosure. As shown in FIG. 3, the client terminal 10 includes a communication unit 110, an operation unit 120, a control unit 130, a storage unit 140, a display unit 150, and an audio output unit 160.

[0041] (Communication unit 110) The communication unit 110 has a transmitting unit that transmits data to an external device and a receiving unit that receives data from the external device. The communication unit 110 according to this embodiment may be communicatively connected to an external device or the Internet using, for example, a wired or wireless LAN, Wi-Fi (registered trademark), Bluetooth (registered trademark), a mobile communication network (LTE, 4G, 5G), or the like.

[0042] For example, the communication unit 110 can communicate with the server 20 and the CDN 30 via the network 40 to send and receive data.

[0043] (Operation unit 120 and display unit 150) The operation unit 120 accepts operation inputs from a user and outputs the input information to the control unit 130. The display unit 150 functions as a display unit that displays various screens. The operation unit 120 and the display unit 150 may be configured as separate units, or may be configured as an integrated unit like a touch panel display.

[0044] (Audio output unit 160) The audio output unit 160 has a function of outputting audio data under the control of the control unit 130. The audio output unit 160 may be realized by, for example, a speaker, headphones, earphones, a bone conduction speaker, or the like.

[0045] (control unit 130) The control unit 130 functions as a calculation processing unit and a control device, and controls the overall operation of the client terminal 10 in accordance with various programs. The control unit 130 is realized by an electronic circuit such as a CPU or a microprocessor. The control unit 130 may also include a ROM for storing the programs to be used, calculation parameters, etc., and a RAM for temporarily storing parameters that change as appropriate.

[0046] In addition, the control unit 130 can also function as a tour menu data acquisition unit 131, a user data processing unit 132, a tour menu display processing unit 133, a tour event data acquisition unit 134, a guide content acquisition unit 135, a virtual space display processing unit 136, a tour event processing unit 137, and a guide content playback processing unit 138.

[0047] The tour menu data acquiring unit 131 acquires tour menu data including list information of each event provided in the tour from the server 20, and outputs the tour menu data to the tour menu display processing unit 133. The tour menu data acquiring unit 131 is an example of a menu data acquiring unit.

[0048] The user data processing unit 132 acquires user data including the user's tour completion status from the server 20, and outputs the data to the tour menu display processing unit 133. The tour completion status is an example of information related to the progress of an event provided to the user. The user data includes at least information related to the progress of the event.

[0049] The tour menu display processing unit 133 controls the display of tour menu data on the display unit 150. The tour menu data includes various images and the like required for display. When displaying the tour menu data, the tour menu display processing unit 133 may visualize and display the user's tour completion status (an example of the progress status of an event). For example, the tour menu display processing unit 133 displays check marks or stamps for tour menus (i.e., each event included in a tour event) that the user has already experienced. Information (e.g., stamp images) for visualizing the tour completion status may also be included in the tour menu data received from the server 20. Display examples of tour menu data will be described later with reference to FIGS. 11 to 14.

[0050] The tour event data acquisition unit 134 acquires tour event data including each combination of information on the location of the guide target in the virtual space and storage location information of the corresponding guide content from the server 20. The tour event data acquisition unit 134 is an example of an information acquisition unit.

[0051] The storage location information of the guide content is output to the guide content acquisition unit 135. The guide content acquisition unit 135 acquires the guide content from the network via the communication unit 110 based on the storage location information of the guide content. For example, the guide content acquisition unit 135 can acquire the guide content from the CDN 30 via the communication unit 110. The guide content acquisition unit 135 is an example of a content acquisition unit.

[0052] The information on the guide target location is output to the virtual space display processing unit 136. The virtual space display processing unit 136 places a guide playback object in the virtual space at the position indicated by the information on the guide target location. The information (e.g., a 3D model) used to draw the guide playback object may be obtained in advance from the server 20 when the virtual space is generated, or may be included in the tour event data. In this embodiment, a tour introducing multiple locations in the virtual space is assumed, and there is information on multiple locations to be guided. The virtual space display processing unit 136 performs processing to place a guide playback object at each location.

[0053] The tour event processing unit 137 performs a process of executing a tour event. Specifically, when a user performs a start operation on a guide playback object arranged in the virtual space, the tour event processing unit 137 instructs the guide content playback processing unit 138 to play back the corresponding guide content. Playback of the guide content is an example of a content playback event provided to the user. The tour event processing unit 137 is also an example of an event processing unit.

[0054] The guide content playback processing unit 138 controls playback of the guide content acquired by the guide content acquisition unit 135, which corresponds to the guide playback object for which the user has performed a start operation. Note that the timing of acquisition of the guide content by the guide content acquisition unit 135 is not particularly limited. For example, the guide content playback processing unit 138 controls output of a guide voice from the voice output unit 160, or controls superimposing and displaying a display screen of a guide video on a display screen of the virtual space on the display unit 150. Note that the guide content playback processing unit 138 may play back the guide content in a streaming format. The guide content playback processing unit 138 is an example of a playback processing unit.

[0055] When the reproduction of the guide content is completed, the tour event processing unit 137 transmits a message to the user data processing unit 132 that the guide content has been reproduced. The user data processing unit 132 can manage the user's tour achievement status. When the user's tour achievement status is updated, the user data processing unit 132 transmits the latest user data to the server 20 via the communication unit 110. Furthermore, when the user's tour achievement status is updated, the tour menu display processing unit 133 also performs processing such as displaying new check marks or stamps for the experienced tour menu (each event).

[0056] (Storage unit 140) The storage unit 140 is realized by a ROM that stores programs and calculation parameters used in the processing of the control unit 130, and a RAM that temporarily stores parameters that change as needed.

[0057] The configuration of the client terminal 10 has been specifically described above. Note that the configuration of the client terminal 10 according to the present disclosure is not limited to the example shown in Fig. 3. For example, the client terminal 10 does not necessarily have to have all of the components shown in Fig. 3. Furthermore, the client terminal 10 may be realized by multiple devices.

[0058] <3. Tour event details> Next, the tour event according to this embodiment will be described in detail with reference to the drawings.

[0059] <<3-1. Tour Event Experience Flow>> 4 is a diagram showing a display example of a guide playback object placed in a virtual space according to this embodiment. In this embodiment, it is assumed that a soccer stadium or the like that is the home of a certain soccer team is reproduced in the virtual space, where fans of the soccer team can gather and interact with each other and experience various events.

[0060] The display screen 500 shown in FIG. 4 is an example of a virtual space image from the user's viewpoint, and is displayed on the display unit 150 of the client terminal 10. The virtual space image from the user's viewpoint includes a user avatar A moving within the virtual space as the user's avatar. As shown on the display screen 500, in this embodiment, as an example, a guide playback object 502 is placed on the grounds of a soccer stadium. The user operates the user avatar A to approach the guide playback object 502 and perform a start operation to start the guide. The virtual space display processing unit 136 may change the display mode of the guide playback object 502 as feedback on the user operation, as appropriate, when the user avatar A approaches the guide playback object 502 or when a start operation is received.

[0061] FIG. 5 is a diagram showing an example of guide content playback according to this embodiment. Display screen 510 shown in FIG. 5 displays a reproduction of an entrance in a soccer stadium used by players. The entrance includes, for example, sofas and a dining area, and is used for players to rest and socialize. When a user performs a start operation on a guide playback object (not shown in FIG. 5 ) placed at the entrance, playback of the guide content begins. The guide content may be a guide video filmed at an actual entrance. The content of the guide content is not particularly limited, and may be, for example, a guide video that shows the entrance while explaining about the entrance, or a guide video in which players sit on a sofa in the entrance and talk about how to spend time there or anecdotes. The method for displaying the guide video is not particularly limited, and for example, as shown in FIG. 5 , a guide video display screen 512 and subtitle display 514 may be superimposed on display screen 510 (Picture in Picture method). The user can view guide video display screen 512 while controlling user avatar A to move around the entrance.

[0062] The guide video display screen 512 may be enlarged. Fig. 6 is a diagram showing an example of an enlarged display of a guide video according to this embodiment. As shown in Fig. 6, a guide video display screen 522 with an enlarged display size may be displayed on a display screen 520 that displays a virtual space image.

[0063] Additionally, predetermined items are dropped at locations where each event is offered (e.g., entrance, gym, grounds, etc.), and the user can search for and collect the items by operating user avatar A. The predetermined items may be, for example, puzzle pieces.

[0064] Furthermore, the tour event provided by this embodiment can be experienced by multiple users in a synchronized manner in a party mode. For example, the server 20 controls the client terminals 10 of users who have registered to participate in the party mode to synchronize the tour events to be executed.

[0065] <<3-2. Special Activities>> The tour event according to this embodiment may include not only the playback of guide content related to the guide location, but also a special activity related to the guide location. Information on the special activity is associated with information on the location to be guided and is included in the tour event data.

[0066] Examples of special activities include games, quizzes, commemorative photography, viewing of history videos, etc. Specific examples will be described below with reference to the drawings.

[0067] Fig. 7 is a diagram illustrating a game, which is an example of a special activity according to this embodiment. As shown on a display screen 530 in Fig. 7, for example, in a gym, which is one of the guide locations, a user can control a user avatar A to play a game with a player avatar. In the example shown in Fig. 7, a soccer tennis game is being played in which players kick a soccer ball across a tennis net. Selection of a game experience, start operation, etc. can also be performed using a guide playback object 531 located in the gym.

[0068] 8 is a diagram illustrating a commemorative photo event, which is an example of a special activity according to this embodiment. As shown on display screen 540 in FIG. 8, for example, in a press room, a user may take a commemorative photo of user avatar A and a director avatar.

[0069] 9 is a diagram illustrating a history video viewing event, which is an example of a special activity according to this embodiment. For example, a user can view a history video in a room (history room) that displays various team-related exhibits, such as a timeline of the team's history from its inception to the present, photos of past players, autographs, uniforms, etc. As shown on display screen 550 in FIG. 9, the history video viewing event may take place in a virtual room in which, for example, numerous video thumbnails and video previews are arranged on the walls and ceiling.

[0070] FIG. 10 is a diagram illustrating a history quiz event, which is an example of a special activity according to this embodiment. For example, in the virtual room described with reference to FIG. 9, a user can experience a history quiz. As shown on a display screen 560 in FIG. 10, for example, a quiz is displayed at the front of the virtual room, and option areas (e.g., areas for option A, option B, option C, and option D) are displayed on the floor. The user can select an option and answer by operating user avatar A and moving user avatar A to any option area.

[0071] The selection and start operations of the history video event and history quiz event described above can all be performed using the guide playback object arranged in the history room.

[0072] <<3-3. Displaying Menu Data>> Next, a display example of menu data will be described with reference to the drawings. The display format of the menu data is not particularly limited, but in this embodiment, a display format will be described in which, for example, a passport motif is used in collaboration with an airline company, a tour menu is displayed on each page, and stamps are placed on tour menus (each event) that have already been experienced. Note that the display format is not limited to collaborations, and may be a display format with a soccer ball or team uniform motif.

[0073] 11 is a diagram showing an example of a display of a menu data cover with a passport motif according to this embodiment. As shown on a display screen 600 in FIG. 11, for example, a cover image 602 showing the logo of a team and the logo of a partner airline side by side is displayed as the cover of the menu data. The user can turn the page by swiping horizontally or operating a button, and transition to the page of each tour menu.

[0074] 12 is a diagram showing an example of the display of a page of each tour menu of menu data using a passport motif according to this embodiment. As shown on a display screen 610 in FIG. 12, a page image 612 showing information about each tour menu is displayed. The page image 612 includes the name of the location to be guided, a thumbnail image of the location, a stamp image 614 to be pressed if the location has already been experienced, and a GO button 616 to move to the location. Puzzle pieces 618 (an example of an item) that can be collected at each location may also be displayed.

[0075] For example, in a guided tour conducted at a virtual soccer stadium, locations to be guided include the entrance, gym, press room, locker room, and history room. The tour organizer (e.g., the team management) prepares guide content for each of the entrance, gym, press room, locker room, and history room. Then, as menu data, tour menu pages corresponding to the entrance, gym, press room, locker room, and history room are displayed.

[0076] FIG. 13 is a diagram showing an example of a display page for checking the collection status of puzzle pieces included in menu data using a passport motif according to this embodiment. As shown on display screen 620 in FIG. 13, a page image 622 showing, for example, collected puzzle pieces is displayed. This allows the user to intuitively grasp the collection status of puzzle pieces. Furthermore, by completing an image such as a player's photo when all puzzle pieces are collected, the user's motivation to visit each tour menu location can be increased.

[0077] FIG. 14 is a diagram illustrating a reward that is awarded by experiencing the events of a guided tour according to this embodiment and collecting all stamps. As described above, when experiencing each event of the tour event, more specifically, when playing back the guide content by operating the guide playback object installed at the guided location, a stamp image 614 is pressed as shown in FIG. 12. In the tour event experience according to this embodiment, a predetermined reward may be awarded when all stamps are collected. Examples of the predetermined reward include items that can be used in the virtual space (items that can be worn on avatars, currency, points, specific avatar movements (also called emotes), etc.), bonus videos, tickets to participate in special events held in the virtual space, etc.

[0078] In this embodiment, when all events in the tour event are completed (i.e., all stamps are collected), a reward notification image 632 is displayed on the display screen 630 in FIG. 14 to notify the user of the item awarded as a reward. If the tour event is, for example, a tie-up with an airline, the item awarded as a reward may be an item related to the airline (e.g., a pilot hat). While the example described above illustrates a reward being awarded when all stamps are collected, this is not limiting. Multiple rewards may be prepared, and the type of reward or the number of rewards awarded may vary depending on the number of stamps collected (the number of events completed). Furthermore, when multiple rewards are set, displaying the number of stamps (the number of events completed) required to receive each reward on the screen is expected to further increase the user's motivation.

[0079] <4. Operation processing> FIG. 15 is a flowchart showing an example of the flow of the tour event execution process according to this embodiment.

[0080] As shown in FIG. 15, first, the client terminal 10 detects that the user has performed an operation to obtain a tour passport in the virtual space (step S103). The tour passport is an example of the right to participate in a tour event, and the user can obtain it in the virtual space. For example, it can be obtained by purchasing it at a shop, by clearing a specific event, by visiting a specific location, or by talking to a specific avatar. Alternatively, it can be obtained by receiving it from the management side.

[0081] Next, in response to obtaining the tour passport (ie, obtaining the right to participate in the tour event), the client terminal 10 obtains the tour menu data, user data, and tour event data from the server 20 (steps S106, S109, S112).

[0082] Next, the client terminal 10 acquires the guide content based on the storage location information of the guide content included in the tour event data (step S115).

[0083] Next, the client terminal 10 places a guide playback object at the location in the virtual space based on the information about the location of the guide target included in the tour event data (step S118). If there is information about multiple locations of the guide target, the client terminal 10 places a guide playback object at each of the multiple locations.

[0084] Next, the client terminal 10 determines whether or not the user has performed a guide start operation on the guide playback object (step S121). The client terminal 10 repeats the determination until the start operation is performed (step S121 / No).

[0085] If the start operation is performed (step S121 / Yes), the client terminal 10 starts playing back the guide content (step S124). The client terminal 10 continues playing back the guide content until the playing back of the guide content ends (step S127 / No).

[0086] Next, when the reproduction of the guide content has ended (step S127 / Yes), the client terminal 10 presses the stamp of the corresponding event on the display of the menu data (step S130).

[0087] Then, the client terminal 10 transmits the latest tour completion status of the user to the server 20 (step S133).

[0088] The above has described the flow of the tour event execution process according to this embodiment. Note that the operation process shown in Fig. 15 is an example, and this embodiment is not limited to this. The operation process shown in Fig. 15 does not have to be performed entirely in the order shown in Fig. 15; for example, some processes may be skipped, the order of some processes may be reversed, or some processes may be performed in parallel.

[0089] Specifically, for example, the client terminal 10 may acquire tour event data from the server 20 before an operation to obtain a tour passport is performed, and place a guide playback object in the virtual space based on information about the location of the guide target included in the tour event data. In this case, the client terminal 10 sets the guide playback object to an inactive state and activates it when the tour passport is obtained. Furthermore, when any operation is performed on an inactive guide playback object, the client terminal 10 performs control to display a message such as "Please obtain a tour passport."

[0090] In addition, in the above-mentioned operation process, it has been explained that the guide content is played back as a tour event in response to an operation on the guide playback object, but this is not limited to this, and a special activity may also be performed as a tour event.

[0091] <5. Variations> Next, a modification of this embodiment will be described.

[0092] The information processing system 1 according to this embodiment may link a tour event in a virtual space with the real world.

[0093] For example, the guide content to be played back may be an image captured by a camera installed at a corresponding location in real space. For example, an image captured by a camera installed in the gym of the stadium in real space may be displayed in a gym of a stadium in the virtual space. Such an image may be a real-time image. The client terminal 10 may receive an image captured by a camera installed in real space via the server 20, for example. Note that, for example, the identification information of the camera is used as the storage location information of the guide content.

[0094] The information processing system 1 may play back environmental sounds collected in the real world as environmental sounds during a tour event in a virtual space. For example, when a user operates a user avatar to tour a stadium in a virtual space, the information processing system 1 plays back cheers, chants, and the like collected in the stadium in the real world.

[0095] The information processing system 1 may track the movements of local people using various sensors, such as cameras, motion sensors, and depth sensors, installed in the real world and display them as avatars in a virtual space to reproduce the movements of the local people. The information processing system 1 may reflect the real-time movements of local people in avatars in the virtual space. That is, in the virtual space, a mixture of user avatars that move in response to user operations and that participate remotely from locations distant from the corresponding real-world locations, and avatars whose movements are tracked for users actually present in the corresponding real world, are displayed. The information processing system 1 may control the display of these avatars so that they can be distinguished. For example, the appearance of each avatar that tracks and reflects the movements of each user (spectator) in a stadium in the real world may all be the same, uniform avatar.

[0096] The information processing system 1 may display an image of the virtual space on a large display device located in the real world. For example, an image of a stadium in the virtual space may be displayed in a stadium in the real world. This allows local spectators to peek into the virtual space. Furthermore, if the movements of the local spectators are reflected in avatars in the virtual space displayed on the large display device, the local spectators can communicate with user avatars (avatars of users participating remotely) in the virtual space through gestures, emotes, and the like, via the movements of the avatars. Furthermore, the information processing system 1 may display an image of the virtual space on a large display device in the real world and also display images of local spectators in the virtual space. This allows communication between users participating in the virtual space and local spectators.

[0097] The information processing system 1 may display the text chat in the virtual space on a large display device located in the real world. The information processing system 1 may also convert the text chat in the virtual space into audio data and play it back in a stadium in the real world.

[0098] The information processing system 1 may enable chat (voice chat, text chat) between spectators in the stadium in the real world and users participating in the virtual space.

[0099] The information processing system 1 may display, in the virtual space, a video image captured of a virtual space being displayed on a large display device placed in a stadium in the real world.

[0100] <6. Hardware Configuration> An embodiment of the present disclosure has been described above. Next, an example of a hardware configuration used in at least one of the client terminal 10 and the server 20 according to an embodiment of the present disclosure will be described with reference to FIG.

[0101] 16 is a block diagram showing an example hardware configuration of an information processing device 900 according to an embodiment of the present disclosure. The information processing device 900 is an example of a hardware configuration applied to at least one of the client terminal 10 and the server 20 according to this embodiment. Note that the information processing device 900 does not necessarily have to have all of the hardware configuration shown in FIG.

[0102] 16, the information processing device 900 includes a CPU 901, a ROM (Read Only Memory) 903, and a RAM 905. The information processing device 900 may also include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input device 915, an output device 917, a storage device 919, a drive 921, a connection port 923, and a communication device 925. Instead of or in addition to the CPU 901, the information processing device 900 may have a processing circuit such as a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), or an ASIC (Application Specific Integrated Circuit).

[0103] The CPU 901 functions as an arithmetic processing unit and control unit, and controls all or part of the operations within the information processing device 900 in accordance with various programs recorded in the ROM 903, the RAM 905, the storage device 919, or the removable recording medium 927. The ROM 903 stores programs and calculation parameters used by the CPU 901. The RAM 905 temporarily stores programs used in the execution of the CPU 901 and parameters that change as appropriate during the execution. The CPU 901, the ROM 903, and the RAM 905 are interconnected by a host bus 907 constituted by an internal bus such as a CPU bus. Furthermore, the host bus 907 is connected to an external bus 911 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 909.

[0104] The input device 915 is a device operated by a user, such as a button. The input device 915 may include a mouse, a keyboard, a touch panel, a switch, a lever, or the like. The input device 915 may also include a microphone that detects the user's voice. The input device 915 may be, for example, a remote control device that uses infrared or other radio waves, or an externally connected device 929 such as a mobile phone that supports operation of the information processing device 900. The input device 915 includes an input control circuit that generates an input signal based on information input by the user and outputs the signal to the CPU 901. The user operates the input device 915 to input various data to the information processing device 900 and to instruct processing operations.

[0105] The input device 915 may also include an imaging device and a sensor. The imaging device is a device that captures real space and generates a captured image using an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) and various components such as a lens for controlling the formation of a subject image on the imaging element. The imaging device may capture a still image or a moving image.

[0106] The sensors include various types of sensors such as a distance measurement sensor, an acceleration sensor, a gyro sensor, a geomagnetic sensor, a vibration sensor, an optical sensor, and a sound sensor. The sensors acquire information about the state of the information processing device 900 itself, such as the attitude of the housing of the information processing device 900, and information about the surrounding environment of the information processing device 900, such as the brightness and noise around the information processing device 900. The sensors may also include a GPS (Global Positioning System) sensor that receives a GPS signal and measures the latitude, longitude, and altitude of the device.

[0107] The output device 917 is configured with a device capable of visually or audibly notifying the user of acquired information. The output device 917 may be, for example, a display device such as an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display, or an audio output device such as a speaker or headphones. The output device 917 may also include a PDP (Plasma Display Panel), a projector, a hologram, a printer, or the like. The output device 917 outputs the results obtained by processing by the information processing device 900 as video such as text or an image, or as sound such as voice or audio. The output device 917 may also include a lighting device that brightens the surroundings.

[0108] The storage device 919 is a data storage device configured as an example of a storage unit of the information processing device 900. The storage device 919 is configured, for example, by a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, or a magneto-optical storage device. The storage device 919 stores programs and various data executed by the CPU 901, as well as various data acquired from the outside.

[0109] The drive 921 is a reader / writer for a removable recording medium 927 such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and is built into or externally attached to the information processing device 900. The drive 921 reads information recorded on the attached removable recording medium 927 and outputs the information to the RAM 905. The drive 921 also writes information to the attached removable recording medium 927.

[0110] The connection port 923 is a port for directly connecting a device to the information processing device 900. The connection port 923 may be, for example, a USB (Universal Serial Bus) port, an IEEE 1394 port, or a SCSI (Small Computer System Interface) port. The connection port 923 may also be an RS-232C port, an optical audio terminal, or an HDMI (registered trademark) (High-Definition Multimedia Interface) port. By connecting an external device 929 to the connection port 923, various types of data can be exchanged between the information processing device 900 and the external device 929.

[0111] The communication device 925 is, for example, a communication interface configured with a communication device for connecting to the network 931. The communication device 925 may be, for example, a communication card for a wired or wireless local area network (LAN), Bluetooth (registered trademark), Wi-Fi (registered trademark), or WUSB (Wireless USB). The communication device 925 may also be a router for optical communication, a router for an asymmetric digital subscriber line (ADSL), or a modem for various types of communication. The communication device 925 transmits and receives signals, for example, between the Internet and other communication devices using a predetermined protocol such as TCP / IP. The network 931 connected to the communication device 925 is a network connected by wire or wirelessly, for example, the Internet, a home LAN, infrared communication, radio wave communication, or satellite communication.

[0112] <7. Supplementary Information> Although the preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, the present technology is not limited to such examples. It is clear that a person skilled in the art of the present disclosure can conceive of various modified or altered examples within the scope of the technical ideas described in the claims, and it is understood that these also naturally fall within the technical scope of the present disclosure.

[0113] For example, in the above embodiment, an event in which multiple guide locations are set and corresponding guide playback content is provided is referred to as a "tour," but the name is not limited to this and may also be a "stamp rally," "facility tour," "marathon," etc.

[0114] At least a part of the functional configuration of the client terminal 10 according to this embodiment may be realized in the server 20.

[0115] The entire functional configuration of the client terminal 10 may be realized by the server 20, and the server 20 may transmit information on the display screen to the client terminal 10, and the client terminal 10 may transmit information on user operations to the server 20.

[0116] The client terminal 10 may be configured from one or more information processing devices.

[0117] Furthermore, the information processing system 1 according to this embodiment may be composed of a server 20 and a client terminal 10, or may be applied to a server 20 having the functional configuration of the client terminal 10 shown in FIG. 3, or may be applied to the client terminal 10 shown in FIG. 3.

[0118] One or more computer programs can also be created to cause the hardware, such as the CPU, ROM, and RAM, built into the above-mentioned server 20 or client terminal 10 to perform the functions of the server 20 or client terminal 10. Also provided is a computer-readable storage medium storing the one or more computer programs.

[0119] The effects described herein are merely descriptive or exemplary and are not limiting. That is, the technology according to the present disclosure may achieve other effects in addition to or in place of the above-described effects that would be apparent to a person skilled in the art from the description herein.

[0120] The present technology can also be configured as follows. (1) a virtual space display processing unit that places, in a virtual space, a virtual object associated with identification information that identifies the content; a content acquisition unit that acquires the content based on the identification information; a playback processing unit that plays back the content; Equipped with The content is content related to a location where the virtual object is placed. Information processing system. (2) The information processing system according to (1), further comprising an event processing unit that causes the playback processing unit to execute a playback event of the content in response to a start operation by a user on the virtual object. (3) an information acquisition unit that acquires placement location information and the identification information of the virtual object; the virtual space display processing unit performs processing to place the virtual object at the location indicated by the placement location information. The information processing system according to (2) above. (4) There are a plurality of pieces of placement location information, the virtual objects are placed at a plurality of locations in a virtual space, The content to be played is content related to each location. The information processing system according to (3) above. (5) The placement location information is information indicating a type of a specific location in the virtual space. The information processing system according to (4) above. (6) The information processing system according to any one of (1) to (5), wherein the identification information is information indicating a location where the content is stored. (7) the content is audio or video; the playback processing unit plays back the audio or displays the video in a superimposed manner in the virtual space, The information processing system according to any one of (1) to (5) above. (8) a user data processing unit that acquires user data including at least information regarding a progress status of an event provided to a user in response to an operation on the virtual object, and updates the user data based on an execution result of the event output from the event processing unit; a menu data acquisition unit that acquires menu data for an event; a display processing unit that displays the menu data; Furthermore, the display processing unit visualizes and displays the progress of the event in the display of the menu data. The information processing system according to any one of (2) to (4) above. (9) The information processing system according to (8), wherein the display processing unit displays a predetermined image for an event that has already been executed when displaying the menu data. (10) The information processing system according to (9), wherein the predetermined image is a stamp image. (11) The information processing system according to (9), wherein the predetermined image is a puzzle piece image corresponding to an event that has already been performed. (12) The information processing system according to any one of (9) to (11), wherein the display processing unit displays, in the display of the menu data, a reward to be given to the user according to the number of events that have been executed. (13) the content is guide content that provides an explanation regarding a location where the virtual object is placed, The menu data is guided tour data including a list of events to be offered at each location in the virtual space. The information processing system according to any one of (8) to (12) above. (14) The virtual space is a reproduction of a real space, The guide content is an image captured in the real space. The information processing system according to (13) above. (15) The processor: Placing a virtual object associated with identification information that identifies content in a virtual space; acquiring the content based on the identification information; playing the content; Including, The content is content related to a location where the virtual object is placed. Information processing methods. (16) Computer, a virtual space display processing unit that places, in a virtual space, a virtual object associated with identification information that identifies the content; a content acquisition unit that acquires the content based on the identification information; a playback processing unit that plays back the content; It functions as The content is content related to a location where the virtual object is placed. program. [Explanation of symbols]

[0121] 1. Information Processing Systems 10 Client Terminal 110 Communications Department 120 Operation section 130 Control Unit 131 Tour Menu Data Acquisition Unit 132 User data processing section 133 Tour menu display processing unit 134 Tour Event Data Acquisition Department 135 Guide Content Acquisition Department 136 Virtual space display processing unit 137 Tour Event Processing Department 138 Guide content playback processing unit 140 Storage section 150 Display section 160 Audio output section 20 servers 210 Communications Department 220 Control Unit 230 Storage section 30 CDN 40 Network

Claims

1. a virtual space display processing unit that places, in a virtual space, a virtual object associated with identification information that identifies the content; a content acquisition unit that acquires the content based on the identification information; a playback processing unit that plays back the content; Equipped with The content is content related to a location where the virtual object is placed. Information processing system.

2. The information processing system according to claim 1 , further comprising an event processing unit that causes the playback processing unit to execute a playback event of the content in response to a start operation by a user on the virtual object.

3. an information acquisition unit that acquires placement location information and the identification information of the virtual object; the virtual space display processing unit performs processing to place the virtual object at the location indicated by the placement location information. The information processing system according to claim 2 .

4. There are a plurality of pieces of placement location information, the virtual objects are placed at a plurality of locations in a virtual space, The content to be played is content related to each location. The information processing system according to claim 3 .

5. The placement location information is information indicating a type of a specific location in the virtual space. The information processing system according to claim 4 .

6. The information processing system according to claim 1 , wherein the identification information is information indicating a location where the content is stored.

7. the content is audio or video; the playback processing unit plays back the audio or displays the video in a superimposed manner in the virtual space, The information processing system according to claim 1 .

8. a user data processing unit that acquires user data including at least information regarding a progress status of an event provided to a user in response to an operation on the virtual object, and updates the user data based on an execution result of the event output from the event processing unit; a menu data acquisition unit that acquires menu data for an event; a display processing unit that displays the menu data; Furthermore, the display processing unit visualizes and displays the progress of the event in the display of the menu data. The information processing system according to claim 2 .

9. The information processing system according to claim 8 , wherein the display processing unit displays a predetermined image for an event that has already been executed in displaying the menu data.

10. The information processing system according to claim 9 , wherein the predetermined image is a stamp image.

11. The information processing system according to claim 9 , wherein the predetermined image is a puzzle piece image corresponding to an executed event.

12. The information processing system according to claim 9 , wherein the display processing unit displays, in the display of the menu data, a reward to be given to the user in accordance with the number of events that have been executed.

13. the content is guide content that provides an explanation regarding a location where the virtual object is placed, The menu data is guided tour data including a list of events to be offered at each location in the virtual space. The information processing system according to claim 8 .

14. The virtual space is a reproduction of a real space, The guide content is an image captured in the real space. The information processing system according to claim 13.

15. The processor: Placing a virtual object associated with identification information that identifies content in a virtual space; acquiring the content based on the identification information; playing the content; Including, The content is content related to a location where the virtual object is placed. Information processing methods.

16. Computer, a virtual space display processing unit that places, in a virtual space, a virtual object associated with identification information that identifies the content; a content acquisition unit that acquires the content based on the identification information; a playback processing unit that plays back the content; It functions as The content is content related to a location where the virtual object is placed. program.

Citation Information

Patent Citations

  • Distribution server, program, and distribution system

    JP2023121967A