Program, information processing method, and information processing system

Abstract

To provide an information processing system allowing many users to share information shared by users in a memorable manner.SOLUTION: An information processing system 1 includes: a first display control part for displaying a first UI element for activating a browser in an application, on a screen of a virtual space; an activation part for activating the browser in the application when receiving an operation of a user on the first UI element; a second display control part for displaying a second UI element for sharing information displayed on the browser in the application; a sharing part, when receiving an operation of the user 10 on the second UI element, transmitting, to a server, a share request to share the information displayed on the browser in the application with other devices used by other users 10 viewing a screen of the virtual space; and a third display control part for displaying the information displayed on the browser in the application on a display object located in the virtual space as shared information.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a program, an information processing method, and an information processing system. [Background technology]

[0002] In social network services and the like, one user has already shared information posted on a website or the like with another user. For example, a Web sharing system described in Patent Document 1 includes a first communication terminal and a second communication terminal having a Web sharing application. The Web sharing application displays a Web sharing browser window. The Web sharing browser window of the first communication terminal is associated with the IP address of the second communication terminal. The Web sharing application of the first communication terminal displays a Web page of an inputted URL (Uniform Resource Locator) in the Web sharing browser window. The second communication terminal acquires the URL inputted to the first communication terminal and displays the Web page in the Web sharing browser window. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2003-030121 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-mentioned Web sharing system, when a user shares information with other users, there is room for improvement in terms of the means used to impress other users with the shared information. [Means for solving the problem]

[0005] The program for solving the above problem causes one or more computers to function as a first display control unit that displays a first UI element that launches an in-app browser on a screen of a virtual space, a launch unit that launches the in-app browser when a user's operation on the first UI element is received, a second display control unit that displays a second UI element for sharing information displayed in the in-app browser, a sharing unit that sends a sharing request to a server when the user's operation on the second UI element is received to share the information displayed in the in-app browser with another device used by another user who views the screen of the virtual space, and a third display control unit that displays the information displayed in the in-app browser on a display object located in the virtual space as shared information.

[0006] An information processing method for solving the above problem includes a first display control process in which one or more computers display a first UI element for launching an in-app browser on a screen of a virtual space, a launch process for launching the in-app browser when a user's operation on the first UI element is received, a second display control process for displaying a second UI element for sharing information displayed in the in-app browser, and a sharing process for transmitting a sharing request to a server when a user's operation on the second UI element is received, to share the information displayed in the in-app browser with another device used by another user viewing the screen of the virtual space. and a third display control process for displaying the information displayed in the in-app browser as shared information on a display object located in the virtual space.

[0007] An information processing system that solves the above problem includes a first display control unit that displays a first UI element that launches an in-app browser on a screen of a virtual space, a launch unit that launches the in-app browser when a user's operation on the first UI element is received, a second display control unit that displays a second UI element for sharing information displayed in the in-app browser, a sharing unit that sends a sharing request to a server when the user's operation on the second UI element is received to share the information displayed in the in-app browser with another device used by another user who views the screen of the virtual space, and a third display control unit that displays the information displayed in the in-app browser on a display object located in the virtual space as shared information.

[0008] In this disclosure, a "browser" includes at least one of an in-app browser and a web browser installed separately from a program. Effect of the Invention

[0009] According to the present invention, it is possible for information to be shared by a user to be shared with many users in a manner that is likely to leave a lasting impression. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic diagram illustrating an information processing system according to a first embodiment. [Diagram 2] FIG. 2 is a diagram illustrating a hardware configuration of a device such as a user device according to the embodiment. [Diagram 3] FIG. 2 is a diagram illustrating user information according to the embodiment. [Figure 4] FIG. 2 is a diagram illustrating the browsing information of the embodiment. [Diagram 5] FIG. 2 is a block diagram illustrating functions of a user device according to the embodiment. [Figure 6] 3A to 3C are schematic diagrams illustrating the drawing process of a display object and an avatar object in the embodiment. [Figure 7]11 is a flowchart showing a processing procedure of a user device according to the embodiment. [Figure 8] 11A and 11B are diagrams illustrating a screen displayed on a user device according to the embodiment. [Figure 9] 11A and 11B are diagrams illustrating a screen displayed on a user device according to the embodiment. [Figure 10] 11A and 11B are diagrams illustrating a screen displayed on a user device according to the embodiment. [Figure 11] 11A and 11B are diagrams illustrating a screen displayed on a user device according to the embodiment. [Figure 12] 13 is a flowchart showing a processing procedure of a user device according to the second embodiment. [Figure 13] 11A and 11B are diagrams illustrating a screen displayed on a user device according to the embodiment. [Figure 14] 11A and 11B are diagrams illustrating a screen displayed on a user device according to the embodiment. [Figure 15] 13 is a flowchart showing a processing procedure of a user device according to the third embodiment. [Figure 16] 11A and 11B are diagrams illustrating a screen displayed on a user device according to the embodiment. [Figure 17] 11A and 11B are diagrams illustrating a screen displayed on a user device according to the embodiment. [Figure 18] 13A and 13B are diagrams illustrating screens displayed on a user device in the fourth embodiment. [Figure 19] FIG. 13 is a diagram illustrating a screen displayed on a user device in the fifth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] (First embodiment) Hereinafter, a first embodiment of a program, an information processing method, and an information processing system will be described.

[0012] <Information processing system> An information processing system 1 will be described with reference to FIG. 1. The information processing system 1 includes a management server 15 and a user device 20. The management server 15 and the user device 20 transmit and receive data via a network such as the Internet. In this embodiment, the information processing system 1 is a system capable of distributing a video in which a user 10 displays a virtual space using the user device 20. The information processing system 1 provides a movable space in which the user 10 can move between positions (hereinafter, virtual positions) in the virtual space. The movable space is also called a world or a field. The user device 20 displays an image (video) of the virtual space as viewed from the virtual position according to a user's operation.

[0013] The management server 15 is connected to a user device 20 via a network. The user device 20 is a device in which an application for distributing and viewing videos is installed (implemented), or a device used by a user 10 who has registered with a video providing service for distributing and viewing videos. The management server 15 is responsible for relaying data related to video distribution. The management server 15 includes a user information storage unit 16 and a browsing information storage unit 17.

[0014] A user 10 who distributes a video using a user device 20 is called a distributor user 11, and a user who watches the distributed video is called a viewing user 12. A user 10 can be both a distributor user 11 and a viewing user 12. That is, when a user 10 distributes a video, the user 10 is a distributor user 11, and when the user watches a video, the user 10 is a viewing user 12. In addition, a user device 20 used by a distributor user 11 is called a distributor user device 21, and a user device 20 used by a viewing user 12 is called a viewing user device 22. In this embodiment, when the distributor user 11 and the viewing user 12 are not distinguished from each other, the user device 20 is simply called a user device 10. In addition, when the distributor user device 21 and the viewing user device 22 are not distinguished from each other, the user device 20 is simply called a user device 20. In addition, in this embodiment, a distributor user 11 is a sharer who shares information. In addition, when there are multiple distributor users 11, the distributor user 11 can be a sharee who views information shared by other distributor users 11. In addition, a viewing user 12 is a sharee who views the shared information. In addition, sharing of information can be rephrased as providing information. Moreover, a sharer can be rephrased as a provider of information.

[0015] The broadcast user device 21 is capable of broadcasting videos in which the virtual positions of multiple broadcast users 11 are located in the same virtual space. Broadcasting videos by multiple users in the same virtual space is called collaboration broadcasting. Hereinafter, a broadcast user 11 who requests the generation of a room, which is a virtual space shared by a group of broadcast users 11, is called a host user 11H, and a broadcast user 11 who participates in the room generated by the host user 11H is called a guest user 11G.

[0016] Asset data of a movable space is stored in the management server 15. In the movable space, a plurality of objects are set at predetermined positions. The management server 15 receives a room creation request and identification information of a movable space specified by the user 10 from the user device 20. Then, the management server 15 creates a room for the specified movable space, with the user 10 who sent the room creation request as the host user 11H. For example, the management server 15 receives, from the broadcasting user device 21 of the host user 11H, identification information of a room for a "shopping mall world" that includes objects such as stores and products, and a room creation request. The management server 15 creates the room and transmits asset data to the broadcasting user device 21 of the host user 11H.

[0017] In this embodiment, the user 10 can participate in the collaboration distribution as a guest user by accepting the participation request of the host user 11H or by having the participation request sent by the user 10 approved by the host user 11H. In the former method, the host user 11H selects a user who sends a participation request from a list of users. The list includes users who have mutually accepted each other. When the distribution user device 21 of the host user 11H accepts the operation of the participation request, it transmits the participation request and the identification information of the selected user to the management server 15. The user device 20 of the selected user 10 receives the participation request via the management server 15. The user device 20 accepts the user 10's operation of accepting the participation request. The user device 20 transmits the participation request to the management server 15. When the management server 15 receives the participation request in response to the participation request, it associates the identification information of the user who sent the participation request with the room. This makes this user a guest user 11G. Also, in the latter method, the user device 20 accepts the operation of the participation request of the user 10 on the room list screen or the like. The user device 20 transmits the room identification information and a join request to the management server 15. The management server 15 transmits an approval request for the join request to the broadcast user device 21 of the host user 11H. The host user 11H performs an operation to approve the approval request displayed on the broadcast user device 21. The broadcast user device 21 transmits approval information to the management server 15 based on this approval operation. When the management server 15 receives a join request in response to the join request, it associates the identification information of the user who transmitted the join request with the room, thereby making the user who transmitted the join request a guest user 11G.

[0018] The viewing user 12 can start viewing a video by selecting a video (room) that he / she wants to view from a video list screen displayed by the application or a video list screen of the website of the video providing service. The viewing user device 22 receives drawing data for displaying a video from the management server 15 without going through the approval of the distribution user 11.

[0019] <Hardware configuration> The hardware configuration of the user device 20 will be described with reference to FIG. 2. The user device 20 is a smartphone (multi-function phone terminal), a tablet terminal, a personal computer, a console game machine, a wearable computer, or an information processing device capable of playing videos other than these devices. The wearable computer may have a screen on which the user can watch videos. For example, it may be a head-mounted display worn on the user's head, or a glasses-type wearable terminal. The user device 20 may be a device that operates independently, or may be composed of multiple devices that are connected to each other so that various data can be transmitted and received between them. An example of the latter user device 20 is, for example, a system that performs tracking using an outside-in method.

[0020] 2 shows a configuration of a user device 20 equipped with a sensor unit 112 that detects the motion of the broadcast user 11. Note that the sensor unit 112 may be a device separate from the user device 20 and communicatively connected to the user device 20.

[0021] The user device 20 includes a processing circuit 100 , a storage 104 , a sensor unit 112 , a display 109 , a touch panel 110 and peripheral devices 111 . The processing circuit 100 includes a CPU 101, which is a processor that executes one or more of the control processes disclosed in this specification, and a memory 102. Processing data and instructions may be stored in the memory 102. In addition, these processing data and instructions may be stored in a storage 104, which is a storage medium disk such as a hard drive (HDD) or a portable storage medium, or may be stored in a storage medium provided separately from the processing circuit 100. The storage 104 is connected to the CPU 101 via a bus 108 and a storage controller 103. In this embodiment, an application is stored in the storage 104. The application includes a program for distributing and viewing videos, and various data required for executing the program.

[0022] Each function disclosed herein may be implemented using a circuit that may include, but is not limited to the CPU 101, a general-purpose processor, a special-purpose processor, an integrated circuit, an ASIC (Application Specific Integrated Circuits), a conventional circuit, and / or a combination thereof, configured or programmed to perform the disclosed functions. A processor is a processing circuit or circuit since it includes transistors and other circuits therein. A processor may be a programmed processor that executes a program stored in a memory. In this disclosure, a processing circuit, each display control unit, or other unit or means is hardware that performs or is programmed to perform the mentioned functions. The hardware may be any hardware disclosed herein or otherwise known that is programmed or configured to perform the mentioned functions.

[0023] Furthermore, the processor is not limited by the form of computer readable medium on which the instructions of the process are stored. For example, the instructions may be stored on a CD, DVD, FLASH memory, RAM, ROM, PROM, EPROM, EEPROM, hard disk or other non-transitory computer readable medium of an information processing device with which the processing circuit 100 communicates, such as a server or computer. The process may also be stored in network-based storage, cloud-based storage, or other mobile-accessible storage and executable by the processing circuit 100.

[0024] The descriptions or blocks in the flowcharts disclosed herein may be understood to represent modules, segments, or portions of code that include one or more executable instructions for implementing specific logical functions or steps in a process. Also, the descriptions or blocks may perform functions in a different order than that shown or described in the specification, such as substantially simultaneously or in reverse order.

[0025] The hardware elements for implementing the processing circuit 100 may be implemented by various circuit elements. Furthermore, the functions of the above-described embodiments may be implemented by a circuit including one or more processing circuits.

[0026] The processing circuit 100 also includes a network controller 106 for connecting to a network NW. The network NW may be a public network such as the Internet, or a private network such as a local area network (LAN) or a wide area network (WAN), or any combination thereof, and may also include a public switched telephone network (PSTN) or an integrated services digital network (ISDN), or a sub-network. The network NW may also be wired, such as an Ethernet network, a universal serial bus (USB) cable, or wireless, such as a cellular network, including 3G, 4G, and 5G wireless cellular systems. The wireless network may also be Wi-Fi, wireless LAN, Bluetooth, or other forms of wireless communication known in the art. Furthermore, the network controller 106 may be compliant with other direct communication standards, such as Bluetooth, near field communication (NFC), infrared, etc.

[0027] The processing circuit 100 further includes a display controller 105 and an input / output interface 107. These are connected to a bus 108. The display controller 105 is connected to a display 109. The input / output interface 107 is connected to a touch panel 110 and a peripheral device 111.

[0028] The sensor unit 112 will be described. The sensor unit 112 is one or more sensors that detect face motions indicating changes in the user's facial expression and body motions indicating changes in the relative position of the user's body with respect to the sensor unit 112. Face motions include blinking, opening and closing of the mouth, and other movements. The sensor unit 112 may be a publicly known sensor. The sensor unit 112 has a sensor that measures the distance to a measurement object by irradiating the measurement object with light. For example, a true depth sensor or a "LIDAR" (Light Detection and Ranging, or Laser Imaging Detection and Ranging) sensor may be used. For example, the light emitting unit projects tens of thousands of invisible dots (points) onto the user's face or the like using a dot projector. Then, the reflected light of the dot pattern is detected and analyzed to form a depth map of the face, and an infrared image of the face or the like is captured, thereby capturing accurate face data. The arithmetic processing unit of the sensor unit 112 generates various information based on the depth map and the infrared image, and compares the information with registered reference data to calculate the depth of each point on the face (the distance between each point and the near-infrared camera) and positional deviations other than the depth. Another example of the sensor unit 112 includes at least one of a ToF sensor that measures the time of flight or phase difference until light irradiated toward the user is reflected by a measurement target such as the user's face and returns using a distance measurement method other than the above-mentioned method, a camera that captures the user's face, and an image processing unit that processes the data captured by the camera. The ToF sensor calculates the distance to the measurement target based on the time of flight or phase difference.

[0029] The sensor unit 112 outputs the facial motion and body motion to the processing circuit 100 as tracking data. The tracking data is included in the motion data. Motion data generally refers to data for moving an avatar object. For example, the motion data includes, in addition to the tracking data, data for making the avatar object perform a pre-registered predetermined motion such as "clap". Such pre-registered motion of the avatar object is hereinafter referred to as an "emote". Data for executing an emote is referred to as emote data.

[0030] Furthermore, the sensor unit 112 may have a function of tracking not only the user's face but also the hands (hand tracking). The sensor unit 112 may also include a sensor that detects the position or orientation of a human body part other than the hand. The sensor unit 112 may further include a sensor that detects speed or acceleration, a sensor that detects direction or orientation (such as a gyro sensor), etc. The sensor unit 112 may have a spatial mapping function that recognizes objects in the real space where the user exists based on the detection results of the various sensors described above, and maps the recognized objects on a spatial map.

[0031] The peripheral device 111 includes a microphone and a speaker. The peripheral device 111 may be an operation button provided on the housing of the user device 20, a keyboard, a mouse, a controller operated by the user's hand, or the like. The controller may incorporate various known sensors such as an acceleration sensor, an inertial measurement unit (IMU) such as a gyroscope, or the like. Another example of the peripheral device 111 may be a tracking device that identifies the user's hand movement, eye movement, head movement, line of sight, and the like. In this aspect, for example, a user's instruction is determined based on the user's hand movement, and various operations such as starting or ending distribution of a video, rating a message or a video, and displaying a predetermined object can be performed. Note that, when the user device 20 includes an input device such as a mouse or a controller as the peripheral device 111, the touch panel 110 may be omitted. When the user device 20 includes a touch panel 110, the input device such as a mouse or a controller may be omitted.

[0032] The management server 15 includes a processing circuit 100 having a configuration similar to that of the user device 20. The management server 15 may omit the sensor unit 112, the peripheral devices 111 such as a speaker and a microphone, the display 109, and the like.

[0033] A video application installed in the storage 104 will be described. The application includes a native unit implemented in the user device 20. The native unit runs on an OS (Operating System) of the user device 20, and is capable of accessing resources such as the storage 104 of the user device 20. The native unit displays video on the display 109 based on drawing data received from the management server 15.

[0034] In one aspect, the application includes an in-app browser. The in-app browser is a component that realizes a browser function such as WebView included in the application. The WebView is incorporated in the application, and is, for example, an API (Application Programming Interface) such as SFSafariView or WKWebView. The in-app browser includes an analysis unit and a display control unit. The in-app browser displays acquired web data on a screen and executes JavaScript (registered trademark) by interpreting HTML, CSS, etc. in the same way as an independent web browser. The web data is data such as an HTML file required for the in-app browser to display a screen on the display 109. The web data is composed of one or more files. For example, the web data is a file written in a markup language such as HTML (Hyper Text Markup Language), JavaScript (registered trademark), etc., a CSS (Cascading Style Sheets) file, an external file written in JavaScript (registered trademark), etc. The in-app browser requests web data corresponding to a specified URL from an external web server 120 (see FIG. 1) or management server 15. The in-app browser acquires web data from the web server 120 or management server 15.

[0035] Furthermore, if the received web data is HTML data, the analysis unit of the in-app browser of the user device 20 performs HTML analysis. If the received web data includes image data in JPEG format, GIF format, PNG format, or the like, the analysis unit of the in-app browser causes the display processing unit of the in-app browser to perform display processing.

[0036] As another aspect, when an application receives a predetermined input operation from the user, the application may launch a web browser installed separately from the application on the user device 20. In this embodiment, the application will be described as having an in-app browser. In this embodiment, the in-app browser will be described separately from the web browser installed on the user device 20 separately from the application. In the following, when at least one of the in-app browser and the web browser is included, it will be simply referred to as a "browser".

[0037] <Data Structure> The user information 30 and the browse information 31 will be described with reference to FIG. 3 and FIG. FIG. 3 shows an example of user information 30 recorded in the user information storage unit 16. The user information 30 is recorded for each user. The user information 30 includes a user ID (identifier) ​​that is user identification information, accumulated points, and coins. The accumulated points are points that are awarded for video-related activities such as distribution and viewing of videos, and are accumulated for each user. The coins are virtual currency purchased by the user. The coins can be used as payment for items, gift objects, or parts of avatar objects in an application or a platform that provides the application.

[0038] FIG. 4 shows an example of the browsing information 31 recorded in the browsing information storage unit 17. The browsing information 31 indicates information that can be displayed in the in-app browser of the user device 20. The browsing information 31 includes world identification information, browsing permission information, and location information. The world identification information is a name or identifier of a movable space (world) in which the browsing information is displayed. The browsing permission information is a URL or domain of a website that is permitted to be browsed in the in-app browser. For example, the world identification information of "Shopping Mall World" may be associated with the URL of a top page of an EC site that sells products such as clothes, miscellaneous goods, and electrical appliances. The products of the EC site may be products that are distributed in the real world and that the user 10 can use in the real world. Or the products may be products that can be used in a virtual space. Products that can be used in a virtual space include, for example, items that can be worn by an avatar object. Products that can be used in a virtual space may be products that can be purchased and used in the virtual space.

[0039] The location information is recorded when the browsing information displayed in the in-app browser is changed depending on the location in the movable space. For example, in "Shopping Mall World," a webpage of an e-commerce site selling clothes is displayed in or near a virtual store selling clothes. Also, a webpage of an e-commerce site selling furniture is displayed in or near a virtual store selling furniture. In this case, the coordinate range of the movable space is recorded in association with the browsing permission information.

[0040] <User device functions> The functions of the user device 20 will be described with reference to Fig. 5. The processing circuit 100 of the user device 20 executes a program to function as a first display control unit 36, a second display control unit 37, a third display control unit 38, a startup unit 39, and a sharing unit 40.

[0041] The first display control unit 36 ​​displays a first UI element for activating an in-app browser on a screen displaying a virtual space. The first UI element is a character string associated with a destination URL, a GUI (Graphical User Interface) such as a button, an image element displayed on the in-app browser screen, or an object located in the virtual space.

[0042] The second display control unit 37 displays a second UI element for sharing information displayed in the in-app browser. In this embodiment, the first display control unit 36 ​​and the second display control unit 37 function only in a distribution mode in which videos are distributed.

[0043] The third display control unit 38 displays the information displayed in the in-app browser as shared information on a display object located in the virtual space. The shared information is information displayed in the in-app browser on the user's own device and requested to be shared by the user 10. Alternatively, the shared information is information requested to be shared by another user 10.

[0044] The launch unit 39 launches the in-app browser when an operation by the user 10 on the first UI element is accepted. In this embodiment, the launch unit 39 launches the in-app browser only in the delivery mode. The in-app browser acquires web data associated with the first UI element and displays a screen based on the web data.

[0045] When the sharing unit 40 receives an operation by the user 10 on the second UI element, the sharing unit 40 transmits a sharing request to the management server 15 to share the information displayed in the in-app browser with another user device 20 (another device) used by another user 10 viewing the screen of the virtual space. In this embodiment, the sharing unit 40 transmits the sharing request to the management server 15 only in the distribution mode.

[0046] The function of the third display control unit 38 will be described in detail with reference to Fig. 6. A general object 50 and an avatar object 60 are located in the movable space 73. Here, the general object 50 refers to an object other than the avatar object 60 other than the avatar object corresponding to the broadcast user 11. A world coordinate system (X, Y, Z) is set in the movable space 73. An object coordinate system (x, y, z) is set for the general object 50.

[0047] One or more display objects 51 are located in the movable space 73. The display object 51 is an example of a general object 50. The display object 51 can display shared information 55 shared by the distribution user 11. In this embodiment, the shared information 55 is an image such as a still image in JPEG format, GIF format, PNG format, or the like, or a video based on video data such as MPEG4.

[0048] In the example of FIG. 6, the display object 51 is an object consisting of a two-dimensional plane with no thickness. As another example, the display object 51 may be a two-dimensional object with projections and recesses, or a three-dimensional object. The display object 51 can be arranged in a three-dimensional virtual space such as a movable space 73. The two-dimensional display object 51 may be set in association with a three-dimensional general object 50 (in a parent-child relationship) as shown on the left side of FIG. 6. In this case, the display object 51 follows the movement of the general object 50. Alternatively, the display object 51 may be set alone in the movable space 73 as shown on the right side of FIG. 6.

[0049] The display object 51, or the display object 51 and the general object 50 associated therewith, is displayed as a moving object such as a digital signage, a display, a screen, a car, or an airship.

[0050] The third display control unit 38 projects an image based on the web data displayed by the in-app browser onto the display object 51 as the shared information 55 by a technique such as texture mapping. At this time, the third display control unit 38 may process the web data to generate an image to be projected. For example, the third display control unit 38 may extract an image element that was displayed on the browser screen when an operation was performed on the second UI element 72. The image element is data embedded in the web data, and is, for example, image data in a JPEG format, a GIF format, or a PNG format. Alternatively, the image element is image data that displays a video in an MPEG4 format, an AVI format, a MOV format, an FLV format, or the like. Alternatively, the third display control unit 38 may extract an image element with the highest priority from the web data. The third display control unit 38 extracts an image element with a high priority from the image data embedded in the web data. Alternatively, the third display control unit 38 may obtain an image captured from a screen displayed on the browser screen.

[0051] The third display control unit 38 simultaneously displays the shared information 55 for all the display objects 51 arranged within the movable space 73. When a plurality of display objects 51 are located, the third display control unit 38 may display the shared information 55 at different times.

[0052] An object coordinate system is set for the avatar object 60 (not shown). Furthermore, a virtual camera 65 corresponding to each broadcast user 11 is located in the movable space 73. The virtual camera 65 is associated with the avatar object 60. When the avatar object 60 moves by walking or running based on the operation of the broadcast user 11, the virtual camera 65 also follows. As another example, the virtual camera 65 may be a fixed camera fixed at a certain position. For convenience, only one virtual camera 65 is shown in FIG. 6, but if three broadcast users 11 are participating in a collaborative broadcast, three virtual cameras 65 are set.

[0053] The third display control unit 38 renders an image of a predetermined field of view range centered on the optical axis of the virtual camera 65. Then, the third display control unit 38 outputs to the display 109 an image of the movable space 73 as seen from the position of the virtual camera 65. The rendering here refers to a drawing process including acquisition of the position of the virtual camera, perspective projection, hidden surface removal based on depth information associated with each object, and the like. The rendering may be at least one of these processes, or may include processes such as shading and texture mapping.

[0054] The position of the virtual camera 65 can be changed by the broadcasting user 11. For example, the broadcasting user 11 can select a first-person viewpoint (avatar position) or a third-person viewpoint as a setting for the position of the virtual camera 65. In the first-person viewpoint, rendering is performed in a state in which the eye position of the avatar and the position of the virtual camera 65 are aligned or nearly aligned. In this case, the line of sight of the avatar object 60 and the optical axis of the virtual camera 65 are nearly aligned. As a result, an image as if the movable space 73 is viewed from the avatar object 60 is displayed on the display 109. In the third-person viewpoint, the virtual camera 65 is set at a position around the avatar object 60, and rendering is performed so that the avatar object 60 is at the center of the screen. When the virtual camera 65 is set in the third-person viewpoint, an image of the avatar object 60 can be displayed on the screen. The broadcasting user device 21 may be capable of changing the position of the virtual camera 65 in the third-person viewpoint. Alternatively, an image may be generated using a multi-view camera in which one (or more) of the virtual cameras 65 arranged at three or more positions is selected.

[0055] <Video distribution and viewing methods> Next, a method for distributing or viewing a moving image will be described. As a method for distributing or viewing a moving image, one of a client rendering method, a browser rendering method, a video distribution method, and a server distribution method can be used.

[0056] The client rendering method is a method in which each user device 20 executes a program to render an object. The user device 20 receives drawing data for displaying a moving image from the management server 15. This drawing data is data used to render an image of a virtual space including an object. The drawing data includes at least motion data. The user device 20 draws an avatar object 60 using the motion data and the like. In this method, model data and the like of the avatar object 60 are recorded in the storage 104 of the user device 20.

[0057] The browser rendering method is a method in which the distributor user device 21 and the viewer user device 22 display moving images using a web browser stored in the storage 104. At this time, the distributor user device 21 transmits drawing data and the like to the management server 15. The user device 20 that displays moving images receives a web page written in a markup language such as HTML (Hyper Text Markup Language) and using CSS (Cascading Style Sheets), JavaScript (registered trademark), and the like from the management server 15. The web browser program started on the user device 20 draws avatar objects and other objects by JavaScript running on the browser. In this method, the user device 20 records data such as the URL of a web page for displaying moving images in the storage 104. In other words, model data of avatar objects and the like are not stored in the user device 20. In the case of the browser rendering method, an application may not be installed in the user device 20. Or, an application including an in-app browser may be installed in the user device 20.

[0058] The video distribution method is a method in which the broadcasting user device 21 generates video data. Specifically, the broadcasting user device 21 of the host user 11H draws objects using motion data and the like to generate video data. The broadcasting user device 21 also transmits the encoded video data and audio data to the management server 15. The management server 15 transmits the video data and audio data to the viewing user device 22. The viewing user device 22 displays the video on the display 109 based on the video data received from the broadcasting user device 21.

[0059] The server distribution method is a method in which the management server 15 generates video data. The management server 15 receives motion data and audio data from the broadcasting user device 21. The management server 15 then generates video data based on these data. The management server 15 transmits the generated video data to the broadcasting user device 21 and the viewing user device 22. The broadcasting user device 21 and the viewing user device 22 output video to the display 109 based on the received video data.

[0060] In this way, the generation of the moving image data is performed by either the user device 20 or the management server 15. The device that generates the moving image data can be changed depending on the distribution method. The broadcaster user device 21 and the viewer user device 22 may display moving images in different formats. For example, the broadcaster user device 21 may display moving images in a client rendering format, while the viewer user device 22 may display moving images in a browser rendering format. Also, the user may be allowed to select the method of displaying moving images. For example, some of the viewer user devices 22 may display moving images in a client rendering format, while other devices may display moving images in a browser rendering format.

[0061] In this embodiment, a client rendering method in which each user device 20 performs drawing by executing a program will be described in detail. As described above, storage 104 stores three-dimensional model data of avatar objects and other objects, etc. The three-dimensional model data is data recorded in storage 104 when a video application program is installed, data received from management server 15, or a combination thereof.

[0062] The three-dimensional model data of the avatar object will be described. This three-dimensional model data includes drawing data of the body parts that make up the main body of the avatar object, and the attachment parts that can be attached to the avatar object. The body parts are parts that make up the body parts of the avatar object. The data for drawing the body parts includes polygon data, skeletal data (bones) for expressing the movements of the avatar object, texture data, and the like. At least some of the body parts can be set arbitrarily by the user. In other words, the height, build, and the like of the avatar object can be selected by the user. The attachment parts include texture data, and the like. The broadcasting user 11 can set the attachment parts of the avatar object corresponding to himself / herself to his / her preferred parts.

[0063] The model data of the generic object 50 including the display object 51 includes data of buildings, walls, pillars, windows, furniture, digital signage (electronic billboards), screens, and moving objects such as automobiles and airships. The data of the generic object 50 includes polygon data, texture data, and the like.

[0064] The preparation process for video distribution and video viewing will be described. The broadcasting user device 21 transmits identification information (parts ID) indicating parts of an avatar object as drawing data to the management server 15. As described above, the drawing data is data used to render an image of a virtual space including an object. The management server 15 transmits the identification information indicating the parts to another user device 20 (other device). The other user device 20 draws an avatar object of the broadcasting user 11 based on the identification information indicating the parts.

[0065] The process of video distribution and video viewing will be described. The broadcasting user device 21 transmits room identification information, a user ID, and drawing data to the management server 15. The drawing data includes coordinate data indicating a virtual position and motion data. The broadcasting user device 21 also transmits audio data based on the audio collected by the microphone to the management server 15. The management server 15 transmits the received drawing data to the broadcasting user device 21 of another broadcasting user 11 participating in the room or the viewing user device 22 of the viewing user 12 viewing the video. A timestamp is added to the motion data, coordinate data, and audio data. The timestamp is generated based on reference time information based on the processing circuit 100 having a clocking function. Alternatively, the timestamp is generated based on reference time information transmitted from the management server 15 or reference time information acquired from another external server. The timestamp may represent the elapsed time from a reference time, or may represent the time of day.

[0066] The third display control unit 38 of the viewing user device 22 receives the drawing data, the user ID, and the voice data from the management server 15. Then, the third display control unit 38 draws an avatar object corresponding to the user ID using the drawing data. Also, the third display control unit 38 moves the avatar object using the motion data.

[0067] Furthermore, the third display control unit 38 receives data such as messages posted by other users from the management server 15. The third display control unit 38 outputs video data obtained by combining images obtained by rendering avatar objects and other objects with posted messages, notifications, and the like to the display 109. The third display control unit 38 also outputs audio data from the speaker in synchronization with the video data based on a time stamp.

[0068] <Operation> The operation of the broadcast user device 21 when broadcasting a moving image will now be described with reference to FIG. The broadcasting user device 21 and the viewing user device 22 receive asset data of the movable space 73 from the management server 15. The asset data includes model data for drawing each object in the movable space 73, background data, and viewing information 31 associated with the first UI element. The third display control unit 38 moves the avatar object 60 based on the operation of the broadcasting user 11, and displays on the display 109 a virtual space image of an area of ​​the movable space 73 designated by the broadcasting user 11.

[0069] The first display control unit 36 ​​of the broadcast user device 21 displays the first UI element on the screen displaying the virtual space. In this embodiment, only the broadcast user device 21 displays the first UI element. The viewing user device 22 does not display the first UI element.

[0070] The first display control unit 36 ​​receives an operation on the first UI element (step S1). When first display control unit 36 ​​accepts an operation on the first UI element, launch unit 39 launches the in-app browser (step S2). The in-app browser displays a screen based on the web data (step S3). Specifically, the in-app browser acquires a URL, which is viewing permission information associated with the first UI element. The in-app browser further requests the web data of the URL from web server 120 that provides the web data. Upon receiving the web data, the in-app browser analyzes and displays the web data. Note that, if location information is recorded in browsing information 31, the in-app browser acquires a URL corresponding to the coordinate range that includes the virtual location of broadcast user 11.

[0071] The second display control unit 37 displays the second UI element. The second UI element is displayed only by the broadcaster user device 21 that displays the web data in the in-app browser. In other words, the viewer user device 22 does not display the second UI element.

[0072] The second display control unit 37 accepts an operation by the broadcasting user 11 on the second UI element (step S4). When the operation is accepted by the second display control unit 37, the sharing unit 40 transmits a sharing request to the management server 15 (step S5). The sharing request includes the URL of the web data displayed in the in-app browser, the room identification information, and the user ID.

[0073] When the management server 15 receives the sharing request, it transmits sharing instruction information to the broadcaster user devices 21 used by the other broadcaster users 11 participating in the room and the viewing user devices 22 viewing the video in the room. The sharing instruction information includes the URL included in the sharing request. The sharing instruction information may also include a user ID (or account name).

[0074] The third display control unit 38 displays the shared information 55 based on the web page that is the subject of the sharing request on the display object 51 displayed on the own device (step S6). Specifically, if the display object 51 is included in the field of view of the virtual camera 65 corresponding to the broadcasting user 11, an image generated based on the web page is projected onto the display object 51.

[0075] The launch unit 39 may automatically close the in-app browser when the shared information 55 is displayed on the display object 51. Alternatively, the in-app browser may remain displayed unless the user 10 performs an operation to close the in-app browser.

[0076] Furthermore, when new sharing instruction information is received, the third display control unit 38 erases the already displayed shared information 55. The launch unit 39 outputs the URL included in the new sharing instruction information to the in-app browser. The in-app browser acquires web data using the acquired URL. When an operation of the second UI element 72 is accepted, an image based on the newly acquired web data is displayed on the display object 51. The third display control unit 38 repeats the display process on the display object 51 until the distribution of the video ends.

[0077] <Screen display> The screens displayed by the broadcast user device 21 will be described with reference to Figures 8 to 11. Note that Figures 8 to 11 show screens when the virtual camera 65 is positioned from a first-person perspective.

[0078] 8 shows a world selection screen 69 displayed by the application. The world selection screen 69 includes selection sections 69A-69C (banners) corresponding to a plurality of movable spaces 73. When any of the selection sections 69A-69C is selected, the third display control section 38 transmits a distribution start request to the management server 15. Upon receiving the distribution start request, the management server 15 designates the user 10 who transmitted the distribution start request as the host user 11H and generates a room. In addition, the management server 15 transmits asset data to the broadcasting user device 21 of the host user 11H.

[0079] As shown in Fig. 9 to Fig. 11, the third display control unit 38 displays a virtual space screen 70 using asset data. Specifically, the third display control unit 38 displays a general object 50 based on the asset data. In addition, the third display control unit 38 displays an avatar object 60 (see Fig. 11) corresponding to another broadcast user 11 using drawing data transmitted from another broadcast user device 21.

[0080] Fig. 9 shows a virtual space screen 70A including a first UI element 71. The third display control unit 38 displays the virtual space screen 70A according to the field of view of the virtual camera 65. In the example of Fig. 9, a display object 51 and a general object 50 are included in the field of view of the virtual camera 65. The display object 51 is, for example, a digital signage.

[0081] The first UI element 71 is, for example, a button on which an icon (design) is displayed. Alternatively, the first UI element 71 may be a display object 51 or a general object 50 associated therewith. The display mode of the general object 50 as the first UI element 71 may be changed by the broadcast user 11 performing an operation such as clicking, tapping, or swiping.

[0082] 10 shows the virtual space screen 70B that is displayed after the first UI element 71 is operated. The launch unit 39 launches the in-app browser. The in-app browser displays a browser screen 75 in a display mode in which the browser screen 75 is superimposed on or embedded in the virtual space screen 70B. In this embodiment, the browser screen 75 displayed by the broadcasting user device 21 is not displayed on the viewing user device 22.

[0083] The second display control unit 37 displays the second UI element 72. The second UI element 72 is a GUI element such as a button. Alternatively, the second UI element 72 may be set as an image element included in the browser screen 75. In this case, the image element selected by the broadcast user 11 is displayed on the display object 51 as shared information. Alternatively, the second UI element 72 may be the display object 51 or a general object 50 with which the display object 51 is associated. In this case, by selecting the display object 51 or the general object 50, the shared information 55 is displayed on the display object 51 or the general object 50.

[0084] The broadcasting user 11 performs an operation such as clicking, tapping, or swiping on the second UI element 72. For example, the broadcasting user 11 may swipe to move the image element that the broadcasting user 11 wishes to share toward the display object 51. The second display control unit 37 displays the second UI element 72 within the browser screen 75 or superimposed on the browser screen 75. Alternatively, the second display control unit 37 may display the second UI element 72 near the browser screen 75.

[0085] The in-app browser may display on the browser screen 75 a button 77 that is a UI element for closing the browser screen 75, a selection section 74 (such as a carousel) for selecting an image to be displayed, and the like.

[0086] The in-app browser accepts the distribution user's 11 scrolling operation and operations on GUI elements such as the selection unit 74. It then displays a screen based on the operation on the browser screen 75. By displaying a website screen on the browser screen 75, the distribution user 11 can check the screen before sharing the information with other users 10. Also, if a button associated with another URL, such as "Back," "Forward," or "Top Screen," is displayed on the browser screen 75, when that button is selected, the in-app browser obtains web data associated with the other URL. It then transitions the browser screen 75 to another screen.

[0087] The distribution user 11 can select an image that he or she wishes to share with other users 10 on the browser screen 75. Furthermore, the distribution user 11 can purchase a product by selecting a purchase button (not shown) displayed on the browser screen 75.

[0088] 11 shows the virtual space screen 70C that is displayed after the second UI element 72 is operated. The third display control unit 38 displays shared information 55 based on web data on the display object 51. Since the shared information 55 shared by the broadcasting user 11 is displayed in the movable space 73, the shared information 55 can be visually recognized by other broadcasting users 11 (the broadcasting users 11 corresponding to the avatar objects 60 shown in FIG. 11) who share the same movable space 73, and the viewing users 12 who watch the video.

[0089] The first UI element 71 may be associated with web data in which images and the like are arranged in consideration of displaying them on the display object 51. In this case, the third display control unit 38 may display image data captured from the browser screen 75 on the display object 51. As a result, the processing load on the broadcast user device 21 can be reduced. Alternatively, the third display control unit 38 may process the acquired web data and display it on the display object 51. For example, the third display control unit 38 may extract only necessary information such as images (scraping). Alternatively, the third display control unit 38 may display data from the web data of an EC site, etc., from which GUI elements such as a search window, tabs displaying categories, and buttons have been deleted, on the display object 51. The third display control unit 38 may also display data from which personal information of the broadcast user 11 has been deleted, on an in-app browser.

[0090] The browser screen 75 changes based on the operation of the distribution user 11. Meanwhile, the shared information 55 displayed on the display object 51 maintains a state in which an image based on the browser screen 75 at the time the second UI element 72 was operated is displayed, and does not reflect the change in the browser screen 75. According to this embodiment, even if the distribution user 11 purchases a product on the browser screen 75, the personal information displayed in the purchase process is not displayed on the display object 51.

[0091] Alternatively, the shared information 55 displayed on the display object 51 may reflect a change in the browser screen 75. The shared information 55 is synchronized with the browser screen 75. According to this embodiment, the viewing user 12 and the like can also view the screen viewed by the distribution user 11, which facilitates communication between the users 10.

[0092] 11, identification information 76 of the broadcast user 11 who sent the sharing request may be displayed in association with the display object 51. In this case, the broadcast user device 21 and the viewing user device 22 receive sharing instruction information including the ID or account name of the broadcast user 11.

[0093] The display object 51 can be used for various purposes, such as sharing information between a company and a user, or sharing information between users, regardless of the relationship between the sharer and the shared party. For example, an advertiser can associate the URL of a website to be advertised with the first UI element 71. For example, as shown in FIG. 11, an advertiser advertising a product such as clothing associates the URL of a website that lists the product for sale with the first UI element 71. The broadcast user 11 browses and purchases the product displayed on the browser screen 75. The broadcast user 11 also displays the shared information 55 on the display object 51 by operating the second UI element 72 for the purpose of introducing the purchased product, asking other users 10 for advice about a product they wish to purchase, or simply having a conversation about the product. Alternatively, the broadcast user 11 may be a seller who sells the product. In this case, the shared information 55 is displayed on the display object 51 by operating the second UI element 72 to explain the product.

[0094] Also, for example, the first UI element 71 can be associated with the URL of a still image (e.g., a photo of a world, a commemorative photo including an avatar object 60, etc.) or a video (e.g., a game video, etc.) recorded by the broadcasting user 11. These images are temporarily or continuously recorded in the management server 15. In this case, the first UI element 71 is associated with the URL of an image list (e.g., an album) of the broadcasting user 11 recorded in the management server 15. When the first display control unit 36 ​​accepts an operation on the first UI element 71, the launch unit 39 launches an in-app browser and displays the image list on the browser screen 75. The image list displays thumbnails of each image. Furthermore, the launch unit 39 displays an image selected from the image list on the browser screen 75. The third display control unit 38 accepts an operation on the second UI element 72 and displays the selected image on the display object 51 as the shared information 55. According to this, the broadcasting user 11 can communicate with other broadcasting users 11 and viewing users 12 by displaying images and videos taken at past events, etc. on the display object 51.

[0095] The effects of the first embodiment will be described. (1-1) In the first embodiment, the user 10 can display sharable information on the browser screen 75 by operating the first UI element 71. In addition, the user 10 can display the information displayed on the browser screen 75 as shared information 55 on the display object 51 in the movable space 73 by operating the second UI element 72. Therefore, any user 10 who can view the movable space 73 can view the shared information 55 of the display object 51. Therefore, the shared information 55 can be shared with a large number of users 10. In addition, the shared information 55 is displayed in the movable space 73 in which the general object 50 and the avatar object 60 corresponding to the other broadcast user 11 are displayed, so that the shared information 55 can be impressed on the user 10.

[0096] (1-2) In the first embodiment, when multiple broadcast users 11 share the same movable space 73, they can visually recognize the shared information 55 based on the sharing request transmitted from the other broadcast user devices 21. Therefore, the shared information 55 can be shared among multiple users.

[0097] (1-3) In the first embodiment, the shared information is displayed on all display objects 51 located in the movable space 73. In this aspect, the shared information 55 can be displayed on a plurality of display objects 51. This makes it easier for the shared information 55 to be within the visual field of the distribution user 11, thereby enhancing the appeal to the user 10.

[0098] (1-4) In the first embodiment, only the broadcasting user device 21 displays the first UI element 71 and the second UI element 72. That is, only the broadcasting user 11 can make a sharing request for the shared information 55. As a result, the frequency with which sharing requests are transmitted is reduced compared to a case in which all users 10 viewing the screen of the movable space 73 can share information. As a result, the time for which one piece of shared information 55 is displayed on the display object 51 is extended. In addition, it is possible to prevent the shared information 55 displayed on the display object 51 from being frequently changed.

[0099] Second embodiment A second embodiment of the program, information processing method and information processing device will be described below with reference to Figures 12 to 14. In the second embodiment, a broadcast user device 21 displays shared information 55 on a display object 51 that has a predetermined relationship with an avatar object 60 corresponding to a broadcast user 11. Hereinafter, parts similar to those in the first embodiment will be given the same reference numerals and detailed description thereof will be omitted.

[0100] In the second embodiment, the display process of the shared information 55 (step S6) is different from that in the first embodiment. The display process of the shared information 55 will be described with reference to Fig. 12. The broadcast user device 21, which has accepted an operation on the second UI element 72, performs display process using the web data displayed in the in-app browser. Furthermore, the broadcast user device 21 or the viewing user device 22, which has received the sharing instruction information, acquires the web data linked to the URL included in the sharing instruction information.

[0101] The third display control unit 38 selects an object that satisfies a display condition from among the objects located in the movable space 73 (step S10). The third display control unit 38 selects a display object 51 that satisfies at least one of the following two conditions.

[0102] (Condition 1) The relative distance from the position of the avatar object 60 is equal to or smaller than a predetermined distance. (Condition 2) The parameter relating to the priority of the display object 51 is equal to or higher than the priority set in the shared information 55.

[0103] The third display control unit 38 displays the shared information 55 for the display object 51 that satisfies the display condition (step S11). Condition 1 will be described with reference to Fig. 13. Note that Fig. 13 and Fig. 14 show an example in which a display object 51 is displayed in association with an object drawn based on three-dimensional model data.

[0104] In the example of FIG. 13, display objects 51A to 51D are arranged in the movable space 73. The third display control unit 38 of the broadcast user device 21 used by the broadcast user 11A calculates the relative distance L1 between the position of the avatar object 60A corresponding to the broadcast user 11A and the display objects 51A to 51D. Then, the display object 51A in the area Z1 where the relative distance L1 is equal to or less than a predetermined distance is selected as the display object 51 that displays the shared information 55. At this time, the relative distance L1 may be calculated only for the display objects 51 within the predetermined distance range Z of the movable space 73. Note that the relative distance L1 may be calculated between the position of the virtual camera 65 corresponding to the broadcast user 11A and the display objects 51A to 51D instead of the avatar object 60A.

[0105] Meanwhile, the third display control unit 38 of the broadcast user device 21 used by the broadcast user 11B calculates the relative distance L1 between the position of the avatar object 60B corresponding to the broadcast user 11B and each of the display objects 51A to 51D. Then, the display object 51B in the area Z1 where the relative distance L is equal to or less than a predetermined distance is selected as the display object 51 that displays the shared information 55. Note that the relative distance L1 between the position of the virtual camera 65 corresponding to the broadcast user 11B and the display objects 51A to 51D may be calculated instead of the avatar object 60B.

[0106] The viewing user device 22 renders an image seen from the virtual camera 65 (not shown in FIG. 13) of the host user 11H. Therefore, when the broadcast user 11A is the host user 11H, the viewing user device 22 displays the shared information 55 on the display object 51A close to the avatar object 60A.

[0107] That is, even if the same image of the movable space 73 is displayed, the shared information 55 may be displayed on different display objects 51 depending on the user device 20. For example, the display object 51 may be associated with a general object 50 that is a moving object such as an airship or an advertising vehicle. In this case, as the moving object moves, the relative distance L1 between the avatar object 60 and the moving object may be exceeded. In this case, the user device 20 used by the user 10 corresponding to the avatar object 60 stops displaying the shared information 55 of the moving object.

[0108] Condition 2 will be described with reference to FIG. 13. The third display control unit 38 acquires parameters associated with the display objects 51A to 51D that are within the predetermined distance range Z. The higher the priority of the parameter, the larger the value. The display objects 51A and 51B are assigned a value of "1," the display object 51C a value of "2," and the display object 51D a value of "5." Note that the parameters may be acquired for all display objects 51D in the movable space 73, not just within the predetermined distance range Z.

[0109] For example, the third display control unit 38 displays the shared information 55 on the display object 51D having a parameter value of "3". Here, the third display control unit 38 displays the shared information 55 on the display object 51D. The threshold for determining whether or not to display the shared information 55 is changed according to the shared information 55. For example, if it is desired to increase the opportunities for the user 10 to view the shared information 55, the threshold for the shared information 55 is set to "1". Then, the shared information 55 may be displayed on the display object 51 having a parameter value of "1" or more so that as many users as possible can view the shared information 55 of the campaign. Alternatively, if it is desired to increase the appealing effect of the shared information 55, the threshold for the shared information 55 is set to "3". The display object 51 having a parameter value of "3" or more is a display object 51 arranged at a prominent position in the movable space 73 or a display object 51 having a large display area. Then, the appealing effect of the shared information 55 can be improved by displaying the shared information 55 on the display object 51 having a parameter value of "3" or more.

[0110] The user device 20 or the management server 15 may dynamically determine the value of the parameter related to the priority based on the user's behavior (operation). For example, the user device 20 or the management server 15 dynamically determines the value of the parameter related to the priority based on the virtual optical axis of the virtual camera 65. The virtual optical axis can also be rephrased as the line of sight direction of the avatar object 60, or the line of sight direction in the user's movable space 73. At this time, the parameter value is increased for the display object 51 whose relative distance to the optical axis is relatively short, thereby increasing the priority, and the parameter value is decreased for the display object 51 whose relative distance to the optical axis is relatively long, thereby decreasing the priority. The relative distance to the optical axis can be represented by the length of a perpendicular line extending from the display object 51 to the optical axis. Alternatively, the user device 20 or the management server 15 dynamically determines the value of the parameter related to the priority based on the movement range of the avatar object 60 in the movable space 73. The movement range is specified based on the trajectory of the movement of the avatar object 60. The movement range is, for example, a range including the movement trajectory of the avatar object 60. The user device 20 or the management server 15 increases the parameter value of the display object 51 included in the movement range to increase the priority. Furthermore, the user device 20 or the management server 15 increases the parameter value of the display object 51 relatively close to the movement range to increase the priority, and decreases the parameter value of the display object 51 relatively far from the movement range to decrease the priority. By dynamically determining in this manner, the shared information 55 can be displayed on the display object 51 that is easily visible to the user according to the user's tendency of behavior. Furthermore, even if the tendency of behavior differs for each user, the shared information 55 can be displayed on the display object 51 that is easily visible to each user.

[0111] Alternatively, when a new display object 51 is added to the movable space 73, the user device 20 or the management server 15 may dynamically determine a parameter related to priority based on an attribute of the display object 51. For example, it is expected that the higher or larger the display object 51 is, the more users will view the display object 51. For this reason, the value of the parameter related to priority may be dynamically determined based on the height and size of the display object 51. The higher the display object 51 is, the higher the value of the parameter related to priority may be. The larger the display object 51 is, the higher the value of the parameter related to priority may be. The attribute of the display object 51 may be determined based on a color and an effect (expression in a moving image) associated with the display object 51, in addition to the height and size.

[0112] Furthermore, when the shared information 55 is an advertisement, the compensation paid by the advertiser as an advertising fee may be determined according to the parameter value of the display object 51 or the number of display objects 51. Alternatively, when the shared information 55 is an advertisement, the user device 20 may measure the number of times the shared information 55 is included in the field of view of the virtual camera 65. In other words, the inclusion of the shared information 55 in the field of view of the virtual camera 65 is the number of times the shared information 55 is displayed on the display 109 of the user device 20. The user device 20 transmits the measured number of times to the management server 15. The management server 15 sums up the measured number of times received from each user device 20. Then, the compensation paid by the advertiser as an advertising fee is determined based on the total number of times. The compensation increases as the measured number of times increases.

[0113] According to the second embodiment, in addition to the effects (1-1) to (1-3) of the first embodiment, the following effects can be obtained. (2-1) In the second embodiment, the shared information 55 is displayed on the display object 51 whose positional relationship with the avatar object 60 satisfies the display condition. When a display object 51 close to the avatar object 60 is selected, the shared information 55 is displayed on the display object 51 that is likely to be displayed on the virtual space screen 70. Since the user device 20 does not need to display the shared information 55 on all display objects 51, the processing load related to rendering can be reduced.

[0114] Third embodiment Hereinafter, a third embodiment of a program, an information processing method, and an information processing device will be described with reference to Fig. 15 to Fig. 17. In the third embodiment, the viewer user device 22 can also launch an in-app browser. Hereinafter, the same parts as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted.

[0115] 15 shows a process procedure in which the broadcasting user device 21 or the viewing user device 22 that has received the sharing instruction information displays the shared information 55. The sharing unit 40 receives the sharing instruction information from the management server 15 (step S20). The launching unit 39 displays a launch selection unit on the screen (step S21). The launch selection unit is a UI for selecting whether or not to display the shared information 55 in the in-app browser of the broadcasting user device 21 or the viewing user device 22.

[0116] Furthermore, the third display control unit 38 uses the URL included in the sharing instruction information to display the shared information 55 on the display object 51 (step S22). This step S22 may be executed before step S21 or simultaneously with step S21.

[0117] The launch unit 39 determines whether to launch the in-app browser based on the user's operation on the launch selection unit (step S23). When the launch unit 39 determines not to launch the in-app browser based on the operation of the viewing user 12 (step S23: NO), it ends the display process.

[0118] On the other hand, if the launch unit 39 determines that an operation to launch the in-app browser has been performed (step S23: YES), the launch unit 39 launches the in-app browser (step S24). The in-app browser displays a screen based on the web data of the URL included in the sharing instruction information in the in-app browser (step S25).

[0119] Fig. 16 is an example of a viewing screen 70D displayed by the viewing user device 22. The third display control unit 38 of the viewing user device 22 displays a virtual space image seen from the virtual camera 65 corresponding to the host user 11H. The example of Fig. 16 is a viewing screen 70D rendered from a third-person perspective. The third-person perspective viewing screen 70D includes an image of the avatar object 60 of the host user 11H.

[0120] Shared information 55 is displayed in display object 51. Furthermore, viewing screen 70D includes a launch selection section 80. Launch selection section 80 includes a button 81 for opening browser screen 75 and a button 82 for selecting not to open browser screen 75.

[0121] 17 shows a viewing screen 70E that is displayed when a user operation on a button 81 for opening a browser screen 75 is accepted. The viewing screen 70E includes a browser screen 75. The viewing user 12 can browse a website corresponding to the shared information 55 displayed on the browser screen 75. For example, the viewing user 12 can purchase a product listed on the website by performing an operation on a UI element displayed on the browser screen 75.

[0122] According to the third embodiment, in addition to the effects (1-1) to (1-4) of the first embodiment, the following effects can be obtained. (3-1) In the third embodiment, it is possible to select whether or not to display a browser screen 75 corresponding to the shared information 55 shared by another user 10. A user 10 who is interested in the shared information 55 can collect detailed information about the shared information 55 by activating an in-app browser, without activating an independent web browser and performing a search. In addition, the user device 20 that has received the sharing instruction information does not automatically activate the in-app browser upon receiving the sharing instruction information, thereby preventing the viewing user 12 from feeling annoyed.

[0123] (Fourth embodiment) A fourth embodiment of the program, information processing method and information processing device will be described below with reference to Fig. 18. In the fourth embodiment, the broadcast user device 21 can share any information selected by the broadcast user 11. Hereinafter, parts similar to those in the first embodiment will be given the same reference numerals and detailed description thereof will be omitted.

[0124] 18 shows a virtual space screen 70F that is displayed after the broadcasting user 11 launches the in-app browser. The first UI element 71 is associated with the URL of a website that allows searching. When the first display control unit 36 ​​accepts an operation on the first UI element 71, the launch unit 39 launches the in-app browser. The in-app browser displays a screen including a search window 83 and a search execution button 84. The broadcasting user 11 enters a search word in the search window 83 and then selects the search execution button 84.

[0125] The broadcast user device 21 transmits the search word to a web server 120 equipped with a search engine. The broadcast user device 21 receives search results from the web server 120 and displays the received search results on the browser screen 75. When the in-app browser receives an operation to select one of the displayed search results, it requests the web server 120 for web data of a URL corresponding to the selected search result. When the in-app browser receives the web data from the web server 120, it displays an image based on the web data on the browser screen 75. As in FIG. 10, a second UI element 72 is displayed in or near the browser screen 75. The second display control unit 37 receives an operation on the second UI element 72 and transmits a sharing request including the URL to be shared to the management server 15.

[0126] According to the fourth embodiment, in addition to the effects (1-1) to (1-4) of the first embodiment, the following effects can be obtained. (4-1) In the fourth embodiment, any information that the broadcast user 11 has searched for can be shared with other users 10, thereby expanding the range of information that can be shared.

[0127] Fifth embodiment Hereinafter, a fifth embodiment of the program, information processing method, and information processing device will be described with reference to FIG. 19. In the fifth embodiment, the user 10 can move in the movable space 73, regardless of whether he is a broadcast user 11 or a viewing user 12. That is, in this embodiment, the user device 20 transmits drawing data to the management server 15, like the broadcast user device 21 in each of the above embodiments. The drawing data includes at least the position of the avatar object 60 of each user 10. In addition, the user device 20 draws the avatar object 60 of the other user using the drawing data received from the other user device 20 via the management server 15. Hereinafter, the same reference numerals are used for the same parts as in the first embodiment, and detailed description thereof will be omitted.

[0128] In this embodiment, all users 10 can share information. For this reason, if each user 10 shares information at any timing, the shared information 55 displayed on one display object 51 may change frequently. As a result, the shared information 55 may be switched to another shared information 55 before the user 10 has a chance to fully check the shared information 55.

[0129] Therefore, in this embodiment, when the management server 15 receives a sharing request, the management server 15 displays the shared information 55 on a plurality of display objects 51 in turn, rather than displaying the shared information 55 on all of the display objects 51.

[0130] 19, a sequence number N (1 to 4) is associated with the display objects 51A to 51D in the movable space 73. When the management server 15 receives a sharing request, the management server 15 allocates display of the shared information 55 to the display objects 51 based on the sequence number N.

[0131] When the management server 15 receives a sharing request from the user device 20 of the first user 10 corresponding to the avatar object 60A, the management server 15 transmits sharing instruction information to each user device 20 so as to display the shared information 55 that is the target of the sharing request on the display object 51A whose order N is "1." The sharing instruction information includes the URL of the display object to be shared and the identification information of the display object 51A.

[0132] Next, when the management server 15 receives a sharing request from the user device 20 of the second user 10 corresponding to the avatar object 60B, the management server 15 transmits sharing instruction information to each user device 20 to cause the display object 51B, whose order N is "2", to display the shared information 55 that is the target of the sharing request. The sharing instruction information includes the URL of the display object 51B to be shared and the identification information of the display object 51B.

[0133] Similarly, when the management server 15 receives a sharing request from the user device 20 of the third user 10 corresponding to the avatar object 60C, the management server 15 transmits sharing instruction information to each user device 20 to cause the display object 51C, whose order N is "3", to display the shared information 55 that is the target of the sharing request. The sharing instruction information includes the URL of the display object 51C to be shared and the identification information of the display object 51C.

[0134] When the management server 15 receives a new sharing request in a state in which the shared information 55 is displayed on all of the display objects 51A to 51D, the management server 15 transmits a non-display instruction to each of the user devices 20 to hide the shared information 55 displayed on the display object 51 whose order N is "1". Then, the management server 15 transmits new sharing instruction information to each of the user devices 20. As a result, the third display control unit 38 of each of the user devices 20 displays the new shared information 55 on the display object 51A.

[0135] According to the fifth embodiment, in addition to the effects (1-1) to (1-4) of the first embodiment, the following effects can be obtained. (5-1) In the fifth embodiment, all users 10 can share information. In addition, the shared information 55 shared by each user 10 is displayed in turn on another display object 51. Therefore, even if the frequency of sending sharing requests increases, the display time of the shared information 55 does not become so short that it becomes difficult for each user 10 to check the information. Therefore, each user 10 can check the shared information 55 sufficiently.

[0136] The above-described embodiments may be modified as follows: The above-described embodiments and the following modifications may be combined with each other to the extent that no technical contradiction occurs. <user> In each of the above embodiments, the distribution user 11 refers to a user who transmits at least one of information related to images (video) and information related to audio. For example, the distribution user 11 is a user who performs independent video distribution and collaboration distribution in which multiple people can participate. Alternatively, the distribution user 11 may be a user who hosts or organizes a video chat or voice chat in which multiple people can participate and / or watch, or an event (party, etc.) in a virtual space in which multiple people can participate and / or watch. In other words, the distribution user 11 can also be called a host user, organizer user, or organizer user.

[0137] On the other hand, the viewing user 12 refers to a user who receives at least one of information related to video and information related to audio. However, the viewing user 12 not only receives the above information but can also react to it. For example, the viewing user 12 is a user who watches video distribution or collaboration distribution. Alternatively, the viewing user 12 may be a user who participates in and / or watches video chat, voice chat, or an event. Therefore, the viewing user 12 can also be referred to as a guest user, a participating user, a listener, a viewing user, a supporting user, etc.

[0138] In the first to fourth embodiments, it is assumed that the distribution user 11 shares (provides) information. Alternatively, in these embodiments, not only the distribution user 11 but also the viewing user 12 may be able to share (provide) information. In this case, the first display control unit 36 ​​of the viewing user device 22 displays a first UI element 71 on the virtual space screen 70. Also, the second display control unit 37 displays a second UI element 72 on the virtual space screen 70. The launch unit 39 launches an in-app browser. The in-app browser displays web data.

[0139] <Avatar Object> In each of the above embodiments, the user device 20 is configured to draw the avatar object 60 corresponding to the broadcast user 11 using tracking data or emote data obtained by detecting the movements of the broadcast user 11. This allows the movements of the broadcast user 11 or the movements selected by the broadcast user 11 to be reflected in the avatar object 60. Alternatively or in addition to this, the user device 20 may temporarily or continuously draw the avatar object 60 without using tracking data and emote data. In this aspect, the load of the drawing process on the user device 20 can be reduced when drawing a large number of avatar objects 60 in the movable space 73.

[0140] In each of the above embodiments, the user device 20 is configured to draw an avatar object 60 corresponding to the broadcasting user 11. Alternatively, the user device 20 may draw an image of the movable space 73 from a first-person perspective, and may not need to draw avatar objects 60 corresponding to all users 10.

[0141] In each of the above embodiments, user device 20 is configured to draw avatar object 60 corresponding to broadcasting user 11. Alternatively or in addition to this, user device 20 may be configured to draw avatar object 60 corresponding to viewing user 12. User device 20 may be configured to draw avatar object 60 corresponding to viewing user 12 in a manner that imposes a smaller processing load than avatar object 60 corresponding to broadcasting user 11. An example of a manner that imposes a smaller processing load is to display avatar object 60 corresponding to viewing user 12 as a two-dimensional image, to not reflect motion data in avatar object 60 corresponding to viewing user 12, or to not output audio of viewing user 12.

[0142] <Video> In the first to fourth embodiments, it is assumed that the distribution user device 21 distributes videos. Alternatively or additionally, the user device 20 may display an image of a virtual space without distributing a video. The user 10 starts an application and selects a desired movable space 73. The user device 20 displays a virtual space screen of the movable space 73 seen from each virtual camera 65. The user device 20 changes the position of the virtual camera 65 based on a user operation. In this embodiment, the user 10 can freely explore the movable space 73. In addition, the user 10 can visually recognize the shared information 55 displayed on the display object 51 in the process of exploring the movable space 73, or the user 10 can display the shared information 55 on the display object 51 himself.

[0143] In the first to fourth embodiments, the viewing user 12 can view the virtual space screen by selecting a room. Alternatively, the user 10 may be allowed to view the virtual space screen as a viewing user only when approved by the host user 11H. For example, the user device 20 may transmit a viewing request to the broadcasting user device 21 of the host user 11H via the management server 15. Then, when approval information from the broadcasting user device 21 in response to the viewing request is received, the virtual space screen may be displayed using a URL or the like included in the approval information.

[0144] <parameters> The user device 20 may be able to transmit a sharing request when a parameter associated with the user 10 itself is equal to or greater than a predetermined value. Alternatively, the management server 15 may transmit sharing instruction information to another user device 20 when a sharing request is received from a user device 20 of a user 10 whose parameter is equal to or greater than a predetermined value. The parameter may be accumulated points, coins, or the number of friends in an application. A friend is a user who becomes a partner when the user himself / herself approves the other user and the other user also approves the user. The parameter may be a parameter related to the avatar object 60, such as attack power, defense power, fighting power, or stamina.

[0145] <Start part> In each of the above embodiments, the launch unit 39 of the user device 20 launches an in-app browser and acquires web data corresponding to a URL from an external web server 120 or the like. Instead of or in addition to this, the launch unit 39 may request a URL from the management server 15 when the first UI element 71 is operated by the user 10. When the management server 15 receives a request for web data, it reads out the URL recorded in the management server 15. The web data of this URL is data processed into a layout suitable for the browser screen 75. The management server 15 transmits the read out URL to the user device 20. When the user device 20 receives the URL, it requests a web page corresponding to the URL from the external web server 120. In this aspect, the management server 15 can also change the URL during the distribution period of one video. For example, the management server 15 may transmit a different URL to the user device 20 every time a request for a URL is received from the user device 20. The user device 20 can display a different image on the browser screen 75 every time the first UI element 71 is operated.

[0146] As described above, the launch unit 39 may launch a web browser independent of an application, instead of an in-app browser. Here, a web browser independent of an application is simply referred to as a web browser. The function of the in-app browser is similar to that of a web browser. In this embodiment, the launch unit 39 launches the web browser when an operation by the user 10 on the first UI element 71 is accepted. At this time, the launch unit 39 specifies, to the web browser, a URL from which web data is to be obtained. The web browser obtains the web data associated with the first UI element 71 and displays it on the web browser.

[0147] When the sharing unit 40 receives an operation by the user 10 on the second UI element 72, it transmits to the management server 15 a sharing request to share the information displayed on the web browser with another user device 20 (another device).

[0148] Third display control unit 38 projects an image based on the web data displayed by second display control unit 37 on the web browser onto display object 51 as shared information 55 by a technique such as texture mapping. At this time, third display control unit 38 may obtain the web data from the web browser, or may capture the screen displayed by the web browser.

[0149] <Display conditions> In the second embodiment, the shared information 55 is displayed on the display object 51 that satisfies at least one of the conditions 1 and 2. Alternatively, only the condition 1 may be set as the display condition. Alternatively, only the condition 2 may be set as the display condition.

[0150] <Priority> A plurality of types of shared information 55 may be displayed in the movable space 73. In this case, the URL associated with the first UI element 71 may be changed depending on the position of the movable space 73 as described in the first embodiment. Alternatively, the URL associated with the first UI element 71 may be changed depending on the time period within the distribution period. For example, in a first time period that is 10 minutes after the start of distribution, the first UI element 71 associated with the first URL is displayed on the virtual space screen 70. In a second time period after the first time period, the first UI element 71 associated with the second URL is displayed on the virtual space screen 70.

[0151] When multiple types of shared information 55 can be displayed and the shared information 55 is displayed on all display objects 51, a priority may be set for the URL. When the third display control unit 38 receives multiple types of sharing instruction information and the sharing instruction information is waiting to be displayed, the sharing instruction information waiting to be displayed may be displayed as the shared information 55 in order of priority. In this case, the sharing instruction information includes a priority. Alternatively, when the management server 15 receives multiple sharing requests within a certain period of time, the management server 15 transmits the sharing instruction information to each user device 20 in order of priority to the sharing request with the highest priority.

[0152] <Revenue> The management server 15 may receive operation detection information from the user device 20 when the first UI element 71 is operated in the user device 20. The management server 15 may use the operation detection information to sum up the number of times each user device 20 operates the first UI element 71 and calculate the advertising fee according to the total number of times. Alternatively, the management server 15 may receive operation detection information from the user device 20 when the second UI element 72 is operated in the user device 20. The management server 15 may use the operation detection information to sum up the number of times each user device 20 operates the second UI element 72 and calculate the advertising fee according to the total number of times. According to this, the advertising fee can be changed according to the effect calculated based on the number of times the user 10 viewed or shared the browser screen 75 based on the web data.

[0153] <Streaming and viewing method> In each of the above embodiments, the user device 20 distributes and views videos using the client rendering method, but may distribute and view videos using each of the above methods. For example, when the user device 20 renders using the browser rendering method, the user device 20 displays the virtual space screen 70 in an in-app browser or an independent web browser. When the first UI element 71 is operated, the user device 20 opens another browser screen 75 in the in-app browser or the web browser and displays web data associated with the first UI element 71.

[0154] In the browser rendering method, at least one of known methods such as static rendering (Static Server-Side Rendering), server-side rendering (Server-Side Rendering), client-side rendering (Client-Side Rendering), pre-rendering (CSR with Prerendering), and hydration rendering (SSR with (Re)Hydration) can be used as a method for generating files for displaying the virtual space screen 70 and the browser screen 75 by rendering. The rendering here refers to interpreting data described in a markup language or the like and calculating the arrangement of image elements and characters to be displayed on the virtual space screen 70 and the browser screen 75.

[0155] In static rendering, the web server 120 records a static HTML file in advance, and the user device 20 downloads the static HTML file from the web server 120. The user device 20 outputs the rendered HTML file to the display 109 to display the virtual space screen 70 and the browser screen 75. In server-side rendering (SSR), the web server 120 performs rendering and the like in response to a request from the user device 20, and transmits the rendered HTML file to the user device 20. The user device 20 outputs the downloaded HTML file to the display 109 to display the virtual space screen 70 and the browser screen 75. The web server 120 includes an application server. In client-side rendering (CSR), the user device 20 performs rendering by executing JavaScript (registered trademark). At this time, the user device 20 downloads a simple HTML file from the web server 120, and also downloads the necessary JavaScript (registered trademark), CSS files, and the like. In pre-rendering, which is a type of CSR, the user device 20 generates and records some HTML files in advance, and downloads the necessary content from the web server 120 in response to a request and renders it. In hydration rendering, the web server 120 generates and records an unrendered HTML file. The user device 20 downloads the HTML file from the web server 120 and downloads necessary data based on the HTML file for rendering. In each of the above methods, the user device 20 may obtain the necessary data from the management server 15 instead of the web server 120.

[0156] <Information processing system> In each of the above embodiments, the user device 20 is an information processing device such as a smartphone, a mobile phone, a tablet terminal, a personal computer, a console game machine, or a wearable computer such as a head-mounted display. Alternatively, the information processing system may be a system provided in a studio for video distribution. The information processing system includes an information processing device, a server, a sensor unit worn on the body of the distribution user 11, a tracking system for detecting the position of the sensor unit, an operation unit, a speaker, a display, and the like. The tracking system may include a multi-axis laser emitter that emits a pulsed laser light for synchronization. The sensor unit includes a sensor that detects laser light, and detects its own position and orientation while synchronizing with a synchronization pulse.

[0157] The user device 20 functions as a first display control unit 36, a second display control unit 37, a third display control unit 38, a launch unit 39, and a sharing unit 40 by executing an application. At least one of these may be executed by the management server 15 or another device constituting the information processing system 1. For example, the management server 15 may transmit to the user device 20 at least one of a request to display the first UI element 71, a request to launch an in-app browser, and a request to display the second UI element 72. The management server 15 may also transmit to the user device 20 image data to be displayed on a display object 51 located in a virtual space as real-time information.

[0158] Next, the technical ideas that can be understood from the above-described embodiment and other examples will be described below. [A] One or more computers, a first display control unit that displays a first UI element for launching an in-app browser on a screen in a virtual space; a launch unit that launches the in-app browser when a user operation on the first UI element is received; a second display control unit that displays a second UI element for sharing the information displayed in the in-app browser; a sharing unit that, when receiving an operation by the user on the second UI element, transmits to a server a sharing request to share the information displayed on the in-app browser with another device used by another user who views a screen of the virtual space; and and a program that functions as a third display control unit that displays the information displayed in the in-app browser on a display object located in the virtual space as shared information.

[0159] [B] The program described in [A], wherein the third display control unit displays information shared by the other users in the display object when an instruction based on the sharing request sent from the other device is received from the server.

[0160] [C] The program according to [A] or [B], wherein the third display control unit displays the shared information for all of the display objects located in the virtual space.

[0161] [D] The third display control unit displays the shared information on a display object, among the plurality of display objects located in the virtual space, whose positional relationship with the user's position in the virtual space satisfies a display condition.

[0162] [E] the third display control unit displays a third UI element that allows the user to select whether to launch the in-app browser when an instruction based on the sharing request transmitted from the other device is received from the server; The program according to any one of [A] to [D], wherein the launch unit displays the shared information in the in-app browser when an operation to launch the in-app browser is received in the third UI element.

[0163] [F] The program described in any one of [A] to [E], wherein the launch unit obtains web data associated with the first UI element from a web server and displays the obtained web data in the in-app browser.

[0164] [G] The program described in any one of [A] to [F], wherein information obtained by inputting a search word into a search screen displayed in the in-app browser is displayed in the display object as the shared information.

[0165] [H] The first display control unit is programmed to display the first UI element and the second UI element only if the user is a distribution user who distributes a video displaying the virtual space, as described in any one of [A] to [G].

[0166] [I] One or more computers A first display control process for displaying a first UI element for launching an in-app browser on a screen in the virtual space; a launch process for launching the in-app browser when a user operation on the first UI element is received; A second display control process for displaying a second UI element for sharing the information displayed in the in-app browser; a sharing process of transmitting a sharing request to a server when an operation by the user on the second UI element is received, to share the information displayed on the in-app browser with another device used by another user viewing a screen of the virtual space; and a third display control process for displaying the information displayed in the in-app browser as shared information on a display object located in the virtual space.

[0167] [J] a first display control unit that displays a first UI element for launching an in-app browser on a screen in a virtual space; a launch unit that launches the in-app browser when a user operation on the first UI element is received; a second display control unit that displays a second UI element for sharing the information displayed in the in-app browser; a sharing unit that, when receiving an operation by the user on the second UI element, transmits to a server a sharing request to share the information displayed on the in-app browser with another device used by another user who views a screen of the virtual space; and and a third display control unit that displays the information displayed in the in-app browser as shared information on a display object located in the virtual space.

[0168] [K] One or more computers, a first display control unit that displays a first UI element for launching a browser on a screen in a virtual space; a launch unit that launches the browser when a user's operation on the first UI element is received; a second display control unit that displays a second UI element for sharing information displayed on the browser; a sharing unit that, when receiving an operation by the user on the second UI element, transmits to a server a sharing request to share the information displayed on the browser with another device used by another user viewing a screen of the virtual space; and a program that functions as a third display control unit that displays the information displayed on the browser as shared information on a display object located within the virtual space.

[0169] The browser includes at least one of an in-app browser and a web browser installed separately from the program. [Explanation of symbols]

[0170] 1. Information processing system 15…Administration server 20... User device

Claims

A program for causing one or more computers that display a screen of a virtual space to execute: a process of displaying a UI element on the screen of the virtual space; a startup process of starting an in-app browser when a user operation on the UI element is received; a process of displaying the information displayed on the in-app browser on a display object located in the virtual space. According to claim 1, wherein the UI element is a first UI element, the process of displaying the first UI element is a first display control process, the process of displaying the information displayed on the in-app browser on the display object is a third display control process, and one or more of the computers further execute: a second display control process of displaying a second UI element for sharing the information displayed on the in-app browser; a sharing process of, when a user operation on the second UI element is received, sending a sharing request to a server to share the information displayed on the in-app browser with another device used by another user who views the screen of the virtual space. The program according to claim 1. According to claim 1, in the process of displaying the information displayed on the in-app browser on the display object, when an instruction based on a sharing request sent from another device used by another user who views the screen of the virtual space is received from the server, the information shared by the other user is displayed. The program described. According to claim 1, in the process of displaying the information displayed on the in-app browser on the display object, the information displayed on the in-app browser is displayed for all the display objects located in the virtual space. The program described. According to claim 1, in the process of displaying the information displayed on the in-app browser on the display object, the information displayed on the in-app browser is displayed on the display object whose positional relationship with the position of the user in the virtual space satisfies the display condition among the plurality of display objects located in the virtual space. The program described. One or more of the computers further: display a third UI element that can select whether to start the in-app browser when an instruction based on the sharing request sent from the other device is received from the server. The program according to claim 2. According to claim 7 In the startup process, the program according to claim 1, wherein web data associated with the UI element is acquired from a web server, and the acquired web data is displayed in the in-app browser.

8. In the process of displaying the information displayed in the in-app browser on the display object, the program according to claim 1, wherein information acquired by inputting a search word into the search screen displayed in the in-app browser is displayed.

9. The program according to claim 1, wherein one or more of the computers are further caused to execute a process of displaying a screen of the virtual space according to the position of a virtual camera that moves the virtual space based on an operation of the user.

10. The program according to claim 1, wherein one or more of the computers are further caused to execute a process of switching, as a setting regarding the position of a virtual camera, between a first-person view from the position of an avatar in the virtual space and a third-person view from positions around the avatar, based on an operation of the user.

11. The in-app browser is a browser included in an application that displays a screen of the virtual space, the program according to claim 1.

12. In the process of displaying the UI element, the program according to claim 1, wherein the UI element is displayed only when the user is a distribution user who distributes a video that displays the virtual space.

13. One or more computers that display a screen of a virtual space, a process of displaying a UI element on the screen of the virtual space; a startup process of starting an in-app browser when a user operation on the UI element is received; and a process of displaying the information displayed in the in-app browser on a display object located in the virtual space. An information processing method.

14. Comprising one or more computers that display a screen of a virtual space, one or more of the computers execute a process of displaying a UI element on the screen of the virtual space; a process of starting an in-app browser when a user operation on the UI element is received; and a process of displaying the information displayed in the in-app browser on a display object located in the virtual space. An information processing system.

Images