Information processing system, method, and program

Abstract

To improve effectiveness of virtual advertisements.SOLUTION: An information processing system provided herein comprises a display control unit configured to generate a display screen of a virtual space having arranged therein a virtual object that moves according to target motion data, the display control unit also being configured to place different advertising objects in the virtual space depending on a scene on the display screen viewed by a user.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present disclosure relates to an information processing system, a method, and a program. [Background technology]

[0002] Recently, a motion capture technology has become known that extracts human skeletal positions (multiple points corresponding to each part of the body such as the head, torso, and limbs) from captured images and records changes in skeletal positions as human movements.

[0003] Such motion capture technology has been used in recent years in sports matches, etc. For example, by placing virtual objects that represent the movements of players in real space in the virtual space, it is possible to reproduce a real-world match in the virtual space. Also, as disclosed in Patent Document 1, for example, a technology for placing virtual advertisements in the virtual space is known. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-076923 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the technology disclosed in Patent Document 1 is mainly related to synchronizing advertisements on electronic billboards in a virtual space with virtual advertisements, and the technology disclosed in Patent Document 1 does not sufficiently improve the appeal of virtual advertisements.

[0006] Therefore, the present disclosure proposes a new and improved technique that can improve the appeal of virtual advertisements. [Means for solving the problem]

[0007] According to the present disclosure, an information processing system is provided that includes a display control unit that generates a display screen of a virtual space on which virtual objects having movements according to target motion data are placed, and the display control unit places different advertising objects in the virtual space according to the scene on the display screen that the user is viewing.

[0008] The present disclosure also provides a method that includes generating, by a processor, a display screen of a virtual space on which a virtual object having a movement according to target motion data is placed, and generating the display screen of the virtual space includes placing different advertising objects in the virtual space according to a scene on the display screen that a user is viewing.

[0009] Furthermore, according to the present disclosure, there is provided a program for causing a computer to function as a display control unit that generates a display screen of a virtual space on which virtual objects having movements according to target motion data are placed, the display control unit placing different advertising objects in the virtual space according to the scene of the display screen that the user is viewing. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is an explanatory diagram illustrating a configuration of an information processing system 1 according to an embodiment of the present disclosure. [Figure 2] 1 is an explanatory diagram showing a display screen D1 of a virtual space generated and displayed by a user terminal 20. FIG. [Figure 3] 1 is an explanatory diagram illustrating a configuration of a content server 10 according to an embodiment of the present disclosure. [Figure 4] FIG. 10 is an explanatory diagram showing a specific example of event metadata. [Figure 5] FIG. 2 is an explanatory diagram illustrating a configuration of a user terminal 20 according to an embodiment of the present disclosure. [Figure 6] 10 is an explanatory diagram showing a display screen D2 of a virtual space generated and displayed by the user terminal 20. FIG. [Figure 7] 10 is a flowchart showing a flow of a first display control example according to an embodiment of the present disclosure. [Figure 8] A virtual space display screen D3 is shown as a specific example of a virtual space display screen generated when the distance between the position of the virtual viewpoint and the placement position of the advertisement object is a first distance less than a threshold. [Figure 9] A virtual space display screen D4 is shown as a specific example of a virtual space display screen generated when the distance between the position of the virtual viewpoint and the placement position of the advertisement object is a second distance equal to or greater than a threshold value. [Figure 10] 10 is a flowchart showing a flow of a second display control example according to an embodiment of the present disclosure. [Figure 11] FIG. 1 is a block diagram showing an example of a hardware configuration 90. DETAILED DESCRIPTION OF THE INVENTION

[0011] Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant description will be omitted.

[0012] The "Mode for Carrying Out the Invention" will be described in the following order. 1. Information processing system configuration 2. Content server configuration 3. User terminal configuration 4. Display control example 4-1. First display control example 4-2. Second display control example 5. Effects 6. Hardware Configuration 7. Supplementary Information

[0013] <1. Information processing system configuration> The present disclosure relates to an information processing system that generates and displays a display screen in a virtual space. In particular, the present disclosure relates to an information processing system that generates and displays a display screen in a virtual space that reproduces an event in a real space. The following description mainly focuses on an example of an event to which an embodiment of the present disclosure is applied, but the event is not limited to a soccer match. For example, the embodiment of the present disclosure can be applied to a variety of events, such as other sports matches, concerts, plays, roundtable discussions, debates, interviews, promotional events, and various contests.

[0014] First, with reference to FIG. 1, the configuration of an information processing system according to an embodiment of the present disclosure will be described.

[0015] 1 is an explanatory diagram showing the configuration of an information processing system 1 according to an embodiment of the present disclosure. As shown in FIG. 1, the information processing system 1 according to the embodiment of the present disclosure includes a content server 10 and a plurality of user terminals 20.

[0016] The content server 10 and the multiple user terminals 20 are connected to each other so that they can communicate with each other via a communication network 82. The communication network 82 is a wired or wireless transmission path for information transmitted from devices connected to the communication network 82. For example, the communication network 82 may include public network such as the Internet, a telephone network, or a satellite communication network, or various LANs (Local Area Networks) including Ethernet (registered trademark), and WANs (Wide Area Networks). The communication network 82 may also include a dedicated network such as an IP-VPN (Internet Protocol-Virtual Private Network).

[0017] (Content Server 10) The content server 10 transmits content data including analysis data of an event in real space to the user terminal 20. For example, the analysis data includes motion data of objects such as people and equipment involved in the event. If the event is a soccer match, the analysis data includes motion data of players and motion data of the ball.

[0018] The player motion data is time-series bone data indicating the position and orientation of each joint of the player. The motion data also includes time-series data on the player's position. The ball motion data is time-series data on the ball's position. These motion data can be obtained by analyzing data obtained from multiple sensors installed in a soccer stadium in real space. The analysis may include tracking each player and the ball, adjusting the data format, and deleting unnecessary data. The content server 10 may perform the analysis, or another server may perform the analysis. The content server 10 also stores content data of past events (matches) and may transmit the stored content data to the user terminal 20, or may transmit the content data to the user terminal 20 in real time with the real-space events, or may transmit the content data to the user terminal 20 with a time delay relative to the real-space events.

[0019] In the information processing system 1 according to this embodiment, in order to distribute the processing load of the content server 10, the server may be multiplexed in accordance with the number of terminals connected to the content server 10. For example, if a certain virtual space is used by 1,000 user terminals 20, 10 content servers 10 connectable to 100 user terminals 20 are prepared, and each content server 10 provides the same content data. This makes it possible to provide the same content data to a total of 1,000 user terminals 20, albeit for each 100 terminals. Although rough elements such as the flow of time are synchronized in each virtual space, interactions between users may occur separately for each virtual space. Note that the management of the multiplexing of the content server 10 may be performed by a back-end system (not shown).

[0020] Furthermore, the server environment of the content server 10 is not particularly limited. For example, the content server 10 may be a physical server or a virtual server executed on a physical server. The physical server or virtual server described here may be a server provided by a hosting service, or may be a server provided by a provider that provides a service that provides virtual space. Furthermore, the functions of one content server 10 may be realized by multiple physical servers or multiple virtual servers. The content server 10 may manage the location information of users corresponding to multiple user terminals 20 that are communicatively connected to the content server 10.

[0021] (User terminal 20) The user terminal 20 is a terminal used by a user. The user terminal 20 uses content data received from the content server 10 to place virtual objects in a virtual space and generate and display a display screen representing the virtual space. For example, the user terminal 20 places player objects that replicate the movements of players in real space in the virtual space of a soccer stadium based on player motion data included in the content data. Furthermore, the user terminal 20 places a ball object that replicates the movement of a ball in real space in the virtual space of a soccer stadium based on ball motion data included in the content data.

[0022] Furthermore, the user terminal 20 according to the embodiment of the present disclosure places an advertising object, which is a virtual advertisement, in the virtual space. The advertising object is an object for advertising a product, service, company, organization, etc. The advertising object may be two-dimensional data such as still image data or moving image data, or may be three-dimensional data. When an event is held using a predetermined area in the real space, the user terminal 20 may place the advertising object around an area in the virtual space that corresponds to the predetermined area.

[0023] A specific example of a display screen of a virtual space generated and displayed by the user terminal 20 will be described below with reference to FIG.

[0024] Fig. 2 is an explanatory diagram showing a display screen D1 of a virtual space generated and displayed by the user terminal 20. As shown in Fig. 2, the display screen D1 of the virtual space includes displays of a plurality of player objects P1 to P3, a ball object B, and an advertisement object A1. In the example shown in Fig. 2, the advertisement object A1 is placed around an area in the virtual space that corresponds to a soccer court in the real space (i.e., pitch side).

[0025] The virtual space display screen D1 also includes a viewpoint selection display M. The viewpoint selection display M includes items corresponding to each of a plurality of virtual viewpoints. When the user selects one of the items in the viewpoint selection display M, the user terminal 20 generates a display screen of the virtual space in which the virtual space is viewed from the virtual viewpoint corresponding to the selected item. In FIG. 2, multiple items are shown: "Standard," "Bird's eye," "GK," "Shooter," and "Avatar." Of these multiple items, "Standard" is selected in the example shown in FIG. 2.

[0026] In "Standard," the user terminal 20 places the virtual viewpoint on an extension line connecting the goal and the ball. In "Bird's Eye," the user terminal 20 places the virtual viewpoint in a position above and behind the ball, where a wide angle of view can be obtained. These camera positions and camera orientations may be manipulated by the user. In these two items, the virtual viewpoint is placed at a position that provides a bird's-eye view of the players, while in "GK" and "Shooter," the virtual viewpoint is placed at the player's viewpoint, so that a subjective image of the player is generated as a display screen in the virtual space.

[0027] Specifically, in "GK," the user terminal 20 places a virtual viewpoint at the viewpoint position of the goalkeeper. In "Shooter," the user terminal 20 places a virtual viewpoint at the viewpoint position of the player who will shoot at the end of the scene. Note that a scene is one section of a game obtained by dividing the game into multiple sections.

[0028] In "Avatar," the user terminal 20 places a user object corresponding to the user's avatar in a virtual space, and by placing a virtual viewpoint behind the user object, generates a display screen of the virtual space in which the user object is viewed from behind. The user can move the user object within the virtual space by operating the user terminal 20. As the user object moves, the virtual viewpoint also moves, and the display screen of the virtual space also changes.

[0029] The user terminal 20 described above is realized by a smartphone, a tablet terminal, a PC (personal computer), an HMD (head mounted display) that covers the entire field of view, a glasses-type device, a projector, a console game machine, or the like.

[0030] In this specification, the processing when the user terminal 20 stores the advertisement object as application data will be mainly described, but the content server 10 may transmit the advertisement object to the user terminal 20 in the form of content data.

[0031] Furthermore, in the above example, the user terminal 20 generates a display screen of a virtual space based on content data received from the content server 10, but the entity that generates the display screen of the virtual space is not limited to the user terminal 20. For example, if the content server 10 stores a virtual space model, advertising objects, etc., the content server 10 may generate a display screen of the virtual space and transmit the generated display screen to the user terminal 20. In this case, the content server 10 has functions corresponding to the storage unit 220 and display control unit 252 described below.

[0032] <2. Content Server Configuration> The configuration of the information processing system 1 according to the embodiment of the present disclosure has been described above. Next, the configuration of the content server 10 according to the embodiment of the present disclosure will be described with reference to FIG.

[0033] 3 is an explanatory diagram showing the configuration of the content server 10 according to an embodiment of the present disclosure. As shown in FIG. 3, the content server 10 according to an embodiment of the present disclosure includes a communication unit 110, a storage unit 120, and a control unit 150.

[0034] (Communication unit 110) The communication unit 110 communicates various data with other devices. For example, the communication unit 110 receives a request to send content data from the user terminal 20 and transmits the content data to the user terminal 20 under control of the communication control unit 154. The communication unit 110 can also receive event analysis data and sound data obtained by collecting sound at the event from an external server.

[0035] (Storage unit 120) The storage unit 120 stores various data used in the operation of the content server 10. For example, the storage unit 120 stores motion data, sound data, event metadata, and the number of times each scene is played for each event. As described above, the motion data includes player motion data and ball motion data. The player motion data includes, for example, a player ID, which is identification information for the player. The sound data includes cheers, support, the sound of the ball, and the like, obtained by recording sound at the event.

[0036] Event metadata is time-series data indicating the situation for each scene of an event. If the event is a soccer match, the event metadata includes time information, an occurrence, detailed information, and type information. Examples of events that occur in a match include goals (which team scored how many points, which player scored the goal), various warnings from the referee (in soccer, announcing a yellow card or red card, a violation, etc.), free kicks, and player substitutions. The detailed information is detailed information about the occurrence. The time information, the occurrence, and detailed information may be entered manually by an operator or may be obtained mechanically by image analysis or the like. The type information is obtained as a result of a determination by the noteworthy scene determination unit 152 (described later) and indicates "noteworthy" or "normal."

[0037] Fig. 4 is an explanatory diagram showing a specific example of event metadata. In the example shown in Fig. 4, the time "20 minutes to 21 minutes", the occurring event "Chance", the detailed information "AAA was called into action at his near post by BBB...", and the type "normal" are associated. This means that "Chance" occurred in the scene corresponding to the time "20 minutes to 21 minutes", and specifically, the event "AAA was called into action at his near post by BBB..." occurred, and that the scene in question is a normal scene.

[0038] The number of times each scene has been played is the number of times managed for each scene, and is the cumulative number of times each scene has been played by a plurality of user terminals 20. The number of times each scene has been played can be updated by the control unit 150 as needed.

[0039] (control unit 150) The control unit 150 controls the overall operation of the content server 10. In particular, the control unit 150 according to the embodiment of the present disclosure has a function as a noteworthy scene determination unit 152 and a function as a communication control unit 154.

[0040] - Attention scene determination unit 152 The attention scene determination unit 152 determines whether each scene of the event is an attention scene that has attracted a high level of interest from users, and adds the determination result as event metadata to the storage unit 120. The attention scene determination unit 152 can make the above determination based on the reaction to each scene.

[0041] For example, the noteworthy scene determination unit 152 may make the above determination based on sound data stored in the storage unit 120. Specifically, the noteworthy scene determination unit 152 may determine, as a noteworthy scene, a scene that includes cheers louder than a reference level.

[0042] Furthermore, the noteworthy scene determination unit 152 may make the above determination based on the number of times each scene has been played back stored in the storage unit 120. Specifically, the noteworthy scene determination unit 152 may determine that a scene whose number of times played back exceeds a reference value is a noteworthy scene.

[0043] In addition, when users leave comments or express their intention to give high ratings for each scene and the collected comments and high ratings are managed in the memory unit 120, the scene of interest determination unit 152 may determine as a scene of interest a scene for which the number of collected comments or the number of high ratings exceeds a standard.

[0044] -Communication control unit 154 The communication control unit 154 controls communication between the communication unit 110 and the user terminal 20. For example, when the communication unit 110 receives a content data transmission request from the user terminal 20, the communication control unit 154 reads motion data, sound data, and event metadata as content data from the storage unit 120, and causes the communication unit 110 to transmit the content data to the user terminal 20.

[0045] The content data transmission request may include an event ID that identifies the event and time or scene specification information. In this case, the communication control unit 154 may cause the communication unit 110 to transmit to the user terminal 20 the motion data and sound data that correspond to the event ID and that are for the time or scene specified by the specification information, together with the event metadata.

[0046] <3. User terminal configuration> The configuration of the content server 10 according to the embodiment of the present disclosure has been described above. Next, the configuration of the user terminal 20 according to the embodiment of the present disclosure will be described with reference to FIG.

[0047] 5 is an explanatory diagram showing the configuration of a user terminal 20 according to an embodiment of the present disclosure. As shown in FIG. 5, the user terminal 20 according to the embodiment of the present disclosure includes a communication unit 210, a storage unit 220, an operation display unit 230, a sound output unit 240, and a control unit 250.

[0048] (Communication unit 210) The communication unit 210 performs various communications with the content server 10. For example, the communication unit 210 transmits a request to transmit content data to the content server 10 and receives content data from the content server 10.

[0049] (Storage unit 220) The storage unit 220 stores various data used in the operation of the user terminal 20. For example, the storage unit 220 stores a human body model, a virtual space model, and an advertisement object.

[0050] The human body model includes information such as the shape and size of each bone structure of the human body, the face, hairstyle, etc. If the event is a soccer match, the storage unit 220 stores the human body model of each player as the human body model.

[0051] The virtual space model is information that represents the structure of the virtual space. If the event is a soccer match, the storage unit 220 stores a three-dimensional model of a soccer stadium as the virtual space model.

[0052] As described above, an advertising object is an object for advertising a product, service, company, organization, etc. The advertising object may be two-dimensional data such as still image data or moving image data, or may be three-dimensional data.

[0053] An event ID may be set for the advertisement object, indicating which event the advertisement object should be placed on the display screen of the virtual space for. Also, different advertisement objects for the same event may be stored in the storage unit 220. This point will be described in detail in "4. Display Control Example."

[0054] (Operation display section 230) The operation display unit 230 has a function as an operation unit operated by a user and a function as a display unit that displays a display screen. These functions may be formed integrally or separately.

[0055] For example, the user performs a playback operation on the operation display unit 230. The user may also perform an operation to specify a time or scene to be played back on the operation display unit 230. The operation display unit 230 also displays a display screen of the virtual space generated by the display control unit 252, which will be described later.

[0056] (Sound output unit 240) When a display screen of the virtual space is displayed on the operation display unit 230, the sound output unit 240 converts the sound data contained in the content data received by the communication unit 210 into air vibrations and outputs the converted sound data based on control from the sound output control unit 254.

[0057] (control unit 250) The control unit 250 controls the overall operation of the user terminal 20. For example, the control unit 250 controls the acquisition of an application including a human body model, a virtual space model, and an advertisement object from a network, and controls the storage of the acquired application in the storage unit 220. The control unit 250 also functions as a display control unit 252 and a sound output control unit 254 by executing the application.

[0058] The display control unit 252 generates a display screen of the virtual space and displays the display screen of the virtual space on the operation display unit 230. The display control unit 252 generates the display screen of the virtual space based on the data stored in the storage unit 220 and the content data received from the content server 10 by the communication unit 210.

[0059] For example, the display control unit 252 places player objects based on motion data included in the content data in the virtual space of a soccer stadium represented by the virtual space model stored in the storage unit 220. In this case, the display control unit 252 applies the motion data of a certain player to the human body model of that player stored in the storage unit 220 to create a player object of that player, and places that player object at a position indicated by position data included in the motion data. In addition, the display control unit 252 places a ball object at a position indicated by the ball's motion data.

[0060] Furthermore, the display control unit 252 places the advertisement objects stored in the storage unit 220 in the virtual space of the soccer stadium. The display control unit 252 may place the advertisement objects in a region set in advance in the virtual space model. Furthermore, the display control unit 252 places different advertisement objects in the virtual space depending on the scene on the display screen of the virtual space that the user is viewing. Such display control by the display control unit 252 will be described in detail later.

[0061] The sound output control unit 254 causes the sound output unit 240 to output sound data.

[0062] <4. Display control example> The configuration of the user terminal 20 according to the embodiment of the present disclosure has been described above. Next, several examples of display control performed by the display control unit 252 according to the embodiment of the present disclosure will be described.

[0063] (4-1. First display control example) The display control unit 252 arranges in the virtual space, in a scene of interest, which is an example of a particular scene in an event, an advertisement object that is larger than an ordinary scene, which is another scene.

[0064] For example, the virtual space display screen D1 shown in Fig. 2 corresponds to a normal scene, and the virtual space display screen D2 shown in Fig. 6 corresponds to a scene of interest. As shown in contrast between Fig. 2 and Fig. 6, the advertisement object A2 arranged in the scene of interest is larger than the advertisement object A1 arranged in the normal scene, and as a result, even if the position of the virtual viewpoint is the same, the display of the advertisement object A2 is larger than the display of the advertisement object A1.

[0065] For the above display control, the storage unit 220 may store advertisement objects for scenes of interest and advertisement objects for normal scenes. Alternatively, the display control unit 252 may use the advertisement objects stored in the storage unit 220 as they are in normal scenes and enlarge them in scenes of interest.

[0066] In the examples shown in FIGS. 2 and 6, the advertisement objects A1 and A2 have the same content and different sizes, but the relationship between the advertisement objects A1 and A2 is not limited to this example. For example, the advertisement objects A1 and A2 may have different content and the same size, or both the content and the size of the advertisement objects A1 and A2 may be different. The advertisement objects A1 and A2 may have different colors, such as background color, product color, or text color. The advertisement objects A1 and A2 may have different data formats. For example, the advertisement object A1 may be a still image, and the advertisement object A2 may be a moving image. The advertisement object A1 may be a two-dimensional object, and the advertisement object A2 may be a three-dimensional object.

[0067] The flow of the first display control example described above will be summarized below with reference to FIG.

[0068] 7 is a flowchart showing the flow of a first display control example according to an embodiment of the present disclosure. As shown in FIG. 7, first, the user performs a playback operation, including specifying a game, on the operation / display unit 230 of the user terminal 20 (S304). Next, the communication unit 210 transmits a content data transmission request to the content server 10 (S308). The transmission request includes the ID (event ID) of the game specified by the user in S304. As a result, the communication unit 210 receives content data of the specified game from the content server 10 (S312).

[0069] Then, the display control unit 252 places the player objects and the ball object in the virtual space of the soccer stadium represented by the virtual space model stored in the memory unit 220 based on the motion data included in the content data and the human body model stored in the memory unit 220 (S316).

[0070] Next, the display control unit 252 determines whether the scene to be displayed is a scene of interest (S320). The display control unit 252 can make this determination based on event metadata included in the content data.

[0071] When the display control unit 252 determines that the scene to be displayed is a normal scene (S320 / NO), it places a first advertisement object in the virtual space (S324). On the other hand, when the display control unit 252 determines that the scene to be displayed is a scene of interest (S320 / YES), it places a second advertisement object in the virtual space (S328). The first advertisement object may be, for example, an advertisement object A1 shown in FIG. 2, which is smaller than the advertisement object A2 shown in FIG. 6 as the second advertisement object.

[0072] Thereafter, the display control unit 252 generates a display screen of the virtual space (S332), and causes the operation display unit 230 to display the display screen of the virtual space (S336). The above-described processes from S312 to S336 are repeated until the end of playback (S340).

[0073] Although not shown in Figure 7, while the display screen of the virtual space is displayed, the user can perform operations such as specifying the scene or time to be displayed and selecting an item in the viewpoint selection display M, and the user terminal 20 performs controls corresponding to these operations.

[0074] (4-2. Second display control example) The display control unit 252 places different advertisement objects in the virtual space depending on the scene of the display screen of the virtual space that the user is viewing. In the second display control example, the display control unit 252 places different advertisement objects in the virtual space depending on how the display screen of the virtual space appears as a scene of the display screen of the virtual space. Since how the display screen of the virtual space appears changes depending on the position of the virtual viewpoint, it can also be said that the display control unit 252 places different advertisement objects in the virtual space depending on the position of the virtual viewpoint.

[0075] More specifically, the display control unit 252 places different advertisement objects in the virtual space depending on the distance between the position of the virtual viewpoint and the placement position of the advertisement object. For example, when the distance is a first distance, the display control unit 252 may place an advertisement object in the virtual space that is larger in size than when the distance is a second distance that is smaller than the first distance. When the distance is the first distance, the display control unit 252 may place an advertisement object in the virtual space that is the same size as when the distance is the second distance but has larger characters or images than when the distance is the second distance.

[0076] Alternatively, the display control unit 252 may place an advertisement object in the virtual space with different content when the distance is a first distance and when the distance is a second distance that is smaller than the first distance. This example will be described below with reference to FIGS. 8 and 9.

[0077] 8 shows a virtual space display screen D3 as a specific example of a virtual space display screen generated when the distance between the position of the virtual viewpoint and the placement position of the advertisement object is a first distance less than a threshold. In the example shown in FIG. 8, an advertisement object A3 is placed in the virtual space, and thus the advertisement object A3 is displayed on the virtual space display screen D3. The advertisement object A3 is an image of shoes, and the shoes include a logo mark. A user viewing the virtual space display screen D3 can visually recognize the logo mark from the advertisement object A3 and understand which manufacturer the shoes of the advertisement object A3 are.

[0078] 9 shows a virtual space display screen D4 as a specific example of a virtual space display screen generated when the distance between the position of the virtual viewpoint and the placement position of the advertisement object is a second distance equal to or greater than a threshold. In the example shown in FIG. 9, an advertisement object A4 is placed in the virtual space, and thus the advertisement object A4 is displayed on the virtual space display screen D4. The advertisement object A4 is an image of a logo. A user viewing the virtual space display screen D4 can recognize the logo from the advertisement object A4 and understand which manufacturer's advertisement the advertisement object A4 is.

[0079] Note that the size of the advertisement object A3 in the virtual space shown in FIG. 8 is the same as the size of the advertisement object A4 in the virtual space shown in FIG. 9. Therefore, the display size of the advertisement object A4 on the virtual space display screen D4 shown in FIG. 9 is smaller than the display size of the advertisement object A3 on the virtual space display screen D3. FIG. 9 shows, as a comparative example, the display of the advertisement object A3 when the advertisement object A3 is hypothetically arranged in the virtual space. In the comparative example, the display of the advertisement object A3 is small, making it difficult for the user to recognize the logo mark. If the user cannot recognize the logo mark, the advertising effect will be reduced. However, as in the second display control example, the advertisement object A4 shown in FIG. 9 is arranged according to the distance between the position of the virtual viewpoint and the arrangement position of the advertisement object, so that the user can recognize the logo mark, thereby improving the advertising effect.

[0080] The flow of the second display control example described above will be summarized below with reference to FIG.

[0081] 10 is a flowchart showing the flow of a second display control example according to an embodiment of the present disclosure. As shown in FIG. 10, first, the user performs a playback operation, including specifying a game, on the operation / display unit 230 of the user terminal 20 (S304). Next, the communication unit 210 transmits a content data transmission request to the content server 10 (S308). The transmission request includes the ID (event ID) of the game specified by the user in S304. As a result, the communication unit 210 receives content data of the specified game from the content server 10 (S312).

[0082] Then, the display control unit 252 places the player objects and the ball object in the virtual space of the soccer stadium represented by the virtual space model stored in the memory unit 220 based on the motion data included in the content data and the human body model stored in the memory unit 220 (S316).

[0083] Next, the display control unit 252 determines whether the distance between the position of each advertisement object and the position of the virtual viewpoint is equal to or greater than a threshold (S420). Note that the position of the virtual viewpoint changes depending on which item is selected in the viewpoint selection display M shown in FIG. 2 and the situation of the game (for example, the position of the ball object), etc.

[0084] When the display control unit 252 determines that the distance between the placement position of a certain advertisement object and the position of the virtual viewpoint is less than the threshold (S420 / NO), the display control unit 252 places a third advertisement object at the placement position in the virtual space (S424). The third advertisement object is, for example, the advertisement object A3 shown in FIG. 8.

[0085] On the other hand, when the display control unit 252 determines that the distance between the placement position of a certain advertisement object and the position of the virtual viewpoint is equal to or greater than the threshold (S420 / YES), the display control unit 252 places a fourth advertisement object at the placement position in the virtual space (S428). The fourth advertisement object is, for example, the advertisement object A4 shown in FIG. 9.

[0086] Thereafter, the display control unit 252 generates a display screen of the virtual space (S332), and causes the operation display unit 230 to display the display screen of the virtual space (S336). The above-described processes from S312 to S336 are repeated until the end of playback (S340).

[0087] <5. Effects> According to the above-described embodiment of the present disclosure, various effects can be obtained. For example, according to the embodiment of the present disclosure, the display control unit 252 arranges different advertisement objects in the virtual space depending on the scene of the display screen of the virtual space that the user is viewing. With this configuration, appropriate advertisement objects according to the scene are displayed, thereby improving the appeal of the advertisement objects.

[0088] As a specific example, the display control unit 252 may place different advertising objects in the virtual space for a featured scene and a normal scene in an event. Since it is expected that the number of advertising objects recognized will increase in a featured scene, an advertiser can achieve a desired appealing effect by preparing advertising objects for featured scenes and advertising objects for normal scenes based on this. Note that the advertising unit price for displaying advertising objects in featured scenes may be set higher than the advertising unit price for displaying advertising objects in normal scenes.

[0089] Furthermore, according to the embodiment of the present disclosure, an attention scene determination unit 152 is provided that determines whether each scene in an event is an attention scene based on the reaction to each scene. With this configuration, it is possible to reduce the human effort required for determining attention scenes.

[0090] More specifically, the noteworthy scene determination unit 152 can determine whether each scene is a noteworthy scene based on the sound data acquired during the event or the number of times each scene is played. With this configuration, it is possible to obtain an appropriate determination result as to whether each scene is a noteworthy scene.

[0091] Furthermore, the display control unit 252 can arrange, in the virtual space, an advertisement object in a scene of interest that is larger than that in a normal scene. With this configuration, the advertisement object is displayed larger in the scene of interest, which can further improve the appeal of the advertisement object.

[0092] As another example, the display control unit 252 arranges different advertisement objects in the virtual space depending on the position of the virtual viewpoint. That is, the display control unit 252 arranges different advertisement objects in the virtual space depending on the scene in terms of how the virtual space looks. With this configuration, appropriate advertisement objects are displayed depending on how the virtual space looks, thereby improving the appeal of the advertisement objects.

[0093] For example, the display control unit 252 places different advertisement objects in the virtual space depending on the distance between the position of the virtual viewpoint and the placement position of the advertisement object. Since the relationship between the size of the advertisement object and the display size of the advertisement object changes depending on the distance between the position of the virtual viewpoint and the placement position of the advertisement object, it is reasonable to control the advertisement object depending on the distance.

[0094] Specifically, when the distance is a first distance, the display control unit 252 may place an advertisement object in the virtual space that is larger in size than when the distance is a second distance that is smaller than the first distance. Alternatively, the display control unit 252 may place an advertisement object in the virtual space that has different content when the distance is the first distance and when the distance is a second distance that is smaller than the first distance. In either case, it is expected that the appeal effect of the advertisement object will be improved.

[0095] Furthermore, the event is held in a predetermined area in the real space, and the display control unit 252 places advertisement objects around an area in the virtual space that corresponds to the predetermined area. For example, if the predetermined area is a soccer field, the display control unit 252 places advertisement objects on the pitch side around the soccer field. Advertisement objects placed in such areas are less likely to interfere with viewing of the event and are more likely to catch the user's eye.

[0096] <6. Hardware Configuration> The embodiments of the present disclosure have been described above. Information processing such as determining scenes of interest and controlling display is realized by a combination of software and hardware. Below, we will describe examples of hardware configurations that can be applied to the content server 10 and the user terminal 20.

[0097] 11 is a block diagram showing an example of a hardware configuration 90. The hardware configuration 90 includes a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, a RAM (Random Access Memory) 903, and a host bus 904. The hardware configuration 90 also includes a bridge 905, an external bus 906, an interface 907, an input device 908, an output device 910, a storage device (HDD) 911, a drive 912, and a communication device 915.

[0098] The CPU 901 functions as an arithmetic processing unit and a control unit, and controls overall operation in accordance with various programs. The CPU 901 may also be a microprocessor. The ROM 902 stores programs used by the CPU 901, calculation parameters, etc. The RAM 903 temporarily stores programs used in the execution of the CPU 901, parameters that change as appropriate during the execution, etc. These are interconnected by a host bus 904 that is composed of a CPU bus, etc. The functions of the control unit 150 of the content server 10 and the control unit 250 of the user terminal 20, etc., can be realized by the cooperation of the CPU 901, ROM 902, RAM 903, and software.

[0099] The host bus 904 is connected to an external bus 906, such as a PCI (Peripheral Component Interconnect / Interface) bus, via a bridge 905. It is not necessary to configure the host bus 904, bridge 905, and external bus 906 separately, and these functions may be implemented on a single bus.

[0100] The input device 908 is composed of input means such as a mouse, keyboard, touch panel, buttons, microphone, switches, and levers that allow the user to input information, and an input control circuit that generates an input signal based on the user's input and outputs it to the CPU 901. By operating the input device 908, the user can input various types of data and instruct processing operations.

[0101] The output device 910 includes, for example, a display device such as a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Diode) device, and a lamp. Furthermore, the output device 910 includes an audio output device such as a speaker and a headphone. The output device 910 outputs, for example, reproduced content. Specifically, the display device displays various information such as reproduced video data as text or images. Meanwhile, the audio output device converts reproduced audio data and the like into audio and outputs the audio.

[0102] The storage device 911 is a data storage device configured as an example of a storage unit according to this embodiment. The storage device 911 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, and a deleting device that deletes data recorded on the storage medium. The storage device 911 is configured, for example, with an HDD (Hard Disk Drive). This storage device 911 drives a hard disk and stores programs executed by the CPU 901 and various data.

[0103] The drive 912 is a reader / writer for a storage medium, and is built into or externally attached to the hardware configuration 90. The drive 912 reads information recorded on a removable storage medium 84, such as an attached magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and outputs the information to the RAM 903. The drive 912 can also write information to the removable storage medium 84.

[0104] The communication device 915 is, for example, a communication interface configured with a communication device for connecting to the communication network 82. The communication device 915 may be a wireless LAN (Local Area Network) compatible communication device, an LTE (Long Term Evolution) compatible communication device, or a wired communication device that performs wired communication.

[0105] <7. Supplementary Information> Although the preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, the present disclosure is not limited to such examples. It is clear that a person skilled in the art to which the present disclosure pertains can conceive of various modifications or alterations within the scope of the technical ideas set forth in the claims, and it is understood that these also naturally fall within the technical scope of the present disclosure.

[0106] For example, the above describes an example in which the display control unit 252 places different advertisement objects in a scene of interest and a normal scene, and an example in which the display control unit 252 places different advertisement objects depending on the distance between the position of the virtual viewpoint and the position where the advertisement object is placed, but the display control unit 252 may place different advertisement objects depending on other factors.

[0107] For example, when the display control unit 252 controls the sunlight conditions and brightness of the virtual space according to the time period during which content is played, the display control unit 252 may arrange different advertisement objects according to the time period during which content is played. Furthermore, when the display control unit 252 controls the sunlight conditions and brightness of the virtual space according to the time period during which an event is held in the real space, the display control unit 252 may arrange different advertisement objects according to the time period during which the event is held in the real space. With this configuration, advertisement objects suited to the sunlight conditions and brightness of the virtual space (for example, advertisement objects with colors that are highly visible under the sunlight conditions of the virtual space) are arranged, thereby improving the appeal of the advertisement objects.

[0108] Furthermore, the display control unit 252 may arrange different advertisement objects depending on the weather conditions of the virtual space. For example, the display control unit 252 may arrange an advertisement object for a sun protection product when the weather conditions of the virtual space are sunny, and may arrange an advertisement object for a rain protection product such as an umbrella when the weather conditions of the virtual space are rainy. This configuration may also improve the appeal of the advertisement objects.

[0109] The display control unit 252 may also arrange different advertisement objects depending on which display screen is generated to provide a bird's-eye view of a player object. As described above, in "Standard" and "Bird's Eye" modes, the virtual viewpoint is arranged at a position that provides a bird's-eye view of the player object, and the virtual viewpoint also moves as the ball object moves. For example, in a display screen that provides a bird's-eye view of a certain player object, the display control unit 252 may arrange advertisement objects according to the popularity of the player corresponding to the player object or the sponsor with which the player is contracted. Note that the advertisement unit price for displaying advertisement objects on a display screen that provides a bird's-eye view of a player object of a popular player may be set higher than the advertisement unit price for displaying advertisement objects on a display screen that provides a bird's-eye view of a player object of a relatively less popular player.

[0110] The display control unit 252 may also arrange different advertising objects depending on the attributes of the user of the user terminal 20. Examples of the attributes include country of residence, gender, and age. This configuration makes it possible to control whether or not an advertising object for alcoholic beverages is displayed depending on the user's age, and to display advertising objects for brands that correspond to the user's country of residence.

[0111] The user terminal 20 can also take a photograph that represents the virtual space at a certain point in time. For example, in "Avatar," it is possible to take a selfie of the user's avatar. When a photograph is taken, the display control unit 252 may change the advertisement objects in the virtual space. This allows advertisement objects displayed in the photograph to be different from those displayed in the video. In this way, it is useful to arrange different advertisement objects depending on whether the scene the user is viewing is a video scene or a photo scene.

[0112] Although the above describes an example in which advertisement objects are placed on the sidelines of a soccer match, the placement position of advertisement objects is not limited to the sidelines of the pitch. For example, the display control unit 252 may place advertisement objects on event equipment such as players' uniforms, goal nets, or balls. Furthermore, the display control unit 252 may place advertisement objects on three-dimensional objects such as flying objects that fly in a virtual space.

[0113] Although the above describes an example in which an advertisement object is placed in a virtual space and the display of the advertisement object is included in the display screen of the virtual space, the advertisement object may be used in other ways. For example, the display control unit 252 may place the advertisement object in a window separate from the window including the display screen of the virtual space.

[0114] The display screen of the virtual space described above may be designed to be linked to e-commerce. For example, when a user taps a player object on the display screen of the virtual space, the user terminal 20 may access a server that sells uniforms for the player object and display a purchase screen for the uniform of the player object. On the purchase screen, the user may purchase a uniform with the player's number and name engraved on it.

[0115] Furthermore, the steps in the processing of the user terminal 20 do not necessarily have to be processed in chronological order according to the order described in the flowchart. For example, the steps in the processing of the user terminal 20 may be processed in an order different from the order described in the flowchart, or may be processed in parallel.

[0116] It is also possible to create a computer program that causes hardware such as a CPU, ROM, and RAM built into the content server 10 and the user terminal 20 to perform functions equivalent to those of the above-described components of the content server 10 and the user terminal 20. A non-transitory storage medium on which the computer program is stored is also provided.

[0117] Furthermore, the user terminal 20 is able to perform each of the above-described functions of the user terminal 20 by receiving content data from the content server 10. In other words, from a certain perspective, the user terminal 20 according to the embodiment of the present disclosure and the information processing system 1 including the user terminal 20 can be considered to be produced based on the provision of content data from the content server 10.

[0118] Furthermore, the effects described herein are merely descriptive or exemplary and are not limiting. In other words, the technology according to the present disclosure may achieve other effects that will be apparent to those skilled in the art from the description of this specification, in addition to or in place of the above-described effects.

[0119] The following configurations also fall within the technical scope of the present disclosure. (1) a display control unit that generates a display screen of a virtual space in which a virtual object having a movement according to the motion data of the target is arranged; The display control unit places different advertising objects in the virtual space depending on the scene on the display screen that the user is viewing. (2) the motion data of the object is motion data of the object in an event in real space; The information processing system according to (1), wherein the display control unit arranges the different advertising objects in the virtual space between a specific scene in the event and other scenes. (3) The information processing system according to (2), further comprising a scene determination unit that determines whether each scene in the event corresponds to the specific scene based on a reaction to each scene. (4) The information processing system described in (3), wherein the scene determination unit determines whether each scene corresponds to the specific scene based on sound data acquired during the event in the real space. (5) The information processing system according to (3), wherein the scene determination unit determines whether or not each of the scenes corresponds to the specific scene based on the number of times each of the scenes has been played. (6) The information processing system according to any one of (2) to (5), wherein the display control unit places, in the specific scene, an advertisement object larger than those in the other scenes in the virtual space. (7) the display control unit generates, as the display screen, a screen that represents the virtual space as seen from a virtual viewpoint that is a virtual viewpoint in the virtual space; The information processing system described in (1), wherein the display control unit arranges the different advertising objects in the virtual space depending on the scene, and arranges the different advertising objects in the virtual space depending on the position of the virtual viewpoint. (8) The information processing system according to (7), wherein the display control unit places the different advertising objects in the virtual space depending on a distance between a position of the virtual viewpoint and a position where the advertising object is placed. (9) The information processing system described in (8), wherein the display control unit places an advertising object in the virtual space that is larger when the distance is a first distance than when the distance is a second distance that is smaller than the first distance. (10) The information processing system described in (8), wherein the display control unit places an advertising object in the virtual space with different content when the distance is a first distance and when the distance is a second distance smaller than the first distance. (11) the event is carried out using a predetermined area in real space, The information processing system according to any one of (2) to (5), wherein the display control unit arranges the advertisement objects around an area corresponding to the predetermined area in the virtual space. (12) the information processing system includes a user terminal and an information processing device; the information processing device includes the display control unit and a communication control unit that controls transmission of the display screen to the user terminal; The information processing system according to any one of (1) to (11), wherein the user terminal receives the display screen from the information processing device and causes a display unit to display the display screen. (13) the information processing system includes a user terminal and an information processing device; the information processing device includes a communication control unit that controls transmission of the motion data of the target to the user terminal; The information processing system according to any one of (1) to (11), wherein the user terminal includes the display control unit that operates based on motion data of the target received from the information processing device. (14) generating, by a processor, a display screen of a virtual space in which a virtual object having a movement according to the motion data of the target is placed; The method, wherein generating a display screen of the virtual space includes placing different advertising objects in the virtual space depending on the scene of the display screen that a user is viewing. (15) Computer, a program for causing the display control unit to function as a display control unit that generates a display screen of a virtual space in which a virtual object having a movement according to the target motion data is placed, The display control unit is a program that arranges different advertising objects in the virtual space depending on the scene on the display screen that the user is viewing. [Explanation of symbols]

[0120] 1. Information Processing Systems 10 Content Server 110 Communications Department 120 Storage section 150 control section 152 Attention Scene Judgment Unit 154 Communication control section 20 User terminal 210 Communications Department 220 Storage section 230 Operation display section 240 Sound output unit 250 control section 252 Display control unit 254 Sound output control unit

Claims

1. a display control unit that generates a display screen of a virtual space in which a virtual object having a movement according to the motion data of the target is arranged; The display control unit places different advertising objects in the virtual space depending on the scene on the display screen that the user is viewing.

2. the motion data of the object is motion data of the object in an event in real space; The information processing system according to claim 1 , wherein the display control unit arranges the different advertising objects in the virtual space between a specific scene in the event and other scenes.

3. The information processing system according to claim 2 , further comprising a scene determination unit that determines whether each scene in the event corresponds to the specific scene based on a reaction to each scene.

4. The information processing system according to claim 3 , wherein the scene determination unit determines whether or not each of the scenes corresponds to the specific scene based on sound data acquired during the event in the real space.

5. The information processing system according to claim 3 , wherein the scene determination unit determines whether or not each of the scenes corresponds to the specific scene based on the number of times each of the scenes has been played.

6. The information processing system according to claim 2 , wherein the display control unit arranges in the virtual space, in the specific scene, an advertising object that is larger than those in the other scenes.

7. the display control unit generates, as the display screen, a screen that represents the virtual space as seen from a virtual viewpoint that is a virtual viewpoint in the virtual space; The information processing system according to claim 1 , wherein the display control unit arranges the different advertising objects in the virtual space depending on the scene, and arranges the different advertising objects in the virtual space depending on the position of the virtual viewpoint.

8. The information processing system according to claim 7 , wherein the display control unit places the different advertisement objects in the virtual space depending on a distance between the position of the virtual viewpoint and a position where the advertisement object is placed.

9. 9. The information processing system according to claim 8, wherein the display control unit places an advertising object in the virtual space that is larger when the distance is a first distance than when the distance is a second distance that is smaller than the first distance.

10. 9. The information processing system according to claim 8, wherein the display control unit places an advertising object in the virtual space having different content when the distance is a first distance and when the distance is a second distance that is smaller than the first distance.

11. the event is carried out using a predetermined area in real space, The information processing system according to claim 2 , wherein the display control unit arranges the advertisement object around an area corresponding to the predetermined area in the virtual space.

12. the information processing system includes a user terminal and an information processing device; the information processing device includes the display control unit and a communication control unit that controls transmission of the display screen to the user terminal; The information processing system according to claim 1 , wherein the user terminal receives the display screen from the information processing device and displays the display screen on a display unit.

13. the information processing system includes a user terminal and an information processing device; the information processing device includes a communication control unit that controls transmission of the motion data of the target to the user terminal; The information processing system according to claim 1 , wherein the user terminal comprises the display control unit that operates based on the motion data of the target received from the information processing device.

14. generating, by a processor, a display screen of a virtual space in which a virtual object having a movement according to the motion data of the target is placed; The method, wherein generating a display screen of the virtual space includes placing different advertising objects in the virtual space depending on the scene of the display screen that a user is viewing.

15. Computer, a program for causing the display control unit to function as a display control unit that generates a display screen of a virtual space in which a virtual object having a movement according to the target motion data is placed, The display control unit is a program that arranges different advertising objects in the virtual space depending on the scene on the display screen that the user is viewing.

Images