Computer system, content viewing system and program

Abstract

To provide a technology of ensuring the visibility of a provided video while receiving a viewer action such as tipping that a viewer performs for the provided video.SOLUTION: A server system 1100 causes an object, which corresponds to a viewer action of each viewer, to appear in a virtual view space, and provides a video of the view space viewed from the visual point of a target viewer, to a viewer terminal of the target viewer. The server system 1100 includes a visual field ensured region defining unit 237 that defines a visual field ensured region for the target viewer, and a condition satisfying object display control unit 239 that makes display control of an object (condition satisfying object) that satisfies an intra-region condition which indicates that the corresponding object passes or is located in the visual field ensured region, different from display control of an object (condition unsatisfying object) that does not satisfy the intra-region condition.SELECTED DRAWING: Figure 12

Description

[Technical field]

[0001] The present invention relates to a computer system for providing a video to a viewer. [Background technology]

[0002] As a technology for live streaming of video content, a technology is known that accepts voting operations from viewers to praise the video provided or to support the broadcaster (contributor) (see Patent Document 1). Some technologies also have various posting functions that allow viewers to comment on the video provided or to provide monetary rewards to the broadcaster. In particular, the provision of rewards from viewers to contributors is called "tipping" or "gifts" after donations from spectators to street performers. Hereinafter, these will be collectively referred to as "tipping." When a viewer posts a tip or comment using this posting function, the posted information is reflected on the viewing screen by, for example, appearing a corresponding object. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-182546 A Summary of the Invention [Problem to be solved by the invention]

[0004] According to the posting function described above, the poster is given income according to the amount of the tip, which has the effect of encouraging further posting. Also, for the viewers, it brings joy to self-expression by publicly expressing one's will and position to other viewers, such as by praising or cheering, and is expected to have the effect of livening up the atmosphere by inviting more tips. However, if the atmosphere becomes lively and the number of posts such as tips increases, the number of objects displayed on the viewing screen also increases, which can cause a problem of worsening the visibility of the essential video.

[0005] The problem that the present invention aims to solve is to provide a technology that can ensure the visibility of the provided video while accepting viewer actions such as tips made by viewers in response to the provision of the video. [Means for solving the problem]

[0006] A first invention for solving the above problem is a computer system for making objects corresponding to viewer actions of each viewer appear in a virtual viewing space and providing an image of the viewing space seen from the viewpoint of a target viewer to the target viewer, the computer system comprising: a field of view securing area setting means (e.g., the field of view securing area setting unit 237 of FIG. 12) for setting a field of view securing area for the target viewer; and a condition satisfying object display control means (e.g., the condition satisfying object display control unit 239 of FIG. 12) for differentiating display control of objects that satisfy an in-area condition indicating that the object passes through or is located within the field of view securing area (hereinafter referred to as a "condition satisfying object") from display control of objects that do not satisfy the condition (hereinafter referred to as a "condition non-satisfying object").

[0007] According to the first aspect of the present invention, a video of a virtual viewing space in which a corresponding object appears when the viewer performs a viewer action can be provided to the viewer. A view-ensuring area is set for each viewer in this viewing space, and different display controls are performed for objects passing through the view-ensuring area and objects that satisfy a condition located within the view-ensuring area, and other objects that do not satisfy a condition, and the video is provided to each viewer. This makes it possible to ensure the visibility of the provided video while accepting viewer actions such as tipping made by the viewer in response to the provision of the video.

[0008] In addition, a second invention is a computer system of the first invention, further comprising an object movement control means (e.g., object movement control unit 235 of FIG. 12) for making the object appear in the viewing space and moving it along a given trajectory.

[0009] According to the second invention, when a viewer action is performed by the viewer, a corresponding object can be made to appear in the viewing space and can be made to move within the viewing space along a given trajectory.

[0010] A third invention is a computer system of the second invention, wherein the object movement control means moves the object along the trajectory until a predetermined stopping condition is satisfied, and the condition-satisfying object display control means detects the condition-satisfying object from among the objects being moved by the object movement control means.

[0011] According to the third invention, after detecting a condition satisfying object among objects under movement control, it is possible to control the display of the object depending on whether it is a condition satisfying object or a condition non-satisfying object.

[0012] In addition, a fourth invention is a computer system of the second or third invention, wherein the condition-satisfying object display control means has a trajectory change control means (for example, the condition-satisfying object display control unit 239 in Figure 12) that changes the trajectory of the condition-satisfying object in a direction away from the field of view ensuring area.

[0013] According to the fourth invention, it is possible to change the trajectory of the condition satisfying object, and move it in a direction away from the view securing area.

[0014] In addition, a fifth invention is a computer system of any of the first to fourth inventions, in which the condition-satisfying object display control means has a form change control means (for example, form change control unit 243 of Figure 12) that controls the display form of the condition-satisfying object to be different from the display form of the condition non-satisfying object.

[0015] According to the fifth invention, a condition satisfying object and a condition non-satisfying object can be displayed in different display forms.

[0016] In addition, a sixth invention is a computer system of the fifth invention, wherein the form change control means changes the display form of the condition-satisfying object to one that is more transparent and / or smaller in size than the condition-non-satisfying object.

[0017] According to the sixth invention, the condition satisfying object can be displayed with higher transparency and smaller size than the condition non-satisfying object.

[0018] A seventh invention is a computer system of any of the first to sixth inventions, in which a character whose movement is controlled based on a given movement control is placed in the viewing space, and the field of view securing area setting means sets the field of view securing area based on the character.

[0019] According to the seventh aspect of the present invention, the visual field securing area can be set based on a character whose movement is controlled in the viewing space.

[0020] An eighth aspect of the present invention is the computer system according to the seventh aspect of the present invention, wherein the field of view ensuring area setting means sets the field of view ensuring area based on a positional relationship between the viewpoint and the character.

[0021] According to the eighth aspect of the invention, the visual field securing area can be set based on the positional relationship between the character and the viewpoint in the viewing space.

[0022] A ninth aspect of the present invention is the computer system according to the seventh aspect of the present invention, wherein the field of view ensuring area setting means sets the field of view ensuring area based on setting specifications for the field of view ensuring area associated with the character.

[0023] According to the ninth aspect of the present invention, for example, it is possible to determine the setting specifications of the visual field securing area for each character, and to set the visual field securing area using the setting specifications of the character in the viewing space.

[0024] In addition, a tenth invention is a computer system of the eighth invention, further comprising a viewpoint control means (e.g., viewpoint control unit 245 in FIG. 12) that changes the direction of the viewpoint and / or the position of the viewpoint based on operational input from the target viewer, and the field of view securing area setting means updates and sets the field of view securing area in accordance with the control of the viewpoint control means.

[0025] According to the tenth aspect of the invention, when the direction or position of the viewpoint is changed based on the operational input of the viewer, the field of view securing area can be updated and set in accordance with the changed direction or position of the viewpoint.

[0026] An eleventh aspect of the present invention is the computer system according to any one of the first to tenth aspects of the present invention, wherein the view-ensuring area setting means variably sets the view-ensuring area based on an input status of the viewer action.

[0027] According to the eleventh aspect of the present invention, the field of view securing area can be variably set in accordance with the input status of the viewer action.

[0028] In addition, a twelfth invention is a computer system of any of the first to eleventh inventions, wherein the condition satisfying object display control means variably controls the display control of the condition satisfying object based on an input status of the viewer action.

[0029] According to the twelfth invention, by performing display control according to the input status of a viewer action, it is possible to variably control the display control of the condition satisfying objects.

[0030] A thirteenth aspect of the present invention is the computer system according to any one of the first to twelfth aspects of the present invention, wherein the field of view securing area setting means sets the field of view securing area within a field of view range of the viewpoint.

[0031] According to the thirteenth aspect of the present invention, the field of view securing area for the target viewer can be set within the field of view of the viewpoint for the target viewer.

[0032] In addition, a 14th invention is a computer system of any of the 1st to 12th inventions, wherein the condition satisfying object display control means excludes the objects related to the target viewer from the condition satisfying objects, and detects the condition satisfying objects from among the objects related to viewers other than the target viewer.

[0033] According to the 14th invention, objects of viewer actions performed by the target viewer are not considered to be condition-satisfying objects, and condition-satisfying objects are detected from objects of viewer actions performed by viewers other than the target viewer, and the display of the object can be controlled depending on whether it is a condition-satisfying object or a condition-non-satisfying object.

[0034] In addition, a 15th invention is a computer system of any of the 1st to 14th inventions, wherein the viewer action is an operation input entered by consuming a given consumption value from a parameter value possessed by the viewer.

[0035] According to the fifteenth aspect, a viewer can input a viewer action by consuming his / her own parameter value.

[0036] A sixteenth invention is a content viewing system (e.g., the content viewing system 1000 in FIG. 1) comprising a server system (e.g., the server system 1100 in FIG. 1), which is a computer system of any one of the first to fifteenth inventions communicatively connected to a viewer terminal of each viewer, and the viewer terminal (e.g., the viewer terminal 1500 in FIG. 1).

[0037] According to the sixteenth aspect of the present invention, it is possible to realize a content viewing system that exhibits the same effects as any one of the first to fifteenth aspects of the present invention.

[0038] In addition, the 17th invention is a program (for example, video provision program 504 in Figure 18) for causing a computer system to make objects corresponding to viewer actions of each viewer appear in a virtual viewing space and provide an image of the viewing space seen from the viewpoint of the target viewer to the target viewer, the program causing the computer system to function as a field of view securing area setting means for setting a field of view securing area for the target viewer, and a condition satisfying object display control means for differentiating display control of objects (hereinafter referred to as "condition satisfying objects") that satisfy an in-area condition indicating that the object passes through or is located within the field of view securing area from display control of objects (hereinafter referred to as "condition non-satisfying objects") that do not satisfy the condition.

[0039] According to the seventeenth aspect of the present invention, it is possible to realize a program that provides the same effects as the first aspect of the present invention. [Brief description of the drawings]

[0040] [Figure 1] FIG. 1 is a diagram showing an example of the overall configuration of a content viewing system. [Diagram 2] FIG. 2 is a diagram showing an example of the device configuration of a viewer terminal. [Diagram 3] FIG. 1 is a diagram showing an example of a viewing space. [Figure 4] FIG. 4 is a diagram showing an example of a viewing screen. [Diagram 5] FIG. 13 is a diagram showing an example of an object selection screen. [Figure 6] FIG. 13 is a diagram showing an example of an action operation for executing posting. [Figure 7] 6A and 6B are diagrams for explaining a field of view securing area setting process. [Figure 8] 13 is another diagram for explaining the field-of-view securing area setting process. FIG. [Figure 9] FIG. 13 is a diagram showing an example of a coefficient K. [Figure 10] 11A and 11B are diagrams for explaining changes in the display form of a condition satisfying object. [Figure 11] 13 is another diagram for explaining the change in the display form of the condition satisfying object. FIG. [Figure 12]FIG. 2 is a block diagram showing an example of the functional configuration of the server system. [Figure 13] FIG. 4 is a diagram showing an example of a data configuration of user management data. [Figure 14] FIG. 4 is a diagram showing an example of the data configuration of video provision management data. [Figure 15] FIG. 2 is a block diagram showing an example of the functional configuration of a viewer terminal in the first embodiment. [Figure 16] 6 is a flowchart showing a process flow in the server system. [Figure 17] 4 is a flowchart showing a process for generating an image in an audio-visual space. [Figure 18] FIG. 11 is a block diagram showing an example of the functional configuration of a viewer terminal in the second embodiment. [Figure 19] 13 is a diagram showing an example of setting a visual field securing area 60 in Modification 2. FIG. [Figure 20] 13 is a diagram showing another example of setting the visual field securing area 60 in the second modification example. FIG. [Figure 21] 13A to 13C are diagrams for explaining adjustment of margins in Modification 2. [Figure 22] 13A to 13C are views for explaining a condition satisfying object display control process in Modification 3. [Diagram 23] FIG. 4 is a diagram showing an example of setting specification data. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0041] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. Note that the present invention is not limited to the embodiments described below, and the forms to which the present invention can be applied are not limited to the following embodiments. In addition, in the description of the drawings, the same parts are given the same reference numerals.

[0042] [First embodiment] Fig. 1 is a diagram showing an example of the configuration of a content viewing system 1000 according to the present embodiment. As shown in Fig. 1, the content viewing system 1000 includes a server system 1100, which is a computer system, and a viewer terminal 1500 owned by a user (hereinafter also referred to as a "viewer") 2, who is a viewer of the content, and these are connected via a network N so as to be able to communicate data with each other.

[0043] The network N refers to a communication path that allows data communication. In other words, the network N includes a dedicated line (dedicated cable) for direct connection, a LAN (Local Area Network) using Ethernet (registered trademark), etc., as well as a telephone communication network, a cable network, the Internet, and other communication networks, and the communication method can be either wired or wireless.

[0044] The server system 1100 includes, for example, a keyboard 1106 , a touch panel 1108 , and a storage 1140 , and the main unit 1101 is equipped with a control board 1150 .

[0045] The control board 1150 is equipped with various microprocessors such as a CPU (Central Processing Unit) 1151, a GPU (Graphics Processing Unit), and a DSP (Digital Signal Processor), various IC memories 1152 such as a VRAM, RAM, and ROM, and a communication device 1153. Note that a part or the whole of the control board 1150 may be realized by an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or an SoC (System on a Chip).

[0046] The server system 1100 realizes, by the control board 1150 performing calculations based on predetermined programs and data, (1) a user management function for registering users (viewers) 2 and managing information on registered users 2, (2) a distribution service function for allowing an unspecified number of people to enjoy given content, such as multimedia content, simultaneously, (3) a viewer action function for viewers 2 of the content to post “tips” as a given viewer action, and (4) a settlement function for settling the tip amount associated with the tip posting.

[0047] In this embodiment, an example of a live distribution service function that provides content to a viewer terminal 1500 according to a distribution schedule is shown. To realize this distribution service function, the server system 1100 manages a content publishing site. However, the publishing site may be managed using an external video publishing management server 1200. The video publishing management server 1200 is an external server for operating and managing an existing video publishing site (a website that accepts video submissions from an unspecified number of contributors via the Internet, etc., and provides the submitted videos to an unspecified number of viewers in a streaming playback mode). In this case, the server system 1100 communicates with the video publishing management server 1200 to automatically post the content, thereby publishing it.

[0048] Also, as a viewer action function, an example of accepting tips during live distribution of content is shown. The viewer 2 can post tips in exchange for consuming virtual currency equivalent points (hereinafter simply referred to as "currency points") as parameter values ​​that the viewer possesses. In this embodiment, the viewer 2 posts tips using a tip object 4 exemplified in FIG. 5 and the like. Various tip objects 4 with different tip amounts, which are the consumption value of currency points, are provided, and a tip of that amount can be posted by selecting the one to use for posting and performing an action operation described later.

[0049] The settlement function is a function for the viewer 2 to purchase currency points, and in response to a request from the viewer terminal 1500, the settlement function cooperates with an external electronic settlement server 1300 operated by an electronic settlement service provider or the like to carry out a procedure for purchasing currency points (charging process) for the currency points. During the charging process, the electronic settlement server 1300 responds to an inquiry from the server system 1100 and carries out a process for settling the purchase amount of the currency points with the viewer 2's credit card, prepaid card, or the like. The server system 1100 then grants the viewer 2 currency points equivalent to the purchase amount settled by the electronic settlement server 1300.

[0050] 1, the server system 1100 is depicted as a single server device, but multiple server devices connected online may share one or multiple of the above-mentioned functions. The server system 1100 may also be configured to include multiple blade servers sharing each function and connected to each other via an internal bus so that data communication is possible. A configuration in which multiple independent server devices installed at separate locations communicate data via a network N to function as the server system 1100 as a whole may also be used.

[0051] Also, in FIG. 1, two viewer terminals 1500 for viewers 2 are shown, however, in actual operation, there may be three or more viewers 2, each of which accesses the server system 1100 using a viewer terminal 1500.

[0052] Here, the viewer terminal 1500 is a computer system used individually to view content, and is an electronic device (electronic equipment) that can access the server system 1100 via the network N. The viewer terminal 1500 in this embodiment is a device known as a smartphone, but may also be a portable game device, a tablet computer, a personal computer, or the like.

[0053] FIG. 2 is a front view showing an example of the configuration of a viewer terminal 1500 in this embodiment. As shown in FIG. 2, the viewer terminal 1500 includes a direction input key 1502, a home key 1504, a touch panel 1506 that functions as an image display device and a contact position input device, a built-in battery 1509, a speaker 1510, a microphone 1512, a camera 1520, a control board 1550, and a memory card reader 1542 that can read and write data to a memory card 1540 that is a computer-readable storage medium. In addition, a power button, a volume control button, etc. that are not shown in the figure are also provided. An IC card reader or the like that can read and write data contactlessly to an IC card type credit card or prepaid card that can be used to pay tip amounts, etc. may be provided.

[0054] The control board 1550 is equipped with various microprocessors such as a CPU 1551, a GPU, and a DSP, various IC memories 1552 such as a VRAM, a RAM, and a ROM, a wireless communication module 1553 for wireless communication with a mobile phone base station or a wireless communication base station connected to the network N, and an interface circuit 1557. The interface circuit 1557 includes a circuit for receiving signals from the direction input key 1502 and the home key 1504, a driver circuit for the touch panel 1506, an output amplifier circuit for outputting an audio signal to the speaker 1510, an audio signal generating circuit for generating an audio signal collected by the microphone 1512, a circuit for inputting image data of an image captured by the camera 1520, and a signal input / output circuit for the memory card reader 1542. Each of these elements mounted on the control board 1550 is electrically connected to each other via a bus circuit or the like, and is connected so as to be able to read and write data and transmit and receive signals. Note that a part or all of the control board 1550 may be configured with an ASIC, an FPGA, or an SoC.

[0055] In this control board 1550, a viewing program for enabling viewing of content and posting of tips, and various setting data required for executing this viewing program are stored in IC memory 1552. The viewing program and the like are downloaded from server system 1100 at an appropriate timing such as when a user registers. The viewing program and the like may be read from a storage medium such as memory card 1540 obtained separately. Then, CPU 1551 and the like execute the viewing program to perform calculation processing, and controls each part of viewer terminal 1500 in response to operational inputs to touch panel 1506, directional input key 1502, and home key 1504, thereby enabling viewing of content on viewer terminal 1500.

[0056] [About providing content and posting tips] In this embodiment, a video of a live event (concert) held by a performer character such as a character in a virtual viewing space is treated as content, and is live-streamed to the viewer terminal 1500. The performer character may be, for example, a character operated by a distributor (also called a video poster) who wishes to stream the content, or an avatar character of the distributor. The avatar character may be operated by a method in which the distributor moves in a video of the distributor (a so-called Vtuber method).

[0057] Fig. 3 is a diagram showing an example of an audiovisual space 10, which is a virtual three-dimensional space constructed for video distribution. For example, as shown in Fig. 3, the audiovisual space 10 includes a stage 11 and a viewing area 13 in front of the stage 11. During a concert, performer characters 3 perform live performances such as singing songs, dancing, and playing musical instruments on the stage 11. A server system 1100 provides (distributes) content by live-distributing concert videos in this audiovisual space 10 to a viewer terminal 1500.

[0058] The viewing area 13 is a viewing position where viewers who have registered as viewers of the live distribution become spectators 6 and watch the concert, and spectator-view cameras 8 corresponding one-to-one to the viewers are arranged therein. For example, the viewing area 13 is configured with a plurality of spectator seats arranged in a predetermined layout, with one viewer assigned to each seat, and a spectator-view camera 8 for that viewer arranged at each seat. Then, by shooting video of the viewing space 10 with each spectator-view camera 8, a concert video is generated for each viewer. In other words, during the live distribution, video of the viewing space 10 as seen from each spectator-view camera 8 is provided to each viewer terminal 1500 as a concert video for the corresponding viewer.

[0059] In addition, in this embodiment, when a viewer posts a tip during live streaming, the tip object 4 (e.g., tip objects 4a and 4b) used to post the tip appears in the viewing space 10. Specifically, the tip object 4 appears, for example, from the position of the audience seat of the viewer who posted the tip, and moves in the viewing space 10 along a given trajectory (e.g., a parabola) as if it was thrown from the audience seat, as shown by an arrow in FIG. 3. Eventually, it lands on the floor of the viewing area 13 or the stage 11, and is arranged at the landing position. As a process for this purpose, the server system 1100 performs a movement control process of the tip object 4 for each posted tip. Specifically, the tip object 4 is stopped when the tip object 4 lands at the landing position, and the tip object 4 is moved until the stopping condition is satisfied.

[0060] Here, the trajectory of the tipping object 4 is set in advance as a trajectory function determined according to a given action operation. For example, the insertion direction and flight distance (movement distance) of the tipping object 4 are determined according to the action operation of the viewer. In this embodiment, as described later with reference to FIG. 6, the insertion direction is determined by the direction of the flick operation accepted as the action operation, and the flight distance is determined by the flick speed or the length of the flick. Note that multiple tipping trajectory functions may be prepared and one may be determined by accepting a selection operation of the viewer.

[0061] [About the viewing screen] Fig. 4 is a diagram showing an example of a viewing screen of content (concert video) on the viewer terminal 1500. The viewing screen is displayed when a viewer accesses the public server with the viewer terminal 1500 and completes viewer registration for the live streaming to be viewed. As shown in Fig. 4, the viewing screen includes a content display unit 21 on which the concert video of the live streaming is displayed, a camera operation unit 30 for operating the direction and zoom of the spectator viewpoint camera 8 assigned to the viewer, a tipping icon 23 for submitting a tip, and a purchase icon 25 for purchasing currency points.

[0062] Camera operation unit 30 includes a direction operation unit 31 for changing the shooting direction such as panning and tilting, and a view angle operation unit 33 for changing the shooting view angle. Therefore, while watching the concert video displayed on content display unit 21, the viewer can appropriately change the direction and zoom of spectator viewpoint camera 8 on camera operation unit 30.

[0063] In this embodiment, the position of spectator-view camera 8 is fixed to the spectator seats and cannot be moved, but for example, in a case where viewing area 13 is set as standing room only, it may be possible to allow viewers to change the position (shooting position) of spectator-view camera 8 on the assumption that they will move around within viewing area 13. In that case, this can be realized by providing camera operation unit 30 with a position operation unit for changing the shooting position.

[0064] Then, when the tip icon 23 is touched on the viewing screen, an action operation for posting can be performed. Specifically, when the tip icon 23 is touched, first, the object selection screen W1 shown in FIG. 5 is popped up. The object selection screen W1 displays a list of multiple tip objects 4 (4a, 4b, 4c, . . . ) prepared in advance. The tip amount is added to each tip object 4 and presented to the viewer. More specifically, the object selection screen W1 displays only tip objects 4 that the viewer has and can use because the viewer has currency points equal to or greater than the tip amount among the tip objects 4 prepared in advance in a selectable state. For tip objects 4 with insufficient balance, the viewer can touch the purchase icon 25 on the viewing screen in FIG. 4 to purchase currency points and the tip object 4 can be selected. In this way, when sending a tip, the viewer who sends the tip is requested to settle the tip amount through the electronic settlement server 1300.

[0065] In addition, the object selection screen W1 may be configured to display all tip objects 4 in a selectable state, while when the decision button B1 is touched, the balance is checked, and if insufficient, the user is prompted to purchase currency points. Also, the configuration is not limited to purchasing currency points for the tip amount before posting a tip, but may be configured to allow the user to obtain (purchase) tip objects 4 in advance in exchange for consuming currency points, and use the tip objects 4 in hand for posting. In that case, for example, when the purchase icon 25 is touched, a sales screen displaying a list of tip objects 4 for sale is displayed, and the tip objects 4 are sold for their respective tip amounts.

[0066] When a viewer wants to post a tip, the viewer selects the tip object 4 to be used for the post on the object selection screen W1 and touches the confirm button B1. Then, the viewer can perform the action operation of posting in exchange for consuming the currency points for the tip amount.

[0067] FIG. 6 is a diagram showing an example of an action operation for posting. For example, when the settlement of the tip amount is completed, the object selection screen W1 is closed. Then, as shown in FIG. 6, a tip object (a tip object of the type selected immediately before on the object selection screen W1) 4a used for posting a tip is displayed in the lower center of the content display unit 21. Then, the action operation is a flick operation (shaded arrow in FIG. 6) performed with the tip object 4a as the starting point. That is, the direction of the flick operation is used to input the insertion direction of the tip object 4a, and the speed of the flick or the length of the flick is used to input the flight distance (travel distance). When the action operation is performed in this way, the tip object 4a appears in the viewing space 10 and flies to the landing position along a trajectory calculated and set based on the insertion direction and flight distance.

[0068] Therefore, during the live distribution, a viewer who has registered as a viewer can submit tips at any time he or she wishes while watching the concert video displayed on the content display unit 21.

[0069] [detail] As the number of viewers of the live broadcast increases and the atmosphere becomes more lively, the number of tips posted may also increase. The tipping object 4 appears from the seating position in the viewing area 13 and flies and moves within the viewing space 10, so it may cross the visual field of other viewers and interfere with the viewing of the concert video for those other viewers. In this embodiment, in order to prevent the deterioration of the visibility of the concert video caused by viewers posting tips, first, a video of the viewing space 10 is generated excluding the tipping object 4. Then, all viewers watching the live broadcast are sequentially set as target viewers, and a visual field securing area setting process and a condition fulfilling object display control process are performed to composite the display of the tipping object 4 into the video of the viewing space 10.

[0070] 1. About the process of setting the field of view In the view-ensuring area setting process, the server system 1100 sets a view-ensuring area for a target viewer. FIG. 7 and FIG. 8 are diagrams for explaining the view-ensuring area setting process. FIG. 7 focuses on a viewer shown as a spectator 6a in the viewing space 10 in FIG. 3 as a target viewer, and shows a view range 40 (40a) of the spectator viewpoint camera 8a and a view-ensuring area 50 (50a) set for the target viewer. Similarly, FIG. 8 focuses on another target viewer shown as a spectator 6b in FIG. 3, and shows a view range 40 (40a) of the spectator viewpoint camera 8b and a view-ensuring area 50 (50a) set for the target viewer. As shown in each of FIGS. 7 and 8, in the view-ensuring area setting process of this embodiment, a view-ensuring area 50 for the corresponding target viewer (viewers of the spectators 6a and 6b) is set inside the view range 40. Specifically, the view-ensuring area 50 is set to a spatial range narrower than the view range 40 and is centered with the view range 40.

[0071] A specific size of the visual field securing area 50 is determined, for example, using a predetermined coefficient K. FIG. 9 is a diagram showing an example of the coefficient K. As shown in FIG. 9, the coefficient K is determined within a range equal to or greater than 0 and smaller than an upper limit value T21 (T21<1). The coefficient K is determined, for example, so that it becomes larger (closer to T21) the greater the total number of tips posted up to a set time (total number of tips). This can be achieved by preparing a calculation formula for the coefficient K shown in FIG. 9. Also, instead of the total number of tips, the number of tips currently being controlled to move along the trajectory may be used.

[0072] Then, the coefficient K determined based on the total number of tips as described above is used as the area ratio of the viewing area 50 on the projection surface 41 (the area ratio of the viewing area 50 to the display frame F of the concert video provided to the target viewer), and a viewing area 50 of the corresponding size is set for the target viewer.

[0073] Therefore, in Fig. 7 and Fig. 8, a view securing area 50 is set inside the display frame F as shown by a dashed line, but while the total number of tips is small, it can be controlled to be set small (narrow), and gradually larger (wider) as the total number of tips increases. In the example of Fig. 9, the coefficient K is set to "0" while the total number of tips does not exceed a predetermined threshold T23, so the view securing area 50 is not set during that time. This allows control to be realized to set the view securing area 50 when the total number of tips exceeds the threshold T23.

[0074] Furthermore, because the field of view securing area 50 is set so that its center is aligned with the field of view 40 of the target viewer, if the target viewer changes the orientation of spectator-viewpoint camera 8 using camera operation unit 30, the field of view securing area 50 can be updated in accordance with the changed orientation. In this embodiment, the position of spectator-viewpoint camera 8 is fixed, but even if it is configured to be changeable, it is possible to update and set the field of view securing area 50 in accordance with the changed position.

[0075] According to the view securing area setting process here, a view securing area 50 can be set within the view range 40 for each viewer. In addition, at that time, the size of the view securing area 50 can be changed according to the total number of tips posted up to the setting time. It is assumed that the atmosphere is not that lively while the total number of tips is small, and even if tipping objects 4 are in the field of view, they are few in number, so they are unlikely to interfere with viewing. In such a case, the view securing area 50 can be set not to be set, or the view securing area 50 can be set to be small (narrow). On the other hand, when the atmosphere becomes lively and the total number of tips increases, the number of tipping objects 4 in the field of view may also increase, so that the tipping objects 4 may frequently cross the field of view and interfere with viewing. In anticipation of such a case, the view securing area 50 can be set to be large (wide) as the total number of tips increases.

[0076] In addition, FIG. 9 shows an example in which the coefficient K is set to 0 while the total number of tips does not exceed the threshold T23. In contrast, the coefficient K may be determined to be a value equal to or greater than a predetermined value greater than 0 even while the total number of tips does not exceed the threshold T23. In that case, the field of view securing area 50 will always be set (even if no tips have been posted yet and the total number of tips is 0).

[0077] In addition, instead of being limited to a configuration in which a formula for calculating the coefficient K is prepared, a configuration in which the correspondence between the total number of tips and the coefficient K is defined in a table format and the coefficient K is set to gradually increase as the total number of tips increases may be adopted.

[0078] In addition, the total number of tips has been given as an example of the input status of viewer actions, and a case has been described in which the field of view ensuring area 50 is variably set based on the total number of tips. However, other items indicating the input status of viewer actions, such as the total amount of tips posted up to the time of setting, the timing of posting of the tips, and the type of tip object 4 used to post the tips, may be used instead of the total number of tips, or the coefficient K may be determined using the total number of tips or a combination of two or more of these items, and the field of view ensuring area 50 may be set to a size according to each value.

[0079] Additionally, the field of view securing area 50 may be variably set based on the attributes of the target viewer. Examples of the attributes include the total charge amount of the target viewer and the viewing time of the live broadcast (concert video) being viewed. In this case, for example, the upper limit value T21 (T21>1) of the coefficient K is adjusted so that it is larger the higher the total charge amount is and is smaller the lower the total charge amount is. Similarly, the upper limit value T21 is increased as the viewing time is longer, while the upper limit value T21 is adjusted so that it is smaller as the viewing time is shorter. In this way, the size of the field of view securing area 50 can be set taking into account the total charge amount and viewing time of the target viewer.

[0080] In addition, in the case of a configuration in which videos related to live streaming are obtained from video contributors and provided, the attributes can include the relationship between the target viewer and the video contributor (for example, whether or not they are friends with each other, etc.). In that case, the upper limit T21 of the coefficient K is adjusted to be larger when watching a friend's video compared to when watching a video of a video contributor who is not a friend.

[0081] The field of view securing area 50 may be variably set based on the number of viewers of the live broadcast. This is because an increase in the number of viewers may lead to an increase in the number of tips posted. For example, by determining the coefficient K according to the number of viewers, it is possible to set the field of view securing area 50 small (or not set) when the number of viewers is small, and to set the field of view securing area 50 large as the number of viewers increases. In addition, by determining the coefficient K using the number of viewers in combination with the above-mentioned input status of viewer actions and the attributes of the target viewers, the field of view securing area can be set to a size according to each value.

[0082] In addition, the field of view securing area 50 may be variably set according to the scene of the concert video at the time of setting. For example, in a lively scene, the field of view securing area 50 may be made small (or not set), and in a quiet scene, a wide range within the field of view 40 may be set as the field of view securing area 50. This makes it possible to change the display form of the tip object 4 in the viewing space 10 to one that is difficult to see overall by the condition fulfilling object display control process in the subsequent stage in a quiet scene, while not making the change in a lively scene and giving priority to a performance display showing that the atmosphere is lively.

[0083] 2. Condition Satisfying Object Display Control Processing In the condition satisfying object display control process, the server system 1100 treats a tipping object 4 that satisfies a predetermined in-area condition as a condition satisfying object, and a tipping object 4 that does not satisfy the in-area condition as a condition non-satisfying object, and performs different display control for both, thereby synthesizing the display of the tipping object 4 with the image of the viewing space 10 (more specifically, the image of the viewing space 10 excluding the tipping object 4). The in-area condition is set in advance as a condition indicating that the tipping object passes through or is located within the visual field securing area 50 of the target viewer. Through this process, a video of the concert video to be displayed on the content display unit 21 on the viewing screen can be generated for each viewer.

[0084] In this embodiment, the server system 1100 first classifies the tipping objects 4 in the viewing space 10 by classifying the tipping objects 4 that are within the field of view 50 of the target viewer as condition-satisfying objects because they satisfy the in-area condition, and classifying the remaining tipping objects 4 as condition-non-satisfying objects.

[0085] In the classification procedure, first, among all the tipping objects 4, tipping objects 4 related to the target viewer, i.e., tipping objects 4 posted by the target viewer, are excluded from detection targets. Then, condition-satisfying objects that satisfy the in-area condition are detected from tipping objects 4 posted by viewers other than the target viewer. Next, if any of the detected condition-satisfying objects has already been moved and placed at a landing position, it is excluded from the condition-satisfying objects. In other words, among the detected condition-satisfying objects, those whose movement is being controlled by the movement control process are determined to be condition-satisfying objects.

[0086] After classifying the tipping objects 4 in the audio-visual space 10 as described above, the server system 1100 performs display control for the tipping objects 4 classified as condition non-satisfying objects based on the tipping object definition data 510 (see FIG. 12). On the other hand, for the tipping objects 4 classified as condition satisfying objects, the server system 1100 performs control to display them in a display form different from the display form when they are the above-mentioned condition non-satisfying objects (i.e., the display form based on the tipping object definition data 510).

[0087] 10 and 11 are diagrams for explaining the control of changing the display form here. FIG. 10 shows a display frame F when the total number of tips is small and the visual field securing area 50 is small, and FIG. 11 shows a display frame F when the total number of tips is increased and the visual field securing area 50 is set large. In this embodiment, the display form of the tipping object 4 classified as a condition-satisfying object (i.e., moving in the viewing space 10) is changed to a display form with high transparency and small size. For example, the display form is changed by halving the size and setting the transparency to 50%. Therefore, as shown in each of FIGS. 10 and 11, when the tipping object 4 moving in the viewing space 10 enters the visual field securing area 50, the tipping object 4 is reduced to half and changed to a semi-transparent display. However, the display form of the tipping object 4A of the tip posted by the target viewer is not changed even if it enters the visual field securing area 50, and is displayed in the same display form before entering the visual field securing area 50. In addition, the display form of the tip object 4B for which the movement control process has already ended and which has already landed at the landing position is also not changed.

[0088] According to the condition-satisfying object display control process here, the tipping objects 4 in the viewing space 10 are classified into condition-satisfying objects and condition-unsatisfying objects, and the display form of the tipping objects 4 can be changed depending on which type the tipping objects 4 are classified into. More specifically, among the tipping objects 4 in the field of view securing area 50, the size of the tipping objects 4 that are under movement control and related to tips posted by viewers other than the target viewer can be reduced or the transparency can be increased. This makes it possible to display the tipping objects 4 in the field of view securing area 50 in a display form that is difficult to see.

[0089] On the other hand, since the display form of the tip object 4A of the tip posted by the target viewer is not changed, the tip object 4A posted by the user can be displayed in an easy-to-see manner.

[0090] Similarly, the display form of the tipping object 4B that has already landed at the landing position is not changed even if the landing position is within the field of view securing area 50. This is because the display of the stopped tipping object 4B is considered unlikely to obstruct the field of view. Also, by displaying them, it is possible to realize a dramatic display that shows that the atmosphere is getting excited.

[0091] The change in the display form here is an example, and is not limited to a change in both transparency and size. For example, only the size may be changed to a smaller size, or only the transparency may be changed to a higher value (higher transparency). Also, the transparency may be set to 100%, for example, to hide the corresponding tip object 4 (condition-satisfying object).

[0092] [Function configuration] 1. Server system Fig. 12 is a block diagram showing an example of a functional configuration of the server system 1100. As shown in Fig. 12, the server system 1100 of this embodiment includes an operation input unit 100s, a server processing unit 200s, an image display unit 390s, a sound output unit 392s, a communication unit 394s, and a server storage unit 500s.

[0093] The operation input unit 100s is for inputting various operations for system management, maintenance, etc., and can be realized by, for example, a keyboard, a mouse, a touch panel, etc. In FIG.

[0094] The server processing unit 200s can be realized by a processor, which is an arithmetic circuit such as a CPU, GPU, ASIC, FPGA, or other electronic components such as an IC memory, and controls input and output of data between each unit of the device including the operation input unit 100s and the server storage unit 500s. Then, it performs various arithmetic processing based on predetermined programs and data, operation input signals from the operation input unit 100s, data received from the viewer terminal 1500, and the like, and generally controls the operation of the server system 1100. In FIG. 1, this corresponds to the control board 1150 and its CPU 1151.

[0095] The server processing unit 200s includes a user management unit 210, a billing processing unit 220, a video provision control unit 230, a timing unit 280s, an image generation unit 290s, a sound generation unit 292s, and a communication control unit 294s.

[0096] The user management unit 210 performs processes related to user registration and manages the data of each registered user linked to the user account. For example, it can execute processes such as granting a unique user account to a registered user, registration information management processes for registering and managing personal information for each user account, and usage history management processes for managing login and logout history. Of course, it can also appropriately include management processes for other data linked to user accounts.

[0097] The billing processor 220 performs billing in response to a user's purchase of currency points, and grants the user currency points equivalent to the purchase amount. The billing processor 220 also performs monthly billing for paid members of the distribution service.

[0098] The video provision control unit 230 performs various processes for realizing live distribution of a concert video in the viewing space. In this embodiment, a video of the viewing space is generated for each viewer, and the video is controlled to be live distributed to the viewer terminal 1500 of the corresponding viewer. In addition, the video provision control unit 230 also manages the live distribution schedule and viewers. The video provision control unit 230 includes a live progress control unit 231, a viewer-specific video generation unit 233, an object movement control unit 235, a field of view securing area setting unit 237, a condition satisfying object display control unit 239, and a viewpoint control unit 245.

[0099] The live progress control unit 231 controls the progress of the live stage in the viewing space by performing processes such as setting up a stage and viewing area to construct a viewing space, placing performer characters in the viewing space and controlling their movements, and placing and controlling spectator viewpoint cameras for each viewer in the viewing space.

[0100] The viewer-specific video generation unit 233 generates, for each viewer of the live broadcast, a video of the viewing space seen from the spectator viewpoint camera, excluding the tip object, for each frame.

[0101] The object movement control unit 235 is a functional unit that performs movement control processing, detects an action operation of posting a tip made on the viewer terminal 1500, and controls the appearance and movement of a tip object in the viewing space. Specifically, it sets a landing position according to the throwing direction and flight distance input by the action operation, and sets a movement path of the tip object that moves along a given trajectory from the viewer's seat position to the landing position. Then, it controls the movement of the tip object according to the set movement path.

[0102] The field of view ensuring area setting unit 237 is a functional unit that performs a field of view ensuring area setting process for each viewer of live distribution who is sequentially determined to be a target viewer, and sets a field of view ensuring area for the target viewer.

[0103] The condition satisfying object display control unit 239 is a functional unit that performs a condition satisfying object display control process for each viewer of the live broadcast who is sequentially set as a target viewer, and performs different display control for the condition satisfying object and the condition non-satisfying object to synthesize the display of the tip object into the video of the viewing space generated by the viewer-specific video generation unit 233. This condition satisfying object display control unit 239 has a condition satisfying object detection unit 241 and a form change control unit 243.

[0104] The condition satisfying object detection unit 241 detects a condition satisfying object that satisfies an in-area condition from among the tipping objects in the viewing space, and classifies the detected object as a condition non-satisfying object.

[0105] The form change control unit 243 controls the display form of the condition satisfying object to be different from the display form of the condition non-satisfying object. In this embodiment, the display form of the tipping object detected as the condition satisfying object by the condition satisfying object detection unit 241 is changed by increasing the transparency of the tipping object and reducing the size of the tipping object.

[0106] The viewpoint control unit 245 detects an operation to change the shooting direction or shooting angle of view in the viewer terminal 1500, and performs control to change the direction and zoom of the spectator viewpoint camera of that viewer.

[0107] The timekeeping unit 280s uses a system clock to keep track of the current date and time, time limit, and the like.

[0108] The image generating unit 290s generates images relating to system management of the server system 1100 and outputs them to the image display unit 390s.

[0109] The sound generation unit 292s is realized by executing an IC or software that generates or decodes audio data, and generates or decodes audio data such as operation sounds and BGM related to the system management and video distribution of the server system 1100. Audio signals related to system management are output to the sound output unit 392s.

[0110] The communication control unit 294s performs communication connection and data processing for data communication with an external device (eg, the viewer terminal 1500) via the communication unit 394s, and realizes data exchange with the external device.

[0111] The image display unit 390s displays various screens for system management and the like based on the image signal input from the image generation unit 290s. For example, this can be realized by an image display device such as a flat panel display, a projector, or a head mounted display. In FIG. 1, this corresponds to the touch panel 1108.

[0112] The sound output unit 392s emits the sound signal input from the sound generation unit 292s. In FIG. 1, this corresponds to a speaker (not shown) provided in the main device 1101 or the touch panel 1108.

[0113] The communication unit 394s realizes communication by connecting to the network N. For example, it can be realized by a wireless communication device, a modem, a TA (terminal adapter), a jack of a wired communication cable, a control circuit, etc. In FIG. 1, the communication device 1153 corresponds to this.

[0114] In the server storage unit 500s, programs for operating the server system 1100 and realizing various functions of the server system 1100, data used during execution of the programs, etc. are stored in advance or temporarily stored each time processing is performed. For example, it can be realized by IC memory such as RAM or ROM, a magnetic disk such as a hard disk, an optical disk such as a CD-ROM or DVD, etc. In FIG. 1, this corresponds to the IC memory 1152 and the storage 1140.

[0115] The server storage unit 500s also stores a server program 501, a distribution viewing program 503, tipping object definition data 510, user management data 520, and video provision management data 530. In addition, other necessary data such as timers, counters, various tables, thresholds, and flags are appropriately stored.

[0116] The server program 501 is a program for causing the server processing unit 200s to function as the user management unit 210, the billing processing unit 220, and the video provision control unit 230. Note that programs for causing the server processing unit 200s to function as the image generation unit 290s, the sound generation unit 292s, and the communication control unit 294s may also be included as appropriate.

[0117] The delivered viewing program 503 is the original of the viewing program 502 (see FIG. 15) that is downloaded to the viewer terminal 1500 .

[0118] The tipping object definition data 510 is data that defines a tipping object. In this embodiment, the data is prepared for each tipping object selectable on the object selection screen W1 in Fig. 5, and stores the tipping amount, model data for displaying the tipping amount, and the like in association with the object ID of the corresponding tipping object.

[0119] The user management data 520 is prepared for each user who has completed user registration, and stores various data for management related to the user. Specifically, as shown in Fig. 13, one user management data 520 includes a user account (user ID) 521 of the corresponding user, payment medium ledger data 523, and a viewing history 525 of the content (concert video) that the user viewed as a viewer.

[0120] The payment medium ledger data 523 stores information on the balance of electronic payment medium (currency points in this embodiment) associated with the user, such as the purchase date and time of currency points and the history of the number of purchases (charged amount), the consumption date and time of currency points and the history of the number of consumptions, etc. In addition, if the user is a paid member of a distribution service, the monthly charge amount, etc. are also stored.

[0121] The video provision management data 530 is generated for each live distribution, and stores various data describing the latest state of the live distribution. For example, one video provision management data 530 includes a distribution ID 531, a distribution schedule 533, a live distribution flag 535 (ON: live distribution / OFF: provided) indicating whether or not live distribution is in progress, a viewer account list 537, tipping submission data 540, viewing space management data 550, and viewer-specific video data 570, as shown in FIG.

[0122] The tipping posting data 540 is generated every time an action operation of posting a tip made on the viewer terminal 1500 is detected. Then, one tipping posting data 540 includes a posting ID 541 for identifying the tip, a posting viewer account 543 which is the user account of the viewer who posted the tip, an object ID 545 of a tip object used to post the tip, the tipping amount 547, and a posting date and time 549.

[0123] The viewing space management data 550 includes performer character control data 551, audience viewpoint camera control data 553, tipping object movement control data 555, and viewer-specific tipping object display control data 560.

[0124] The performer character control data 551 stores data representing the state of the performer character 3 (see FIG. 3, etc.) in the viewing space, such as position coordinates, posture, moving speed, and action control data.

[0125] Spectator viewpoint camera control data 553 is prepared for each viewer of the live broadcast (a viewer registered in viewer account list 537), and stores data such as the position, orientation (posture), and angle of view of spectator viewpoint camera 8 (see Figure 3), which is the viewpoint for the corresponding viewer when rendering the concert video footage.

[0126] The tipping object movement control data 555 stores data related to the movement control of the tipping object used to post a tip on the viewer terminal 1500. For example, the data includes an appearance position, a landing position, a movement path, a position coordinate history, and the like.

[0127] The viewer-specific tip object display control data 560 is prepared for each viewer of the live broadcast and stores data for display control of tip objects applied to the viewer. For example, the viewer account 561, which is the user account of the viewer, stores visual field securing area data 563 and an object classification table 565.

[0128] In the field of view securing area data 563, the range of the field of view securing area for the viewer, which the field of view securing area setting unit 237 has set as the target viewer, is set.

[0129] The object classification table 565 is a data table that sets the latest classification for each tip object in the audio-visual space, whether it is a condition satisfying object or a condition non-satisfying object.

[0130] The viewer-specific video data 570 stores video data of a concert video generated for each viewer and provided to the corresponding viewer. Specifically, the video data is video data of a viewing space excluding a tip object generated for each frame by the viewer-specific video generating unit 233, and stores video data in which a tip object display is synthesized by the condition satisfying object display control unit 239.

[0131] 2. Viewer terminal Fig. 15 is a block diagram showing an example of a functional configuration of a viewer terminal 1500. As shown in Fig. 15, the viewer terminal 1500 includes an operation input unit 100, a device processing unit 200, an image display unit 390, a sound output unit 392, a communication unit 394, and a terminal storage unit 500.

[0132] The operation input unit 100 is for the user to input various operations, and can be realized by, for example, a button switch, a joystick, a touch pad, a track ball, an acceleration sensor, an angular velocity sensor, a CCD module, etc. In Fig. 2, this corresponds to the direction input key 1502, the home key 1504, and the touch panel 1506.

[0133] The device processing unit 200 can be realized by a processor, which is an arithmetic circuit such as a CPU, GPU, ASIC, or FPGA, or an electronic component such as an IC memory, and controls input and output of data between each unit of the device including the operation input unit 100 and the terminal storage unit 500. Then, it performs various arithmetic processing based on predetermined programs and data, an operation input signal from the operation input unit 100, data received from the server system 1100, etc., and generally controls the operation of the viewer terminal 1500. In FIG. 2, this corresponds to the control board 1550 and its CPU 1551. And, the device processing unit 200 in this embodiment includes a viewer terminal arithmetic unit 270, a timer unit 280, an image generation unit 290, a sound generation unit 292, and a communication control unit 294.

[0134] The viewer terminal calculation unit 270 executes various calculation processes for making the viewer terminal 1500 function as a terminal for accessing the server system 1100 and viewing the content (concert video). For example, the viewer terminal calculation unit 270 includes an operation signal transmission control unit 271 and an image display control unit 273.

[0135] The operation signal transmission control unit 271 performs processing for transmitting various data and request information to the server system 1100 in response to an operation input to the operation input unit 100 .

[0136] The image display control unit 273 performs control for displaying a viewing screen, etc., based on various data, etc., received from the server system 1100. In this embodiment, the image display control unit 273 performs control for accessing a public site to view and browse a concert video, that is, control for realizing a function as a so-called web browser. It is also possible to configure the image of various screens, such as the viewing screen, to be generated by the viewer terminal 1500, rather than by the server system 1100. In this case, the image display control unit 273 performs control for objects arranged in a virtual three-dimensional space (viewing space) for generating 3DCG, for example, and the image generation unit 290 renders the 3DCG, and executes various controls for generating a concert video in the viewing space.

[0137] The image generating unit 290 cooperates with the image display control unit 273 to generate various image data, and controls the generation and output of image signals for displaying those images on the image display unit 390, etc. In FIG. 2, the GPU mounted on the control board 1550 corresponds to this.

[0138] The sound generation unit 292 is realized, for example, by a digital signal processor (DSP), a processor such as a voice synthesis IC, an audio codec for playing audio files, etc., and generates audio signals such as sound effects, operation sounds, background music, etc., and outputs them to the sound output unit 392.

[0139] The communication control unit 294 performs communication connection and data processing for data communication with an external device (eg, the server system 1100) via the communication unit 394, and realizes data exchange with the external device.

[0140] The image display unit 390 displays various screens such as a viewing screen based on the image signal input from the image generation unit 290. For example, the image display unit 390 can be realized by an image display device such as a flat panel display, a projector, or a head mounted display. In FIG. 2, the touch panel 1506 corresponds to this.

[0141] The sound output unit 392 is realized by a device that outputs (emits) sound based on the audio signal input from the sound generation unit 292. In FIG.

[0142] The communication unit 394 realizes communication by connecting to the network N. For example, it can be realized by a wireless communication device, a modem, a TA, a jack for a wired communication cable, a control circuit, etc. In FIG. 2, the wireless communication module 1553 corresponds to this.

[0143] The terminal storage unit 500 stores in advance or temporarily stores each time processing is performed programs for operating the viewer terminal 1500 and realizing the functions of the viewer terminal 1500 and data used during execution of the programs. For example, this can be realized by IC memory such as RAM or ROM, a magnetic disk such as a hard disk, or an optical disk such as a CD-ROM or DVD. In Fig. 2, this corresponds to the IC memory 1552 and the memory card 1540. A configuration using online storage is also possible.

[0144] The terminal storage unit 500 also stores a viewing program 502 for causing the terminal processing unit 200 to function as the viewer terminal calculation unit 270. The viewing program 502 may be a dedicated client program, or may be configured by a web browser program and a plug-in for realizing interactive image display, etc. In this embodiment, the viewing program 502 is a copy of a distribution viewing program 503 (see FIG. 12) provided by the server system 1100.

[0145] [Processing flow] Fig. 16 is a flowchart showing the flow of processing related to live distribution of a concert video performed by the server system 1100, focusing on one live distribution. Fig. 17 is a flowchart showing the flow of processing related to generation of a video of the viewing space started in step S5 of Fig. 16. The processing described here is realized by the server processing unit 200s reading and executing the server program 501. Prior to this processing, a distribution schedule 533 is set. Then, provision of the video of the viewing space to the viewer terminal 1500 is started according to the set distribution schedule 533.

[0146] 16, the live progress control unit 231 first sets up a viewing space (virtual three-dimensional space) and places spectator viewpoint cameras for each viewer (step S1), then starts controlling the spectator viewpoint cameras and the movements of the performer characters (step S3). It then starts generating video of the viewing space and live distribution to the viewer terminal 1500 (step S5).

[0147] During the live distribution, the action operation of posting a tip is monitored in each viewer terminal 1500. If an action operation in any of the viewer terminals 1500 is detected (step S7: YES), the object movement control unit 235 places and makes the tip object used in the tip posting appear in the viewing space, starts a movement control process, and starts control of the movement of the tip object (step S9).

[0148] Thereafter, the process returns to step S7 and repeats the above-described process until the live distribution ends (step S11: NO), and when the live distribution ends (step S11: YES), the process ends.

[0149] Next, in the generation process of the video of the viewing space started in step S5, the process of loop A is repeatedly executed for each frame (steps S501 to S517) as shown in Fig. 17. Then, in loop A, first, the process of loop B is executed for each of the viewers in sequence as the target viewers (steps S503 to S515).

[0150] That is, in loop B, first, the viewer-specific image generating unit 233 generates an image of the viewing space excluding the tip object as seen from the spectator viewpoint camera of the target viewer (step S505). Next, the view securing area setting unit 237 performs a view securing area setting process to set a view securing area for the target viewer in the viewing space (step S507).

[0151] Next, the condition satisfying object display control unit 239 performs a condition satisfying object display control process. That is, first, the condition satisfying object detection unit 241 classifies all tipping objects in the viewing space into condition satisfying objects and condition non-satisfying objects by the above-mentioned classification procedure (step S509). Next, the form change control unit 243 synthesizes the display of the tipping objects with the video of the viewing space generated in step S505 according to the classification in step S509. That is, the form change control unit 243 performs display control based on the tipping object definition data 510 for the tipping objects classified as condition non-satisfying objects (step S511). In addition, the form change control unit 243 performs display control for the tipping objects classified as condition satisfying objects after changing the size and transparency based on the display form based on the tipping object definition data 510 (step S513).

[0152] Then, when the processing of loop B has been executed for all viewers, the processing of loop A for one frame is terminated.

[0153] As described above, according to this embodiment, a visual field securing area is set for each viewer, and the display form of the tipping object can be made different inside and outside the visual field securing area. Specifically, the visual field securing area can be set to a size according to the total number of tips at the time of setting, with the center aligned with the visual field range of the spectator viewpoint camera for the corresponding viewer. Then, the display form of the tipping object in the visual field securing area can be changed so that it is difficult to see, for example, by reducing the size or increasing the transparency of the tipping object in the visual field securing area. Therefore, it is possible to ensure the visibility of the display of the concert video (the image of the viewing space displayed on the content display unit 21) on the viewing screen for each viewer.

[0154] Second Embodiment Next, a second embodiment to which the present invention is applied will be described. Hereinafter, differences from the first embodiment will be mainly described, and the same components as those in the first embodiment will be given the same reference numerals as those in the first embodiment, and duplicated explanations will be omitted.

[0155] In the first embodiment, the video provision control unit 230 (see FIG. 12) is configured to be realized by the server system 1100, but in the second embodiment, the video provision control unit 230 is realized by a viewer terminal. In the second embodiment, the server system 1100 performs user registration and management of the user information, billing processing, and management of live distribution schedules and viewers. In addition, when the server system 1100 detects an action operation of posting a tip on a viewer terminal, it generates tip posting data 540 (see FIG. 14) and transmits it to each viewer terminal 1500.

[0156] 18 is a block diagram showing an example of the functional configuration of a viewer terminal 1500A in this embodiment. As shown in FIG. 18, the viewer terminal 1500A includes an operation input unit 100, a device processing unit 200, an image display unit 390, a sound output unit 392, a communication unit 394, and a device storage unit 500.

[0157] The device processing unit 200 has a video provision control unit 230, and omits the image display control unit 273 of the viewer terminal calculation unit 270. That is, the viewer terminal 1500A of this embodiment does not acquire video data of the viewing space 10 from the server system 1100, but rather the video provision control unit 230 itself generates a video of the viewing space.

[0158] The terminal storage unit 500 also stores a video provision program 504 for causing the terminal processing unit 200 to function as the viewer terminal calculation unit 270 and the video provision control unit 230, user management data 520 relating to the user of the viewer terminal 1500A, video provision management data 530 relating to the live distribution that the user is viewing as a viewer, and tip object definition data 510. However, in the video provision management data 530, the spectator viewpoint camera control data 553 and the viewer-specific tip object display control data 560 of the viewing space management data 550 may be set to those relating to the viewer of the viewer terminal 1500.

[0159] The process flow of the viewer terminal 1500A in this embodiment is basically the same as the flowcharts shown in Fig. 16 and Fig. 17, and each step may be interpreted as being executed by the video provision control unit 230 of the viewer terminal 1500A. However, in the process related to video generation in Fig. 17, loop B processing is performed for the viewer of the viewer terminal 1500. Also, in step S7 in Fig. 16, an action operation in each viewer terminal 1500 is detected by receiving tip posting data 540 from the server system 1100.

[0160] According to the second embodiment, it is possible to achieve the same effects as the first embodiment. In addition, since the viewer terminal 1500 generates an image of the viewing space seen from the spectator viewpoint camera of the viewer, the processing performed by the server system 1100 in the first embodiment can be shared among the viewer terminals 1500, and the processing load of the server system 1100 can be reduced.

[0161] The forms to which the present invention can be applied are not limited to the above-described embodiments, and constituent elements can be added, omitted, or modified as appropriate.

[0162] [Variation 1] For example, the server system 1100 and the viewer terminal 1500 may share roles and functions in an intermediate form between the first and second embodiments. In particular, the server system 1100 and the viewer terminal 1500 may be configured to distribute and execute the processing related to the video provision control unit 230. Specifically, among the functional units of the viewer terminal 1500A shown in FIG. 18, the live progress control unit 231 is left in the server system 1100, and the server system 1100 controls the movements of the performer characters, performs calculations to set the viewing space, and transmits various data of the viewing space to the viewer terminal 1500 (the viewer terminal 1500A in FIG. 18) as needed. The viewer terminal 1500 generates an image of the viewing space based on the various data of the viewing space.

[0163] [Variation 2] 7, 8, etc., a view securing area 50 for the viewer is set inside the view range 40 of the spectator viewpoint camera 8, with its center aligned with the view range 40. Alternatively, the view securing area may be set to a size that includes all or a major part of the performer character 3 within the view securing area, aligned with a predetermined reference position of the performer character 3. When there are multiple performer characters in the viewing space, a view securing area is set for each of the performer characters.

[0164] For example, if the field of view securing area is set to a size that includes the entire performer character 3, the center position of the performer character 3 can be set as the reference position. If the head of the performer character 3 is considered to be a key part and the field of view securing area is set to a size that includes the head of the performer character 3, the center position of the head can be set as the reference position. Furthermore, the size of the field of view securing area (whether a size that includes the entire performer character 3 or a size that includes a key part) and the reference position can be changed according to the zoom ratio of the spectator viewpoint camera 8.

[0165] 19 and 20 are diagrams showing examples of setting the visual field securing area 60 in this modified example, and respectively show the visual field securing area 60 set in scenes with different postures of the performer character 3. As shown in each of Figs. 19 and 20, in this modified example, the size of the visual field securing area 60 is set with equal margins around the performer character 3, as indicated by the arrows, so that the entire performer character 3 is included inside.

[0166] According to this modification, even if there is a tipping object moving to a position overlapping with the performer character 3 as viewed from the spectator viewpoint camera 8 of the target viewer, the tipping object can be displayed in a display form that makes it difficult to see by the condition-satisfying object display control process at a later stage. Therefore, it is possible to ensure the visibility of the performer character 3 by preventing a situation in which the performer character 3 is hidden and obstructed by a tipping object moving in front during viewing of a live broadcast. Furthermore, according to this embodiment, even if the performer character 3 moves and the distance to the spectator viewpoint camera 8 changes, the field of view securing area 60 can be set to follow the movement of the performer character 3.

[0167] [Variation 3] In addition, in a configuration in which the field of view securing area 60 is set to follow the performer character 3, the width of the margin of the field of view securing area 60 indicated by the arrow in FIG. 19 etc. may be adjusted. For example, the margin may be adjusted to be wider on the moving direction side of the performer character 3. FIG. 21 is a diagram for explaining the adjustment of the margin in this modified example. As shown in FIG. 21, for example, in a scene in which the performer character 3 stands up from a sitting position indicated by the dashed line in FIG. 21 and jumps, the field of view securing area 60A is set with wide margins in front and above, which are the moving direction of the performer character 3.

[0168] According to this modification, the tip object approaching the moving direction of the performer character 3 can be displayed in a display form that is difficult to see by the condition satisfying object display control process. Therefore, the visibility of the performer character 3 can be more reliably ensured.

[0169] However, the width of the margin may be fixed at an initial setting, and the initial setting width may be set according to the type of performer character 3. For example, if there is a tendency in the movement pattern of the performer character, such as not moving much or jumping frequently, the margin width may be initially set according to that tendency (according to the type of performer character). For example, if the performer character jumps a lot, the upper margin may be initially set to a width that is longer than the rest. If a range of motion is set for the performer character, the margin width may be initially set according to that range of motion, or may be adjusted as needed.

[0170] Also, the setting position of the field of view securing area 60 may be shifted in the direction in which the margin is expanded without changing the size of the field of view securing area 60. In this case, the margin on the opposite side to the direction in which the margin is expanded becomes smaller.

[0171] [Variation 4] Furthermore, in a configuration in which different types of performer characters may appear in the viewing space, data relating to the setting location, reference position, shape, and initial margin settings of the viewing area may be determined in advance for each type of performer character.The viewing area may then be set according to the settings corresponding to the performer characters in the viewing space.When there are multiple performer characters in the viewing space, the viewing area is set for each performer character using settings according to their type.

[0172] For example, regarding the set part and the reference position, if a charming part is set for each type of performer character, the part may be set as the set part and its center position may be set as the reference position, etc. This makes it possible to variably set which part of the performer character is the main part described above in Modification 2 according to the type of performer character.

[0173] In addition, regarding the initial margin settings, if the movement pattern tendencies and range of motion are set for each performer character, the width of the margins in each direction (up, down, left, right, front, back) may be set based on these settings.

[0174] [Variation 5] Also, the setting specifications of the viewing field securing area may be determined in advance for each type of performer character. Then, the viewing field securing area may be set according to the setting specifications corresponding to the performer character in the viewing space. When there are multiple performer characters in the viewing space, the viewing field securing area is set for each performer character using the setting specifications according to the type. FIG. 23 is a diagram showing an example of setting specification data determined for a certain performer character type. As shown in FIG. 23, the setting specification data is prepared for each character type, for example, and includes the setting of the principle of the setting specification and the setting of an exception when the corresponding condition is satisfied. Therefore, the viewing field securing area is set based on different setting specifications depending on whether or not the corresponding performer character in the viewing space is an exceptional case where the condition is satisfied. If there is a video uploader, this setting specification data may be configured so that the video uploader can set and edit the conditions and each item of the setting specification.

[0175] According to this modified example, it is possible to set the field of view securing area according to the setting specifications corresponding to the performer character.

[0176] [Variation 6] In the above-described embodiments and modifications, the display control of the condition satisfying object and the condition non-satisfying object is differentiated by changing the display form of the two objects. Alternatively, the display control of the condition satisfying object and the condition non-satisfying object may be differentiated by changing the trajectory (movement path) of the condition satisfying object from the initial setting based on the action operation.

[0177] Fig. 22 is a diagram for explaining the condition satisfying object display control process in this modified example. In Fig. 22, the view securing area 60 set with the position of the performer character 3 as the center is shown by a dashed line. In the condition satisfying object display control process in this modified example, the condition satisfying object display control unit 239 acts as a trajectory change control means and changes the trajectory of the tip object, which is the condition satisfying object, in a direction away from the view securing area 60.

[0178] Specifically, for the tipping object under movement control, it is determined whether the moving path, which is the trajectory to the landing position, passes through the visual field securing area 60. Then, the passing tipping object is detected as a condition satisfying object. In the example of FIG. 22, the tipping object 4 moving on the moving path L31 shown by the dashed line passes through the visual field securing area 60 before reaching the initially set landing position P31, and is detected as a condition satisfying object. If a condition satisfying object is detected, the landing position is moved to correct the moving path so that it does not pass through the visual field securing area 60. In the example of FIG. 22, the landing position P31 of the tipping object 4 is moved to the landing position P33, and the initial moving path L31 shown by the dashed line is corrected to the moving path L33 shown by the solid line.

[0179] In addition, the configuration is not limited to moving the landing position to correct the movement path, but for example, the movement path of the tip object 4 may be corrected so that it reflects at the boundary position with the field of view securing area 60 and falls outside the field of view securing area 60.

[0180] [Variation 7] In addition, in the above embodiments, an example has been described in which the field of view securing area is variably set based on the input status of the viewer action, etc. (when the size is changed according to the total number of tips). In contrast, the size of the field of view securing area may be fixed, while the display control of the condition satisfying object may be variably controlled based on the input status of the viewer action, etc. Of course, the size of the field of view securing area may be changed in the same manner as in the above embodiments, and the display control of the condition satisfying object may also be variably controlled.

[0181] For example, in the case of changing the size and transparency of the condition-satisfying object as in the first embodiment, the degree of the change may be determined according to the total number of tips at the time of display control. The larger the total number of tips, the larger the reduction rate and transparency are controlled.

[0182] [Variation 8] Furthermore, when displaying content (image of viewing space) on the viewing screen (content display unit 21; see FIG. 4), the ranges of viewing field securing areas 50 (see FIG. 7, etc.), 60 (see FIG. 19, etc.), and 60A (see FIG. 21, etc.) may be presented to the viewer so that they can be visually recognized. For example, a dashed line shown as the range of viewing field securing area 50 in display frame F in FIG. 7, etc. may be added for presenting the viewing field securing area 50, and displayed on content display unit 21. In other words, the range of viewing field securing area 50 on projection surface 41 may be illustrated on content display unit 21. Of course, the type of line is not limited to solid lines, dashed lines, etc.

[0183] The display surrounding the field of view securing area 50 is merely an example, and the manner of display is not particularly limited as long as the display allows the inside and outside of the field of view securing area 50 to be distinguished. For example, the display may be performed by placing an object of the field of view securing area 50 in the viewing space. In this case, it is preferable to set the transparency of the object to be high so that the visibility of the inside of the field of view securing area 50 is not reduced.

[0184] In addition, in the case of a configuration in which a visual field securing area is displayed, the viewer may be allowed to change the size, shape, position, etc. This can be realized, for example, by accepting a change operation for each item by the viewer.

[0185] In addition, the present modified example may be configured to be able to switch between displaying and not displaying the range of the field of view securing area. For example, a button for switching the display of the field of view securing area may be provided on the viewing screen, and a switching operation by the viewer may be accepted, allowing each viewer to switch between displaying and not displaying the field of view securing area.

[0186] [Variation 9] In addition, in the above-mentioned embodiments, an example is shown in which a concert video of a performer character in a viewing space is provided to a viewer terminal, but the content of the video is not particularly limited. Also, a configuration may be adopted in which a video contributor posts videos, and the posted videos are acquired from the video contributor's terminal and provided. For example, the present invention may be applied to live broadcasting of a musical performance or entertainment performed in a viewing space by a performer character played by the video contributor, or to providing a gameplay video in which a game character operated by the video contributor plays against an opponent character in the viewing space.

[0187] [Variation 10] Also, the viewing screen may be configured to display the total number of tips posted up to that point in time for the content being viewed (total number of tips). It is not limited to the total number of tips, but may be configured to display the total number of tips received within a specified period of time in the most recent past. The display may be in a form that displays the value of the total number of posts, or in a form that allows the user to visually recognize the magnitude of the value of the total number of posts. For example, this may be realized by displaying a gauge that indicates the value of the total number of posts, or a balloon that inflates as the value of the total number of posts increases.

[0188] For example, in a configuration in which a tipping object moving within the field of view is hidden by the condition fulfillment object display control process, the viewer may have difficulty in grasping the status of tipping because the viewer cannot see the corresponding tipping object. According to this modified example, even in such a case, the total number of tips submitted for the content being viewed can be confirmed, so that the actual status of tipping can be grasped.

[0189] [Variation 11] Also, a function for setting a field of view securing area and performing different display control for condition satisfying objects and condition non-satisfying objects may be configured to be switched between "ON (performs the control)" and "OFF (does not perform the control)" as needed. For example, an ON / OFF switch button may be placed on the viewing screen to accept a switching operation by the viewer, thereby allowing the function to be switched ON / OFF for each viewer. Alternatively, a period during which the function is turned OFF (a time period during live streaming) may be set in advance, and the function may be turned OFF during that period. If there is a video uploader, the video uploader may be allowed to set the time period during which the function is turned OFF.

[0190] [Variation 12] In addition, in the above embodiments, examples have been shown in which tipping is posted by selectively using tipping objects with different tipping amounts, but a configuration may be adopted in which a tipping amount can be input and any amount of tipping can be posted. Tips can include free tips in addition to those that consume currency points. In addition to tipping, a configuration may be adopted in which supportive comments, impression comments, etc. can be posted, or a combination of comments and tipping can be posted. It is possible to accept input of comments that include, as appropriate, images such as illustrations and photographs (also called stamps, etc.) in addition to text (letters, numbers, symbols). [Explanation of symbols]

[0191] 1000...Content viewing system 1100...Server system 100s…Operation input section 200s…Server processing section 210...User Management Department 220...Charge processing unit 230...Video provision control unit 231…Live progress control section 233…Viewer-specific video generation unit 235...Object movement control unit 237... Field of view securing area setting section 239...Condition-satisfying object display control unit 241...Condition-satisfying object detection unit 243... Shape change control unit 245... Viewpoint control unit 290s…Image generation section 292s…sound generation section 294s…Communication control section 390s...Image display section 392s…Sound output section 394s…Communication Department 500s…Server storage 501...Server program 503...Streaming viewing program 510…Tipping object definition data 520...User management data 523: Payment medium ledger data 530...Video provision management data 533…Distribution Schedule 537... Viewer account list 540…Tipping submission data 550...Viewing space management data 551...Actor character control data 553…Audience viewpoint camera control data 555…Tipping object movement control data 560…Tipping object display control data for each viewer 563…Visual field area data 565…Object Classification Table 570…Video data by viewer 1500, 1500A... Viewer terminal 100...Operation input section 200...Terminal processing section 270...user terminal computing unit 271...Operation signal transmission control unit 273...Image display control unit 290...Image generation unit 292...Sound generation section 294…Communication control unit 390...Image display section 392…Sound output section 394…Communications Department 500…Device memory section 502... Viewing Program 504...Video provision program N…Network 1200: Video publishing management server 1300: Electronic payment server 2...User (viewer) 10. Viewing space 3...Actor character 4…Tipping object 8…Spectator view camera 40…Field of view 50, 60, 60A…Visibility area

Claims

1. 1. A computer system for making an object corresponding to a viewer action of each viewer appear in a virtual viewing space, and providing each viewer with an image of the viewing space seen from a viewpoint for the viewer, comprising: a setting means for setting, in the viewing space, a viewpoint for each of the viewers and a viewing area based on the viewpoint; a condition satisfying object display control means for controlling the display of the video for each of the viewers by making the display control of an object satisfying an in-area condition indicating that the object passes through or is located within the view securing area of ​​the viewer (hereinafter referred to as a "condition satisfying object") different from the display control of an object not satisfying the in-area condition (hereinafter referred to as a "condition non-satisfying object"); A computer system comprising:

2. an object movement control means for making the object appear in the viewing space and move it along a given trajectory; The computer system of claim 1 further comprising:

3. A computer system for making an object corresponding to a viewer action of each viewer appear in a virtual viewing space, and providing a video of the viewing space seen from a viewpoint for a target viewer to the target viewer, comprising: A setting means for setting a viewing area for the target viewer; an object movement control means for causing the object to appear in the viewing space and to move along a given trajectory; a condition satisfying object display control means for controlling display of an object that satisfies an in-area condition indicating that the object passes through or is located within the visual field securing area (hereinafter referred to as a "condition satisfying object") differently from display of an object that does not satisfy the in-area condition (hereinafter referred to as a "condition non-satisfying object"); Equipped with the condition satisfying object display control means detects the condition satisfying object from among the objects whose movement by the object movement control means has not yet ended and which are still moving; Computer system.

4. the object movement control means moves the object along the trajectory until a predetermined end condition is satisfied; 4. A computer system according to claim 2 or 3.

5. the condition satisfying object display control means includes trajectory change control means for changing the trajectory of the condition satisfying object in a direction away from the field of view securing area, A computer system according to any one of claims 2 to 4.

6. the condition satisfying object display control means includes a form change control means for controlling a display form of the condition satisfying object to be different from a display form of the condition non-satisfying object; A computer system according to any one of claims 1 to 5.

7. the form change control means changes the display form of the condition satisfying object to one having higher transparency and / or smaller size than the condition non-satisfying object; 7. The computer system of claim 6.

8. A character whose movement is controlled based on a given movement control is placed in the viewing space, the setting means sets the visual field securing area based on the character. A computer system according to any one of claims 1 to 7.

9. the setting means sets the field of view securing area based on a positional relationship between the viewpoint and the character.

9. The computer system of claim 8.

10. the setting means sets the visual field securing area based on a setting specification of the visual field securing area associated with the character; 9. The computer system of claim 8.

11. a viewpoint control means for changing the direction of the viewpoint and / or the position of the viewpoint based on an operational input from the viewer; Further comprising: The setting means updates and sets the visual field securing area in response to control by the viewpoint control means.

10. The computer system of claim 9.

12. the setting means variably sets the field of view securing area based on an input status of the viewer action. A computer system according to any one of claims 1 to 11.

13. the condition satisfying object display control means variably controls display control of the condition satisfying object based on an input status of the viewer action. A computer system according to any one of claims 1 to 12.

14. The setting means sets the visual field securing area within a visual field range of the viewpoint. A computer system according to any one of claims 1 to 13.

15. the condition satisfying object display control means excludes the object corresponding to a viewer action of the viewer related to the view securing area from among the condition satisfying objects, and detects the condition satisfying object from among the objects corresponding to viewer actions of viewers other than the viewer related to the view securing area. A computer system according to any one of claims 1 to 14.

16. The viewer action is an operation input input by consuming a given consumption value from a parameter value owned by the viewer. A computer system according to any one of claims 1 to 15.

17. A server system that is a computer system according to any one of claims 1 to 16 and is communicatively connected to a viewer terminal of each viewer; The viewer terminal; A content viewing system comprising:

18. A program for causing a computer system to make an object corresponding to a viewer action of each viewer appear in a virtual viewing space, and to provide each of the viewers with an image of the viewing space seen from a viewpoint for the viewer, the program comprising: a setting means for setting, in the viewing space, a viewpoint for each of the viewers and a field of view securing area based on the viewpoint; a condition satisfying object display control means for controlling the display of the video for each of the viewers by making the display control of an object satisfying an in-area condition indicating that the object passes through or is located within the view securing area of ​​the viewer (hereinafter referred to as a "condition satisfying object") different from the display control of an object not satisfying the in-area condition (hereinafter referred to as a "condition non-satisfying object"); A program for causing the computer system to function as the

19. A program for causing a computer system to make an object corresponding to a viewer action of each viewer appear in a virtual viewing space, and to provide a video of the viewing space seen from a viewpoint for a target viewer to the target viewer, A setting means for setting a viewing area for the target viewer; an object movement control means for making the object appear in the viewing space and move it along a given trajectory; a condition satisfying object display control means for differentiating display control of an object satisfying an in-area condition indicating that the object passes through or is located within the visual field securing area (hereinafter referred to as a "condition satisfying object") from display control of an object not satisfying the in-area condition (hereinafter referred to as a "condition non-satisfying object"); and causing the computer system to function as the condition satisfying object display control means detects the condition satisfying object from among the objects whose movement by the object movement control means has not yet ended and which are still moving; program.

Images