Terminal device and display video determination system

Abstract

To provide a terminal device and a display video determination system for automatically selecting a video desired by a user from among a plurality of videos and displaying the video on the terminal device.SOLUTION: A terminal device comprises: a video acquisition unit that acquires videos captured by multiple pieces of imaging means; a video display unit that displays a video; an imaging attribute information storage unit storing imaging attribute information pertaining to the positions and orientations of the imaging means; a user position information storage unit storing user position information pertaining to the position of a user; and a display video determination unit that, on the basis of the imaging attribute information and the user position information, selects a video from among the plurality of videos captured by the multiple pieces of imaging means, and determines the video to be displayed on the video display unit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a terminal device and a display video determination system. [Background technology]

[0002] There is a multi-angle distribution system that distributes video captured by multiple cameras installed at the venue of an event such as a sporting event or concert to a terminal device carried by a user. This distribution system simultaneously plays back video captured by multiple cameras at different positions and orientations relative to the event on the terminal device. Users can then watch the event by switching between the videos they want to view at any time (for example, see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-162399 Summary of the Invention [Problem to be solved by the invention]

[0004] At an event venue, a user who has come to watch the event may want to view footage from a different position and orientation than the actual viewing position. In this case, the user must manually find and select the desired footage from multiple footage shot from various positions and orientations. As the number of cameras increases, the number of footage options also increases. Therefore, selecting the desired footage from among these options can become cumbersome for the user.

[0005] The present disclosure has been made to solve such problems, and aims to provide a terminal device and a display image determination system that automatically selects an image desired by a user from multiple images and determines it as the image to be displayed on the terminal device. [Means for solving the problem]

[0006] The terminal device according to the present disclosure includes an image acquisition unit that acquires images captured by a plurality of imaging means, an image display unit that displays the images, an image capture attribute information storage unit that stores image capture attribute information relating to the position and orientation of the imaging means, a user position information storage unit that stores user position information relating to the position of the user, and a display image determination unit that selects an image from a plurality of images captured by each of the plurality of imaging means based on the image capture attribute information and the user position information and determines the image to be displayed on the image display unit.

[0007] The display video determination system according to the present disclosure is a display video determination system that determines video to be displayed on a terminal device of a user attending a specific event at the venue of the specific event, and includes: a distribution video management server having a plurality of imaging means installed at the venue of the specific event; a video acquisition unit that acquires video captured by the plurality of imaging means; an imaging attribute information acquisition unit that acquires imaging attribute information relating to the position and orientation of each of the imaging means; a video transmission unit that transmits the video via a communication unit; and an imaging attribute information transmission unit that transmits the imaging attribute information of each of the imaging means via the communication unit; a terminal device having a video acquisition unit that acquires the plurality of videos transmitted from the distribution video management server; an imaging attribute information acquisition unit that acquires the imaging attribute information transmitted from the distribution video management server; a user location information acquisition unit that acquires user location information relating to the position of the user; a video display unit that displays the video; and a display video determination unit that selects one of the plurality of videos based on the imaging attribute information and the user location information to determine the video to be displayed on the video display unit. [Effects of the Invention]

[0008] The present disclosure makes it possible to provide a terminal device and a display video determination system that automatically selects a video desired by a user from a plurality of videos and determines the video as the video to be displayed on the terminal device. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram illustrating an example of a display video determination system according to the present disclosure. [Figure 2] FIG. 2 is a block diagram illustrating an example of a distribution video management server in the display video determination system according to the present disclosure. [Figure 3] FIG. 3 is an explanatory diagram showing an example of the layout of an event venue in the display video determination system according to the present disclosure. [Figure 4] FIG. 4 is a block diagram illustrating an example of a terminal device in the display video determination system according to the present disclosure. [Figure 5] FIG. 5 is a flowchart showing an example of processing by the distribution video management server in the display video determination system according to the present disclosure. [Figure 6] FIG. 6 is a flowchart showing an example of processing by a terminal device in the display video determination system according to the present disclosure. [Figure 7] FIG. 7 is a flowchart illustrating an example of processing by a terminal device in the display video determination system according to the present disclosure. [Figure 8] FIG. 8 is a block diagram showing another example of a terminal device in the display video determination system according to the present disclosure. [Figure 9] FIG. 9 is a flowchart showing an example of processing by a terminal device in the display video determination system according to the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0010] Embodiment 1 A display video determination system according to the present disclosure will be described below with reference to the drawings. The display video determination system according to the present disclosure is a system that determines a video to be displayed on a terminal device of a user who has come to a venue for a specific event, such as a sporting event or a concert, to watch the event. In the first embodiment, the position from which the user watches the event at the venue is fixed. Note that the act of a user watching a viewing target, such as a sports player or a concert singer, at an event venue is sometimes collectively referred to as "watching an event."

[0011] <Display video determination system> First, an example of the configuration of a display video determination system will be described using FIG. 1. FIG. 1 is a block diagram illustrating an example of a display video determination system according to the present disclosure. As shown in FIG. 1, the display video determination system 1 includes multiple imaging units 10, a distribution video management server 20, and one or more terminal devices 30. Note that multiple imaging units, including imaging unit 10a and imaging unit 10b, are collectively referred to as imaging units 10. Also, multiple terminal devices 30, including terminal device 30a and terminal device 30b, or a single terminal device 30, are collectively referred to as terminal device 30. The distribution video management server 20 and the terminal device 30 are interconnected via a network NW in a manner enabling information communication. The network NW includes communication lines such as the Internet, a local area network (LAN), and a wide area network (WAN), as well as communication networks such as base stations. The network NW may be wired or wireless, as long as they are connected in a manner enabling information communication. The imaging units 10 and the distribution video management server 20 may also be interconnected via the network NW in a manner enabling information communication.

[0012] The imaging means 10 is a camera installed at the venue of a specific event, captures the event, and generates video information, which is video information. The imaging means 10 are preferably positioned so as to capture different images of the event. In the present disclosure, different images of the event are captured by varying the placement position and shooting direction of the imaging means 10. Note that the placement position and shooting direction of the imaging means 10 do not need to be fixed while capturing the event. Each imaging means 10 transmits imaging attribute information related to the position and orientation of the imaging means 10 to the distribution video management server 20 along with the video information.

[0013] The distribution video management server 20 distributes the video captured by the imaging means 10 to the terminal device 30. Fig. 2 is a block diagram showing an example of the distribution video management server in the display video determination system according to the present disclosure. As shown in Fig. 2, the distribution video management server 20 includes a video acquisition unit 201, a video synthesis unit 202, a video transmission unit 203, an image capture attribute information acquisition unit 204, an image capture attribute information transmission unit 205, a timer 206, and a communication unit 207.

[0014] The video acquisition unit 201 acquires the video captured by the imaging unit 10 as video information from each imaging unit 10. Then, the video synthesis unit 202 synthesizes the video information acquired by the video acquisition unit 201 into one piece of video information (hereinafter referred to as synthesized video information). The synthesized video information is information for displaying all videos in a list on the terminal device 30. The video transmission unit 203 transmits the video information acquired by the video acquisition unit 201 and the synthesized video information synthesized by the video synthesis unit 202 to the terminal device 30 via the communication unit 207.

[0015] The imaging attribute information acquisition unit 204 acquires imaging attribute information relating to the position and orientation of each imaging unit 10 from each imaging unit 10. The imaging attribute information can also be understood as information indicating the position and direction from which the video information generated by the imaging unit 10 was captured. In the present disclosure, the imaging attribute information acquisition unit 204 acquires the imaging attribute information from the imaging unit 10, but this is not limiting. For example, the imaging attribute information acquisition unit 204 may acquire the imaging attribute information using an API (Application Programming Interface). The imaging attribute information acquisition unit 204 may also acquire the imaging attribute information at predetermined time intervals set by the timer 206. Furthermore, the imaging attribute information acquisition unit 204 may acquire information relating to the positions and orientations of the imaging units 10 arranged at an event venue or the like by having the information registered in advance by a service provider according to this embodiment and stored in a storage unit (not shown). The imaging attribute information transmission unit 205 then transmits the imaging attribute information acquired by the imaging attribute information acquisition unit 204 from each imaging unit 10 to the terminal device 30 via the communication unit 207. That is, the imaging property information transmitting unit 205 transmits imaging property information in association with each imaging means 10.

[0016] Returning to the explanation of FIG. 1, the terminal device 30 is a communication device such as a smartphone, tablet, or PC (Personal Computer) owned by a user who has come to the venue of a particular event to watch the event. When the user is within a predetermined range (hereinafter referred to as the reference position range) from the location where the event is being watched, such as a seat, the terminal device 30 displays video from the imaging means 10 that is most different from the user's position and orientation. On the other hand, when the user leaves their seat to go to a facility such as a restroom or a shop and is outside the reference position range, the terminal device 30 displays video from the imaging means 10 that is closest to the user's position and orientation. In other words, the user can watch video of the event that is similar to the scene they were watching in their seat, even when they are away from their seat.

[0017] 3 is an explanatory diagram showing an example of the layout of an event venue in the display video determination system according to the present disclosure. The event venue may be, for example, a baseball stadium, and users watch a baseball game while sitting in the seats designated by their tickets. As shown in FIG. 3, for example, when user Y is within a reference position range A that includes the seat position of user Y, the terminal device 30 displays the video captured by the imaging unit 10d that is the furthest from the position and orientation of user Y. On the other hand, when user Y is outside the reference position range A, the terminal device 30 displays the video captured by the imaging unit 10b that is closest to the position and orientation of user Y.

[0018] Fig. 4 is a block diagram showing an example of a terminal device in the display video determination system according to the present disclosure. As shown in Fig. 4, terminal device 30 includes communication unit 301, video acquisition unit 302, image capture attribute information acquisition unit 303, image capture attribute information storage unit 304, user position information acquisition unit 305, user position information storage unit 306, weighting coefficient setting unit 307, weighting coefficient storage unit 308, reference position range setting unit 309, reference position range storage unit 310, current position information acquisition unit 311, current position information storage unit 312, timer 313, display video determination unit 314, and video display unit 315. Terminal device 30 can cause each processing unit to function by, for example, executing an application program that executes the display video determination process.

[0019] The video acquisition unit 302 acquires videos captured by the multiple imaging means 10 from the distribution video management server 20 via the communication unit 301. More specifically, the video acquisition unit 302 acquires video information related to the videos captured by each imaging means 10 and composite video information obtained by combining these pieces of video information from the distribution video management server 20.

[0020] The imaging attribute information acquisition unit 303 acquires the imaging attribute information of each imaging means 10 from the distribution video management server 20 via the communication unit 301. Then, the imaging attribute information acquisition unit 303 stores the acquired imaging attribute information in the imaging attribute information storage unit 304 in association with the imaging means 10.

[0021] The user position information acquisition unit 305 acquires user position information relating to the position of user Y. The user position information acquisition unit 305 acquires the user position information by the user inputting the location where the event will be watched, such as a seat number, into a dedicated app on the terminal device 30. Alternatively, the user position information acquisition unit 305 may acquire the user position information by starting a dedicated app on the terminal device 30 at the location where user Y will be watching the event. Then, the user position information acquisition unit 305 stores the acquired user position information in the user position information storage unit 306.

[0022] The weighting coefficient setting unit 307 sets, for each imaging means 10, a weighting coefficient used to determine the video to be displayed on the terminal device 30, based on the imaging attribute information and the user position information. First, the weighting coefficient setting unit 307 acquires user position information from the user position information storage unit 306, and then automatically acquires information regarding the orientation of user Y with respect to the viewing target corresponding to the position of user Y, based on, for example, seat information at an event venue. In other words, the weighting coefficient setting unit 307 acquires user orientation information based on the user position information stored in the user position information storage unit 306.

[0023] Here, the position information is, for example, the latitude and longitude coordinates of the location of the user Y or the imaging means 10. Therefore, when storing the acquired user position information in the user position information storage unit 306, the user position information acquisition unit 305 may convert the seat information into latitude and longitude coordinates and store the converted information. Furthermore, the orientation information is, for example, the value of a two-dimensional vector in the horizontal direction in which the user Y or the imaging means 10 is facing. For example, the orientation information may be represented by angle information in which the north direction is 0°. The orientation information may also be a three-dimensional vector value when the up and down directions are also taken into consideration. The orientation information may be acquired from a compass function of the terminal device 30, or may be acquired from the positional relationship between the position of the user Y and the position of the viewing target.

[0024] Then, the weighting coefficient setting unit 307 calculates a differential distance indicating the distance between user Y and each imaging unit 10 and a differential angle indicating the difference in orientation between user Y and each imaging unit 10 based on the position information and orientation information of each imaging unit 10 included in the imaging attribute information and the position information and orientation information of user Y. For example, if user Y is facing northeast (45°) and the imaging unit 10 is facing south (180°), the differential angle is 135°. Furthermore, the weighting coefficient setting unit 307 assigns weights to each imaging unit 10 based on the calculated differential distances and differential angles. Specifically, the weighting coefficient setting unit 307 calculates a position weighting coefficient and an orientation weighting coefficient for each imaging unit 10. Here, a larger position weighting coefficient indicates a greater distance from user Y's position. Furthermore, a larger orientation weighting coefficient indicates a greater difference from user Y's orientation.

[0025] Then, the weighting coefficient setting unit 307 sets the sum of the position weighting coefficient and the orientation weighting coefficient for each imaging unit 10 as the weighting coefficient for each imaging unit 10. The weighting coefficient setting unit 307 stores the weighting coefficient for each imaging unit 10 in the weighting coefficient storage unit 308. Note that the weighting coefficient setting unit 307 sets the weighting coefficient at a predetermined time interval set by the timer 313.

[0026] Reference position range setting unit 309 sets reference position range A shown in Fig. 3. Reference position range setting unit 309 sets reference position range A based on the user position information stored in user position information storage unit 306. More specifically, reference position range setting unit 309 may set, for example, a range having a radius of a predetermined distance centered on coordinates included in the user position information stored in user position information storage unit 306 as reference position range A. Reference position range setting unit 309 stores the set reference position range A in reference position range storage unit 310.

[0027] The current location information acquisition unit 311 acquires user location information at a predetermined time interval set by the timer 313. The current location information acquisition unit 311 acquires the current location information of the user by acquiring the location information of the terminal device 30, for example, using a GPS (Global Positioning System) function or the like provided in the terminal device 30. Then, the current location information acquisition unit 311 stores the acquired user location information in the current location information storage unit 312. The user location information stored in the current location information storage unit 312 is used to determine whether the user Y is within the reference location range A.

[0028] Display video determination unit 314 selects one of the multiple videos captured by each of the multiple imaging means 10 based on the imaging attribute information and user position information. Then, display video determination unit 314 determines the selected video as the video to be displayed on video display unit 315. More specifically, display video determination unit 314 determines the video to be displayed on video display unit 315 using the weighting coefficients of each of the imaging means 10 stored in weighting coefficient storage unit 308.

[0029] 3, a method for determining the image to be displayed on image display unit 315 by display image determination unit 314 will be described. First, display image determination unit 314 determines whether the current position of user Y is within reference position range A, based on the user position information stored in current position information storage unit 312 and reference position range A stored in reference position range storage unit 310.

[0030] If the current position of user Y is within reference position range A, display image determination unit 314 refers to the weighting coefficients of each imaging means 10 stored in weighting coefficient storage unit 308, and identifies imaging means 10d with the largest weighting coefficient. Then, display image determination unit 314 selects from image acquisition unit 302 the image captured by imaging means 10d with the largest weighting coefficient, and determines this as the image to be displayed on image display unit 315. In other words, when user Y is within reference position range A, terminal device 30 displays the image of imaging means 10d whose position and orientation are most different from user Y's position and orientation.

[0031] On the other hand, if the current position of user Y is outside reference position range A, display image determination unit 314 refers to the weighting coefficients of each imaging means 10 stored in weighting coefficient storage unit 308, and identifies imaging means 10b with the smallest weighting coefficient. Then, display image determination unit 314 selects the image captured by imaging means 10b with the smallest weighting coefficient from image acquisition unit 302, and determines it as the image to be displayed on image display unit 315. In other words, if the user leaves their seat to go to a facility such as a restroom or a convenience store, and user Y is outside reference position range A, terminal device 30 displays the image captured by imaging means 10b with the position and orientation closest to that of user Y.

[0032] If the weighting coefficient has not been set, display image determination section 314 displays all images on image display section 315 based on the composite image information.

[0033] Returning to the explanation of Fig. 4, video display unit 315 displays the video selected by display video determination unit 314. More specifically, video display unit 315 displays the video selected by display video determination unit 314 based on the weighting coefficient, for example, in a single screen. Furthermore, video display unit 315 may enlarge and display the video selected by display video determination unit 314, and display the other videos smaller than the selected video in a list. If a weighting coefficient has not been set, video display unit 315 displays a list of all videos based on the composite video information.

[0034] <Processing method by display video determination system> Next, an example of processing by the display video determination system will be described with reference to Fig. 5 to Fig. 7. First, an example of processing by the distribution video management server 20 will be described with reference to Fig. 5. Fig. 5 is a flowchart showing an example of processing by the distribution video management server in the display video determination system according to the present disclosure. The distribution video management server 20 starts the flowchart of Fig. 5 when, for example, live distribution of an event begins.

[0035] First, the video acquisition unit 201 acquires, from each of the imaging means 10, the video captured by the imaging means 10 as video information (step S101).

[0036] Next, timer 206 checks whether measurement of predetermined time Δt0 has started. Note that display video determination system 1 sets predetermined time Δt0 in advance before this flowchart starts. If timer 206 measuring predetermined time Δt0 has started (step S102: YES) and Δt0 has elapsed (step S103: YES), imaging attribute information acquisition unit 204 acquires imaging attribute information relating to the position and orientation of imaging means 10 from each imaging means 10 (step S104).

[0037] Note that even if the timer 206 for measuring the predetermined time Δt0 has not yet started (step S102: NO), the distribution video management server 20 executes step S104. After step S104, the imaging attribute information transmitting unit 205 transmits the imaging attribute information acquired by the imaging attribute information acquiring unit 204 to the terminal device 30 via the communication unit 207 (step S105). Then, the timer 206 starts measuring Δt0 (step S106).

[0038] If Δt0 has not yet elapsed (step S103: NO), or after timer 206 starts measuring Δt0 (step S106), video synthesis unit 202 synthesizes the videos (step S107). More specifically, video synthesis unit 202 synthesizes the video information acquired by video acquisition unit 201 into one piece of video information (synthetic video information).

[0039] Next, the video transmission unit 203 transmits the video information acquired by the video acquisition unit 201 and the composite video information composited by the video composition unit 202 to the terminal device 30 via the communication unit 207 (step S108). Then, the distributed video management server 20 checks whether an operation to end the distribution has been performed on an operation unit (not shown). If an operation to end the distribution has been performed (step S109: YES), the distributed video management server 20 ends the flowchart of Fig. 5. On the other hand, if an operation to end the distribution has not been performed (step S109: NO), the distributed video management server 20 executes step S101 again.

[0040] Next, an example of processing by terminal device 30 will be described with reference to Fig. 6 and Fig. 7. Fig. 6 and Fig. 7 are flowcharts showing an example of processing by a terminal device in the display video determination system according to the present disclosure. For example, when user Y who has visited an event venue launches a dedicated app on terminal device 30, terminal device 30 starts the flowcharts of Fig. 6 and Fig. 7.

[0041] First, the user position information acquisition unit 305 acquires user position information relating to the position of the user Y (step S201). Then, the user position information acquisition unit 305 stores the acquired user position information in the user position information storage unit 306.

[0042] Next, reference position range setting unit 309 sets reference position range A (step S202). Reference position range setting unit 309 sets reference position range A based on the user position information stored in user position information storage unit 306. Reference position range setting unit 309 stores the set reference position range A in reference position range storage unit 310.

[0043] Next, the video acquisition unit 302 acquires the video information captured by each imaging means 10 and the composite video information obtained by combining these pieces of video information from the distribution video management server 20 (step S203). At this time, the imaging attribute information acquisition unit 303 may also acquire the imaging attribute information from the distribution video management server 20 and store the imaging attribute information in the imaging attribute information storage unit 304.

[0044] Next, display video determination unit 314 determines whether a weighting factor has been set by checking whether a weighting factor has been stored in weighting factor storage unit 308. If a weighting factor has been set (step S204: YES), display video determination unit 314 determines whether the current position of user Y is within reference position range A, based on the user position information stored in current position information storage unit 312 and reference position range A stored in reference position range storage unit 310.

[0045] If the current position of user Y is within reference position range A (step S206: YES), display image determination unit 314 refers to the weighting coefficients of the imaging means 10 stored in weighting coefficient storage unit 308, and identifies imaging means 10d with the largest weighting coefficient. Then, display image determination unit 314 displays the image of imaging means 10d with the largest weighting coefficient from image acquisition unit 302 on image display unit 315 (step S207).

[0046] On the other hand, if the current position of user Y is outside reference position range A (step S206: NO), display image determination unit 314 refers to the weighting coefficients of each imaging means 10 stored in weighting coefficient storage unit 308, and identifies imaging means 10b with the smallest weighting coefficient. Then, display image determination unit 314 displays the image of imaging means 10b with the smallest weighting coefficient from image acquisition unit 302 on image display unit 315 (step S208).

[0047] If the weighting coefficient has not been set (step S204: NO), display video determination section 314 displays a list of all videos on video display section 315 based on the composite video information (step S205).

[0048] After step S205, step S207 or step S208, if the communication unit 301 has received imaging attribute information from the distribution video management server 20 (step S209: YES), the imaging attribute information acquisition unit 303 acquires the imaging attribute information of each imaging means 10 and stores the acquired imaging attribute information in the imaging attribute information storage unit 304 (step S210).

[0049] If the imaging attribute information has not been received (step S209: NO), or after the imaging attribute information has been acquired and stored (step S210), the timer 313 checks whether or not measurement of the predetermined time Δt1 has started. The display video determination system 1 presets the predetermined time Δt1 before the start of this flowchart. If measurement of Δt1 has not started (step S211: NO), the current location information acquisition unit 311 acquires user location information and stores the acquired user location information in the current location information storage unit 312 (step S213). Then, the timer 313 starts measuring Δt1 (step S214). If measurement of Δt1 has started (step S211: YES) and Δt1 has elapsed (step S212: YES), the terminal device 30 also executes steps S213 and S214.

[0050] If Δt1 has not yet elapsed (step S212: NO), or after timer 313 starts measuring Δt1 (step S214), reference position range setting unit 309 checks whether it is necessary to reset the reference position range. For example, if an operation requesting resetting of the reference position range is performed on an operation unit (not shown), reference position range setting unit 309 determines that it is necessary to reset the reference position range. If it is necessary to reset the reference position range (step S215: YES), reference position range setting unit 309 resets reference position range A based on the user position information stored in user position information storage unit 306 (step S216).

[0051] If resetting of the reference position range is not necessary (step S215: NO), or after resetting the reference position range A (step S216), the timer 313 checks whether measurement of the predetermined time Δt2 has started. The display video determination system 1 sets the predetermined time Δt2 in advance before the start of this flowchart. If measurement of Δt2 has not started (step S217: NO), the weighting coefficient setting unit 307 sets a weighting coefficient for each imaging means 10 and stores it in the weighting coefficient storage unit 308 (step S219). Then, the timer 313 starts measuring Δt2 (step S220). If measurement of Δt2 has started (step S217: YES) and Δt2 has elapsed (step S218: NO), the terminal device 30 also executes steps S219 and S220.

[0052] If Δt2 has not yet elapsed (step S218: NO), or after timer 313 starts measuring Δt2 (step S220), terminal device 30 checks whether an operation to end reception of the distribution has been performed on an operation unit (not shown). If an operation to end reception has been performed (step S221: YES), terminal device 30 ends the flowcharts of FIGS. 6 and 7. On the other hand, if an operation to end reception has not been performed (step S221: NO), terminal device 30 executes the process of step S203 again. Note that the determination in step S221 may be performed based on whether or not a signal indicating the end of distribution has been received from distribution video management server 20, in addition to the operation to end reception.

[0053] As described above, according to the first embodiment, it is possible to provide a display video determination system that automatically selects a video desired by a user from a plurality of videos captured by a plurality of imaging means and determines the video as the video to be displayed on a terminal device.

[0054] Note that the present invention is not limited to the first embodiment, and can be modified as appropriate without departing from the spirit of the present invention. For example, when the weighting coefficient setting unit 307 acquires user position information from the user position information storage unit 306, it acquires user orientation information with respect to the event corresponding to the position of user Y based on seat information at the event venue. Regarding the acquisition of user orientation information, the user position information acquisition unit 305 may also acquire the user orientation information together with the user position information. For example, when user Y is at a place where he or she is watching the event, he or she may operate an app while pointing the terminal device 30 toward the event, so that the user position information acquisition unit 305 acquires the user orientation information together with the user position information.

[0055] Furthermore, if the position and orientation of each imaging means 10 are fixed during live streaming of an event, the imaging attribute information acquisition unit 204 does not need to acquire imaging attribute information at the predetermined time interval set by the timer 206. In this case, the imaging attribute information acquisition unit 204 only needs to acquire imaging attribute information at least once after the start of live streaming.

[0056] Furthermore, display image determination unit 314 may determine an image to be displayed on image display unit 315 using the weighting coefficient of each imaging means 10 and the zoom magnification of each imaging means 10. If user Y's current position is within reference position range A, display image determination unit 314 selects an image captured by imaging means 10 with the largest weighting coefficient from image acquisition unit 302 and displays it on image display unit 315. Here, if there are multiple imaging means 10 with the largest weighting coefficients, display image determination unit 314 selects, for example, an image captured by imaging means 10 with the largest zoom magnification among them and displays it on image display unit 315. On the other hand, if user Y's current position is outside reference position range A and there are multiple imaging means 10 with the smallest weighting coefficients, display image determination unit 314 selects, for example, an image captured by imaging means 10 with the largest zoom magnification among them and displays it on image display unit 315.

[0057] Embodiment 2 Another example of the display video determination system according to the present disclosure will be described below with reference to the drawings. Note that explanations of parts that overlap with those of the first embodiment will be omitted as appropriate. In this embodiment, the position from which the user watches the event in the venue is not fixed. In other words, the user can watch the event while moving around the venue.

[0058] <Display video determination system> First, the display video determination system has the same configuration as the display video determination system shown in Fig. 1, including multiple imaging means 10, a distribution video management server 20, and one or more terminal devices 30. The imaging means 10 and the distribution video management server 20 have the same configuration as in the first embodiment, and therefore their explanation will be omitted.

[0059] As in the first embodiment, the terminal device 30 is a communication device such as a smartphone, tablet, or PC (Personal Computer) owned by a user who has come to a venue for a particular event to watch the event. In this embodiment, the user watches the event while moving around the venue. Therefore, even if the user's position in the venue changes, the terminal device 30 appropriately displays the image captured by the imaging means 10 that is most different from the user's current position and orientation at that position.

[0060] The configuration of terminal device 30 in this embodiment will be described using Fig. 8. Fig. 8 is a block diagram showing another example of a terminal in the display video determination system according to the present disclosure. As shown in Fig. 8, terminal device 30 includes communication unit 301, video acquisition unit 302, image capture attribute information acquisition unit 303, image capture attribute information storage unit 304, user position information acquisition unit 305, user position information storage unit 306, weighting coefficient setting unit 307, weighting coefficient storage unit 308, timer 313, display video determination unit 314, and video display unit 315. Note that video acquisition unit 302, image capture attribute information acquisition unit 303, image capture attribute information storage unit 304, weighting coefficient setting unit 307, and video display unit 315 have the same configurations as those in embodiment 1, and therefore description thereof will be omitted.

[0061] Similar to the first embodiment, the user position information acquisition unit 305 acquires user position information relating to the user's position. In this embodiment, the user position information acquisition unit 305 acquires user position information at predetermined time intervals set by the timer 313. In other words, the user position information acquisition unit 305 acquires user position information relating to the user's current position at predetermined time intervals. Then, the user position information acquisition unit 305 stores the acquired user position information in the user position information storage unit 306.

[0062] Similar to the first embodiment, display video determination unit 314 selects one of the multiple videos captured by each of the multiple imaging means 10 based on the imaging attribute information and user position information, and determines the video to be displayed on terminal device 30. More specifically, display video determination unit 314 determines the video to be displayed on video display unit 315 using the weighting coefficients of each of the imaging means 10 stored in weighting coefficient storage unit 308.

[0063] <Processing method by display video determination system> Next, an example of the processing by the display video determination system will be described. The processing by distribution video management server 20 is the same as that in the first embodiment, and therefore the description thereof will be omitted.

[0064] An example of processing by terminal device 30 in this embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing an example of processing by a terminal device in a display video determination system according to the present disclosure. Terminal device 30 starts the flowchart of Fig. 9 when, for example, user Y who has arrived at an event venue launches a dedicated app on terminal device 30.

[0065] First, the video acquisition unit 302 acquires video information captured by each imaging unit 10 and composite video information obtained by combining these pieces of video information from the distribution video management server 20 (step S301). Then, the imaging attribute information acquisition unit 303 stores the imaging attribute information acquired from the distribution video management server 20 in the imaging attribute information storage unit 304.

[0066] Next, display video determination unit 314 determines whether weighting factors have been set by checking whether weighting factors have been stored in weighting factor storage unit 308. If weighting factors have been set (step S302: YES), display video determination unit 314 references the weighting factors of each imaging means 10 stored in weighting factor storage unit 308 and identifies imaging means 10d with the largest weighting factor. Then, display video determination unit 314 displays the video of imaging means 10 with the largest weighting factor from video acquisition unit 302 on video display unit 315 (step S304).

[0067] On the other hand, if the weighting coefficient has not been set (step S302: NO), display video determination section 314 displays a list of all videos on video display section 315 based on the composite video information (step S303).

[0068] After step S303 or step S304, if the communication unit 301 has received imaging attribute information from the distribution video management server 20 (step S305: YES), the imaging attribute information acquisition unit 303 acquires the imaging attribute information of each imaging means 10 and stores the acquired imaging attribute information in the imaging attribute information storage unit 304 (step S306).

[0069] If the imaging attribute information has not been received (step S305: NO), or after the imaging attribute information has been acquired and stored (step S306), the timer 313 checks whether measurement of a predetermined time Δt1 has started. If measurement of Δt1 has not started (step S307: NO), the user position information acquisition unit 305 acquires user position information and stores the acquired user position information in the user position information storage unit 306 (step S309). Next, the weighting coefficient setting unit 307 sets a weighting coefficient for each imaging unit 10 and stores it in the weighting coefficient storage unit 308 (step S310). Then, the timer 313 starts measuring Δt1 (step S311).

[0070] If measurement of Δt1 has already started (step S307: YES) and Δt1 has already elapsed (step S308: YES), the terminal device 30 also executes steps S309, S310, and S311.

[0071] If Δt1 has not yet elapsed (step S308: NO), or after starting measurement of Δt1 (step S311), the terminal device 30 checks whether an operation to end reception of the distribution has been performed on an operation unit (not shown). If an operation to end reception has been performed (step S312: YES), the terminal device 30 ends the flowchart in Fig. 9. On the other hand, if an operation to end reception has not been performed (step S312: NO), the terminal device 30 executes step S301 again.

[0072] As described above, according to the second embodiment, it is possible to provide a display video determination system that automatically selects a video desired by the user as appropriate and determines it as the video to be displayed on the terminal device, even if the user's position in the venue changes.

[0073] It should be noted that the present invention is not limited to the second embodiment and can be modified as appropriate without departing from the spirit of the present invention. For example, similar to the first embodiment, the display image determination unit 314 may determine the image to be displayed on the image display unit 315 using the weighting coefficient of each imaging means 10 and the zoom magnification of each imaging means 10. If there are multiple imaging means 10 with the largest weighting coefficient, the display image determination unit 314 may select the image captured by the imaging means 10 with the largest zoom magnification among them, and display it on the image display unit 315.

[0074] Furthermore, in the above-described embodiment, the distributed video management server 20 combines the video information from the imaging means 10 and transmits it to each terminal device 30, and the terminal device 30 selects from among multiple pieces of video information. However, this is not limited to this. For example, the terminal device 30 selects the video information to be displayed on the terminal device 30 and transmits information requesting the video information to the distributed video management server 20. The terminal device 30 then receives and displays the video information transmitted from the distributed video management server 20. In another example, the terminal device 30 transmits its current location information and identification information identifying the terminal device 30 (or identification information identifying the user) to the distributed video management server 20. The distributed video management server 20 then acquires the current location information, selects the video information to be displayed on the terminal device 30 of the user, and transmits it to the terminal device 30 of the user. The video information to be displayed on the terminal device 30 may be multiple videos including at least the video determined by the display video determination unit 314. In this case, the user Y can easily select a desired image from among the multiple images displayed on the terminal device 30. [Explanation of symbols]

[0075] 1 Display image determination system 10. Imaging means 20. Streaming video management server 30 Terminal Equipment 201 Video Acquisition Unit 202 Video synthesis unit 203 Video transmission unit 204 Image capture attribute information acquisition unit 205 Image capture attribute information transmission unit 206 Timer 207 Communications Department 301 Communications Department 302 Video Acquisition Unit 303 Image attribute information acquisition unit 304 Image capture attribute information storage unit 305 User location information acquisition unit 306 User location information storage unit 307 Weighting coefficient setting unit 308 Weighting coefficient memory unit 309 Reference position range setting section 310 Reference position range storage unit 311 Current location information acquisition unit 312 Current location information storage unit 313 Timer 314 Display image determination unit 315 Video display unit A Reference position range NW Network Y user

Claims

1. an image acquisition unit that acquires images captured by a plurality of imaging means; a video display unit that displays the video; an imaging attribute information storage unit that stores imaging attribute information relating to the position and orientation of the imaging means; a user position information storage unit that stores user position information relating to the position of a user of the terminal device; a display image determination unit that selects an image from a plurality of images captured by each of the plurality of imaging means based on the imaging attribute information and the user position information and determines the image to be displayed on the image display unit, Terminal device.

2. a weighting coefficient setting unit that calculates a differential distance and a differential angle between the user and each of the imaging means based on the imaging attribute information stored in the imaging attribute information storage unit and the user position information stored in the user position information storage unit, and sets a weighting coefficient for each of the imaging means based on the differential distance and the differential angle; the display image determination unit determines the image captured by the imaging means having the largest weighting coefficient as the image to be displayed on the image display unit; The terminal device according to claim 1 .

3. a reference position range storage unit configured to store a reference position range of the user, the reference position range being set based on the user position information stored in the user position information storage unit; a current location information storage unit that stores the user location information acquired at predetermined time intervals; The display image determination unit is configured to determine whether the user position information stored in the current position information storage unit is If the image is within the reference position range, the image captured by the imaging means having the largest weighting coefficient is determined as the image to be displayed on the image display unit; If the position is outside the reference position range, the image captured by the imaging means having the smallest weighting coefficient is determined as the image to be displayed on the image display unit. The terminal device according to claim 2 .

4. the imaging attribute information further includes information regarding the zoom magnification of the imaging means, when there are a plurality of the imaging means determined based on the weighting coefficients, the display image determination unit determines an image to be displayed on the image display unit from images captured by the plurality of the imaging means determined based on the weighting coefficients, further based on the zoom magnification of the imaging means. The terminal device according to claim 3 .

5. A display image determination system that determines an image to be displayed on a terminal device of a user who attends a specific event at a venue of the specific event, a plurality of imaging means installed at the venue of the specific event; an image acquisition unit that acquires images captured by the plurality of imaging means; an image capture attribute information acquisition unit that acquires image capture attribute information relating to the position and orientation of each of the image capture means; a video transmission unit that transmits the video via a communication unit; an imaging attribute information transmitting unit that transmits the imaging attribute information of each of the imaging means via the communication unit; a distribution video management server having a video acquisition unit that acquires the plurality of videos transmitted from the distribution video management server; an image capture attribute information acquisition unit that acquires the image capture attribute information transmitted from the distribution video management server; a user location information acquisition unit that acquires user location information relating to the location of the user; a video display unit that displays the video; a display image determination unit that selects one image from the plurality of images based on the imaging attribute information and the user position information and determines the image to be displayed on the image display unit; and a terminal device having Display image determination system.

Images