Terminal device and display video determination system

Abstract

According to the present disclosure a terminal device and a display video determination system can be provided in which a user-desired video is automatically selected from among a plurality of videos and determined as the video to be displayed on a terminal device.　A terminal device according to the present disclosure comprises: a video acquisition unit that acquires videos taken by a plurality of imaging means; a video display unit that displays a video; an imaging attribute information storage unit storing imaging attribute information pertaining to the positions and orientations of the imaging means; a user position information storage unit storing user position information pertaining to the position of a user; and a display video determination unit that, on the basis of the imaging attribute information and the user position information, selects a video from among the plurality of videos respectively taken by the plurality of imaging means and determines the selected video as the video to be displayed on the video display unit.

Description

Terminal device and display image determination system

[0001] The present disclosure relates to a terminal device and a display video determination system.

[0002] There is a multi-angle distribution system that distributes video captured by multiple cameras installed at a venue for an event such as a sporting event or concert to a terminal device carried by a user. This distribution system simultaneously plays back video captured by the multiple cameras from different positions and orientations relative to the event on the terminal device. Users can then watch the event by switching between the videos they want to view at any time (see, for example, Patent Document 1).

[0003] JP 2013-162399 A

[0004] At an event venue, a user who has come to watch the event may want to view footage from a different position and orientation than the actual viewing position. In this case, the user must manually find and select the desired footage from multiple footage shot from various positions and orientations. As the number of cameras increases, the number of footage options also increases. Therefore, selecting the desired footage from among these options can become cumbersome for the user.

[0005] The present disclosure has been made to solve such problems, and aims to provide a terminal device and a display image determination system that automatically selects an image desired by a user from multiple images and determines it as the image to be displayed on the terminal device.

[0006] The terminal device according to this embodiment comprises an image acquisition unit that acquires an image captured by an imaging means, an image display unit that displays the image, an image capture attribute information storage unit that stores image capture attribute information relating to the position and orientation of the imaging means, a user position information storage unit that stores user position information relating to the position of the user, and a display image determination unit that selects an image from a plurality of images captured by each of the plurality of imaging means based on the image capture attribute information and the user position information, and determines the image to be displayed on the image display unit.

[0007] The display video determination system of this embodiment is a display video determination system that determines video to be displayed on a terminal device of a user attending a specific event at the venue of the specific event, and comprises: a distribution video management server having a plurality of imaging means installed at the venue of the specific event; a video acquisition unit that acquires video captured by the plurality of imaging means; an imaging attribute information acquisition unit that acquires imaging attribute information regarding the position and orientation of each of the imaging means; a video transmission unit that transmits the video via a communication unit; and an imaging attribute information transmission unit that transmits the imaging attribute information of each of the imaging means via the communication unit; a video acquisition unit that acquires the video transmitted from the distribution video management server; an imaging attribute information acquisition unit that acquires the imaging attribute information transmitted from the distribution video management server; a user location information acquisition unit that acquires user location information regarding the position of the user; a video display unit that displays the video; and a display video determination unit that selects one of the plurality of videos based on the imaging attribute information and the user location information to determine the video to be displayed on the video display unit.

[0008] According to this embodiment, it is possible to provide a terminal device and a display video determination system that automatically selects a video desired by a user from a plurality of videos and determines the video as the video to be displayed on the terminal device.

[0009] FIG. 1 is a block diagram showing an example of a display video determination system according to the present disclosure. FIG. 2 is a block diagram showing an example of a distribution video management server in the display video determination system according to the present disclosure. FIG. 3 is an explanatory diagram showing an example of an arrangement at an event venue in the display video determination system according to the present disclosure. FIG. 4 is a block diagram showing an example of a terminal device in the display video determination system according to the present disclosure. FIG. 5 is a flowchart showing an example of processing by the distribution video management server in the display video determination system according to the present disclosure. FIG. 6 is a flowchart showing an example of processing by the terminal device in the display video determination system according to the present disclosure. FIG. 7 is a flowchart showing an example of processing by the terminal device in the display video determination system according to the present disclosure. FIG. 8 is a block diagram showing another example of a terminal device in the display video determination system according to the present disclosure. FIG. 9 is a flowchart showing an example of processing by the terminal device in the display video determination system according to the present disclosure.

[0010] Embodiment 1 Hereinafter, a display video determination system according to the present disclosure will be described with reference to the drawings. The display video determination system according to the present disclosure is a system that determines a video to be displayed on a terminal device of a user who has come to a venue for a specific event, such as a sporting event or a concert, to watch the event. In this embodiment 1, the position from which the user watches the event at the venue is fixed. Note that the act of a user watching a viewing target, such as a sports player or a concert singer, at an event venue is sometimes collectively referred to as "watching an event."

[0011] <Display Video Determination System> First, an example of the configuration of a display video determination system will be described using FIG. 1. FIG. 1 is a block diagram illustrating an example of a display video determination system according to the present disclosure. As shown in FIG. 1, the display video determination system 1 includes multiple imaging units 10, a distribution video management server 20, and one or more terminal devices 30. Note that multiple imaging units, including imaging units 10a and 10b, are collectively referred to as imaging units 10. Furthermore, multiple terminal devices 30, including terminal device 30a and terminal device 30b, or a single terminal device 30, are collectively referred to as terminal device 30. The distribution video management server 20 and the terminal devices 30 are connected to each other via a network NW in a manner enabling information communication. The network NW includes communication lines such as the Internet, a local area network (LAN), and a wide area network (WAN), as well as communication networks such as base stations. The network NW may be wired or wireless, as long as they are connected in a manner enabling information communication. The imaging units 10 and the distribution video management server 20 may also be connected to each other via the network NW in a manner enabling information communication.

[0012] The imaging means 10 is a camera installed at the venue of a specific event, captures the event, and generates video information, which is video information. The imaging means 10 are preferably positioned so as to capture different images of the event. In the present disclosure, different images of the event are captured by varying the placement position and shooting direction of the imaging means 10. Note that the placement position and shooting direction of the imaging means 10 do not need to be fixed while capturing the event. Each imaging means 10 transmits imaging attribute information related to the position and orientation of the imaging means 10 to the distribution video management server 20 along with the video information.

[0013] The distribution video management server 20 distributes the video captured by the imaging unit 10 to the terminal device 30. Fig. 2 is a block diagram showing an example of the distribution video management server in the display video determination system according to the present disclosure. As shown in Fig. 2, the distribution video management server 20 includes a video acquisition unit 201, a video synthesis unit 202, a video transmission unit 203, an image capture attribute information acquisition unit 204, an image capture attribute information transmission unit 205, a timer 206, and a communication unit 207.

[0014] The video acquisition unit 201 acquires the video images captured by the imaging units 10 as video information from each of the imaging units 10. The video synthesis unit 202 then synthesizes the video information acquired by the video acquisition unit 201 into one piece of video information (hereinafter referred to as synthesized video information). The synthesized video information is information for displaying all videos in a list on the terminal device 30. The video transmission unit 203 transmits the video information acquired by the video acquisition unit 201 and the synthesized video information synthesized by the video synthesis unit 202 to the terminal device 30 via the communication unit 207.

[0015] The imaging attribute information acquisition unit 204 acquires imaging attribute information relating to the position and orientation of each imaging unit 10 from each imaging unit 10. The imaging attribute information can also be interpreted as information indicating the position and direction from which the video information generated by the imaging unit 10 was captured. In the present disclosure, the imaging attribute information acquisition unit 204 acquires the imaging attribute information from the imaging unit 10, but this is not limiting. For example, the imaging attribute information acquisition unit 204 may acquire the imaging attribute information using an API (Application Programming Interface). The imaging attribute information acquisition unit 204 may also acquire the imaging attribute information at predetermined time intervals set by a timer 206. Furthermore, the imaging attribute information acquisition unit 204 may acquire information relating to the positions and orientations of the imaging units 10 installed at an event venue or the like by having the information registered in advance by a service provider according to this embodiment and stored in a storage unit (not shown). The imaging attribute information transmission unit 205 then transmits the imaging attribute information acquired by the imaging attribute information acquisition unit 204 from each imaging unit 10 to the terminal device 30 via the communication unit 207. That is, the imaging property information transmitting unit 205 transmits imaging property information in association with each imaging unit 10 .

[0016] Returning to the explanation of FIG. 1 , the terminal device 30 is a communication device such as a smartphone, tablet, or PC (Personal Computer) owned by a user who has come to the venue of a particular event to watch the event. When the user is within a predetermined range (hereinafter referred to as the reference position range) from the location where the event is being watched, such as a seat, the terminal device 30 displays video from the imaging means 10 that is most different from the user's position and orientation. On the other hand, when the user leaves their seat to go to a facility such as a restroom or a shop and is outside the reference position range, the terminal device 30 displays video from the imaging means 10 that is closest to the position and orientation from which the user was watching from their seat. In other words, the user can watch video of the event that is similar to the scene they were watching from their seat, even when they are away from their seat.

[0017] 3 is an explanatory diagram showing an example of the layout of an event venue in the display video determination system according to the present disclosure. The event venue may be, for example, a baseball stadium, and users watch a baseball game while sitting in seats designated by their tickets. As shown in FIG. 3 , for example, when user Y is within a reference position range A that includes the seat position of user Y, the terminal device 30 displays the video captured by the imaging unit 10d that is the furthest from the position and orientation of user Y. On the other hand, when user Y is outside the reference position range A, the terminal device 30 displays the video captured by the imaging unit 10b that is closest to the seat position and orientation of user Y.

[0018] 4 is a block diagram showing an example of a terminal device in the display video determination system according to the present disclosure. As shown in FIG. 4, terminal device 30 includes a communication unit 301, a video acquisition unit 302, an image capture attribute information acquisition unit 303, an image capture attribute information storage unit 304, a user position information acquisition unit 305, a user position information storage unit 306, a weighting coefficient setting unit 307, a weighting coefficient storage unit 308, a reference position range setting unit 309, a reference position range storage unit 310, a current position information acquisition unit 311, a current position information storage unit 312, a timer 313, a display video determination unit 314, and a video display unit 315. Terminal device 30 can cause each of the processing units to function by, for example, executing an application program that executes the display video determination process.

[0019] The video acquisition unit 302 acquires videos captured by the multiple imaging means 10 from the distribution video management server 20 via the communication unit 301. More specifically, the video acquisition unit 302 acquires video information related to the videos captured by each imaging means 10 and composite video information obtained by combining these pieces of video information from the distribution video management server 20.

[0020] The imaging attribute information acquisition unit 303 acquires the imaging attribute information of each imaging unit 10 from the distribution video management server 20 via the communication unit 301. Then, the imaging attribute information acquisition unit 303 stores the acquired imaging attribute information in the imaging attribute information storage unit 304 in association with the imaging unit 10.

[0021] The user position information acquisition unit 305 acquires user position information related to the position of user Y (user Y's seat position). The user position information acquisition unit 305 acquires the user position information by the user inputting the location where the event will be watched, such as a seat number, into a dedicated app on the terminal device 30. Alternatively, the user position information acquisition unit 305 may acquire the user position information by starting a dedicated app on the terminal device 30 at the location where user Y will be watching the event. Then, the user position information acquisition unit 305 stores the acquired user position information in the user position information storage unit 306.

[0022] The weighting coefficient setting unit 307 sets, for each imaging means 10, a weighting coefficient used to determine the video to be displayed on the terminal device 30, based on the imaging attribute information and the user position information. First, the weighting coefficient setting unit 307 acquires user position information from the user position information storage unit 306, and then automatically acquires information regarding the orientation of user Y relative to the viewing target corresponding to the position of user Y, based on, for example, seat information at an event venue. In other words, the weighting coefficient setting unit 307 acquires user orientation information based on the user position information stored in the user position information storage unit 306.

[0023] Here, the position information is, for example, the latitude and longitude coordinates of the location of user Y or the imaging means 10. Therefore, when storing the acquired user position information in the user position information storage unit 306, the user position information acquisition unit 305 may convert the seat information into latitude and longitude coordinates and store the converted information. Furthermore, the orientation information is, for example, the value of a two-dimensional vector in the horizontal direction in which user Y or the imaging means 10 is facing. For example, the orientation information may be represented by angle information in which north is set to 0°. The orientation information may also be a three-dimensional vector value when the up and down directions are also taken into consideration. The orientation information may be acquired from a compass function of the terminal device 30, or may be acquired from the positional relationship between the position of user Y and the position of the viewing target.

[0024] Then, the weighting coefficient setting unit 307 calculates a differential distance indicating the distance between user Y and each imaging unit 10 and a differential angle indicating the difference in orientation between user Y and each imaging unit 10 based on the position information and orientation information of each imaging unit 10 included in the imaging attribute information and the position information and orientation information of user Y. For example, if user Y is facing northeast (45°) and the imaging unit 10 is facing south (180°), the differential angle is 135°. Furthermore, the weighting coefficient setting unit 307 assigns weights to each imaging unit 10 based on the calculated differential distance and differential angle. Specifically, the weighting coefficient setting unit 307 calculates a position weighting coefficient and an orientation weighting coefficient for each imaging unit 10. Here, a larger position weighting coefficient indicates a greater distance from user Y's position. Furthermore, a larger orientation weighting coefficient indicates a greater difference from user Y's orientation.

[0025] Then, the weighting coefficient setting unit 307 sets the sum of the position weighting coefficient and the orientation weighting coefficient for each imaging unit 10 as the weighting coefficient for each imaging unit 10. The weighting coefficient setting unit 307 stores the weighting coefficient for each imaging unit 10 in the weighting coefficient storage unit 308. The weighting coefficient setting unit 307 sets the weighting coefficient at a predetermined time interval set by the timer 313.

[0026] The reference position range setting unit 309 sets the reference position range A shown in Fig. 3. The reference position range setting unit 309 sets the reference position range A based on the user position information stored in the user position information storage unit 306. More specifically, the reference position range setting unit 309 may set, for example, a range having a radius of a predetermined distance centered on the coordinates included in the user position information stored in the user position information storage unit 306 as the reference position range A. The reference position range setting unit 309 stores the set reference position range A in the reference position range storage unit 310.

[0027] The current location information acquisition unit 311 acquires user location information at a predetermined time interval set by the timer 313. The current location information acquisition unit 311 acquires the current location information of the user by acquiring the location information of the terminal device 30, for example, using a GPS (Global Positioning System) function or the like provided in the terminal device 30. Then, the current location information acquisition unit 311 stores the acquired user location information in the current location information storage unit 312. The user location information stored in the current location information storage unit 312 is used to determine whether the user Y is within the reference location range A.

[0028] Display image determination unit 314 selects one of the multiple images captured by each of the multiple imaging means 10 based on the imaging attribute information and the user position information. Then, display image determination unit 314 determines the selected image as the image to be displayed on image display unit 315. More specifically, display image determination unit 314 determines the image to be displayed on image display unit 315 using the weight coefficients of each of the imaging means 10 stored in weight coefficient storage unit 308.

[0029] 3, a method for determining an image to be displayed on image display unit 315 by display image determination unit 314 will be described. First, display image determination unit 314 determines whether or not user Y's current position is within reference position range A, based on the user position information stored in current position information storage unit 312 and reference position range A stored in reference position range storage unit 310.

[0030] If the current position of user Y is within reference position range A, display image determination unit 314 refers to the weighting coefficients of each imaging unit 10 stored in weighting coefficient storage unit 308 and identifies imaging unit 10d with the largest weighting coefficient. Then, display image determination unit 314 selects from image acquisition unit 302 the image captured by imaging unit 10d with the largest weighting coefficient, and determines it as the image to be displayed on image display unit 315. In other words, when user Y is within reference position range A, terminal device 30 displays the image of imaging unit 10d whose position and orientation are most different from those of user Y.

[0031] On the other hand, if the current position of user Y is outside the reference position range A, the display image determination unit 314 refers to the weighting coefficients of the respective imaging units 10 stored in the weighting coefficient storage unit 308 and identifies the imaging unit 10b with the smallest weighting coefficient. Then, the display image determination unit 314 selects the image captured by the imaging unit 10b with the smallest weighting coefficient from the image acquisition unit 302 and determines it as the image to be displayed on the image display unit 315. In other words, if user Y leaves his / her seat to go to a facility such as a restroom or a convenience store and is outside the reference position range A, the terminal device 30 displays the image of the imaging unit 10b whose position and orientation are closest to those of user Y.

[0032] When the weighting coefficient has not been set, display image determination section 314 displays the entire image on image display section 315 based on the composite image information.

[0033] Returning to the description of Fig. 4, video display unit 315 displays the video selected by display video determination unit 314. More specifically, video display unit 315 displays the video selected by display video determination unit 314 based on the weighting coefficient, for example, in a single screen. Furthermore, video display unit 315 may enlarge and display the video selected by display video determination unit 314, and display the other videos in a list smaller than the selected video. If a weighting coefficient has not been set, video display unit 315 displays a list of all videos based on the composite video information.

[0034] <Processing Method by Display Video Determination System> Next, an example of processing by the display video determination system will be described using Fig. 5 to Fig. 7. First, an example of processing by the distribution video management server 20 will be described using Fig. 5. Fig. 5 is a flowchart showing an example of processing by the distribution video management server in the display video determination system according to the present disclosure. The distribution video management server 20 starts the flowchart of Fig. 5 when, for example, live distribution of an event begins.

[0035] First, the video acquisition unit 201 acquires, from each of the imaging units 10, the video images captured by the imaging units 10 as video information (step S101).

[0036] Next, the timer 206 checks whether measurement of the predetermined time Δt0 has started. Note that the display video determination system 1 sets the predetermined time Δt0 in advance before this flowchart starts. If the timer 206 measuring the predetermined time Δt0 has started (step S102: YES) and Δt0 has elapsed (step S103: YES), the imaging attribute information acquisition unit 204 acquires imaging attribute information relating to the position and orientation of the imaging means 10 from each imaging means 10 (step S104).

[0037] Note that even if the timer 206 for measuring the predetermined time Δt0 has not yet started (step S102: NO), the distribution video management server 20 executes step S104. After step S104, the image capture attribute information transmitting unit 205 transmits the image capture attribute information acquired by the image capture attribute information acquiring unit 204 to the terminal device 30 via the communication unit 207 (step S105). Then, the timer 206 starts measuring Δt0 (step S106).

[0038] If Δt0 has not yet elapsed (step S103: NO), or after the timer 206 starts measuring Δt0 (step S106), the video composition unit 202 composes the videos (step S107). More specifically, the video composition unit 202 composes the video information acquired by the video acquisition unit 201 into one piece of video information (composite video information).

[0039] Next, the video transmission unit 203 transmits the video information acquired by the video acquisition unit 201 and the composite video information synthesized by the video synthesis unit 202 to the terminal device 30 via the communication unit 207 (step S108). The distributed video management server 20 then checks whether an operation to end the distribution has been performed on an operation unit (not shown). If an operation to end the distribution has been performed (step S109: YES), the distributed video management server 20 ends the flowchart of Fig. 5. On the other hand, if an operation to end the distribution has not been performed (step S109: NO), the distributed video management server 20 executes step S101 again.

[0040] Next, an example of processing by the terminal device 30 will be described with reference to Figures 6 and 7. Figures 6 and 7 are flowcharts showing an example of processing by a terminal device in the display video determination system according to the present disclosure. For example, when user Y who has visited an event venue launches a dedicated app on the terminal device 30, the terminal device 30 starts the flowcharts of Figures 6 and 7.

[0041] First, the user position information acquisition unit 305 acquires user position information relating to the position of the user Y (step S201). Then, the user position information acquisition unit 305 stores the acquired user position information in the user position information storage unit 306.

[0042] Next, the reference position range setting unit 309 sets the reference position range A (step S202). The reference position range setting unit 309 sets the reference position range A based on the user position information stored in the user position information storage unit 306. The reference position range setting unit 309 stores the set reference position range A in the reference position range storage unit 310.

[0043] Next, the video acquisition unit 302 acquires the video information captured by each imaging unit 10 and the composite video information obtained by combining these pieces of video information from the distribution video management server 20 (step S203). At this time, the imaging attribute information acquisition unit 303 may also acquire the imaging attribute information from the distribution video management server 20 and store the imaging attribute information in the imaging attribute information storage unit 304.

[0044] Next, display video determination unit 314 determines whether a weighting factor has been set by checking whether a weighting factor has been stored in weighting factor storage unit 308. If a weighting factor has been set (step S204: YES), display video determination unit 314 determines whether user Y's current position is within reference position range A, based on the user position information stored in current position information storage unit 312 and reference position range A stored in reference position range storage unit 310.

[0045] If user Y's current position is within reference position range A (step S206: YES), display image determination unit 314 references the weighting coefficients of each imaging unit 10 stored in weighting coefficient storage unit 308 and identifies imaging unit 10d with the largest weighting coefficient. Then, display image determination unit 314 displays the image of imaging unit 10d with the largest weighting coefficient from image acquisition unit 302 on image display unit 315 (step S207).

[0046] On the other hand, if the current position of user Y is outside reference position range A (step S206: NO), display image determination unit 314 refers to the weighting coefficients of each imaging unit 10 stored in weighting coefficient storage unit 308, and identifies imaging unit 10b with the smallest weighting coefficient. Then, display image determination unit 314 displays the image of imaging unit 10b with the smallest weighting coefficient from image acquisition unit 302 on image display unit 315 (step S208).

[0047] If the weighting coefficient has not been set (step S204: NO), display image determination section 314 displays a list of all images on image display section 315 based on the composite image information (step S205).

[0048] After step S205, step S207 or step S208, if the communication unit 301 has received imaging attribute information from the distribution video management server 20 (step S209: YES), the imaging attribute information acquisition unit 303 acquires the imaging attribute information of each imaging means 10 and stores the acquired imaging attribute information in the imaging attribute information storage unit 304 (step S210).

[0049] If the image capture attribute information has not been received (step S209: NO), or after the image capture attribute information has been acquired and stored (step S210), the timer 313 checks whether measurement of the predetermined time Δt1 has already started. The display image determination system 1 pre-sets the predetermined time Δt1 before the start of this flowchart. If measurement of Δt1 has not already started (step S211: NO), the current location information acquisition unit 311 acquires user location information and stores the acquired user location information in the current location information storage unit 312 (step S213). Then, the timer 313 starts measuring Δt1 (step S214). If measurement of Δt1 has already started (step S211: YES) and Δt1 has already elapsed (step S212: YES), the terminal device 30 also executes steps S213 and S214.

[0050] If Δt1 has not yet elapsed (step S212: NO), or after timer 313 starts measuring Δt1 (step S214), reference position range setting unit 309 checks whether resetting of the reference position range is necessary. For example, if an operation requesting resetting of the reference position range is performed on an operation unit (not shown), reference position range setting unit 309 determines that resetting of the reference position range is necessary. If resetting of the reference position range is necessary (step S215: YES), reference position range setting unit 309 resets reference position range A based on the user position information stored in user position information storage unit 306 (step S216).

[0051] If resetting of the reference position range is not necessary (step S215: NO), or after resetting the reference position range A (step S216), the timer 313 checks whether measurement of the predetermined time Δt2 has already started. The display image determination system 1 pre-sets the predetermined time Δt2 before this flowchart begins. If measurement of Δt2 has not already started (step S217: NO), the weighting coefficient setting unit 307 sets a weighting coefficient for each imaging unit 10 and stores it in the weighting coefficient storage unit 308 (step S219). Then, the timer 313 starts measuring Δt2 (step S220). If measurement of Δt2 has already started (step S217: YES) and Δt2 has already elapsed (step S218: NO), the terminal device 30 also executes steps S219 and S220.

[0052] If Δt2 has not yet elapsed (step S218: NO), or after the timer 313 starts measuring Δt2 (step S220), the terminal device 30 checks whether an operation to end reception of the distribution has been performed on an operation unit (not shown). If an operation to end reception has been performed (step S221: YES), the terminal device 30 ends the flowcharts of Figures 6 and 7. On the other hand, if an operation to end reception has not been performed (step S221: NO), the terminal device 30 executes the process of step S203 again. Note that the determination of step S221 may be performed based on whether or not a signal indicating the end of distribution has been received from the distribution video management server 20, in addition to the operation to end reception.

[0053] As described above, according to this first embodiment, a display image determination system can be provided that automatically selects an image desired by a user from multiple images captured by multiple imaging means and determines the image as the image to be displayed on a terminal device.

[0054] Note that the present invention is not limited to the first embodiment and can be modified as appropriate without departing from the spirit of the present invention. For example, when the weighting coefficient setting unit 307 acquires user position information from the user position information storage unit 306, it acquires user orientation information for the event corresponding to the position of user Y based on seat information at the event venue. Regarding the acquisition of user orientation information, the user position information acquisition unit 305 may also acquire the user orientation information together with the user position information. For example, when user Y is at a location where he or she is watching the event, he or she may operate an app while pointing the terminal device 30 toward the event, thereby causing the user position information acquisition unit 305 to acquire the user orientation information together with the user position information.

[0055] Furthermore, if the positions and orientations of the image capturing means 10 are fixed during live streaming of an event, the image capturing attribute information acquisition unit 204 does not need to acquire the image capturing attribute information at the predetermined time intervals set by the timer 206. In this case, the image capturing attribute information acquisition unit 204 only needs to acquire the image capturing attribute information at least once after the start of live streaming.

[0056] Furthermore, display image determination unit 314 may determine an image to be displayed on image display unit 315 using the weighting coefficient of each imaging unit 10 and the zoom magnification of each imaging unit 10. If user Y's current position is within reference position range A, display image determination unit 314 selects an image captured by imaging unit 10 with the largest weighting coefficient from image acquisition unit 302 and displays it on image display unit 315. Here, if there are multiple imaging units 10 with the largest weighting coefficients, display image determination unit 314 selects, for example, an image captured by imaging unit 10 with the largest zoom magnification among them and displays it on image display unit 315. On the other hand, if user Y's current position is outside reference position range A and there are multiple imaging units 10 with the smallest weighting coefficients, display image determination unit 314 selects, for example, an image captured by imaging unit 10 with the largest zoom magnification among them and displays it on image display unit 315.

[0057] Embodiment 2 Hereinafter, another example of a display video determination system according to the present disclosure will be described with reference to the drawings. Note that explanations of parts that overlap with Embodiment 1 will be omitted as appropriate. In this embodiment, the position from which the user watches the event in the venue is not fixed. In other words, the user can watch the event while moving around the venue.

[0058] <Display video determination system> First, the display video determination system has the same configuration as the display video determination system shown in Fig. 1, including a plurality of imaging means 10, a distribution video management server 20, and one or more terminal devices 30. The imaging means 10 and the distribution video management server 20 have the same configuration as in the first embodiment, and therefore their description will be omitted.

[0059] As in the first embodiment, the terminal device 30 is a communication device such as a smartphone, tablet, or PC (Personal Computer) owned by a user who has come to a specific event venue to watch the event. In this embodiment, the user watches the event while moving around the venue. Therefore, even if the user's position at the venue changes, the terminal device 30 appropriately displays the image captured by the imaging means 10 that is most different from the user's current position and orientation at that position.

[0060] The configuration of terminal device 30 in this embodiment will be described using Figure 8. Figure 8 is a block diagram showing another example of a terminal in the display video determination system according to the present disclosure. As shown in Figure 8, terminal device 30 includes a communication unit 301, a video acquisition unit 302, an image capture attribute information acquisition unit 303, an image capture attribute information storage unit 304, a user position information acquisition unit 305, a user position information storage unit 306, a weighting coefficient setting unit 307, a weighting coefficient storage unit 308, a timer 313, a display video determination unit 314, and a video display unit 315. Note that since video acquisition unit 302, image capture attribute information acquisition unit 303, image capture attribute information storage unit 304, weighting coefficient setting unit 307, and video display unit 315 have the same configurations as those in embodiment 1, description thereof will be omitted.

[0061] Similar to the first embodiment, the user position information acquisition unit 305 acquires user position information relating to the user's position. In the present embodiment, the user position information acquisition unit 305 acquires user position information at predetermined time intervals set by the timer 313. In other words, the user position information acquisition unit 305 acquires user position information relating to the user's current position at predetermined time intervals. Then, the user position information acquisition unit 305 stores the acquired user position information in the user position information storage unit 306.

[0062] Similar to the first embodiment, display video determination unit 314 selects one of the multiple videos captured by each of the multiple imaging means 10 based on the imaging attribute information and the user position information, and determines the video to be displayed on terminal device 30. More specifically, display video determination unit 314 determines the video to be displayed on video display unit 315 using the weighting coefficients of each of the imaging means 10 stored in weighting coefficient storage unit 308.

[0063] <Processing Method by Display Video Determination System> Next, an example of processing by the display video determination system will be described. The processing by distribution video management server 20 is the same as in the first embodiment, and therefore description thereof will be omitted.

[0064] An example of processing by terminal device 30 in this embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing an example of processing by a terminal device in a display video determination system according to the present disclosure. Terminal device 30 starts the flowchart of Fig. 9 when, for example, user Y who has visited an event venue launches a dedicated app on terminal device 30.

[0065] First, the video acquisition unit 302 acquires video information captured by each imaging unit 10 and composite video information obtained by combining these pieces of video information from the distribution video management server 20 (step S301). Then, the imaging attribute information acquisition unit 303 stores the imaging attribute information acquired from the distribution video management server 20 in the imaging attribute information storage unit 304.

[0066] Next, display image determination unit 314 determines whether weighting factors have been set by checking whether weighting factors have been stored in weighting factor storage unit 308. If weighting factors have been set (step S302: YES), display image determination unit 314 references the weighting factors of each imaging unit 10 stored in weighting factor storage unit 308 and identifies imaging unit 10d with the largest weighting factor. Then, display image determination unit 314 displays the image of imaging unit 10 with the largest weighting factor from image acquisition unit 302 on image display unit 315 (step S304).

[0067] On the other hand, if the weighting coefficient has not been set (step S302: NO), display image determination section 314 displays a list of all images on image display section 315 based on the composite image information (step S303).

[0068] After step S303 or step S304, if the communication unit 301 has received imaging attribute information from the distribution video management server 20 (step S305: YES), the imaging attribute information acquisition unit 303 acquires the imaging attribute information of each imaging means 10 and stores the acquired imaging attribute information in the imaging attribute information storage unit 304 (step S306).

[0069] If the imaging attribute information has not been received (step S305: NO), or after the imaging attribute information has been acquired and stored (step S306), the timer 313 checks whether measurement of the predetermined time Δt1 has already started. If measurement of Δt1 has not already started (step S307: NO), the user position information acquisition unit 305 acquires user position information and stores the acquired user position information in the user position information storage unit 306 (step S309). Next, the weighting factor setting unit 307 sets a weighting factor for each imaging unit 10 and stores it in the weighting factor storage unit 308 (step S310). Then, the timer 313 starts measuring Δt1 (step S311).

[0070] If measurement of Δt1 has already started (step S307: YES) and Δt1 has already elapsed (step S308: YES), the terminal device 30 also executes steps S309, S310, and S311.

[0071] If Δt1 has not yet elapsed (step S308: NO), or after starting measurement of Δt1 (step S311), the terminal device 30 checks whether an operation to end reception of the broadcast has been performed on an operation unit (not shown). If an operation to end reception has been performed (step S312: YES), the terminal device 30 ends the flowchart of FIG. 9. On the other hand, if an operation to end reception has not been performed (step S312: NO), the terminal device 30 executes step S301 again.

[0072] As described above, according to the second embodiment, a display video determination system can be provided that automatically selects the video desired by the user as appropriate and determines it as the video to be displayed on the terminal device, even if the user's position in the venue changes.

[0073] It should be noted that the present invention is not limited to the second embodiment and can be modified as appropriate without departing from the spirit of the present invention. For example, similar to the first embodiment, the display image determination unit 314 may determine the image to be displayed on the image display unit 315 using the weighting coefficient of each imaging unit 10 and the zoom magnification of each imaging unit 10. If there are multiple imaging units 10 with the largest weighting coefficients, the display image determination unit 314 may select, for example, the image captured by the imaging unit 10 with the largest zoom magnification among them, and display it on the image display unit 315.

[0074] Furthermore, in the above-described embodiment, the distributed video management server 20 combines the video information from the imaging unit 10 and transmits it to each terminal device 30, and the terminal device 30 selects from among multiple pieces of video information. However, this is not limited to this. For example, the terminal device 30 selects the video information to be displayed on the terminal device 30 and transmits information requesting the video information to the distributed video management server 20. The terminal device 30 then receives and displays the video information transmitted from the distributed video management server 20. In another example, the terminal device 30 transmits its current location information and identification information identifying the terminal device 30 (or identification information identifying the user) to the distributed video management server 20. The distributed video management server 20 then acquires the current location information, selects the video information to be displayed on the user's terminal device 30, and transmits it to the user's terminal device 30. The video information to be displayed on the terminal device 30 may be multiple videos including at least the video determined by the display video determination unit 314. In this case, user Y can easily select a desired image from among the multiple images displayed on terminal device 30 .

[0075] This application claims priority based on Japanese Patent Application No. 2024-059590, filed April 2, 2024, the disclosure of which is incorporated herein by reference in its entirety.

[0076] The present disclosure is applicable to, for example, terminal devices and display image determination systems.

[0077] REFERENCE SIGNS LIST 1 Display video determination system 10 Imaging means 20 Distribution video management server 30 Terminal device 201 Video acquisition unit 202 Video synthesis unit 203 Video transmission unit 204 Imaging attribute information acquisition unit 205 Imaging attribute information transmission unit 206 Timer 207 Communication unit 301 Communication unit 302 Video acquisition unit 303 Imaging attribute information acquisition unit 304 Imaging attribute information storage unit 305 User position information acquisition unit 306 User position information storage unit 307 Weighting coefficient setting unit 308 Weighting coefficient storage unit 309 Reference position range setting unit 310 Reference position range storage unit 311 Current position information acquisition unit 312 Current position information storage unit 313 Timer 314 Display video determination unit 315 Video display unit A Reference position range NW Network Y User

Claims

1. A terminal device comprising: an image acquisition unit that acquires images captured by an imaging means; an image display unit that displays the images; an image capture attribute information storage unit that stores image capture attribute information relating to the position and orientation of the imaging means; a user position information storage unit that stores user position information relating to the position of a user of the terminal device; and a display image determination unit that selects an image from a plurality of images captured by each of a plurality of the imaging means based on the image capture attribute information and the user position information, and determines the image to be displayed on the image display unit.

2. The terminal device according to claim 1, further comprising a weighting factor setting unit that calculates a differential distance and a differential angle between the user and each of the imaging means based on the imaging attribute information stored in the imaging attribute information storage unit and the user position information stored in the user position information storage unit, and sets a weighting factor for each of the imaging means based on the differential distance and differential angle, and the display image determination unit determines the image captured by the imaging means with the largest weighting factor as the image to be displayed on the image display unit.

3. A terminal device as described in claim 2, further comprising: a reference position range storage unit that stores a reference position range of the user that is set based on the user position information stored in the user position information storage unit; and a current position information storage unit that stores user position information acquired at predetermined time intervals, wherein the display image determination unit, when the user position information stored in the current position information storage unit is within the reference position range, determines the image captured by the imaging means with the largest weighting coefficient as the image to be displayed on the image display unit, and when the user position information stored in the current position information storage unit is outside the reference position range, determines the image captured by the imaging means with the smallest weighting coefficient as the image to be displayed on the image display unit.

4. The terminal device according to claim 3, wherein the imaging attribute information further includes information relating to the zoom magnification of the imaging means, and wherein, when there are multiple imaging means determined based on the weighting coefficient, the display image determination unit determines the image to be displayed on the image display unit from images captured by the multiple imaging means determined based on the weighting coefficient, further based on the zoom magnification of the imaging means.

5. The terminal device according to claim 1, wherein the image acquisition unit acquires images captured by a plurality of the imaging means.

6. A display video determination system for determining video to be displayed on a terminal device of a user attending a specific event at the venue of the specific event, comprising: a plurality of imaging means installed at the venue of the specific event; a distribution video management server having: a video acquisition unit that acquires video captured by the plurality of imaging means; an imaging attribute information acquisition unit that acquires imaging attribute information relating to the position and orientation of each of the imaging means; a video transmission unit that transmits the video via a communication unit; and an imaging attribute information transmission unit that transmits the imaging attribute information of each of the imaging means via the communication unit; a video acquisition unit that acquires the video transmitted from the distribution video management server; an imaging attribute information acquisition unit that acquires the imaging attribute information transmitted from the distribution video management server; a user position information acquisition unit that acquires user position information relating to the position of the user; a video display unit that displays the video; and a display video determination unit that selects one of the plurality of videos based on the imaging attribute information and the user position information to determine the video to be displayed on the video display unit.

7. The display video determination system according to claim 6, wherein the video acquisition unit in the terminal device acquires a plurality of the videos transmitted from the distribution video management server.

Images