User terminal device, information processing device, distribution system, and program

Abstract

A distribution system (1) includes: a plurality of image capturing devices (10a)-(10h) that capture the same imaging target area, and generate and transmit a plurality of time-series captured images; an information processing device (20) that transmits the plurality of time-series captured images; and user terminal devices (30a), (30b), (1030a), (1030b) that display the plurality of time-series captured images. The user terminal devices (30a), (30b), (1030a), (1030b) include display control units (314), (1314) that delay and display, among the plurality of time-series captured images, a plurality of time-series captured images generated by the image capturing devices (10a)-(10h) of which the imaging directions are outside preset ranges based on the directions of the user terminal devices (30a), (30b), (1030a), (1030b).

Description

User terminal device, information processing device, distribution system, and program

[0001] The present disclosure relates to a user terminal device, an information processing device, a distribution system, and a program for receiving and displaying videos generated by a plurality of imaging devices.

[0002] Conventionally, various techniques for distributing videos generated by a plurality of imaging devices have been proposed. As an example of such a technique, Patent Document 1 sets video information corresponding to the same subject in the same group based on the video information and position information of a wireless terminal, and based on the video information included in the same group, generates a multi-view video group that is a group of videos from multiple viewpoints of the subject, and discloses a video distribution system that distributes video information corresponding to the multi-view video group.

[0003] Japanese Patent Application Laid-Open No. 2012-222756

[0004] However, the video distribution system disclosed in Patent Document 1 distributes videos from multiple viewpoints of a subject simultaneously, and has a problem that videos generated by a plurality of imaging devices that image the same imaging target area cannot be displayed with a delay according to the viewing direction of the user.

[0005] The present disclosure solves such problems, and provides a user terminal device, an information processing device, a distribution system, and a program capable of displaying videos generated by a plurality of imaging devices that image the same imaging target area with a delay according to the viewing direction of the user.

[0006] A user terminal device that receives and displays a video generated by an imaging device according to the present disclosure from an information processing device, wherein the information processing device transmits imaging direction information indicating the imaging direction of the imaging device to the user terminal device together with the video, and the user terminal device includes a display control unit that delays and displays the video when the imaging direction of the video is outside a predetermined range based on the direction in which the user terminal device is facing, and displays the video without delay when the imaging direction of the video is within the predetermined range.

[0007] The information processing device for transmitting video received from multiple imaging devices to a user terminal device according to this disclosure includes: a receiving unit that receives imaging direction information indicating the direction of imaging from an imaging device and terminal device direction information indicating the direction the user terminal device is facing from a user terminal device; a grouping processing unit that uses the imaging direction information and terminal device direction information corresponding to each of the multiple imaging devices to perform a grouping process that divides the multiple imaging devices into a delayed group consisting of imaging devices whose imaging direction is outside a predetermined range and a non-delayed group consisting of imaging devices whose imaging direction is within a predetermined range; and a transmitting unit that transmits multiple time-series images generated by imaging devices belonging to the delayed group with a delay and transmits multiple time-series images generated by imaging devices belonging to the non-delayed group without delay.

[0008] The distribution system relating to this disclosure includes multiple imaging devices that photograph the same target area and generate and transmit multiple time-series images; an information processing device that transmits the multiple time-series images transmitted by the multiple imaging devices; and a user terminal device that displays the multiple time-series images transmitted by the information processing device. The user terminal device includes a display control unit that displays, with a delay, multiple time-series images generated by imaging devices whose respective shooting directions are outside a predetermined range based on the direction the user terminal device is facing, and displays, without delay, multiple time-series images generated by imaging devices whose respective shooting directions are within a predetermined range.

[0009] The program relating to this disclosure causes a computer to perform the following processes: a grouping process that divides multiple imaging devices into a delayed group consisting of imaging devices whose imaging direction is outside a predetermined range based on the direction of the user terminal device, and a non-delayed group consisting of imaging devices whose imaging direction is within a predetermined range, using the imaging direction of each imaging device that captures the same target area and generates multiple images in a time series, and the direction of the user terminal device; a process that transmits multiple images in a time series generated by imaging devices belonging to the delayed group to the user terminal device with a delay; and a process that transmits multiple images in a time series generated by imaging devices belonging to the non-delayed group to the user terminal device without delay.

[0010] The program relating to this disclosure causes the user terminal device to perform the following processes: a grouping process that divides multiple imaging devices, each generating multiple images in a time series by imaging the same target area, into a delayed group consisting of imaging devices whose imaging direction is outside a predetermined range based on the direction of the user terminal device, and a non-delayed group consisting of imaging devices whose imaging direction is within a predetermined range; a process that displays the multiple images in a time series generated by imaging devices belonging to the delayed group with a delay; and a process that displays the multiple images in a time series generated by imaging devices belonging to the non-delayed group without delay.

[0011] This disclosure provides a user terminal device, information processing device, distribution system, and program that can display images generated by multiple cameras capturing the same target area, with a delay according to the user's viewing direction.

[0012] This figure shows an example of the configuration of the distribution system according to this disclosure. This figure shows the configuration of the imaging device according to this disclosure. This figure shows the configuration of the information processing device according to the first embodiment. This figure shows the configuration of the user terminal device according to the first embodiment. This figure shows an example of a default area. This is a sequence diagram showing an example of processing performed in the distribution system according to the first embodiment. This is a flowchart showing an example of grouping processing according to the first embodiment. This figure shows an example of the imaging device management table according to the first embodiment. This is a conceptual diagram showing the delayed transmission buffer and real-time transmission buffer according to the first embodiment. This figure shows an example of an image displayed on the display unit of the user terminal device according to this disclosure. This figure shows the configuration of the information processing device according to the second embodiment. This figure shows the configuration of the user terminal device according to the second embodiment. This is a sequence diagram showing an example of processing performed in the distribution system according to the second embodiment. This is a flowchart showing an example of grouping processing according to the second embodiment. This is a conceptual diagram showing the first delayed display buffer, the second delayed display buffer and the real-time display buffer according to the second embodiment. This figure shows an example of the imaging device management table according to the second embodiment.

[0013] <First Embodiment> Figure 1 is a diagram showing an example of the configuration of the distribution system 1 according to the present disclosure. The distribution system 1 is a system that distributes and displays captured images generated by a plurality of imaging devices 10a to 10h. The distribution system 1 includes a plurality of imaging devices 10a to 10h, an information processing device 20, and one or more user terminal devices 30a, 30b. The imaging devices 10a to 10h, the information processing device 20, and the user terminal devices 30a, 30b can communicate data with each other via a network 40. The network 40 may include a wide area network (WAN) or a local area network (LAN), etc. The distribution system 1 may include any number of imaging devices and user terminal devices.

[0014] Multiple imaging devices 10a to 10h are imaging devices that capture the same target area and generate multiple time-series images (moving images). Multiple imaging devices 10a to 10h may also be imaging devices that simultaneously capture the same target area and generate multiple time-series images. Specific examples of target areas include various areas such as live venues, sports venues, and stadiums. Figure 2 shows the configuration of imaging device 10a. Other imaging devices included in the distribution system 1 have the same configuration as imaging device 10a. Imaging device 10a comprises a processing unit 11, a communication interface (I / F) 12, a storage device 13, an imaging device 14, and a sound collection device 15.

[0015] The arithmetic unit 11 is a device that performs overall control of the imaging device 10a. Specific examples of the arithmetic unit 11 include processors such as a CPU (Central Processing Unit), MPU (Micro Processing Unit), and GPU (Graphics Processing Unit). The arithmetic unit 11 executes the method defined by the program stored in the storage device 13. In other embodiments, the functions performed by the arithmetic unit 11 may be performed by integrated circuits such as FPGAs (Field-Programmable Gate Arrays) and ASICs (Application Specific Integrated Circuits). These devices are equivalent to computers.

[0016] The communication interface 12 is an interface for communicating data with other devices. The communication interface 12 can communicate various types of information with other devices such as the information processing device 20 via the network 40. The communication interface 12 can also receive signals necessary for positioning, such as positioning signals transmitted by positioning satellites and identification signals (beacons) transmitted by signal transmitters in indoor positioning systems.

[0017] The storage device 13 stores various types of data, such as programs executed by the arithmetic unit 11 and data processed by the arithmetic unit 11.

[0018] The imaging device 14 is a device that photographs the object to be photographed. Specific examples of the imaging device 14 include various image sensors such as a CCD (Charge Coupled Device) image sensor and a CMOS (Complementary Metal Oxide Semiconductor) image sensor, which convert optical signals received through a lens (not shown) into electrical signals.

[0019] The sound collection device 15 is a device that converts sound waves around the imaging device 10a or in a predetermined direction relative to the imaging device 10a into electrical signals. Examples of sound collection devices 15 include omnidirectional microphones and directional microphones.

[0020] The computing device 11 includes a position calculation unit 110, a shooting direction calculation unit 111, a captured image generation unit 112, a sound information generation unit 113, and a transmission unit 114.

[0021] The position calculation unit 110 calculates the position of the imaging device 10a and generates position information for the imaging device 10a. The position calculation unit 110 can generate position information for the imaging device 10a using positioning signals transmitted by positioning satellites. The position calculation unit 110 may also generate position information for the imaging device 10a using identification signals transmitted by signal transmitters in the indoor positioning system.

[0022] The shooting direction calculation unit 111 calculates the shooting direction of the shooting device 10a and generates shooting direction information indicating the shooting direction of the shooting device 10a. Specifically, the shooting direction calculation unit 111 can calculate the shooting direction based on information output by geomagnetic sensors equipped in the shooting device 10a, such as MI (Magneto Impedance) sensors or MR (Magneto Resistance) sensors (not shown). The shooting direction can be expressed as an angle between 0 degrees and less than 360 degrees, with north (0 degrees) as the reference direction.

[0023] The image generation unit 112 generates an image of the target area using the electrical signal output by the imaging device 14. The image generation unit 112 generates the image at a predetermined frame rate (fps). The predetermined frame rate can be any frame rate.

[0024] The sound information generation unit 113 acquires the electrical signal output by the sound collection device 15 and generates sound information corresponding to the captured image. The sound information corresponding to the captured image is the sound information generated by the sound information generation unit 113 based on the sound collected by the sound collection device 15 of the camera 10a during the period from when one captured image is generated by the captured image generation unit 112 until the next captured image is generated.

[0025] The transmitting unit 114 transmits the position information, shooting direction information, captured image, and sound information of the shooting device 10a to the information processing device 20.

[0026] The information processing device 20 is a device that transmits images captured by the imaging devices 10a to 10h to user terminal devices 30a and 30b for display. A specific example of the information processing device 20 is a server, etc. The information processing device 20 is equivalent to a computer. Figure 3 is a diagram showing the configuration of the information processing device 20. The information processing device 20 comprises an arithmetic unit 21, a communication interface (I / F) 22, and a storage device 23.

[0027] The arithmetic unit 21 is a device that performs overall control of the information processing device 20. Specific examples of the arithmetic unit 21 include processors such as CPUs, MPUs, and GPUs. The arithmetic unit 21 executes the method defined by the program stored in the storage device 23. In other embodiments, the functions performed by the arithmetic unit 21 may be performed by integrated circuits such as FPGAs and ASICs.

[0028] The communication interface 22 is an interface for communicating data with other devices. The communication interface 22 can communicate various types of information with other devices such as user terminal devices 30a and 30b via the network 40.

[0029] The storage device 23 stores various types of data, such as programs executed by the arithmetic unit 21 and data processed by the arithmetic unit 21.

[0030] The arithmetic unit 21 includes a receiving unit 210, a grouping processing unit 211, a storage unit 215, and a transmission unit 216.

[0031] The receiving unit 210 receives information transmitted by the imaging devices 10a to 10h and information transmitted by the user terminal devices 30a and 30b. The information transmitted by the imaging devices 10a to 10h includes the position information of the imaging devices 10a to 10h, imaging direction information, captured image, and sound information. The information transmitted by the user terminal devices 30a and 30b includes the position information of the user terminal devices 30a and 30b and terminal device direction information indicating the direction in which the user terminal devices 30a and 30b are facing. The direction in which the user terminal devices 30a and 30b are facing may be the direction of the object to be photographed relative to the position of the user.

[0032] The grouping processing unit 211 uses the respective shooting directions of the multiple shooting devices 10a to 10h and the directions of the user terminal devices 30a and 30b to divide the multiple shooting devices 10a to 10h into a delayed group and a non-delayed group for each user terminal device 30a and 30b. The delayed group is a group consisting of shooting devices whose shooting direction is outside a predetermined range based on the directions of the user terminal devices 30a and 30b. The non-delayed group is a group consisting of shooting devices whose shooting direction is within a predetermined range. The predetermined range can be any angle range, such as the effective field of view of a person (for example, 70 degrees). The grouping processing unit 211 includes a position determination unit 212, a shooting device determination unit 213, and a registration unit 214.

[0033] The position determination unit 212 uses the position information of the user terminal devices 30a and 30b to determine whether the positions of the user terminal devices 30a and 30b are within a predetermined area. Figure 5 shows an example of a predetermined area. The predetermined area 60 can be defined, for example, by the walls of a structure. Multiple imaging devices 10a to 10h are arranged within the predetermined area 60. The predetermined area 60 also includes the area to be photographed. Multiple imaging devices 10a to 10h photograph the same area to be photographed. In the example shown in Figure 5, the position determination unit 212 determines that the position of the user terminal device 30a is within the predetermined area. On the other hand, the position determination unit 212 determines that the position of the user terminal device 30b is outside the predetermined area.

[0034] The imaging device determination unit 213 compares the direction indicated by the terminal device direction information of each user terminal device 30a and 30b with the imaging direction information of each imaging device 10a to 10h, and determines whether or not there is an imaging device with an imaging direction within the above-defined range.

[0035] The registration unit 214 registers, for each user terminal device 30a, 30b, imaging devices within a predetermined range of imaging directions as imaging devices in the non-delay group in the imaging device management table. The registration unit 214 also registers, for each user terminal device 30a, 30b, imaging devices outside the predetermined range of imaging directions as imaging devices in the delay group in the imaging device management table. Furthermore, if the registration unit 214 determines that the user terminal devices 30a, 30b are located outside the predetermined area, it registers all imaging devices as imaging devices in the non-delay group in the imaging device management table. The imaging device management table may be stored in the storage device 23 of the information processing device 20, or it may be stored in another device via the network 40.

[0036] Figure 8 shows an example of a shooting device management table according to the first embodiment. The registration unit 214 registers the identification information of shooting devices in shooting directions within a predetermined range as shooting devices in the non-delay group, associating it with the identification information of the user terminal device, and registers it in the shooting device management table. The registration unit 214 also registers the identification information of shooting devices in shooting directions outside the predetermined range as shooting devices in the delay group, associating it with the identification information of the user terminal device, and registers it in the shooting device management table.

[0037] Furthermore, if the registration unit 214 determines that the user terminal devices 30a and 30b are located outside the predetermined area, it registers the identification information of all imaging devices in the imaging device management table as imaging devices of the non-delay group, associated with the identification information of the user terminal devices.

[0038] The storage unit 215 stores the captured images and corresponding sound information of the imaging devices belonging to the delay group in the delayed transmission buffer for each user terminal device 30a, 30b. The storage unit 215 also stores the captured images and corresponding sound information of the imaging devices belonging to the non-delay group in the real-time transmission buffer for each user terminal device 30a, 30b. The delayed transmission buffer and the real-time transmission buffer are memory areas within the storage device 23. The delayed transmission buffer and the real-time transmission buffer may also be configured as areas of cache memory provided by the arithmetic unit 21.

[0039] Figure 9 is a conceptual diagram showing a delayed transmission buffer and a real-time transmission buffer according to the first embodiment. Time-series captured images and corresponding sound information are sequentially stored in the delayed transmission buffer and the real-time transmission buffer. The time-series captured images and corresponding sound information stored in the delayed transmission buffer and the real-time transmission buffer are transmitted in FIFO (First In First Out) format. In the example shown in Figure 9, the imaging device 10e belongs to the non-delayed group, and the other imaging devices 10a, 10b, and 10c belong to the delayed group. Furthermore, it is assumed that imaging by these imaging devices started at the time indicated by t = 0 ms.

[0040] As shown in Figure 9, the real-time transmission buffer stores the images captured by the imaging device 10e belonging to the non-delay group, along with the corresponding sound information. More specifically, the real-time transmission buffer stores the images captured by the imaging device 10e, starting with the first image captured by the imaging device 10e, identified at t=0ms, along with the corresponding sound information, and these images and sound information are transmitted sequentially.

[0041] The delayed transmission buffer stores multiple arbitrary images, as well as images captured by imaging devices 10a, 10b, and 10c belonging to the non-delayed group, and their corresponding sound information. The multiple arbitrary images are images transmitted prior to the images captured by imaging devices 10a, 10b, and 10c, and may be images captured before the image identified at t=0ms is captured. The delayed transmission buffer stores a number of arbitrary images corresponding to the delay time. Therefore, in the example shown in Figure 9, the image captured by imaging device 10e identified at t=0ms and its corresponding sound information are transmitted from the real-time transmission buffer at the same time as the arbitrary images stored in the delayed transmission buffer are transmitted. Subsequently, the image captured by imaging device 10e identified at t=1200ms and its corresponding sound information stored in the real-time transmission buffer are transmitted at the same time as the images captured by imaging devices 10a, 10b, and 10c identified at t=0ms and their corresponding sound information stored in the delayed transmission buffer are transmitted.

[0042] The transmitting unit 216 transmits, for each user terminal device 30a, 30b, the captured image and corresponding sound information stored in the delayed transmission buffer, and the captured image and corresponding sound information stored in the real-time transmission buffer.

[0043] More specifically, the transmission unit 216 transmits to the user terminal device 30a the captured image and corresponding sound information stored in the delayed transmission buffer for the user terminal device 30a, and the captured image and corresponding sound information stored in the real-time transmission buffer for the user terminal device 30a. The transmission unit 216 also transmits to the user terminal device 30b the captured image and corresponding sound information stored in the delayed transmission buffer for the user terminal device 30b, and the captured image and corresponding sound information stored in the real-time transmission buffer for the user terminal device 30b.

[0044] In this way, the transmission unit 216 delays and transmits a plurality of time-series captured images generated by the imaging devices belonging to the delay group, and transmits the plurality of time-series captured images generated by the imaging devices belonging to the non-delay group without delay. In other embodiments, instead of individually transmitting a single captured image and the corresponding audio information, the transmission unit 216 may transmit a plurality of time-series captured images forming a chapter and the corresponding audio information.

[0045] The user terminal devices 30a and 30b are devices that display the captured images transmitted by the information processing device 20. Specific examples of the user terminal devices 30a and 30b include information processing devices such as smartphones and tablet terminals. These information processing devices correspond to computers.

[0046] FIG. 4 is a diagram showing the configuration of the user terminal device 30a. Other user terminal devices included in the distribution system 1 have the same configuration as the user terminal device 30a. The user terminal device 30a includes an arithmetic unit 31, a communication interface (I / F) 32, a storage device 33, a display unit 34, and a sound output unit 35.

[0047] The arithmetic unit 31 is a device that performs overall control of the user terminal device 30a. Specific examples of the arithmetic unit 31 include processors such as a CPU, an MPU, and a GPU. The arithmetic unit 31 executes the program stored in the storage device 33 to execute the method defined by the program. In other embodiments, the functions executed by the arithmetic unit 31 may be executed by an integrated circuit such as an FPGA or an ASIC.

[0048] The communication interface 32 is an interface for communicating data with other devices. The communication interface 32 can communicate various information with other devices such as the information processing device 20 via the network 40. Further, the communication interface 32 can receive positioning signals transmitted by positioning satellites and identification signals transmitted by signal transmitters in an indoor positioning system, which are necessary for positioning.

[0049] The storage device 33 stores various types of data, such as programs executed by the arithmetic unit 31 and data processed by the arithmetic unit 31.

[0050] The display unit 34 is a device that displays various images, such as captured images, transmitted by the information processing device 20. A specific example of the display unit 34 is a display screen.

[0051] The sound output unit 35 is a device that outputs various sounds, such as sound information transmitted by the information processing device 20. A specific example of the sound output unit 35 is a speaker.

[0052] The calculation unit 31 includes a receiving unit 310, a position calculation unit 311, a direction calculation unit 312, a transmitting unit 313, a display control unit 314, and a sound playback unit 315.

[0053] The receiving unit 310 receives information transmitted by other devices. The information received by the receiving unit 310 includes captured images and corresponding sound information transmitted by the information processing device 20, and positioning signals transmitted by positioning satellites.

[0054] The position calculation unit 311 calculates the position of the user terminal device 30a and generates position information for the user terminal device 30a. Specifically, the position calculation unit 311 can generate position information for the user terminal device 30a using positioning signals transmitted by positioning satellites. The position calculation unit 311 may also generate position information for the user terminal device 30a using identification signals transmitted by signal transmitters in the indoor positioning system.

[0055] The direction calculation unit 312 calculates the direction the user terminal device 30a is facing and generates terminal device direction information indicating the direction of the user terminal device 30a. Specifically, the direction calculation unit 312 can calculate the direction of the user terminal device 30a based on information output by a geomagnetic sensor, such as an MI sensor or MR sensor (not shown), provided by the user terminal device 30a. The direction of the user terminal device 30a can be, for example, the longitudinal or short-lateral direction of the display unit 34 of the user terminal device 30a. The direction of the user terminal device 30a can be expressed as an angle between 0 degrees and less than 360 degrees, with north (0 degrees) as the reference direction.

[0056] The transmitting unit 313 transmits various information to other devices. The information transmitted by the transmitting unit 313 includes the location information and terminal device direction information of the user terminal device 30a.

[0057] The display control unit 314 controls the display of images by the display unit 34. Specifically, the display control unit 314 causes the display unit 34 to display the captured images transmitted by the information processing device 20. Figure 10 shows an example of an image 50 displayed on the display unit 34 of the user terminal device 30a. The image 50 includes multiple captured images transmitted by the information processing device 20. The display control unit 314 displays the captured image selected by the user of the user terminal device 30a in the largest image area 51 of the image 50.

[0058] The sound reproduction unit 315 controls the sound output by the sound output unit 35. Specifically, the sound reproduction unit 315 causes the sound output unit 35 to output the sound indicated by the sound information transmitted by the information processing device 20.

[0059] Figure 6 is a sequence diagram showing the processing performed in the distribution system 1 according to the first embodiment. In step S1, the position calculation unit 110 of the imaging device 10a calculates the position of the imaging device 10a and generates position information for the imaging device 10a. In step S2, the shooting direction calculation unit 111 of the imaging device 10a calculates the shooting direction of the imaging device 10a and generates shooting direction information for the imaging device 10a. In step S3, the image generation unit 112 of the imaging device 10a generates an image of the area to be photographed. In step S4, the sound information generation unit 113 of the imaging device 10a collects sound and generates sound information. In step S5, the transmission unit 114 of the imaging device 10a transmits the position information, shooting direction information, image, and sound information of the imaging device 10a to the information processing device 20. The imaging device 10a repeatedly executes the processing in steps S1 to S5. The imaging devices 10b to 10h also execute the same processing as the imaging device 10a.

[0060] In step S6, the position calculation unit 311 of the user terminal device 30a calculates the position of the user terminal device 30a and generates position information for the user terminal device 30a. In step S7, the direction calculation unit 312 of the user terminal device 30a calculates the direction of the user terminal device 30a and generates terminal device direction information for the user terminal device 30a. In step S8, the transmission unit 313 of the user terminal device 30a transmits the position information and terminal device direction information of the user terminal device 30a to the information processing device 20. The user terminal device 30a repeatedly executes the processes from steps S6 to S8. The user terminal device 30b also executes the same processes as the user terminal device 30a.

[0061] In step S9, the grouping processing unit 211 of the information processing device 20 uses the shooting direction information of the shooting devices 10a to 10h, the position information of the user terminal device 30a, and the terminal device direction information to perform a grouping process that groups the shooting devices 10a to 10h for each user terminal device 30a, 30b, dividing the shooting devices 10a to 10h into a delayed group and a non-delayed group. Details of the grouping process will be described later with reference to Figure 7.

[0062] In step S10, the storage unit 215 of the information processing device 20 stores the captured images and corresponding sound information of the imaging devices belonging to the delay group in the delayed transmission buffer for each user terminal device 30a, 30b. In step S11, the storage unit 215 stores the captured images and corresponding sound information of the imaging devices belonging to the non-delay group in the real-time transmission buffer for each user terminal device 30a, 30b. In step S12, the transmission unit 216 of the information processing device 20 transmits the captured images and corresponding sound information stored in the delayed transmission buffer and the captured images and corresponding sound information stored in the real-time transmission buffer to the user terminal devices 30a, 30b, respectively. The information processing device 20 repeatedly executes the processes from steps S9 to S12.

[0063] In step S13, the display control unit 314 of the user terminal device 30a displays the captured image transmitted by the information processing device 20 on the display unit 34. The user terminal device 30a repeatedly executes the process in step S13. The user terminal device 30b also executes the same process as the user terminal device 30a.

[0064] Figure 7 shows an example of the grouping process according to the first embodiment. Hereinafter, the grouping process for grouping the imaging devices 10a to 10h with respect to the user terminal device 30a will be described with reference to Figure 7. The grouping process for the user terminal device 30b is the same as the grouping process shown in Figure 7.

[0065] In step S20, the position determination unit 212 of the information processing device 20 determines whether the position of the user terminal device 30a, as indicated by the position information of the user terminal device 30a, is within a predetermined area. If it is determined that the position of the user terminal device 30a is outside the predetermined area (NO), in step S25, the registration unit 214 registers all the imaging devices 10a to 10h as imaging devices of the non-delay group in the imaging device management table, and the grouping process ends.

[0066] In step S20, if it is determined that the position of the user terminal device 30a is within a predetermined area (YES), the process branches to step S21. In step S21, the imaging device determination unit 213 compares the direction indicated by the terminal device direction information of the user terminal device 30a with the imaging direction indicated by the imaging direction information of each imaging device 10a to 10h, and determines whether or not there is an imaging device with an imaging direction within a predetermined range based on the direction of the user terminal device 30a.

[0067] In step S21, if it is determined that there is an imaging device with a shooting direction within a predetermined range (YES), in step S22, the registration unit 214 registers the imaging device with a shooting direction within the predetermined range as an imaging device of the non-delay group in the imaging device management table. In step S23, the registration unit 214 registers the imaging device with a shooting direction outside the predetermined range as an imaging device of the delay group in the imaging device management table, and the grouping process ends.

[0068] If, in step S21, it is determined that there are no imaging devices within the predetermined range of imaging directions (NO), then in step S24, the registration unit 214 registers all imaging devices 10a to 10h as imaging devices of the delay group in the imaging device management table, and the grouping process ends.

[0069] As described above, user terminal devices 30a and 30b display, with a delay, multiple time-series images generated by multiple imaging devices 10a to 10h, specifically those images generated by imaging devices whose imaging direction is outside a predetermined range based on the direction of user terminal devices 30a and 30b, and display multiple time-series images generated by imaging devices whose imaging direction is within the predetermined range without delay.

[0070] By adopting this configuration, users of user terminal devices 30a and 30b can align their field of view with the direction of the user terminal devices 30a and 30b, thereby displaying images generated by multiple shooting devices 10a to 10h that capture the same target area, with a delay according to the user's field of view. In particular, by delaying the display of images generated by shooting devices whose shooting direction is outside the predetermined range, images from shooting devices shooting in a direction different from the user's field of view are displayed with a delay. Therefore, users can view images from a direction different from their own line of sight, which are displayed with a delay on the display screens of user terminal devices 30a and 30b.

[0071] Furthermore, in the first embodiment described above, each of the multiple imaging devices 10a to 10h transmits imaging direction information indicating the imaging direction of its own device to the information processing device 20. User terminal devices 30a and 30b transmit terminal device direction information indicating the direction of their own devices to the information processing device 20. The grouping processing unit 211 of the information processing device 20 uses the imaging directions of each of the multiple imaging devices 10a to 10h indicated by the imaging direction information and the directions of the user terminal devices 30a and 30b indicated by the terminal device direction information to divide the multiple imaging devices 10a to 10h into a delayed group consisting of imaging devices whose imaging directions are outside a predetermined range and a non-delayed group consisting of imaging devices whose imaging directions are within a predetermined range. The transmission unit 216 of the information processing device 20 transmits multiple time-series images generated by imaging devices belonging to the delayed group with a delay, and transmits multiple time-series images generated by imaging devices belonging to the non-delayed group without delay.

[0072] By adopting this configuration, the information processing device 20 can divide the multiple shooting devices 10a to 10h into a delayed group and a non-delayed group using the shooting direction information transmitted by each of the multiple shooting devices 10a to 10h and the terminal device direction information transmitted by each of the user terminal devices 30a and 30b. Therefore, even if the direction of the multiple shooting devices 10a to 10h and the user terminal devices 30a and 30b changes, the information processing device 20 can divide the multiple shooting devices 10a to 10h into a delayed group and a non-delayed group based on the changed direction. For example, a user of user terminal device 30a can change their own line of sight direction and change the direction of user terminal device 30a, so that even after changing their line of sight direction, they can see an image of a different direction from their own line of sight displayed with a delay on the display screen of user terminal device 30a. In addition, even if the shooting direction of a shooting device that was within a predetermined range changes and goes outside the predetermined range, the image captured by that shooting device can be displayed with a delay on the display screens of user terminal devices 30a and 30b. In this way, users can easily view captured video footage that is not in their field of view. In this disclosure, "delay" refers to the delay in displaying multiple time-series captured images generated by a shooting device belonging to the non-delay group.

[0073] <Second Embodiment> In the second embodiment, user terminal devices 1030a and 1030b perform grouping processing of the imaging devices included in the distribution system 1. The information processing device 1020 transfers the captured images and corresponding sound information transmitted by the imaging devices included in the distribution system 1 to the user terminal devices 1030a and 1030b. The following description will focus on the differences from the first embodiment.

[0074] Figure 11 shows an example of the configuration of an information processing device 1020 according to the second embodiment. The information processing device 1020 comprises an arithmetic unit 1021, a communication interface (I / F) 1022, and a storage device 1023. In the second embodiment, a delayed transmission buffer is not constructed in the storage device 1023, and a real-time transmission buffer is constructed instead.

[0075] The arithmetic unit 1021 includes a receiving unit 1210, a storage unit 1215, and a transmitting unit 1216. The storage unit 1215 stores the images captured by the imaging devices 10a to 10h and the corresponding sound information in a real-time transmission buffer. The transmitting unit 1216 sequentially transmits the images captured and the corresponding sound information stored in the real-time transmission buffer, along with the position information and imaging direction information of the imaging devices 10a to 10h, to the user terminal devices 1030a and 1030b.

[0076] Figure 12 shows the configuration of the user terminal device 1030a according to the second embodiment. Other user terminal devices included in the distribution system 1 have the same configuration as the user terminal device 1030a. The user terminal device 1030a comprises a computing device 1031, a communication interface (I / F) 1032, a storage device 1033, a display unit 1034, and an audio output unit 1035.

[0077] The calculation unit 1031 includes a receiving unit 1310, a position calculation unit 1311, a direction calculation unit 1312, a transmitting unit 1313, a display control unit 1314, a sound playback unit 1315, a grouping processing unit 1316, and a storage unit 1320.

[0078] The grouping processing unit 1316 uses the shooting direction information of each of the multiple shooting devices 10a to 10h, the information indicating the direction of the user terminal device 1030a, and the position information of the user terminal device 1030a to divide the multiple shooting devices 10a to 10h into a first delayed group, a second delayed group, and a non-delayed group.

[0079] The grouping processing unit 1316 includes a position determination unit 1317, a shooting device determination unit 1318, and a registration unit 1319.

[0080] The position determination unit 1317 uses the position information of the user terminal device 1030a to determine whether or not the position of the user terminal device 1030a is within a predetermined area.

[0081] The imaging device determination unit 1318 compares the direction of the user terminal device 1030a calculated by the direction calculation unit 1312 with the imaging direction indicated by the imaging direction information of each imaging device 10a to 10h, and determines whether or not there is an imaging device with an imaging direction within the above-predetermined range.

[0082] The registration unit 1319 registers the imaging device in the imaging direction as one of the imaging devices in the non-delay group, the first delay group, or the second delay group in the imaging device management table. Figure 16 shows an example of the imaging device management table according to the second embodiment.

[0083] If the user terminal device 1030a is located within a predetermined area, the registration unit 1319 registers the identification information of the imaging device with a shooting direction within the predetermined range as an imaging device in the non-delay group in the imaging device management table. The registration unit 1319 also registers the identification information of the imaging device with a shooting direction outside the predetermined range as an imaging device in the second delay group in the imaging device management table.

[0084] On the other hand, if the user terminal device 1030a is located outside the predetermined area, the registration unit 1319 registers the identification information of the camera that generated the image corresponding to the display image selected by the user of the user terminal device 1030a on the display unit 1034, as a camera in the non-delay group in the camera device management table. The registration unit 1319 also registers the identification information of other camera devices as camera devices in the first delay group in the camera device management table. More specifically, the registration unit 1319 registers the identification information of camera devices other than the camera that generated the image corresponding to the display image selected by the user of the user terminal device 1030a, as camera devices in the first delay group in the camera device management table.

[0085] The storage unit 1320 stores the captured images and corresponding sound information of the imaging devices belonging to the first delay group in the first delay display buffer. The storage unit 1320 also stores the captured images and corresponding sound information of the imaging devices belonging to the second delay group in the second delay display buffer. Furthermore, the storage unit 1320 stores the captured images and corresponding sound information of the imaging devices belonging to the non-delay group in the real-time display buffer. The first delay display buffer, the second delay display buffer, and the real-time display buffer are memory areas within the storage device 1033 of the user terminal devices 1030a and 1030b. The first delay display buffer, the second delay display buffer, and the real-time display buffer may also be configured as areas of cache memory provided by the arithmetic unit 1031 of the user terminal devices 1030a and 1030b.

[0086] Figure 15 is a conceptual diagram showing the first delayed display buffer, the second delayed display buffer, and the real-time display buffer according to the second embodiment. The first delayed display buffer, the second delayed display buffer, and the real-time display buffer sequentially store time-series captured images and sound information corresponding to those captured images. The time-series captured images and corresponding sound information stored in the first delayed display buffer, the second delayed display buffer, and the real-time display buffer are output in FIFO format. In the example shown in Figure 15, the imaging device 10e belongs to the non-delayed group, the imaging device 10a belongs to the first delayed group, and the imaging device 10c belongs to the second delayed group. Furthermore, it is assumed that imaging by the imaging device started at the time indicated by t = 0 ms.

[0087] As shown in Figure 15, the real-time display buffer stores the images captured by the imaging device 10e belonging to the non-delay group, along with the corresponding sound information. More specifically, the real-time display buffer stores the images captured by the imaging device 10e, starting with the first image captured by the imaging device 10e, identified at t=0ms, along with the corresponding sound information. The display control unit 1314 sequentially displays these captured images on the display unit 1034. At this time, the sound playback unit 1315 can play back the sound indicated by the sound information corresponding to the captured image displayed in the largest image area 51 (Figure 10) of the display screen.

[0088] The first delayed display buffer stores a plurality of arbitrary images, the captured image of the camera 10a belonging to the first delay group, and corresponding sound information. The plurality of arbitrary images are images that are displayed prior to the captured image of the camera 10a. The first delayed display buffer stores a number of arbitrary images corresponding to the first delay time. Therefore, the display control unit 1314 displays the captured image of the camera 10e, identified as t=1200ms and stored in the real-time display buffer, and at the same time displays the captured image of the camera 10a, identified as t=0ms and stored in the first delayed display buffer. For example, if the camera 10a belonging to the first delay group is selected, the display control unit 1314 displays the captured image of the camera 10e stored in the real-time display buffer in an image area other than the image area 51 of the image 50, and at the same time displays the captured image of the camera 10a stored in the first delayed display buffer in the largest image area 51 of the image 50. The user of the user terminal device 1030a can set any time as the first delay time.

[0089] The second delay display buffer stores multiple arbitrary images, images captured by the camera 10c belonging to the second delay group, and corresponding sound information. The multiple arbitrary images are images that are displayed prior to the images captured by the camera 10c. The second delay display buffer stores a number of arbitrary images corresponding to the second delay time. Therefore, the display control unit 1314 displays the image captured by the camera 10e, identified as t = 2400 ms, stored in the real-time display buffer, and at the same time displays the image captured by the camera 10c, identified as t = 0 ms, stored in the second delay display buffer. This second delay time is longer than the first delay time. Users of the user terminal device 1030a can set any time as the second delay time.

[0090] Figure 13 is a sequence diagram showing the processes executed in the distribution system 1 according to the second embodiment. The processes in steps S1 to S7 are the same as those in steps S1 to S7 shown in Figure 6.

[0091] In step S30, the transmission unit 1216 of the information processing device 1020 transmits the position information, shooting direction information, captured image, and sound information received from the shooting devices 10a to 10h to the user terminal devices 1030a and 1030b.

[0092] In step S31, the grouping processing unit 1316 of the user terminal device 1030a performs a grouping process that groups the imaging devices 10a to 10h using the imaging direction information of the imaging devices 10a to 10h, the position information of the user terminal device 1030a, and the terminal device direction information, dividing the imaging devices 10a to 10h into a delayed group and a non-delayed group. Details of the grouping process will be described later with reference to Figure 14.

[0093] In step S32, the storage unit 1320 of the user terminal device 1030a stores the captured images and corresponding sound information of the imaging devices belonging to the first delay group in the first delay display buffer. In step S33, the storage unit 1320 of the user terminal device 1030a stores the captured images and corresponding sound information of the imaging devices belonging to the second delay group in the second delay display buffer. In step S34, the storage unit 1320 stores the captured images and corresponding sound information of the imaging devices belonging to the non-delay group in the real-time display buffer.

[0094] In step S35, the display control unit 1314 of the user terminal device 1030a displays the captured images stored in the first delayed display buffer, the captured images stored in the second delayed display buffer, and the captured images stored in the real-time display buffer on the display unit 1034. At this time, the sound playback unit 1315 of the user terminal device 1030a can output the sound indicated by the sound information corresponding to the captured image displayed in the largest image area 51 of the display unit 1034 to the sound output unit 1035. The user terminal device 1030a repeatedly executes the processes in steps S6, S7, and S31 to S35. The user terminal device 1030b also executes the same processes as the user terminal device 1030a.

[0095] Figure 14 shows an example of grouping processing according to the second embodiment. In step S40, the position determination unit 1317 of the user terminal device 1030a determines whether the position of the user terminal device 1030a, indicated by the position information of the user terminal device 1030a, is within a predetermined area.

[0096] In step S40, if it is determined that the position of the user terminal device 1030a is within a predetermined area (YES), the process branches to step S41. In step S41, the imaging device determination unit 1318 compares the direction of the user terminal device 1030a with the imaging direction indicated by the imaging direction information of each imaging device 10a to 10h, and determines whether or not there is an imaging device with an imaging direction within a predetermined range based on the direction of the user terminal device 1030a.

[0097] In step S41, if it is determined that there is an imaging device with a shooting direction within a predetermined range (YES), in step S42, the registration unit 1319 registers the imaging device with a shooting direction within the predetermined range as an imaging device of the non-delay group in the imaging device management table. In step S43, the registration unit 1319 registers the imaging device with a shooting direction outside the predetermined range as an imaging device of the second delay group in the imaging device management table, and the grouping process ends.

[0098] If, in step S41, it is determined that there are no imaging devices within the predetermined range of imaging directions (NO), then in step S44, the registration unit 1319 registers all imaging devices 10a to 10h as imaging devices of the second delay group in the imaging device management table, and the grouping process ends.

[0099] In step S40, if it is determined that the location of the user terminal device 1030a is outside the predetermined area (NO), in step S45, the registration unit 1319 registers the camera that produced the image selected by the user from among the multiple captured images displayed on the display unit 1034 as a camera in the non-delay group in the camera management table. In step S46, the registration unit 1319 registers the camera devices other than the camera that produced the image selected by the user from among the multiple captured images displayed on the display unit 1034 as camera devices in the first delay group in the camera management table, and the grouping process ends.

[0100] In the second embodiment described above, each of the multiple imaging devices 10a to 10h transmits imaging direction information indicating the imaging direction of its own device to the information processing device 1020. The information processing device 1020 transmits the imaging direction information of the multiple imaging devices 10a to 10h to the user terminal devices 1030a and 1030b. The grouping processing unit 1316 of the user terminal devices 1030a and 1030b uses the imaging directions of each of the multiple imaging devices 10a to 10h indicated by the imaging direction information, and the directions of the user terminal devices 1030a and 1030b to perform a grouping process that divides the multiple imaging devices 10a to 10h into a delayed group consisting of imaging devices whose imaging directions are outside a predetermined range, and a non-delayed group consisting of imaging devices whose imaging directions are within a predetermined range. The display control unit 1314 of the user terminal devices 1030a and 1030b displays multiple time-series captured images generated by the imaging device belonging to the delay group with a delay, and displays multiple time-series captured images generated by the imaging device belonging to the non-delay group without delay.

[0101] By adopting this configuration, user terminal devices 1030a and 1030b can divide the multiple imaging devices 10a to 10h into a delayed group and a non-delayed group using the imaging direction information transmitted by each of the multiple imaging devices 10a to 10h and the information indicating the direction of user terminal devices 1030a and 1030b. Therefore, even if the direction of the multiple imaging devices 10a to 10h and user terminal devices 1030a and 1030b changes, user terminal devices 1030a and 1030b can divide the multiple imaging devices 10a to 10h into a delayed group and a non-delayed group based on the changed direction.

[0102] Furthermore, in the second embodiment described above, if the user terminal devices 1030a and 1030b are located outside a predetermined area, the storage unit 1320 of the user terminal devices 1030a and 1030b saves the captured image from the camera that generated the captured image corresponding to the display image selected by the user of the user terminal devices 1030a and 1030b to the real-time display buffer. The storage unit 1320 of the user terminal devices 1030a and 1030b also saves the captured images from camera devices other than the camera that generated the captured image corresponding to the display image selected by the user of the user terminal devices 1030a and 1030b to the first delayed display buffer. The display control unit 1314 of the user terminal devices 1030a and 1030b then displays the captured images stored in the real-time display buffer in real time, and displays the captured images stored in the first delayed display buffer with a delay of the first delay time.

[0103] By adopting this configuration, users of user terminal devices 1030a and 1030b located outside the designated area can view in real time the video from the camera that produced the image corresponding to the display image they selected, and can also view video from other cameras with a delay.

[0104] Furthermore, in the second embodiment described above, if the user terminal devices 1030a and 1030b are located within a predetermined area, the storage unit 1320 of the user terminal devices 1030a and 1030b saves images captured by the camera in a shooting direction outside the predetermined range to a second delayed display buffer. The display control unit 1314 of the user terminal devices 1030a and 1030b then displays the captured images saved in the second delayed display buffer with a delay of a second delay time that is longer than the first delay time.

[0105] If the user terminal devices 1030a and 1030b are located within the predetermined area, in other words, if the users of the user terminal devices 1030a and 1030b are located within the predetermined area, the users are likely to be looking at the target area with their own eyes. On the other hand, if the user terminal devices 1030a and 1030b are located outside the predetermined area, in other words, if the users of the user terminal devices 1030a and 1030b are located outside the predetermined area, the users are likely to be looking at the images displayed on the display units 1034 of the user terminal devices 1030a and 1030b. Therefore, by delaying the display of the captured image stored in the second delayed display buffer by a second delayed time, which is longer than the first delayed time, it is possible to give users who are looking at the target area with their own eyes time to view the image from a camera with a shooting direction outside the predetermined range.

[0106] In the above example, the program can be stored and provided to the computer using various types of non-transitory computer-readable medium. Non-transitory computer-readable medium includes various types of tangible storage medium. Examples of non-transitory computer-readable medium include magnetic storage media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical storage media (e.g., magneto-optical disks), CD-ROMs, CD-Rs, CD-R / Ws, and semiconductor memory (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, RAMs). Alternatively, the program may be provided to the computer using various types of transient computer-readable medium. Examples of transient computer-readable medium include electrical signals, optical signals, and electromagnetic waves. Transitory computer-readable medium can supply the program to the computer via wired communication channels such as electric wires and optical fibers, or via wireless communication channels.

[0107] The present invention is not limited to the embodiments described above, and can be modified as appropriate without departing from the spirit of this disclosure. For example, in other embodiments, any of the shooting devices 10a to 10h, information processing devices 20, 1020, and user terminal devices 30a, 30b, 1030a, 1030b may be equipped with a volume determination unit that determines whether the volume of the sound information generated by the sound information generation unit 113 of each shooting device is equal to or greater than a predetermined volume. The predetermined volume can be, for example, the volume of cheers. The user terminal devices 30a, 30b, 1030a, 1030b can display the captured image (hereinafter referred to as the "attention image") corresponding to the sound information that has been determined to be equal to or greater than the predetermined volume in a different manner from other captured images.

[0108] Specifically, the following are ways to attract the attention of users of user terminal devices 30a, 30b, 1030a, and 1030b: for example, by displaying predefined characters to attract the user's attention, such as "Attention," superimposed on the attention image; by displaying the attention image with flashing lights or highlighting it; and by displaying the attention image with a changed color. By adopting this configuration, users of user terminal devices 30a, 30b, 1030a, and 1030b can recognize the existence of an attention image corresponding to sound information above a predetermined volume, for example, a captured image generated while cheering is occurring.

[0109] This application claims priority based on Japanese Patent Application No. 2024-166002, filed on 25 September 2024, and incorporates all of its disclosures herein.

[0110] This disclosure can be used in a distribution system for distributing and displaying video.

[0111] 1: Distribution system 10a-10h: Shooting device 11: Calculation unit 110: Position calculation unit 111: Shooting direction calculation unit 112: Shooting image generation unit 113: Sound information generation unit 114: Transmission unit 12: Communication interface 13: Storage device 14: Imaging device 15: Sound collection device 20: Information processing device 21: Calculation unit 210: Receiving unit 211: Grouping processing unit 212: Position determination unit 213: Shooting device determination unit 214: Registration unit 215: Storage unit 216: Transmission unit 22: Communication interface 23: Storage device 30a,30b: User terminal device 31: Calculation unit 310: Receiving unit 311: Position calculation unit 312: Direction calculation unit 313: Transmission unit 314: Display control unit 315: Sound playback unit 316: Grouping processing unit 317: Position determination unit 318: Shooting device determination unit 319: Registration unit 320: Storage unit 32: Communication interface 33: Storage device 34: Display unit 35: Sound output unit 40: Network 50: Image 51: Image area 60: Default area 1020: Information processing device 1021: Calculation unit 1210: Receiving unit 1211: Grouping processing unit 1212: Position determination unit 1213: Shooting device determination unit 1214: Registration unit 1215: Storage unit 1216 : Transmitting unit 1022 : Communication interface 1023 : Storage device 1030a : User terminal device 1030b : User terminal device 1031 : Calculation unit 1310 : Receiving unit 1311 : Position calculation unit 1312 : Direction calculation unit 1313 : Transmitting unit 1314 : Display control unit 1315 : Sound playback unit 1316 : Grouping processing unit 1317 : Position determination unit 1318 : Shooting device determination unit 1319 : Registration unit 1320 : Storage unit 1032 : Communication interface 1033 : Storage device 1034 : Display unit 1035 : Sound output unit,

Claims

1. A user terminal device that receives and displays an image generated by a shooting device from an information processing device, wherein the information processing device transmits shooting direction information indicating the shooting direction of the shooting device to the user terminal device along with the image, and the user terminal device includes a display control unit that delays the display of the image when the shooting direction of the image is outside a predetermined range based on the direction the user terminal device is facing, and displays the image without delay when the shooting direction of the image is within the predetermined range.

2. The information processing device transmits a plurality of images generated by a plurality of the imaging devices that image the same target area, along with the corresponding imaging direction information. The user terminal device further includes a grouping processing unit that divides the plurality of imaging devices into a first delay group, a second delay group, and a non-delay group using the location information of the user terminal device, the imaging direction of each of the plurality of imaging devices indicated by the imaging direction information, and the direction of the user terminal device. The grouping processing unit, when the location information is within a predetermined area, groups imaging devices whose imaging direction information is within the predetermined range into a non-delay group, and imaging devices whose imaging direction information is outside the predetermined range into a second delay group. When the location information is outside a predetermined area, groups imaging devices that generated an image corresponding to the display image selected by the user in the user terminal device into a non-delay group, and imaging devices other than those that generated an image corresponding to the display image into a first delay group. The user terminal device according to claim 1, wherein the display control unit displays images generated by a shooting device belonging to the first delay group with a predetermined time delay, displays images generated by a shooting device belonging to the second delay group with a delay longer than the predetermined time, and displays images generated by a shooting device belonging to the non-delay group without delay.

3. An information processing device for transmitting video received from multiple imaging devices to a user terminal device, comprising: a receiving unit that receives imaging direction information indicating the direction of imaging from the imaging devices and terminal device direction information indicating the direction the user terminal device is facing from the user terminal device; a grouping processing unit that performs a grouping process using the imaging direction information and terminal device direction information corresponding to each of the multiple imaging devices to divide the multiple imaging devices into a delayed group consisting of imaging devices whose imaging direction is outside a predetermined range and a non-delayed group consisting of imaging devices whose imaging direction is within the predetermined range; and a transmitting unit that transmits multiple time-series images generated by imaging devices belonging to the delayed group with a delay and transmits multiple time-series images generated by imaging devices belonging to the non-delayed group without delay.

4. The information processing apparatus according to claim 3, wherein the grouping processing unit further determines whether the user terminal device is within a predetermined area using location information received from the user terminal device, and if it determines that the user terminal device is not within the predetermined area, it performs a grouping process to make all the imaging devices into imaging devices of the non-delay group.

5. A distribution system comprising: a plurality of imaging devices that photograph the same target area and generate and transmit a plurality of time-series images; an information processing device that transmits the plurality of time-series images transmitted by the plurality of imaging devices; and a user terminal device that displays the plurality of time-series images transmitted by the information processing device, wherein the user terminal device includes a display control unit that displays with a delay the plurality of time-series images generated by imaging devices whose respective imaging directions are outside a predetermined range based on the direction the user terminal device is facing, and displays without delay the plurality of time-series images generated by imaging devices whose respective imaging directions are within the predetermined range.

6. The distribution system according to claim 5, wherein each of the plurality of imaging devices transmits imaging direction information indicating the imaging direction of its own device to the information processing device, the user terminal device transmits terminal device direction information indicating the direction of its own device to the information processing device, the information processing device includes a grouping processing unit that performs a grouping process to divide the plurality of imaging devices into a delayed group consisting of imaging devices whose imaging direction is outside the predetermined range and a non-delayed group consisting of imaging devices whose imaging direction is within the predetermined range, using the imaging direction of each of the plurality of imaging devices indicated by the imaging direction information and the direction of the user terminal device indicated by the terminal device direction information, and a transmission unit that transmits a plurality of time-series images generated by imaging devices belonging to the delayed group with a delay and transmits a plurality of time-series images generated by imaging devices belonging to the non-delayed group without delay.

7. The distribution system according to claim 5, wherein each of the plurality of imaging devices transmits imaging direction information indicating the imaging direction of its own device to the information processing device, the information processing device transmits the imaging direction information to the user terminal device, the user terminal device includes a grouping processing unit that performs a grouping process to divide the plurality of imaging devices into a delayed group consisting of imaging devices whose imaging direction is outside the predetermined range and a non-delayed group consisting of imaging devices whose imaging direction is within the predetermined range, using the imaging direction of each of the plurality of imaging devices indicated by the imaging direction information and the direction of the user terminal device, and the display control unit displays a plurality of time-series images generated by imaging devices belonging to the delayed group with a delay, and displays a plurality of time-series images generated by imaging devices belonging to the non-delayed group without delay.

8. A program that causes a computer to perform the following processes: a grouping process that divides a plurality of imaging devices, each generating multiple time-series images by imaging the same target area, into a delayed group consisting of imaging devices whose imaging direction is outside a predetermined range based on the direction of the user terminal device, and a non-delayed group consisting of imaging devices whose imaging direction is within the predetermined range; a process that delays the transmission of multiple time-series images generated by imaging devices belonging to the delayed group to the user terminal device; and a process that transmits multiple time-series images generated by imaging devices belonging to the non-delayed group to the user terminal device without delay.

9. A program that causes a user terminal device to perform the following processes: a grouping process that divides a plurality of imaging devices, each of which captures the same target area and generates multiple images in a time series, into a delayed group consisting of imaging devices whose imaging direction is outside a predetermined range based on the direction of the user terminal device, and a non-delayed group consisting of imaging devices whose imaging direction is within the predetermined range; a process that displays the multiple images in a time series generated by imaging devices belonging to the delayed group with a delay; and a process that displays the multiple images in a time series generated by imaging devices belonging to the non-delayed group without delay.

Images