Image communication system, communication management device, communication management method and program

Abstract

To provide an image communication system that simultaneously provides photographic images of a plurality of attention points with one photographing device.SOLUTION: A communication management device in an image communication system 1 receives coordinate information on a plurality of attention points Pn transmitted by a communication terminal, and transmits, to the communication terminal, an IP address of a shared photographing device 10A-1-4(10A-2-1) that is selected from a plurality of photographing devices, is at the shortest distance to two arbitrary designated positions indicated by the coordinate values of the attention points, and can share images of the two attention points P1 and P2, and predetermined area information on the shared photographing device indicating predetermined areas for seeing the two attention points P1 and P2 on the front. Upon receiving the predetermined area information on the shared photographing device, the communication terminal displays, on a display, predetermined area images when the two attention points P1 and P2 are seen on the front.SELECTED DRAWING: Figure 42

Description

[Technical field]

[0001] The present invention relates to an image communication system, a communication management device, a communication management method, and a program. [Background technology]

[0002] There is known a camera capable of capturing images in all directions using multiple wide-angle or fisheye lenses. There is also known a system that distributes image data captured by such a camera in real time and enables a user to view in real time the status of a distribution base where the camera is installed (placed) at another base.

[0003] For example, a system has been disclosed that allows a user to grasp the situation in a remote location by displaying images captured by a plurality of cameras placed in the remote location on a terminal (see Patent Document 1). Summary of the Invention [Problem to be solved by the invention]

[0004] However, the conventional method has a problem in that it is not possible to simultaneously provide captured images of a plurality of points of interest using a single image capturing device. [Means for solving the problem]

[0005] In order to solve the above-mentioned problems, the present invention relates to a method for taking images captured by a plurality of image capture devices. photograph An image communication system having a communication terminal that displays an image and a communication management device that communicates with the communication terminal, the communication management device having a receiving means for receiving each designated position information transmitted from the communication terminal, the designated position information indicating each of a plurality of designated positions in an area in which the plurality of image capture devices are arranged, and a receiving means for receiving each of the designated position information transmitted from the plurality of image capture devices. and others a shared photographing device which is capable of sharing images of any two designated positions among the designated positions indicated by the designated position information received by the receiving means and which has a shortest distance from each other to any two designated positions; A selection means for selecting the previousa transmitting means for transmitting, to the communication terminal, information on each of the predetermined areas of the shared photographing device, which indicates each of the predetermined areas for viewing the two designated positions from the front, From the communication management device The above each Predetermined area information and the captured image a receiving means for receiving the signal received by the receiving means; A processing means for generating, from the photographed image received by the receiving means, each of the predetermined area images corresponding to each of the predetermined area information, using the each of the predetermined area information; and a display control means for displaying the image. Effect of the Invention

[0006] As described above, according to the present invention, it is possible to provide images captured at a plurality of points of interest simultaneously using a single image capturing device. [Brief description of the drawings]

[0007] [Figure 1] 1A is a left side view of the imaging device, FIG. 1B is a front view of the imaging device, and FIG. 1C is a plan view of the imaging device. [Diagram 2] FIG. 13 is an image of the imaging device in use. [Diagram 3] (A) is a hemispherical image (front side) captured by the camera, (B) is a hemispherical image (rear side) captured by the camera, and (C) is an image represented by equirectangular projection. [Figure 4] (A) is a conceptual diagram showing how a sphere is covered with an equirectangular projection image, and (B) is a diagram showing a spherical image. [Diagram 5] FIG. 13 is a diagram showing the positions of a virtual camera and a predetermined area when a celestial sphere image is a three-dimensional solid sphere. [Figure 6] FIG. 6(A) is a three-dimensional perspective view of FIG. 5, and FIG. 6(B) is a diagram showing a state in which an image of a predetermined area is displayed on a display. [Figure 7] 13 is a diagram showing the relationship between predetermined region information and an image of a predetermined region T. FIG. [Figure 8] FIG. 1 illustrates points in three-dimensional Euclidean space in spherical coordinates. [Figure 9] FIG. 1 is a diagram showing an overall configuration of an image communication system. [Figure 10] FIG. 2 is a diagram for explaining an outline of a distribution point in the image communication system. [Figure 11] FIG. 2 is a diagram illustrating an example of a hardware configuration of the imaging device. [Figure 12] FIG. 2 is a diagram illustrating an example of a hardware configuration of a distribution terminal, a communication management device, and a communication terminal. [Figure 13] FIG. 1 illustrates an example of a functional configuration of an image communication system. [Figure 14] FIG. 1 illustrates an example of a functional configuration of an image communication system. [Figure 15] FIG. 1A is a schematic diagram showing an example of a photographing device management table, and FIG. 1B is a conceptual diagram showing an example of an image type management table. [Figure 16] FIG. 1A is a schematic diagram showing an example of a session management table, and FIG. 1B is a conceptual diagram showing an example of an image type management table. [Figure 17] FIG. 13 is a schematic diagram showing an example of a predetermined area management table. [Figure 18] FIG. 13 is a conceptual diagram illustrating an example of a layout information management table. [Figure 19] FIG. 13 is a schematic diagram illustrating an example of a distribution base management table. [Figure 20] FIG. 1A is a schematic diagram showing an example of an image type management table, and FIG. 1B is a conceptual diagram showing an example of a predetermined area management table. [Figure 21] 10 is a diagram for roughly explaining an example of the relationship between attention points P and the imaging device when two attention points P are set. FIG. [Figure 22] FIG. 2 is a diagram for roughly explaining an example of the installation direction and azimuth angle of each image capturing device around a point of interest P1. [Figure 23] 1 is a diagram for roughly explaining an example of the installation direction and azimuth angle of each image capturing device around a point of interest P2. FIG. [Figure 24] 10 is a diagram for roughly explaining an example of the relationship between attention points P and the imaging device when three attention points P are set. FIG. [Diagram 25] FIG. 1 is a diagram for explaining an example of a relationship between image capturing devices arranged at irregular positions and each of the points of interest. [Figure 26] FIG. 11 is a sequence diagram showing an example of a process for participating in a specific communication session in the image communication system. [Figure 27] FIG. 13 is a diagram illustrating an example of a selection screen for a communication session. [Figure 28] 11 is a sequence diagram showing an example of a management process of image type information in the image communication system. FIG. [Figure 29] 1 is a sequence diagram showing an example of a communication process of captured image data and sound data in an image communication system. [Diagram 30] FIG. 11 is a sequence diagram showing an example of a display process of an attention point P in the image communication system. [Diagram 31] 10 is a flowchart illustrating an example of a selection process of an imaging device. [Diagram 32] 13 is a flowchart illustrating an example of a selection process of a shared imaging device. [Diagram 33] FIG. 13 is a diagram illustrating an example of a focus point designation screen displayed on the communication terminal. [Diagram 34] FIG. 13 is a diagram showing an example of a display screen that displays images captured by a camera around a point of interest P1. [Diagram 35] FIG. 13 is a diagram showing an example of a display screen that displays images captured by a camera around a point of interest P1. [Diagram 36] FIG. 13 is a diagram showing an example of a display screen that displays images captured by a camera around a point of interest P1. [Figure 37] FIG. 13 is a diagram showing an example of a display screen that displays images captured by a camera around a point of interest P1. [Figure 38] FIG. 13 is a diagram showing an example of a display screen that displays images captured by a camera around a point of interest P2. [Figure 39] FIG. 13 is a diagram showing an example of a display screen that displays images captured by a camera around a point of interest P2. [Diagram 40] FIG. 13 is a diagram showing an example of a display screen that displays images captured by imaging devices in the vicinity of eye point P2. [Diagram 41]FIG. 13 is a diagram showing an example of a display screen that displays images captured by a camera around a point of interest P2. [Diagram 42] FIG. 13 is a diagram showing an example of a display screen of the communication terminal when multiple attention points are selected. [Diagram 43] FIG. 11 is a sequence diagram showing a modified example of a display process of a predetermined area image in the image communication system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. Note that if there is a duplicated portion in the description of the drawings, the description will be omitted.

[0009] [Embodiment] [Image Generation Method] The image generating method will be described with reference to FIGS.

[0010] First, the appearance of the imaging device 10 will be described with reference to Fig. 1. The imaging device 10 is a digital camera for obtaining captured images that are the basis of a full celestial sphere (360°) image. Fig. 1(A) is a left side view of the imaging device, Fig. 1(B) is a front view of the imaging device, and Fig. 1(C) is a plan view of the imaging device.

[0011] As shown in Fig. 1(A), the photographing device 10 is sized so that a person can hold it in one hand. Also, as shown in Figs. 1(A), 1(B), and 1(C), an image sensor 103a is provided on the front side (front side) and an image sensor 103b is provided on the back side (rear side) of the upper part of the photographing device 10. These image sensors (image sensors) 103a and 103b are used in conjunction with optical members (for example, lenses 102a and 102b described later) capable of photographing a hemispherical image (angle of view of 180° or more). Also, as shown in Fig. 1(B), an operation unit 115 such as a shutter button is provided on the surface opposite to the front side of the photographing device 10.

[0012] Next, the usage of the photographing device 10 will be described with reference to Fig. 2. Fig. 2 is an image diagram of the photographing device in use. As shown in Fig. 2, the photographing device 10 is used, for example, by a user holding it in his / her hand to photograph subjects around the user. In this case, two hemispherical images can be obtained by capturing images of subjects around the user using the image sensor 103a and the image sensor 103b shown in Fig. 1, respectively.

[0013] Next, an outline of the processing of an image captured by the image capture device 10 will be described with reference to Fig. 3 and Fig. 4. Fig. 3(A) is a diagram showing a hemispherical image (front side) captured by the image capture device, Fig. 3(B) is a diagram showing a hemispherical image (rear side) captured by the image capture device, and Fig. 3(C) is a diagram showing an image expressed by equirectangular projection (hereinafter referred to as "equirectangular projection image"). Fig. 4(A) is a conceptual diagram showing a state in which a sphere is covered with an equirectangular projection image, and Fig. 4(B) is a diagram showing a celestial sphere image.

[0014] As shown in Fig. 3(A), the image obtained by the image sensor 103a becomes a hemispherical image (front side) curved by the lens 102a described below. Also, as shown in Fig. 3(B), the image obtained by the image sensor 103b becomes a hemispherical image (rear side) curved by the lens 102b described below. Then, the photographing device 10 synthesizes the hemispherical image (front side) and the hemispherical image (rear side) flipped 180 degrees to generate an equirectangular projection image EC as shown in Fig. 3(C).

[0015] Then, the photographing device 10 uses OpenGL ES (Open Graphics Library for Embedded Systems) to paste an equirectangular projection image EC so as to cover the spherical surface as shown in Fig. 4(A) and create a celestial sphere image (celestial sphere panoramic image) CE as shown in Fig. 4(B). In this way, the celestial sphere image CE is expressed as an image in which the equirectangular projection image EC faces the center of the sphere. Note that OpenGL ES is a graphics library used to visualize 2D (2-Dimensions) and 3D (3-Dimensions) data. Also, the celestial sphere image CE may be a still image or a video.

[0016] As described above, the spherical image CE is an image pasted to cover the spherical surface, which gives a sense of incongruity to people when they see it. Therefore, the imaging device 10 can display a predetermined region T (hereinafter, referred to as a "predetermined region image") that is a part of the spherical image CE as a planar image with little curvature, thereby enabling a display that does not give a sense of incongruity to people. This will be described with reference to Figs. 5 to 8.

[0017] FIG. 5 is a diagram showing the positions of the virtual camera and the predetermined area when the image is a three-dimensional sphere. The virtual camera IC corresponds to the position of the viewpoint of a user who views the celestial sphere image CE displayed as a three-dimensional sphere. FIG. 6(A) is a three-dimensional perspective view of FIG. 5, and FIG. 6(B) is a diagram showing a state in which the image of the predetermined area is displayed on the display. FIG. 6(A) shows the celestial sphere image CE shown in FIG. 5 as a three-dimensional sphere CS. If the celestial sphere image CE generated in this way is a celestial sphere CS, as shown in FIG. 5, the virtual camera IC is located inside the celestial sphere image CE. The predetermined area T in the celestial sphere image CE is a shooting area of ​​the virtual camera IC, and is specified by the predetermined area information indicating the shooting direction and the angle of view of the virtual camera IC in the three-dimensional virtual space including the celestial sphere image CE. In addition, the zoom of the predetermined area T can also be expressed by moving the virtual camera IC closer to or farther away from the celestial sphere image CE. The predetermined area image Q is an image of the predetermined area T in the celestial sphere image CE. Therefore, the predetermined area T can be specified by the angle of view α and the distance f from the virtual camera IC to the spherical image CE (see FIG. 7).

[0018] Then, the predetermined area image Q shown in Fig. 6(A) is displayed on a predetermined display as an image of the shooting area of ​​the virtual camera IC as shown in Fig. 6(B). The image shown in Fig. 6(B) is a predetermined area image represented by the initial setting (default) predetermined area information. The following description will be given using the shooting direction (ea, aa) and angle of view (α) of the virtual camera IC. Note that the predetermined area T may be represented by the shooting area (X, Y, Z) of the virtual camera IC, which is the predetermined area T, instead of the angle of view α and the distance f.

[0019] Next, the relationship between the predetermined area information and the image of the predetermined area T will be described with reference to FIG. 7. FIG. 7 is a diagram showing the relationship between the predetermined area information and the image of the predetermined area T. As shown in FIG. 7, "ea" indicates an elevation angle, "aa" indicates an azimuth angle, and "α" indicates an angle of view. That is, the attitude of the virtual camera IC is changed so that the gaze point of the virtual camera IC indicated by the shooting direction (ea, aa) becomes the center point CP(x, y) of the predetermined area T, which is the shooting area of ​​the virtual camera IC. As shown in FIG. 7, the center point CP(x, y) when the diagonal angle of view of the predetermined area T represented by the angle of view α of the virtual camera IC is α becomes the parameter ((x, y)) of the predetermined area information. The predetermined area image Q is an image of the predetermined area T in the omnidirectional image CE. f is the distance from the virtual camera IC to the center point CP(x, y). L is the distance between any vertex of the predetermined area T and the center point CP(x, y) (2L is the diagonal line). In FIG. 7, the trigonometric function shown in the following formula 1 generally holds.

[0020]

number

[0021] The image capturing device 10 described above is an example of an image capturing device capable of capturing a wide-angle image, and a celestial sphere image is an example of a wide-angle image. Here, a wide-angle image is generally an image captured using a wide-angle lens, and is captured with a lens that can capture a wider range than the human eye can sense. Also, it generally means an image captured with a lens with a focal length of 35 mm or less in 35 mm film equivalent.

[0022] FIG. 8 is a diagram showing points in a three-dimensional Euclidean space in spherical coordinates. Here, the position coordinates of the center point CP when expressed in a spherical polar coordinate system are (r, θ, φ). (r, θ, φ) are the radius, polar angle, and azimuth angle, respectively. The radius r is the distance from the origin of the three-dimensional virtual space including the omnidirectional image to the center point CP, and is therefore equal to f. FIG. 8 is a diagram showing these relationships. Hereafter, the explanation will be given using the position coordinates (r, θ, φ) of the virtual camera IC.

[0023] [Image communication system overview] Next, an outline of the configuration of the image communication system of this embodiment will be described with reference to Fig. 9. Fig. 9 is a diagram showing an example of the overall configuration of an image communication system. The image communication system 1 shown in Fig. 9 is a system that allows captured images such as videos distributed from multiple distribution bases to be displayed at multiple viewing bases, thereby allowing a wide range of images (for example, spherical images) captured at the distribution bases to be viewed in real time. Note that in this embodiment, the distribution bases are also referred to as areas.

[0024] As shown in FIG. 9, the image communication system 1 includes an image capture device 10 (10A, 10B; hereinafter referred to as image capture device 10 when no distinction is necessary) and a distribution terminal 30 (30A, 30B; hereinafter referred to as distribution terminal 30 when no distinction is necessary) located at each of a plurality of distribution bases (distribution base A (area A), distribution base B (area B)), a communication management device 50, and a communication terminal 70 (70C, 70D; hereinafter referred to as communication terminal 70 when no distinction is necessary) located at each of a plurality of viewing bases (viewing base A, viewing base B).

[0025] The distribution terminal 30, the communication management device 50, and the communication terminal 70 constituting the image communication system 1 can communicate via a communication network 100. The communication network 100 is constructed by the Internet, a mobile communication network, a LAN (Local Area Network), etc. Note that the communication network 100 may include not only wired communication but also wireless communication networks such as 3G (3rd Generation), 4G (4th Generation), 5G (5th Generation), Wi-Fi (Wireless Fidelity) (registered trademark), WiMAX (Worldwide Interoperability for Microwave Access), or LTE (Long Term Evolution).

[0026] Among these, the photographing device 10 is a special digital camera for photographing a subject, scenery, etc., and obtaining two hemispherical images that are the basis of a celestial sphere image, as described above. The photographed image obtained by the photographing device 10 may be a moving image or a still image, or may be both a moving image and a still image. The photographed image may also include sound together with the image. The distribution terminal 30 distributes the image acquired from the photographing device 10 via a wired cable such as a USB (Universal Serial Bus) cable to the communication terminal 70 via the communication management device 50. Here, the photographing device 10A and the distribution terminal 30A are located at the same base, that is, distribution base A. Meanwhile, the photographing device 10B and the distribution terminal 30B are located at the same base, that is, distribution base B. Note that the number of distribution bases is not limited to two bases, and may be only one base, or may be three or more bases. The connection relationship between the photographing device 10 and the distribution terminal 30 may be a wireless connection using short-range wireless communication or the like, instead of a wired connection using a wired cable.

[0027] The communication management device 50 manages and controls the communication between the distribution terminal 30 and the communication terminal 70, and manages the type of image data being transmitted and received (for example, types of general images and special images). Here, the special images are spherical images. The communication management device 50 is disposed in a service company or the like that provides image communication services. The communication management device 50 has a server function, and in response to a request from the communication terminal 70, provides identification information of the image data (image data ID), the IP address of the photographing device, image type information indicating the type of image data, and the like.

[0028] The communication management device 50 may be constructed by a single computer, or may be constructed by multiple computers in which each unit (function or means) is divided and arbitrarily assigned. In addition, all or part of the functions of the communication management device 50 may be a server computer existing in a cloud environment, or a server computer existing in an on-premise environment.

[0029] The communication terminal 70 is a computer such as a PC used by a user at each viewing location. The communication terminal 70 displays an image (still image or video) distributed from the distribution terminal 30. The communication terminal 70 acquires a spherical image, which is an image captured by the imaging device 10, via the communication network 100. In addition, the communication terminal 70 has OpenGL ES installed, and can create predetermined area information indicating a partial area of ​​the spherical image, or create a predetermined area image from the spherical image transmitted from the distribution terminal 30. Here, the communication terminal 70C is placed at the viewing location A where the user A1 is located, and the communication terminal 70D is placed at the viewing location B where the user B is located.

[0030] 9 are merely examples, and other examples may be used. The communication terminal 70 is not limited to a PC, and may be, for example, a tablet terminal, a smartphone, a wearable terminal, a PJ (Projector), an IWB (Interactive White Board: an electronic whiteboard with a blackboard function that allows intercommunication), an autonomous robot, or the like.

[0031] Here, a distribution base in the image communication system 1 will be briefly described with reference to Fig. 10. Fig. 10 is a diagram for explaining an outline of a distribution base in the image communication system. Fig. 10 shows a plurality of image capture devices 10A and a distribution terminal 30A arranged at a distribution base A, and is an image diagram showing an overview of a state in which a plurality of vehicles are arranged between the plurality of image capture devices 10. Note that Fig. 10 describes an example of distribution base A, but the same applies to other distribution bases such as distribution base B.

[0032] In the distribution site A shown in FIG. 10, a plurality of image capture devices 10A (image capture devices 10A-1 to 10A-8) and a distribution terminal 30A capable of communicating with each of the image capture devices 10A are arranged in a space such as an automobile showroom. The distribution site is not limited to an automobile showroom, and may be an office floor, a school, a factory, a warehouse, a construction site, a server room, or a store, or any other space where a user (viewer) of a viewing site needs to know the situation of a remote site. The image capture devices 10A are arranged at predetermined intervals on pillars or poles of a predetermined height arranged in the showroom. Furthermore, the image capture devices 10A may be arranged at predetermined intervals while being suspended from the ceiling of the showroom. In the distribution site A, the entire distribution site A is captured using the plurality of image capture devices 10A. The distribution terminal 30A receives captured image data from the image capture device 10A and distributes the received captured image data to the communication terminal 70 at the viewing site. The numbers of the photographing devices 10A and the broadcasting terminals 30A arranged at the broadcasting point A are not limited to those illustrated in Fig. 10. That is, as shown at the broadcasting point A in Fig. 9, the relationship between the photographing devices 10A and the broadcasting terminals 30A may be one-to-one. Furthermore, as shown in Fig. 10, the relationship between the photographing devices 10A and the broadcasting terminals 30A may be many-to-one. These relationships are similar at the broadcasting point B.

[0033] Conventionally, in a system in which images captured by a plurality of remotely located image capturing devices can be viewed from a viewing base, when a user wants to see a specific location at a distribution base, the user does not know which image captured by which image capturing device to view. In addition, when users at different viewing bases want to view different locations, operations (e.g., PTZ (pan-tilt-zoom) operations) on the image capturing devices conflict, so that multiple users viewing the same distribution base cannot perform exclusive viewing such as viewing different locations. Furthermore, even when the above-mentioned omnidirectional image is captured by an image capturing device, a process must be performed to individually operate the multiple omnidirectional images to display the desired location, and the user cannot intuitively operate the images. Therefore, the image communication system 1 enables multiple users to simultaneously view different locations at a distribution base by focusing on the images captured by the same image capturing device through intuitive operations on the user's display screen.

[0034] [Hardware configuration of image communication system] Next, the hardware configuration of each device or terminal constituting the image communication system according to the embodiment will be described with reference to Figures 11 and 12. Note that components may be added or deleted from the hardware configurations shown in Figures 11 and 12 as necessary.

[0035] <Hardware configuration of the imaging device> First, the hardware configuration of the imaging device 10 will be described with reference to Fig. 11. Fig. 11 is a diagram showing an example of the hardware configuration of the imaging device. In the following, the imaging device 10 is an omnidirectional (all-directional) imaging device using two imaging elements, but the number of imaging elements may be two or more. In addition, the imaging device does not necessarily have to be a device dedicated to omnidirectional imaging, and an omnidirectional imaging unit may be attached to a normal digital camera, smartphone, or the like to have substantially the same functions as the imaging device 10.

[0036] As shown in FIG. 11, the photographing device 10 is composed of an imaging unit 101, an image processing unit 104, an imaging control unit 105, a microphone 108, a sound processing unit 109, a CPU (Central Processing Unit) 111, a ROM (Read Only Memory) 112, an SRAM (Static Random Access Memory) 113, a DRAM (Dynamic Random Access Memory) 114, an operation unit 115, an input / output I / F 116, a short-range communication circuit 117, an antenna 117a of the short-range communication circuit 117, an electronic compass 118, a gyro sensor 119, an acceleration sensor 120, and a network I / F 121.

[0037] Of these, the imaging unit 101 includes wide-angle lenses (so-called fisheye lenses) 102a and 102b (hereinafter, when there is no need to distinguish between them, they will be referred to as lenses 102) each having an angle of view of 180° or more for forming a hemispherical image, and two imaging elements 103a and 103b provided corresponding to the lenses. The imaging elements 103a and 103b include an image sensor such as a CMOS (Complementary Metal Oxide Semiconductor) sensor or a CCD (Charge Coupled Device) sensor that converts an optical image by the lenses 102a and 102b into image data of an electrical signal and outputs it, a timing generation circuit that generates horizontal or vertical synchronization signals and pixel clocks for the image sensors, and a group of registers in which various commands or parameters required for the operation of the imaging elements are set.

[0038] The imaging elements 103a and 103b of the imaging unit 101 are each connected to the image processing unit 104 via a parallel I / F bus. Meanwhile, the imaging elements 103a and 103b of the imaging unit 101 are each connected to the imaging control unit 105 via a serial I / F bus (such as an I2C bus). The image processing unit 104, the imaging control unit 105, and the sound processing unit 109 are connected to the CPU 111 via a bus 110. In addition, the ROM 112, the SRAM 113, the DRAM 114, the operation unit 115, the input / output I / F 116, the short-range communication circuit 117, the electronic compass 118, the gyro sensor 119, the acceleration sensor 120, and the network I / F 121 are also connected to the bus 110.

[0039] The image processing unit 104 takes in the image data output from the image sensors 103a and 103b via a parallel I / F bus, performs a predetermined processing on each image data, and then synthesizes the image data to create equirectangular projection image data such as that shown in Figure 3(C).

[0040] The imaging control unit 105 generally sets commands and the like in the register groups of the imaging elements 103a and 103b using an I2C bus, with the imaging control unit 105 acting as a master device and the imaging elements 103a and 103b acting as slave devices. Necessary commands and the like are received from the CPU 111. The imaging control unit 105 also uses the I2C bus to retrieve status data and the like from the register groups of the imaging elements 103a and 103b and send it to the CPU 111.

[0041] Furthermore, the imaging control unit 105 instructs the imaging elements 103a and 103b to output image data when the shutter button of the operation unit 115 is pressed (or tapped or otherwise operated, hereinafter simply referred to as "operation"). Some imaging devices 10 have a preview display function or a function corresponding to video display on a display (for example, a display of an external terminal such as a smartphone that performs short-distance communication with the imaging device 10 using the short-distance communication circuit 117). In this case, the image data is output from the imaging elements 103a and 103b continuously at a predetermined frame rate (frames / minute).

[0042] As described later, the imaging control unit 105 also functions as a synchronization control means for synchronizing the output timing of image data from the imaging elements 103a and 103b in cooperation with the CPU 111. In this embodiment, the imaging device 10 is not provided with a display unit, but a display unit may be provided. The microphone 108 converts sound into sound (signal) data. The sound processing unit 109 takes in the sound data output from the microphone 108 through an I / F bus and performs a predetermined process on the sound data.

[0043] The CPU 111 controls the overall operation of the photographing device 10 and executes necessary processing. The ROM 112 stores various programs for the CPU 111. The SRAM 113 and the DRAM 114 are work memories, and store programs executed by the CPU 111, data in the middle of processing, etc. In particular, the DRAM 114 stores image data in the middle of processing by the image processing unit 104, and data of a processed equirectangular projection image.

[0044] The operation unit 115 is a collective term for various operation buttons, a power switch, a shutter button, a touch panel having both display and operation functions, etc. A user operates the operation unit 115 to input various shooting modes, shooting conditions, etc.

[0045] The input / output I / F 116 is a general term for an interface circuit (such as a USB I / F) with an external medium such as an SD card or a personal computer. The input / output I / F 116 may be wireless or wired. The data of the equirectangular projection image stored in the DRAM 114 is recorded on an external medium via the input / output I / F 116, or transmitted to an external terminal (device) via the input / output I / F 116 as necessary.

[0046] The short-range communication circuit 117 communicates with an external terminal (device) by short-range wireless communication technology such as NFC (Near Field Communication), Bluetooth (registered trademark), or Wi-Fi (registered trademark) via an antenna 117a provided in the photographing device 10. The short-range communication circuit 117 can transmit data of the equirectangular projection image to the external terminal (device).

[0047] The electronic compass 118 calculates the direction of the image capturing device 10 from the earth's magnetism and outputs the direction information. This direction information is an example of related information (metadata) according to Exif and is used for image processing such as image correction of the captured image. The related information also includes each data of the image capture date and time and the data capacity of the image data. The gyro sensor 119 is a sensor that detects angle changes (roll angle, pitch angle, yaw angle) accompanying the movement of the image capturing device 10. The angle changes are an example of related information (metadata) according to Exif and are used for image processing such as image correction of the captured image. The acceleration sensor 120 is a sensor that detects acceleration in three axial directions. The image capturing device 10 calculates the attitude (angle with respect to the direction of gravity) of the own device (image capturing device 10) based on the acceleration detected by the acceleration sensor 120. The accuracy of image correction is improved by providing the acceleration sensor 120 in the image capturing device 10. The network I / F 121 is an interface for performing data communication using a communication network 100 such as the Internet via a router or the like.

[0048] <Hardware configuration of distribution terminal> Fig. 12 is a diagram showing an example of the hardware configuration of a distribution terminal. Each hardware component of distribution terminal 30 is indicated by a reference number in the 300 series. Distribution terminal 30 is constructed by a computer, and includes a CPU 301, a ROM 302, a RAM 303, a HD (Hard Disk) 304, a HDD controller 305, a display 306, an external device connection I / F 308, a network I / F 309, a bus line 310, a keyboard 311, a pointing device 312, a DVD-RW (Digital Versatile Disk Rewritable) drive 314, a media I / F 316, an audio input / output I / F 317, a microphone 318, a speaker 319, and a short-distance communication circuit 320, as shown in Fig. 12.

[0049] Among these, the CPU 301 controls the operation of the entire distribution terminal 30. The ROM 302 stores programs such as an IPL used to drive the CPU 301. The RAM 303 is used as a work area for the CPU 301. The HD 304 stores various data such as programs. The HDD controller 305 controls reading or writing of various data from or to the HD 304 under the control of the CPU 301. The display 306 displays various information such as a cursor, a menu, a window, a character, or an image. The display 306 is an example of a display unit. The display 306 may be a touch panel display equipped with an input means. The external device connection I / F 308 is an interface for connecting various external devices. In this case, the external device is, for example, a USB memory or a printer. The network I / F 309 is an interface for data communication using the communication network 100. The bus line 310 is an address bus or a data bus for electrically connecting each component such as the CPU 301 shown in FIG. 12.

[0050] The keyboard 311 is a type of input means having a plurality of keys for inputting characters, numbers, various instructions, etc. The pointing device 312 is a type of input means for selecting or executing various instructions, selecting a processing target, moving a cursor, etc. The input means may be not only the keyboard 311 and the pointing device 312, but also a touch panel or a voice input device, etc. The DVD-RW drive 314 controls reading or writing of various data from a DVD-RW 313 as an example of a removable recording medium. The DVD-RW is not limited to a DVD-RW, and may be a DVD-R or a Blu-ray (registered trademark) Disc, etc. The media I / F 316 controls reading or writing (storing) of data from a recording medium 315 such as a flash memory. The microphone 318 is a type of built-in sound collecting means for inputting sound. The sound input / output I / F 317 is a circuit for processing input / output of sound signals between the microphone 318 and the speaker 319 under the control of the CPU 301. The short-range communication circuit 320 is a communication circuit for communicating with an external terminal (device) by short-range wireless communication technology such as NFC, Bluetooth, or Wi-Fi.

[0051] <Hardware configuration of communication management device> Fig. 12 is a diagram showing an example of the hardware configuration of the communication management device. Each piece of hardware configuration of the communication management device 50 is indicated by a reference number in the 500 range in parentheses. The communication management device 50 is constructed by a computer, and as shown in Fig. 12, has the same configuration as the distribution terminal 30, so a description of each piece of hardware configuration will be omitted.

[0052] <Hardware configuration of communication terminal> Fig. 12 is a diagram showing an example of the hardware configuration of a communication terminal. Each piece of hardware configuration of the communication terminal 70 is indicated by a reference number in the 700 range in parentheses. The communication terminal 70 is constructed by a computer, and as shown in Fig. 12, has the same configuration as the distribution terminal 30, so a description of each piece of hardware configuration will be omitted.

[0053] Each of the above programs may be recorded in a computer-readable recording medium as an installable or executable file and distributed. Examples of the recording medium include a CD-R (Compact Disc Recordable), a DVD (Digital Versatile Disk), a Blu-ray Disc, an SD card, and a USB memory. The recording medium may be provided domestically or internationally as a program product. For example, the communication management device 50 realizes the communication management method according to the present invention by executing the program according to the present invention.

[0054] [Functional configuration of image communication system] Next, the functional configuration of the image communication system according to the embodiment will be described with reference to Fig. 13 to Fig. 20. Fig. 13 and Fig. 14 are diagrams showing an example of the functional configuration of the image communication system. Fig. 13 and Fig. 14 show devices or terminals shown in Fig. 9 that are related to the processing or operation described below.

[0055] <Functional configuration of the imaging device> First, the functional configuration of the photographing device 10 will be described with reference to Fig. 13. The photographing device 10 has a communication unit 11, a reception unit 12, an imaging unit 13, a sound collection unit 14, and a storage / readout unit 19. Each of these units is a function or means realized by operating any of the components shown in Fig. 11 by an instruction from the CPU 111 according to a program for the photographing device that is expanded from the SRAM 113 onto the DRAM 114. The photographing device 10 also has a storage unit 1000 constructed by the ROM 112, SRAM 113, and DRAM 114 shown in Fig. 11. The storage unit 1000 stores a GUID (Globally Unique Identifier) ​​of the own device.

[0056] The communication unit 11 is mainly realized by the processing of the CPU 111, and communicates various data or information with other devices or terminals. The communication unit 11 performs data communication with other devices or terminals by short-range wireless communication technology, for example, using a short-range communication circuit 117. The communication unit 11 also performs data communication with other devices or terminals via various cables, for example, using an input / output I / F 116. Furthermore, the communication unit 11 performs data communication with other devices or terminals via a communication network 100, using a network I / F 121.

[0057] The reception unit 12 is mainly realized by the processing of the CPU 111 on the operation unit 115, and receives various selections or inputs from the user. The imaging unit 13 is mainly realized by the processing of the CPU 111 on the imaging unit 101, the image processing unit 104, and the imaging control unit 105, and captures an image of a subject such as a landscape, and acquires captured image data. The sound collection unit 14 is mainly realized by the processing of the CPU 111 on the microphone 108 and the sound processing unit 109, and collects sounds around the imaging device 10.

[0058] The storage / reading unit 19 is realized mainly by the processing of the CPU 111 , and stores various data (or information) in the storage unit 1000 and reads various data (or information) from the storage unit 1000 .

[0059] <Functional configuration of distribution terminal> Next, the functional configuration of the distribution terminal 30 will be described with reference to Fig. 13. The distribution terminal 30 has a transmission / reception unit 31, a reception unit 32, an image / sound processing unit 33, a display control unit 34, a determination unit 35, a creation unit 36, a communication unit 37, and a storage / readout unit 39. Each of these units is a function or means realized by operating any of the components shown in Fig. 12 by an instruction from the CPU 301 according to the program for the distribution terminal loaded from the HD 304 onto the RAM 303. The distribution terminal 30 also has a storage unit 3000 constructed by the ROM 302, RAM 303, and HD 304 shown in Fig. 12.

[0060] The transmission / reception unit 31 is realized mainly by the processing of the CPU 301 for the network I / F 309, and transmits and receives various data or information to and from other devices or terminals via the communication network 100.

[0061] The reception unit 32 is realized mainly by the processing of the CPU 301 on the keyboard 311 or the pointing device 312, and receives various selections or inputs from the user.

[0062] The image / sound processing unit 33 is mainly realized by the processing of the CPU 301, and performs image processing on the captured image data acquired by the photographing device 10 by capturing an image of a subject. In addition, the image / sound processing unit 33 performs audio processing on the audio data related to the audio signal after the user's voice is converted into an audio signal by the microphone 318. For example, the image / sound processing unit 33 performs image processing on the captured image data received from the photographing device 10 based on image type information such as a source name so that the display control unit 34 displays an image on the display 306. Specifically, when the image type information indicates that the image is a special image, the image / sound processing unit 33 creates the celestial sphere image data by converting the captured image data (for example, data of each hemispherical image as shown in Fig. 3(A) and (B)) into celestial sphere image data as shown in Fig. 4(B). Furthermore, the image / sound processing unit 33 outputs an audio signal related to the audio data distributed from another terminal via the communication management device 50 to the speaker 319, and causes the speaker 319 to output the audio.

[0063] The display control unit 34 is mainly realized by the processing of the CPU 301, and displays various images, characters, etc. on the display 306. The determination unit 35 is realized by the processing of the CPU 301, and performs various determinations. The determination unit 35 determines, for example, the image type related to the captured image data received from the imaging device 10.

[0064] The creation unit 36 ​​is mainly realized by the processing of the CPU 301, and creates a source name, which is an example of image type information, in accordance with a naming rule based on the result of the determination by the determination unit 35 of whether the image is a general image or a special image (here, a spherical image). For example, if the determination unit 35 determines that the image is a general image, the creation unit 36 ​​creates a source name "Video" indicating that it is a general image. On the other hand, if the determination unit 35 determines that the image is a special image, the creation unit 36 ​​creates a source name "Video_Omni" indicating that it is a special image.

[0065] The communication unit 37 is mainly realized by processing of the CPU 301 for the short-range communication circuit 320, and communicates with the communication unit 11 of the photographing device 10 using a short-range wireless communication technology such as NFC, Bluetooth, or WiFi. Note that although the communication unit 37 and the transmission / reception unit 31 have been described as having separate communication units, they may be configured to share a common communication unit.

[0066] The storage / reading unit 39 is realized mainly by the processing of the CPU 301 , and stores various data (or information) in the storage unit 3000 and reads various data (or information) from the storage unit 3000 .

[0067] (Radiation device management table) Fig. 15(A) is a conceptual diagram showing an example of a photographing device management table. A photographing device management DB 3001 configured by the photographing device management table shown in Fig. 15(A) is constructed in the storage unit 3000. In this photographing device management table, the vendor ID and product ID of the GUID of the photographing device capable of obtaining two hemispherical images that are the basis of the omnidirectional image are stored and managed. As the GUID, for example, a vendor ID (VID) and a product ID (PID) used in a USB device can be used. The vendor ID and the product ID may be stored, for example, at the time of shipment from the factory of the distribution terminal 30, or may be additionally stored after shipment from the factory.

[0068] (Image type management table) FIG. 15B is a conceptual diagram showing an example of an image type management table. In the storage unit 3000, an image type management DB 3002 configured by the image type management table shown in FIG. 15B is constructed. In this image type management table, an IP (Internet Protocol) address of a photographing device, which is an example of a destination of the photographing device, and a source name (image type information) are managed in association with each image data ID. Among them, the image data ID is an example of image data identification information for identifying image data when performing image distribution. The IP address of the photographing device indicates the IP address of the photographing device 10 that photographed the image data indicated by the associated image data ID. The source name is a name for identifying the photographing device 10 that photographed the image data indicated by the associated image data ID, and is an example of image type information. This source name is a name created by the distribution terminal 30 according to a predetermined naming rule.

[0069] For example, four image capture devices, whose IP addresses are "2.1.2.3", "2.1.1.5", "2.1.5.4", and "2.1.5.6", respectively, are transmitting image data indicated by image data IDs "RS001", "RS002", "RS003", and "RS004". Furthermore, the types of images indicated by the source names of the image capture devices are "Video_Omni", "Video_Omni", "Video", and "Video", which indicate that the image types of the captured images are "special image", "special image", "general image", and "general image", respectively. In this embodiment, the special image is a spherical image. Note that the IP address is an example of destination information, and the destination information may be a MAC (Media Access Control) address or a terminal ID (Identification), etc. Furthermore, the IP address is represented by simplifying the IPv4 address, but the IP address may be an IPv6 address. Furthermore, data other than image data may also be managed in association with the image data ID. Data other than image data may be, for example, sound data, material data when sharing a screen between a distribution base and a viewing base, etc.

[0070] <Functional configuration of the communication management device> Next, the functional configuration of the communication management device 50 will be described with reference to Fig. 14. The communication management device 50 has a transmission / reception unit 51, a selection unit 53, a determination unit 55, a generation unit 56, a distribution base management unit 57, and a storage / readout unit 59. Each of these units is a function or means realized by operating any of the components shown in Fig. 12 by an instruction from the CPU 501 in accordance with the program for the communication management device expanded from the HD 504 onto the RAM 503. The communication management device 50 also has a storage unit 5000 constructed by the ROM 502, RAM 503, and HD 504 shown in Fig. 12.

[0071] The transmission / reception unit 51 is realized mainly by the processing of the CPU 501 for the network I / F 509, and transmits and receives various data or information to and from other devices via the communication network 100.

[0072] The selection unit 53 is mainly realized by the processing of the CPU 501, and selects a specific image capture device 10 from the multiple image capture devices 10. The selection unit 53 selects a specific image capture device 10 from the multiple image capture devices 10, for example, based on each coordinate value indicating a plurality of attention points Pn (n is a natural number of 2 or more; hereinafter, simply referred to as "multiple attention points Pn") accepted by the communication terminal 70, and arrangement position information (coordinate value) indicating the arrangement positions of the multiple image capture devices 10. In this embodiment, the attention point Pn indicates each designated position in the area where the multiple image capture devices are arranged. In other words, the attention point indicates the designated position. In this embodiment, the selection unit 53 functions or has a means that functions as an example of a selection means. In this embodiment, the coordinate value is also called coordinate information.

[0073] The determination unit 55 is mainly realized by the processing of the CPU 501, and performs various determinations. The selection unit 53 is mainly realized by the processing of the CPU 501, and selects the image capturing device 10 in response to a request from the communication terminal 70. In this embodiment, the determination unit 55 functions or has a means for functioning as an example of a determination means.

[0074] The generating unit 56 is mainly realized by the processing of the CPU 501, and generates image data ID and predetermined area information. The generating unit 56 generates, for example, predetermined area information indicating a predetermined area (for example, a predetermined area T shown in FIG. 5, etc.) in a captured image captured by the capturing device 10 selected by the selecting unit 53. Note that an image in which the entire captured image is displayed (for example, a celestial sphere image CE shown in FIG. 5, etc.) is also referred to as an "entire image." In addition, in this embodiment, the generating unit 56 functions or has a means that functions as an example of a generating means. Specifically, the generating unit 56 generates identification information of the capturing device 10 closest to each of the multiple attention points Pn, each designated position coordinate information (coordinate value) indicating the coordinates of each of the attention points, and each predetermined area information indicating each predetermined area for viewing each designated position from the front. Note that the generating unit 56 generates identification information of each of the capturing devices 10 closest to each attention point P from a plurality of divided areas obtained by dividing the area in which the multiple capturing devices 10 are arranged by a predetermined number of each of the multiple attention points Pn. Furthermore, the generating unit 56 calculates predetermined area information for viewing the direction of a predetermined attention point among the multiple attention points Pn designated by the user in the front (center) in association with the coordinate value of the attention point P.

[0075] The distribution base management unit 57 is mainly realized by the processing of the CPU 501, and manages distribution base information indicating the status of the distribution base.

[0076] The storage / reading unit 59 is realized mainly by the processing of the CPU 501 , and stores various data (or information) in the storage unit 5000 and reads various data (or information) from the storage unit 5000 .

[0077] (Session management table) FIG. 16(A) is a conceptual diagram showing an example of a session management table. A session management DB 5001 configured by the session management table shown in FIG. 16(A) is constructed in the storage unit 5000. In this session management table, a base ID and an IP address of a participating communication terminal are associated and managed for each session ID. Among them, the session ID is an example of session identification information for identifying a communication session that realizes image communication, and is generated for each virtual floor. The session ID is also managed by each communication terminal, and is used when selecting a communication session in each communication terminal. The base ID is an example of base identification information for identifying a distribution base. The IP address of the participating communication terminal indicates the IP address of the communication terminal that has participated in the virtual floor indicated by the associated session ID.

[0078] (Image type management table) FIG. 16(B) is a conceptual diagram showing an example of an image type management table. In the storage unit 5000, an image type management DB 5002 configured by the image type management table shown in FIG. 16(B) is constructed. In this image type management table, in addition to each piece of information managed in the image type management table shown in FIG. 15(B), a session ID that is the same as the session ID managed in the session management table is managed in association with each other. Note that the communication management device 5 manages the same image data ID, the IP address of the photographing device, and the image type information managed in the distribution terminal 30 and the communication terminal 70 in order to transmit image type information, etc. to a communication terminal already in an image call and a newly participating communication terminal when a new communication terminal enters the virtual floor, etc. This eliminates the need to transmit and receive image type information, etc. between a communication terminal already in a call and a newly participating communication terminal.

[0079] (Prescribed area management table) Fig. 17 is a conceptual diagram showing an example of a predetermined area management table. A predetermined area management DB 5003 configured by the predetermined area management table shown in Fig. 17 is constructed in the storage unit 5000. In this predetermined area management table, for each IP address of the photographing device (image transmission source), the attention point coordinate value (x, y, z) indicating the position of the attention point, the IP address of the communication terminal to which the photographed image data is transmitted, and predetermined area information indicating the parameters of the predetermined area image being displayed on the communication terminal to which the photographed image data is transmitted are associated and managed. As shown in Figs. 6 and 7, the predetermined area information is a conversion parameter for converting the photographed image into an image of the predetermined area T in the photographed image (predetermined area image).

[0080] For example, the first row of the specified area management table in Figure 17 manages that when the IP address of the camera device 10 is "2.1.2.3", after the distribution terminal 30 receives the photographed image data captured by the camera device 10, the photographed image data sent from the distribution terminal 30 is sent via the communication management device 50 to the communication terminal 70 with the IP address "1.2.1.3".

[0081] In addition, when the transmission / reception unit 51 receives new specified area information that includes the same set of IP addresses as the IP address of the shooting device that is the source of the captured image data that is already managed and the IP address of the communication terminal to which the captured image data is to be sent, the storage / reading unit 59 overwrites the specified area information already managed with the newly received specified area information.

[0082] (Layout information management table) FIG. 18 is a conceptual diagram showing an example of a placement information management table. A placement information management DB 5004 configured by the placement information management table shown in FIG. 18 is constructed in the storage unit 5000. In this placement information management table, for each base ID for identifying a distribution base, the IP address of the camera device 10 placed at the distribution base, the coordinate value indicating the position where the camera device 10 is placed, and the placement direction of the camera device 10 are associated and managed. Among these, the coordinate value indicates the coordinate value on the map of the distribution base where the camera device 10 is placed. Also, the placement direction of the camera device 10 indicates the direction (angle) on the map to which the front of the camera device 10 faces. Note that this placement information is set to any direction (angle) by the administrator of the distribution base or the distribution terminal 30.

[0083] (Distribution location management table) FIG. 19 is a conceptual diagram showing an example of a distribution base management table. In the storage unit 5000, a distribution base management DB 5005 configured by the distribution base management table shown in FIG. 19 is constructed. In this distribution base management table, distribution base information indicating a base name and a status of the distribution base is managed in association with each base ID for identifying a distribution base. Among them, the distribution base information includes a URL (Uniform Resource Locator) for accessing map image data indicating a map of the distribution base and base coordinate information (coordinate value) indicating the coordinate value of the distribution base. The communication terminal 70 can obtain the map image data and base coordinate information of the distribution base by accessing the URL transmitted from the communication management device 50. The URL is an example of storage destination information. The storage destination information is not limited to a URL, and may be a URI (Uniform Resource Identifier) ​​or the like.

[0084] <Functional configuration of communication terminal> Next, the functional configuration of the communication terminal 70 will be described with reference to Fig. 14. The communication terminal 70 has a transmission / reception unit (acquisition unit) 71, a reception unit 72, an image / sound processing unit 73, a display control unit 74, a judgment unit 75, a creation unit 76, a focus point identification unit 77, a selection unit 81, a generation unit 82, and a storage / readout unit 79. Each of these units is a function or means realized by operating any of the components shown in Fig. 12 by an instruction from the CPU 701 according to the program for the communication terminal expanded from the HD 704 onto the RAM 703. The communication terminal 70 also has a storage unit 7000 constructed by the ROM 702, RAM 703, and HD 704 shown in Fig. 12.

[0085] The transmitting / receiving unit (acquisition unit) 71 is mainly realized by processing of the CPU 701 on the network I / F 709, and transmits and receives various data or information to and from other devices or terminals via the communication network 100. For example, the transmitting / receiving unit (acquisition unit) 71 receives photographed image data distributed from the distribution terminal 30 via the communication management device 50. The transmitting / receiving unit (acquisition unit) 71 also functions as an acquisition unit, for example, and acquires identification information of a shared photographing device that can share each image of any two attention points out of each coordinate information (each designated position information of the attention points Pn) of a plurality of attention points Pn, and each predetermined area information of the shared photographing device that indicates each predetermined area for viewing each of the two attention points from the front.

[0086] The reception unit 72 is mainly realized by the processing of the CPU 701 on the keyboard 711 or the pointing device 712, and receives various selections or inputs from the user. The reception unit 72 receives, for example, input of a plurality of attention points Pn at a distribution base designated by the user. In this embodiment, the reception unit 72 functions or has a means that functions as an example of a reception means.

[0087] The image / sound processing unit 73 is mainly realized by the processing of the CPU 701, and performs image processing on the captured image data distributed from the distribution terminal 30. In addition, the image / sound processing unit 73 performs audio processing on the audio data distributed from the distribution terminal 30. For example, in order to display an image of a predetermined area corresponding to the predetermined area information received by the transmission / reception unit (acquisition unit) 71 on the display 706, the image / sound processing unit 73 performs perspective projection transformation using the predetermined area information on the captured image (omnidirectional image) to generate a predetermined area image corresponding to the predetermined area information. Furthermore, the image / sound processing unit 73 outputs an audio signal related to the audio data distributed from the distribution terminal 30 via the communication management device 50 to the speaker 719, and causes the speaker 719 to output audio.

[0088] The display control unit 74 is mainly realized by the processing of the CPU 701, and causes various images, characters, etc. to be displayed on the display 706. The display control unit 74 causes the display 706 to display, for example, a predetermined area image generated by the image / sound processing unit 73.

[0089] The determination unit 75 performs various determinations and is realized by processing of the CPU 701. In this embodiment, the display control unit 74 functions as an example of a display control unit or has a unit that functions as such.

[0090] The creation unit 76 is mainly realized by the processing of the CPU 701, and realizes the same function as the creation unit 36. The attention point identification unit 77 is mainly realized by the processing of the CPU 701, and identifies an attention point P at a distribution base where the image capturing device 10 is installed. The attention point identification unit 77 identifies, for example, coordinate information of each of a plurality of attention points Pn on a map image of the distribution base designated by the user.

[0091] The selection unit 81 is mainly realized by the processing of the CPU 701, and realizes the same function as the selection unit 53. The generation unit 82 is mainly realized by the processing of the CPU 701, and generates predetermined area information. For example, the generation unit 82 generates predetermined area information indicating a predetermined area in a captured image captured by the image capture device 10 selected by the selection unit 81. The generation unit 82 also functions as, for example, an acquisition unit, and acquires predetermined area information indicating a predetermined area including a point of interest P in an image captured by a specific image capture device 10 selected based on the coordinate information of the multiple points of interest Pn accepted by the acceptance unit 72 and the arrangement position of the image capture device 10.

[0092] The storage / reading unit 79 is realized mainly by the processing of the CPU 701 , and stores various data (or information) in the storage unit 7000 and reads various data (or information) from the storage unit 7000 .

[0093] Image type management table Fig. 20(A) is a conceptual diagram showing an example of an image type management table. An image type management DB 7001 configured by the image type management table shown in Fig. 20(A) is constructed in the storage unit 7000. This image type management table has the same data configuration as the image type management table shown in Fig. 15(B), so a description thereof will be omitted.

[0094] Predetermined area management table Fig. 20(B) is a conceptual diagram showing an example of a predetermined area management table. A predetermined area management DB 7002 configured by the predetermined area management table shown in Fig. 20(B) is constructed in the storage unit 7000. In this predetermined area management table, for each IP address of the photographing device that photographed the photographed image data, the attention point coordinate values ​​(x, y, z) indicating the position of the attention point and the predetermined area information indicating the predetermined area image being displayed are managed in association with each other. As shown in Figs. 6 and 7, the predetermined area information is a conversion parameter for converting the photographed image into an image of the predetermined area T in the photographed image (predetermined area image).

[0095] Next, the relationship between the attention point P and the image capturing devices when a plurality of image capturing devices 10 are arranged at the distribution base A will be described with reference to FIGS.

[0096] <When two points of interest P are set> FIG. 21 is a diagram for explaining an example of the relationship between the attention point P and the photographing device when two attention points P are set. For example, in a distribution base A (area A) such as a showroom in the image communication system 1 shown in FIG. 10, a plurality of photographing devices 10A are regularly arranged in a grid as shown in FIG. 21. This arrangement state is generated as a two-dimensional arrangement image (map image) by the generating unit 56 based on the coordinate values ​​of each photographing device 10. At this time, a user who uses the communication terminal 70 can operate the "attention point" button 860 by referring to a tour image 830 corresponding to the two-dimensional arrangement image displayed on the base display screen 820 on the display 706 of the communication terminal 70. FIG. 21 shows a state in which attention points P1 and P2 are set at the distribution base. Note that attention points P1 and P2 are examples of a plurality of designated positions.

[0097] <Selection process of imaging device around the attention point P1> FIG. 22 is a diagram for roughly explaining an example of the installation direction and azimuth angle of each image capturing device around the attention point P1. As shown in the example of FIG. 22, the selection unit 53 of the communication management device 50 divides the area of ​​the distribution base into four parts as shown by dotted lines, with the attention point P1 given by a black circle (●) on the two-dimensional layout image (map image) generated in the communication management device 50 as the center (boundary). The four divided areas are areas 1-1, 1-2, 1-3, and 1-4 clockwise from the top left of the two-dimensional layout image. At this time, the selection unit 53 selects the image capturing devices 10A-1-1, 10A-1-2, 10A-1-3, and 10A-1-4 that are arranged at the positions closest to the attention point P1 from each area. At this time, the selection unit 53 can use well-known techniques, for example a formula for calculating the distance between two points, to select the photographing devices 10A-1-1, 10A-1-2, 10A-1-3, and 10A-1-4 that are located closest to the point of interest P1 from each area.

[0098] <Selection process of imaging device around the attention point P2> FIG. 23 is a diagram for roughly explaining an example of the installation direction and azimuth angle of each image capturing device around the attention point P2. Similarly, in the case of FIG. 23, the image capturing devices 10A-2-1, 10A-2-2, 10A-2-3, and 10A-2-4 arranged at the position closest to the attention point P2 can be selected by the method shown in the example of FIG. 22. As shown in the example of FIG. 23, the selection unit 53 of the communication management device 50 divides the area of ​​the distribution base into four parts as shown by the dashed lines, with the attention point P2 given by a black circle (●) on the two-dimensional arrangement image (map image) generated in the communication management device 50 as the center (boundary). The four divided areas are areas 2-1, 2-2, 2-3, and 2-4 clockwise from the top left of the two-dimensional arrangement image. At this time, the selection unit 53 selects the image capturing devices 10A-2-1, 10A-2-2, 10A-2-3, and 10A-2-4 that are located closest to the attention point P2 from each area, in the same manner as in the case of the attention point P1.

[0099] <When three points of interest P are set> FIG. 24 is a diagram for explaining an example of the relationship between the attention point P and the image capturing device when three attention points P are set. In the case of FIG. 24, the image capturing devices 10A-3-1, 10A-3-2, 10A-3-3, and 10A-3-4 arranged at the position closest to the attention point P3 can be selected in the same manner as in the examples of FIG. 22 and FIG. 23. As shown in the example of FIG. 24, the selection unit 53 of the communication management device 50 divides the area of ​​the distribution base into four parts as shown by dotted lines finer than those in the case of the attention point P1, with the attention point P3 given by a black circle (●) on the two-dimensional arrangement image (map image) generated in the communication management device 50 as the center (boundary). The four divided areas are areas 3-1, 3-2, 3-3, and 3-4 clockwise from the top left of the two-dimensional arrangement image. At this time, the selection unit 53 selects the image capture devices 10A-3-1, 10A-3-2, 10A-3-3 and 10A-3-4 that are located closest to the attention point P3 from each area, in the same manner as in the cases of the attention points P1 and P2.

[0100] On the other hand, Fig. 25 is a diagram for roughly explaining an example of the relationship between the camera devices arranged at irregular positions and each attention point. As shown in Fig. 25, the camera devices 10 arranged at the distribution base A may be arranged at irregular positions relative to each other, and the selection unit 53 can select the camera device arranged at the position closest to each attention point as described in Figs. 21 to 24.

[0101] [Processing or Operation of the Embodiment] <Session Join Processing> Next, the process or operation of the image communication system according to the embodiment will be described with reference to Fig. 26 to Fig. 42. In the following description, an example will be described in which an image captured at distribution point A is distributed to the communication terminal 70, but similar processes are performed in image distribution from other distribution points such as distribution point B. First, a process of joining a specific communication session will be described with reference to Figs. 26 and 27. Fig. 26 is a sequence diagram showing an example of a process of joining a specific communication session in the image communication system. Fig. 27 is a diagram showing an example of a selection screen for a communication session.

[0102] First, a user at the viewing location A (e.g., user A1) performs an operation to display a selection screen for a communication session, and the reception unit 72 receives the operation to display the selection screen, whereby the display control unit 74 of the communication terminal 70C displays the selection screen 800 shown in Fig. 27 on the display 706 (step S11). The selection screen 800 shown in Fig. 27 displays selection buttons 810a, 810b, 810c, etc., which indicate each of the floors A1, B1, B2, etc., to be selected. Each selection button 810a, etc. is associated with a session ID.

[0103] Here, when user A1 selects the desired selection button (here, selection button 810a) of the virtual floor that is the distribution base, the reception unit 72 accepts the selection of the communication session (step S12). Then, the transmission / reception unit (acquisition unit) 71 transmits a participation request to the communication management device 50 for the communication session with the distribution base (step S13). As a result, the transmission / reception unit 51 of the communication management device 50 receives the participation request. This participation request includes a session ID indicating the communication session whose selection was accepted in step S12, and the IP address of the communication terminal 70C that is the request source terminal.

[0104] Next, the storage / read unit 59 of the communication management device 50 performs a process of participating in the communication session by adding the IP address received in step S13 to the participation terminal IP address field of the record of the same session ID as the session ID received in step S13 in the session management table (session management DB 5001, see FIG. 16(A)) (step S14). Also, the storage / read unit 59 reads out the base ID associated with the session ID of the communication session for which the participation process has been performed in the session management DB 5001. Next, the storage / read unit 59 searches the distribution base management table (distribution base management DB 5005, see FIG. 19) using the base ID read out in step S14 as a search key, thereby reading out distribution base information associated with the same base ID as the read out base ID (step S15). Then, the transmission / reception unit 51 transmits a participation request response to the communication terminal 70C (step S16). As a result, the transmission / reception unit (acquisition unit) 71 of the communication terminal 70C receives the participation request response. This participation request response includes the session ID received in step S13, the distribution base information read in step S15, and the participation processing result. The participation processing result also includes the base ID read in step S14. The following describes a case where the participation processing is successful. Note that the communication terminal 70D at the viewing base B performs the communication session participation processing by the same processing as that shown in Fig. 26.

[0105] <Image type information management process> Next, the management processing of image type information will be described with reference to Fig. 28. Fig. 28 is a sequence diagram showing the management processing of image type information in the image communication system.

[0106] First, when a user at the distribution site A connects the photographing device 10A to the distribution terminal 30A, the storage / readout unit 19 of the photographing device 10A reads out the GUID of its own device (the photographing device 10A) stored in the storage unit 1000. Then, the communication unit 11 of the photographing device 10A transmits the GUID of its own device to the distribution terminal 30A (step S31). As a result, the communication unit 37 of the distribution terminal 30A receives the GUID of the photographing device 10A.

[0107] Next, the determination unit 35 of the distribution terminal 30A determines whether the same vendor ID and product ID as the vendor ID and product ID in the GUID received in step S31 are managed in the photographing device management table (photographing device management DB3001, see FIG. 15(A)), thereby determining the image type (step S32). Specifically, if the same vendor ID and product ID are managed in the photographing device management DB3001, the determination unit 35 determines that the photographing device 10A is a photographing device that captures special images (here, spherical images). On the other hand, if the same vendor ID and product ID are not managed in the photographing device management table (photographing device management DB3001, see FIG. 15(A)), the determination unit 35 determines that the photographing device 10A is a photographing device that captures general images.

[0108] Next, the storage / reading unit 39 stores the IP address of the photographing device 10A in an image type management table (image type management DB3002, see FIG. 15(B)) in association with the image type information determined in step S32 (step S33). In this state, no image data ID is associated. The image type information is, for example, a source name or image type (general image, special image) determined according to a predetermined naming rule.

[0109] Next, the transmitting / receiving unit 31 transmits a request to add image type information to the communication management device 50 (step S34). This request to add image type information includes the IP address of the imaging device 10A, the location ID of the distribution location A, and the image type information stored in step S33. As a result, the transmitting / receiving unit 51 of the communication management device 50 receives the request to add image type information.

[0110] Next, the memory / read unit 59 of the communication management device 50 searches the session management table (session management DB 5001, see FIG. 16(A)) using the location ID received in step S34 as a search key, and reads out the corresponding session ID (step S35).

[0111] Next, the generating unit 56 generates a unique image data ID (step S36). Then, the storing / reading unit 59 stores the session ID read out in step S35, the image data ID generated in step S36, and the IP address and image type information of the photographing device 10A received in step S34 in association with each other as a new record in the image type management table (image type management DB 5002, see FIG. 16(B)) (step S37). Then, the transmitting / receiving unit 51 transmits the image data ID generated in step S36 to the distribution terminal 30A (step S38). As a result, the transmitting / receiving unit 31 of the distribution terminal 30A receives the image data ID.

[0112] Next, the memory / read unit 39 of the distribution terminal 30A stores the image data ID received in step S38 in an image type management table (image type management DB3002, see FIG. 15(B)) in association with the IP address and image type information of the photographing device 10A stored in step S33 (step S39).

[0113] Meanwhile, the transmitting / receiving unit 51 of the communication management device 50 transmits an addition notification of the image type information to the communication terminal 70C (step S40). As a result, the transmitting / receiving unit (acquisition unit) 71 of the communication terminal 70C receives the addition notification of the image type information. This addition notification of the image type information includes the image data ID generated in step S36, and the IP address and image type information of the imaging device 10A stored in step S37.

[0114] Next, storage / readout unit 79 of communications terminal 70C associates and stores the image data ID, IP address of photographing device 10A, and image type information received in step S40 as a new record in an image type management table (image type management DB 7001, see FIG. 20(A)) (step S41). As described above, distribution terminal 30A and communications terminal 70C can share the same information in image type management DB 3002 and image type management DB 7001. Similarly, an additional communication of image type information is transmitted to another communications terminal, communications terminal 70D, and communications terminal 70D also stores the image type information in its image type management DB 7001.

[0115] <Communication processing of captured image data> Next, a process in which photographed image data and sound data obtained at the distribution base A are transmitted to each communication terminal (communication terminals 70C, 70D) via the communication management device 50 will be described with reference to Fig. 29. Fig. 29 is a sequence diagram showing an example of communication processing of photographed image data and sound data in an image communication system. Note that Fig. 29 shows an example in which photographed image data obtained by one photographing device 10 is distributed to each communication terminal 70, but the same process is also performed in the case where multiple photographed image data obtained by other photographing devices 10 arranged at the distribution base are distributed.

[0116] First, the communication unit 11 of the photographing device 10A transmits photographed image data obtained by photographing a subject, scenery, or the like, and sound data obtained by collecting sound to the distribution terminal 30A (step S51). As a result, the communication unit 37 of the distribution terminal 30A receives the photographed image data and sound data. In this case, since the photographing device 10A is a device that can obtain two hemispherical images that are the basis of a celestial sphere image, the photographed image data is composed of data of two hemispherical images, as shown in Figs. 3(A) and (B).

[0117] Next, the transmitting / receiving unit 31 of the distribution terminal 30A transmits the photographed image data and sound data sent from the photographing device 10A to the communication management device 50 (step S52). As a result, the transmitting / receiving unit 51 of the communication management device 50 receives the photographed image data, sound data, and image data ID. This transmission and reception includes an image data ID for identifying the photographed image data to be transmitted and received.

[0118] Next, the transmitting / receiving unit 51 of the communication management device 50 transmits the captured image data and the sound data to the communication terminals (communication terminals 70C, 70D) participating in the same session as the distribution terminal 30A (steps S53, S54). As a result, the transmitting / receiving units (acquisition units) 71 of the communication terminals 70C and 70D receive the captured image data and the sound data, respectively. Each of these transmissions and receptions includes an image data ID for identifying the captured image data to be transmitted and received.

[0119] <Display process of attention point P> Next, a process of displaying images of a plurality of attention points Pn at a distribution base designated by a user at a viewing base will be described with reference to Fig. 30 to Fig. 42. Fig. 30 is a sequence diagram showing an example of a display process of attention point P in an image communication system. Fig. 30 describes an example in which a communication terminal 70C at a viewing base A displays a captured image distributed from a distribution terminal 30A. Note that a similar process is performed when a captured image is displayed on a communication terminal 70D at another viewing base, viewing base B.

[0120] First, the display control unit 74 of the communication terminal 70C uses the distribution base information received in step S16 to display a base display screen 820 showing the status of the distribution base A on the display 706 (step S71). Fig. 33 is a diagram showing an example of a focus point designation screen displayed on the communication terminal. The base display screen 820 shown in Fig. 33 displays a tour image 830 showing the status of the distribution base.

[0121] A base display screen 820 shown in FIG. 33 includes a tour image 830 that allows the user to remotely view the distribution base by viewing a panoramic image of the distribution base, a viewpoint change icon 850 for changing the viewpoint to a specified shooting point of the tour image 830, a cross (or a star or the like) 855 indicating a point of interest P, a “point of interest” button 860 operated to display the point of interest P within the distribution base, an “OK” button 870 operated to confirm the selection of points of interest P1, P2, . . ., and a “cancel” button 880 operated to end viewing of the distribution base.

[0122] Among these, the tour image 830 is displayed using map image data included in the distribution base information received in step S16. The tour image 830 is an image of the distribution base photographed in advance by the photographing device 10, and the user A1 can grasp the layout of the entire distribution base by operating the viewpoint change icon 850. Specifically, the user A1 can view a desired location in the distribution base by operating the viewpoint change icon 850 using the pointer p1 while looking at the tour image 830. Note that, although the tour image 830 is described as being displayed using map image data included in the distribution base information received in step S16, the tour image 830 may be configured to display photographed image data of the distribution base received in real time.

[0123] Next, the user A1 operates the "attention point" button 860 and operates the viewpoint change icon 850 using the pointer p1, whereby the display control unit 74 accepts the designation (input) of the attention point P1. Furthermore, the user A1 continues to operate the viewpoint change icon 850 using the pointer p1 to a location different from the attention point P1, whereby the reception unit 72 accepts the designation (input) of the attention point P2. In this way, the user A1 inputs multiple attention points P1, P2, etc., and operates the "OK" button 870, whereby the reception unit 72 accepts the selection of multiple attention points Pn by the user A1 (step S72). The reception unit 72 may accept the designation of multiple attention points Pn by the user A1 clicking or double-clicking the mouse, which is an example of an input means.

[0124] Next, the attention point identification unit 77 identifies attention point coordinates, which are the coordinates of the attention point P whose designation was accepted in step S72 (step S73). Here, the attention point coordinates identified by the attention point identification unit 77 are the coordinates of the center point of the tour image 830 that is displayed when the designation of the multiple attention points Pn was accepted in step S72. Note that the attention point coordinates may be coordinates indicating the position of the pointer p1 in the tour image 830.

[0125] The transmitting / receiving unit (acquiring unit) 71 transmits an imaging device selection request indicating a request to select an imaging device 10 to the communication management device 50 (step S74). As a result, the transmitting / receiving unit 51 of the communication management device 50 receives the imaging device selection request transmitted from the communication terminal 70. This imaging device selection request includes the point of interest coordinates identified in step S74 and the base ID received in step S16.

[0126] In the image communication system 1 according to the present embodiment, when the process of step S74 described above is executed, other devices may exist between the communication terminal 70 (communication terminal) and the communication management device 50 (communication management device). In other words, each piece of information transmitted and received between the communication terminal 70 and the communication management device 50 may be configured to be transmitted and received once via another device.

[0127] <Selection of imaging modality> Next, the communication management device 50 executes a selection process of the photographing device 10 in response to the photographing device selection request received in step S74 (step S75). Here, the process of step S75 will be described in detail with reference to Fig. 31 and Fig. 21 to Fig. 24. Fig. 31 is a flow chart showing an example of the photographing device selection process.

[0128] First, the storage / reading unit 59 searches the distribution base management table (distribution base management DB 5005, see FIG. 18) using the base ID received in step S74 as a search key, and reads out distribution base information associated with the same base ID as the received base ID (step S101).

[0129] Next, the selection unit 53 divides the area of ​​the distribution base A into a plurality of areas by line segments passing through the coordinates of each of the attention points P indicating a predetermined position, based on the coordinates of each of the attention points Pn received in step S74 (step S102). In the example shown in Fig. 22, the attention point P1 designated by the user A1 is indicated by a black circle (●). In this case, the selection unit 53 can select the image capture devices 10A-1-1, 10A-1-2, 10A-1-3, and 10A-1-4 that are located closest to the attention point P1. The same applies to the attention point P2.

[0130] Next, the storage / reading unit 59 searches the placement information management table (placement information management DB 5004, see FIG. 18) using the location ID received in step S74 as a search key, and reads out placement information associated with the same location ID as the received location ID (step S103).

[0131] Next, the selection unit 53 selects the camera device 10 closest to the attention point coordinates for each area divided in step S102 based on the coordinate values ​​indicated by the arrangement information read in step S103 (step S104). Specifically, the selection unit 53 sequentially processes the camera devices 10 indicated in the arrangement information one by one.

[0132] First, the selection unit 53, for example, refers to the coordinate values ​​indicated by the read-out arrangement information and determines which of the divided areas (for example, area 1-area 4) the area in which the camera device 10 exists belongs to. After that, the selection unit 53 calculates the distance between the coordinate values ​​of the camera device 10 and each of the attention point coordinates. Then, if the camera device 10 is the first camera device 10 in the determined area, or if the distance is shorter than the camera device 10 that is "currently the shortest distance" in the determined area, the selection unit 53 holds the identification information of the camera device 10 (for example, the IP address of the camera device 10) and the calculated distance as the camera device 10 that is "currently the shortest distance" in the determined area.

[0133] The selection unit 53 performs the above-mentioned process on all the camera devices 10 shown in the installation information, thereby selecting the camera device 10 that is "closest" in each of the divided areas. The selection unit 53 selects the same number of camera devices 10 as the number of divided areas. In the example of FIG. 22, the selection unit 53 selects the camera devices 10A-1-1, 10A-1-2, 10A-1-3, and 10A-1-4 as the camera devices 10 that are closest to the attention point coordinates of the attention point P1 in the area 1-1-area 1-4, respectively. Similarly, in the example of FIG. 23, the selection unit 53 selects the camera devices 10A-2-1, 10A-2-2, 10A-2-3, and 10A-2-4 as the camera devices 10 that are closest to the attention point coordinates of the attention point P2 in the area 2-1-area 2-4, respectively. The above-mentioned process is similar to the case where three attention points are specified in FIG. 24.

[0134] Next, the selection unit 53 selects a shared imaging device based on the coordinate values ​​indicated by the arrangement information read out in step S103 (step S105).

[0135] <Selection of Shared Radiography Modality> Fig. 32 is a flow chart showing an example of the selection process of the shared photographing device. First, the selection unit 53 selects two attention points from among a plurality of attention points Pn designated by the user A1 (step S151). Note that the attention points illustrated in Figs. 22 and 23 are P1 and P2.

[0136] Next, the determination unit 55 determines whether or not there is a shared camera device between the two selected attention points P1 and P2 (step S152). The determination of the presence or absence of a shared camera device in step S152 is to determine whether or not there is a camera device that can provide predetermined area information indicating each predetermined area for viewing each of the two designated positions (attention points P1 and P2) from the front. Specifically, the selection unit 53 reads out the coordinate values ​​indicating the positions of the attention points P1 and P2 designated by the user A1 from the predetermined area management table (predetermined area management DB 5003, see FIG. 17). Next, the selection unit 53 searches for each coordinate value of the camera device 10 managed in the arrangement information management table (arrangement information management DB 5004, see FIG. 18) and selects the camera device 10 that is the closest to the two coordinate values ​​(designated positions) and can share each image of the two coordinate values ​​(designated positions). In other words, the photographing device 10 in which the distance between the attention point P1 and the photographing device 10 and the distance between the attention point P2 and the photographing device 10 are the shortest are the shared photographing devices.

[0137] If there is a shared imaging device that can be shared between the two selected attention points (P1 and P2) (step S152; YES), the selection unit 53 selects one shared imaging device that can be shared. In this case, in the example shown in Fig. 22 and Fig. 23, the selection unit 53 selects the imaging device 10A-1-4 (imaging device 10A-2-1) as a shared imaging device that can be shared between the attention points P1 and P2 (step S153). Note that the calculation formula for determining that the distance between the above-mentioned two coordinate values ​​(designated positions) is the shortest from each other can be obtained by a well-known calculation, so the explanation will be omitted.

[0138] Next, the determination unit 55 determines whether or not the process has been performed for all the attention points (step S154). The reason for performing the process of step S154 is that the user may specify three or more attention points. FIG. 24 is a diagram for roughly explaining an example of the relationship between the attention points P and the photographing devices when three attention points P are set. FIG. 24 shows an example in which the attention point P3 is added and three attention points are specified by the user A1. When there are two attention points, the determination of the presence or absence of a shared photographing device is sufficient once, but when there are three attention points, three combinations of two attention points are generated, so three determinations are required. For example, the selection unit 53 first determines whether or not there is a shared photographing device that can be shared between the attention points P1 and P2. Similarly, the selection unit 53 determines whether or not there is a shared photographing device that can be shared between the attention points P1 and P3, and between the attention points P2 and P3. Similarly, when the number of attention points specified by the user A1 becomes four or more, the determination unit 55 performs the determination multiple times.

[0139] As shown in Fig. 24, when three attention points P are specified and it has not been determined whether or not there is a shared photographing device that can be shared for each of all the attention points (step S154; NO), the determination unit 55 returns to the process of step S151. On the other hand, when there are two attention points, or when the determination of whether or not there is a shared photographing device that can be shared for all combinations of selecting two attention points out of the three attention points is completed (step S154; YES), the determination unit 55 exits this flow. In other words, when the determination unit 55 determines that there are multiple combinations of two attention point coordinates among the attention point coordinates indicated by the multiple attention points Pn received by the transmission / reception unit 51, the generation unit 56 generates identification information of the shared photographing device obtained for all the combinations, and each predetermined area information of the shared photographing device indicating each predetermined area for viewing each of the two designated positions in the combination from the front.

[0140] If there is no sharable camera device between the two selected attention points (P1 and P2) (step S152; NO), the selection unit 53 does not select a sharable camera device, but selects each camera device 10 closest to the attention point coordinates for each area divided in step S102 (step S155). For example, the selection unit 53 selects the camera devices 10A-2-1, 10A-2-2, 10A-2-3, and 10A-2-4 arranged at the positions closest to the attention point P2 in Fig. 24 and the camera devices 10A-3-1, 10A-3-2, 10A-3-3, and 10A-3-4 arranged at the positions closest to the attention point P3, and transitions to step S154.

[0141] Fig. 25 is a diagram for explaining an example of the relationship between the image capturing devices arranged at irregular positions and each attention point. The process of selecting a shared image capturing device is also applied to a state in which the image capturing devices 10 arranged at the distribution base are arranged at irregular positions (distributed positions) as shown in Fig. 25.

[0142] Returning to FIG. 31, the generating unit 56 generates the predetermined area information of the selected shared camera device (step S106). In this process, the generating unit 56 generates the predetermined area information based on the relationship between the predetermined area information shown in FIG. 7 and the image of the predetermined area T. As described above, the generating unit 56 calculates the predetermined area information for displaying the direction of each attention point in front (center) based on the attention point coordinate values ​​managed in the predetermined area management table (predetermined area management DB 5003, see FIG. 17) and the predetermined area information (radius (r), polar angle (θ), azimuth angle (φ)) corresponding to the attention point coordinate values, and the coordinate values ​​(x, y, z) corresponding to the IP address of the camera device and the arrangement direction (angle with respect to the x-axis) of the camera device managed in the arrangement information management table (arrangement information management DB 5004, see FIG. 18). Specifically, the generating unit 56 generates the predetermined area information for displaying the predetermined area image (perspective projection transformation image) in which the attention point coordinates are located at the center of the omnidirectional image captured by the selected camera device 10. Here, the radius vector (r) and the polar angle (θ) are assumed to have predetermined values ​​set in advance. This indicates that the angle of view and the angle of elevation of the perspective transformation image are processed as constant. The azimuth angle (φ) can be calculated as a relative value between the installation direction of the image capture device 10 indicated in the installation information and the direction from the image capture device 10 to the coordinates of the point of interest, as shown in FIG. 21. Then, the generation unit 56 generates predetermined area information for displaying (perspective projection display) a predetermined area image centered on the coordinates of the point of interest from the omnidirectional image acquired by the image capture device 10 based on the calculation result.

[0143] Next, the generating unit 56 generates predetermined area information of the other image capturing devices selected for each of the attention points (step S107). That is, the generating unit 56 generates each predetermined area information indicating each predetermined area for viewing each attention point P in front based on the identification information of each image capturing device 10 closest to each attention point P among the attention points Pn obtained from the multiple divided areas obtained when dividing the area in which the multiple image capturing devices 10 are arranged by a predetermined number passing through each of the multiple attention points Pn, and the attention point coordinate information indicating the coordinates of each attention point P. Specifically, the generating unit 56 generates predetermined area information for displaying a predetermined area image (perspective projection transformation image) in which the attention point coordinates are in front of the omnidirectional image captured by the selected image capturing device 10A. The method of generating the predetermined area information of the other image capturing devices is the same as that of step S106 described above. The generating unit 56 executes such processing for all image capturing devices 10A selected in step S104. The placement position indicating the coordinate values ​​of the camera 10 and the placement direction indicating the direction in which the front of the camera 10A faces are set in advance in the placement information management DB 5004 by an administrator or the like. In the process of step S106 described above, in order to obtain a combination of the IP address of the camera and the predetermined area information, the memory / read unit 59 and the selection unit 53 generate corresponding predetermined area information using a predetermined area management table (predetermined area management DB 5003, see FIG. 17) and a placement information management table (placement information management DB 5004, see FIG. 18), respectively, managed by the communication management device 50.

[0144] Then, the storage / reading unit 59 stores the predetermined area information generated in step S105 in a predetermined area management table (predetermined area management DB 5003, see FIG. 17(A)) in association with the IP address of the corresponding image capturing device 10A (step S108).

[0145] In this way, the communication management device 50 can select a shared photographing device 10 that can provide specified area information of multiple attention points Pn based on each of the attention point coordinate values ​​of multiple attention points Pn transmitted from the communication terminal 70 and each of the placement information (each coordinate value) of the multiple photographing devices 10.

[0146] In this embodiment, the generating unit 56 has a function or a means to function as an example of a generating means. Furthermore, the generating unit 56 that generates the predetermined area information may be configured to be included in another device provided between the communication management device 50 and the communication terminal 70, in addition to being included in the communication management device 50.

[0147] Returning to FIG. 30, the transmitting / receiving unit 51 of the communication management device 50 transmits a selection result notification, which is a processing result in step S75, to the communication terminal 70C (step S76). As a result, the transmitting / receiving unit (acquisition unit) 71 of the communication terminal 70C receives the selection result notification transmitted from the communication management device 50. This selection result notification includes each identification information of each camera device closest to the attention point Pn including the shared camera device selected in step S104, the predetermined area information generated in step S105 for each camera device closest to the attention point Pn so that the attention point is in front, and each predetermined area information of each camera device closest to the attention point Pn. In other words, the transmitting / receiving unit 51 transmits to the communication terminal 70 the identification information (IP address) of each camera device 10 closest to each coordinate value among the coordinate values ​​of the multiple attention points Pn generated by the generation unit 56, each coordinate information (coordinate value) indicating each coordinate of each attention point P, and each predetermined area information indicating each predetermined area for viewing each attention point P in front. In this manner, the transmitting / receiving unit (acquisition unit) 71 of the communication terminal 70C acquires each of the predetermined area information indicating each of the predetermined areas including the multiple attention points Pn accepted in step S72.

[0148] As described above, the transmitter / receiver 51 transmits to the communication terminal 70 the identification information (IP address) of the shared photographing device (photographing device 10A-1-4 (10A-2-1)) which is selected from the multiple photographing devices and has the shortest distance to any two of the designated positions (coordinate values) indicating the multiple designated position information (point of interest Pn) received by the transmitter / receiver 51 and which can share the images of the two designated positions (points of interest P1 and P2), and the specified area information of the shared photographing device (photographing device 10A-1-4 (10A-2-1)) indicating the respective specified areas for viewing the two designated positions from the front.

[0149] The transmitting / receiving unit 51 of the communication management device 50 can transmit each piece of predetermined area information to the communication terminal 70 at the same time or at different times. Furthermore, even if the pieces of predetermined area information are transmitted at different times, the order of transmission of the pieces of predetermined area information does not matter.

[0150] Next, the memory / read unit 79 of the communication terminal 70C stores the specified area information received in step S76 in the specified area management table (specified area management DB7002, see Figure 20 (B)) in association with the IP address of the imaging device 10 (step S77).

[0151] Next, the transmitting / receiving unit (acquiring unit) 71 transmits a captured image request to the communication management device 50 in order to acquire the captured image captured by the selected imaging device 10 (step S78). As a result, the transmitting / receiving unit 51 of the communication management device 50 receives the captured image request transmitted from the communication terminal 70. Note that the captured image request includes the image data ID acquired in step S40.

[0152] The storage / readout unit 59 of the communication management device 50 that has received the captured image request searches the image type management table (image type management DB 5002, see FIG. 16(B)) using the image data ID as a search key to read out the corresponding source name (image type information) (step S79). This identifies the image data representing the captured image that corresponds to the image data ID.

[0153] The transmitting / receiving unit 51 transmits image data representing the captured image that has been read out to the communication terminal 70 (step S80). As a result, the transmitting / receiving unit 71 of the communication terminal 70 receives the image data transmitted from the communication management device 50. This image data includes an image data ID and sound data relating to the captured image.

[0154] Next, the reception unit 72 receives a selection of a display image to be displayed on the communication terminal 70C from the captured image data received in step S53 through a predetermined input operation by the user A1 (step S81). Note that if the communication terminal 70 is capable of simultaneously displaying multiple captured images, or if the number of received captured images is less than the number that can be simultaneously displayed on the communication terminal 70, the process of step S78 may be omitted.

[0155] Next, the image / sound processing unit 73 generates a predetermined area image by performing perspective projection transformation using the predetermined area information received in step S76 in order to display an image of the predetermined area specified by the predetermined area information corresponding to the display image selected in step S76 (step S82). This allows the communication terminal 70C to generate a predetermined area image including the attention point P specified by the user from among the captured images (panoramic images) captured by the imaging device 10 selected in the communication management device 50.

[0156] Then, the display control unit 74 causes the display 706 to display the predetermined area image generated in step S79 (step S83).

[0157] ●Examples of screen display of each designated area image● Here, an example of a display screen in the communication terminal 70 according to this embodiment will be described. Figs. 34 to 37 are diagrams showing an example of a display screen displaying images captured by the imaging devices around the attention point P1. In the case of Fig. 34, the subjects (vehicles) in these captured images are tilted by the angle (azimuth angle) between each imaging device and the attention point P1, for example, about 45° with respect to the X-axis. Fig. 34 shows an example in which a predetermined area image X11 is displayed on the communication terminal 70. In Fig. 34, when the imaging device 10A-1-1 is tilted about 45° counterclockwise with respect to the X-axis and viewed from the center of attention point P1, a predetermined area image X11 in which one vehicle is reflected in the background is displayed on the communication terminal 70. Similarly, in the cases of Figs. 35, 36, and 37, the predetermined area images X12, X13, and X14 are displayed on the communication terminal 70, respectively.

[0158] 38-41 are diagrams showing an example of a display screen displaying images taken by the photographing devices around the attention point P2. In the case of FIG. 38, the subjects (vehicles) in these photographed images are tilted by the angle (azimuth angle) between each photographing device and the attention point P2, for example, about 60° with respect to the X-axis. FIG. 38 shows an example in which a predetermined area image X21 is displayed on the communication terminal 70. In FIG. 38, when the photographing device 10A-2-1 is tilted about 60° with respect to the X-axis and viewed from the center of attention point P2, a predetermined area image X21 in which another vehicle is reflected in the background is displayed on the communication terminal 70. Similarly, in the cases of FIGS. 39, 40, and 41, predetermined area images X22, X23, and X24 are displayed on the communication terminal 70, respectively.

[0159] ●Example of communication device screen display● FIG. 42 is a diagram showing an example of a display screen of a communication terminal when multiple attention points are selected. First, a user of the communication terminal 70 operates a viewpoint change icon 850, a pointer P1, and an attention point button 860 in a tour image 830 displayed on the display 706 to specify attention points P1 and P2 at two different positions. When the attention points P1 and P2 are specified by the user, the display control unit 74 of the communication terminal 70 displays a display screen 950 shown in FIG. 42. For example, the display screen 950 displays an area 1 screen 960 that is captured by each imaging device in an area 1 given by the attention point P1 specified by the user. The area 1 screen 960 is a screen including screens 961, 962, 963, and 964 that display a predetermined area image to be viewed with the attention point P1 as the center. In each of the screens 961, 962, 963, and 964, a screen displaying a predetermined area image to be viewed with the attention point P1 as the center among the celestial sphere images captured by the image capturing devices 10A-1-1, 10A-1-2, 10A-1-3, and 10A-1-4 closest to the attention point P1 is displayed on the display screen 950. Note that each image capturing device 10 closest to the attention point P1 is selected by the selection unit 53 from among the areas 1-1, 1-2, 1-3, and 1-4 obtained by dividing the area into four with the attention point P1 at the center (boundary) as described above.

[0160] Similarly, on the display screen 950, a region 2 screen 970 captured by each camera in the region 2 given by the attention point P2 designated by the user is displayed. The region 2 screen 970 is a screen including screens 971, 972, 973, and 974 displaying predetermined region images to be viewed with the attention point P2 as the center. On each of the screens 971, 972, 973, and 974, a screen displaying a predetermined region image to be viewed with the attention point P2 as the center among the omnidirectional images captured by the camera devices 10A-2-1, 10A-2-2, 10A-2-3, and 10A-2-4 closest to the attention point P2 is displayed on the display screen 950. Note that each camera device 10 closest to the attention point P2 is selected by the selection unit 53 from among the regions 2-1, 2-2, 2-3, and 2-4 obtained by dividing the region into four with the attention point P2 at the center (border) as described above.

[0161] At this time, the predetermined area image to be viewed around the attention point P1 in the area 1-4 included in the area 1 screen 960 and the predetermined area image to be viewed around the attention point P2 in the area 2-1 included in the area 2 screen 970 are two predetermined area images in the omnidirectional image captured by the same photographing device 10A-1-4 (or 10A-2-1). That is, as shown in FIG. 42, the user can simultaneously view different predetermined area images in the omnidirectional image captured by the same photographing device 10A-1-4 (or 10A-2-1) arranged at the distribution base. At this time, the display control unit 74 of the communication terminal 70 may change the screen display content on at least one of the small screen 1-4 in the area 1 screen 960 and the small screen 2-1 in the area 2 screen 970 to distinguish them from small screens displaying other predetermined area images and to indicate that they are predetermined area images captured by the same photographing device. Specific examples of changing the screen display contents include adding predetermined characters, alphanumeric characters, symbols, marks, backgrounds, etc. to at least one of the small screens 1-4 and 2-1, changing the screen display size, blinking the screen, etc. In the example shown in Fig. 42, a sun mark is added by the display control unit 74 to the screens of the small screens 1-4 and 2-1.

[0162] Furthermore, on the display screen 950, a map 980 showing an overhead view of the distribution base A is displayed by the display control unit 74. On this map 980, attention points P1 and P2 designated by the user are displayed by black circles (●) at coordinates corresponding to the coordinate values ​​of attention points P1 and P2. This allows the user to simultaneously check what kind of predetermined area image is being distributed from the distribution base for each attention point designated by the user by comparing the area 1 screen 960, the area 2 screen 970, and the map 980, respectively.

[0163] In this way, the image communication system 1 can use the communication management device 50 to select an appropriate photographing device 10 for simultaneously viewing multiple attention points Pn designated by a user at a viewing location. Then, the image communication system 1 can cause the communication terminal 70 to display an image showing the multiple attention points Pn by transmitting, from the communication management device 50 to the communication terminal 70, predetermined area information capable of displaying an image in which the multiple attention points Pn have been photographed by the selected photographing device 10.

[0164] In addition, in the image communication system 1 according to this embodiment, when the above-mentioned processes of steps S75 to S77, steps S79 to S81, etc. are executed, other devices may exist between the communication management device 50 (communication management device) and the communication terminal 70 (communication terminal). In other words, each piece of information transmitted and received between the communication management device 50 and the communication terminal 70 may be configured to be transmitted and received once via another device.

[0165] In addition, in the present embodiment, an example has been described in which the selection unit 53 divides the distribution base into four areas. However, the selection unit 53 may increase or decrease the number of areas depending on the number of imaging devices 10 or distribution terminals arranged at the distribution base, the network bandwidth of the communication network 100, or the number of images that can be simultaneously received and displayed on the communication terminal 70, etc.

[0166] <Modification of the Display Process of Predetermined Region Image> Next, a modified example of the display process of a predetermined area image in the image communication system 1 will be described with reference to Fig. 43. Fig. 43 is a sequence diagram showing a modified example of the display process of a predetermined area image in the image communication system. Fig. 43 shows an example in which the above-mentioned selection process of the image capture device 10 is executed by the communication terminal 70 at the viewing location. Note that the process of steps S201 to S203 is similar to the process of steps S71 to S73 in Fig. 30, and therefore description thereof will be omitted.

[0167] 43, the transmitting / receiving unit (acquisition unit) 71 transmits a placement information acquisition request, which is a request to acquire placement information indicating the placement position of the image capturing device 10, to the communication management device 50 (step S204). As a result, the transmitting / receiving unit 51 of the communication management device 50 receives the placement information acquisition request transmitted from the communication terminal 70C. This placement information acquisition request includes the base ID received in steps S14 and S16.

[0168] Next, the communication management device 50 searches the placement information management table (placement information management DB 5004, see FIG. 18) using the location ID received in step S204 as a search key to read out placement information associated with the same location ID as the received location ID (step S205). Then, the transmitting / receiving unit 51 transmits the placement information read out in step S205 to the communication terminal 70C (step S206). As a result, the transmitting / receiving unit (acquisition unit) 71 of the communication terminal 70C receives the placement information transmitted from the communication management device 50.

[0169] Next, the selection unit 81 executes a selection process of the photographing device based on the coordinate values ​​indicated by the arrangement information received in step S206 (step S207). The selection process of the photographing device executed in step S207 is the same as the process of step S75 shown in FIG. 30 (details are shown in the flowchart of FIG. 31), and therefore the description will be omitted. Among them, the processes of steps S101 and S103 may be omitted. Furthermore, the storage of the predetermined area information by the storage / readout unit 79 executed in the process of step S107 is performed in the predetermined area management table (predetermined area management DB 7002, see FIG. 20(B)) instead of the predetermined area management table (predetermined area management DB 5003, see FIG. 17). Furthermore, the processes of steps S208 to S213 are the same as the processes of steps S78 to S83 in FIG. 30, and therefore the description will be omitted.

[0170] In this way, the image communication system 1 according to the modified embodiment can display an image showing the attention point P on the communication terminal 70 by having the communication terminal 70 select the photographing device 10 that photographs an image showing the attention point P specified by the user. In this way, the image communication system 1 can allow users at the viewing location to simultaneously view images of multiple specified attention points, similar to the above-described embodiment.

[0171] In addition, in the case of a camera that allows PTZ operation, there is a delay in the response speed of the PTZ operation and a limit to the mechanical operating range. In particular, when considering the mechanical operating range, even if a wide-angle camera that can capture about 180 degrees is placed opposite, if the subject near the specified point of interest moves, the camera that allows PTZ operation will also need to be moved. For this reason, it is desirable to have multiple camera devices at each distribution base.

[0172] [Main Effects of the Present Embodiment] As described above, the communication management device 50 in the image communication system 1 according to one embodiment of the present invention receives the coordinate information of the multiple attention points Pn transmitted by the communication terminal 70 among the multiple photographing devices (S74), and transmits to the communication terminal 70 the IP address of the shared photographing device 10A-1-4 (10A-2-1) that is the shortest distance from any two coordinate values ​​(the coordinate values ​​of the attention points P1 and P2) among the coordinate values ​​of the attention points and can share the images of the two attention points P1 and P2, and the predetermined area information of the shared photographing device indicating each of the predetermined areas for viewing the two attention points P1 and P2 from the front (S76). The communication terminal 70 receives the predetermined area information of the shared photographing device indicating each of the predetermined areas for viewing the two attention points P1 and P2 from the front (S76), and displays the predetermined area images of the two attention points P1 and P2 when viewed from the front on the display 706 based on the predetermined area information of the shared photographing device (S83). This allows the communication management device 50 to simultaneously display on the communication terminal 70 each of the predetermined area images of the shared photographing device photographing the multiple attention points Pn designated by the user, without performing any special processing on the photographing device 10. Therefore, a user who has designated multiple attention points Pn can simultaneously check the predetermined area images of each attention point photographed by one photographing device on the screen of the communication terminal 70.

[0173] Furthermore, by selecting a shared imaging device, it is possible to expect an effect of reducing the processing load of the communication management device 50 in the image communication system 1 by the amount of one device.

[0174] [Supplementary description of the embodiment] In the above-described embodiment, a case has been described in which the captured image (whole image) is a three-dimensional panoramic image as an example of a celestial sphere image (celestial sphere panoramic image), but the captured image may be a two-dimensional panoramic image.

[0175] Also, in the above-described embodiment, the communication terminal 70 at the viewing location does not need to be a dedicated viewing terminal, and may be configured to distribute captured images from the terminal itself, and perform both the distribution function and the viewing function simultaneously. Similarly, the distribution terminal 30 at the distribution location does not need to be a dedicated distribution terminal, and may be configured to display captured images distributed from other locations, and perform both the distribution function and the viewing function simultaneously. In this way, the image communication system 1 may be configured to perform two-way communication of captured images between multiple locations.

[0176] In addition, each function of the above-mentioned embodiment can be realized by one or more processing circuits. Here, the "processing circuit" in this specification includes a device programmed to execute each function by software, such as a processor implemented by an electronic circuit. This device refers to, for example, a processor, an ASIC (Application Specific Integrated Circuit), a DSP (digital signal processor), an FPGA (field programmable gate array), a SOC (System on a chip), a GPU (Graphics Processing Unit), and a conventional circuit module designed to execute each function described above.

[0177] In addition, the various tables in the above-mentioned embodiments may be generated by the learning effect of machine learning, and the data of each associated item may be classified by machine learning, making it unnecessary to use tables. Here, machine learning is a technology for making a computer acquire human-like learning capabilities, and refers to a technology in which a computer autonomously generates an algorithm required for judgment such as data identification from learning data previously acquired, and applies this to new data to make predictions. The learning method for machine learning may be any of supervised learning, unsupervised learning, semi-supervised learning, reinforcement learning, and deep learning, or may be a combination of these learning methods, and any learning method for machine learning may be used.

[0178] So far, we have described a communication terminal, an image communication system, an image display method, and a program according to one embodiment of the present invention. However, the present invention is not limited to the above-described embodiment, and can be modified within the scope of what a person skilled in the art can conceive, such as adding, changing, or deleting other embodiments. As long as the functions and effects of the present invention are achieved in any aspect, it is included in the scope of the present invention. [Explanation of symbols]

[0179] 1. Image communication system 10. Imaging Device 30 Distribution terminal 50 Communication management device 51 Transmitting / receiving unit (an example of a transmitting means) 53 Selection unit (an example of a selection means) 55 Judgment unit (an example of a judgment means) 56 Generation unit (an example of a generation means) 70 Communication terminal 71 Transmitting / receiving unit (an example of an acquiring means, an example of a receiving means) 72 Reception unit (an example of reception means) 74 Display control unit (an example of a display control means) 77 Predetermined position identification part 81 Selection unit (an example of a selection means) 82 Generation unit (an example of a generation means) [Prior art documents] [Patent documents]

[0180] [Patent Document 1] JP 2017-22587 A

Claims

1. An image communication system having a communication terminal that displays images captured by a plurality of image capture devices, and a communication management device that communicates with the communication terminal, The communication management device includes: a receiving means for receiving each piece of designated position information, which is transmitted from the communication terminal and indicates a plurality of designated positions in an area in which the plurality of image capturing devices are arranged; a selection means for selecting, from the plurality of photographing devices, a shared photographing device which is closest to any two of the designated positions indicated by the designated position information received by the receiving means and which can share images of the two designated positions; a transmitting means for transmitting, to the communication terminal, information on each of the predetermined areas of the shared photographing device, which indicates each of the predetermined areas for viewing the two designated positions from the front, and the photographed image, The communication terminal includes: a receiving means for receiving the predetermined area information and the captured image from the communication management device; a processing means for generating, from the photographed image received by the receiving means, each of the predetermined area information pieces, a predetermined area image corresponding to each of the predetermined area information pieces; and a display control means for displaying each of the predetermined area images generated by the processing means.

1. An image communication system comprising:

2. The image communication system described in Claim 1, characterized in that the receiving means of the communication management device receives the captured image.

3. When there are a plurality of combinations of the two arbitrary designated positions, the selection means selects the shared photographing device obtained for each of the combinations, the transmitting means transmits to the communication terminal each piece of predetermined area information of the shared photographing device, which indicates each predetermined area for viewing two designated positions of the combination from the front; 3. The image communication system according to claim 1, wherein the image communication system includes:

4. 4. An image communication system according to claim 1, the selection means selects the shared photographing device from the plurality of photographing devices based on each piece of coordinate information indicating the plurality of designated positions received by the receiving means and each piece of coordinate information indicating each arrangement position of the plurality of photographing devices.

5. 5. The image communication system according to claim 1, further comprising: a generating means for generating each predetermined area information indicating each predetermined area for viewing each of the designated positions from the front, based on identification information of each of the camera devices closest to each of the designated positions obtained from a plurality of divided areas obtained by dividing an area in which the plurality of camera devices are arranged by a predetermined number of parts passing through each of the designated positions, and on each of the designated position coordinate information indicating the coordinates of each of the designated positions, 1. An image communication system comprising:

6. 6. The image communication system according to claim 5, The generating means includes: generating each of the predetermined area information based on an arrangement direction of each of the image capturing devices and an azimuth angle with respect to each of the image capturing devices and each of the plurality of designated positions; 1. An image communication system comprising:

7. The transmitting means is transmitting to the communication terminal identification information of each of the photographing devices closest to each of the plurality of designated positions generated by the generating means, each of the designated position coordinate information indicating the respective coordinates of each of the designated positions, and each of the predetermined area information indicating each of the predetermined areas for viewing each of the designated positions from the front; 7. An image communication system according to claim 5 or 6.

8. 8. An image communication system according to claim 1, The communication terminal further comprises: a receiving means for receiving an input of the plurality of designated positions in an area displayed on a display means and in which the plurality of image capturing devices are arranged; a transmission means for transmitting each piece of designated location information indicating each of the plurality of designated locations accepted by the acceptance means to the communication management device, 1. An image communication system comprising:

9. A communication management device that communicates with a communication terminal that displays images captured by a plurality of image capture devices, a receiving means for receiving each piece of designated position information, which is transmitted from the communication terminal and indicates a plurality of designated positions in an area in which the plurality of image capturing devices are arranged; a selection means for selecting, from the plurality of photographing devices, a shared photographing device which is closest to any two of the designated positions indicated by the designated position information received by the receiving means and which can share images of the two designated positions; a transmitting means for transmitting to the communication terminal the predetermined area information of the shared photographing device, which indicates each predetermined area for viewing the two designated positions from the front, and the photographed image. A communication management device comprising:

10. A communication management method executed by a communication management device that communicates with a communication terminal that displays images captured by a plurality of image capture devices, comprising: a receiving step of receiving designated position information, which indicates a plurality of designated positions in an area in which the plurality of image capturing devices are arranged and which has been transmitted from the communication terminal; a selection step of selecting, from the plurality of photographing devices, a shared photographing device which is closest to any two of the designated positions indicated by the designated position information received in the receiving step and which can share images of the two designated positions; a transmitting step of transmitting, to the communication terminal, information on each of the predetermined areas of the shared photographing device, which indicates each of the predetermined areas for viewing the two designated positions from the front, and the photographed image. A communication management method comprising:

11. A program for causing a computer to function as each of the means recited in claim 9.

Images