Communication processing system, communication system, information processing method, and program

Abstract

To more reliably obtain appropriate images when periodically photographing an image of an object.SOLUTION: A communication processing system that transmits images captured by a photographing device to multiple terminal devices via a communication network includes a photographing accuracy determination unit that determines the photographing accuracy of a specified object in the image captured by the photographing device, and an instruction unit that, when the photographing accuracy determination unit determines that the photographing accuracy is insufficient, instructs the photographing device to move and re-photograph such that an image of the specified object can be captured with sufficient photographing accuracy.SELECTED DRAWING: Figure 18

Description

[Technical Field]

[0001] The present invention relates to a communication processing system, a communication system, an information processing method, and a program. [Background technology]

[0002] The following Patent Document 1 discloses a technology that determines whether the work of a first worker (experienced worker) is successful by comparing video of the work of a first worker (experienced worker) with video of the work of a second worker, and outputs the determination result as work support information. Summary of the Invention [Problem to be solved by the invention]

[0003] However, with the technology of Patent Document 1, if the video of the second worker's work cannot be captured properly, it is not possible to appropriately determine whether the second worker's work was successful. In this case, with the technology of Patent Document 1, it is necessary to manually confirm that the video of the second worker's work could not be captured properly and to issue an instruction to re-capture the video of the second worker's work, making it difficult to obtain an appropriate image.

[0004] In view of the above-mentioned problems, an object of the present invention is to make it possible to more reliably acquire appropriate images when periodically capturing images of an object. [Means for solving the problem]

[0005] In view of the above problems, a communication processing system according to one embodiment is a communication processing system that transmits an image captured by a photographing device to a plurality of terminal devices via a communication network, and includes a photographing accuracy determination unit that determines the photographing accuracy of a specified object in the image captured by the photographing device, and an instruction unit that, if the photographing accuracy determination unit determines that the photographing accuracy is insufficient, instructs the photographing device to move and re-photograph the image so that an image of the specified object can be captured with sufficient photographing accuracy. [Effects of the Invention]

[0006] According to the communication processing system of one embodiment, when images of an object are taken periodically, appropriate images can be obtained more reliably. [Brief explanation of the drawings]

[0007] [Figure 1] (a) is a left side view of the imaging device, (b) is a front view of the imaging device, and (c) is a plan view of the imaging device. [Figure 2] Image of the imaging device in use [Figure 3] (a) is a hemispherical image (before) taken with the imaging device, (b) is a hemispherical image (after) taken with the imaging device, and (c) is a diagram showing the image represented by the Mercator projection. [Figure 4] (a) is a conceptual diagram showing how a sphere is covered with a Mercator image, and (b) is a diagram showing a spherical image. [Figure 5] A diagram showing the positions of the virtual camera and the specified area when the spherical image is treated as a three-dimensional sphere. [Figure 6] (a) is a three-dimensional perspective view of FIG. 5, (b) is a diagram showing the predetermined area image in the state of (a) displayed on the display, (c) is a diagram showing the predetermined area after changing the viewpoint of the virtual camera IC in (a), and (d) is a diagram showing the predetermined area image in the state of (c) displayed on the display. [Figure 7] Diagram showing points in three-dimensional Euclidean space using spherical coordinates [Figure 8] Conceptual diagram showing the relationship between a specified area and a point of interest [Figure 9] 1 is a schematic diagram of a communication system according to an embodiment of the present invention; [Figure 10] Hardware configuration of the imaging device [Figure 11] Relay device hardware configuration diagram [Figure 12] Hardware configuration diagram of the communication processing system [Figure 13] FIG. 2 is a diagram illustrating the functional configuration of the communication system. [Figure 14] User / Device Management DB Conceptual Diagram [Figure 15]Conceptual diagram of virtual room management database [Figure 16] Conceptual diagram of viewpoint information management database [Figure 17] Sequence diagram showing the communication process for wide-field images in the communication system [Figure 18] FIG. 10 is a diagram showing a processing sequence of an image complementing process performed by a communication system according to an embodiment; [Figure 19] 1 is a flowchart showing an example (first example) of a processing procedure performed by a communication processing system according to an embodiment; [Figure 20] FIG. 10 is a diagram showing an example of a determination condition used by the imaging accuracy determination unit; [Figure 21] FIG. 10 is a diagram showing an example of an output of a re-photographing instruction from a terminal device carried by a worker on-site; [Figure 22] FIG. 10 is a diagram showing an example of an output of a re-photographing instruction from a terminal device carried by a worker on-site; DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, an embodiment will be described with reference to the drawings.

[0009] [Overview of spherical images] A method for generating a spherical image will be described with reference to Fig. 1 to Fig. 8. A spherical image is also called a spherical panoramic image or a 360° panoramic image, and is an example of a wide-field video with a wide viewing angle. Wide-field images also include simple panoramic images of about 180°.

[0010] First, the appearance of the imaging device 10 will be described using Fig. 1. The imaging device 10 is a digital camera for obtaining captured images that are the basis for creating a spherical image. Fig. 1(a) is a left side view of the imaging device, Fig. 1(b) is a front view of the imaging device, and Fig. 1(c) is a plan view of the imaging device.

[0011] As shown in Fig. 1(a), the photographing device 10 is small enough to be held in one hand. As shown in Figs. 1(a), 1(b), and 1(c), an image sensor 103a is provided on the front side (front side) of the upper portion of the photographing device 10, and an image sensor 103b is provided on the rear side (rear side). As shown in Fig. 1(b), an operation unit 115 such as a shutter button is provided on the front side of the photographing device 10.

[0012] Next, a usage situation of the imaging device 10 will be described with reference to FIG. 2. Note that FIG. 2 is an image diagram of the imaging device in use. As shown in FIG. 2, the imaging device 10 is communicably connected to a relay device 3 installed on some kind of stand, and is used to capture surrounding subjects, scenery, and the like. In this case, two hemispherical images can be obtained by capturing images of subjects around the user using the imaging element 103a and the imaging element 103b shown in FIG. 1. Note that if the omnidirectional image captured by the imaging device 10 is not to be transmitted to other communication terminals or systems, the relay device 3 is not necessary.

[0013] Next, an outline of processing until a celestial sphere image is created from an image captured by the image capturing device 10 will be described with reference to Figs. 3 and 4. Fig. 3(a) is a diagram showing a hemispherical image (front side) captured by the image capturing device, Fig. 3(b) is a diagram showing a hemispherical image (rear side) captured by the image capturing device, and Fig. 3(c) is a diagram showing an image expressed by equirectangular projection (hereinafter referred to as "equirectangular projection image"). An image expressed by Mercator projection or the like (hereinafter referred to as "Mercator image") may also be used. Fig. 8(a) is a conceptual diagram showing a state in which a sphere is covered with an equirectangular projection image, and Fig. 8(b) is a diagram showing a celestial sphere image. The "equirectangular projection image" is an equirectangular celestial sphere image as an example of the wide-field-of-view image described above.

[0014] As shown in Fig. 3(a), the image obtained by the image sensor 103a becomes a hemispherical image (front side) curved by a wide-angle lens 102a such as a fisheye lens, which will be described later. Also, as shown in Fig. 3(b), the image obtained by the image sensor 103b becomes a hemispherical image (rear side) curved by a wide-angle lens 102b such as a fisheye lens, which will be described later. Then, the image capturing device 10 combines the hemispherical image (front side) with a hemispherical image (rear side) flipped 180 degrees to create an equirectangular projection image EC as shown in Fig. 3(c).

[0015] The image capturing device 10 then uses software such as OpenGL ES (Open Graphics Library for Embedded Systems) to apply an equirectangular projection image EC to cover the spherical surface as shown in FIG. 3( a), thereby creating a celestial sphere image CE as shown in FIG. 3( b). In this way, the celestial sphere image CE is represented as an image in which the equirectangular projection image EC faces the center of the sphere. OpenGL ES is a graphics library used to visualize 2D (two-dimensional) and 3D (three-dimensional) data. OpenGL ES is merely an example of software that performs image processing, and the celestial sphere image CE may be created by other software. The celestial sphere image CE may be a still image or a video. While the image capturing device 10 has been described as generating a celestial sphere image, the communication processing system 5 or the communication terminals 7 and 9 may perform similar image processing or some of the image processing steps.

[0016] Then, by using OpenGL ES (Open Graphics Library for Embedded Systems), the Mercator image is pasted to cover the surface of the sphere as shown in FIG. 4(a), and a spherical image as shown in FIG. 4(b) is created. In this way, the spherical image is expressed as an image in which the Mercator image faces the center of the sphere. Note that OpenGL ES is a graphics library used to visualize 2D (2-Dimensions) and 3D (3-Dimensions) data. Note that the spherical image may be a still image or a video.

[0017] As described above, the spherical image CE is an image pasted to cover the spherical surface, which gives a sense of incongruity to people. Therefore, the communication terminals 7 and 9 can display a predetermined region of the spherical image (hereinafter referred to as a "predetermined region image") as a flat image with little curvature, thereby enabling a display that does not give a sense of incongruity to people. This will be described with reference to FIGS. 5 to 8.

[0018] Fig. 5 is a diagram showing the positions of a virtual camera and a predetermined area when a celestial sphere image is a three-dimensional sphere. The virtual camera IC corresponds to the position of a virtual viewpoint of a user viewing a celestial sphere image CE displayed as a three-dimensional sphere. In Fig. 6, (a) is a three-dimensional perspective view of Fig. 5, (b) is a diagram showing the predetermined area image in the state of (a) displayed on a display, (c) is a diagram showing the predetermined area after the viewpoint of the virtual camera IC in (a) is changed, and (d) is a diagram showing the predetermined area image in the state of (c) displayed on a display.

[0019] If the celestial sphere image CE generated in this manner is a three-dimensional sphere CS, the virtual camera IC is located inside the celestial sphere image CE as shown in Fig. 5. A predetermined area T in the celestial sphere image CE is an imaging area of ​​the virtual camera IC, and is specified by viewpoint information (also referred to as "predetermined area information") that indicates the imaging direction and angle of view of the virtual camera IC in a three-dimensional virtual space including the celestial sphere image CE.

[0020] Furthermore, zooming of the predetermined region T can also be expressed by moving the virtual camera IC closer to or farther away from the celestial sphere image CE. The predetermined region image Q is an image of the predetermined region T in the celestial sphere image CE. Therefore, the predetermined region T can be specified by the angle of view α and the distance f from the virtual camera IC to the celestial sphere image CE.

[0021] Furthermore, when the virtual viewpoint of the virtual camera IC is moved (also referred to as "changed") from the state of Fig. 6(a) to the right (left as one faces the drawing) as shown in Fig. 6(c), the predetermined area T in the omnidirectional image CE is moved to the predetermined area T' accordingly, and the predetermined area image Q displayed on the predetermined display is changed to the predetermined area image Q'. As a result, the image shown in Fig. 6(b) is changed to the image shown in Fig. 6(d) and displayed on the display.

[0022] Next, the relationship between the viewpoint information and the image of the predetermined area T will be described with reference to Fig. 7 and Fig. 8. Fig. 7 is a diagram showing points in a three-dimensional Euclidean space using spherical coordinates. Fig. 8 is a conceptual diagram showing the relationship between the predetermined area and the point of interest (center point).

[0023] Here, the coordinates of an arbitrary position when the center point CP shown in Fig. 7 is expressed in a spherical polar coordinate system are (r, θ, φ). (r, θ, φ) are the radius vector, polar angle, and azimuth angle, respectively. The radius vector r is the distance from the origin of the three-dimensional virtual space including the omnidirectional image to an arbitrary point (the center point CP in Fig. 8), and is equal to the distance f shown in Fig. 8.

[0024] Furthermore, as shown in FIG. 8, when the center of a predetermined area T, which is the imaging area of ​​the virtual camera IC, is considered to be the center point CP in FIG. 7, the trigonometric function shown in the following (Equation 1) generally holds. (L / f) = tan(α / 2) (Equation 1) Note that f is the distance from the virtual camera IC to the center point CP. L is the distance between any vertex of the predetermined area T and the center point CP (2L is the diagonal). α is the angle of view. In this case, the viewpoint information for identifying the predetermined area T can be expressed by pan(θ), tilt(φ), and fov(α). Note that zooming of the predetermined area T can be expressed by widening or narrowing the range (arc) of the angle of view α.

[0025] [Communication system overview] Next, an overview of a communication system according to an embodiment of the present invention will be described with reference to Fig. 9. Fig. 9 is a schematic diagram of a communication system according to an embodiment of the present invention.

[0026] 9, the communication system 1a of this embodiment is composed of an imaging device 10, a relay device 3, a communication terminal 7, and communication terminals 9a, 9b, and 9c. The communication terminals 9a, 9b, and 9c are collectively referred to as "communication terminal 9." The communication terminal may also be referred to as a "display terminal" that displays images, etc.

[0027] Of these, the image capturing device 10 is a digital camera for capturing a spherical image, as described above. The relay device 3 is an example of a cradle that charges the image capturing device 10 and transmits and receives data to and from the image capturing device 10. The relay device 3 can perform data communication with the image capturing device 10 via a contact point, and can also perform data communication with the communication processing system 5 via the communication network 100. The communication network 100 includes, for example, the Internet, a LAN (Local Area Network), a (wireless) router, etc.

[0028] Furthermore, the communication processing system 5 is, for example, a server computer, and can perform data communication with the relay device 3 and the communication terminals 7 and 9 via the communication network 100. The communication terminals 7 and 9 are, for example, laptop PCs (Personal Computers), and can perform data communication with the communication processing system 5 via the communication network 100. OpenGL ES is installed in the communication terminals 7 and 9, and they create a predetermined area image (see FIG. 6 ) from the omnidirectional image received from the communication processing system 5. Note that the communication processing system 5 may be configured by a single server computer or may be configured by multiple server computers.

[0029] Furthermore, the image capturing device 10 and the relay device 3 are installed at predetermined positions by an observer X, such as a salesperson, in a clothing store Sa. The communication terminal 7 is operated by the observer X. The communication terminal 9a is operated by a viewer A, such as a remote customer. Similarly, the communication terminals 9b and 9c are operated by viewers B and C, such as remote customers, respectively.

[0030] The communication processing system 5 transmits (distributes) the omnidirectional image obtained from the imaging device 10 via the relay device 3 to the communication terminals 7 and 9 via the communication network. Furthermore, the communication processing system 5 receives, from each communication terminal 9, each piece of viewpoint information for specifying a predetermined area of ​​the predetermined area image currently being displayed on each communication terminal 9 (currently being viewed by each viewer A, B, or C), and transmits each piece of viewpoint information to the communication terminal 7. Then, the communication terminal 7 displays a viewpoint display area based on each piece of viewpoint information on the predetermined area image, which is a predetermined area of ​​the omnidirectional image received from the communication processing system 5. This allows the observer X to know which predetermined area of ​​the omnidirectional image the remote viewers A, B, or C are focusing on when viewing it.

[0031] [Hardware configuration of the embodiment] Next, the hardware configurations of the image capturing device 10, relay device 3, communication processing system 5, and communication terminals 7 and 9 of this embodiment will be described in detail with reference to FIGS.

[0032] <Hardware configuration of the imaging device> Fig. 10 is a hardware configuration diagram of the photographing device 10. As shown in Fig. 10, the photographing device 10 is composed of an imaging unit 101, an image processing unit 104, an imaging control unit 105, a microphone 108, a sound processing unit 109, a CPU (Central Processing Unit) 111, a ROM (Read Only Memory) 112, an SRAM (Static Random Access Memory) 113, a DRAM (Dynamic Random Access Memory) 114, an operation unit 115, an input / output I / F 116, a short-range communication circuit 117, an antenna 117a of the short-range communication circuit 117, an electronic compass 118, a gyro sensor 119, an acceleration sensor 120, and a network I / F 121.

[0033] Of these, the imaging unit 101 is equipped with wide-angle lenses 102a and 102b (hereinafter referred to as lenses 102 when there is no need to distinguish between them) that are each capable of capturing an image with a field of view of 180° or more to form a hemispherical image, and two imaging elements 103a and 103b that are provided corresponding to the lenses 102a and 102b, respectively.

[0034] Furthermore, the imaging elements 103a, 103b include an image sensor such as a CMOS (Complementary Metal Oxide Semiconductor) sensor or a CCD (Charge Coupled Device) sensor that converts optical images captured by the lenses 102a, 102b, etc. into image data in the form of electrical signals and outputs the image data, a timing generation circuit that generates horizontal or vertical synchronization signals and pixel clocks for the image sensors, and a group of registers in which various commands or parameters required for the operation of the imaging elements are set. Note that the configuration in which the imaging unit 101 has two wide-angle lenses is merely an example, and the imaging unit 101 may have only one, or three or more.

[0035] The imaging elements 103a and 103b of the imaging unit 101 are each connected to the image processing unit 104 via a parallel I / F bus. On the other hand, the imaging elements 103a and 103b of the imaging unit 101 are each connected to the imaging control unit 105 via a serial I / F bus (such as an I2C bus).

[0036] The image processing unit 104, the imaging control unit 105, and the sound processing unit 109 are connected to a CPU 111 via a bus 110. Furthermore, the bus 110 is also connected to a ROM 112, an SRAM 113, a DRAM 114, an operation unit 115, an input / output I / F 116, a short-range communication circuit 117, an electronic compass 118, a gyro sensor 119, an acceleration sensor 120, a network I / F 121, and the like.

[0037] The image processing unit 104 takes in the image data output from the image sensors 103a and 103b via a parallel I / F bus, performs predetermined processing on each piece of image data, and then synthesizes the image data to create data for an equirectangular projection image (an example of a wide-field image), which will be described later.

[0038] The imaging control unit 105 generally sets commands and the like in the registers of the imaging elements 103a and 103b using an I2C bus, with the imaging control unit 105 acting as a master device and the imaging elements 103a and 103b acting as slave devices. Necessary commands and the like are received from the CPU 111. The imaging control unit 105 also uses the I2C bus to retrieve status data and the like from the registers of the imaging elements 103a and 103b and send it to the CPU 111.

[0039] Furthermore, the imaging control unit 105 instructs the imaging elements 103a and 103b to output image data when the shutter button on the operation unit 115 is pressed. Some imaging devices 10 have a preview display function or a function for displaying moving images on a display (for example, a display of an external terminal such as a smartphone that performs short-range communication with the imaging device 10 using the short-range communication circuit 117). In this case, the image data is output continuously from the imaging elements 103a and 103b at a predetermined frame rate (frames / minute).

[0040] As will be described later, the imaging control unit 105 also functions as a synchronization control means that cooperates with the CPU 111 to synchronize the output timing of image data from the imaging elements 103a and 103b. Although the imaging device 10 is not provided with a display unit in this embodiment, a display unit may be provided. The microphone 108 converts sound into sound (signal) data. The sound processing unit 109 receives the sound data output from the microphone 108 via an I / F bus and performs predetermined processing on the sound data.

[0041] The CPU 111 controls the overall operation of the image capturing device 10 and executes necessary processing. The ROM 112 stores various programs for the CPU 111. The SRAM 113 and DRAM 114 are work memories that store programs executed by the CPU 111, data in the middle of processing, etc. In particular, the DRAM 114 stores image data in the middle of processing by the image processing unit 104 and data of processed equirectangular projection images.

[0042] The operation unit 115 is a general term for various operation buttons, a power switch, a shutter button, a touch panel that combines display and operation functions, etc. A user operates the operation unit 115 to input various imaging modes, imaging conditions, etc.

[0043] The input / output I / F 116 is a general term for an interface circuit (such as a USB I / F) with an external medium such as an SD card or a personal computer. The input / output I / F 116 may be wireless or wired. The data of the equirectangular projection image stored in the DRAM 114 is recorded on an external medium via the input / output I / F 116, or transmitted to an external terminal (device) via the input / output I / F 116 as needed.

[0044] The short-range communication circuit 117 communicates with an external terminal (device) by short-range wireless communication technology such as NFC (Near Field Communication), Bluetooth (registered trademark), or Wi-Fi via an antenna 117a provided in the image capturing device 10. The short-range communication circuit 117 can transmit data of the equirectangular projection image to the external terminal (device).

[0045] The electronic compass 118 calculates the direction of the image capturing device 10 from the Earth's magnetism and outputs the direction information. This direction information is an example of related information (metadata) according to Exif, and is used for image processing such as image correction of the captured image. The related information also includes data such as the image capture date and time and the data size of the image data.

[0046] The gyro sensor 119 is a sensor that detects changes in angle (roll angle, pitch angle, yaw angle) that accompany the movement of the image capturing device 10. The changes in angle are an example of related information (metadata) according to Exif, and are used for image processing such as image correction of captured images.

[0047] The acceleration sensor 120 is a sensor that detects acceleration in three axial directions. The image capturing device 10 calculates the attitude (angle with respect to the direction of gravity) of the image capturing device 10 itself (the image capturing device 10) based on the acceleration detected by the acceleration sensor 120. By providing the image capturing device 10 with the acceleration sensor 120, the accuracy of image correction is improved.

[0048] The network I / F 121 is an interface for performing data communication using a communication network 100 such as the Internet via a router or the like. The hardware configuration of the image capturing device 10 is not limited to that shown here, and any hardware configuration may be used as long as it can realize the functional configuration of the image capturing device 10. At least a part of the hardware configuration may be present on the relay device 3 or the communication network 100.

[0049] <Hardware configuration of relay device> Fig. 11 is a diagram showing the hardware configuration of the relay device 3. Note that Fig. 11 shows the hardware configuration when the relay device 3 is a cradle having a wireless communication function.

[0050] As shown in FIG. 11, the relay device 3 includes a CPU 310, a ROM 302, a RAM 303, an EEPROM 304, a CMOS sensor 305, a bus line 310, a communication unit 313, an antenna 313a, a GPS receiving unit 314, and an input / output I / F 316.

[0051] Of these, the CPU 301 controls the overall operation of the relay device 3. The ROM 302 stores programs such as an IPL (Initial Program Loader) used to drive the CPU 301. The RAM 303 is used as a work area for the CPU 301.

[0052] An EEPROM (Electrically Erasable and Programmable ROM) 304 reads or writes data under the control of the CPU 301. The EEPROM 304 stores an operating system (OS) executed by the CPU 301, other programs, and various data.

[0053] The CMOS (Complementary Metal Oxide Semiconductor) sensor 305 is a solid-state image sensor that captures an image of a subject under the control of the CPU 301 and obtains image data.

[0054] The communication unit 313 communicates with the communication network 100 by using a wireless communication signal via an antenna 313a.

[0055] The GPS receiving unit 314 receives a GPS signal including the position information (latitude, longitude, and altitude) of the relay device 3 via a GPS (Global Positioning Systems) satellite or an IMES (Indoor Messaging System) as an indoor GPS.

[0056] The input / output I / F 316 is an interface circuit (such as a USB I / F) electrically connected to the input / output I / F 116 of the image capturing apparatus 10. The input / output I / F 316 may be wireless or wired.

[0057] The bus line 310 is an address bus, a data bus, etc. for electrically connecting the above-mentioned components.

[0058] <Hardware configuration of communication processing system and communication terminal> 12 is a diagram showing the hardware configuration of the communication processing system 5. The hardware configuration of the communication terminals 7 and 9 is the same as that of the communication processing system 5, and therefore a description thereof will be omitted.

[0059] As shown in FIG. 4, the communication processing system 5 is a computer and includes a CPU 501, a ROM 502, a RAM 503, an SSD 504, an external device connection I / F 505, a network I / F 506, a display 507, an operation unit 508, a media I / F 509, a bus line 510, a CMOS sensor 511, and a speaker 512.

[0060] Of these, the CPU 501 controls the overall operation of the communication processing system 5. The ROM 502 stores programs such as IPL used to drive the CPU 501. The RAM 503 is used as a work area for the CPU 501.

[0061] The SSD 504 reads or writes various data under the control of the CPU 501. If the communication terminals 7 and 9 are smartphones or the like, the SSD 504 may not be provided. Alternatively, a hard disk drive (HDD) may be provided instead of the SSD 504.

[0062] The external device connection I / F 505 is an interface for connecting various external devices, such as a display, a speaker, a keyboard, a mouse, a USB memory, and a printer.

[0063] The network I / F 506 is an interface for performing data communication via the communication network 100 .

[0064] The display 507 is a type of display unit such as a liquid crystal display or organic electroluminescence (EL) display that displays various images.

[0065] An operation unit 508 is an input means for selecting and executing various instructions such as various operation buttons, a power switch, a shutter button, and a touch panel, selecting a processing target, moving a cursor, and the like.

[0066] The media I / F 509 controls reading and writing (storing) of data from and to a recording medium 509m such as a flash memory, etc. The recording medium 509m includes DVDs, Blu-ray Discs (registered trademarks), etc.

[0067] The CMOS sensor 511 is a type of imaging means that captures an image of a subject and obtains image data under the control of the CPU 501. A CCD sensor may be used instead of a CMOS sensor.

[0068] The speaker 512 is a circuit that converts electrical signals into physical vibrations to produce sounds such as music and voice.

[0069] The bus line 510 is an address bus, a data bus, etc. for electrically connecting the components such as the CPU 501 shown in FIG.

[0070] [Functional configuration of the embodiment] Next, the functional configuration of this embodiment will be described with reference to Fig. 13 to Fig. 16. Fig. 13 is a diagram showing the functional configuration of the communication system.

[0071] <Functional configuration of the imaging device> 13, the photographing device 10 has a reception unit 12, an imaging unit 16, a sound collection unit 17, a connection unit 18, and a memory / readout unit 19. Each of these units is a function or means realized by any of the components shown in FIG. 10 operating in response to an instruction from the CPU 111 in accordance with a photographing / storage program loaded from the SRAM 113 onto the DRAM 114.

[0072] The image capturing device 10 also includes a storage unit 1000 configured by a ROM 112, an SRAM 113, and a DRAM 114 shown in FIG.

[0073] The reception unit 12 is realized by the processing of the operation unit 115 on the CPU 111, and receives operation input from the user.

[0074] The imaging section 16 is mainly realized by processing from the CPU 111 to the imaging unit 101, the image processing unit 104, the imaging control unit 105, and the CPU 111, and captures images of scenery and the like to obtain captured images.

[0075] The sound collection unit 17 is mainly realized by processing of the sound processing unit 109 from the CPU 111, and collects sounds around the image capturing device .

[0076] The connection unit 18 is mainly realized by processing from the CPU 111 to the input / output I / F 116, and performs data communication with the relay device 3.

[0077] The storage / readout unit 19 is mainly realized by the processing of the CPU 111 , and stores various data (or information) in the storage unit 1000 and reads out various data (or information) from the storage unit 1000 .

[0078] <Functional configuration of relay device> 13, the relay device 3 has a communication unit 31 and a connection unit 38. These units are functions or means realized when any of the components shown in FIG. 11 operates in response to an instruction from the CPU 301 in accordance with the program for the relay device 3 loaded from the EEPROM 304 onto the RAM 303.

[0079] The communication unit 31 is mainly realized by processing from the CPU 301 shown in FIG. 11 to the communication unit 313, and performs data communication between the image capturing device 10 and the communication processing system 5 via the communication network 100.

[0080] The connection unit 38 is mainly realized by processing from the CPU 301 to the input / output I / F 316, and performs data communication with the image capturing device 10.

[0081] <Functional configuration of communication processing system> 13, the communication processing system 5 has a communication unit 51, a reception unit 52, and a storage / readout unit 59. Each of these units is a function or means realized when any of the components shown in FIG. 12 operates in response to an instruction from the CPU 501 in accordance with the program for the communication processing system 5 loaded from the SSD 504 onto the RAM 503.

[0082] The communication unit 51 is mainly realized by processing from the CPU 501 shown in FIG. 11 to the network I / F 505, and performs data communication with other devices (relay device 3, communication terminals 7 and 9) via the communication network 100.

[0083] The reception unit 52 is realized by the processing of the operation unit 508 for the CPU 501, and receives operation input from a user (here, a system administrator or the like).

[0084] The storage / readout unit 59 is mainly realized by the processing of the CPU 501 , and stores various data (or information) in the storage unit 5000 and reads out various data (or information) from the storage unit 5000 .

[0085] The communication processing system 5 also has a storage unit 5000 constructed by the RAM 503 and HD 504 shown in Fig. 12. In this storage unit 5000, a user device management DB 5001, a virtual room management DB 5002, and a viewpoint information management DB 5003 are constructed.

[0086] (User / Device Management DB) 14 is a conceptual diagram of the user device management DB 5001. The user device management DB 5001 is configured in a table format, and stores and manages user IDs (or device IDs), names, and IP addresses in association with each other.

[0087] The user ID is an example of user identification information for identifying a user (observer X, viewers A, B, C). The device ID is an example of device identification information for identifying a device such as the image capture device 10. In FIG. 9, if a head-mounted display or the like is used in addition to the image capture device 10, the head-mounted display or the like is also treated as a device.

[0088] The name is the name of the user or the device, and the IP address is an example of destination identification information for the communication terminal used by the user and the device such as the image capturing device 10.

[0089] (Virtual room management DB) 15 is a conceptual diagram of the virtual room management DB 5002. The virtual room management DB 5002 is configured in a table format, and stores and manages the virtual room ID, virtual room name, device ID, observer ID, viewer ID, and storage (information on the storage location of image data) in association with each other.

[0090] The virtual room ID is an example of virtual room identification information for identifying a virtual room. The virtual room name is the name of the virtual room and is assigned by a user or the like. The device ID is the same as the device ID in FIG. 14 and is the ID of a device that has participated in the virtual room indicated by the virtual room ID of the same record.

[0091] The observer ID is an example of observer identification information for identifying the observer ID among the user IDs in FIG. 14, and is the ID of the observer who participated in the virtual room indicated by the virtual room ID of the same record.

[0092] The viewer ID is an example of viewer identification information for identifying a viewer ID in particular among the user IDs in FIG. 14, and is the ID of a viewer who has participated in the virtual room indicated by the virtual room ID of the same record.

[0093] The storage is an example of storage location information indicating the location where the wide-field image or the like is stored, and specifically indicates a URL, a file path, or the like.

[0094] (Viewpoint Information Management DB) 16 is a conceptual diagram of the viewpoint information management DB 5003. The viewpoint information management DB 5003 is configured in a table format, and stores and manages the viewer ID, IP address, viewpoint information (pan, tilt, fov), and timestamp in association with each other.

[0095] The viewer ID is the same as the viewer ID in Figure 15. The IP address is the same as the IP address in Figure 14. The viewpoint information (pan, tilt, fov) is the viewpoint information sent from the communication terminal of the viewer indicated by the viewer ID of the same record. The timestamp indicates the time when the viewpoint information of the same record was sent.

[0096] <Transmission and reception processing of wide-field image and sound information in communication systems> Fig. 17 is a sequence diagram showing the communication process for wide-field images in a communication system. Note that the process shown in Fig. 17 is performed after the image capture device 10 and the communication terminals 7 and 9 have already joined the same virtual room. Note also that steps S11 to S22 in the process shown in Fig. 17 are repeated, for example, about 30 or 60 times per second.

[0097] S11: In the image capturing device 10, the imaging unit 16 captures a celestial sphere image of the inside of the store Sa to obtain a wide-field image, and then the connection unit 18 sends the wide-field image to the relay device 3. At the same time, in the image capturing device 10, the sound collection unit 17 collects sounds inside the store Sa to obtain sound information, and then the connection unit 18 sends the sound information to the relay device 3. At this time, the connection unit 18 also sends to the relay device 3 a virtual room ID for identifying the virtual room in which the image capturing device 10 is participating and a device ID for identifying the image capturing device 10.

[0098] S12: In the relay device 3, the communication unit 31 transmits the information (wide-field image, sound information, virtual room ID, and device ID) acquired by the connection unit 38 in process S11 to the communication processing system 5 via the communication network 100.

[0099] S13: In the communication processing system 5, the storage and reading unit 59 searches the virtual room management DB 5002 based on the virtual room ID received in process S12, thereby reading out the observer IDs and viewers IDs participating in the same virtual room as the image capturing device 10. The storage and reading unit 59 also searches the user device management DB 5001 based on the read-out observer IDs and viewers IDs, thereby reading out the IP addresses of the communication terminals 7 of the corresponding observers and the IP addresses of the communication terminals 9 of the viewers. The communication unit 51 then references the IP address of the communication terminal 7, and transmits the wide-field image and sound information received in process S12 to the communication terminal 7.

[0100] S14: The communication unit 51 of the communication processing system 5 references the IP address of the communication terminal 9a and transmits the wide-field image and sound information received in step S12 to the communication terminal 9a. As a result, the display control unit 94 of the communication terminal 9a displays the wide-field image on the display, and the sound output control unit 95 outputs sound based on the sound information from the speaker.

[0101] S15: Similarly, the communication unit 51 of the communication processing system 5 references the IP address of communication terminal 9b and transmits the wide-field image and sound information received in process S12 to communication terminal 9b. As a result, in communication terminal 9b, the display control unit 94 displays the wide-field image on the display, and the sound output control unit 95 outputs sound based on the sound information from the speaker.

[0102] S16: Similarly, the communication unit 51 of the communication processing system 5 references the IP address of the communication terminal 9c and transmits the wide-field image and sound information received in step S12 to the communication terminal 9c. As a result, the display control unit 94 of the communication terminal 9c displays the wide-field image on the display, and the sound output control unit 95 outputs sound based on the sound information from the speaker.

[0103] [Image Complement Processing] The image complementing process performed by the communication system according to an embodiment will be described below.

[0104] In the communication system of this embodiment, there are cases where an image of an object is not captured properly by the photographing device 10. For example, there are cases where the distance from the photographing device 10 to the object is too far, or where an obstacle (e.g., a person) exists between the photographing device 10 and the object, etc.

[0105] For this reason, for example, in a facility such as a factory or store, when an object is periodically photographed using the photographing device 10 to periodically check the condition of the object, if the image of the object is not photographed correctly, the image of the object must be photographed again.

[0106] Therefore, in the communication processing system 5 of this embodiment, when the image of the object is not captured properly by the photographing device 10, the communication processing system 5 performs an image complementation process described below, thereby moving the photographing device 10 and causing the photographing device 10 to re-capture the image of the object so that the image of the object can be captured properly by the imaging unit 16 of the photographing device 10. This allows the communication system of this embodiment to more reliably obtain appropriate images when periodically capturing images of the object.

[0107] (Image completion processing function) As shown in FIG. 13, the communication processing system 5 includes a photographing accuracy determining unit 53 and an instruction unit 54 as functions related to image complementation processing.

[0108] The imaging accuracy determination unit 53 determines the imaging accuracy of a predetermined object in an on-site image captured by the imaging device 10. An on-site image is an image (wide-field image) including a predetermined object that is captured by the imaging device 10 at a site within a predetermined facility such as a factory or indoors. For example, if a predetermined determination condition is met, the imaging accuracy determination unit 53 determines that "the imaging accuracy of the predetermined object in the on-site image is sufficient," and if the predetermined determination condition is not met, the imaging accuracy determination unit 53 determines that "the imaging accuracy of the predetermined object in the on-site image is insufficient."

[0109] If the photographing accuracy judgment unit 53 judges that the photographing accuracy of a specified object in the on-site image is insufficient, the instruction unit 54 instructs the photographing device 10 to move (for example, to a new position, etc.) and to photograph again so that the photographing device 10 can photograph the on-site image with sufficient photographing accuracy of the specified object.

[0110] (Image Complement Processing Sequence) 18 is a diagram showing a processing sequence of image complement processing by a communication system according to an embodiment. It is assumed that a plurality of users are participating in the same virtual room to hold a remote conference. In the processing sequence shown in FIG. 18, the relay device 3 is not shown.

[0111] In the processing sequence shown in FIG. 18, first, the image capturing device 10 transmits on-site images to the communication processing system 5 (S31).

[0112] The image capturing device 10 captures a site image including a predetermined object specified by the communication processing system 5. For example, the image capturing device 10 patrols within a predetermined facility to capture images of multiple objects within the facility. In this case, the image capturing device 10 captures a site image including the predetermined object by, for example, performing image recognition of the predetermined object specified by the communication processing system 5. Alternatively, for example, the image capturing device 10 acquires, from the communication processing system 5, location information (such as coordinate information of a GPS system) of a location where a site image including the predetermined object can be captured, and captures a site image including the predetermined object when moving to a location specified by the location information.

[0113] Next, the communication processing system 5 transmits the on-site image to each of the plurality of communication terminals 7, 9 participating in the same virtual room (S32). As a result, the on-site image is displayed on the display of each of the plurality of communication terminals 7, 9, and the on-site image can be simultaneously viewed by the plurality of users participating in the same virtual room.

[0114] Next, the photographing accuracy determining unit 53 of the communication processing system 5 determines the photographing accuracy of a predetermined object in the on-site image (S33).

[0115] In the communication processing system 5, if the photographing accuracy judgment unit 53 judges that the photographing accuracy of a specified object in the on-site image is insufficient, the instruction unit 54 instructs the photographing device 10 to move so that an on-site image of the specified object can be photographed with sufficient photographing accuracy (S34).

[0116] After moving in response to a movement instruction from the communication processing system 5, the photographing device 10 can photograph an on-site image with sufficient photographing accuracy of a predetermined object by re-photographing the on-site image using the imaging unit 16. Then, the photographing device 10 transmits the on-site image re-photographed by the imaging unit 16 to the relay device 3 and the communication processing system 5 via the connection unit 18, thereby allowing multiple users participating in the same virtual room to simultaneously view the re-photographed on-site image.

[0117] Furthermore, users participating in the same virtual room can instruct the communication processing system 5 from the communication terminals 7 and 9 to include additional objects in the on-site image (S35).

[0118] In this case, the imaging accuracy determination unit 53 of the communication processing system 5 checks the image, position, etc. of the additional object (S36). Then, the instruction unit 54 instructs the imaging device 10 to move so that an on-site image including the additional object can be captured (S37).

[0119] After moving in response to the movement instruction, the image capturing device 10 can capture a site image including the additional object by capturing a site image using the imaging unit 16. Then, the image capturing device 10 transmits the site image including the additional object to the communication processing system 5 via the connection unit 18, allowing multiple users participating in the same virtual room to simultaneously view the site image including the additional object.

[0120] In this example, the communication processing system 5 instructs the movement of the photographing device 10 (for example, to a destination position, etc.), but this is not limited to this, and for example, the user may instruct the movement of the photographing device 10 (for example, to a destination position, etc.).

[0121] The instruction unit 54 may also instruct a terminal device (e.g., a mobile terminal, a wearable terminal, etc.) carried by a site worker to move the image capturing device 10 and re-capture the site image. In this case, the site worker may move the image capturing device 10 and operate the image capturing device 10 to re-capture the site image in accordance with the instruction from the instruction unit 54. In this case, the instruction to move and re-capture output by the terminal device may be in any form, such as a character string, an image, or a sound.

[0122] (First Example of Processing Procedure by Communication Processing System 5) FIG. 19 is a flowchart showing an example (first example) of a processing procedure by the communication processing system 5.

[0123] First, the photographing accuracy determination unit 53 acquires an object list showing multiple objects to be checked in a facility such as a factory or store from the storage unit 5000 of the communication processing system 5 in which the object list is stored (step S201). Thereafter, the photographing accuracy determination unit 53 checks whether each of the multiple objects shown in the object list has been photographed by the photographing device 10 with sufficient accuracy.

[0124] Next, the imaging accuracy determination unit 53 adds new images captured by the imaging device 10 to the acquired imaging data (step S202).

[0125] Next, the photographing accuracy determination unit 53 determines whether the photographing accuracy of the predetermined object included in the object list acquired in step S201 is sufficient in the photographed image added in step S202 (step S203). For example, if a predetermined determination condition is met, the photographing accuracy determination unit 53 determines that "the photographing accuracy of the predetermined object is sufficient," and if the predetermined determination condition is not met, the photographing accuracy determination unit 53 determines that "the photographing accuracy of the predetermined object is insufficient."

[0126] In step S203, if it is determined that the "capturing accuracy of the predetermined object is insufficient" for one or more predetermined objects (step S203: NO), the instruction unit 54 instructs the image capturing device 10 to move and capture again so that an on-site image including the additional object can be captured (step S203). Thereafter, the communication processing system 5 returns the process to step S202.

[0127] In step S203, if it is determined that the "photography accuracy of the specified object is sufficient" for all of the multiple objects included in the object list (step S203: YES), the communication processing system 5 terminates the series of processes shown in Figure 5.

[0128] (Adding / removing objects from the object list) In addition, the communication processing system 5 may allow an on-site worker to select any object (an object that has not yet been designated as a target object) from the captured image displayed on the screen of the terminal device he or she is using as a new target object and add it to the target object list.

[0129] In addition, the communication processing system 5 may allow an on-site worker to select any object (an object that has not yet become a target object) from the captured image displayed on the screen of the terminal device he or she is using, and delete that object from the target object list.

[0130] In addition, the communication processing system 5 may allow a user participating in a conference to select any object (an object that has not yet become a target) from the captured image displayed on the screen of the communication terminal 7, 9 that the user is using as a new target and add it to the target list.

[0131] In addition, the communication processing system 5 may allow a user participating in a conference to select any object (an object that is already a target) from the captured image displayed on the screen of the communication terminal 7, 9 that the user is using, and delete the object from the target object list.

[0132] Furthermore, after a new object is added to the object list, if the communication processing system 5 determines that the accuracy of the new object is not sufficient in the latest image captured by the photographing device 10, it may refer to a previous image captured by the photographing device 10, and if it determines that the accuracy of the new object is sufficient in the previous image, it may keep the previous image as evidence without having the photographing device 10 capture the image again.

[0133] (Example of judgment conditions) Fig. 20 is a diagram showing an example of the judgment conditions used by the imaging accuracy judgment unit 53. The judgment condition table 55 shown in Fig. 20 is stored in the storage unit 5000 or the like provided in the communication processing system 5. The judgment condition table 55 indicates a plurality of judgment conditions, and is used by the imaging accuracy judgment unit 53 to judge whether or not the imaging accuracy of a predetermined object is sufficient.

[0134] The judgment condition table 55 has multiple condition groups set, and each condition group is assigned an ID. Each condition group includes one or more judgment conditions. When a condition group includes multiple judgment conditions, the judgment condition applied by the condition group is an AND condition of these multiple judgment conditions.

[0135] For example, in the judgment condition table 55 shown in Fig. 20, a condition group with an ID set to "1" includes one judgment condition indicated as "absence of target object." When using this condition group with an ID of "1" as a judgment condition, if a target object does not exist in an image captured by the image capturing device 10, the photographing accuracy judgment unit 53 judges that "the photographing accuracy of the target object is insufficient."

[0136] 20, the condition group having an ID of "2" includes one judgment condition indicated as "brightness." When the condition group having an ID of "2" is used as a judgment condition, the photographing accuracy judgment unit 53 judges that "the photographing accuracy of the predetermined object is insufficient" if the brightness of the predetermined object in the image photographed by the photographing device 10 is equal to or lower than a predetermined threshold.

[0137] 20, the condition group having an ID of "3" includes a first judgment condition indicated as "estimated distance specified value or less" and a second judgment condition indicated as "apparent size specified value or more." When the condition group having an ID of "3" is used as a judgment condition, the imaging accuracy judgment unit 53 judges that "the imaging accuracy of the predetermined object is sufficient" if the distance between the imaging device 10 and the predetermined object is less than the specified value (i.e., not too far away) and the apparent size of the predetermined object is greater than the specified value (i.e., sufficiently large).

[0138] 20, the condition group having an ID of "4" includes a first determination condition indicated as "shooting from multiple directions" and a second determination condition indicated as "number of shooting frames equal to or greater than a specified value." When the condition group having an ID of "4" is used as a determination condition, if the image capturing device 10 captures an image of a predetermined object from multiple directions and captures a video of the predetermined object with a number of frames equal to or greater than a specified value, the image capturing accuracy determination unit 53 determines that "the image capturing accuracy of the predetermined object is sufficient."

[0139] (Example of output of re-photographing instructions from a terminal device carried by a worker on-site) 21 and 22 are diagrams showing examples of an instruction to re-photograph an image output from a terminal device carried by a worker on-site.

[0140] The example shown in Figure 21 shows an object A1, which is not the object to be re-photographed, being viewed by a worker on-site through the glasses 401 of the wearable terminal 400 worn by the worker.

[0141] 21, an icon 401A is displayed in the upper right corner of the glasses 401 of the wearable terminal 400 to instruct the worker on-site to re-capture the spherical image using the image capturing device 10.

[0142] 21, a graphic 401B (left arrow) indicating the direction of the object to be re-photographed is displayed on the left side of the glasses 401 of the wearable device 400. The worker on-site can easily determine the direction in which the object to be re-photographed is located by using this graphic 401B.

[0143] The example shown in FIG. 22 shows an image of an object A2, which is the target of re-photographing, being viewed by a worker on-site through glasses 401 of a wearable terminal 400 worn by the worker.

[0144] 22, an icon 401A is displayed in the upper right corner of the glasses 401 of the wearable terminal 400 to instruct the worker on-site to re-capture the spherical image using the image capturing device 10.

[0145] 22, a figure 401C (circular frame) indicating that the object is to be re-photographed is displayed at a position overlapping with object A2 on glasses 401 of wearable device 400. On-site workers can easily identify the object to be re-photographed by this figure 401C.

[0146] 21 and 22, graphic 401B indicating the direction of an object and graphic 401C indicating the object are output from wearable terminal 400 worn by a worker on-site, but this is not limiting. For example, graphic 401B indicating the direction of an object and graphic 401C indicating the object may be output from a mobile terminal used by a worker on-site. Also, for example, instead of indicating the object and its direction with a graphic, the object and its direction may be indicated with a character string or sound.

[0147] As described above, the communication processing system 5 of one embodiment is a communication processing system 5 that transmits images captured by the photographing device 10 to multiple communication terminals 7, 9 via the communication network 100, and is equipped with a photographing accuracy judgment unit 53 that judges the photographing accuracy of a specified object in the image captured by the photographing device 10, and an instruction unit 54 that, if the photographing accuracy judgment unit judges that the photographing accuracy is insufficient, instructs the photographing device 10 to move and re-photograph so that an image of the specified object can be captured with sufficient photographing accuracy.

[0148] As a result, the communication processing system 5 according to one embodiment can reliably determine whether an object has been photographed correctly without relying on the judgment of an on-site worker, a conference participant, or the like, and if the object has not been photographed correctly, can relatively quickly acquire an image of the object in which the object has been photographed correctly by instructing the image capturing device 10 to move and photograph again. Therefore, according to the communication processing system 5 according to one embodiment, it is possible to more reliably acquire appropriate images when periodically photographing an object.

[0149] The best mode for carrying out the present invention has been described above using examples, but the present invention is not limited to these examples in any way, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention. [Explanation of symbols]

[0150] 5. Communication Processing System 7,9 Communication terminal (terminal device) 10 Imaging equipment 16 Imaging unit 18 Connection 53 Imaging Accuracy Assessment Department 54 Instruction section 55 Judgment Condition Table 100 Communication Network 400 Wearable Devices 401 Glass 401A Icon 401B, 401C Shapes A1,A2 Object [Prior art documents] [Patent documents]

[0151] [Patent Document 1] Patent No. 7265667

Claims

1. A communication processing system that transmits images captured by an image capturing device to a plurality of terminal devices via a communication network, an imaging accuracy determination unit that determines imaging accuracy of a predetermined object in the image captured by the imaging device; an instruction unit that instructs the photographing device to move and photograph again when the photographing accuracy determination unit determines that the photographing accuracy is not sufficient so that an image of the predetermined object can be photographed with sufficient photographing accuracy; A communication processing system comprising:

2. The instruction unit The on-site worker instructs the terminal device he / she carries to move the image capturing device and take another image.

2. The communication processing system according to claim 1.

3. an object list showing a plurality of objects; The imaging accuracy determination unit determining the imaging accuracy for each of the plurality of objects shown in the object list; The instruction unit Instructing the imaging device to move and re-image an object determined to have insufficient imaging accuracy among the plurality of objects.

2. The communication processing system according to claim 1.

4. The object list can be used to add and delete objects from the terminal device.

4. The communication processing system according to claim 3.

5. When a new object is added to the object list from the terminal device, The imaging accuracy determination unit The accuracy of capturing the new object can be determined from past images captured by the image capture device before the new object was added to the object list.

5. The communication processing system according to claim 4.

6. a judgment condition table in which one or more judgment conditions are set, The imaging accuracy determination unit A determination is made as to whether or not the photographing accuracy of the predetermined object is sufficient based on the one or more determination conditions set in the determination condition table.

2. The communication processing system according to claim 1.

7. 1. An information processing method used in a communication processing system that transmits an image captured by an image capturing device to a plurality of terminal devices via a communication network, comprising: a photographing accuracy determination step of determining photographing accuracy of a predetermined object in the image photographed by the photographing device; an instruction step of instructing the photographing device to move and photograph again so that an image of the predetermined object can be photographed with sufficient photographing accuracy when the photographing accuracy is determined to be insufficient by the photographing accuracy determination step; An information processing method comprising:

8. A program used in a communication processing system that transmits images captured by an image capturing device to multiple terminal devices via a communication network, Computer, an imaging accuracy determination unit that determines imaging accuracy of a predetermined object in the image captured by the imaging device; an instruction unit that instructs the photographing device to move and photograph again so that an image of the predetermined object can be photographed with sufficient photographing accuracy when the photographing accuracy determination unit determines that the photographing accuracy is not sufficient. A program that functions as a

9. A communication system that transmits images captured by an imaging device to a plurality of terminal devices via a communication processing system, The communication processing system includes: an imaging accuracy determination unit that determines imaging accuracy of a predetermined object in an image captured by the imaging device; an instruction unit that instructs the photographing device to photograph an image of the predetermined object with sufficient photographing accuracy when the photographing accuracy determination unit determines that the photographing accuracy is not sufficient, The imaging device is an imaging unit that re-captures an image based on an instruction from the communication processing system; a connection unit for transmitting the re-captured image to the communication processing system; A communication system having:

10. 1. An information processing method used in a communication system in which an image captured by an image capturing device is transmitted to a plurality of terminal devices via a communication processing system, comprising: the communication processing system, a photographing accuracy determination step of determining photographing accuracy of a predetermined object in an image photographed by the photographing device; and if it is determined that the photographing accuracy is not sufficient by the photographing accuracy determination step, executing an instruction step of instructing the photographing device so that the photographing device can photograph an image of the predetermined object with sufficient photographing accuracy, The imaging device is an imaging step of re-capturing an image based on an instruction from the communication processing system; a connection step of transmitting the re-captured image to the communication processing system. Information processing methods.

11. A program used in a communication system that transmits images captured by an image capturing device to a plurality of terminal devices via a communication processing system, the communication processing system, an imaging accuracy determination unit that determines imaging accuracy of a predetermined object in an image captured by the imaging device; when the photographing accuracy determination unit determines that the photographing accuracy is insufficient, the photographing device functions as an instruction unit that instructs the photographing device so that the photographing device can photograph an image of the predetermined object with sufficient photographing accuracy; The imaging device, an imaging unit that re-captures an image based on an instruction from the communication processing system; and a connection unit for transmitting the re-captured image to the communication processing system; program.

Images