Communication System

Abstract

The present invention provides a communication system. It is possible to acquire peripheral images based on multiple angles with a simple structure that suppresses costs. The communication system (1) comprises: a communication unit (30) that performs relay communication for relaying communication between a mobile communication terminal (51-55) and a communication device (510) by performing a first communication between a first camera (32-34) and a mobile communication terminal (51-55) and a second communication with a communication device (510) other than the mobile communication terminal (51-55); a communication control unit (12) that receives data of a second camera image captured by a second camera (51a-55a) of the mobile communication terminal (51-55) through a first communication for relay communication from the mobile communication terminal (51-55) with which the first communication is established; and an image processing unit (14) that performs prescribed image processing based on the data of the first camera image captured by the first camera (32-34) and the data of the second camera image.

Description

Technical Field

[0001] The present invention relates to communication systems. Background Art

[0002] In the past, a system has been proposed in which a driving recorder mounted on a vehicle has a function of communicating with an image collection device outside the moving object, and transmits images captured by the driving recorder to the image collection device (for example, see Patent Document 1). In this system, in addition to accident detection, the captured images are also used for fixed-point observation, search for lost children, confirmation of the situation at a fire scene, and other purposes.

[0003] Prior Art Literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2003-87615 Summary of the invention

[0006] Problems to be solved by the invention

[0007] In the case of the above-mentioned prior art, the obtained images are limited to the images taken by the fixed-angle camera of the driving recorder. Therefore, there is a disadvantage that it is difficult to collect images taken in a wide range. Although the use of an omnidirectional camera is also considered, it will cause disadvantages such as an increase in device cost and complication of image processing.

[0008] The present invention has been made in view of the above background, and an object of the present invention is to provide a communication system capable of acquiring images of the surrounding area at various angles with a simple structure at reduced cost.

[0009] Means for solving problems

[0010] As a method for achieving the above-mentioned purpose, there can be cited a communication system comprising: a first shooting device; a communication unit, which performs relay communication for relaying communication between the mobile communication terminal and the communication device by performing a first communication with the mobile communication terminal and a second communication with a communication device other than the mobile communication terminal; a communication control unit, which receives data of a second shot image captured by a second shooting device possessed by the mobile communication terminal from the mobile communication terminal with which the first communication is established through the first communication used for the relay communication; and an image processing unit, which performs prescribed image processing based on the data of the first shot image captured by the first shooting device and the data of the second shot image.

[0011] In the above-mentioned communication system, it can also be constructed as follows: the communication system has a synchronous shooting time determination unit, which determines the synchronous shooting time for synchronizing the shooting of the first shooting device and the second shooting device, the communication control unit sends synchronous shooting time information representing the synchronous shooting time to the mobile communication terminal for which the first communication for the relay communication is established through the first communication, the communication control unit receives data of the second shooting image captured by the second shooting device at the synchronous shooting time based on the synchronous shooting time information through the first communication, and the image processing unit performs the prescribed image processing based on the data of the first shooting image captured by the first shooting device at the synchronous shooting time and the data of the second shooting image captured by the second shooting device at the synchronous shooting time.

[0012] In the above communication system, the image processing unit may execute, as the predetermined image processing, a process of generating integrated image data obtained by associating data of the first captured image with data of the second captured image.

[0013] In the above communication system, the communication control unit may be configured to transmit the integrated image data to the communication device through the second communication.

[0014] In the above-mentioned communication system, it can also be constructed as follows: the communication system is used in a mobile body, and the communication system has a mobile communication terminal position identification unit, which identifies whether the mobile communication terminal is located at a specified position in the mobile body, and the communication control unit receives the data of the second captured image through the first communication when the mobile communication terminal position identification unit identifies that the mobile communication terminal is located at the specified position.

[0015] In the above communication system, the mobile communication terminal position identification unit may set the predetermined location according to the number of the mobile communication terminals for which the first communication for the relay communication is established.

[0016] In the above-mentioned communication system, it can also be configured that the mobile communication terminal position recognition unit identifies the posture of the mobile communication terminal when recognizing that the mobile communication terminal is located at the specified position in the mobile body, and the communication control unit receives the data of the second captured image through the first communication when the mobile communication terminal position recognition unit recognizes that the mobile communication terminal is located at the specified position with a specified posture.

[0017] In the above-mentioned communication system, it can also be constructed that the communication system has a mobile communication terminal performance identification unit, which identifies the performance of the mobile communication terminal, and the communication control unit receives the data of the second captured image from the mobile communication terminal through the first communication when the mobile communication terminal performance identification unit identifies that the performance of the mobile communication terminal for which the first communication for the relay communication is established is a specified performance.

[0018] In the above-mentioned communication system, it can also be configured that the communication unit performs the relay communication on the multiple mobile communication terminals through the first communication between the multiple mobile communication terminals, and the communication control unit receives the data of the second captured image captured by the second capturing device possessed by the multiple mobile communication terminals with which the first communication has been established through the first communication used for the relay communication.

[0019] The communication system is composed of a camera or a driving recorder.

[0020] Effects of the Invention

[0021] According to the above communication system, it is possible to acquire images of the surroundings at various angles with a simple configuration while suppressing costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 This is a diagram showing how to use a driving recorder.

[0023] Figure 2 It is the structural diagram of the driving recorder.

[0024] Figure 3 This is a first flowchart of the captured image provision process.

[0025] Figure 4 This is a second flowchart of the captured image provision process.

[0026] Description of symbols

[0027] 1…driving recorder, 10…processor, 11…shooting control unit, 12…communication control unit, 14…image processing unit, 15…synchronous shooting time determination unit, 17…mobile communication terminal position recognition unit, 18…timing unit, 19…speed recognition unit, 20…memory, 21…control program, 22…shooting image area, 30…NAD, 31…antenna, 32…front camera, 33…rear camera, 34…in-vehicle camera, 35…GNSS, 36…acceleration sensor, 37…switch, 38…display, 51 to 55…mobile communication terminal, 51a to 55a…camera, 100…vehicle (moving body), 110…other vehicles, 300…base station of cellular communication, 310…router of Wi-Fi spot, 500…wide area network, 510…image management server, 520…information providing server, U1 to U5…users. DETAILED DESCRIPTION

[0028] [1. How to use the dashcam]

[0029] Reference Figure 1 The following describes the use of a driving recorder 1 as an example of the structure of the communication system of the present invention. The driving recorder 1 is installed in a vehicle 100 and has a function of photographing the surroundings of the vehicle 100 and the interior of the vehicle 100 through a camera. The vehicle 100 is equivalent to a mobile object of the present invention.

[0030] The driving recorder 1 has the function of performing cellular communication and Wi-Fi (registered trademark) communication. The driving recorder 1 communicates with an external communication device (equivalent to the communication device of the present invention) via a wide area network 500 by performing cellular communication with a base station 300 of each cell or by performing Wi-Fi communication with a router 310 installed at a Wi-Fi point near a road. Figure 1 In FIG. 5 , as the external communication devices, an image management server 510 and an information providing server 520 are exemplified.

[0031] In addition, the driving recorder 1 has a Wi-Fi router function, and the Wi-Fi router establishes Wi-Fi communication with the mobile communication terminals 51 and 52 used by the users U1 and U2 in the vehicle 100, thereby realizing an in-vehicle Wi-Fi network environment. The mobile communication terminals 51 and 52 are smart phones, mobile phones, tablet terminals, portable game consoles, etc. with Wi-Fi communication functions. The mobile communication terminals 51 and 52 are respectively equipped with cameras 51a and 52a.

[0032] The driving recorder 1 functions as a Wi-Fi router, and can enable communication between the mobile communication terminals 51 and 52 and external communication devices such as the image management server 510 and the information providing server 520 via the in-vehicle Wi-Fi network and the wide area network 500. Even if the mobile communication terminals 51 and 52 do not have a cellular communication function, the users U1 and U2 can utilize the in-vehicle Wi-Fi environment provided by the driving recorder 1, for example, to communicate with the information providing server 520 to obtain information.

[0033] In addition, the driving recorder 1 can also communicate with the mobile communication terminals 53, 54, and 55 outside the vehicle near the vehicle 100 through the in-vehicle Wi-Fi network environment. Figure 1 , there is shown an example of wireless communication between the mobile communication terminal 53 used by the user U3 standing on the sidewalk, and the mobile communication terminals 54 and 55 used by the users U4 and U5 in the opposite vehicle 110, and the driving recorder 1 using the in-vehicle Wi-Fi. The mobile communication terminals 53 to 55 are respectively equipped with cameras 53a to 55a.

[0034] The drive recorder 1 transmits the images captured by the camera to the image management server 510 via the wide area network 500. The image management server 510 uses the captured images received from the drive recorder 1 to perform processes such as accident analysis, fixed-point observation, and road equipment inspection.

[0035] Here, the wireless communication between the driving recorder 1 and the mobile communication terminals 51 to 55 is equivalent to the first communication of the present invention, and the wireless communication between the driving recorder 1 and the external communication devices such as the image management server 510 and the information providing server 520 is equivalent to the second communication of the present invention. Through the first communication and the second communication, relay communication is performed to relay the communication between the mobile communication terminals 51 to 55 and the external communication devices. The cameras 51a to 55a respectively provided in the mobile communication terminals 51 to 55 are equivalent to the second shooting equipment of the present invention.

[0036] [2. Structure of the driving recorder]

[0037] Reference Figure 2, the structure of the driving recorder 1 is described. The driving recorder 1 includes a processor 10, a memory 20, a NAD (Network Access Device) 30, an antenna 31, a front camera 32, a rear camera 33, an in-vehicle camera 34, a GNSS (Global Navigation Satellite System) sensor 35, an acceleration sensor 36, a switch 37, and a display 38. The front camera 32, the rear camera 33, and the in-vehicle camera 34 are equivalent to the first shooting device of the present invention.

[0038] NAD 30 is a chip integrating a cellular communication module and a Wi-Fi communication module. Antenna 31 is a dual-purpose antenna supporting cellular communication and Wi-Fi communication. NAD 30 and antenna 31 constitute a communication unit of the present invention.

[0039] The front camera 32 captures the front surroundings of the vehicle 100 and outputs the captured images to the processor 10. The rear camera 33 captures the rear surroundings of the vehicle 100 and outputs the captured images to the processor 10. The interior camera 34 captures the interior of the vehicle 100 and outputs the captured images to the processor. In addition, the front camera 32, the rear camera 33, and the interior camera 34 may not all be provided, and, for example, only the front camera 32 may be provided.

[0040] The GNSS sensor 35 receives radio waves from positioning satellites to detect the current position (latitude, longitude) of the driving recorder 1, and outputs a position detection signal to the processor 10. The acceleration sensor 36 detects the acceleration generated in the driving recorder 1, and outputs an acceleration detection signal to the processor 10. The acceleration sensor 36 detects acceleration in three orthogonal axis directions, for example. The switch 37 outputs an operation signal corresponding to the operation of the user U1, U2 to the processor 10. The display 38 displays the operation status of the driving recorder 1, etc. according to the control input from the processor 10.

[0041] The processor 10 functions as a shooting control unit 11, a communication control unit 12, an image processing unit 14, a synchronous shooting time determination unit 15, a mobile communication terminal position recognition unit 17, a timing unit 18, and a speed recognition unit 19 by reading and executing a control program 21 of the driving recorder 1 stored in the memory 20.

[0042] The imaging control unit 11 performs imaging using at least one of the front camera 32, the rear camera 33, and the in-vehicle camera 34 at a predetermined imaging time, and stores the data of the captured image (first captured image) in the captured image area 22 of the memory 20. As the imaging time, for example, the following times (1) to (3) are set.

[0043] (1) When the vehicle 100 encounters an accident.

[0044] The imaging control unit 11 recognizes that the vehicle 100 has encountered an accident by detecting acceleration of a level greater than a predetermined threshold by the acceleration sensor 36. Alternatively, the vehicle 100 may recognize that the vehicle 100 has encountered an accident based on an impact detection signal of an impact sensor provided in an airbag or the like installed in the vehicle 100.

[0045] (2) When the vehicle 100 is traveling at a predetermined location.

[0046] The shooting control unit 11 recognizes that the vehicle 100 is traveling at a predetermined location set in advance based on the current location of the driving recorder 1 detected by the GNSS sensor 35. The predetermined location may be a location where traffic jams are likely to occur, a location where road equipment (road signs, utility poles, etc.) to be maintained, a tourist spot, etc.

[0047] (3) When the vehicle 100 is traveling at the imaging request point.

[0048] The shooting control unit 11 identifies the shooting request location by receiving the shooting request location information transmitted from the image management server 510, and identifies that the vehicle 100 is traveling at the shooting request location based on the current position of the driving recorder 1 detected by the GNSS sensor 35. As the shooting request location, for example, the scene of an accident involving another vehicle, the scene of a fire, the scene of a missing child, etc. are set.

[0049] The communication control unit 12 controls the in-vehicle Wi-Fi communication based on the NAD 30 and the communication with the external communication device via the wide area network 500. The communication control unit 12 groups the data obtained by combining the in-vehicle Wi-Fi information data and the captured image data, and communicates with the external communication device via the wide area network 500 through packet communication. Through this processing, the overhead of the control data added to the information data such as the captured image sent by packetization is reduced, thereby reducing the communication volume, thereby reducing the communication cost borne by the users U1 and U2.

[0050] The communication control unit 12 receives the data of the image (second captured image) captured by the mobile communication terminals 51 and 52 from the mobile communication terminals 51 and 52 through the first communication. The processing of the communication control unit 12 to obtain the data of the second captured image will be described later. The image processing unit 14 generates integrated image data, which is obtained by associating and recording the data of the image (first captured image) captured by the front camera 32, the rear camera 33, and the in-vehicle camera 34 with the data of the second captured image received by the communication control unit 12. The processing of the image processing unit 14 to generate the integrated image data is equivalent to the prescribed image processing of the present invention.

[0051] The synchronous shooting time determination unit 15 determines the synchronous shooting time for synchronizing the shooting of the front camera 32, the rear camera 33 and the in-vehicle camera 34 in the driving recorder 1 with the shooting of the cameras 51a and 52a in the mobile communication terminals 51 and 52. The communication control unit 12 transmits the integrated image data generated by the image processing unit 14 to the image management server 510 via the wide area network 500 through the NAD 30.

[0052] The mobile communication terminal position recognition unit 17 determines whether the mobile communication terminals 51 and 52 used in the vehicle interior are located at a predetermined location based on the image of the vehicle interior 100 captured by the in-vehicle camera 34. The predetermined location is, for example, the location where the bracket for the mobile communication terminal is installed (the neck of the headrest of the seat, etc.). Figure 1 , a situation where the mobile communication terminal 52 is located at a predetermined position is illustrated.

[0053] The timing unit 18 performs a process of timing the current date and time. The shooting control unit 11 adds the information of the date and time of the shooting time timed by the timing unit 18 to the captured images captured by the front camera 32, the rear camera 33 and the in-vehicle camera 34, and stores the data of the first captured image in the captured image area 22 of the memory 20. The speed recognition unit 19 recognizes the driving speed (moving speed) of the vehicle 100 by receiving the speed detection signal Vcar of the vehicle speed sensor of the vehicle 100. The driving recorder 1 receives the speed detection signal Vcar by performing wired or wireless communication with the ECU (Electronic Control Unit) of the vehicle 100. The speed recognition unit 19 can also recognize the driving speed (moving speed) of the vehicle 100 by performing prescribed image processing on the captured images.

[0054] [3. Processing of providing captured images]

[0055] according to Figure 3 to Figure 4 The flowchart shown in the figure explains the processing of providing the captured image executed by the drive recorder 1.

[0056] exist Figure 3 In step S1, the shooting control unit 11 enters the process into step S2 when it becomes any of the shooting moments in (1) to (3) above. In step S2, the shooting control unit 11 determines whether there is a mobile communication terminal with which the in-vehicle Wi-Fi communication is established with the NAD 30. Then, if there is a mobile communication terminal with which the in-vehicle Wi-Fi communication is established, the shooting control unit 11 enters the process into step S3, and if there is no mobile communication terminal with which the in-vehicle Wi-Fi communication is established, the shooting control unit 11 enters the process into step S20.

[0057] In step S20, the photographing control unit 11 performs photographing based on at least one of the front camera 32, the rear camera 33, and the in-vehicle camera 34, and stores the data of the first photographed image in the photographed image area 22 of the memory 20. In the next step S21, the communication control unit 12 sends the data of the first photographed image to the image management server 510 via the NAD 30, and the process enters Figure 4 In this case, only the data of the first captured image captured by the drive recorder 1 is sent to the image management server 510 .

[0058] In step S3, the mobile communication terminal position recognition unit 17 recognizes the position of the mobile communication terminal in the cabin of the vehicle 100 by extracting the image portion of the mobile communication terminal from the image captured by the in-vehicle camera 34. Figure 1 In the example of FIG. 1 , the positions of the mobile communication terminals 51 and 52 used in the vehicle cabin of the vehicle 100 are recognized. In the next step S4, the mobile communication terminal position recognition unit 17 determines whether the position of the mobile communication terminal is the above-mentioned predetermined position.

[0059] exist Figure 1 In the example, it is determined that the mobile communication terminal 52 is located at the specified location. Then, the mobile communication terminal location recognition unit 17 causes the processing to enter step S5 when the location of the mobile communication terminal is the specified location, and causes the processing to enter step S20 when the location of the mobile communication terminal is not the specified location. In step S5, the synchronous shooting time determination unit 15 determines the synchronous shooting time based on the shooting time identified in step S1, and the synchronous shooting time is used to synchronize the shooting of the driving recorder 1 and the mobile communication terminal. In the next step S6, the communication control unit 12 sends the synchronous shooting time notification information notifying the synchronous shooting time to the mobile communication terminal 52 through the in-vehicle Wi-Fi communication based on NAD30.

[0060] When the mobile communication terminal 52 receives the synchronous shooting time notification information sent from the driving recorder 1, it identifies the synchronous shooting time from the synchronous shooting time notification information, and performs shooting with the camera 52a when it becomes the synchronous shooting time. Then, the mobile communication terminal 52 sends the data of the captured second shot image to the driving recorder 1 through the in-vehicle Wi-Fi communication based on NAD30. In addition, the shooting of the driving recorder 1 and the mobile communication terminal 52 may also be the shooting of dynamic images or continuous images spanning the period before and after the synchronous shooting time.

[0061] Return to Figure 3 , the communication control unit 12 and the shooting control unit 11 execute the processing of steps S7 and S8 and the processing of steps S30 and S31 in parallel. When the communication control unit 12 receives the data of the second shot image from the mobile communication terminal 52 in step S7, the processing proceeds to step S8, the data of the second shot image is stored in the shot image area 22 of the memory 20, and the processing proceeds to step S9. Figure 4 Step S9.

[0062] In addition, when the synchronous shooting time is reached in step S30, the shooting control unit 11 advances the processing to step S31, and performs shooting using at least one of the front camera 32, the rear camera 33, and the in-vehicle camera 34. Then, the shooting control unit 11 stores the data of the first shot image captured in the shot image area 22 of the memory 20, and advances the processing to step S32. Figure 4 Step S9.

[0063] In step S9, the image processing unit 14 generates integrated image data by associating and recording the data of the first captured image and the data of the second captured image stored in the captured image area 22 by the imaging control unit 11. In the next step S10, the communication control unit 12 transmits the integrated image data generated by the image processing unit 14 to the image management server 510 via the wide area network 500 through the communication control unit 12 and the NAD 30.

[0064] The comprehensive image data includes data of a first captured image captured by the front camera 32, the rear camera 33 or the in-vehicle camera 34 of the driving recorder 1 at the same time (the synchronous shooting time, the period before and after the synchronous shooting time), and data of a second captured image captured by the camera 52a of the mobile communication terminal 52.

[0065] Therefore, the image management server 510 can obtain the images of the periphery of the vehicle 100 or the interior of the vehicle 100 taken at multiple angles at the same time by integrating the image data. In addition, the image management server 510 can obtain more detailed information about the accident that occurred in the vehicle 100 by analyzing the data of the first image and the data of the second image.

[0066] [4. Other embodiments]

[0067] In the above embodiment, the four-wheeled vehicle 100 is exemplified as the mobile object on which the drive recorder 1 is mounted, but the mobile object on which the drive recorder 1 is mounted may be a two-wheeled vehicle, an aircraft, a ship, or the like.

[0068] In the above-mentioned embodiment, access to the wide area network 500 is performed by cellular or Wi-Fi communication, but it can also be performed by other communication methods. In addition, communication between the mobile communication terminals 51, 52 used by the users U1, U2 of the vehicle 100 and the driving recorder 1 is performed by in-vehicle Wi-Fi (equivalent to the second communication network of the present invention), but it can also be performed by other communication standards such as Bluetooth (registered trademark).

[0069] In the above embodiment, an example is shown in which the communication system of the present invention is constituted by the driving recorder 1, but the communication system of the present invention can also be constituted by a communication terminal with a camera (smartphone, mobile phone, tablet terminal, camera with communication function, etc.).

[0070] In the above embodiment, according to Figure 3 As shown in the flowchart, the communication control unit 12 limits the mobile communication terminal (at a predetermined position of the vehicle 100) to Figure 1 In the example of the mobile communication terminal 52, the synchronous shooting time notification information is sent and the data of the second shooting image shot by the mobile communication terminal is obtained. As another structure, it is also possible to use the mobile communication terminal used in the vehicle 100 (in Figure 1 In the example of FIG. 5 , the mobile communication terminals 51 and 52 are used as the objects to send the synchronous shooting time notification information and obtain the data of the second shot image shot by the mobile communication terminals.

[0071] In addition, the mobile communication terminal position recognition unit 17 may also set a predetermined position for recognizing the position of the mobile communication terminal according to the number of mobile communication terminals that have established in-vehicle Wi-Fi communication with the driving recorder 1. For example, when there is one mobile communication terminal with which the first communication for relay communication is established, the predetermined position is set to a position that can capture the rear of the vehicle 1, when there are two mobile communication terminals, the predetermined position is set to a position that can capture the right rear of the vehicle 1 and a position that can capture the left rear of the vehicle 1, and when there are three mobile communication terminals, the predetermined position is set to a position that can capture the right rear of the vehicle 1, a position that can capture the center of the rear of the vehicle 1, and a position that can capture the left rear of the vehicle 1, thereby expanding the capturing range around the vehicle 1.

[0072] Furthermore, it may be that the mobile communication terminal position recognition unit 17 recognizes the posture of the mobile communication terminal when recognizing that the mobile communication terminal is located at the specified position of the vehicle 1, and the communication control unit 12 receives data of the second captured image through the in-vehicle Wi-Fi communication when the mobile communication terminal position recognition unit 17 recognizes that the mobile communication terminal is located at the specified position with a specified posture.

[0073] In the above-mentioned embodiment, a mobile communication terminal performance identification unit for identifying the performance of the mobile communication terminal may also be provided. When the mobile communication terminal performance identification unit identifies that the performance of the mobile communication terminal with which in-vehicle Wi-Fi communication has been established is as specified, the communication control unit 12 receives data of the second captured image from the mobile communication terminal through in-vehicle Wi-Fi communication.

[0074] In the above embodiment, there is a synchronous shooting time determination unit 15, which synchronizes the shooting in the driving recorder 1 with the shooting in the mobile communication terminals 51 and 52, but the synchronous shooting time determination unit 15 can also be omitted to obtain the data of the second captured image captured by the mobile communication terminals 51 and 52 at any time.

[0075] Alternatively, the mobile communication terminal used in the vehicle 100 may be a mobile communication terminal ( Figure 1 The mobile communication terminals 51 to 55 in the example are taken as targets, the synchronous shooting time notification information is notified, and the second captured image data captured by each mobile communication terminal is obtained.

[0076] In the above embodiment, the structure of the driving recorder 1 and the mobile communication terminals 51 to 55 performing wireless communication is shown. Figure 1As shown, when the mobile communication terminals 51 and 52 are used in the cabin of the vehicle 100, the mobile communication terminals 51 and 52 may be connected to the drive recorder 1 via communication cables to perform wired communication.

[0077] In the above-mentioned embodiment, as the prescribed image processing based on the first captured image data and the second captured image data, the image processing unit 14 performs processing to generate integrated image data, which is obtained by associating the data of the first captured image with the data of the second captured image. As other image processing based on the first captured image data and the second captured image data, for example, processing such as recognition of objects existing around the vehicle 1 and determination of the risk of contact with the objects may also be performed.

[0078] also, Figure 2 This is a schematic diagram showing the structure of the driving recorder 1 according to the main processing contents for easy understanding of the present invention. The structure of the driving recorder 1 may also be configured in other ways. In addition, the processing of each structural element may be performed by one hardware unit or by multiple hardware units. Figure 3-4 The processing of each component of the flowchart shown may be executed by one program or by a plurality of programs.

[0079] [4. Structure supported by the above-mentioned embodiments]

[0080] The above-mentioned embodiment supports the following structure.

[0081] (Structure 1) A communication system comprising: a first camera; a communication unit that performs relay communication for relaying communication between a mobile communication terminal and a communication device other than the mobile communication terminal by performing a first communication with the mobile communication terminal and a second communication with a communication device other than the mobile communication terminal; a communication control unit that receives data of a second captured image captured by a second camera provided to the mobile communication terminal from the mobile communication terminal with which the first communication is established through the first communication used for the relay communication; and an image processing unit that performs prescribed image processing based on the data of the first captured image captured by the first camera and the data of the second captured image.

[0082] According to the communication system of structure 1, it is possible to obtain data of second captured images at various angles captured by the second camera of the mobile communication terminal together with data of first captured images captured by the first camera of the communication system through a simple structure that suppresses costs.

[0083] (Structure 2) A communication system according to Structure 1, wherein the communication system has a synchronous shooting moment determination unit, which determines a synchronous shooting moment for synchronizing shooting of the first shooting device and the second shooting device, the communication control unit sends synchronous shooting moment information indicating the synchronous shooting moment to the mobile communication terminal to which the first communication for the relay communication is established through the first communication, the communication control unit receives data of the second shooting image captured by the second shooting device at the synchronous shooting moment based on the synchronous shooting moment information through the first communication, and the image processing unit performs the prescribed image processing based on the data of the first shooting image captured by the first shooting device at the synchronous shooting moment and the data of the second shooting image captured by the second shooting device at the synchronous shooting moment.

[0084] According to the communication system of structure 2, by performing image processing using data of a first captured image captured by a first capturing device of the communication system and data of a second captured image captured by a second capturing device of a mobile communication terminal at the same time, it is possible to identify an object, determine the risk of contact with the object, etc.

[0085] (Structure 3) A communication system according to Structure 1 or Structure 2, wherein, as the prescribed image processing, the image processing unit performs processing for generating integrated image data obtained by associating data of the first captured image with data of the second captured image.

[0086] According to the communication system of structure 3, it is possible to obtain comprehensive image data, which is data that associates the first image data captured by the first camera of the communication system and the second image data captured by the second camera of the mobile communication terminal at the same time.

[0087] (Structure 4) The communication system according to Structure 3, wherein the communication control section transmits the integrated image data to the communication device through the second communication.

[0088] According to the communication system of the configuration 4, it is possible to provide the integrated image data including the data of the second photographed image photographed by the second photographing device of the mobile communication terminal to the communication device.

[0089] (Structure 5) A communication system according to any one of Structures 1 to 4, wherein the communication system is used in a mobile body, the communication system has a mobile communication terminal position identification unit, the mobile communication terminal position identification unit identifies whether the mobile communication terminal is located at a specified position in the mobile body, and the communication control unit receives data of the second captured image through the first communication when the mobile communication terminal position identification unit identifies that the mobile communication terminal is located at the specified position.

[0090] According to the communication system of Configuration 5, it is possible to capture an image of the interior of the moving object or the vicinity of the moving object by the second imaging device of the mobile communication terminal used inside the moving object or the vicinity of the moving object and obtain the image.

[0091] (Structure 6) The communication system according to Structure 5, wherein the mobile communication terminal position identification unit sets the predetermined location according to the number of the mobile communication terminals for which the first communication for the relay communication is established.

[0092] According to the communication system of Configuration 6, it is possible to set a predetermined location corresponding to the imaging range covered by the second imaging device of the mobile communication terminal according to the number of mobile communication terminals with which the first communication for relaying communication is established.

[0093] (Structure 7) A communication system according to Structure 5 or Structure 6, wherein the mobile communication terminal position recognition unit recognizes the posture of the mobile communication terminal when recognizing that the mobile communication terminal is located at the specified position in the mobile body, and the communication control unit receives data of the second captured image through the first communication when the mobile communication terminal position recognition unit recognizes that the mobile communication terminal is located at the specified position with a specified posture.

[0094] According to the communication system of configuration 7, by recognizing the posture of the mobile communication terminal, it is possible to specify the shooting range and shooting direction of the second camera of the mobile communication terminal in more detail and obtain the data of the second captured image captured by the second camera.

[0095] (Structure 8) A communication system according to any one of Structures 1 to 7, wherein the communication system has a mobile communication terminal performance identification unit that identifies the performance of the mobile communication terminal, and the communication control unit receives data of the second captured image from the mobile communication terminal through the first communication when the mobile communication terminal performance identification unit identifies that the performance of the mobile communication terminal for which the first communication for the relay communication is established is a specified performance.

[0096] According to the communication system of structure 8, it is possible to limit the reception of data of the second captured image captured by the second camera from the mobile communication terminal when the communication performance of the mobile communication terminal and the performance of the second camera possessed by the mobile communication terminal are above a specified level.

[0097] (Structure 9) A communication system according to any one of Structures 1 to 8, wherein the communication unit performs the relay communication for multiple mobile communication terminals through the first communication between the multiple mobile communication terminals, and the communication control unit receives data of the second captured image captured by the second captured device possessed by the multiple mobile communication terminals with which the first communication has been established through the first communication used for the relay communication.

[0098] According to the communication system of Configuration 9, by receiving data of second photographed images photographed by second photographing devices of a plurality of mobile communication terminals, data of photographed images in a wide range can be collected.

[0099] (Structure 10) A communication system according to any one of Structures 1 to 9, wherein the communication system is composed of a camera or a driving recorder.

[0100] According to the communication system of structure 10, the communication systems of structures 1 to 9 can be implemented as the functions of a camera or a driving recorder.

Claims

1. A communication system comprising: A first camera, mounted on the vehicle, photographing the surroundings of the vehicle; a communication unit that performs relay communication for relaying communication between the mobile communication terminal and the communication device by performing first communication with the mobile communication terminal and second communication with a communication device other than the mobile communication terminal; a communication control unit that receives, from the plurality of mobile communication terminals that have established the first communication, data of a second captured image captured by a second camera respectively provided at least one mobile communication terminal used by at least one user riding in the vehicle and at least one mobile communication terminal outside the vehicle near the vehicle, through the first communication used for the relay communication; as well as An image processing unit generates integrated image data by integrating data of a first captured image and data of the second captured image captured by the first camera, wherein the data of the first captured image and the data of the second captured image are captured at the same time.

2. The communication system according to claim 1, wherein: The communication system includes a synchronous imaging time determination unit that determines a synchronous imaging time for synchronizing the imaging times of the first camera and the second camera. the communication control unit transmits, through the first communication, synchronous shooting time information indicating the synchronous shooting time to the mobile communication terminal that has established the first communication for the relay communication, The communication control unit receives, through the first communication, data of the second captured image captured by the second camera at the synchronous capturing time based on the synchronous capturing time information, The image processing unit generates the integrated image data based on data of the first captured image captured by the first camera at the synchronous capturing time and data of the second captured image captured by the second camera at the synchronous capturing time.

3. The communication system according to claim 1, wherein: The communication control unit transmits the integrated image data to the communication device through the second communication.

4. The communication system according to claim 1, wherein: The communication system includes a mobile communication terminal position recognition unit, the mobile communication terminal position recognition unit recognizing whether the mobile communication terminal is located at a predetermined position of the vehicle, The communication control unit receives the data of the second captured image through the first communication when the mobile communication terminal position recognition unit recognizes that the mobile communication terminal is located at the predetermined location.

5. The communication system according to claim 4, wherein: The mobile communication terminal position recognition unit sets the predetermined location according to the number of the mobile communication terminals that have established the first communication for the relay communication.

6. The communication system according to claim 4, wherein: The mobile communication terminal position recognition unit recognizes the posture of the mobile communication terminal when recognizing that the mobile communication terminal is located at the predetermined position of the vehicle. The communication control unit receives the data of the second captured image through the first communication when the mobile communication terminal position recognition unit recognizes that the mobile communication terminal is located at the predetermined location in a predetermined posture.

7. The communication system according to claim 1, wherein: The communication system includes a mobile communication terminal performance identification unit, which identifies the performance of the mobile communication terminal. The communication control unit receives the data of the second captured image from the mobile communication terminal through the first communication when the mobile communication terminal performance identification unit identifies that the performance of the mobile communication terminal that established the first communication for the relay communication is a predetermined performance.

8. The communication system according to claim 1, wherein: The communication system is composed of a driving recorder.

Images