Communication Systems

Abstract

To provide a communication system which can acquire a photographed image of the periphery from various angles with an inexpensive simple structure.SOLUTION: A communication system 1 comprises: first imaging devices 32-34; a communication unit 30 which executes the first communication with mobile communication terminals 51-55 and the second communication with a communication device 510 other than the mobile communication terminals 51-55 to execute relay communication for relaying communication between the mobile communication terminals 51-55 and the communication device 510; a communication control unit 12 which receives data of a second photographed image captured by second imaging devices 51a-55a provided in the mobile communication terminals 51-55 in which the first communication is established for the relay communication from the mobile communication terminals 51-55 via the first communication; and an image processing unit 14 which executes prescribed image processing on the basis of the data of the first photographed image captured by the first imaging devices 32-34 and data of the second photographed image.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to communication systems. [Background technology]

[0002] Conventionally, a system has been proposed in which a drive recorder mounted on a vehicle is provided with a function for communicating with an image collecting device outside the moving body, and images captured by the drive recorder are transmitted to the image collecting device (see, for example, Patent Document 1). In this system, the captured images are used for purposes such as fixed point observation, searching for lost children, and checking the situation at the scene of a fire, in addition to detecting accidents. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2003-87615 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the case of the above-mentioned conventional technology, the images obtained are limited to those captured by a fixed-angle camera installed in the drive recorder. Therefore, there is a disadvantage that it is difficult to collect images captured over a wide range. Although it is possible to use an omnidirectional camera, this would result in disadvantages such as increased device costs and complicated image processing. The present invention has been made in view of the above background, and has an object to provide a communication system capable of acquiring images of the surroundings taken from a variety of angles with a simple configuration at low cost. [Means for solving the problem]

[0005] To achieve the above objectives No. 1As an aspect, the present invention includes a communication unit that executes relay communication to relay communication between a mobile communication terminal and a communication device by executing a first communication between a first photographing device and a mobile communication terminal and a second communication between the mobile communication terminal and a communication device other than the mobile communication terminal; a communication control unit provided in the mobile communication terminal with which the first communication for the relay communication has been established, that receives data of a second photographed image taken by the second photographing device from the mobile communication terminal via the first communication; and an image processing unit that executes predetermined image processing based on the data of the first photographed image taken by the first photographing device and the data of the second photographed image. a synchronous photographing time determination unit that determines a synchronous photographing time for synchronously photographing the first photographing device and the second photographing device; Equipped with The communication control unit transmits, via the first communication, synchronous shooting time point information indicating the synchronous shooting time point to the mobile communication terminal with which the first communication for the relay communication is established, and receives, via the first communication, data of the second photographed image photographed by the second photographing device at the synchronous shooting time point based on the synchronous shooting time point information, and the image processing unit performs the predetermined image processing based on the data of the first photographed image photographed by the first photographing device at the synchronous shooting time point and the data of the second photographed image photographed by the second photographing device at the synchronous shooting time point. Examples include communication systems.

[0007] In the above communication system, the image processing unit may be configured to execute, as the predetermined image processing, a process of generating integrated image data that associates data of the first captured image with data of the second captured image.

[0008] In the above communication system, the communication control unit may be configured to transmit the integrated image data to the communication device by the second communication.

[0009] the above As a second aspect for achieving the object, there is a communication system including: a communication unit used in a mobile body, which executes a first communication between a first photographing device and a mobile communication terminal, and a second communication between a communication device other than the mobile communication terminal, thereby executing relay communication for relaying communication between the mobile communication terminal and the communication device; a communication control unit provided in the mobile communication terminal with which the first communication for the relay communication has been established, which receives data of a second photographed image taken by the second photographing device from the mobile communication terminal through the first communication; an image processing unit which executes predetermined image processing based on the data of the first photographed image taken by the first photographing device and the data of the second photographed image; and a mobile communication terminal position recognition unit which recognizes whether or not the mobile communication terminal is located at a predetermined location of the mobile body, wherein the communication control unit receives the data of the second photographed image through the first communication when it is recognized by the mobile communication terminal position recognition unit that the mobile communication terminal is located at the predetermined location, and the mobile communication terminal position recognition unit sets the predetermined location depending on the number of the mobile communication terminals with which the first communication for the relay communication has been established. .

[0011] the above As a third aspect for achieving the object, there is a communication system including: a communication unit used in a mobile body, which executes a first communication between a first photographing device and a mobile communication terminal, and a second communication between a communication device other than the mobile communication terminal, thereby executing relay communication for relaying communication between the mobile communication terminal and the communication device; a communication control unit provided in the mobile communication terminal with which the first communication for the relay communication has been established, which receives data of a second photographed image taken by the second photographing device from the mobile communication terminal via the first communication; an image processing unit which executes predetermined image processing based on data of the first photographed image taken by the first photographing device and data of the second photographed image; and a mobile communication terminal position recognition unit which recognizes whether or not the mobile communication terminal is located at a predetermined location of the mobile body, wherein the mobile communication terminal position recognition unit recognizes the attitude of the mobile communication terminal when it recognizes that the mobile communication terminal is located at the predetermined location of the mobile body, and the communication control unit receives the data of the second photographed image via the first communication when it is recognized by the mobile communication terminal position recognition unit that the mobile communication terminal is located at the predetermined location in the predetermined attitude. .

[0012] In the above communication system, a mobile communication terminal performance recognition unit may be provided that recognizes the performance of the mobile communication terminal, and the communication control unit may be configured to receive data of the second captured image from the mobile communication terminal via the first communication when the mobile communication terminal performance recognition unit recognizes that the performance of the mobile communication terminal with which the first communication for the relay communication has been established is a predetermined performance.

[0013] the above As a fourth aspect for achieving the object, there is a communication system including a communication unit that executes relay communication for relaying communication between a mobile communication terminal and the communication device by executing a first communication between a first photographing device and a mobile communication terminal and a second communication between the mobile communication terminal and a communication device other than the mobile communication terminal, a communication control unit that receives data of a second photographed image taken by a second photographing device provided in the mobile communication terminal with which the first communication for the relay communication is established from the mobile communication terminal through the first communication, and an image processing unit that executes predetermined image processing based on data of the first photographed image taken by the first photographing device and data of the second photographed image, wherein the communication unit executes the relay communication for a plurality of the mobile communication terminals through the first communication between the plurality of the mobile communication terminals, and the communication control unit receives data of the second photographed image taken by the second photographing device provided in the plurality of the mobile communication terminals with which the first communication for the relay communication is established through the first communication. . A fifth aspect for achieving the above object is a communication system including: a communication unit used in a mobile body, which executes a first communication between a first photographing device and a mobile communications terminal, and a second communication between a communication device other than the mobile communications terminal, thereby executing relay communication to relay communication between the mobile communications terminal and the communication device; a communication control unit provided in the mobile communications terminal with which the first communication for the relay communication has been established, which receives data of a second captured image captured by the second photographing device from the mobile communications terminal via the first communication; an image processing unit which performs predetermined image processing based on the data of the first captured image captured by the first photographing device and the data of the second captured image; and a mobile communications terminal position recognition unit which is provided in the mobile body and recognizes whether the mobile communications terminal is located at a predetermined location of the mobile body from an image captured by an indoor camera that is provided in the mobile body and captures an interior of the mobile body, and the communication control unit receives the data of the second captured image via the first communication when it is recognized by the mobile communications terminal position recognition unit that the mobile communications terminal is located at the predetermined location.

[0014] The communication system may be configured with a camera or a drive recorder. Effect of the Invention

[0015] According to the above communication system, images of the surroundings taken from a variety of angles can be acquired with a simple configuration that reduces costs. [Brief description of the drawings]

[0016] [Figure 1] FIG. 1 is an explanatory diagram of a usage mode of a drive recorder. [Diagram 2] FIG. 2 is a configuration diagram of the drive recorder. [Diagram 3] FIG. 3 is a first flowchart of the captured image providing process. [Figure 4] FIG. 4 is a second flowchart of the captured image providing process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] [1. How to use the dashcam] A usage mode of a drive recorder 1, which is an example of the configuration of a communication system according to the present disclosure, will be described with reference to Fig. 1. The drive recorder 1 is used by being attached to a vehicle 100, and has a function of capturing images of the periphery of the vehicle 100 and the interior of the vehicle 100 using a camera. The vehicle 100 corresponds to a moving body according to the present disclosure.

[0018] The drive recorder 1 has a function of performing cellular communication and Wi-Fi (registered trademark) communication. The drive recorder 1 communicates with an external communication device (corresponding to the communication device of the present disclosure) via a wide area network 500 by performing cellular communication with a base station 300 of each cell, or by performing Wi-Fi communication with a router 310 installed at a Wi-Fi spot near a road. In FIG. 1, an image management server 510 and an information provision server 520 are illustrated as examples of the external communication device.

[0019] Furthermore, the drive recorder 1 has a function of a Wi-Fi router that establishes Wi-Fi communication with mobile communication terminals 51 and 52 used by users U1 and U2 in the vehicle 100 to realize an in-vehicle Wi-Fi network environment. The mobile communication terminals 51 and 52 are smartphones, mobile phones, tablet terminals, portable game consoles, etc. that have a Wi-Fi communication function. The mobile communication terminals 51 and 52 are equipped with cameras 51a and 52a, respectively.

[0020] The drive recorder 1 functions as a Wi-Fi router, enabling communication between the mobile communication terminals 51, 52 and external communication devices such as an image management server 510 and an information providing server 520 via the in-vehicle Wi-Fi network and the wide area network 500. Even if the mobile communication terminals 51, 52 do not have a cellular communication function, the users U1, U2 can use the in-vehicle Wi-Fi environment provided by the drive recorder 1 to communicate with, for example, the information providing server 520 to obtain information.

[0021] The in-vehicle Wi-Fi network environment of the drive recorder 1 also enables communication with mobile communication terminals 53, 54, and 55 outside the vehicle near the vehicle 100. Fig. 1 illustrates a situation in which wireless communication via in-vehicle Wi-Fi is established between the drive recorder 1 and a mobile communication terminal 53 used by a user U3 standing on the sidewalk and mobile communication terminals 54 and 55 used by users U4 and U5 in an oncoming vehicle 110. The mobile communication terminals 53 to 55 are equipped with cameras 53a to 55a, respectively.

[0022] The drive recorder 1 transmits images captured by the camera to the image management server 510 via the wide area network 500. The image management server 510 uses the captured images received from the drive recorder 1 to perform processes such as accident analysis, fixed point observation, and road facility inspection.

[0023] Here, the wireless communication between the drive recorder 1 and the mobile communication terminals 51 to 55 corresponds to the first communication in the present disclosure, and the wireless communication between the drive recorder 1 and an external communication device such as the image management server 510 or the information providing server 520 corresponds to the second communication in the present disclosure. 1 letter Faith and the 2 letters By this communication, relay communication is performed to relay communication between the mobile communication terminals 51 to 55 and the external communication device. The cameras 51a to 55a provided in the mobile communication terminals 51 to 55 respectively correspond to the second imaging device of the present disclosure.

[0024] [2. Drive recorder configuration] The configuration of the drive recorder 1 will be described with reference to Fig. 2. The drive recorder 1 includes a processor 10, a memory 20, a NAD (Network Access Device) 30, an antenna 31, a front camera 32, a rear camera 33, an in-vehicle camera 34, a GNSS (Global Navigation Satellite System) sensor 35, an acceleration sensor 36, a switch 37, and a display 38. The front camera 32, the rear camera 33, and the in-vehicle camera 34 correspond to a first imaging device in the present disclosure.

[0025] The NAD 30 is a chip that integrates a cellular communication module and a Wi-Fi communication module. The antenna 31 is a dual-purpose antenna that supports both cellular and Wi-Fi communications. The NAD 30 and the antenna 31 constitute the communication unit of the present disclosure.

[0026] The front camera 32 photographs the surroundings in front of the vehicle 100 and outputs the photographed image to the processor 10. The rear camera 33 photographs the surroundings behind the vehicle 100 and outputs the photographed image to the processor 10. The in-vehicle camera 34 photographs the interior of the vehicle 100 and outputs the photographed image to the processor. Note that instead of including all of the front camera 32, rear camera 33, and in-vehicle camera 34, for example, a configuration including only the front camera 32 may be used.

[0027] The GNSS sensor 35 receives radio waves from positioning satellites to detect the current position (latitude, longitude) of the drive recorder 1 and outputs a position detection signal to the processor 10. The acceleration sensor 36 detects acceleration occurring in the drive recorder 1 and outputs an acceleration detection signal to the processor 10. The acceleration sensor 36 detects acceleration in three orthogonal axial directions, for example. The switch 37 outputs an operation signal to the processor 10 in response to operations by the users U1 and U2. The display 38 displays the operating status of the drive recorder 1, etc. in response to control input from the processor 10.

[0028] The processor 10 reads and executes the control program 21 for the drive recorder 1 stored in the memory 20, thereby functioning as a shooting control unit 11, a communication control unit 12, an image processing unit 14, a synchronous shooting time determination unit 15, a mobile communication terminal position recognition unit 17, a timing unit 18, and a speed recognition unit 19.

[0029] The photographing control unit 11 photographs an image using at least one of the front camera 32, the rear camera 33, and the in-vehicle camera 34 at a predetermined photographing timing, and stores data of the photographed image (first photographed image) in the photographed image area 22 of the memory 20. As the photographing timing, for example, the following timings (1) to (3) are set. (1) When vehicle 100 is involved in an accident. The photography control unit 11 recognizes that the vehicle 100 has been involved in an accident by detecting an acceleration level equal to or higher than a predetermined threshold value by the acceleration sensor 36. Note that the photography control unit 11 may recognize that the vehicle 100 has been involved in an accident based on an impact detection signal from an impact sensor provided in an airbag or the like attached to the vehicle 100.

[0030] (2) When vehicle 100 travels along a fixed point. The shooting control unit 11 recognizes that the vehicle 100 is traveling through a preset fixed point from the current position of the drive recorder 1 detected by the GNSS sensor 35. As the fixed point, for example, a point where traffic congestion is likely to occur, a point where road facilities (road signs, utility poles, etc.) that are the subject of maintenance are located, a tourist spot, etc. are set.

[0031] (3) When the vehicle 100 passes a location where a photograph is requested. The photography control unit 11 recognizes the photography request point by receiving information about the photography request point transmitted from the image management server 510, and recognizes that the vehicle 100 is traveling through the photography request point from the current position of the drive recorder 1 detected by the GNSS sensor 35. As the photography request point, for example, the scene of an accident caused by another vehicle, the scene of a fire, the scene of a lost child, etc. are set.

[0032] The communication control unit 12 controls the in-vehicle Wi-Fi communication by the NAD 30 and the communication with the external communication device via the wide area network 500. The communication control unit 12 packetizes data that combines the in-vehicle Wi-Fi information data and the captured image data, and communicates with the external communication device via the wide area network 500 by packet communication. This process shrinks the overhead of control data that is added to the information data such as the captured image transmitted by the packet, thereby reducing the communication volume, and therefore the communication costs borne by the users U1 and U2 can be reduced.

[0033] The communication control unit 12 receives data of the image (second captured image) captured by the mobile communication terminal 51, 52 from the mobile communication terminal 51, 52 through the first communication. The process by which the communication control unit 12 obtains the data of the second captured image will be described later. The image processing unit 14 generates integrated image data in which the data of the image (first captured image) captured by the front camera 32, the rear camera 33, and the in-car camera 34 and the data of the second captured image received by the communication control unit 12 are associated and recorded. The process by which the image processing unit 14 generates the integrated image data corresponds to the predetermined image processing of the present disclosure.

[0034] The synchronous shooting time determination unit 15 determines a synchronous shooting time for synchronizing the shooting times of the front camera 32, the rear camera 33, and the in-vehicle camera 34 in the drive recorder 1 with the shooting times of the cameras 51a, 52a in the mobile communication terminals 51, 52. The communication control unit 12 transmits the integrated image data generated by the image processing unit 14 to the image management server 510 via the wide area network 500 by the NAD 30.

[0035] The mobile communication terminal position recognition unit 17 judges whether the mobile communication terminals 51, 52 being used in the vehicle cabin are located at a predetermined location from an image of the vehicle cabin of the vehicle 100 captured by the in-vehicle camera 34. The predetermined location is, for example, a location where a holder for the mobile communication terminal is attached (such as the neck part of a headrest of a seat). FIG. 1 illustrates an example of a situation where the mobile communication terminal 52 is located at a predetermined location.

[0036] The clock unit 18 performs a process of clocking the current date and time. The photography control unit 11 stores data of a first photographed image, which is obtained by adding information on the date and time of photography measured by the clock unit 18 to the images photographed by the front camera 32, the rear camera 33, and the in-vehicle camera 34, in the photographed image area 22 of the memory 20. The speed recognition unit 19 recognizes the running speed (moving speed) of the vehicle 100 by receiving a speed detection signal Vcar from a vehicle speed sensor provided in the vehicle 100. The drive recorder 1 receives the speed detection signal Vcar by performing wired or wireless communication with an ECU (Electronic Control Unit) provided in the vehicle 100. The speed recognition unit 19 may recognize the running speed (moving speed) of the vehicle 100 by performing a predetermined image processing on the photographed image.

[0037] [3. Provision of captured images] The captured image providing process executed by the drive recorder 1 will be described with reference to the flowcharts shown in FIGS.

[0038] 3, the photography control unit 11 advances the process to step S2 when the photography timing of any one of the above (1) to (3) arrives. In step S2, the photography control unit 11 determines whether or not there is a mobile communication terminal with which in-vehicle Wi-Fi communication is established with the NAD 30. Then, the photography control unit 11 advances the process to step S3 if there is a mobile communication terminal with which in-vehicle Wi-Fi communication is established, and advances the process to step S20 if there is no mobile communication terminal with which in-vehicle Wi-Fi communication is established.

[0039] In step S20, the photography control unit 11 captures an image using at least one of the front camera 32, the rear camera 33, and the in-vehicle camera 34, and stores the captured first captured image data in the captured image area 22 of the memory 20. In the following step S21, the communication control unit 12 transmits the first captured image data to the image management server 510 via the NAD 30, and the process proceeds to step S11 in Fig. 4. In this case, only the data of the first captured image captured by the drive recorder 1 is transmitted to the image management server 510.

[0040] Furthermore, in step S3, mobile communication terminal position recognition unit 17 recognizes the position of the mobile communication terminal within the cabin of vehicle 100 by extracting an image portion of the mobile communication terminal from the image captured by in-vehicle camera 34. In the example of Fig. 1, the positions of mobile communication terminals 51, 52 being used within the cabin of vehicle 100 are recognized. In the next step S4, mobile communication terminal position recognition unit 17 determines whether or not the position of the mobile communication terminal is at the above-mentioned predetermined location.

[0041] In the example of Fig. 1, it is determined that the mobile communication terminal 52 is located at a predetermined location. If the mobile communication terminal is located at the predetermined location, the mobile communication terminal location recognition unit 17 advances the process to step S5, and if the mobile communication terminal is not located at the predetermined location, the mobile communication terminal location recognition unit 17 advances the process to step S20. In step S5, the synchronous shooting time determination unit 15 determines a synchronous shooting time for synchronously shooting by the drive recorder 1 and the mobile communication terminal, based on the shooting timing recognized in step S1. In the following step S6, the communication control unit 12 transmits synchronous shooting time notification information notifying the synchronous shooting time to the mobile communication terminal 52 by in-vehicle Wi-Fi communication via the NAD30.

[0042] When the mobile communication terminal 52 receives the synchronous shooting time notification information transmitted from the drive recorder 1, it recognizes the synchronous shooting time from the synchronous shooting time notification information, and performs shooting with the camera 52a at the synchronous shooting time. Then, the mobile communication terminal 52 transmits data of the captured second captured image to the drive recorder 1 by in-vehicle Wi-Fi communication via the NAD 30. Note that the shooting by the drive recorder 1 and the mobile communication terminal 52 may be video shooting or continuous image shooting in a period extending before and after the synchronous shooting time.

[0043] 3, the communication control unit 12 and the photography control unit 11 execute the processes in steps S7 and S8 and the processes in steps S30 and S31 in parallel. When the communication control unit 12 receives the data of the second captured image from the mobile communication terminal 52 in step S7, the process proceeds to step S8, where the data of the second captured image is stored in the captured image area 22 of the memory 20, and the process proceeds to step S9 in FIG.

[0044] Furthermore, when the time for synchronous photographing is reached in step S30, the photographing control unit 11 advances the process to step S31, and photographs the image using at least one of the front camera 32, the rear camera 33, and the in-vehicle camera 34. Then, the photographing control unit 11 stores data of the photographed first photographed image in the photographed image area 22 of the memory 20, and advances the process to step S9 in FIG.

[0045] In step S9, the image processing unit 14 generates integrated image data in which the data of the first captured image and the data of the second captured image stored in the captured image area 22 by the shooting control unit 11 are associated and recorded. In the following step S10, the communication control unit 12 transmits the integrated image data generated by the image processing unit 14 to the image management server 510 via the wide area network 500 via the communication control unit 12 and the NAD 30.

[0046] The integrated image data includes data of a first captured image taken by the front camera 32, rear camera 33, or in-vehicle camera 34 of the drive recorder 1 at the same timing (the time of synchronous shooting, or the period before and after the time of synchronous shooting), and data of a second captured image taken by the camera 52a of the mobile communication terminal 52.

[0047] Therefore, the image management server 510 can obtain images of the periphery of the vehicle 100 or the interior of the vehicle 100 taken at various angles at the same time using the integrated image data. The image management server 510 can obtain more detailed information about an accident or the like that has occurred in the vehicle 100 by analyzing the data of the first captured image and the data of the second captured image.

[0048] [4. Other embodiments] In the above embodiment, the four-wheeled vehicle 100 is exemplified as a moving body to which the drive recorder 1 is attached. However, the moving body to which the drive recorder 1 is attached may be a two-wheeled vehicle, an aircraft, a ship, or the like.

[0049] In the above embodiment, the wide area network 500 is accessed by cellular or Wi-Fi communication, but other communication methods may be used. Also, communication between the mobile communication terminals 51, 52 used by the users U1, U2 of the vehicle 100 and the drive recorder 1 is performed by in-vehicle Wi-Fi (corresponding to the second communication network in the present disclosure), but other communication specifications such as Bluetooth (registered trademark) may be used.

[0050] In the above embodiment, an example was shown in which the communication system of the present disclosure was configured using a drive recorder 1, but the communication system of the present disclosure may also be configured using a communication terminal equipped with a camera (a smartphone, a mobile phone, a tablet terminal, a camera with communication function, etc.).

[0051] In the above embodiment, the communication control unit 12 performs synchronization only on the mobile communication terminals (mobile communication terminals 52 in the example of FIG. 1) located at a predetermined location of the vehicle 100 according to the flowchart shown in FIG. photograph The time point notification information is transmitted to acquire the data of the second captured image captured by the mobile communication terminal. As another configuration, the mobile communication terminal (mobile communication terminals 51 and 52 in the example of FIG. 1) used in the vehicle 100 is subjected to a synchronous detection without determining whether the mobile communication terminal is located at a predetermined location. photograph The time point notification information may be transmitted to acquire data of a second captured image captured by the mobile communication terminal.

[0052] Also, the mobile communication terminal position recognition unit 17 may set a predetermined location for recognizing the location of the mobile communication terminal according to the number of mobile communication terminals with which in-vehicle Wi-Fi communication has been established with the drive recorder 1. For example, when the number of mobile communication terminals with which the first communication for relay communication has been established is one, the predetermined location is set to a location where the rear of the vehicle 1 can be photographed, when the number of mobile communication terminals is two, the predetermined location is set to a location where the right rear of the vehicle 1 can be photographed and a location where the left rear of the vehicle 1 can be photographed, and when the number of mobile communication terminals is three, the predetermined location is set to a location where the right rear of the vehicle 1 can be photographed, a location where the rear center of the vehicle 1 can be photographed, and a location where the left rear of the vehicle 1 can be photographed, thereby expanding the photographing range around the vehicle 1.

[0053] Furthermore, when the mobile communication terminal position recognition unit 17 recognizes that the mobile communication terminal is located at the specified location of the vehicle 1, it recognizes the posture of the mobile communication terminal, and the communication control unit 12 may receive data of the second captured image via in-vehicle Wi-Fi communication when the mobile communication terminal position recognition unit 17 recognizes that the mobile communication terminal is located at the specified location in the specified posture.

[0054] In the above embodiment, a mobile communication terminal performance recognition unit is provided that recognizes the performance of the mobile communication terminal, and the communication control unit 12 may receive data of the second captured image from the mobile communication terminal via in-car Wi-Fi communication when the mobile communication terminal performance recognition unit recognizes that the performance of the mobile communication terminal with which in-car Wi-Fi communication has been established with the NAD30 is a predetermined performance.

[0055] In the above embodiment, a synchronous shooting time determination unit 15 was provided to synchronize the shooting in the drive recorder 1 with the shooting in the mobile communication terminals 51, 52, but the synchronous shooting time determination unit 15 may be omitted and data of the second captured image captured at any timing by the mobile communication terminals 51, 52 may be obtained.

[0056] Alternatively, the synchronization may be performed not only on the mobile communication terminals used in the vehicle 100 but also on the mobile communication terminals (mobile communication terminals 51 to 55 in the example of FIG. 1) with which in-vehicle Wi-Fi communication is established between the NAD 30 and the vehicle. photograph The time point notification information may be notified and second captured image data captured by each mobile communication terminal may be acquired.

[0057] In the above embodiment, a configuration was shown in which the drive recorder 1 and the mobile communication terminals 51 to 55 communicated wirelessly. However, as shown in FIG. 1, when the mobile communication terminals 51, 52 are used inside the passenger compartment of the vehicle 100, the mobile communication terminals 51, 52 and the drive recorder 1 may be connected by a communication cable to perform wired communication.

[0058] In the above embodiment, the image processing unit 14 executes a process of generating integrated image data that associates data of the first captured image with data of the second captured image as a predetermined image process based on the first captured image data and the second captured image data. As another image process based on the first captured image data and the second captured image data, for example, a process of recognizing an object present around the vehicle 1, determining a risk of contact with the object, etc. may be executed.

[0059] 2 is a schematic diagram showing the configuration of the drive recorder 1 divided according to main processing contents in order to facilitate understanding of the present invention, and the configuration of the drive recorder 1 may be divided in other ways. Furthermore, the processing of each component may be executed by one hardware unit or by multiple hardware units. Furthermore, the processing of each component according to the flowcharts shown in FIGS. 3 and 4 may be executed by one program or by multiple programs.

[0060] [4. Configuration supported by the above embodiment] The above embodiment supports the following configurations. (Configuration 1) A communication system comprising: a communication unit that performs relay communication to relay communication between a mobile communication terminal and a communication device by performing a first communication between a first photographing device and a mobile communication terminal, and a second communication between the first photographing device and a communication device other than the mobile communication terminal; a communication control unit that is provided in the mobile communication terminal with which the first communication for the relay communication has been established, and that receives data of a second photographed image taken by a second photographing device from the mobile communication terminal via the first communication; and an image processing unit that performs predetermined image processing based on the data of the first photographed image taken by the first photographing device and the data of the second photographed image. According to the communication system of configuration 1, data of a first captured image captured by a first photographing device of the communication system, as well as data of a second captured image captured at various angles by a second photographing device of a mobile communication terminal, can be obtained using a simple configuration that reduces costs.

[0061] (Configuration 2) The communication system described in Configuration 1 includes a synchronous shooting time determination unit that determines a synchronous shooting time for synchronizing shooting by the first photographing device and the second photographing device, and the communication control unit transmits synchronous shooting time information indicating the synchronous shooting time to the mobile communication terminal with which the first communication for the relay communication has been established via the first communication, and receives data of the second photographed image taken by the second photographing device at the synchronous shooting time based on the synchronous shooting time information via the first communication, and the image processing unit performs the specified image processing based on the data of the first photographed image taken by the first photographing device at the synchronous shooting time and the data of the second photographed image taken by the second photographing device at the synchronous shooting time. According to the communication system of configuration 2, it is possible to recognize an object, determine the risk of contact with the object, and so on, by performing image processing using data of a first captured image taken by a first photographing device of the communication system and data of a second captured image taken by a second photographing device of the mobile communication terminal at the same time.

[0062] (Configuration 3) A communication system according to configuration 1 or 2, wherein the image processing unit executes a process of generating integrated image data that associates data of the first captured image with data of the second captured image as the specified image processing. According to the communication system of configuration 3, it is possible to obtain integrated image data that includes, in association with each other, data of a first captured image captured by a first capturing device of the communication system and data of a second captured image captured by a second capturing device of the mobile communication terminal at the same time.

[0063] (Configuration 4) In the communication system according to configuration 3, the communication control unit transmits the integrated image data to the communication device by the second communication. According to the communication system of configuration 4, it is possible to provide the communication device with integrated image data including data of the second captured image captured by the second imaging device of the mobile communication terminal.

[0064] (Configuration 5) A communication system described in any one of configurations 1 to 4, which is used in a mobile body and includes a mobile communication terminal position recognition unit that recognizes whether the mobile communication terminal is located at a specified location of the mobile body, and the communication control unit receives data of the second captured image via the first communication when the mobile communication terminal position recognition unit recognizes that the mobile communication terminal is located at the specified location. According to the communication system of configuration 5, an image of the inside of the moving body or the vicinity of the moving body can be captured and acquired by the second imaging device of a mobile communication terminal used inside the moving body or the vicinity of the moving body.

[0065] (Configuration 6) The communication system according to configuration 5, wherein the mobile communication terminal location recognition unit sets the predetermined location depending on the number of the mobile communication terminals with which the first communication for the relay communication is established. According to the communication system of configuration 6, a predetermined location can be set according to the shooting range covered by the second shooting device of the mobile communication terminal, depending on the number of mobile communication terminals with which first communication for relay communication has been established.

[0066] (Configuration 7) A communication system as described in Configuration 5 or Configuration 6, wherein the mobile communications terminal position recognition unit recognizes the posture of the mobile communications terminal when it recognizes that the mobile communications terminal is located at the specified location of the moving body, and the communication control unit receives data of the second captured image via the first communication when the mobile communications terminal position recognition unit recognizes that the mobile communications terminal is located at the specified location in a specified posture. According to the communication system of configuration 7, by recognizing the posture of the mobile communication terminal, it is possible to specify in more detail the shooting range and shooting direction of the second photographing device of the mobile communication terminal, and obtain data of the second photographed image captured by the second photographing device.

[0067] (Configuration 8) A communication system described in any one of configurations 1 to 7, comprising a mobile communication terminal performance recognition unit that recognizes the performance of the mobile communication terminal, and when the mobile communication terminal performance recognition unit recognizes that the performance of the mobile communication terminal with which the first communication for the relay communication is established is a predetermined performance, the communication control unit receives data of the second captured image from the mobile communication terminal via the first communication. According to the communication system of configuration 8, data of a second photographed image taken by the second photographing device can be received from a mobile communication terminal only when the communication performance of the mobile communication terminal, the performance of the second photographing device provided in the mobile communication terminal, etc. are at or above a predetermined level.

[0068] (Configuration 9) A communication system described in any one of configurations 1 to 8, wherein the communication unit executes the relay communication for multiple mobile communication terminals through the first communication between multiple mobile communication terminals, and the communication control unit receives data of the second captured image captured by the second photographing device provided in multiple mobile communication terminals with which the first communication for the relay communication has been established through the first communication. According to the communication system of configuration 9, data of second captured images captured by second imaging devices of a plurality of mobile communication terminals is received, making it possible to collect data of captured images over a wide range.

[0069] (Configuration 10) A communication system according to any one of configurations 1 to 9, which is configured by a camera or a drive recorder. According to the communication system of configuration 10, the communication systems of configurations 1 to 9 can be realized as the functions of a camera or a drive recorder. [Explanation of symbols]

[0070] 1...Dashcam, 10...Processor, 11...Shooting control unit, 12...Communication control unit, 14...Image processing unit, 15...Synchronized shooting time determination unit, 17...Mobile communication terminal position recognition unit, 18...Timekeeping unit, 19...Speed ​​recognition unit, 20...Memory, 21...Control program, 22...Shooting image area, 30...NAD, 31...Antenna, 32...Front camera, 33...Rear camera, 34...In-vehicle camera, 35...GNSS, 36...Acceleration sensor, 37...Switch, 38...Display, 51-55...Mobile communication terminal, 51a-55a...Camera, 100...Vehicle (mobile body), 110...Other vehicle, 300...Cellular communication base station, 310...Wi-Fi spot router, 500...Wide area network, 510...Image management server, 520...Information provision server, U1-U5...User.

Claims

1. A first imaging device; a communication unit that performs a first communication with a mobile communication terminal and a second communication with a communication device other than the mobile communication terminal, thereby performing a relay communication for relaying a communication between the mobile communication terminal and the communication device; a communication control unit provided in the mobile communication terminal with which the first communication for the relay communication is established, the communication control unit receiving data of a second captured image captured by a second photographing device from the mobile communication terminal through the first communication; an image processing unit that executes a predetermined image processing based on data of a first captured image captured by the first imaging device and data of the second captured image; a synchronous photographing time determination unit that determines a synchronous photographing time for synchronously photographing the first photographing device and the second photographing device; Equipped with The communication control unit transmitting, via the first communication, synchronous shooting time point information indicating the synchronous shooting time point to the mobile communication terminal with which the first communication for the relay communication has been established; receiving, via the first communication, data of the second photographed image photographed by the second photographing device at the synchronous photographing time point based on the synchronous photographing time point information; The image processing unit executes the predetermined image processing based on data of the first photographed image photographed by the first photographing device at the time of the synchronous photographing and data of the second photographed image photographed by the second photographing device at the time of the synchronous photographing. Communication systems.

2. For use in a moving body, A first imaging device; a communication unit that performs a first communication with a mobile communication terminal and a second communication with a communication device other than the mobile communication terminal, thereby performing a relay communication for relaying a communication between the mobile communication terminal and the communication device; a communication control unit provided in the mobile communication terminal with which the first communication for the relay communication is established, the communication control unit receiving data of a second captured image captured by a second photographing device from the mobile communication terminal through the first communication; an image processing unit that executes a predetermined image processing based on data of a first captured image captured by the first imaging device and data of the second captured image; a mobile communication terminal location recognition unit that recognizes whether the mobile communication terminal is located at a predetermined location of the moving body; Equipped with the communication control unit receives data of the second captured image through the first communication when the mobile communication terminal location recognition unit recognizes that the mobile communication terminal is located at the predetermined location; The mobile communication terminal location recognition unit sets the predetermined location in accordance with the number of the mobile communication terminals with which the first communication for the relay communication is established. Communication systems.

3. For use in a moving body, A first imaging device; a communication unit that performs a first communication with a mobile communication terminal and a second communication with a communication device other than the mobile communication terminal, thereby performing a relay communication for relaying a communication between the mobile communication terminal and the communication device; a communication control unit provided in the mobile communication terminal with which the first communication for the relay communication is established, the communication control unit receiving data of a second captured image captured by a second photographing device from the mobile communication terminal through the first communication; an image processing unit that executes a predetermined image processing based on data of a first captured image captured by the first imaging device and data of the second captured image; a mobile communication terminal location recognition unit that recognizes whether the mobile communication terminal is located at a predetermined location of the moving body; Equipped with the mobile communication terminal position recognition unit recognizes the attitude of the mobile communication terminal when it recognizes that the mobile communication terminal is located at the predetermined location of the moving body; The communication control unit receives data of the second captured image through the first communication when the mobile communication terminal position recognition unit recognizes that the mobile communication terminal is located at the predetermined location in a predetermined posture. Communication systems.

4. A first imaging device; a communication unit that performs a first communication with a mobile communication terminal and a second communication with a communication device other than the mobile communication terminal, thereby performing a relay communication for relaying a communication between the mobile communication terminal and the communication device; a communication control unit provided in the mobile communication terminal with which the first communication for the relay communication is established, the communication control unit receiving data of a second captured image captured by a second photographing device from the mobile communication terminal through the first communication; an image processing unit that executes a predetermined image processing based on data of a first captured image captured by the first imaging device and data of the second captured image; Equipped with the communication unit performs the relay communication for the plurality of mobile communication terminals through the first communication between the plurality of mobile communication terminals; The communication control unit receives, via the first communication, data of the second photographed image photographed by the second photographing device provided in the plurality of mobile communication terminals with which the first communication for the relay communication has been established. Communication systems.

5. For use in a moving body, A first imaging device; a communication unit that performs a first communication with a mobile communication terminal and a second communication with a communication device other than the mobile communication terminal, thereby performing a relay communication for relaying a communication between the mobile communication terminal and the communication device; a communication control unit provided in the mobile communication terminal with which the first communication for the relay communication is established, the communication control unit receiving data of a second captured image captured by a second photographing device from the mobile communication terminal through the first communication; an image processing unit that executes a predetermined image processing based on data of a first captured image captured by the first imaging device and data of the second captured image; a mobile communication terminal position recognition unit that recognizes whether the mobile communication terminal is located at a predetermined location of the mobile body from an image captured by an indoor camera that is provided on the mobile body and captures an image of an interior of the mobile body; Equipped with The communication control unit receives data of the second captured image through the first communication when the mobile communication terminal location recognition unit recognizes that the mobile communication terminal is located at the predetermined location. Communication systems.

6. The image processing unit executes, as the predetermined image processing, a process of generating integrated image data in which data of the first captured image and data of the second captured image are associated with each other. A communication system according to any one of claims 1 to 5.

7. The communication control unit transmits the integrated image data to the communication device through the second communication.

7. The communication system according to claim 6.

8. A mobile communication terminal performance recognition unit that recognizes the performance of the mobile communication terminal, The communication control unit receives data of the second captured image from the mobile communication terminal through the first communication when the mobile communication terminal performance recognition unit recognizes that the performance of the mobile communication terminal with which the first communication for the relay communication is established is a predetermined performance. A communication system according to any one of claims 1 to 7.

9. Consists of a camera or a drive recorder A communication system according to any one of claims 1 to 8.

Images