Image transfer system, image transmission device, and image transfer method

Abstract

To provide an image transfer system that can acquire images of the vehicle with a simpler configuration. [Solution] The image transfer system 10 according to this disclosure comprises an image transmission device 2 that transmits a vehicle image captured by an imaging unit 21, an image transfer device 3 that transfers the vehicle image received from the image transmission device 2, and an image display device 1 that displays the vehicle image received from the image transfer device 3. If the vehicle image includes a license plate image, the image transmission device 2 transmits the license plate information read from the license plate image and the vehicle image to the image transfer device 3, the image transfer device 3 transfers the vehicle image to a destination corresponding to the license plate information received from the image transmission device 2, and the image display device 1 displays the vehicle image transferred from the image transfer device 3.

Description

Technical Field

[0006] , , ,

[0005] , , , ,

[0001] The present disclosure relates to an image transfer system, an image transmission device, and an image transfer method.

Background Art

[0002] As a means for a vehicle driver to check the situation around the vehicle, there is known a technique of detecting surrounding dangers using a camera provided on the vehicle and notifying the driver of the information.

[0003] As a related technique, Patent Document 1 discloses a blind spot information request device capable of requesting other vehicles for useful image information that compensates for the blind spots of the driver. The device includes a blind spot range calculation means for calculating a blind spot range that is a blind spot for the driver of the host vehicle, and a communication means for transmitting blind spot range information representing the calculated blind spot range to other vehicles. The device also receives image information transmitted from other vehicles that have received the blind spot range information, and displays the image information on a display. Thereby, the driver can grasp the presence of pedestrians or the like hidden in the blind spot range.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In the technique disclosed in Patent Document 1, other vehicles control the imaging direction and imaging range of the surrounding environment monitoring camera based on the blind spot range information received from the host vehicle. Therefore, other vehicles need to be equipped with a motor for adjusting the imaging direction and a camera having a zoom or magnification adjustment function. As a result, in the technique disclosed in Patent Document Ⅰ, the configuration of the system may become complicated.

[0006] The purpose of this disclosure is to provide an image transfer system, an image transmission device, and an image transfer method that can acquire images of the vehicle with a simpler configuration, in light of the above-mentioned problems. [Means for solving the problem]

[0007] The image transfer system described herein is An image transmission device that transmits vehicle images captured by the imaging unit, An image transfer device that transfers the vehicle image received from the image transmission device, The system includes an image display device that displays the vehicle image received from the image transfer device, If the vehicle image includes a license plate image, the image transmission device transmits the license plate information read from the license plate image and the vehicle image to the image transfer device. The image transfer device transfers the vehicle image to a transfer destination corresponding to the number information received from the image transmission device. The image display device displays the vehicle image transferred from the image transfer device.

[0008] The image transmission device relating to this disclosure is A vehicle image acquisition unit acquires vehicle images captured by the imaging unit, The system includes a transmission unit that, if the vehicle image includes a license plate image, transmits the license plate information read from the license plate image and the vehicle image to an image transfer device that transfers the vehicle image to a transfer destination corresponding to the license plate information.

[0009] The image transfer method relating to this disclosure is: In an image transmission device that transmits a vehicle image captured by an imaging unit, if the vehicle image includes a license plate image, the number information read from the license plate image and the vehicle image are transmitted to an image transfer device that transfers the vehicle image. In the image transfer device, the vehicle image is transferred to a transfer destination corresponding to the number information received from the image transmission device. The image display device displays the vehicle image transferred from the image transfer device. [Effects of the Invention]

[0010] The image transfer system, image transmission device, and image transfer method described herein enable the acquisition of images of the vehicle with a simpler configuration. [Brief explanation of the drawing]

[0011] [Figure 1] Figure 1 is a block diagram showing the overall configuration of the image transfer system. [Figure 2] Figure 2 is a block diagram showing the detailed configuration of the image transfer system. [Figure 3] Figure 3 shows an example of a registration information database. [Figure 4] Figure 4 shows the situation in front of the vehicle as seen from the perspective of the driver of the vehicle traveling behind. [Figure 5] Figure 5 shows the situation in front of the vehicle as seen from the driver's perspective. [Figure 6] Figure 6 is a flowchart showing the flow of the image transmission process performed by the image transmission device. [Figure 7] Figure 7 is a flowchart showing the flow of the image transfer process performed by the image transfer device. [Figure 8] Figure 8 is a flowchart showing the flow of image display processing performed by an image display device. [Modes for carrying out the invention]

[0012] Embodiments of the present disclosure will be described in detail below with reference to the drawings. In each drawing, the same or corresponding elements are denoted by the same reference numerals. For clarity of explanation, redundant explanations will be omitted where necessary.

[0013] (Image Transfer System 10) FIG. 1 is a block diagram showing the overall configuration of an image transfer system 10 according to the present disclosure. The image transfer system 10 includes an image display device 1, an image transmission device 2, and an image transfer device 3. The image display device 1 is mounted on a vehicle V1 and includes a display unit 12 for displaying an image. The image transmission device 2 is mounted on a vehicle V2 and includes an imaging unit 21 for imaging surrounding vehicles.

[0014] Vehicles V1 and V2 are vehicles traveling in the same lane. Vehicles V1 and V2 are traveling from the right side to the left side in FIG. 1, and vehicle V2 is traveling immediately behind vehicle V1. Hereinafter, it will be described as if vehicles V1 and V2 are traveling in the same lane and there are no other vehicles between vehicle V1 and vehicle V2, but it is not limited thereto. The image transfer system 10 may be applied to three or more vehicles, and these multiple vehicles may be traveling in different lanes. Also, other vehicles may exist between the vehicle equipped with the image display device 1 and the vehicle equipped with the image transmission device 2.

[0015] Also, for the sake of explanation below, an example in which vehicle V1 includes the image display device 1 and vehicle V2 includes the image transmission device 2 will be described, but each vehicle may include both the image display device 1 and the image transmission device 2. Also, for example, vehicles V1 and V2 may each include a device in which the image display device 1 and the image transmission device 2 are integrated.

[0016] The image display device 1 and the image transmission device 2 are connected to the image transfer device 3 via a network N. The network N includes, for example, an Internet line or a wireless communication network, etc., but the type of communication is not limited thereto. The image display device 1, the image transmission device 2, and the image transfer device 3 each include a transmission unit and a reception unit not shown in FIG. 1, and communicate with each other via the network N.

[0017] The image transfer system 10 is a system that provides an image transfer service that transfers vehicle images acquired by an imaging device installed in a vehicle to a destination vehicle via a communication means. In the example shown in Figure 1, the image transfer system 10 transfers vehicle images acquired by the imaging unit 21 of vehicle V2 to the image display device 1 of vehicle V1 via the network N. The image display device 1 displays the transferred vehicle images on the display unit 12. The driver of vehicle V1 can see the vehicle image showing their own vehicle on the display unit 12, so they can easily understand the situation of their own vehicle as seen from vehicle V2.

[0018] The image transfer system 10 provides the image transfer service to pre-registered users. The image transfer service may be a paid service. Users of the image transfer system 10 register the license plate number of their vehicle and the destination for transferring vehicle images with the image transfer system 10. For example, a user registers their vehicle's license plate number and the destination for transferring vehicle images using a terminal device such as a PC (Personal Computer) or smartphone. For example, the destination for transferring vehicle images taken of vehicle V1 is associated with the image display device 1 installed in vehicle V1.

[0019] A vehicle image is an image of surrounding vehicles. When the imaging unit of one's own vehicle images another vehicle, the vehicle image includes the exterior of that other vehicle. In the example in Figure 1, the vehicle image acquired by the imaging unit 21 of vehicle V2 includes the exterior of vehicle V1. Thus, a vehicle image captured by one's own vehicle is, for example, an image that includes another vehicle traveling in front. However, it is not limited to this; a vehicle image captured by one's own vehicle may also include other vehicles traveling behind, to the left, or to the right of one's own vehicle.

[0020] Referring to Figure 1, the overview of the processing performed by the image transfer system 10 will be explained. Note that the white, one-way arrows shown in Figure 1 simply illustrate the flow of information (data or signals, etc.) and do not exclude the bidirectional nature of information.

[0021] First, the image transmission device 2 of vehicle V2 uses the imaging unit 21 to image vehicle V1 and acquire a vehicle image (S1). Next, the image transmission device 2 transmits the vehicle image to the image transfer device 3 (S2). The image transfer device 3 receives the vehicle image from the image transmission device 2 and transfers the vehicle image to the image display device 1 (S3). The image transfer device 3 can identify the image display device 1 as the destination for the vehicle image based on the license plate information contained in the vehicle image.

[0022] The image display device 1 receives the vehicle image transferred from the image transfer device 3 (S4) and displays the vehicle image on the display unit 12 (S5). This allows the driver of vehicle V1 to view the vehicle image, including their own vehicle, captured from vehicle V2. The specific processing of each device and specific examples of vehicle images will be described later.

[0023] Figure 2 is a block diagram showing the detailed configuration of the image transfer system 10. Referring to Figure 2, the configurations of the image display device 1, the image transmission device 2, and the image transfer device 3 will be described. Note that the image display device 1 and the image transmission device 2 may be configured as dedicated hardware mounted on the vehicle, or they may be configured as devices with functions such as a drive recorder. The image transfer device 3 may be configured as a server device installed outside the vehicle.

[0024] (Image transmission device 2) First, let's describe the image transmission device 2. The image transmission device 2 transmits vehicle images captured of surrounding vehicles to the image transfer device 3. The image transmission device 2 comprises an imaging unit 21, a vehicle image acquisition unit 22, a license plate reading unit 23, a registration determination unit 24, a transmission unit 27, a receiving unit 28, and a storage unit 29.

[0025] The image transmission device 2 includes a processor and memory, although these are not shown in the diagram. The storage unit 29, which is a storage device, stores a computer program on which the processing described herein is implemented. The processor can load the computer program from the storage device into the memory and execute the computer program. In this way, the processor realizes the functions of the vehicle image acquisition unit 22, the license plate reading unit 23, and the registration determination unit 24.

[0026] Furthermore, the vehicle image acquisition unit 22, the license plate reading unit 23, and the registration determination unit 24 may each be implemented with dedicated hardware. Some or all of each component may be implemented by general-purpose or dedicated circuits, processors, etc., or combinations thereof. These may be configured by a single chip or by multiple chips connected via a bus. Some or all of each component may be implemented by a combination of the above-mentioned circuits, etc., and programs. In addition, a CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (Field-Programmable Gate Array), quantum processor (quantum computer control chip), etc. can be used as the processor.

[0027] The imaging unit 21 is an imaging device that images the area around vehicle V2. The imaging unit 21 is attached to vehicle V2 and performs imaging in a predetermined direction. As a result, the imaging unit 21 images other vehicles traveling around vehicle V2. In the example in Figure 1, the other vehicle is vehicle V1 traveling in front of vehicle V2. Therefore, the imaging unit 21 may be a front camera capable of imaging the area in front of vehicle V2. The imaging unit 21 is installed, for example, above the interior of vehicle V2, in a position capable of imaging the area in front of vehicle V2.

[0028] The imaging unit 21 images the vehicle V1 traveling ahead at predetermined time intervals and outputs the vehicle images acquired by imaging to the vehicle image acquisition unit 22. The vehicle images may be moving images or still images. In the following description, the imaging unit 21 will be described as capturing moving images of the area in front of the vehicle V2.

[0029] Although Figure 2 shows the imaging unit 21 inside the image transmission device 2, the imaging unit 21 may be provided separately from the image transmission device 2. For example, if the vehicle V2 is equipped with a drive recorder, the camera of the drive recorder may be used as the imaging unit 21. Furthermore, multiple imaging units 21 may be provided in the vehicle V2. For example, the imaging unit 21 may include a left-side camera that images the left side of the vehicle V2, a right-side camera that images the right side of the vehicle V2, and a rear-side camera that images the rear of the vehicle V2. In addition, the imaging unit 21 may be, for example, a panoramic camera capable of capturing images around the vehicle V2 with a 360-degree field of view.

[0030] The vehicle image acquisition unit 22 acquires a vehicle image from the imaging unit 21. The vehicle image acquisition unit 22 outputs the vehicle image to the license plate reading unit 23. The vehicle image acquisition unit 22 may also store the vehicle image in the storage unit 29.

[0031] The license plate reading unit 23 extracts a license plate image from the vehicle image. The license plate image is the image region of the vehicle image taken of vehicle V1 that corresponds to the license plate attached to vehicle V1. Here, the license plate displays the registration number of vehicle V1. The license plate may be, for example, a vehicle registration number plate, a vehicle number plate, or a sign.

[0032] The license plate reading unit 23 reads license plate information from the license plate image if the vehicle image includes a license plate image. The license plate information is information obtained from the license plate image. The license plate reading unit 23 may use any image analysis technique to extract the license plate image and read the license plate information.

[0033] The license plate information may include, for example, the registration place name, classification number, kana characters, and serial designation number as inscribed on the license plate in Japan. The registration place name indicates the name of the place where the vehicle was registered. The classification number indicates the classification of the vehicle V1 by type and use. The kana characters indicate the use, such as commercial or private use. The serial designation number is part of the vehicle number and is a four-digit number inscribed in a relatively conspicuous location on the license plate.

[0034] The number reading unit 23 may acquire this character information using image recognition processing such as OCR (Optical Character Recognition). The number reading unit 23 outputs the read number information to the transmission unit 27. Although this example shows the number reading unit 23 reading the number information, the number may be read by a device other than the image transmission device 2, and the image transmission device 2 may acquire the reading result.

[0035] The registration determination unit 24 determines whether the license plate information of vehicle V1 read by the license plate reading unit 23 is registered in the image transfer system 10. For example, the registration determination unit 24 makes a registration confirmation request to the image transfer device 3 to check whether the license plate information is already registered. For example, the registration determination unit 24 makes a registration confirmation request by sending the license plate information and the registration confirmation request to the image transfer device 3. As a result, the registration confirmation unit 31 in the image transfer device 3 checks whether the license plate information is registered or not. The image transfer device 3 stores a registration information DB (DataBase) 391, and the registration confirmation unit 31 checks whether the license plate information is registered in the registration information DB 391. As a response to the registration confirmation request, the registration confirmation unit 31 sends the confirmation result to the image transmission device 2.

[0036] The registration determination unit 24 receives a response to the registration confirmation request from the image transfer device 3 via the receiving unit 28, and determines whether or not the license plate information is registered in the image transfer system 10 based on the confirmation result. The registration of license plate information in the image transfer device 3 indicates that the vehicle associated with that license plate information is eligible for the image transfer service provided by the image transfer system 10. If the license plate information of vehicle V1 is registered in the image transfer device 3, then vehicle V1 is eligible for the image transfer service.

[0037] If the registration determination unit 24 determines that the license plate information is registered, it transmits the license plate information and the vehicle image captured by the imaging unit 21 to the image transfer device 3. Therefore, the registration determination unit 24 transmits the vehicle image if the vehicle V1 is eligible for the service, and does not transmit the vehicle image if the vehicle V1 is not eligible. In this way, by checking whether the vehicle is registered with the image transfer system 10 before transmitting the vehicle image to the image transfer device 3, the image transmission device 2 can suppress the transmission of unnecessary images to the image transfer device 3.

[0038] Although this example describes registration verification being performed in the registration verification unit 31 of the image transfer device 3, the method of registration verification is not limited to this. For example, the image transmission device 2 may be equipped with the function of the registration verification unit 31 and perform registration verification in the image transmission device 2. In this case, the storage unit 29 of the image transmission device 2, or an external storage device, may store the registration information DB 391.

[0039] For example, suppose the registration determination unit 24 of the image transmission device 2 also includes the function of the registration confirmation unit 31. In this case, the registration determination unit 24 refers to the registration information DB 391 and checks whether the number information read by the number reading unit 23 is registered in the registration information DB 391. If there is number information in the registration information DB 391 that matches the number information read, the registration determination unit 24 determines that the number information is registered. By performing registration confirmation of number information in this way in the image transmission device 2, the time required for registration confirmation can be reduced.

[0040] The transmitting unit 27 transmits information to the outside via a communication means. The communication means may be, for example, mobile communication technology or the internet. As for mobile communication technology, for example, low-latency 5G (5th Generation Mobile Communication System) or technologies with even lower latency may be used. The communication means are not limited to these.

[0041] The transmitting unit 27 transmits information to the image transfer device 3 via the network N. For example, if the vehicle image includes a license plate image, the transmitting unit 27 transmits the license plate information read by the license plate reading unit 23 and a registration confirmation request to the image transfer device 3. Also, if the registration determination unit 24 determines that the license plate information is registered in the image transfer system 10, the transmitting unit 27 transmits the license plate information and the vehicle image to the image transfer device 3.

[0042] The receiving unit 28 receives information from the outside via a communication means. For example, the receiving unit 28 receives a response from the image transfer device 3 to a request for confirmation of registration of number information.

[0043] The storage unit 29 stores various data and programs. At least a portion of the storage unit 29 is composed of non-volatile memory so that data is retained even when the power to the image transmission device 2 is turned off. The storage unit 29 may also store vehicle images acquired by the vehicle image acquisition unit 22.

[0044] (Image transfer device 3) Next, the image transfer device 3 will be described. The image transfer device 3 receives vehicle images from the image transmission device 2 and transfers the received vehicle images to the image display device 1. The image transfer device 3 may also check whether the license plate information of vehicle V1 is registered, and if registration is confirmed, transfer the vehicle images to the destination corresponding to the license plate information. The image transfer device 3 may be implemented by, for example, a server device or cloud system that provides image transfer services. The image transfer device 3 comprises a registration confirmation unit 31, a transfer processing unit 32, a transmission unit 37, a receiving unit 38, and a storage unit 39.

[0045] The image transfer device 3 includes a processor and memory, although these are not shown in the diagram. The storage unit 39, which is a storage device, stores a computer program on which the processing described herein is implemented. The processor can load the computer program from the storage device into the memory and execute the computer program. In this way, the processor realizes the functions of the registration confirmation unit 31 and the transfer processing unit 32.

[0046] Furthermore, the registration confirmation unit 31 and the transfer processing unit 32 may each be implemented with dedicated hardware. Some or all of each component may be implemented by general-purpose or dedicated circuits, processors, etc., or combinations thereof. These may be composed of a single chip or multiple chips connected via a bus. Some or all of each component may be implemented by a combination of the above-mentioned circuits, etc., and programs. In addition, a CPU, GPU, FPGA, quantum processor, etc. can be used as the processor.

[0047] The registration confirmation unit 31 checks whether the license plate information received from the image transmission device 2 is registered in the image transfer system 10. When the registration confirmation unit 31 receives the license plate information and registration confirmation request from the image transmission device 2, it refers to the registration information DB 391 stored in the storage unit 39. The registration information DB 391 associates the license plate information with the transfer destination of the vehicle image.

[0048] Figure 3 shows an example of the registration information DB391. In this example, the registration information DB391 includes the user ID, license plate information, and transfer destination information. The user ID is information that identifies the user receiving the image transfer service. The license plate information is the information written on the license plate of the vehicle to which the image transfer service is provided. The transfer destination is information that indicates the destination to which the vehicle image is transferred.

[0049] The destination is, for example, the address of the image display device 1. The address of the image display device 1 may be, for example, an IP address (Internet Protocol address) used for communication in network N. Alternatively, the destination may be a device ID that identifies the image display device 1. Furthermore, if the image transfer device 3 is a cloud server, the destination may be an endpoint of a dedicated system. In addition to these, the destination may be any information that identifies the destination to which the vehicle image is transferred. If the registration confirmation unit 31 confirms the registration of the license plate information, it uses the registration information DB 391 to identify the destination associated with the license plate information.

[0050] Returning to Figure 2, the transfer processing unit 32 performs the transfer processing of the vehicle image. If the registration confirmation unit 31 determines that the license plate information is registered in the registration information DB 391, the transfer processing unit 32 sends a transfer permission request to the image display device 1. The transfer permission request is a request to the image display device 1 to allow the transfer of the vehicle image. The transfer processing unit 32 receives a response to the transfer permission request from the image display device 1 via the receiving unit 38. If the transfer of the vehicle image is permitted, the transfer processing unit 32 transfers the vehicle image to the image display device 1 via the transmitting unit 37.

[0051] The transmitting unit 37 transmits information to the outside via a communication means. The communication means is, for example, mobile communication technology or the internet. For example, the transmitting unit 37 transmits the result of registration confirmation as a response to the registration confirmation request from the image transmitting device 2. The transmitting unit 37 also transmits a transfer permission request to the image display device 1. If transfer is permitted, the transmitting unit 37 transfers the vehicle image to the image display device 1.

[0052] The receiving unit 38 receives information from the outside via a communication means. For example, the receiving unit 38 receives a registration confirmation request from the image transmission device 2. The receiving unit 38 also receives a response to a transfer permission request from the image display device 1.

[0053] The storage unit 39 stores various data and programs. At least a portion of the storage unit 39 is composed of non-volatile memory so that data is retained even when the power to the image transfer device 3 is turned off. The storage unit 39 also stores the registration information DB 391 described above. The registration information DB 391 may be stored in a device other than the image transfer device 3.

[0054] (Image display device 1) Next, the image display device 1 will be described. The image display device 1 receives vehicle images transferred from the image transfer device 3 and displays the received vehicle images. The image display device 1 comprises an image selection unit 11, a display unit 12, a transmission unit 17, a reception unit 18, and a storage unit 19.

[0055] The image display device 1 includes a processor and memory (not shown). The storage unit 19, which is a storage device, stores a computer program on which the processing described herein is implemented. The processor can load the computer program from the storage device into memory and execute the computer program. In this way, the processor realizes the function of the image selection unit 11.

[0056] Furthermore, the image selection unit 11 may be implemented with dedicated hardware. Part or all of the image selection unit 11 may be implemented by general-purpose or dedicated circuits, processors, etc., or combinations thereof. These may be configured as a single chip or as multiple chips connected via a bus. Part or all of the image selection unit 11 may be implemented by a combination of the aforementioned circuits, etc., and a program. Additionally, a CPU, GPU, FPGA, quantum processor, etc., can be used as the processor.

[0057] The image selection unit 11 selects a vehicle image to display on the display unit 12. When multiple vehicle images are transferred from the image transfer device 3, the image selection unit 11 selects the vehicle image to display based on the imaging distance of each of the multiple vehicle images. The imaging distance indicates the distance between the imaging device and the vehicle being photographed. In the example in Figure 1, the imaging distance is the distance between the imaging unit 21 of the image transmission device 2 and the vehicle V1.

[0058] The image selection unit 11 selects images from a plurality of vehicle images that are relatively close in imaging distance. For example, the image selection unit 11 may select the image with the closest imaging distance among the plurality of vehicle images, or it may select multiple images with higher imaging distances. The image selection unit 11 may also adjust the number of vehicle images to select depending on the size of the display area in the display unit 12, the number of display units 12 provided in the vehicle V1, or user selection. The image selection unit 11 may also exclude vehicle images that are located beyond a predetermined imaging distance.

[0059] The following methods 1 to 3 are examples of methods for calculating the imaging distance. Method 1 is a method that directly calculates the imaging distance using a distance measuring sensor. Method 2 is a method that calculates the imaging distance based on the position information of vehicles V1 and V2. Method 3 is a method that calculates the imaging distance by comparing the size of the license plate image included in the vehicle image with reference data.

[0060] (Method 1) Method using measurement results from a distance measuring sensor In Method 1, it is assumed that the vehicle V2 is equipped with a distance measuring sensor. The distance measuring sensor is a sensor that measures the distance from the imaging unit 21 of the vehicle V2 to objects present around the vehicle V2. The distance measuring sensor measures the distance between the imaging unit 21 and the vehicle V1 at the time the imaging unit 21 captures an image of the vehicle V1, and this distance is recorded as the imaging distance.

[0061] Range measuring sensors include, for example, LIDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging), stereo cameras, ToF (Time of Flight) cameras, millimeter-wave radar, or ultrasonic sensors. Range measuring sensors may also be composite sensors that have the function of imaging the subject in addition to the function of measuring the distance to the subject.

[0062] When transmitting a vehicle image to the image transfer device 3, the transmission unit 27 of the image transmission device 2 transmits the vehicle image to the image transfer device 3, associating the vehicle image with the imaging distance. The transmission unit 37 of the image transfer device 3 transmits the vehicle image to the image display device 1, associating the vehicle image with the imaging distance. The image transmission device 2 and the image transfer device 3 perform this process for each of the multiple vehicle images. As a result, the image selection unit 11 can acquire multiple vehicle images and the imaging distance associated with each vehicle image.

[0063] (Method 2) Method using positioning technology In Method 2, it is assumed that vehicles V1 and V2 are equipped with position detection sensors. The position detection sensors are sensors that detect the position of each vehicle. The position detection sensors may be sensors that perform positioning using technologies such as GNSS (Global Navigation Satellite System), including GPS (Global Positioning System).

[0064] Here, the position detection sensor equipped on vehicle V1 is referred to as position detection sensor SE1, and the position detection sensor equipped on vehicle V2 is referred to as position detection sensor SE2. Position detection sensors SE1 and SE2 acquire the position information of vehicles V1 and V2, respectively. For example, position detection sensor SE1 constantly acquires the position information of vehicle V1 and stores it in the storage unit 19.

[0065] The position detection sensor SE2 also detects the position of vehicle V2 at the time the vehicle image was captured and outputs the position information of vehicle V2 to the image transmission device 2. The transmission unit 27 of the image transmission device 2 associates the vehicle image with the position information of vehicle V2 and transmits it to the image transfer device 3. The transmission unit 37 of the image transfer device 3 associates the vehicle image with the position information of vehicle V2 and transfers it to the image display device 1. As a result, the image selection unit 11 can acquire the vehicle image and the position information of vehicle V2 at the time the vehicle image was captured, in association with each other.

[0066] The image selection unit 11 refers to the storage unit 19 and obtains the position information of vehicle V1 at the time when a vehicle image was captured by vehicle V2. The image selection unit 11 compares the position information of vehicle V1 with the position information of vehicle V2 and calculates the distance between vehicle V1 and vehicle V2 as the imaging distance. The image display device 1, image transmission device 2, and image transfer device 3 perform this process for each of the multiple vehicle images. As a result, the image selection unit 11 can obtain multiple vehicle images and the imaging distance associated with each vehicle image.

[0067] Furthermore, if vehicle V1 and vehicle V2 communicate directly using V2V (Vehicle-to-Vehicle) communication, the transmission unit 27 of the image transmission device 2 may directly transmit the vehicle image and the location information of vehicle V2 to vehicle V1.

[0068] (Method 3) Method using the size of the license plate image In Method 3, the image selection unit 11 calculates the imaging distance based on the size of the license plate image included in the vehicle image received from the image transfer device 3. For example, the image selection unit 11 measures the number of pixels and the vertical and horizontal dimensions of the license plate image. The image selection unit 11 calculates the imaging distance by comparing the measurement results with reference data.

[0069] Reference data is a correspondence between the size of the license plate image in a vehicle image and the actual imaging distance. For example, reference data can be created by imaging a vehicle at multiple imaging distances and measuring the size of the license plate image for each of the acquired vehicle images. The reference data may be created in a table format, for example, and stored in the storage unit 19 beforehand. The image selection unit 11 calculates the imaging distance corresponding to each vehicle image by comparing the license plate image contained in each of the multiple vehicle images received from the image transfer device 3 with the reference data.

[0070] The image selection unit 11 may calculate the imaging distance using some or all of the methods 1 to 3 described above, or it may calculate the imaging distance by combining other methods. Based on the calculated imaging distance, the image selection unit 11 selects a vehicle image to be displayed on the display unit 12 from among a plurality of vehicle images received from the image transmission device 2.

[0071] The image selection unit 11 may also simply select the vehicle image to display based on the size of the license plate image. For example, the image selection unit 11 may select the vehicle image with the largest license plate image from among several vehicle images.

[0072] The image selection unit 11 may also determine the level of proximity of the imaging distance based on the size of the license plate image and select a vehicle image based on the determined level. For example, the image selection unit 11 may determine the level of proximity of the imaging distance as "very close," "somewhat close," "somewhat far," or "very far." The image selection unit 11 may, for example, select a vehicle image for which the imaging distance is determined to be "very close." Note that the level is not limited to four levels and can be arbitrary. The image selection unit 11 may also represent the level numerically.

[0073] While license plates have the advantage of being the same size regardless of vehicle type, making it easy to calculate the imaging distance, the image selection unit 11 may also calculate the imaging distance using images of objects other than license plates. For example, the image selection unit 11 may calculate the imaging distance based on the size of the entire image of the vehicle (vehicle V1) included in the vehicle image, or the size of characteristic parts.

[0074] The display unit 12 displays the vehicle image transferred from the image transfer device 3. The display unit 12 is, for example, a display. The display unit 12 may also be a touch panel with input functionality. If the vehicle V1 is equipped with a drive recorder, the display of the drive recorder may be used as the display unit 12. The display may be one provided on the drive recorder itself, or it may be a separate display provided on the vehicle V1. For example, the display unit 12 may be the display of a terminal device such as a smartphone used by the user of the vehicle V1.

[0075] When multiple vehicle images are transferred from the image transfer device 3, the display unit 12 displays the vehicle image selected by the image selection unit 11. For example, the display unit 12 displays the vehicle image with the closest imaging distance among the multiple vehicle images. As a result, the display unit 12 can display the vehicle image in which vehicle V1 is shown most prominently, allowing the user to easily understand the status of their own vehicle.

[0076] Furthermore, if multiple vehicle images are selected in the image selection unit 11 to be displayed on the display unit 12, the display unit 12 will display the multiple vehicle images. In this case, the display unit 12 may display the multiple selected vehicle images simultaneously on the same screen, or it may switch between displaying some of these images. When displaying multiple selected vehicle images simultaneously, the display unit 12 may vary the display mode depending on the imaging distance. For example, the display unit 12 may display the vehicle image closest in imaging distance as the largest. Alternatively, the display unit 12 may display the vehicle image closest in imaging distance in the center.

[0077] When switching between displaying parts of multiple selected vehicle images, the display unit 12 may switch the display of these images at predetermined time intervals, or it may accept user selections via the input unit and switch the display accordingly.

[0078] Referring to Figures 4 and 5, examples of vehicle images displayed on the display unit 12 when processing related to the image transfer system 10 is performed will be explained. Figure 4 is a diagram showing the situation in front of vehicle V2 as seen from the driver's perspective of vehicle V2. Figure 5 is a diagram showing the situation in front of vehicle V1 as seen from the driver's perspective of vehicle V1. In Figures 4 and 5, similar to the example shown in Figure 1, vehicle V2 is traveling behind vehicle V1.

[0079] As shown in Figure 4, vehicle V1 is about to turn left at an intersection in front of vehicle V2. In front of vehicle V1 is pedestrian P1 about to cross the crosswalk. Also, motorcycle P2 is approaching from behind vehicle V1. The driver of vehicle V2 can easily see pedestrian P1 and motorcycle P2. However, motorcycle P2 may be in the blind spot of the driver of vehicle V1. In such a case, the driver of vehicle V1 may turn left at the intersection without noticing motorcycle P2, which could result in a collision between motorcycle P2 and vehicle V1, or a fall of motorcycle P2.

[0080] In the image transfer system 10 according to this disclosure, as shown in Figure 5, the display unit 12 of the vehicle V1 displays a vehicle image 121. The vehicle image 121 is an image acquired by the image transmission device 2 of the vehicle V2 capturing an image of the vehicle V1, and transferred to the image display device 1 via the image transfer device 3.

[0081] As shown in Figure 5, the vehicle image 121 includes pedestrians P1 visible from vehicle V1, as well as vehicle V1 and motorcycle P2, which are neither visible nor imaged by vehicle V1. By viewing the vehicle image 121, the driver of vehicle V1 can easily understand the situation even in areas that are blind spots and difficult to see from their own field of vision. This allows the driver of vehicle V1 to confirm the safety of the area around their vehicle and prevent accidents from occurring. In addition, vehicle V2 shares vehicle images with vehicle V1 by transferring the vehicle images it has captured to vehicle V1. This allows vehicle V2 to contribute to improving the safety of the area around its vehicle.

[0082] Returning to Figure 2, the transmitting unit 17 transmits information to the outside via a communication means. The communication means is, for example, mobile communication technology or the internet. For example, the transmitting unit 17 transmits information to the image transfer device 3 via the network N. For example, the transmitting unit 17 transmits a response to a transfer permission request to the image transfer device 3.

[0083] The receiving unit 18 receives information from an external source via a communication means. For example, the receiving unit 18 receives a transfer permission request from the image transfer device 3. The receiving unit 18 also receives vehicle images transferred from the image transfer device 3. The receiving unit 18 may store the received vehicle images in the storage unit 19.

[0084] The storage unit 19 stores various data and programs. At least a portion of the storage unit 19 is composed of non-volatile memory so that data is retained even when the power to the image display device 1 is turned off. The storage unit 19 also stores vehicle images received from the image transfer device 3. The storage unit 19 may retain vehicle images for a predetermined period of time and delete them after that period has elapsed. By retaining vehicle images, they can be used, for example, as evidence recording the circumstances of an accident. However, the vehicle images may be stored in a device other than the image display device 1.

[0085] In the above explanation, an example was shown in which a vehicle V2 traveling behind images a vehicle V1 traveling in front, but the system is not limited to this. The image transmission system 10 may also be configured so that the vehicle V1 traveling in front images the vehicle V2 traveling behind. In that case, vehicle V1 may be equipped with an image transmission device 2 and vehicle V2 may be equipped with an image display device 1. In that case, the imaging unit 21 of the image transmission device 2 provided in vehicle V1 may be configured to image the area behind vehicle V1.

[0086] For example, the imaging unit 21 is a rear camera that captures images of the area behind the vehicle V1. The imaging unit 21 is installed, for example, above the interior of the vehicle V1 or on the rear exterior of the vehicle V1, in a position that allows it to capture images of the area behind the vehicle V1. The other components can be considered in general the same way as the configuration of the image display device 1 and image transmission device 2 described above, so a detailed explanation is omitted.

[0087] If some or all of the components of the image display device 1, image transmission device 2, and image transfer device 3 are implemented by multiple information processing devices or circuits, these multiple information processing devices or circuits may be centrally located or distributed. For example, the information processing devices or circuits may be implemented in a form in which each is connected via a communication network, such as a client-server system or a cloud computing system. Also, for example, the functions of the image transfer device 3 may be provided in SaaS (Software as a Service) format.

[0088] (Processing by the image transfer system 10) Next, the processing performed by each device in the image transfer system 10 will be explained with reference to Figures 6 to 8. Figure 6 is a flowchart showing the flow of image transmission processing performed by the image transmission device 2. Figure 7 is a flowchart showing the flow of image transfer processing performed by the image transfer device 3. Figure 8 is a flowchart showing the flow of image display processing performed by the image display device 1. Note that the processing shown in Figures 6 to 8 uses the example described using Figures 1 to 5, in which a vehicle V2 traveling behind captures an image of a vehicle V1 traveling in front.

[0089] (Image transmission process of image transmission device 2) Referring to Figure 6, the image transmission process of the image transmission device 2 will be explained. First, the imaging unit 21 captures an image of the vehicle V1 (S11). The vehicle image acquisition unit 22 then acquires the vehicle image obtained from the imaging.

[0090] Next, the number reading unit 23 determines whether or not the vehicle image contains a license plate image (S12). If it is determined that the vehicle image does not contain a license plate image (NO in S12), the process in step S11 is repeated. If it is determined that the vehicle image contains a license plate image (YES in S12), the number reading unit 23 reads the license plate information from the vehicle image (S13).

[0091] Next, the registration determination unit 24 requests the image transfer device 3 to confirm the registration of the license plate information (S14). For example, the registration determination unit 24 makes the registration confirmation request by transmitting the license plate information and the registration confirmation request to the image transfer device 3. As a result, the image transfer device 3 confirms the registration of the license plate information. The registration confirmation verifies whether the vehicle is eligible for the image transfer service. The receiving unit 28 receives the registration confirmation result from the image transfer device 3 (S15).

[0092] The registration determination unit 24 determines whether or not the license plate information is registered based on the registration confirmation result (S16). If it is determined that the license plate information is not registered (NO in S16), the process returns to step S11 and the subsequent processing is repeated. If it is determined that the license plate information is registered (YES in S16), the transmission unit 27 transmits the license plate information and vehicle image to the image transfer device 3 (S17).

[0093] Furthermore, the image transmission device 2 may have a function to track a vehicle whose license plate information has been recognized once. For example, even if the license plate is not visible in the vehicle image, the image transmission device 2 may track vehicle V1 by using its features or movement patterns. The features of vehicle V1 may be, for example, its shape, color, or size. In that case, the image transmission device 2 may proceed to step S17 after step S11 without performing steps S12 to S16.

[0094] (Image transfer processing of image transfer device 3) Referring to Figure 7, the image transfer process of the image transfer device 3 will be explained. First, the receiving unit 38 determines whether or not it has received a registration confirmation request from the image transmission device (S21). If it is determined that a registration confirmation request has not been received (NO in S21), the process in step S21 is repeated. If it is determined that a registration confirmation request has been received (YES in S21), the registration confirmation unit 31 performs registration confirmation of the number information (S22).

[0095] Next, the registration confirmation unit 31 determines whether or not the number information is registered (S23). Specifically, the registration confirmation unit 31 refers to the registration information DB 391 in the storage unit 39 to check whether the number information is registered. If it is determined that the number information is not registered (NO in S23), the registration confirmation unit 31 sends a message to the image transmission device 2 indicating that the number information is not registered (S25). After that, the process returns to step S21.

[0096] If it is determined that the license plate information is registered (YES in S23), the registration confirmation unit 31 transmits a message to the image transmission device 2 indicating that the license plate information is registered (S24). The registration confirmation unit 31 also identifies the transfer destination associated with the registered license plate information. Subsequently, the license plate information and vehicle image are transmitted from the image transmission device 2 to the image transfer device 3. The receiving unit 38 receives the license plate information and vehicle image from the image transmission device 2 (S26).

[0097] Next, the transmitting unit 37 sends a transfer permission request to the image display device 1 (S27). Subsequently, the image display device 1 sends a response to the transfer permission request, which the receiving unit 38 receives. The transfer processing unit 32 determines whether the transfer is permitted or not (S28). The transfer processing unit 32 determines that the transfer is permitted if the receiving unit 38 receives a permission response, and that the transfer is denied if the receiving unit 38 receives a denial response. If it is determined that the transfer is denied (NO in S28), the process ends. If it is determined that the transfer is permitted (YES in S28), the transmitting unit 37 transfers the vehicle image to the image display device 1 (S29).

[0098] (Image display processing of image display device 1) Referring to Figure 8, the image display process of the image display device 1 will be explained. First, the receiving unit 18 determines whether or not it has received a transfer permission request from the image transfer device 3 (S31). If it is determined that a transfer permission request has not been received (NO in S31), the process of step S31 is repeated.

[0099] If it is determined that a transfer permission request has been received (YES in S31), the transmission unit 17 determines whether or not to allow the transfer of the vehicle image to the image display device 1 (S32). The transmission unit 17 may be configured to automatically determine whether to allow the transfer of the vehicle image, or it may be configured to determine whether to allow or deny the transfer in response to user input, for example.

[0100] If it is determined that the transfer of the vehicle image should be refused (NO in S32), the transmitting unit 17 sends a refusal response to the image transfer device 3 (S34). If it is determined that the transfer of the vehicle image should be permitted (YES in S32), the transmitting unit 17 sends a permission response to the image transfer device 3 (S33). Subsequently, the vehicle image is transferred from the image transfer device 3 to the image display device 1. The receiving unit 18 receives the vehicle image from the image transfer device 3 (S35). The receiving unit 18 may also store the vehicle image in the storage unit 19.

[0101] Next, the image selection unit 11 determines whether or not multiple vehicle images have been transferred from the image transfer device 3 (S36). If it is determined that multiple vehicle images have not been transferred from the image transfer device 3 (NO in S36), the process proceeds to step S38. If it is determined that multiple vehicle images have been transferred from the image transfer device 3 (YES in S36), the image selection unit 11 selects a vehicle image to display on the display unit 12 based on the imaging distance of each of the multiple vehicle images (S37). The image selection unit 11 can calculate the imaging distance using methods 1 to 3 described above. For example, the image selection unit 11 selects the image with the closest imaging distance among the multiple vehicle images. Then, the display unit 12 displays the vehicle image (S38). As a result, the display unit 12 displays an image such as the vehicle image 121 shown in Figure 5.

[0102] As described above, in the image transfer system 10 of this disclosure, a vehicle image captured by the rear vehicle V2 is transmitted from the image transmission device 2 to the image transfer device 3, and then transferred from the image transfer device 3 to the image display device 1 of vehicle V1. The display unit 12 of vehicle V1 displays a vehicle image captured from the rear of vehicle V1, so the driver of vehicle V1 can easily grasp the situation of their vehicle, including areas that are blind spots from their own vehicle.

[0103] Furthermore, the image transfer system 10 can use the license plate information read from the vehicle image to determine whether or not the user of vehicle V1 is registered in advance, and if it determines that the user is registered, it can transfer the vehicle image. This prevents the transfer of unnecessary images.

[0104] Furthermore, when multiple vehicle images are transferred from the image transfer device 3, the image transfer system 10 can display a vehicle image selected based on the imaging distance of each of the multiple vehicle images. This allows the image transfer system 10 to display, for example, the vehicle image with the closest imaging distance.

[0105] With this configuration, the image transfer system 10 can acquire images of its own vehicle with a simpler setup.

[0106] Each of the functional components of the image display device 1, image transmission device 2, and image transfer device 3 described above may be implemented by hardware (e.g., hardwired electronic circuits) or by a combination of hardware and software (e.g., a combination of electronic circuits and a program to control them). For example, this disclosure can also be implemented by having a CPU execute a computer program.

[0107] The program, when loaded into a computer, includes a set of instructions (or software code) for causing the computer to perform one or more of the functions described in the embodiments. The program may be stored in various types of non-transitory computer-readable medium or tangible storage medium. Examples, but not limited to, include RAM (Random-Access Memory), ROM (Read-Only Memory), flash memory, SSD (Solid-State Drive), or other memory technologies, CD-ROM, DVD (Digital Versatile Disc), Blu-ray® disc, or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage, or other magnetic storage devices. The program may also be transmitted over various types of transient computer-readable medium or communication medium. Examples, but not limited to, include transient computer-readable medium or communication medium, including electrically, optically, acoustically, or otherwise propagating signals.

[0108] This disclosure is not limited to the embodiments described above, and may be modified as appropriate without departing from its intent. [Explanation of symbols]

[0109] 1. Image display device 2 Image transmission device 3. Image Transfer Device 10 Image Transfer System 11 Image Selection Section 12 Display section 17, 27, 37 Transmitter 18, 28, 38 Receiving section 19, 29, 39 Memory section 21 Imaging Department 22 Vehicle Image Acquisition Unit 23 Number reading unit 24 Registration Determination Unit 31 Registration Confirmation Department 32 Transfer Processing Unit 121 Vehicle Images 391 Registration Information Database N Network P1 Pedestrian P2 Motorcycle V1, V2 vehicles

Claims

1. An image transmission device that transmits vehicle images captured by the imaging unit, An image transfer device that transfers the vehicle image received from the image transmission device, The system includes an image display device that displays the vehicle image received from the image transfer device, If the vehicle image includes a license plate image, the image transmission device transmits the license plate information read from the license plate image and the vehicle image to the image transfer device. The image transfer device transfers the vehicle image to a transfer destination corresponding to the number information received from the image transmission device. The image display device displays the vehicle image transferred from the image transfer device. Image transfer system.

2. The image transmission device determines whether the license plate information is registered in the image transfer system, and if it determines that it is registered, it transmits the license plate information and the vehicle image to the image transfer device. The image transfer system according to claim 1.

3. When multiple vehicle images are transferred from the image transfer device, the image display device displays a vehicle image selected based on the imaging distance of each of the multiple vehicle images. The image transfer system according to claim 1 or 2.

4. A vehicle image acquisition unit acquires vehicle images captured by the imaging unit, If the vehicle image includes a license plate image, the system includes a transmission unit that transmits the license plate information read from the license plate image and the vehicle image to an image transfer device that transfers the vehicle image to a transfer destination corresponding to the license plate information. Image transmission device.

5. In an image transmission device that transmits a vehicle image captured by an imaging unit, if the vehicle image includes a license plate image, the number information read from the license plate image and the vehicle image are transmitted to an image transfer device that transfers the vehicle image. In the image transfer device, the vehicle image is transferred to a transfer destination corresponding to the number information received from the image transmission device. In the image display device, the vehicle image transferred from the image transfer device is displayed. Image transfer method.

Images