Display control device
By combining the captured images of multiple on-board cameras in the dash recorder and synthesize the vehicle icons to generate the synthetic image, it solves the problem that it is difficult for users to intuitively grasp the relationship between the captured images of the on-board cameras and their own vehicle position, achieving more intuitive operations and better user experience.
Patent Information
- Application Number
- CN202411872151.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-12-25
- Filing Date
- 2024-12-18
- Publication Date
- 2025-06-27
AI Technical Summary
In a dash recorder, it is difficult for users to intuitively grasp the positional relationship between images captured by multiple on-board cameras and their own vehicles.
Through the image junction part, the captured images of multiple vehicle-mounted cameras are combined to generate a combined image around the vehicle, and the vehicle icon is synthesized on the combined image to generate a synthetic image. The device divides the composite image into multiple divided image areas, and the user can select the divided image area to be enlarged and displayed only the captured image of the on-board camera corresponding to the area.
The user can easily grasp the positional relationship between the captured images captured through multiple on-board cameras and their own vehicles, improving the user experience and operational intuitiveness.
Smart Images

Figure CN120207111A_ABST
Abstract
Description
Technical Field
[0001] This application relates to a display control device. Background Art
[0002] For example, Patent Document 1 describes a driving recorder equipped with multiple in-vehicle cameras. This driving recorder displays the captured images of the multiple in-vehicle cameras side by side on a display unit. Moreover, when one of the captured images among the multiple displayed captured images is selected by a user, the selected captured image is enlarged and displayed. Prior Art Documents Patent Documents
[0003] Patent Document 1: Japanese Unexamined Patent Application Publication No. 2020-145687 Summary of the Invention Problems to be Solved by the Invention
[0004] In the above driving recorder, the captured images of the multiple in-vehicle cameras are merely displayed side by side on the display unit. Therefore, when a user selects a captured image of an in-vehicle camera that they want to enlarge and display, it is difficult to intuitively grasp which direction of the vehicle the captured image of the in-vehicle camera is taken from.
[0005] Therefore, in the case where the display control device disclosed in this application displays the captured images of the surroundings of its own vehicle captured by multiple in-vehicle cameras on the display unit, the user can easily grasp the positional relationship between the captured images captured by the multiple in-vehicle cameras and its own vehicle. Technical Means for Solving the Problems
[0006] One aspect of the present application relates to a display control device that displays captured images of the surroundings of its own vehicle captured by a plurality of in-vehicle cameras on a display unit, and includes: an image combining unit that combines the captured images of the plurality of in-vehicle cameras to generate a combined image of the surroundings of its own vehicle; an icon synthesizing unit that generates a synthesized image in which a vehicle icon representing its own vehicle is synthesized on the combined image generated by the image combining unit; a region determining unit that divides the synthesized image into a plurality of divided image regions corresponding to the shooting regions of the plurality of in-vehicle cameras respectively, and the region determining unit determines the divided image region selected by the user among the plurality of divided image regions included in the synthesized image; and a display control unit that displays the synthesized image generated by the icon synthesizing unit on the display unit, and when the divided image region selected by the user is determined by the region determining unit, displays the captured image of the in-vehicle camera corresponding to the determined divided image region on the display unit, and does not display the captured images of in-vehicle cameras other than the in-vehicle camera corresponding to the determined divided image region on the display unit. The icon synthesizing unit synthesizes the vehicle icon at the position of its own vehicle in the combined image in such a way that the shooting direction of the in-vehicle camera when viewed from its own vehicle is consistent with the orientation of the vehicle icon in the combined image, and generates a synthesized image.
[0007] Alternatively, the above display control device may further include a suspiciousness calculating unit that calculates the suspiciousness of the recognized person based on the actions of the person recognized by the person tracking unit and the pre-determined suspicious person actions. When a plurality of persons recognized by the person tracking unit are present in the divided image region selected by the user, the display control unit switches the captured image of the in-vehicle camera along with the movement of the person with the highest suspiciousness calculated by the suspiciousness calculating unit so that the person is displayed on the display unit. Advantages of the Invention
[0008] According to one aspect of the present application, when displaying the captured images of the surroundings of its own vehicle captured by a plurality of in-vehicle cameras on the display unit, the user can easily grasp the positional relationship between the captured images captured by the plurality of in-vehicle cameras and its own vehicle. Brief Description of the Drawings
[0009] Figure 1 is a block diagram showing an example of a driving recorder according to an embodiment. Figure 2 is a diagram showing an example of a synthesized image. Figure 3 is a diagram showing an example of the captured image of the in-vehicle camera corresponding to the divided image region selected by the user. Figure 4 is a flowchart showing a processing flow of recording the captured image of the in-vehicle camera. Figure 5It is a flowchart showing the processing flow for displaying the captured images of an in-vehicle camera. Detailed implementation
[0010] Hereinafter, exemplary embodiments will be described with reference to the accompanying drawings. In addition, in each drawing, the same or corresponding elements are denoted by the same reference numerals, and repeated descriptions are omitted.
[0011] As Figure 1 shown, the dashcam 100 is mounted on its own vehicle V. The dashcam 100 includes an ECU (Electronic Control Unit), a camera unit 2, and a display unit 3. The dashcam 100 displays the captured images of the surroundings of its own vehicle V captured by a plurality of in-vehicle cameras 20 included in the camera unit 2 on the display unit 3. The dashcam 100 stores the captured images of the in-vehicle cameras 20 and displays the stored captured images according to an instruction from the user.
[0012] The camera unit 2 includes a plurality of in-vehicle cameras 20. In the present embodiment, as the plurality of in-vehicle cameras 20, the camera unit 2 includes a front camera 21 that captures the front of its own vehicle V, a rear camera 22 that captures the rear of its own vehicle V, a left camera 23 that captures the left side of its own vehicle V, and a right camera 24 that captures the right side of its own vehicle V. By the front camera 21, the rear camera 22, the left camera 23, and the right camera 24, it is possible to continuously capture the entire circumference around its own vehicle V.
[0013] The display unit 3 displays the captured images (videos) captured by the camera unit 2. The display unit 3 may be a monitor mounted on its own vehicle V. The display unit 3 is not limited to being provided on its own vehicle V, and may also be a monitor of a portable terminal such as a smartphone.
[0014] The ECU 1 functions as a display control device that displays the captured images of the surroundings of its own vehicle V captured by a plurality of in-vehicle cameras 20 on the display unit 3. The ECU 1 is an electronic control unit having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a communication module, etc. The ECU 1 realizes various functions, for example, by loading the program stored in the ROM into the RAM and using the CPU to execute the program loaded into the RAM. The ECU 1 may also be composed of a plurality of electronic units.
[0015] The ECU 1 functionally includes a storage unit 11, a person tracking unit 12, a suspiciousness calculation unit 13, an image combining unit 14, an icon synthesizing unit 15, a region determination unit 16, and a display control unit 17. The storage unit 11 stores the captured images captured by the multiple in-vehicle cameras 20 included in the camera unit 2. The storage unit 11 sequentially stores the captured images together with the time information when the captured images are captured. The captured images stored in the storage unit 11 are read according to an instruction from the user and displayed on the display unit 3.
[0016] The person tracking unit 12 identifies the persons in the captured images of the in-vehicle cameras 20. That is, the person tracking unit 12 identifies whether there are persons around its own vehicle V. The person tracking unit 12 can identify the persons in the captured images according to known image processing techniques. When the person tracking unit 12 identifies a person in the captured image, it generates tracking information for tracking the movement of the person among the captured images of the multiple in-vehicle cameras 20. The tracking information includes information indicating in which captured image of which in-vehicle camera 20 the identified person is included as the person moves. The person tracking unit 12 stores the generated tracking information in the storage unit 11.
[0017] The suspiciousness calculation unit 13 calculates the suspiciousness for the persons identified by the person tracking unit 12. The suspiciousness calculation unit 13 calculates the suspiciousness of the identified person according to the actions of the identified person and the pre-determined actions of suspicious persons. The suspiciousness calculation unit 13 can also use AI (Artificial Intelligence) to calculate the suspiciousness. For example, when the suspiciousness calculation unit 13 detects actions such as attempting to steal its own vehicle V or attempting to play a prank on its own vehicle V, it calculates a high suspiciousness. In addition, when the suspiciousness calculation unit 13 detects signs of actions such as attempting to steal its own vehicle V or attempting to play a prank on its own vehicle V, it calculates a high suspiciousness. As the actions of suspicious persons, actions such as attempting to steal its own vehicle V or attempting to play a prank on its own vehicle V are preset in advance. The suspiciousness calculation unit 13 stores the calculated suspiciousness in the storage unit 11.
[0018] The image combining unit 14 combines the captured images of the multiple in-vehicle cameras 20 to generate a combined image of the surroundings of its own vehicle V. The combined image refers to an image obtained by continuously combining the captured images of the multiple in-vehicle cameras 20 around the entire circumference of its own vehicle V. For example, when the shooting areas of two in-vehicle cameras 20 overlap, the image combining unit 14 uses the captured image of either in-vehicle camera 20 to generate a combined image for the overlapping area. The icon synthesizing unit 15 generates an image, i.e., a synthesized image, in which a vehicle icon representing its own vehicle V is synthesized on the combined image generated by the image combining unit 14.
[0019] An example of the image generated by the image combining unit 14 and the icon synthesizing unit 15 will be described. As Figure 2 shown, the image combining unit 14 combines the captured image C1 captured by the front camera 21, the captured image C2 captured by the rear camera 22, the captured image C3 captured by the left camera 23, and the captured image C4 captured by the right camera 24 to generate a combined image C of the surroundings of the own vehicle V. The icon synthesizing unit 15 adds a vehicle icon A representing the own vehicle V to the combined image C to generate a synthesized image B.
[0020] In addition, the icon synthesizing unit 15 synthesizes the vehicle icon A at the position of the own vehicle V in the combined image C in such a manner that the shooting direction of the in-vehicle camera 20 when viewed from the own vehicle V is consistent with the orientation of the vehicle icon A in the combined image C. That is, the icon synthesizing unit 15 arranges the vehicle icon A such that the captured image C1 captured by the front camera 21 is in front of the vehicle icon A when viewed from the vehicle icon A, the captured image C2 captured by the rear camera 22 is behind the vehicle icon A when viewed from the vehicle icon A, the captured image C3 captured by the left camera 23 is to the left of the vehicle icon A when viewed from the vehicle icon A, and the captured image C4 captured by the right camera 24 is to the right of the vehicle icon A when viewed from the vehicle icon A.
[0021] The synthesized image generated by the icon synthesizing unit 15 is divided into a plurality of divided image regions in a manner corresponding to the shooting regions of the plurality of in-vehicle cameras 20 respectively. For example Figure 2 shown, the icon synthesizing unit 15 uses a dividing line L that divides the shooting regions of adjacent in-vehicle cameras 20 to divide the synthesized image B into a plurality of divided image regions. In Figure 2 the example shown, the synthesized image B is divided into divided image regions K1, K2, K3, and K4 around the vehicle icon A. The divided image region K1 corresponds to the shooting region (captured image C1) of the front camera 21. The divided image region K2 corresponds to the shooting region (captured image C2) of the rear camera 22. The divided image region K3 corresponds to the shooting region (captured image C3) of the left camera 23. The divided image region K4 corresponds to the shooting region (captured image C4) of the right camera 24.
[0022] Accordingly, by observing the synthesized image B displayed on the display unit 3, the user can grasp which in-vehicle camera 20 each region of the synthesized image B is captured by. In addition, the icon synthesizing unit 15 is not limited to using the dividing line L, and the synthesized image B may also be divided into divided image regions K1 to K4 by making the colors of the respective divided image regions K1 to K4 different from each other.
[0023] The area determination unit 16 determines the segmented image area selected by the user among the multiple segmented image areas included in the composite image. Here, the user can observe the composite image displayed on the display unit 3 and select the segmented image area (in-vehicle camera 20) that they want to magnify and confirm. For example, when the display unit 3 has a touch panel function, the user can select the segmented image area by touching the display screen of the display unit 3. However, the method for the user to select the segmented image area is not particularly limited. The area determination unit 16 determines the segmented image area that the user selects and wants to magnify and confirm.
[0024] The display control unit 17 displays the composite image generated by the icon composition unit 15 on the display unit 3. The display control unit 17 displays the composite image on the display unit 3 according to an instruction from the user. The display control unit 17 sequentially displays the composite images after the time indicated by the user on the display unit 3. Thereby, the user can confirm the conditions around their own vehicle V during the period they want to confirm.
[0025] In addition, as Figure 2 shown, the display control unit 17 displays the combined image C and the vehicle icon A in the composite image B in such a way as to form an image of observing their own vehicle V and the surroundings of their own vehicle from an obliquely upper direction. Here, the display control unit 17 displays the combined image C and the vehicle icon A in the composite image B in such a way that the side and the upper surface of the vehicle where the vehicle icon A can be observed are visible.
[0026] The user can change the viewing angle and the observation point position of the composite image B displayed on the display unit 3. The display control unit 17 adjusts the orientation, etc. of the combined image C and the vehicle icon A in the composite image B in such a way as to form the viewing angle and the observation point position indicated by the user, and displays the adjusted composite image B on the display unit 3. For example, in the Figure 2 example shown, it is formed as a view of observing their own vehicle V from the left front obliquely. For example, according to an instruction from the user, the display control unit 17 adjusts the orientation, etc. of the combined image C and the vehicle icon A in the composite image B in such a way as to form a view of observing their own vehicle V from the right rear obliquely, and displays the adjusted composite image B on the display unit 3.
[0027] When the area determination unit 16 determines the segmented image area selected by the user, the display control unit 17 displays the captured image of the in-vehicle camera 20 corresponding to the determined segmented image area on the display unit 3. In addition, the display control unit 17 does not display the captured images of the in-vehicle cameras 20 other than the in-vehicle camera 20 corresponding to the determined segmented image area on the display unit 3. That is, the display control unit 17 only displays the captured image corresponding to the segmented image area that the user selects and wants to magnify and confirm on the display unit 3. For example, assume that in Figure 2In the state where the synthesized image B shown is being displayed on the display unit 3, the user selects the divided image area K2. In this case, as Figure 3 shown, the display control unit 17 displays only the captured image C2 of the rear camera 22 corresponding to the divided image area K2 among the plurality of in-vehicle cameras 20 on the display unit 3.
[0028] Here, there is a case where a person recognized by the person tracking unit 12 exists in the divided image area selected by the user. In this case, the display control unit 17 switches the captured image of the in-vehicle camera 20 as the person moves, based on the tracking information generated by the person tracking unit 12, so that the person is displayed on the display unit 3. At this time, the display control unit 17 may also display the recognized person in a recognizable manner to the user.
[0029] For example, in Figure 2 the display example of the synthesized image B shown, there is a person H behind the host vehicle V. The person tracking unit 12 recognizes the person H in the captured image C2 of the rear camera 22, that is, in the divided image area K2. In addition, as the person H moves, the person tracking unit 12 generates tracking information indicating which captured image of the in-vehicle camera 20 includes the person H. Assume that in this situation, the user selects the divided image area K2 as the divided image area to be enlarged and confirmed. In this case, as Figure 3 shown, the display control unit 17 displays the captured image C2 of the rear camera 22 corresponding to the divided image area K2 on the display unit 3 according to the user's selection. And the display control unit 17 switches the in-vehicle camera 20 displayed on the display unit 3 according to the tracking information so that even if the person H moves, the person H will appear on the display unit 3. For example, the display control unit 17 may also display the person H surrounded by a frame line L1 on the display unit 3 so that the user can recognize the person H recognized by the person tracking unit 12. However, the method of displaying the recognized person H in a recognizable manner is not particularly limited. For example, the display control unit 17 may also make the person H blink or change the color.
[0030] In addition, there is a case where a plurality of persons recognized by the person tracking unit 12 exist in the divided image area selected by the user. In this case, the display control unit 17 switches the captured image of the in-vehicle camera 20 as the person closest to the host vehicle V moves, so that the person is displayed on the display unit 3.
[0031] When there are multiple persons identified by the person tracking unit 12 within the divided image area selected by the user, the display control unit 17 may also switch the display image of the in-vehicle camera 20 according to the suspiciousness calculated by the suspiciousness calculation unit 13. In this case, the display control unit 17 switches the captured image of the in-vehicle camera 20 along with the movement of the person with the highest suspiciousness calculated by the suspiciousness calculation unit 13, so that the person is displayed on the display unit 3.
[0032] Next, the Figure 4 shown flowchart is used to describe the processing flow of recording the captured image of the in-vehicle camera 20 in the driving recorder 100. Additionally, here, the case where the driving recorder 100 records to monitor the surrounding conditions when the own vehicle V is parked is described. As an example, Figure 4 the shown processing starts when the own vehicle V has stopped. As Figure 4 shown, after the own vehicle V stops, the storage unit 11 stores (records) the captured images of each in-vehicle camera 20 (S101). The person tracking unit 12 performs processing to identify persons within the captured images of the in-vehicle camera 20. When a person is identified (S102: Yes), the person tracking unit 12 generates tracking information obtained by tracking the movement of the person among the captured images of multiple in-vehicle cameras 20. The person tracking unit 12 stores the generated tracking information in the storage unit 11 (S103).
[0033] When no person is identified (S102: No), or after generating the tracking information in S103, the storage unit 11 determines whether to end the storage (recording) of the captured images. For example, when the own vehicle V starts moving from the parked state, the storage unit 11 determines to end the storage of the captured images. When it is determined to end the storage of the captured images (S104: Yes), the storage unit 11 ends the storage (recording) of the captured images (S105). When it is not determined to end the storage of the captured images (S104: No), the driving recorder 100 processes again from S101.
[0034] Next, the Figure 5 flowchart is used to describe the processing flow of the display of the captured images in the driving recorder 100. Here, the case where the user later confirms the surrounding conditions of the own vehicle V when parked is taken as an example for description. Figure 5 The shown processing starts according to an instruction from the user to display the captured images. As Figure 5 shown, when the user gives an instruction to display, the image combining unit 14 combines the captured images of multiple in-vehicle cameras 20 to generate a combined image of the surroundings of the own vehicle V. Then, the icon synthesizing unit 15 synthesizes vehicle icons on the generated captured image to generate a synthesized image (S201).
[0035] The display control unit 17 displays the generated composite image on the display unit 3 (S202). The display control unit 17 determines whether the divided image area selected by the user has been determined by the area determination unit 16 (S203). That is, the display control unit 17 determines whether the user has selected the divided image area to be enlarged and displayed. When the divided image area selected by the user has been determined by the area determination unit 16 (S203: Yes), the display control unit 17 displays only the captured image of one vehicle-mounted camera 20 corresponding to the divided image area selected by the user on the display unit 3 (S204). The display control unit 17 determines whether to end the display of the captured image of the vehicle-mounted camera 20 (S205). For example, the display control unit 17 can determine to end the display when the user inputs an instruction to end the display.
[0036] When it is determined not to end the display (S205: No), the display control unit 17 determines whether the user has given an instruction to restore the display (S206). The instruction to restore the display is an instruction to return from the form of displaying only the captured image of one vehicle-mounted camera 20 to the form of displaying the composite image showing the entire surroundings of the own vehicle V. The user can give this instruction to restore the display, for example, by pressing a "Back" button or the like. When the user has not given an instruction to restore the display (S206: No), the display control unit 17 performs the process of S204.
[0037] In addition, there is a case where a person is recognized within the divided image area selected by the user by the person tracking unit 12. In this case, in S204, the display control unit 17 switches the captured image of the vehicle-mounted camera 20 as the person moves according to the tracking information generated by the person tracking unit 12 so that the person is displayed on the display unit 3. In addition, when multiple people are recognized within the divided image area selected by the user, the display control unit 17 switches the captured image of the vehicle-mounted camera 20 as the person closest to the own vehicle V moves so that the person is displayed on the display unit 3. Alternatively, the display control unit 17 switches the captured image of the vehicle-mounted camera 20 as the person with the highest suspiciousness calculated by the suspiciousness calculation unit 13 moves so that the person is displayed on the display unit 3.
[0038] When there is an instruction to restore the display (S206: Yes), the driving recorder 100 processes again from S201. When it is not determined in S203 that the divided image area has been selected (S203: No), the display control unit 17 determines whether to end the display of the captured image of the in-vehicle camera 20 (S207). When it is not determined to end the display of the captured image (S207: No), the driving recorder 100 processes again from S201. When it is determined in S205 or S207 to end the display of the captured image (S205, S207: Yes), the display control unit 17 ends the display of the captured image (S208).
[0039] As described above, the image combining unit 14 combines the captured images of the plurality of in-vehicle cameras 20 to generate a combined image. The icon synthesizing unit 15 synthesizes a vehicle icon on the generated combined image to generate a synthesized image. At this time, the icon synthesizing unit 15 synthesizes the vehicle icon at the position of the own vehicle in the combined image in such a manner that the shooting direction of the in-vehicle camera 20 when viewed from the own vehicle V coincides with the orientation of the vehicle icon in the combined image. The display control unit 17 displays the generated synthesized image on the display unit 3. In addition, when the user selects a divided image area, the display control unit 17 displays the captured image of the in-vehicle camera 20 corresponding to the selected divided image area on the display unit 3. Thus, the user can easily grasp which area around the own vehicle V the captured images of the plurality of combined in-vehicle cameras 20 are taken with reference to the orientation of the vehicle icon in the synthesized image displayed on the display unit 3. Therefore, in the driving recorder 100, when the captured images around the own vehicle V taken by the plurality of in-vehicle cameras 20 are displayed on the display unit 3, the user can easily grasp the positional relationship between the captured images taken by the plurality of in-vehicle cameras 20 and the own vehicle V.
[0040] The display control unit 17 displays the combined image and the vehicle icon in the synthesized image in such a manner as to form an image of the own vehicle V and the surroundings of the own vehicle V viewed from an obliquely upper position. That is, a synthesized image showing the state of the own vehicle V viewed from an obliquely upper position is displayed on the display unit 3. Thus, the user can more easily grasp the situation (positional relationship, etc.) around the own vehicle V.
[0041] There is a case where a person is recognized by the person tracking unit 12 within the divided image area selected by the user. In this case, the display control unit 17 switches the captured image of the in-vehicle camera 20 as the person moves according to the tracking information generated by the person tracking unit 12 so that the person is displayed on the display unit 3. Thus, the user does not need to switch the captured image of the in-vehicle camera 20 displayed on the display unit 3 as the person moves. Therefore, the user can easily confirm the surroundings of the own vehicle V.
[0042] There is a case where multiple persons are recognized within the divided image area selected by the user by the person tracking unit 12. In this case, the display control unit 17 switches the captured image of the in-vehicle camera 20 along with the movement of the person closest to the own vehicle V so that the person is displayed on the display unit 3. For example, when there are multiple persons around the own vehicle V, the person closer to the own vehicle V is more likely to play a prank on the own vehicle V than the person farther away from the own vehicle V. Therefore, the display control unit 17 switches the captured image of the in-vehicle camera 20 to display the person closest to the own vehicle V. Thereby, even when there are multiple persons around the own vehicle V, the user can easily confirm the person with a high necessity for confirmation.
[0043] There is a case where multiple persons are recognized within the divided image area selected by the user by the person tracking unit 12. In this case, the display control unit 17 switches the captured image of the in-vehicle camera 20 along with the movement of the person with the highest suspiciousness calculated by the suspiciousness calculation unit 13 so that the person is displayed on the display unit 3. For example, when there are multiple persons around the own vehicle V, the person making suspicious actions is more likely to play a prank on the own vehicle V than the person not making suspicious actions. Therefore, the display control unit 17 switches the captured image of the in-vehicle camera 20 to display the person with the highest suspiciousness. Thereby, even when there are multiple persons around the own vehicle V, the user can easily confirm the person with a high necessity for confirmation.
[0044] As described above, the embodiments of the present application have been described, but the present application is not limited to the above embodiments. For example, in the above embodiments, the case where the user later confirms the captured images pre-stored in the storage unit 11 has been described. However, the present invention is not limited thereto, and the driving recorder 100 may also generate a composite image in real time and display it on the display unit 3.
[0045] The installation position, the number of installations, and the type of the in-vehicle camera 20 are not particularly limited. For example, the in-vehicle camera 20 may also be a 360° camera (panoramic camera) capable of shooting 360° around. Four 360° cameras may also be configured to respectively shoot the front, rear, left, and right of the own vehicle V. In this case, the driving recorder 100 can also only magnify and display the required part from the captured images with a wide viewing angle.
[0046] At least a part of the above-described embodiments and various modification examples can be arbitrarily combined. Explanation of reference numerals
[0047] 1…ECU (Display control device); 3…Display unit; 12…Person tracking unit; 13…Suspicion degree calculation unit; 14…Image combination unit; 15…Icon synthesis unit; 16…Region determination unit; 17…Display control unit; 20…In-vehicle camera; A…Vehicle icon; B…Composite image; C…Combined image; C1 to C4…Captured images; H…Person; K1 to K4…Divided image regions.
Claims
1. A display control device that displays images of the surroundings of a vehicle captured by a plurality of vehicle-mounted cameras on a display unit, comprising: an image combining unit that combines the images captured by the plurality of vehicle-mounted cameras to generate a combined image of the surroundings of the own vehicle; an icon synthesis unit for generating a synthesized image by synthesizing a vehicle icon representing the own vehicle on the combined image generated by the image combining unit; a region determination unit, wherein the composite image is divided into a plurality of segmented image regions in a manner corresponding to respective shooting regions of the plurality of vehicle-mounted cameras, and the region determination unit determines the segmented image region selected by the user among the plurality of segmented image regions included in the composite image; as well as a display control unit that displays the synthesized image generated by the icon synthesizing unit on the display unit, and, when the segmented image area selected by the user is determined by the area determining unit, displays the captured image of the vehicle-mounted camera corresponding to the determined segmented image area on the display unit, and does not display the captured images of the vehicle-mounted cameras other than the vehicle-mounted camera corresponding to the determined segmented image area on the display unit, The icon synthesis unit synthesizes the vehicle icon at the position of the own vehicle in the combined image so that the shooting direction of the vehicle-mounted camera when viewed from the own vehicle is consistent with the orientation of the vehicle icon in the combined image, thereby generating the synthesized image.
2. The display control device according to claim 1, wherein: The display device further includes: a person tracking unit that recognizes a person in the captured image and generates tracking information for tracking movement of the person between the captured images of the plurality of vehicle-mounted cameras; When the person identified by the person tracking unit is present in the segmented image area selected by the user, the display control unit switches the captured image of the vehicle-mounted camera according to the tracking information as the person moves so that the person is displayed on the display unit.
3. The display control device according to claim 2, wherein: When a plurality of persons identified by the person tracking unit are present within the segmented image area selected by the user, the display control unit switches the captured image of the vehicle-mounted camera as the person closest to the own vehicle moves so that the person is displayed on the display unit.
4. The display control device according to claim 2, wherein: The display control device further comprises: a suspicion degree calculation unit for calculating the suspicion degree of the identified person based on the action of the person identified by the person tracking unit and the action of a predetermined suspicious person, In the case where multiple persons identified by the person tracking unit exist in the segmented image area selected by the user, the display control unit switches the captured image of the vehicle-mounted camera along with the movement of the person with the highest suspicion calculated by the suspicion calculation unit, so that the person is displayed on the display unit.
5. The display control device according to any one of claims 1 to 4, wherein: The display control unit displays the combined image and the vehicle icon in the composite image so as to form an image in which the own vehicle and the surroundings of the own vehicle are viewed from obliquely above.
Citation Information
Patent Citations
Drive recorder, and display device and program for the same
JP2020145687A