vehicle
The vehicle integrates a camera and monitor system with an image addition device to display location-specific information and advertisements, enhancing information transmission and reducing driver stress.
Patent Information
- Application Number
- JP2021189287
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-11-22
- Publication Date
- 2025-11-07
- Estimated Expiration
- 2041-06-17
AI Technical Summary
Existing vehicles lack an effective means to utilize monitors for transmitting information to the outside, such as advertisements and real-time images, that are tailored to the vehicle's current location and surroundings.
A vehicle equipped with a camera to capture images of its surroundings, a monitor on the exterior to display real-time images in the opposite direction, and an image addition device that overlays additional images based on the vehicle's position and stored content, enhancing information transmission.
The system effectively transmits location-specific information, including advertisements, to pedestrians and drivers, improving information dissemination and reducing driver stress by providing relevant images and alerts.
Smart Images

Figure 0007765807000001 
Figure 0007765807000002 
Figure 0007765807000003
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to vehicles. [Background technology]
[0002] Patent Document 1 discloses an in-vehicle image display device that includes a camera installed in a vehicle to capture images in front of the vehicle, a storage means containing at least video advertising image data and still advertising image data, an image playback unit that plays back the image data stored in the storage means and outputs an image signal, a vehicle state detection means that detects at least one piece of information from the vehicle's running state, the state of the turn signals, and the open / closed state of the boarding / exiting doors, a monitor installed at the rear of the vehicle so that it can be seen from outside the rear, and a video signal switching unit that switches between the image signal from the camera and the image signal from the image playback unit based on the detection information from the vehicle state detection means and sends it to the monitor. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2003-252153 Summary of the Invention [Problem to be solved by the invention]
[0004] The present disclosure provides a vehicle that can more effectively utilize a monitor for transmitting information to the outside of the vehicle. [Means for solving the problem]
[0005] A vehicle according to one aspect of the present disclosure comprises a camera mounted on the vehicle body to capture images of the area around the vehicle body, a monitor mounted on the exterior surface of the vehicle body facing in the opposite direction to the direction the camera is facing and displaying real-time images captured by the camera in the opposite direction, and an image addition device that displays on the monitor additional images that change according to the position of the vehicle body based on content stored in a database in association with location information and the current position of the vehicle body.
[0006] According to this vehicle, by displaying an additional image corresponding to the current location of the vehicle on the monitor, it is possible to transmit information corresponding to the current location of a person viewing the image, thereby making it possible to more effectively utilize the monitor for transmitting information to the outside of the vehicle.
[0007] The image adding device may display an additional image including an advertisement according to the position of the vehicle body on the monitor, in which case the monitor can be used effectively for more effective advertisements.
[0008] The image adding device may identify facilities within the field of view included in the real-time image based on the current position and direction of travel of the vehicle and map information, and display an additional image including advertisements for the facilities within the field of view on the monitor. In this case, the effectiveness of the advertisements can be further improved by displaying advertisements related to the camera image.
[0009] The image adding device may display an additional image on the monitor that associates an advertisement for the facility within the field of view with the facility within the field of view in the real-time image. In this case, the monitor can be used more effectively due to the synergistic effect of information dissemination by the camera image and information dissemination by the additional image.
[0010] The camera may be mounted on the vehicle body to capture images of the area in front of the vehicle, and the monitor may be mounted on the rear of the vehicle body to display real-time images toward the rear of the vehicle. In this case, the monitor can be effectively used to transmit information to following vehicles.
[0011] The image adding device may display on the monitor an additional image including a display of the planned exit position of the vehicle from the road it is currently traveling on, based on the route the vehicle is scheduled to travel. In this case, stress on the driver of the following vehicle can be reduced and reckless overtaking can be suppressed.
[0012] The camera may be mounted on the vehicle body so as to capture an image of the rear of the vehicle body, and the monitor may be mounted on the front of the vehicle body and display a real-time image facing the front of the vehicle body. In this case, when a vehicle stops at an intersection to wait for a right turn, the monitor can be effectively used to transmit information to drivers of oncoming vehicles waiting to turn right at the same intersection.
[0013] The camera may be mounted on the vehicle body so as to capture the image in the direction in which the first side of the vehicle body faces, and the monitor may be mounted on the second side of the vehicle body so as to display the real-time image captured by the camera in the direction in which the second side faces. In this case, the monitor can be effectively used to provide information to pedestrians on the sidewalk, for example.
[0014] The vehicle may further include a second camera mounted on the vehicle body facing in a direction opposite to the direction the camera faces so as to capture images of the surroundings of the vehicle body, and the monitor may display a real-time image and a second real-time image captured by the second camera. In this case, the combined use of the camera and the second camera can widen the field of view, thereby increasing the usefulness of the image displayed on the monitor and improving the effectiveness of information dissemination by the monitor.
[0015] The image adding device may reduce the display size of the additional image during the second stop period, during which the vehicle stops to allow passengers to board or disembark, compared to the first stop period, during which the vehicle stops depending on road conditions. It is conceivable that the need for camera images is greater during the second stop period than during the first stop period. For example, during the second stop period, there is a greater likelihood that passengers will cross the road to board or disembark, increasing the need for images of the front of the vehicle in the following vehicle. Therefore, by reducing the display size of the additional image during the second stop period compared to the first stop period, it is possible to transmit information that better matches the needs of passengers.
[0016] The image adding device may dim the display of the additional image during the second stop period when the vehicle is stopped to allow passengers to board or disembark, compared to the first stop period when the vehicle is stopped depending on road conditions. In this case, by dimming the display of the additional image during the second stop period compared to the first stop period, it is possible to transmit information that better matches the needs.
[0017] The image adding device may further display on the monitor, while the vehicle is stopped, an attention-grabbing image including an indication that a person is getting off the vehicle, thereby improving the usefulness of the image displayed on the monitor and the effectiveness of information dissemination by the monitor.
[0018] The image adding device may further display on the monitor an enhanced image that enhances the image of the moving object in the real-time image, thereby improving the usefulness of the image displayed on the monitor and the effectiveness of information dissemination by the monitor.
[0019] The image adding device may further display images received from other vehicles on the monitor, thereby improving the usefulness of the images displayed on the monitor and the effectiveness of information dissemination by the monitor.
[0020] A vehicle according to another aspect of the present disclosure includes a camera mounted on the vehicle body to capture images of the area behind the vehicle body, and a monitor mounted on the front of the vehicle body to display real-time images captured by the camera toward the front of the vehicle body.
[0021] For example, when a vehicle is stopped at an intersection to wait for a right turn, an image of the rear of the vehicle is increasingly needed by oncoming vehicles waiting to turn right at the same intersection. Therefore, with this vehicle, which provides an image of the rear of the vehicle to other vehicles in front, the monitor can be used more effectively. [Effects of the Invention]
[0022] According to the present disclosure, a vehicle can be provided that can more effectively utilize a monitor for transmitting information to the outside of the vehicle. [Brief explanation of the drawings]
[0023] [Figure 1] FIG. 1 is a schematic diagram illustrating a general configuration of a vehicle. [Figure 2] FIG. 2 is a block diagram illustrating an example of the functional configuration of an image adding device. [Figure 3] 10 is a schematic diagram illustrating an example of a composite image of a real-time image and an additional image including an advertisement. FIG. [Figure 4] 10 is a schematic diagram illustrating an example of a composite image of a real-time image and an additional image including an exit notice image. FIG. [Figure 5] 10 is a schematic diagram illustrating an example of a composite image of a real-time image and an attention-calling image. FIG. [Figure 6] 10 is a schematic diagram illustrating a composite image of a real-time image and an enhanced image. FIG. [Figure 7] FIG. 10 is a schematic diagram illustrating a composite image of a real-time image and a remote image. [Figure 8] FIG. 2 is a schematic diagram illustrating a hardware configuration of an image adding device. [Figure 9] FIG. 10 is a schematic diagram showing a modified example of the vehicle. [Figure 10] FIG. 10 is a schematic diagram showing another modified example of the vehicle. [Figure 11] 10 is a flowchart illustrating an image display procedure. DETAILED DESCRIPTION OF THE INVENTION
[0024] Hereinafter, the embodiments will be described in detail with reference to the drawings. In the description, the same elements or elements having the same functions are denoted by the same reference numerals, and redundant description will be omitted.
[0025] 〔vehicle〕 1 is a bus used for public transportation. Vehicle 1 may be a route bus, a microbus, or a tourist bus. Vehicle 1 has a vehicle body 10, a camera 20, a monitor 30, a GPS sensor 41, a vehicle speed sensor 42, and an image adding device 100.
[0026] The vehicle body 10 is configured to accommodate a driver and passengers. In the drawings, a four-wheeled vehicle body 10 is illustrated, but the vehicle body 10 is not limited to four wheels and may have, for example, six wheels. The outer surface 11 of the vehicle body 10 includes a front surface 12 facing forward D11, a rear surface 13 facing rearward D12, and a first side surface 14 and a second side surface 15 facing opposite to each other. As an example, the first side surface 14 faces a left direction D21 of the vehicle body 10, and the second side surface 15 faces a right direction D22. The second side surface 15 may face the left direction D21, and the first side surface 14 may face the right direction D22.
[0027] The camera 20 is provided on the vehicle body 10 so as to capture images of the surroundings of the vehicle body 10. For example, the camera 20 is provided at one location on the outer surface 11 of the vehicle body 10, and faces in the direction that the outer surface 11 faces at that location. The direction in which the camera 20 faces is the direction from the position where the camera 20 is installed toward the subject being photographed by the camera 20. Hereinafter, the direction in which the camera 20 faces will be referred to as the "viewing direction" of the camera 20.
[0028] As an example, the camera 20 is provided on the vehicle body 10 so as to capture an image of the front D11. For example, the camera 20 is provided on the front face 12 so as to face the front D11 (so that the viewing direction 21 is the front D11). Being provided on the front face 12 means being provided so as to be able to capture an image of the area facing the front face 12. In the drawing, the camera 20 is provided outside the front face 12, but the camera 20 may be provided inside the vehicle body 10 as long as it can capture an image of the area facing the front face 12. The same applies when the camera 20 is provided on another surface. For example, the camera 20 may be provided inside the vehicle body 10 so as to capture an image of the area in front of the vehicle body 10 through a transparent panel (e.g., a windshield) that constitutes the front face 12. Specific examples of the camera 20 include cameras that include an imaging element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.
[0029] The monitor 30 is provided on the outer surface 11 of the vehicle body 10 facing in the opposite direction 22 to the field of view 21 of the camera 20, and displays a real-time image captured by the camera 20 in the opposite direction 22. As described above, when the camera 20 faces forward D11, the monitor 30 is provided on the rear surface 13 of the vehicle body 10, and displays a real-time image toward the rear D12 of the vehicle body 10. The monitor 30 being provided on the rear surface 13 means that the monitor 30 is provided so that a person facing the rear surface 13 can view the display content of the monitor 30 as part of the rear surface 13. In the illustration, the camera 20 is provided outside the rear surface 13, but the monitor 30 may be provided inside the vehicle body 10 as long as it is viewable by a person facing the rear surface 13.
[0030] A real-time image means an image that is displayed at substantially the same time as it is captured by the camera 20. A real-time image changes in synchronization with changes in the current situation of the subject being captured by the camera 20. In reality, due to the influence of signal transmission, image processing, etc., there is a slight time lag between the image captured by the camera 20 and its display on the monitor 30. If this time lag is small enough to be negligible, the image displayed on the monitor 30 is included in the real-time image.
[0031] The GPS sensor 41 receives satellite signals for the GPS (Global Positioning System). The vehicle speed sensor 42 detects the traveling speed of the vehicle body 10.
[0032] The image adding device 100 displays on the monitor 30 an additional image that changes depending on the position of the vehicle body 10, based on the content stored in the database in association with the location information and the current position of the vehicle body 10. For example, the image adding device 100 repeatedly executes a cycle of detecting the current position of the vehicle body 10 based on satellite signals received by the GPS sensor 41, extracting content corresponding to the detected current position from the database, and displaying an additional image showing the extracted content on the monitor 30. Hereinafter, this cycle will be referred to as an "update cycle." Since the content extracted from the database by the image adding device 100 changes depending on the position of the vehicle body 10, the additional image displayed on the monitor 30 will also change depending on the position of the vehicle body 10. Note that, for convenience, the term "current position" is used, but this does not mean the strict present, but rather means, for example, a position at a certain timing within the above-mentioned update cycle.
[0033] The image adding device 100 may display the additional image together with the real-time image on the monitor 30, or may display the additional image on the monitor 30 at a timing different from the display timing of the real-time image. When displaying the additional image together with the real-time image on the monitor 30, the image adding device 100 may display the additional image by superimposing it on the real-time image within a range that does not obstruct the visibility of objects on the road (for example, moving bodies such as oncoming vehicles or pedestrians).
[0034] Specific examples of content include tourist information, advertisements, news, etc. related to the current location. For example, the image adding device 100 may display on the monitor 30 an additional image including an advertisement corresponding to the position of the vehicle body 10. For example, the image adding device 100 may identify a facility within the field of view included in the real-time image based on the current location and traveling direction of the vehicle 1 and map information, and display on the monitor 30 an additional image including an advertisement for the facility within the field of view. The image adding device 100 may display on the monitor 30 an additional image that associates the advertisement for the facility within the field of view with the facility within the field of view in the real-time image.
[0035] As an example, as shown in FIG. 2, the image adding device 100 has, as functional configurations (hereinafter referred to as "functional blocks"), a location information acquiring unit 111, a real-time image acquiring unit 112, a map database 115, a content database 114, an added image generating unit 116, and an image combining unit 117. The location information acquiring unit 111 acquires current location information of the vehicle body 10 for each update cycle described above. For example, the location information acquiring unit 111 acquires satellite signals received by the GPS sensor 41, and detects the current location and traveling direction of the vehicle body 10 based on the acquired satellite signals. The real-time image acquiring unit 112 acquires real-time images captured by the camera 20 for each update cycle described above.
[0036] The map database 115 stores map data of an area including the travel route of the vehicle 10. A specific example of the map data is two-dimensional map data that represents the positions and shapes of facilities such as roads and buildings located within the area using latitude, longitude, etc. The map data may also be three-dimensional map data that represents the positions and shapes of facilities using latitude, longitude, and altitude.
[0037] Content database 114 stores a plurality of contents in association with locations. For example, content database 114 stores a plurality of advertisement data sets in association with locations. For example, content database 114 stores each of the plurality of advertisement data sets in association with a location in map data.
[0038] The additional image generating unit 116 extracts content corresponding to the current location acquired by the location information acquiring unit 111 from the content database 114 for each update cycle described above, and generates an additional image showing the extracted content. For example, the additional image generating unit 116 generates an additional image including an advertisement according to the location of the vehicle body 10.
[0039] For example, the additional image generation unit 116 identifies within-view facilities included in a real-time image (a real-time image acquired by the real-time image acquisition unit 112) based on the current position and traveling direction of the vehicle body 10 detected by the position information acquisition unit 111 and the map data stored in the map database 115. For example, the additional image generation unit 116 calculates the within-view area of the map data included in the field of view of the camera 20 based on the current position and traveling direction of the vehicle body 10 and the angle of view and resolution performance of the camera 20, and identifies within-view facilities included in the within-view area. The additional image generation unit 116 extracts an advertising dataset of the identified within-view facilities from the content database 114, and generates an additional image including the extracted advertising dataset of the within-view facilities.
[0040] The image synthesis unit 117 synthesizes the real-time image acquired by the real-time image acquisition unit 112 and the additional image generated by the additional image generation unit 116 for each update cycle described above, and displays the synthesized image on the monitor 30. As a result, the additional image is displayed on the monitor 30 together with the real-time image.
[0041] The additional image generation unit 116 may generate an additional image to associate an advertisement for a facility within the field of view with the facility within the field of view in the real-time image. Associating an advertisement with a facility within the field of view means visually indicating which facility within the field of view the advertisement corresponds to by using a leader line, arrow, or the like. For example, the additional image generation unit 116 calculates the display position of the facility within the field of view in the field of view area based on the current position and traveling direction of the vehicle body 10 and the angle of view of the camera 20, and identifies the position to be supported by a leader line, arrow, or the like based on the calculated display position.
[0042] 3 is a schematic diagram illustrating an example of an additional image that associates advertisements for facilities within the field of view with the facilities within the field of view in a real-time image. In this diagram, multiple facility images 211 corresponding to the facilities within the field of view in the real-time image are associated with multiple advertisement images 212 by arrows. Note that in the illustration, only the name of the advertised object is included in the advertisement image 212, but the advertisement image 212 can also include various other information.
[0043] The image adding device 100 may be configured to acquire map data and content data from a server via network communication, and update the stored contents of the map database 115 and the content database 114 with the acquired map data and content data, respectively. For example, the image adding device 100 calculates an acquisition target area of a predetermined size based on the current position of the vehicle body 10, and acquires map data and content data for the acquisition target area from the server. The image adding device 100 updates the stored contents of the map database 115 with the acquired map data, and updates the stored contents of the content database 114 with the acquired content data.
[0044] The image adding device 100 may update the stored contents of the map database 115 and the content database 114 at each update cycle described above, or at each of a plurality of update cycles. Furthermore, after updating the stored contents of the map database 115 and the content database 114, the image adding device 100 may update the stored contents of the map database 115 and the content database 114 when the amount of change in the current position of the vehicle body 10 exceeds a predetermined amount.
[0045] The image adding device 100 may be configured to display on the monitor 30 an additional image including an indication of a planned exit position of the vehicle 10 from the road on which the vehicle 10 is currently traveling, based on the planned route of the vehicle 10. Exiting a road includes turning left or right onto a road intersecting the road. For example, as shown in FIG. 2, the image adding device 100 further includes a traveling route storage unit 121 that stores the planned route of the vehicle 10.
[0046] For each update cycle, the additional image generation unit 116 identifies the planned exit position based on the route stored in the travel route storage unit 121 and the current position acquired by the position information acquisition unit 111. For example, the additional image generation unit 116 calculates the display position of the planned exit position in the field of view based on the current position and traveling direction of the vehicle body 10 and the angle of view of the camera 20, and includes an exit notice image indicating the planned exit direction in the additional image at the calculated display position.
[0047] 4 is a schematic diagram illustrating an additional image including an exit notice image, in which an exit notice image 213 is displayed in accordance with the display position of the planned exit position in the real-time image.
[0048] The image adding device 100 may be configured to reduce the display size of the additional image during a second stop period in which the vehicle body 10 is stopped to allow passengers to board or disembark, compared to a first stop period in which the vehicle body 10 is stopped depending on road conditions. Reducing the display size of the additional image also includes erasing the display of the additional image (reducing the display size of the additional image to zero). The image adding device 100 may be configured to reduce the display of the additional image during the second stop period, compared to the first stop period. Reducing the display of the additional image means making the display of the additional image transparent, so that a transparent image of the real-time image is displayed even in the display position of the additional image.
[0049] For example, the image adding device 100 further includes a traveling state monitoring unit 122 as shown in Fig. 2. The traveling state monitoring unit 122 recognizes the first stopping period and the second stopping period based on at least the vehicle speed detected by the vehicle speed sensor 42 and the open / closed state of the boarding / alighting door of the vehicle body 10. The additional image generating unit 116 sets the display size of the additional image based on the confirmation result by the traveling state monitoring unit 122 for each update cycle described above.
[0050] For example, if the additional image generating unit 116 determines that the current period is a first stop period, the additional image generating unit 116 sets the display size of the additional image to a first size. If the traveling state monitoring unit 122 determines that the current period is a second stop period, the additional image generating unit 116 sets the display size of the additional image to a second size smaller than the first size. The image combining unit 117 combines the additional image with the real-time image at the display size set by the additional image generating unit 116 and displays the combined image on the monitor 30.
[0051] The image adding device 100 may be configured to further display, on the monitor 30, an attention drawing image including an indication that a person is getting on or off the vehicle body 10 while the vehicle body 10 is stopped. For example, when the traveling state monitoring unit 122 determines that the vehicle body 10 is stopped, the additional image generating unit 116 generates an attention drawing image 214 including a character string indicating that a person is getting on or off the vehicle body 10. The image combining unit 117 combines the attention drawing image 214 generated by the additional image generating unit 116 with a real-time image and displays it on the monitor 30 (see FIG. 5 ).
[0052] The image adding device 100 may be configured to further display an enhanced image that enhances the image of a moving object in the real-time image on the monitor 30. For example, the added image generating unit 116 extracts a moving object such as an oncoming vehicle or a pedestrian from the real-time image, and generates an enhanced image 216 that enhances a moving object image 215 corresponding to the extracted moving object. The image combining unit 117 combines the enhanced image 216 generated by the added image generating unit 116 with the real-time image, and displays it on the monitor 30 (see FIG. 6).
[0053] 6 shows an example of an emphasis image 216 that emphasizes the moving object image 215 by surrounding it with a frame, but the method of emphasizing the moving object image 215 is not limited to this. The additional image generation unit 116 may display on the monitor 30 an emphasis image 216 that fills the moving object image 215 with a predetermined emphasis color.
[0054] The image adding device 100 may be configured to further display an image received from another vehicle on the monitor 30. For example, as shown in FIG. 2, the image adding device 100 may further include a remote image acquiring unit 123. The remote image acquiring unit 123 acquires image data from another vehicle via wireless network communication. The additional image generating unit 116 generates a remote image 217 based on the image data acquired by the remote image acquiring unit 123. The image combining unit 117 combines the remote image 217 generated by the additional image generating unit 116 with a real-time image and displays it on the monitor 30 (see FIG. 7).
[0055] 7 illustrates an example in which a real-time image received from another vehicle is displayed as the remote image 217, but the additional image generation unit 116 may generate the remote image 217 that further includes an additional image received from another vehicle. Alternatively, the additional image generation unit 116 may generate the remote image 217 that includes only the additional image received from another vehicle.
[0056] Fig. 8 is a block diagram illustrating an example of the hardware configuration of the image adding device 100. As shown in Fig. 8, the image adding device 100 has a circuit 190. The circuit 190 has one or more processors 191, a memory 192, a storage 193, a communication port 194, a camera control circuit 195, a monitor control circuit 196, and an input / output port 197.
[0057] The storage 193 stores a program for causing the image adding device 100 to display on the monitor 30 an additional image that changes depending on the position of the vehicle body 10, based on the content stored in the database in association with the position information and the current position of the vehicle body 10. For example, the image adding device 100 stores a program for causing the image adding device 100 to configure each of the above-mentioned functional blocks.
[0058] The memory 192 temporarily stores the program loaded from the storage 193. The processor 191 causes the image adding device 100 to function as each of the above-mentioned functional blocks by executing the program loaded into the memory 192. The results of intermediate calculations by the processor 191 are stored in the memory 192 as appropriate.
[0059] The camera control circuit 195 controls the camera 20 in accordance with instructions from the processor 191. Controlling the camera 20 includes causing the camera 20 to acquire an image, causing the camera 20 to transmit the acquired image, and receiving the image transmitted from the camera 20. The monitor control circuit 196 controls the monitor 30 in accordance with instructions from the processor 191. Controlling the monitor 30 includes transmitting image data to the monitor 30 and displaying an image corresponding to the transmitted image data on the monitor 30. The input / output port 197 inputs and outputs information to and from the GPS sensor 41 and the vehicle speed sensor 42 in accordance with instructions from the processor 191.
[0060] The hardware configuration of the image adding device 100 illustrated above is merely an example and can be changed as appropriate. For example, some of the above-mentioned functional blocks may be configured using dedicated elements such as an ASIC (Application Specific Integrated Circuit).
[0061] In the above, an example has been given in which the camera 20 is provided on the vehicle body 10 to capture an image of the area ahead D11 of the vehicle body 10, and the monitor 30 is provided on the rear surface 13 of the vehicle body 10. However, the arrangement of the camera 20 and the monitor 30 is not limited to this. For example, the camera 20 may be provided on the vehicle body 10 to capture an image of the area behind D12 of the vehicle body 10, and the monitor 30 may be provided on the front surface 12 of the vehicle body 10, and a real-time image may be displayed toward the area ahead D11 of the vehicle body 10. Also, as shown in FIG. 9 , the vehicle 1 may be provided with both a set of camera 20A and monitor 30A that displays a real-time image of the area ahead D11 of the vehicle body 10 toward the area behind D12 of the vehicle body 10, and a set of camera 20B and monitor 30B that displays a real-time image of the area behind D12 of the vehicle body 10 toward the area ahead D11 of the vehicle body 10. In this case, the image addition device 100 may be configured to display added images on both the monitor 30A and the monitor 30B.
[0062] Alternatively, the camera 20 may be provided on the vehicle body 10 so as to capture an image in the direction in which the first side surface 14 of the vehicle body 10 faces (e.g., the left direction D21), and the monitor 30 may be provided on the second side surface 15 of the vehicle body 10 and display a real-time image captured by the camera 20 facing the direction in which the second side surface 15 faces (e.g., the right direction D22). Alternatively, the camera 20 may be provided on the vehicle body 10 so as to capture an image in the direction in which the second side surface 15 of the vehicle body 10 faces, and the monitor 30 may be provided on the first side surface 14 of the vehicle body 10 and display a real-time image captured by the camera 20 facing the direction in which the first side surface 14 faces. Alternatively, as shown in FIG. 10 , the vehicle 1 may be provided with both a set of a camera 20C and a monitor 30C that displays a real-time image in the left direction D21 of the vehicle body 10 facing the right direction D22 of the vehicle body 10, and a set of a camera 20D and a monitor 30D that displays a real-time image in the right direction D22 of the vehicle body 10 facing the left direction D21 of the vehicle body 10.
[0063] The vehicle 1 may further include a second camera mounted on the vehicle body 10 facing between the viewing direction 21 of the camera 20 and the opposite direction 22 to capture images of the surroundings of the vehicle body 10, and the monitor 30 may display a real-time image and a second real-time image captured by the second camera. For example, the vehicle 1 may be equipped with a camera 20C (second camera) capturing images in the left direction D21 and a camera 20D (second camera) capturing images in the right direction D22 in addition to the camera 20 capturing images in the forward direction D11, and the monitor 30 may display a combination of the real-time image captured by the camera 20 and the second real-time images captured by the cameras 20C and 20D facing backward D12.
[0064] [Image display procedure] Next, an example of a procedure for displaying an added image executed by the image adding device 100 will be described. As shown in Fig. 11, the image adding device 100 executes steps S01 and S02. In step S01, the position information acquiring unit 111 acquires current position information of the vehicle body 10. In step S02, the real-time image acquiring unit 112 acquires a real-time image captured by the camera 20.
[0065] Next, the image adding device 100 executes steps S03, S04, and S05. In step S03, the additional image generating unit 116 calculates the in-field area of the map data that is included in the field of view of the camera 20, based on the current position and traveling direction of the vehicle body 10 and the angle of view and resolution performance of the camera 20. In step S04, the additional image generating unit 116 identifies in-field facilities included in the in-field area, and extracts an advertising dataset of the in-field facilities from the content database 114. In step S05, the additional image generating unit 116 generates an additional image that includes the advertising dataset of the extracted in-field facilities.
[0066] Next, the image adding device 100 executes steps S06 and S07. In step S06, the additional image generating unit 116 identifies the planned exit position based on the route stored in the travel route storage unit 121 and the current position acquired by the position information acquiring unit 111. In step S07, the additional image generating unit 116 checks whether the distance from the current position to the planned exit position is smaller than a predetermined threshold.
[0067] If it is determined in step S07 that the distance from the current position to the planned exit position is smaller than the predetermined threshold, the image adding device 100 executes step S08. In step S08, the additional image generating unit 116 calculates the display position of the planned exit position in the field of view area based on the current position and traveling direction of the vehicle body 10 and the angle of view of the camera 20, and generates an exit notice image indicating the planned exit direction at the calculated display position, and includes the image in the additional image.
[0068] Next, the image adding device 100 executes step S09. If it is determined in step S07 that the distance from the current position to the planned exit position is greater than the predetermined threshold, the image adding device 100 executes step S09 without executing step S08. In step S09, the added image generating unit 116 extracts a moving object such as an oncoming vehicle or a pedestrian from the real-time image, and generates an enhanced image 216 that enhances the moving object image 215 corresponding to the extracted moving object.
[0069] Next, the image adding device 100 executes step S11. In step S11, the added image generating unit 116 checks whether the remote image acquiring unit 123 has acquired image data from another vehicle.
[0070] If it is determined in step S11 that image data has been acquired from another vehicle, the image adding device 100 executes step S12. In step S12, the added image generating unit 116 generates a remote image 217 based on the image data acquired by the remote image acquiring unit 123.
[0071] Next, the image adding device 100 executes step S13. If it is determined in step S11 that image data has not been acquired from another vehicle, the image adding device 100 executes step S13 without executing step S12. In step S13, the traveling state monitoring unit 122 checks whether the vehicle body 10 is stopped based on the vehicle speed detected by the vehicle speed sensor 42, etc.
[0072] If it is determined in step S13 that the vehicle body 10 is not stopped, the image adding device 100 executes step S14. In step S14, the additional image generating unit 116 sets the display size of the additional image to a first size. The image combining unit 117 combines the additional image with the real-time image at the display size set by the additional image generating unit 116. Furthermore, the image combining unit 117 combines the enhanced image 216 generated in step S09 and the remote image 217 generated in step S12 with the real-time image.
[0073] If it is determined in step S13 that the vehicle body 10 is stopped, the image adding device 100 executes steps S15 and S16. In step S15, the additional image generating unit 116 generates an attention drawing image 214 including a character string indicating that a person is getting off the vehicle body 10. In step S16, the additional image generating unit 116 sets the display size of the additional image to a second size smaller than the first size. The image combining unit 117 combines the additional image with the real-time image at the display size set by the additional image generating unit 116. Furthermore, the image combining unit 117 combines the highlighted image 216 generated in step S09, the remote image 217 generated in step S12, and the attention drawing image 214 generated in step S15 with the real-time image.
[0074] Next, the image adding device 100 executes step S17. In step S17, the image combining unit 117 displays on the monitor 30 an image obtained by combining the real-time image with the added image, the enhanced image 216, and the remote image 217. This completes the update cycle, and the image adding device 100 returns the process to step S01. Thereafter, the update cycle is repeatedly executed.
[0075] [Effects of the embodiment] As described above, the vehicle 1 is equipped with a camera 20 mounted on the vehicle body 10 to capture images of the area around the vehicle body 10, a monitor 30 mounted on the outer surface of the vehicle body 10 facing in the opposite direction 22 to the direction in which the camera 20 is facing, and which displays real-time images captured by the camera 20 in the opposite direction 22, and an image addition device 100 which displays on the monitor 30 additional images that change according to the position of the vehicle body 10 based on content stored in a database in association with location information and the current position of the vehicle body 10.
[0076] According to this vehicle 1, by displaying an additional image corresponding to the current location of the vehicle 1 on the monitor 30, it is possible to transmit information corresponding to the current location of a person viewing the image. This allows the monitor 30 for transmitting information to the outside of the vehicle to be used more effectively.
[0077] The image adding device 100 may display on the monitor 30 an additional image including an advertisement according to the position of the vehicle body 10. In this case, the monitor 30 can be effectively used for more effective advertisements.
[0078] The image adding device 100 may identify facilities within the field of view included in the real-time image based on the current position and traveling direction of the vehicle 1 and map information, and display an added image including advertisements for the facilities within the field of view on the monitor 30. In this case, by displaying advertisements related to the images from the camera 20, the effectiveness of the advertisements can be further improved.
[0079] The image adding device 100 may display an additional image that associates an advertisement for a facility within the field of view with the facility within the field of view in the real-time image on the monitor 30. In this case, the monitor 30 can be used more effectively due to the synergistic effect of information transmission by the image from the camera 20 and information transmission by the additional image.
[0080] The camera 20 may be provided on the vehicle body 10 so as to capture an image D11 in front of the vehicle body 10, and the monitor 30 may be provided on the rear surface 13 of the vehicle body 10 to display a real-time image toward the rear D12 of the vehicle body 10. In this case, the monitor 30 can be effectively used to transmit information to following vehicles.
[0081] The image adding device 100 may display on the monitor 30 an additional image including a display of a planned exit position of the vehicle 10 from the road on which the vehicle 10 is currently traveling, based on the planned route of the vehicle 10. In this case, stress on the driver of the following vehicle can be reduced and reckless overtaking can be suppressed.
[0082] The camera 20 may be provided on the vehicle body 10 so as to capture an image D12 behind the vehicle body 10, and the monitor 30 may be provided on the front 12 of the vehicle body 10, and display a real-time image facing the front D11 of the vehicle body 10. In this case, when the vehicle 1 stops at an intersection to wait to turn right, the monitor 30 can be effectively used to transmit information to a driver of an oncoming vehicle waiting to turn right at the same intersection.
[0083] The camera 20 may be provided on the vehicle body 10 so as to capture an image in the direction in which the first side surface 14 of the vehicle body 10 faces, and the monitor 30 may be provided on the second side surface 15 of the vehicle body 10, and may display a real-time image captured by the camera 20 in the direction in which the second side surface 15 faces. In this case, the monitor 30 can be effectively used to provide information to pedestrians on the sidewalk, for example.
[0084] The vehicle may further include a second camera mounted on the vehicle body 10 facing in a direction 22 opposite to the direction in which the camera 20 faces so as to capture images of the surroundings of the vehicle body 10, and the monitor 30 may display a real-time image and a second real-time image captured by the second camera. In this case, the combined use of the camera 20 and the second camera widens the field of view, thereby increasing the usefulness of the image displayed on the monitor 30 and improving the effectiveness of information dissemination by the monitor 30.
[0085] The image adding device 100 may reduce the display size of the additional image during the second stop period in which the vehicle body 10 stops to allow passengers to board or disembark, compared to the first stop period in which the vehicle body 10 stops depending on road conditions. During the second stop period, the need for images from the camera 20 may be greater than during the first stop period. For example, during the second stop period, there is a higher possibility that passengers will cross the road to board or disembark, so the need for an image of the area D11 ahead of the vehicle 1 is greater for the following vehicle 1. Therefore, by reducing the display size of the additional image during the second stop period compared to the first stop period, it is possible to transmit information that better matches the needs.
[0086] The image adding device 100 may dim the display of the additional image during the second stop period in which the vehicle 10 stops to allow passengers to get on or off, compared to the first stop period in which the vehicle 10 stops depending on road conditions. In this case, too, by dimming the display of the additional image during the second stop period compared to the first stop period, it is possible to transmit information that better matches the needs.
[0087] The image adding device 100 may further display, on the monitor 30, an attention-calling image including an indication that a person is getting off the vehicle body 10 while the vehicle body 10 is stopped. In this case, the usefulness of the image displayed on the monitor 30 can be improved, and the effectiveness of information transmission by the monitor 30 can be improved.
[0088] The image adding device 100 may further display an enhanced image that enhances the image of the moving object in the real-time image on the monitor 30. In this case, the usefulness of the image displayed on the monitor 30 can be improved, and the effectiveness of information dissemination by the monitor 30 can be improved.
[0089] The image adding device 100 may further display on the monitor 30 an image received from another vehicle 1. In this case, the usefulness of the image displayed on the monitor 30 can be improved, and the effectiveness of information transmission by the monitor 30 can be improved.
[0090] A vehicle 1 according to another aspect of the present disclosure includes a camera 20 mounted on the vehicle body 10 to capture an image of the rear D12 of the vehicle body 10, and a monitor 30 mounted on the front 12 of the vehicle body 10 to display real-time images captured by the camera 20 toward the front D11 of the vehicle body 10.
[0091] Although the embodiments have been described above, the present invention is not necessarily limited to the exemplified embodiments and can be modified as appropriate without departing from the spirit of the present invention. For example, the vehicle 1 is not limited to a bus as long as it is a vehicle that can travel on public roads. For example, the vehicle 1 may be a freight vehicle such as a truck, or may be a streetcar. [Explanation of symbols]
[0092] 1...vehicle, 10...vehicle body, 12...front, 13...rear, 14...first side, 15...second side, D21...left direction, D22...right direction, D11...forward, D12...rear, 20...camera, 21...viewing direction, 22...opposite direction, 30...monitor, 100...image addition device.
Claims
1. A camera installed on the vehicle body to capture an image of the area in front of the vehicle body; a monitor provided on a rear surface of the vehicle body and displaying real-time images captured by the camera toward the rear of the vehicle body; an image adding device that displays on the monitor an additional image that changes depending on the position of the vehicle body, based on content stored in a database in association with position information and the current position of the vehicle body; The image adding device displays the additional image on the monitor, including an indication of a planned exit position of the vehicle body from a road currently being traveled, based on a route planned to be traveled by the vehicle body.
2. 2. The vehicle according to claim 1, wherein the image adding device displays the additional image, including an advertisement corresponding to a position of the vehicle body, on the monitor.
3. The vehicle of claim 1, wherein the image adding device identifies a facility within the field of view included in the real-time image based on the current position and direction of travel of the vehicle and map information, and displays the additional image including an advertisement for the facility within the field of view on the monitor.
4. 4. The vehicle according to claim 3, wherein the image adding device displays, on the monitor, the additional image that associates an advertisement for the facility within the field of view with the facility within the field of view in the real-time image.
5. a second camera provided on the vehicle body facing the side of the vehicle body and photographing the side of the vehicle body; 5. The vehicle according to claim 1, wherein the monitor displays the real-time image and a second real-time image captured by the second camera.
6. 6. The vehicle according to claim 1, wherein the image adding device further displays, on the monitor, an enhanced image that enhances an image of a moving object in the real-time image.
7. 7. The vehicle according to claim 1, wherein the image adding device further displays an image received from another vehicle on the monitor.
Citation Information
Patent Citations
Vehicle
JP2003141696A
In-vehicle image display device
JP2003252153A
Vehicle mounted imaging apparatus
JP2007142624A
In-vehicle machine
JP2011237878A
Information display for vehicle
JP2011253486A