Drive record display system and drive record display method

Abstract

To improve the readability of driving records, allowing users to vividly recall their driving memories. [Solution] The system comprises a camera 61 positioned on a vehicle Q, a device for acquiring positioning data Dp of the vehicle Q, an information terminal 8 owned by the vehicle user, and a server capable of communicating with the information terminal 8. The server acquires video data Dv1 captured by the camera 61 and positioning data Dp acquired by the device, generates a thumbnail P corresponding to the video data Dv1, generates vehicle trajectory data RT based on the positioning data Dp, and transmits it to the information terminal 8 as display data. Based on the display data, the information terminal 8 displays map data MP and trajectory data RT overlaid, and displays the thumbnail P at a position adjacent to the shooting location of the video data Dv1 on the map data MP.

Description

Technical Field

[0006] , , , , , , ,

[0005] , ,

[0001] The technology disclosed herein belongs to the technical field related to a drive recording and display system and a drive recording and display method.

Background Art

[0002] In recent years, it has been common to share memories of a drive etc. through digital data. As a method of leaving memories of a drive, there is a method of creating an electronic album using image data taken during the drive.

[0003] Patent Document 1 discloses a navigation album system that creates an electronic album in which digital image data including data taken at a tourist spot located on a travel route is linked to the position information of the travel route specified by a navigation device and displayed on a display means.

[0004] Patent Document 2 discloses a shooting information browsing system in which a server collects and stores shooting location data of shootings by in-vehicle cameras implemented in a plurality of vehicles, and enables the collected and stored results to be browsed by a terminal device.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0006] Patent Document 1 is advantageous for evoking memories of tourist destinations and other places that are the destination of a drive. However, Patent Document 1 pays little attention to the drive itself, and there is room for improvement in evoking memories where the drive itself is the purpose. Furthermore, Patent Document 1 has room for improvement in terms of the ease of viewing information at a glance.

[0007] Patent Document 2 collects and stores shooting location data from in-vehicle cameras used in multiple vehicles and provides it to the user. Therefore, it is suitable for understanding tourist spots at the destination or intermediate stops of a drive, or for identifying photo shooting locations. On the other hand, from the perspective of recalling personal drive memories, similar to Patent Document 1, there is room for improvement in terms of convenience, such as enabling users to recall the conditions of the day of the drive (e.g., weather, scenery, etc.) more realistically and understand them in an overview manner.

[0008] The technology disclosed herein was developed in light of these points, and its purpose is to enable users to quickly recall memories of specific drives. [Means for solving the problem]

[0009] To solve the aforementioned problems, a first aspect of the technology disclosed herein relates to a drive record display system for displaying a record of a vehicle's drive. The drive record display system comprises a camera positioned in the vehicle, a device in the vehicle that acquires positioning data of the vehicle, an information terminal having a display screen and owned by the vehicle's user, and a server capable of communicating with the information terminal. The server acquires video data captured by the camera in the device and positioning data acquired by the device, generates thumbnails corresponding to each of the video data, generates vehicle driving trajectory data on map data based on the positioning data, and transmits display data including the shooting location of each of the video data, the thumbnail, and the driving trajectory data to the information terminal. The information terminal receives the display data and, based on the display data, displays the driving trajectory data overlaid on the map data on the display screen, and displays the thumbnail at a position adjacent to the shooting location of the video data on the map data.

[0010] In the first embodiment, map data, driving trajectory, and thumbnails are displayed simultaneously on the information terminal's display screen. Displaying these images on a single screen enhances user convenience. Specifically, during a drive, the user can grasp and understand the conditions of the day's drive at a glance. Furthermore, after the drive, the user can recall the conditions of the day's drive (e.g., weather, scenery, etc.) more vividly.

[0011] A second aspect of the technology disclosed herein is, in the first aspect, the server updates the display data based on video data or positioning data acquired by the device while the vehicle is being driven, transmits the updated display data to the information terminal, and the information terminal updates the display of the driving trajectory data or thumbnails based on the updated display data.

[0012] In the second embodiment, the display data is updated while the vehicle is being driven, and the display of the driving trajectory or thumbnail on the information terminal is updated. This improves the real-time nature of the display of the vehicle's driving trajectory or thumbnail while driving. For example, while displaying the driving trajectory of the vehicle in real time, if a thumbnail is generated, it becomes possible to display that thumbnail at a location adjacent to the shooting location.

[0013] In a third aspect of the technology disclosed herein, in the first or second aspect, the display data transmitted from the server to the information terminal includes scale data relating to the scale of the map data, which enables the display on the display screen of the information terminal of a series of driving trajectories, including the starting point of the drive and the current location when the vehicle is driving, and the information terminal displays the map data scaled according to the scale data and the series of driving trajectories superimposed, and displays the thumbnail at a position adjacent to the shooting location of the video data on the map data.

[0014] According to the third embodiment, regardless of the distance traveled, a series of driving trajectories from the starting point of the drive to the current location (during the drive) can be displayed on the information terminal's display screen.

[0015] In a fourth aspect of the technology disclosed herein, in the first aspect, the display data transmitted from the server to the information terminal includes scale data relating to the scale of the map data that enables the display of a series of driving trajectories, including the start and end points of a drive, on the display screen of the information terminal, and the information terminal displays the map data scaled according to the scale data and the series of driving trajectories superimposed, and displays the thumbnail at a position adjacent to the shooting location of the video data on the map data.

[0016] According to the fourth embodiment, regardless of the distance traveled, a series of driving trajectories from the start point to the end point of the drive can be displayed on the display screen of the information terminal.

[0017] In a fifth aspect of the technology disclosed herein, in the first aspect, the thumbnails are arranged on the drive record display screen of the information terminal so as not to overlap with the driving trajectory data.

[0018] According to the fifth aspect, the overview of information is improved, making it easier to grasp and understand the driving situation on the day.

[0019] In a sixth aspect of the technology disclosed herein, in the first aspect, the thumbnails are arranged on the drive record display screen of the information terminal such that adjacent thumbnails do not overlap.

[0020] According to the sixth embodiment, the thumbnails are arranged so that they do not overlap, allowing the entirety of each thumbnail to be viewed, thus providing a user-friendly display screen. In addition, since no part of the thumbnail is hidden, it is easier for the user to recall memories of their drive.

[0021] In a seventh aspect of the technology disclosed herein, in the first aspect, when a touch operation is performed on the thumbnail, the information terminal acquires the video data from the server and displays it on the display screen.

[0022] According to the seventh aspect, the video data is displayed on the screen by touching the thumbnail, allowing the user to check the details of the video data and making it easier for the user to recall memories of the drive.

[0023] In an eighth aspect of the technology disclosed herein, in the first aspect, the information terminal places a thumbnail on a speech bubble-shaped icon and displays the icon such that the destination of the speech bubble extends toward the location where the video data was captured.

[0024] The eighth aspect makes it easier for users to understand in detail the shooting location of the video data corresponding to the thumbnail. By clearly understanding the shooting location in this way, it becomes easier to recall memories of the drive.

[0025] In a ninth aspect of the technology disclosed herein, in the first aspect, when there are a plurality of thumbnails within a predetermined distance range, the server includes, in the display data, the number of video data within the predetermined distance range at the shooting position of the video data, and the information terminal displays, at a position adjacent to the shooting point of the video data on the map data, a number indicating the number of the video data instead of the thumbnail.

[0026] In a tenth aspect of the technology disclosed herein, in the first aspect, when there are a plurality of thumbnails within a predetermined distance range, the server includes, in the display data, a single thumbnail representing the plurality of thumbnails and the number of video data within the predetermined distance range, and the information terminal displays the single thumbnail and a number indicating the number of the video data in association with each other.

[0027] According to the ninth and tenth aspects, since the number of video data within a predetermined distance range is displayed as a number on the display screen of the information terminal, the number of shots at each shooting point can be easily grasped. As a result, the locations where a large number of photos have been taken become clear, and information useful for evoking memories of the drive can be provided to the user.

[0028] An eleventh aspect of the technology disclosed herein relates to a drive record display system for displaying a record of a vehicle's drive. The drive record display system comprises a device that acquires location information of the vehicle within the vehicle, an information terminal owned by the vehicle's user having a camera and a display screen, and a server that can communicate with the information terminal. The server acquires video data captured by the camera on the information terminal and location information acquired by the device, generates a thumbnail corresponding to each of the video data, identifies the shooting location of the video data based on the location information, generates vehicle driving trajectory data on map data based on the location information, transmits display data including the shooting location and thumbnail of each of the video data and the driving trajectory data to the information terminal, the information terminal receives the display data, and based on the display data, displays the driving trajectory overlaid on the map data on the display screen, and displays the thumbnail at a position adjacent to the shooting location of the video data on the map data.

[0029] In the eleventh embodiment, map data, driving trajectory, and thumbnails are displayed simultaneously on the information terminal's display screen. The thumbnails here correspond to video data captured by the user's information terminal. By displaying these images on a single screen, user convenience can be enhanced, similar to the first embodiment. Specifically, during a drive, the user can grasp and understand the conditions of the day's drive at a glance. Furthermore, after the drive, the user can recall the conditions of the day's drive (e.g., weather, scenery, etc.) more vividly.

[0030] A twelfth aspect of the technology disclosed herein relates to a drive record display method for displaying a record of a vehicle's drive. The vehicle is equipped with a camera and a device that acquires location information of the vehicle within the vehicle, and the user of the vehicle has an information terminal having a display screen. In the drive record display method, a server that can communicate with the information terminal acquires video data captured by the camera and location information acquired by the device, generates thumbnails corresponding to each of the video data, generates driving trajectory data of the vehicle on map data based on the location information, transmits display data including the shooting location of each of the video data, the thumbnail and the driving trajectory data to the information terminal, the information terminal receives the display data, and based on the display data, displays the driving trajectory overlaid on the map data on the display screen, and displays the thumbnail at a position adjacent to the shooting location of the video data on the map data.

[0031] In the twelfth embodiment, similar to the first embodiment, map data, driving trajectory, and thumbnails are displayed simultaneously on the information terminal's display screen on a single screen. Displaying these images on a single screen enhances user convenience. Specifically, during a drive, the user can grasp and understand the conditions of the day's drive at a glance. Furthermore, after the drive, the user can recall the conditions of the day's drive (e.g., weather, scenery, etc.) more vividly. [Effects of the Invention]

[0032] As explained above, the technology disclosed herein allows map data, driving trajectories, and thumbnails to be displayed simultaneously on a single screen, enabling users to quickly relive memories of specific drives. [Brief explanation of the drawing]

[0033] [Figure 1] Figure 1 is a conceptual diagram showing an example of the overall configuration of a drive recording and display system according to an exemplary embodiment. [Figure 2]Figure 2 is a schematic diagram of the vehicle's configuration. [Figure 3] Figure 3 is a schematic diagram of the device management server configuration. [Figure 4] Figure 4 shows the configuration of the content management server. [Figure 5] Figure 5 is a diagram showing an example of content information. [Figure 6] Figure 6 is a diagram illustrating the data stored in the storage. [Figure 7] Figure 7 is a block diagram showing an example of the configuration of an information terminal. [Figure 8] Figure 8 is a flowchart for determining when to start and stop a drive. [Figure 9] Figure 9 is a flowchart showing an example of the video data acquisition and storage process. [Figure 10] Figure 10 is a flowchart showing an example of the operation of displaying drive records on an information terminal. [Figure 11] Figure 11 shows an example of the screen display on an information terminal when a mobile application is running. [Figure 12] Figure 12 shows an example of a drive map screen in a mobile app. [Figure 13] Figure 13 shows an example of the drive map screen in a mobile app. [Figure 14] Figure 14 shows an example of a drive map screen in a mobile app. [Modes for carrying out the invention]

[0034] The following describes exemplary embodiments in detail with reference to the drawings.

[0035] The following embodiments are illustrative, and there is no intention to limit the content of this disclosure by the presence or absence of descriptions or by the numerical values ​​provided. Furthermore, the components constituting the systems, servers, etc., described herein, and the functions realized by the components such as functional blocks and modules described herein, may be implemented in circuitry or processing circuitry, including general-purpose processors such as CPUs (Central Processing Units) and GPUs (Graphics Processing Units), application-specific processors, integrated circuits, ASICs (Application Specific Integrated Circuits), conventional circuits, and / or combinations thereof, programmed to realize the described functions. A processor includes transistors and other circuits and is considered circuitry or processing circuitry. A processor may be configured to execute a program stored in memory. Memory includes, for example, volatile memory such as RAM, and non-volatile semiconductor memory such as ROM and flash memory.

[0036] (1) Overall configuration of the drive record display system Figure 1 is a conceptual diagram showing an example of the overall configuration of a drive recording and display system M according to an embodiment. The drive recording and display system M comprises a vehicle Q including equipment with a camera, an information terminal 8, a device management server 5, and a content management server 1.

[0037] In Figure 1, vehicle Q is equipped with a camera 61 and a drive recorder 6, which is a device that acquires location information of vehicle Q within vehicle Q. The drive recorder 6 captures and records video data Dv1 of the area around vehicle Q while vehicle Q is in motion using the camera 61. The video data Dv1 is recorded periodically during driving, or when a recording request is made by the vehicle user (including the driver), or when an event such as an impact occurs. The recorded video data Dv1 includes still images and videos (including those captured in time lapse). The drive recorder 6 is a communication-type drive recorder and communicates with a device management server 5 for drive recorders. The drive recorder 6 transmits the recorded video data Dv1 to the device management server 5, for example, periodically, or at any arbitrary time.

[0038] In this embodiment, the drive recorder 6 has a positioning system 65 (see Figure 2) that acquires the location information of the vehicle Q. The positioning system 65 acquires positioning data Dp, which includes the location information of the vehicle Q. Details of the positioning data Dp will be described later.

[0039] Information terminal 8 is a terminal device carried by user U who is driving vehicle Q or user U who is a passenger in vehicle Q. Information terminal 8 has a camera 81. Information terminal 8 captures and records video data Dv2 using the camera 81.

[0040] The device management server 5 and the content management server 1 can communicate with each other. The content management server 1 corresponds to the server in this disclosure. The device management server 5 receives the video data Dv1 captured by the camera 61 of the drive recorder 6 from the drive recorder 6 and temporarily stores it.

[0041] The content management server 1 receives and stores video data Dv1 and positioning data Dp captured by the drive recorder 6's camera 61 from the device management server 5. The content management server 1 generates a thumbnail P corresponding to the video data Dv1. Based on the positioning data Dp, the content management server 1 generates vehicle Q's driving trajectory data RT on the map data MP. The content management server 1 transmits display data V, including the shooting location and thumbnail P of each video data Dv1 and the driving trajectory data RT, to the information terminal 8. The functions of the content management server 1, video data Dv1, and positioning data Dp will be described later.

[0042] (2) Vehicles As shown in Figure 2, vehicle Q is equipped with a typical in-vehicle system 7. The drive recorder 6 was retrofitted to vehicle Q by user U.

[0043] The drive recorder 6 is an example of a device capable of acquiring location information of vehicle Q. The drive recorder 6 comprises a camera 61, an input unit 62, an output unit 63, a communication interface 64, a positioning system 65, and a storage unit 66. The drive recorder 6 is an example in which the function of a camera 61 placed in the vehicle and the function of acquiring vehicle positioning data are configured as one unit. Note that the camera 61 placed in the vehicle may be located in a different location from the device that acquires vehicle positioning data (in this case, the drive recorder 6).

[0044] The drive recorder 6 acquires positioning data Dp using the positioning system 65 and takes pictures of a predetermined range using the camera 61 at predetermined intervals, and transmits the acquired positioning data Dp and captured video data Dv1 to the device management server 5. The drive recorder 6 may be in the form of a dedicated drive recorder device for the purpose of acquiring driving log data, or it may be in the form of an information terminal such as a smartphone with a mobile application for acquiring driving logs (hereinafter referred to as "mobile app") installed and the information terminal used for drive recorder purposes.

[0045] Camera 61 includes a front camera that captures a predetermined range in front of the vehicle when the housing of the drive recorder 6 (not shown) is installed in a predetermined position on the vehicle (installation state). Alternatively, camera 61 may include a rear camera that captures a predetermined range behind the vehicle when the drive recorder 6 is installed, or it may include an interior camera that captures the interior of the vehicle Q to acquire interior video data. The video data Dv1 captured by camera 61 is linked to the positioning data Dp acquired by the positioning system 65 and stored in the storage unit 66.

[0046] The input unit 62 accepts various types of input. Specifically, the input unit 62 includes, for example, a microphone for acquiring audio from inside the vehicle and an operation reception unit for receiving input operations from user U. Examples of the operation reception unit include a push-button switch and a touch-sensor touch panel. It is also possible to receive input operations from user U via voice recognition through the microphone. In other words, the microphone may also serve as the operation reception unit. Furthermore, in this disclosure, the microphone located inside the vehicle may be a "microphone that is standardly installed in the vehicle as part of the in-vehicle system 7", a "microphone of an aftermarket device such as a drive recorder 6 that is retrofitted to the vehicle Q", or a "microphone provided on an information terminal 8 that is brought into the vehicle by user U while driving".

[0047] The output unit 63 is used to output various types of information. Specifically, the output unit 63 may include, for example, a display panel that displays various types of content on a display screen, a speaker that outputs audio information, or a liquid crystal display unit that presents information by turning on / off. Examples of display panels include liquid crystal panels and organic EL panels.

[0048] The communication interface 64 is a circuit that is connected to the internet and communicates with the device management server 5 via the internet. In this example, the communication interface 64 does not communicate with the content management server 1. Positioning data Dp acquired by the positioning system 65 and video data Dv1 captured by the camera 61 are exchanged with the device management server 5 via the communication interface 64. The positioning data Dp and video data Dv1 are transmitted to the device management server 5 at predetermined intervals. The predetermined interval is not particularly limited, but for example, it is 1 second.

[0049] The positioning system 65 can use a conventionally known configuration (e.g., GPS), receive radio waves from satellites, and acquire positioning data Dp based on those satellite radio waves. The positioning data Dp may be stored in the storage unit 66 on its own, or it may be stored in the storage unit 66 in association with video data Dv1 captured by the camera 61.

[0050] The memory unit 66 is composed of, for example, volatile memory such as RAM, and non-volatile memory such as ROM or flash memory. The memory unit 66 stores the program for operating the drive recorder 6. The memory unit 66 also temporarily records positioning data Dp acquired by the positioning system 65 and video data Dv1 captured by the camera 61.

[0051] The in-vehicle system 7 includes an input unit 71, an output unit 72, a communication interface 73, a sensor group 74, a controller group 75, an actuator group 76, and a storage unit 77.

[0052] The input unit 71 accepts various types of input. Specifically, the input unit 71 includes, for example, a microphone for acquiring sound inside the vehicle cabin and an operation reception unit for receiving user U input operations. Examples of the operation reception unit include a push-button switch and a touch-sensor touch panel. Alternatively, user U input operations may be accepted via voice recognition through the microphone. In other words, the microphone may also function as the operation reception unit.

[0053] The output unit 72 is used to output various types of information. Specifically, the output unit 72 may include, for example, a display panel that displays output information on a display screen, a speaker that outputs audio information, or a liquid crystal display unit that presents information by turning on / off.

[0054] The communication interface 73 is a circuit or device connected to the internet for communicating with other computers, servers, information terminals, etc. In this embodiment, the communication interface 73 does not communicate with any of the device management server 5, drive recorder 6, or content management server 1.

[0055] The sensor group 74 includes a camera 741 positioned on the vehicle and a positioning system 742 used for autonomous driving or driver assistance. The camera 741 includes an external camera that captures a predetermined area outside the vehicle and an internal camera that captures the interior of the vehicle. Although not shown, the external camera is composed of multiple cameras, and the combined shooting ranges of each camera are arranged to capture a 360-degree area around the vehicle.

[0056] The controller group 75 consists of various controllers that control the in-vehicle system. The controller group 75 consists of, for example, ECUs (Electronic Control Units) located in various places on the vehicle Q, and controls the actuator group 76 based on inputs from the input unit 71 and the sensor group 74. The controller group 75 may also include ADAS (Advanced driver-assistance systems) 751 that assist in driving the vehicle Q. The actuator group 76 includes drive system actuators related to the driving of the vehicle Q, braking system actuators related to braking the vehicle Q, and steering system actuators related to steering the vehicle Q.

[0057] The memory unit 77 includes, for example, memory and storage. The memory includes, for example, volatile memory such as RAM and non-volatile memory such as ROM and flash memory. The storage includes, for example, magnetic recording media such as HDD (Hard Disk Drive), semiconductor recording media such as SDD (Solid State Drive), and optical recording media such as DVD. Positioning data Dp acquired by the positioning system 742 and video data Dv1 captured by the camera 741 are temporarily recorded in the memory unit 77.

[0058] -Positioning data- Positioning data Dp is data that includes the vehicle's location information at the time of data acquisition. Specifically, positioning data Dp includes, for example, the acquisition date of positioning data Dp (data acquisition date), the acquisition time of positioning data Dp (data acquisition time), the location information of vehicle Q (e.g., latitude and longitude), the direction of travel information of vehicle Q, the direction and bearing information of vehicle Q, the speed of vehicle Q, and some or all of the identification ID. The file format of positioning data Dp is not particularly limited, but for example, it is a text file conforming to the NMEA format.

[0059] -Video Data- As described above, video data Dv1 is video data captured by a camera (hereinafter referred to as "in-vehicle camera") located on vehicle Q. In the drive recording display system M, the video data Dv1 to be recorded is not particularly limited. Video data Dv1 includes either still images, videos (including those captured in time lapse), or both. Video data Dv1 may also include audio. For example, video data Dv1 may include: "video data of a predetermined range outside the vehicle (e.g., a predetermined range in the direction of travel of the vehicle) captured by an in-vehicle camera while the vehicle is in motion and linked to positioning data"; "video data of the outside or inside of the vehicle captured based on input received directly or indirectly from the driver and / or passengers"; "video data of the outside or inside of the vehicle automatically captured when a specific location or condition is observed by a sensor, etc."; and "time lapse video data of the outside of the vehicle captured semi-automatically and continuously." Examples of specific states include, for instance, "a state in which the atmosphere inside the vehicle is lively" and "a state in which scenery or buildings of a tourist destination are within the camera's frame." In this disclosure, for the sake of explanation, when the driver and passenger are not specifically distinguished, the driver and passenger may be collectively referred to as "User U of Vehicle Q" or simply "User U."

[0060] In the following explanation, data acquired by vehicle Q and available to the drive display system is collectively referred to as content data Dc. Content data Dc includes positioning data Dp and video data Dv1. Video data Dv1 may be linked to positioning data Dp. Video data Dv1 and the positioning data Dp linked to that video data Dv1 only need to be related to each other. For example, positioning data Dp at the time video data Dv1 was taken can be said to be positioning data Dp linked to video data Dv1.

[0061] (3) Device management server As shown in Figure 3, the device management server 5 comprises a communication interface 51, a content management unit 52, and storage 53. The device management server 5 acquires content data Dc (including positioning data Dp and video data Dv1) acquired by the managed drive recorder 6 through data linkage. Furthermore, for drive recorders 6 that are linked with the content management server 1, the device management server 5 also links the content data Dc acquired from the drive recorder 6 with the content management server 1. The device management server 5 is a cloud-type server that receives and manages event notifications or content data Dc from the vehicle Q.

[0062] The communication interface 51 is connected to the internet and communicates with the content management server 1 and the drive recorder 6 via the internet. Data exchange with the drive recorder 6 and data exchange with the content management server 1 are performed via the communication interface 51.

[0063] The content management unit 52 manages the content data Dc in the storage 53. Specifically, the content management unit 52 saves the content data Dc received from the managed drive recorder 6 to the storage 53. Figure 3 shows an example in which content data Dc is received from each of the vehicles Q (Q1, Q2, Q3, ...) and saved to the storage areas 53a, 53b, and 53c of the storage 53, respectively. The content management unit 52 also retrieves the content data Dc to be transmitted from the storage 53 and sends it to the content management server 1 via the communication interface 51.

[0064] The storage 53 stores content data Dc (including positioning data Dp and video data Dv1) acquired by the managed drive recorder 6. Examples of storage 53 include magnetic recording media such as HDDs (Hard Disk Drives), semiconductor recording media such as SSDs (Solid State Drives), and optical recording media such as DVDs.

[0065] (4) Content management server As shown in Figure 4, the content management server 1 comprises a device gateway 2, a content manager 3, a backend for frontend 4 (BFF), a messaging basis 11, and a set of functions 14. The content management server 1 is a cloud-type server that receives and manages content data Dc.

[0066] (4-1) Device Gateway Device Gateway 2 is connected to a network such as the Internet and has a communication interface for communicating with other computers, servers, information terminals, etc. Device Gateway 2 communicates with Device Management Server 5.

[0067] When content data Dc is transmitted from a designated vehicle Q to the device management server 5, the device management server 5 transmits the content data Dc of that vehicle Q to the content management server 1. The content management server 1 receives the content data Dc via the device gateway 2. The device gateway 2 separately receives the positioning data Dp and video data Dv1 acquired by the drive recorder 6 of the vehicle Q. The content data Dc is transmitted from the device management server 5 to the content management server 1 at predetermined intervals, for example, while the vehicle is being driven.

[0068] (4-2) Content Management Department The content management unit 3 integrates the video data Dv1 transmitted from the device management server 5 and the video data Dv2 transmitted from the information terminal 8, stores them in storage 33 (e.g., HDD or SSD), and manages them centrally. In the following description, video data Dv1 and video data Dv2 may be collectively referred to as video data Dv. In other words, video data Dv includes at least one of video data Dv1 or Dv2.

[0069] The content management unit 3 manages "content files" and "content information" separately for the centralized management described above. Management here refers to enabling each application module 15 of the function group 14 and the information terminal 8 to search, refer to, and retrieve "content files" and "content information" based on predetermined conditions. "Content files" and "content information" are related to each other, for example, through a content ID. A "content file" is a file containing the data of the content included in the video data Dv1 and Dv2. This configuration allows for centralized management of video data Dv1 and video data Dv2. For example, when a mobile application on the information terminal 8 accesses the content management unit 3 to view videos or still images taken while driving, searching becomes easier, and search speed and accuracy can be improved.

[0070] The content management unit 3 generates a thumbnail P for video data Dv1 if the video data Dv1 is event video data. The generated thumbnail P is linked to the video data Dv1 and saved in storage 33. The generated thumbnail P is included in content file 33b (see Figure 6).

[0071] Figures 5 and 6 show an example of content information 33a stored in the storage 33 of the content management unit 3. In this example, the storage 33 stores video data Dv from the first drive D1 and the second drive D2. As shown in Figure 5, the video data Dv from the first drive D1 includes video data 11 to 15, numbered No. 11 to No. 15, and the video data Dv from the second drive D2 includes video data 21 to 25, numbered No. 21 to No. 25. Video data 11, 12, 15, 21, 23, and 25 are time-lapse videos taken at predetermined intervals by the camera 61 (external camera) of the drive recorder 6 during normal driving of the vehicle Q, and are an example of video data Dv1, and an example of normal driving video data. Video data 13 and 24 are still images or videos captured by the drive recorder 6's camera 61 (in-car or external camera) during vehicle Q's drives D1 and D2, and are examples of video data Dv1 and event video data. Video data 14 and 22 are still images or videos captured by the information terminal 8's camera 81 during vehicle Q's drives D1 and D2, and are examples of video data Dv2 and event video data. Normal driving video data refers to video data captured at predetermined intervals during normal driving of vehicle Q. Event video data, unlike normal driving video data, is video data captured based on predetermined inputs. As shown in Figures 5 and 6, in this example, thumbnails are generated for video data 13, 14, 22, and 24, respectively.

[0072] (4-3) Messaging infrastructure Returning to Figure 4, the messaging infrastructure 11 is a messaging system used for exchanging messages between application modules 15 included in the function group 14. The messaging infrastructure 11 is provided in accordance with the functions available in the function group 14 and is used by the application modules 15 that realize each of those functions.

[0073] (4-4) Functional Groups Function group 14 includes an application module 15 for realizing various functions and services (hereinafter collectively referred to as "functions"). The application module 15 includes memory for storing application programs for realizing various functions and services, and a processor for executing those application programs, and various functions are realized by executing the application programs. Examples of functions realized by function group 14 include, for example, "user information management function," "drive record management function," "video data management function," "vehicle driving trajectory display function," "memory movie creation and editing function," and "log card (corresponding to drive record image data) creation and editing function."

[0074] Each application module 15 obtains topic information necessary for realizing its respective function from the messaging infrastructure 11. The messaging infrastructure 11 may send various processing requests based on messages to the target application module 15. Examples of processing requests include, for example, "a request to create a new record to the drive record management function when a drive start event occurs" and "an instruction to import the drive end point to the drive record management function when a drive end event occurs".

[0075] The application module 15, which displays the driving trajectory as one of the drive record management functions, generates vehicle driving trajectory data RT on the map data MP based on positioning data Dp. Specifically, the application module 15 identifies the position of vehicle Q from the acquired positioning data Dp and draws a line connecting the previously acquired position of vehicle Q and the currently acquired position of vehicle Q. The starting point of the driving trajectory is the point where the content management server 1 determines that the drive has started. The ending point of the driving trajectory is the point where the content management server 1 determines that the drive has ended. The driving trajectory is continuously generated, i.e., updated, as long as the vehicle Q is still being driven. The updated driving trajectory data RT is sent to BFF4.

[0076] (4-5) BFF BFF4 functions as a data exchange interface with the mobile application implemented on the information terminal 8. Specifically, BFF4 has a communication interface that receives and processes commands from the mobile application implemented on user U's information terminal 8. A communication interface is a circuit or device that is connected to a network such as the internet and communicates with other computers, servers, information terminals, etc. In the example in Figure 4, the communication interface is connected to the internet and communicates with the information terminal 8 via the internet. The communication interface also communicates with the content management unit 3 within the content management server 1.

[0077] BFF4 executes processing in response to commands from the mobile app on the information terminal 8. For example, BFF4 receives commands from the mobile app on the information terminal 8 such as "request to view drive logs and videos / still images," "request to create a memory movie," "request to create a log card," and "instruction to edit the drive log." BFF4 executes processing in response to these commands. Specifically, when BFF4 receives a "request to create a log card" from the information terminal 8, it notifies the application module 15, which has a "log card creation function," receives the log card created by the application module 15, and sends (outputs) it to the information terminal 8 (mobile app).

[0078] BFF4 retrieves the shooting location and thumbnail of the event video from the storage of the content management unit 3, and transmits them to the information terminal 8 as display data V, along with the driving trajectory data received from the application module 15.

[0079] Although Figure 4 shows an example where video data Dv2 is directly transmitted from the information terminal 8 to the content management unit 3, the video data Dv2 may also be transmitted from the information terminal 8 to the content management unit 3 via the BFF 4.

[0080] Content management server 1 may be configured to automatically link predetermined data using technologies such as API integration or SFTP integration. While a detailed explanation is omitted as it is outside the scope of the disclosed technology, content management server 1 consists of hardware such as a processor, memory, and storage, and software such as control programs and data implemented in memory. Each function of content management server 1 is realized by the execution of programs stored in memory by a processor such as a CPU or GPU. Note that content management server 1 is not limited to a cloud server; an on-premises server may also be used.

[0081] (5) Information terminals As shown in Figure 7, the information terminal 8 includes a camera 81, a communication interface 82, an input unit 83, an output unit 84, and a storage unit 86.

[0082] Camera 81 is a camera mounted on the main body of the information terminal 8. It captures optical images and generates video data Dv2. The video data Dv2 is not particularly limited. The video data Dv2 may be a still image or a video. Camera 81 acquires the video data Dv2 upon request from user U. Multiple cameras 81 may be provided on the information terminal 8.

[0083] The communication interface 82 is connected to the internet and communicates with the content management server 1. The communication interface 82 transmits video data Dv2 and positioning data Dp captured by the camera 81 to the content management server 1. The communication interface 82 transmits commands from the mobile application to the content management server 1. The communication interface 82 obtains the location information of vehicle Q from the content management server 1 at predetermined intervals. The predetermined interval is not particularly limited, but for example, it is 1 second. It receives memory information transmitted from the content management server 1.

[0084] The input unit 83 receives various inputs from user U. The input unit 83 includes a push-button switch, a touch-sensor touch panel, and a microphone for acquiring user U's voice.

[0085] The output unit 84 is used to output various types of information. Examples of the output unit 84 include a display panel that displays output information on a display screen, and a speaker that outputs audio information. If the input unit 83 is configured as a touch panel, the output unit 84 and the input unit 83 are configured as the same panel. The output unit 84 reflects the location information and driving trajectory of vehicle Q received from the content management server 1 into map data MP and displays it together with the map image. The output unit 84 displays the memory information received from the content management server 1. The method of acquiring the map data MP is not particularly limited. For example, location information can be provided to a platform that provides digital maps, and map data MP corresponding to the provided location information can be acquired.

[0086] The storage unit 86 is composed of, for example, volatile memory such as RAM, and non-volatile semiconductor memory such as ROM or flash memory. The storage unit 86 stores the video data Dv2 and positioning data Dp acquired by the camera 81. The video data Dv2 and positioning data Dp stored in the storage unit 86 are transmitted to the content management server 1 via the communication interface 82.

[0087] (6) Operation of the drive recording and display system The drive record display system M operates by downloading a mobile application for using the drive record display system M to the information terminal 8 and operating the mobile application on the information terminal 8.

[0088] As part of the initial setup of the mobile app, user U pre-registers information identifying the drive recorder 6 installed in their vehicle Q (manufacturer, model, ID, name of vehicle Q, etc.) with the content management server 1 via the information terminal 8. The content management server 1 identifies the device management server 5 for the drive recorder of that manufacturer and model, and communicates with this device management server 5. The content management server 1 receives video data Dv1 recorded by the drive recorder with the ID registered by user U from the device management server 5. The content management server 1 edits the received video data Dv1, creates it as, for example, drive memory information, and sends it to user U's information terminal 8.

[0089] Furthermore, when user U changes the drive recorder 6 in their vehicle Q, they register information identifying the new drive recorder 6 (manufacturer, model, ID, name of vehicle Q, etc.) with the content management server 1 via the information terminal 8. The content management server 1 then identifies the device management server 5 for the new drive recorder and communicates with this device management server 5. The content management server 1 receives video data Dv1 recorded by the drive recorder with the ID registered by user U from the new device management server 5. The content management server 1 edits the received video data Dv1, creates it as, for example, drive memory information, and sends it to user U's information terminal 8.

[0090] Next, the sequence of operations of the drive recording display system M from drive start to drive end will be explained with reference to the flowcharts in Figures 8 and 9.

[0091] (6-1) Start and end of drive Figure 8 describes the operation and processing, including drive start and drive end determination. Figure 8 describes the operation and processing on content management server 1. The initial state in Figure 8 is after the drive end determination, and content management server 1 is in a state where it has not received positioning data Dp.

[0092] When the vehicle Q is powered on, power is supplied to the drive recorder 6, and the drive recorder 6 turns on. The drive recorder 6 starts recording with the camera 61 and acquiring positioning data Dp with the positioning system 65. When the drive recorder 6 is powered on, data exchange between the drive recorder 6 and the device management server 5 begins. Specifically, the drive recorder 6 exchanges content data Dc, which includes video data Dv1 recorded by the camera 61 and positioning data Dp acquired by the positioning system 65, with the device management server 5.

[0093] When data is exchanged between the drive recorder 6 and the device management server 5, data exchange between the device management server 5 and the content management server 1 begins. When the device management server 5 receives content data Dc (including video data Dv1 and positioning data Dp) from the drive recorder 6, which is the target of data exchange with the content management server 1, it sends an event notification to the content management server 1.

[0094] In step S11, when the content management server 1 receives positioning data Dp from the device management server 5, in step S12, the content management server 1 determines that an event has occurred in which the vehicle from which the positioning data Dp was received has started driving (hereinafter simply referred to as "start driving"). The positioning data Dp here includes positioning data Dp associated with video data Dv1. In other words, positioning data Dp is not limited to cases where it is received alone, and positioning data Dp may be included in or incorporated into video data Dv1.

[0095] In step S13, the content management server 1 determines whether the state in which positioning data Dp has not been received by the device gateway 2 (hereinafter referred to as the "non-reception state") has exceeded a predetermined time. If the duration of the non-reception state is less than or equal to the predetermined time (NO in step S13), the content management server 1 determines in step S15 that the drive is continuing. On the other hand, if the duration of the non-reception state is longer than or equal to the predetermined time (YES in step S13), the content management server 1 determines in step S14 that a drive termination event has occurred.

[0096] In the above process, the "predetermined period" for determining the occurrence of drive start and drive end events is not particularly limited. The "predetermined period" may be set in advance, or it may be configured to be set and changed externally. Furthermore, the content management server 1 may be configured to allow the user U to set and change the "predetermined period" via an information terminal or computer owned by the user U.

[0097] (6-2) Acquisition and storage of video data Figure 9 is a flowchart showing an example of the video data acquisition and saving process. This flowchart is executed repeatedly as long as the drive is running.

[0098] In step S22, the content management server 1 requests the device management server 5 to acquire video data Dv1. The device management server 5 then sends the video data Dv1 to the device gateway 2, and the device gateway 2 receives the video data Dv1 (S23). At this time, the positioning data Dp and the video data Dv1 associated with the positioning data Dp are received separately. Note that the timing at which the positioning data Dp and video data Dv1 are received does not need to be the same; they may be received at different times. The video data Dv1 received by the device gateway 2 is sent to the content management unit 3, and the positioning data Dp is sent to the event hub 12 as topic information Dm.

[0099] In step S24, the content management unit 3 determines whether the received video data Dv1 is a normal driving image (e.g., a time-lapse video) taken during normal vehicle driving, or an event video taken at a different time from the normal driving image based on a predetermined input.

[0100] -1. In the case of a normal driving image- In step S24, if the video data Dv1 is a normal driving image, the flow proceeds to step S25. In step S25, the content management unit 3 assigns a content ID to the video data Dv1 and sends the content ID to the device gateway 2. The content ID of the video data Dv1 received by the device gateway 2 is sent to the event hub 12 as topic information Dm. The content management unit 3 also saves the video data Dv1 to the storage 33. The content management unit 3 also executes a process to acquire content information. The acquired content information is linked to the content ID created earlier and saved to the storage 33. A specific example of content information is illustrated in Figure 5 and has already been explained.

[0101] -2. In the case of event video data- In step S24, if the video data Dv1 is event video data, the flow proceeds to step S26. In step S26, the same processing as in step S25 is performed. In the next step, S27, the content management unit 3 creates a thumbnail of the video data Dv1. In addition to the thumbnail of the video data Dv1, the content management unit 3 may generate other additional content. The video data of the additional content and the path to the additional content are stored in storage 33. Note that the processing in steps S26 and S27 may be executed in parallel.

[0102] (6-3) Displaying Drive Records Figure 10 is a flowchart illustrating an example of the operation to display the drive record on the information terminal 8. When user U wants to display the drive record of vehicle Q, they perform an input operation on the information terminal 8 to launch the mobile application for displaying the drive record (hereinafter simply referred to as the "mobile application"). As a result, the information terminal 8 displays the launch screen of the mobile application on the display screen W (hereinafter simply referred to as the "display screen W") (step S31). Figure 11 shows an example of the information terminal screen display when the mobile application is running. In Figure 11, the left figure shows the launch state before the vehicle Q starts driving.

[0103] The startup screen of a mobile app is not particularly limited, but for example, it may display multiple navigation bars N, including navigation bars N1 and N2. Navigation bar N1 is located at the bottom of the display screen W, and multiple operation icons are arranged horizontally on the screen. In Figure 11, examples of icons for tap operation include a drive icon for displaying drive information, a media icon for accessing media such as video content, a notification icon for checking notification information, and a settings icon for making various settings. Navigation bar N2 is located in the center of the display screen W, arranged vertically on the screen, and is configured to allow the user to access registered drive records corresponding to their tap operation.

[0104] In step S32 of Figure 10, when the content management server 1 determines that the vehicle Q (hereinafter simply referred to as "vehicle Q") linked to the information terminal 8 has started driving (see S12 in Figure 8), it notifies the information terminal 8 that it has started driving. In addition, as step S35, the content management server 1 executes the process shown in "(6-2) Acquisition and storage of video data" (see Figure 9), and as step S36, it executes the process of generating the driving trajectory. In summary, the content management server 1 acquires video data Dv1 captured by camera 61 or video data Dv2 captured by camera 81 of information terminal 8, and positioning data Dp, generates thumbnails corresponding to the respective video data Dv1 and Dv2, and generates vehicle Q's driving trajectory data RT on the map data MP based on the positioning data Dp. Furthermore, display data V, which includes (1) the shooting locations of each video data Dv1 and Dv2, (2) thumbnails P of each video data Dv1 and Dv2, and (3) driving trajectory data RT, is transmitted to the information terminal 8.

[0105] In step S33, when the information terminal 8 receives a notification that a drive has started, it displays a navigation bar N3 on the display screen W indicating that the vehicle Q has started driving. The right-hand figure in Figure 11 shows an example of the display screen W after the vehicle Q has started driving. The items displayed on the navigation bar N3 are not particularly limited, but for example, the name of the area being driven, the drive time which is the elapsed time since the start of the drive, an icon C1 indicating that the vehicle is driving, and an arrow-shaped operation icon C2 that transitions to the drive map screen may be displayed.

[0106] In step S34, when the user U taps the operation icon C2, the information terminal 8 requests the content management server 1 for display data V.

[0107] In step S37, when the content management server 1 receives a request from the information terminal 8, it sends display data V to the information terminal 8. As described above, the display data V includes the driving trajectory data RT and the shooting locations and thumbnails P of the video data Dv1 taken during the drive. Similarly, the display data V includes the driving trajectory data RT and the shooting locations and thumbnails P of the video data Dv2 taken during the drive.

[0108] In step S38, upon receiving display data V, the information terminal 8 displays the map data MP and the driving trajectory RT superimposed on the display screen W based on the display data V. Furthermore, it displays a thumbnail P of the video data Dv1 at a position adjacent to the shooting location of the video data Dv1 on the map data MP. Similarly, it displays a thumbnail P of the video data Dv2 at a position adjacent to the shooting location of the video data Dv2 on the map data MP. In summary, the information terminal 8 receives display data V, and based on the display data V, displays the driving trajectory data RT superimposed on the map data MP on the display screen W, and displays thumbnails P corresponding to the video data Dv1 and Dv2 at positions adjacent to the shooting locations of the video data Dv1 and Dv2 on the map data MP.

[0109] The transmission of display data V is repeated until a stop request is received from the information terminal 8 or until the end of vehicle Q's drive is determined. The method of repetition is not particularly limited, but for example, the display data is updated at predetermined intervals (for example, every second). In this way, the content management server 1 updates the display data V based on the video data Dv1, Dv2 or positioning data Dp acquired by the drive recorder 6 while vehicle Q is driving, and transmits the updated display data V to the information terminal 8. The information terminal 8 then updates the display of thumbnails of the driving trajectory data RT or video data Dv1, Dv2 based on the updated display data V.

[0110] Figure 12 shows an example of the drive map screen related to the first drive described above. In Figure 12, the screens after 5 minutes, 20 minutes, 45 minutes, and 1 hour and 20 minutes from the start of the drive are shown from left to right. As shown in Figure 12, the map data MP, driving trajectory data RT, and thumbnails P of video data Dv1 and Dv2 are displayed simultaneously on the display screen W of the information terminal 8. Displaying these images on one screen enhances user convenience. Specifically, during the drive, the user can grasp and understand the status of the drive for the day in an overview manner. After the drive, the user can recall the conditions of the drive for the day (e.g., weather, scenery, etc.) more vividly. In Figure 12, Ca is an icon indicating the driving position and orientation of vehicle Q.

[0111] As shown in Figure 12, on the drive map screen of the information terminal 8 (corresponding to the drive record display screen), (1) Thumbnail P is positioned so as not to overlap with the driving trajectory. (2) Thumbnails P are arranged so that adjacent thumbnails P do not overlap. (3) The thumbnail P is placed on the speech bubble-shaped icon C5, and the speech bubble of icon C5 is displayed so that it extends towards the shooting location of the video data.

[0112] As a result, the images taken by the user and the location where they were taken can be displayed on the map data MP in an accurate and intuitive manner. Note that the display modes (1) to (3) above are not mandatory configurations. In other words, the display mode does not have to be one of the above (1) to (3), and the above (1) to (3) may be applied selectively.

[0113] Furthermore, the information terminal 8 may be configured to retrieve video data Dv1 from the content management server 1 and display it on the display screen W when a touch operation is performed on the thumbnail P displayed on the display screen W. Specifically, when the information terminal 8 is touched on the thumbnail P displayed on the display screen W, it sends a request to the content management server 1 for video data Dv1 corresponding to thumbnail P. In response to the request from the information terminal 8, the content management server 1 sends the video data Dv1 corresponding to thumbnail P to the information terminal 8. For video data Dv2, for example, data stored in the information terminal 8 is used. The information terminal 8 then displays the video data Dv1 and Dv2 received from the content management server 1 on the information terminal 8. Furthermore, the content management server 1 may send the video data Dv1 to be displayed as thumbnail P to the information terminal 8 in advance, along with the display data V. This shortens the display time of video data Dv1 in response to a touch operation on thumbnail P.

[0114] (modified version) The above embodiment may also be modified as follows. In the following description, we will primarily explain the differences from the above embodiment.

[0115] In the above embodiment, the display data V transmitted from the content management server 1 to the information terminal 8 may include scale data. The scale data is, for example, data relating to the scale of map data MP that enables the display of a series of driving trajectories, including the starting point of the drive and the current location of the vehicle Q during the drive, on the display screen W of the information terminal 8. Alternatively, for example, the scale data is data relating to the scale of map data MP that enables the display of a series of driving trajectories, including the starting point and ending point of the drive, on the display screen W of the information terminal 8. The information terminal 8 then displays the map data scaled according to the scale data and the series of driving trajectories overlaid on it, and displays a thumbnail adjacent to the shooting location of the video data on the map data MP. This ensures that the drive record can be viewed at a glance, even when driving long distances.

[0116] As shown in Figure 13, if there are multiple thumbnails P within a predetermined distance range, the content management server 1 may include a single thumbnail P representing the multiple thumbnails P and the number of video data within the predetermined distance range in the display data V. In this case, the information terminal 8 displays the representative thumbnail P on the map data MP and displays the number of video data Dv1 taken within the predetermined distance range, corresponding to the representative thumbnail. Figure 13 shows an example where the number of video data Dv1 is indicated in the upper left and right corners of the thumbnail P. This allows for the accurate placement of thumbnails that evoke memories, making them easy to grasp intuitively, while avoiding a cluttered and difficult-to-read impression. Note that it is sufficient to know the number of video data within the predetermined distance range, and the specific display method is not limited to the form shown in Figure 13. Also, for example, if there are multiple thumbnails P within a predetermined distance range, as shown in Figure 14, the information terminal 8 may display a number indicating the number of video data Dv1 in place of the thumbnail P of video data Dv1 at a location adjacent to the shooting location of the video data Dv1 on the map data MP. This allows user U to intuitively understand locations with a high number of video data Dv1 instances. Furthermore, displaying the number of video data Dv1 instances instead of thumbnails P makes the numbers easier to read.

[0117] <Other Embodiments> The technologies disclosed herein are not limited to the embodiments described above and may be substituted insofar as they do not depart from the spirit of the claims.

[0118] The device management server 5 may be omitted. Video data Dv1 and positioning data Dp may be transmitted directly from the drive recorder 6 to the content management server 1.

[0119] The device capable of acquiring the location information of vehicle Q does not have to be the drive recorder 6. This device may be the sensor group 74 provided by the in-vehicle system 7. Furthermore, the camera that acquires video data during driving does not have to be the camera of the drive recorder 6. The camera may be the camera used in the ADAS 751 or the aforementioned camera 741. In this case, the video data and positioning data are transmitted to the content management server 1 via the communication interface 73.

[0120] The content management server 1 may acquire video data captured by the camera 741, create thumbnails, and use them as part of the drive record. In this case, for example, the in-vehicle system 7 exchanges data with the content management server 1 via the communication interface 73. Specifically, for example, the in-vehicle system 7 transmits the video data Dv1 and positioning data Dp stored in the storage unit 77 to the content management server 1 at predetermined intervals (for example, every second). The subsequent handling of the video data Dv1 and positioning data Dp is the same as the handling of the video data Dv1 and positioning data Dp acquired by the drive recorder 6 in the above embodiment, and a detailed explanation is omitted here.

[0121] The vehicle may be a bicycle, motorbike, railway car, electric scooter, rickshaw, etc. When the vehicle is a bicycle, motorbike, or railway car, the device capable of acquiring location information is, for example, a drive recorder. When the vehicle is an electric scooter, bicycle, or motorbike, the linking of the mobile terminal and the drive recorder can be done in the same manner as in the embodiments described above. When the vehicle is a railway car, the railway company approves the user registration when linking the mobile terminal and the drive recorder. When the vehicle is a rickshaw, for example, the camera placed on the vehicle is attached to the rickshaw. The device that acquires the vehicle's positioning data is not particularly limited. For example, it may be attached to the rickshaw, or it may also be an information terminal held by the rickshaw driver. In this case, the positioning data acquired by the positioning function of the information terminal held by the rickshaw driver may be used as the vehicle's positioning data. Alternatively, the information terminal held by a passenger riding in the rickshaw may also serve as the device that acquires the vehicle's positioning data.

[0122] Furthermore, as a reference example, the technology disclosed herein can also be applied to aircraft. When applied to aircraft, the device capable of acquiring location information is a flight recorder. In linking a mobile terminal with a drive recorder, user registration approval is performed by the airline. As another reference example, the technology disclosed herein can be applied to privately operated vessels such as pleasure boats. For vessels, the system of the above embodiment configured for vehicles can be easily adapted by replacing the map with a nautical chart and the driving trajectory with a navigation trajectory. [Industrial applicability]

[0123] The technology disclosed herein is useful for drive recording and display systems. [Explanation of symbols]

[0124] 6. Dashcam (device) 8. Information terminals 61 Camera 81 Camera DV video data M Drive Recording and Display System P Thumbnail Q Vehicle V Display Data Dv1 video data Dv2 video data

Claims

1. A drive record display system that displays a record of a vehicle's driving, Cameras mounted on the vehicle, The vehicle includes equipment for acquiring positioning data of the vehicle, It has a display screen and is connected to an information terminal held by the user of the vehicle, The system comprises a server capable of communicating with the aforementioned information terminal, The aforementioned server, The device acquires video data captured by the camera and positioning data acquired by the device. A thumbnail is generated corresponding to each of the aforementioned video data. Based on the positioning data, the vehicle's driving trajectory data is generated on the map data. The information terminal transmits the shooting location of each of the aforementioned video data, the thumbnail, and display data including the driving trajectory data. The aforementioned information terminal is Upon receiving the aforementioned display data, Based on the display data, the display screen overlays the driving trajectory data onto the map data and displays the thumbnail at a position adjacent to the shooting location of the video data on the map data. Drive record display system.

2. In the drive recording and display system according to claim 1, The server updates the display data based on video data or positioning data acquired by the device while the vehicle is being driven, and transmits the updated display data to the information terminal. The information terminal updates the display of the driving trajectory data or thumbnail based on the updated display data. Drive record display system.

3. In the drive recording display system according to claim 1 or 2, The display data transmitted from the server to the information terminal includes scale data relating to the scale of map data that enables the display of a series of driving trajectories, including the starting point of the drive and the current location of the vehicle when it is being driven, on the display screen of the information terminal. The information terminal displays map data scaled according to the scale data and the series of driving trajectories overlaid on it, and displays the thumbnails on the map data at positions adjacent to the shooting locations of the video data. Drive record display system.

4. In the drive recording and display system according to claim 1, The display data transmitted from the server to the information terminal includes scale data relating to the scale of the map data, which enables the display of a series of driving trajectories, including the start and end points of the drive, on the display screen of the information terminal. The information terminal displays map data scaled according to the scale data and the series of driving trajectories overlaid on it, and displays the thumbnails on the map data at positions adjacent to the shooting locations of the video data. Drive record display system.

5. In the drive recording and display system according to claim 1, In the display screen of the information terminal, the thumbnails are arranged so as not to overlap with the driving trajectory data. Drive record display system.

6. In the drive recording and display system according to claim 1, In the display screen of the information terminal, the thumbnails are arranged so that adjacent thumbnails do not overlap. Drive record display system.

7. In the drive recording and display system according to claim 1, When a touch operation is performed on the thumbnail, the information terminal retrieves the video data from the server and displays it on the display screen. Drive record display system.

8. In the drive recording and display system according to claim 1, The information terminal displays a thumbnail on a speech bubble-shaped icon, with the speech bubble of the icon extending toward the shooting location of the video data. Drive record display system.

9. In the drive recording and display system according to claim 1, If there are multiple thumbnails within a predetermined distance range, the server includes the number of video data within the predetermined distance range at the shooting position of the video data in the display data. The information terminal displays a number indicating the number of video data points in place of the thumbnail at a location adjacent to the shooting location of the video data on the map data. Drive record display system.

10. In the drive recording and display system according to claim 1, If there are multiple thumbnails within a predetermined distance range, the server includes a single thumbnail representing the multiple thumbnails and the number of video data within the predetermined distance range in the display data. The information terminal displays the one thumbnail in association with a number indicating the number of video data. Drive record display system.

11. A drive record display system that displays a record of a vehicle's driving, A device that acquires location information of the vehicle inside the vehicle, It has a camera and a display screen, and is connected to an information terminal held by the user of the vehicle, The system comprises a server capable of communicating with the aforementioned information terminal, The aforementioned server, The information terminal acquires video data captured by the camera and location information acquired by the device. A thumbnail is generated corresponding to each of the aforementioned video data. Based on the location information, the shooting location of the video data is identified, Based on the location information, the vehicle's driving trajectory data is generated on the map data. Display data including the shooting location and thumbnail of each of the aforementioned video data, as well as the driving trajectory data, is transmitted to the information terminal. The aforementioned information terminal is Upon receiving the aforementioned display data, Based on the display data, the display screen overlays the driving trajectory data onto the map data and displays the thumbnail at a position adjacent to the shooting location of the video data on the map data. Drive record display system.

12. A drive record display method for displaying a record of a vehicle's drives, The vehicle is equipped with a camera and a device that acquires location information of the vehicle within the vehicle. The user of the aforementioned vehicle has an information terminal with a display screen, A server capable of communicating with the aforementioned information terminal, The device acquires video data captured by the camera and location information acquired by the device. A thumbnail is generated corresponding to each of the aforementioned video data. Based on the location information, the vehicle's driving trajectory data is generated on the map data. The information terminal transmits the shooting location of each of the aforementioned video data, the thumbnail, and display data including the driving trajectory data. The aforementioned information terminal, Upon receiving the aforementioned display data, Based on the display data, the display screen overlays the driving trajectory data onto the map data and displays the thumbnail at a position adjacent to the shooting location of the video data on the map data. How to display driving records.

Images