Traveling video data recording system and traveling video data recording method

Abstract

To unify management of video data from an on-vehicle camera and video data captured by an information terminal.SOLUTION: A traveling video data recording system includes a content management server 1. The content management server 1 includes a first communication unit that receives positioning data and first video data Dv1 separately, a second communication unit that receives second video data Dv2 captured by a second camera of an information terminal 8 from the information terminal, and a content management unit 3 that has a storage 33. The content management unit 3 integrates the first video data Dv1 received by the first communication unit and the second video data Dv2 received by the second communication unit and stores them in the storage 33.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology disclosed herein belongs to the technical field of a driving video data recording system and a driving video data recording method that record video data while a vehicle is driving. [Background technology]

[0002] In recent years, vehicles have been equipped with cameras (hereinafter referred to as "on-board cameras") that are fixed in specific positions on the vehicle and capture video data inside and outside the vehicle while the vehicle is traveling, for purposes such as drive recorders, ADAS, and understanding the driver's condition.

[0003] Patent Documents 1 and 2 are known as technologies for effectively utilizing in-vehicle cameras. In Patent Document 1, image data and shooting location data captured by in-vehicle cameras from multiple vehicles are collected and provided in a format that can be viewed on a terminal device. In Patent Document 2, memory information acquired by an in-vehicle device or a mobile terminal is sent to a server via the in-vehicle device and stored, and the memory information is then distributed from the server to the mobile terminal. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-28492 [Patent Document 2] Japanese Patent Application Laid-Open No. 2015-230519 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the technology of Patent Document 1 has a problem in that the on-board camera is fixed in a predetermined position on the vehicle, and the user cannot freely set the angle of the on-board camera. For example, when creating a movie of memories during a drive, there is a need to incorporate video data captured on the information terminal carried by the vehicle user. The technology of Patent Document 2 transmits and stores memory information acquired on a mobile terminal to a server via an on-board device, but an on-board device with a function to integrate memory information must be installed in the vehicle.

[0006] The technology disclosed here has been developed in consideration of these points, and its purpose is to centrally manage video data captured by an onboard camera and video data captured by an information terminal owned by the vehicle user without installing any data integration equipment inside the vehicle. [Means for solving the problem]

[0007] In order to solve the above problem, the technology disclosed herein is directed to a driving video data recording system that records video data while a vehicle is driving, and is equipped with a content management server, wherein the content management server is equipped with a first communication unit that separately receives positioning data acquired by a positioning system installed in the vehicle and first video data captured by a first camera installed in the vehicle and linked to the positioning data, a second communication unit that communicates with an information terminal held by a user of the vehicle and receives second video data captured by a second camera of the information terminal from the information terminal, and a content management unit that has storage and integrates the first video data received by the first communication unit and the second video data received by the second communication unit and stores them in the storage.

[0008] According to the above aspect, the first video data captured by the first camera installed in the vehicle and the second video data captured by the information terminal carried by the vehicle user are integrated and stored in the storage, thereby enabling the video data captured by the camera installed in the vehicle and the video data captured by the information terminal carried by the user to be managed in a unified manner. [Effects of the Invention]

[0009] The technology disclosed herein makes it possible to centrally manage video data captured by a camera installed in a vehicle and video data captured by an information terminal owned by the vehicle user. [Brief explanation of the drawings]

[0010] [Figure 1] A conceptual diagram showing a typical configuration example of a driving video data recording system [Figure 2] Block diagram showing an example of the configuration of a content management server [Figure 3] Diagram explaining data stored in storage [Figure 4] A diagram showing an example of content information [Figure 5] A block diagram showing an example of the configuration of a drive recorder and an in-vehicle system. [Figure 6] Block diagram showing an example of the configuration of a device management server [Figure 7] Conceptual diagram showing an example of a network configuration [Figure 8] Flowchart showing an example of the operation of the driving video data recording system [Figure 9] 10 is a flowchart showing an example of a process for acquiring and saving video data; [Figure 10] Flowchart showing additional event determination processing and message transmission processing [Figure 11] Flowchart showing the operation of transmitting video data from an information terminal to a content management server [Figure 12] A conceptual diagram showing another example of the configuration of a driving video data recording system. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, exemplary embodiments will be described in detail with reference to the drawings. In the drawings, identical or corresponding parts will be designated by the same reference numerals, and repeated explanations may be omitted. In the following embodiments, the description will focus on configurations that are highly relevant to the contents of the present disclosure.

[0012] The following embodiments are illustrative, and the contents of the present disclosure are not limited by the presence or absence of descriptions or exemplified numerical values. Furthermore, the components constituting the systems, servers, etc. described in this specification, and the functions realized by the components such as functional blocks and modules described in this specification, may be implemented in circuitry or processing circuitry, including general-purpose processors such as CPUs (Central Processing Units) and GPUs (Graphics Processing Units), application-specific processors, integrated circuits, ASICs (Application Specific Integrated Circuits), conventional circuits, and / or combinations thereof, programmed to realize the described functions. Processors include transistors and other circuits and are considered to be circuitry or processing circuitry. Processors may be configured to execute programs stored in memory. Memory includes, for example, volatile memory such as RAM, and non-volatile semiconductor memory such as ROM and flash memory.

[0013] 1 is a diagram showing an example of the configuration of a driving video data recording system M according to a first embodiment. The driving video data recording system M includes a content management server 1 that records video data of a vehicle Q (e.g., an automobile) while it is driving. As mentioned above, the functions of the content management server 1 described below can be implemented in a processor, integrated circuit, conventional circuit, circuitry, or processing circuitry that is stored in a memory or the like and executes computer-readable instructions (e.g., a program) to perform predetermined processing steps to perform a specific function.

[0014] <Content management server> Fig. 2 is a diagram showing an example of the configuration of the content management server 1. As shown in Fig. 1 and Fig. 2, the content management server 1 includes a device gateway 2, a content manager (Contents Manager) 3, a BFF (Backend for frontend) 4, a messaging basis 11, and a function group 14. The content management server 1 is a cloud-based server that receives and manages event notifications or content data Dc from vehicles Q (Q1, Q2, Q3, ...).

[0015] The content management server 1 may be configured to automatically link predetermined data using, for example, technology such as API linkage or SFTP linkage. Although a detailed description is omitted because it is not the subject of the disclosed technology, the content management server 1 is configured with hardware such as a processor, memory, and storage, and software such as control programs and data implemented in the memory. Each function of the content management server 1, which will be described later, is realized by a processor such as a CPU or GPU executing a program stored in the memory. The content management server 1 is not limited to a cloud server, and an on-premise server may also be used.

[0016] The configuration of the content management server 1 will be described below.

[0017] <Device Gateway> As shown in FIG. 2, the device gateway 2 includes a communication interface 21, an event determination unit 22, and a transmission unit .

[0018] [Communication Interface] The communication interface 21 is a circuit or device connected to a network such as the Internet and used for communicating with other computers, servers, information terminals, etc. The communication interface 21 is an example of a "first communication unit" that separately receives positioning data Dp acquired by a positioning system 65 (see FIG. 5) installed in the vehicle Q and video data Dv1 captured by a camera 61 (see FIG. 5) installed in the vehicle Q and linked to the positioning data Dp. The video data Dv1 is an example of "first video data." The positioning system and camera installed in the vehicle Q will be described later together with other components of the vehicle Q.

[0019] The communication interface 21 is connected to the Internet N (see FIG. 7) and communicates with a device management server 5 (described later) via the Internet N. The event notification is a notification of an event sent from the device management server 5 to the content data Dc, and includes, for example, a notification that the content data Dc (including the video data Dv1 and the positioning data Dp) has been acquired.

[0020] The content management server 1 is data-linked with the device management server 5. Specifically, when content data Dc is transmitted from a specific vehicle Q to the device management server 5, the device management server 5 transmits the content data Dc (including positioning data Dp and video data Dv1) of that vehicle Q to the content management server 1 via the communication interface 21. The content management server 1 receives the positioning data Dp and the video data Dv1 separately as separate files.

[0021] The data included in the content data Dc will be specifically described below.

[0022] -Positioning data- The positioning data Dp is positioning information of the vehicle Q at a predetermined time, and includes, for example, some or all of the following: the date the positioning information was acquired (data acquisition date), the time the positioning information was acquired (data acquisition time), the position information of the vehicle Q (for example, latitude and longitude), the traveling direction information of the vehicle Q, information on the direction and orientation, the moving speed of the vehicle Q, and an identification ID. The positioning data Dp is transmitted, for example, from the device management server 5 to the content management server 1 as a file separate from the video data Dv1. The file format of the positioning data Dp is not particularly limited, but may be, for example, a text file conforming to the NMEA format.

[0023] -Video data- As described above, the video data Dv1 is data of video captured by a camera (hereinafter referred to as an "on-board camera") installed in the vehicle Q. In the driving video data recording system M, the video data Dv1 to be recorded is not particularly limited. The video data Dv1 includes still images and videos (including those captured in a time-lapse manner). The video data Dv1 may also include audio. For example, the video data Dv1 includes "video data captured by an on-board camera while the vehicle is traveling and capturing a predetermined range outside the vehicle (e.g., a predetermined range in the direction of travel of the vehicle) that is linked to positioning data," "video data of the outside of the vehicle or the inside of the vehicle captured based on input received directly or indirectly from the driver and / or passengers," "video data of the outside of the vehicle or the inside of the vehicle that is automatically captured when a specific location or condition is observed by a sensor or the like," and "time-lapse video data of the outside of the vehicle captured semi-automatically and continuously." Examples of the specific state include "a state in which the atmosphere inside the vehicle is lively" and "a state in which scenery, buildings, etc. of a tourist spot are included in the camera frame." Hereinafter, for convenience of explanation, when no particular distinction is made between the driver and the passengers, the driver and passengers may be collectively referred to as "user U of vehicle Q" or simply "user U." The positioning data Dp linked to the video data Dv1 only needs to be related to each other; for example, the positioning data Dp at the time the video data Dv1 was captured can be said to be the positioning data Dp linked to the video data Dv1.

[0024] The cameras that capture the video data Dv1 include a camera (hereinafter referred to as an "exterior camera") that is installed in the vehicle Q and captures a predetermined range outside the vehicle (hereinafter simply referred to as "outside the vehicle"), and a camera (hereinafter referred to as an "interior camera") that is installed in the vehicle Q and captures a predetermined range inside the vehicle cabin. For example, examples of cameras that are installed in the vehicle Q include an "exterior camera that captures the front or rear of the vehicle for use as a drive recorder," an "exterior camera that captures the outside of the vehicle for automatic vehicle control such as ADAS," an "interior camera that captures the driver to check the driver's condition or to provide driving assistance," and an "interior camera that captures the interior of the vehicle to capture the atmosphere and state inside the vehicle." The "camera installed in the drive recorder" may be, for example, a "camera installed in a dedicated device for the drive recorder" or a "camera installed in an information terminal owned by a user U when an application functioning as a drive recorder is installed in the information terminal and operated in the vehicle."

[0025] -Other content data- The content data Dc may include data other than the video data Dv1 and the positioning data Dp. For example, the content data Dc may include "audio data acquired by a microphone placed in the passenger compartment of a vehicle" or "files or data in a specific format created by a specific application."

[0026] [Event Judgment Department] The event determination unit 22 determines events occurring inside the vehicle based on the content data Dc. The events determined by the event determination unit 22 include drive events related to the drive, such as vehicle location information and the journey (from the start of the drive to arriving at the destination), and in-vehicle events related to events that occur inside the vehicle during the drive. Here, a "drive" refers to a journey from a predetermined first point to a predetermined second point. For example, it may be a journey from a departure point (corresponding to the first point) to a destination point (corresponding to the second point) on a certain trip, or a journey from the departure point (corresponding to the first point) via one or more destination points to a final destination or a journey back to the departure point (corresponding to the second point).

[0027] For example, the event determination unit 22 determines that an event "drive of the vehicle Q" has occurred when, after a predetermined period of time has elapsed without receiving positioning data Dp via the communication interface 21, reception of the positioning data Dp begins again. Furthermore, for example, when a state where positioning data is received changes to a state where no positioning data is received, and a predetermined time has elapsed since the state where no positioning data is received, the event determination unit 22 determines that an event "drive of the vehicle Q has ended" has occurred. The "predetermined period" for determining the occurrence of the drive start and drive end events is not particularly limited. The "predetermined period" may be set in advance, or may be configured to be externally configurable and changeable. Furthermore, the event determination unit 22 may be configured to receive input from the user U via the Internet N, allowing the user U to set or change the "predetermined period."

[0028] [Transmitter] The transmitter 23 transmits part or all of the content data Dc received via the communication interface 21 to the content management unit 3. In this example, video data Dv1 is transmitted from the transmitter 23 to the content management unit 3 as the content data Dc. As will be explained in detail later, the video data Dv1 transmitted from the transmitter 23 to the content management unit 3 is stored in the storage 33. At this time, a content ID is assigned as an identifier to each piece of content data Dc (including the video data Dv1). The content ID may be any ID as long as it can identify the content data Dc (including the video data Dv1), and its specific form is not particularly limited.

[0029] The transmitter 23 transmits topic information Dm, which is a key for transmitting and receiving messages, to the event hub 12 of the messaging infrastructure 11. The topic information Dm includes, for example, “positioning data Dp,” “simple location information acquired from the positioning data Dp,” “content ID of the video data Dv1 and / or the video data Dv2 described later,” “storage information indicating that the video data Dv1 and / or the video data Dv2 assigned with the content ID have been stored in the storage 33 of the content management unit 3,” “event information determined by the event determination unit 22,” “status notification of the device management server 5,” and “user usage association information.” The event information determined by the event determination unit 22 is transmitted, for example, embedded in the header of the message router 13. Note that, when drive start and drive end events are received from the outside via the communication interface 21, the transmitter 23 may transmit the received event information to the event hub 12 as the above-mentioned topic information. The topic information Dm is used by the message router 13 described later to determine to which application module (hereinafter simply referred to as "application module" (written as "function" in the drawings)) related to which function or service a message should be sent.

[0030] <Messaging infrastructure> The messaging infrastructure 11 includes an event hub 12 and a message router 13. The messaging infrastructure 11 is provided in correspondence with the functions provided as a function group 14, and is used by application modules 15 for realizing each function. The messaging infrastructure 11 is a messaging system used for exchanging messages between application modules 15 included in the function group 14.

[0031] Specifically, the event hub 12 acquires the topic information Dm from the sending unit 23. As described above, the topic information Dm includes the "positioning data Dp," the "content ID of the video data Dv1 and / or video data Dv2," and "information on the event determined by the event determining unit 22." The topic information Dm acquired by the event hub 12 is passed to the message router 13. The message router 13 determines to which application module 15 the topic information Dm should be sent, and passes it back to the event hub 12. The event hub 12 passes a message including each topic information Dm to the target application module 15 according to the determination of the message router 13. The event hub 12 is an example of a routing module.

[0032] <Content Management Department> The content management unit 3 includes a communication interface 31, a content processing unit 32, and a storage 33. The content management unit 3 integrates the video data Dv1 received via the communication interface 31 and the video data Dv2 received via the communication interface 31 and stores the integrated data in the storage 33. This allows the video data Dv1 and Dv2 to be centrally managed by the content management unit 3. In the following description, the video data Dv1 and the video data Dv2 may be collectively referred to as the video data Dv. In other words, the video data Dv includes at least one of the video data Dv1 and Dv2.

[0033] In the above-mentioned centralized management, the content management unit 3 manages "content files" and "content information" separately. Here, "management" refers to enabling each application module 15 of the functional group 14 and the information terminal 8 to search, refer to, retrieve, etc., "content files" and "content information" based on predetermined conditions. The "content files" and "content information" are mutually related via, for example, a content ID. This configuration allows for centralized management of the video data Dv1 and Dv2. For example, when a mobile application (hereinafter referred to as "mobile app") on the information terminal 8 accesses the content manager to view videos or still images taken while driving, the search becomes easier, and the search speed and accuracy can be improved.

[0034] Here, a "content file" is a file of content data included in the video data Dv1 and Dv2. "Content information" includes information related to the content and information attached to the video data Dv1 and Dv2. As a specific example, the video files (which may also include audio) of the video data Dv1 and Dv2 correspond to "content files." "Content information" may include, for example, the file size, horizontal and vertical dimensions, resolution, and video length of the video data Dv1 and Dv2, the shooting or creation time of the video data Dv1 and Dv2, location information at which the video was shot, the direction and orientation at which the video was shot, the shooting location (including the unique name of the shooting facility, etc.), a content ID, and a path indicating where the content file is saved.

[0035] The components of the content management unit 3 will be specifically described below.

[0036] The communication interface 31 is a circuit or device connected to a network such as the Internet and used to communicate with other computers, servers, information terminals, etc. In the example of FIG. 1, the communication interface 31 is connected to the Internet N (see FIG. 7) and communicates with an information terminal 8 (see FIG. 7) via the Internet N. The communication interface 31 also communicates with a communication interface 21 of a device gateway 2 within the content management server 1. The communication interface 31 is an example of a second communication unit that communicates with an information terminal 8 held by a user of the vehicle Q and receives video data Dv2 captured by a camera 81 (see FIG. 7) of the information terminal 8 from the information terminal 8. Although detailed description thereof is omitted because it is not related to the subject matter of the disclosed technology, the information terminal 8 is, for example, an information terminal such as a smartphone or tablet, and has a function of capturing still images or videos using the built-in camera 81. The information terminal 8 also includes a communication interface 82 (see FIG. 7) that communicates with other authenticated computers and servers via the Internet N.

[0037] The storage 33 is a recording medium intended for long-term storage of digital data, and examples thereof include a magnetic recording medium such as a hard disk drive (HDD), a semiconductor recording medium such as a solid state drive (SDD), and an optical recording medium such as a DVD. As described above, the storage 33 stores "content files" and "content information" so that they are managed separately. The storage 33 includes, for example, a first area 33a in which "content information" is stored and a second area 33b in which "content files" are stored. The storage 33 may be a distributed storage, i.e., data to be stored may be distributed and stored. FIG. 3 shows an example of data stored in the first area 33a and the second area 33b of the storage 33, and FIG. 4 shows an example of content information. In this embodiment, the content information is stored in a table format, but the storage format is not particularly limited and may be another format, such as a tree format.

[0038] In this embodiment, an example will be described in which video data Dv of a first drive D1 and a second drive D2 is stored in storage 33. The video data Dv of first drive D1 includes video data 11 to 15, and the video data Dv of second drive D2 includes video data 21 to 25. In the examples of FIGS. 3 and 4, video data 11, 12, 15, 21, 23, and 25 are time-lapse videos captured at predetermined intervals by camera 61 (exterior camera) of drive recorder 6 during normal driving of vehicle Q, and are examples of video data Dv1 and examples of normal driving video data. Video data 13 and 24 are still images or videos captured by camera 61 (interior camera or exterior camera) of drive recorder 6 during drives D1 and D2 of vehicle Q, and are examples of video data Dv1 and examples of event video data. The video data 14, 22 are still images or videos captured by the camera 81 of the information terminal 8 during drives D1, D2 of the vehicle Q, and are examples of video data Dv2 and examples of event video data. The normal driving video data is video data captured at predetermined intervals during normal driving of the vehicle Q. Furthermore, the event video data is different from the normal driving video data and is video data captured based on a predetermined input.

[0039] The content processing unit 32 assigns a content ID to the video data Dv1 received from the device gateway 2 and stores the content ID in the first area 33a of the storage 33. The assigned content ID is sent to the messaging infrastructure 11 as topic information Dm via the device gateway 2. The content processing unit 32 also performs a virus check on the video data Dv1 to confirm the safety of the data. After confirming the safety of the data, the content processing unit 32 performs predetermined processing on the video data Dv1. Specifically, the content processing unit 32 saves a content file of the video data Dv1 in the second area 33b. The content processing unit 32 also executes processing to acquire content information about the video data Dv1 and saves the acquired information in the first area 33a of the storage 33 in association with the corresponding content ID.

[0040] Specifically, for the video data "No. 11" (hereinafter referred to as video data 11) captured by the drive recorder 6 in FIG. 4, the content processing unit 32 assigns "C1" as a content ID to the video data 11 and registers it in a content information table (hereinafter simply referred to as the "table"). After virus checking the video data 11, the content processing unit 32 executes a process to acquire the size Q1 and frame rate F1 of the video data 11 as content information for the video data 11, and registers the acquired information in the table in association with the content ID "C1" for the video data 11. Although not shown in FIG. 4, if other content information (drive ID, creation time, shooting location, etc.) is attached to the video data 11 as metadata, this information may be acquired and registered as content information. Video data 12, 13, 15, 21, 23 to 25 (video data Dv1) are also processed by the content processing unit 32 in the same manner as the video data 11.

[0041] The content processing unit 32 assigns a content ID to the video data Dv2 received from the information terminal 8 and stores the content ID in the first area 33a of the storage 33. The assigned content ID is transmitted to the messaging infrastructure 11 as topic information Dm via the device gateway 2. The content processing unit 32 also performs a virus check on the video data Dv2 to confirm the safety of the data. After confirming the safety of the data, the content processing unit 32 performs predetermined processing on the video data Dv2. Specifically, the content processing unit 32 stores a content file of the video data Dv2 in the second area 33b. The content processing unit 32 also executes processing to acquire content information of the video data Dv2 from the second video data Dv2 or metadata of the second video data Dv2, and stores the acquired content information in the first area 33a of the storage 33 in association with the corresponding content ID.

[0042] Specifically, for video data "No. 14" (hereinafter referred to as video data 14) shot by information terminal 8 in FIG. 4, content processing unit 32 assigns a content ID of "C4" and registers it in the table. After virus checking video data 14, content processing unit 32 executes a process of acquiring, as content information of video data 14, drive ID "D1" that is an identifier of drive D1, creation time T4 of video data 11, shooting location P4, size Q4, frame rate F4, and playback time R4, and registers the acquired information in the table in association with "C4," the content ID of video data 14. The drive ID of video data Dv2 is transmitted, for example, from information terminal 8 to content management unit 3 together with video data Dv2. Video data 22 (video data Dv2) is also processed by content processing unit 32 in the same manner as video data 14.

[0043] When event video data is received as the first video data Dv1, the content processing unit 32 may generate accompanying video data associated with the event video data and store the event video data and content files of the accompanying video data in the second area 33b of the storage 33. The accompanying video data is not particularly limited, but may be, for example, a thumbnail of the event video data. The path of the accompanying video data is stored in the first area 33a of the storage 33 as content information of the original event video data. The examples of FIGS. 3 and 4 show an example in which two thumbnails (video data 131 and 132) are generated for video data 13 of "No. 13," which is event video data. The video data 131 and 132 are, for example, thumbnails of different sizes. In the example of FIG. 4, thumbnails are generated for video data 13, 22, and 24, which are event video data.

[0044] <Function group> The function group 14 includes an application module 15 for realizing various functions and services (hereinafter collectively referred to as "functions"). The application module 15 includes a memory for storing application programs for realizing the various functions and services, a processor for executing the application programs, etc., and various functions are realized by executing the application programs. Examples of functions realized by the function group 14 include, for example, a "user information management function," a "drive log management function," a "video data management function," and a "memory movie (equivalent to a short movie) creation and editing function."

[0045] As described above, each application module 15 obtains topic information Dm required to realize each function from the event hub 12. Various processing requests based on messages may be sent from the event hub 12 to the target application module 15. Examples of processing requests include, for example, "a request to create a new record made to the drive log management function when a drive start event occurs," and "an instruction to retrieve the drive end point from the storage 33 made to the drive log management function when a drive end event occurs."

[0046] <BFF(Backend for frontend)> 2, the BFF 4 includes a communication interface 41 and a command processing unit 42. The BFF 4 functions as a data exchange window with a mobile app implemented in the information terminal 8. Specifically, the communication interface 41 receives and processes commands from the mobile app implemented in the information terminal 8 of the user U.

[0047] The communication interface 41 is a circuit or device connected to a network such as the Internet and for communicating with other computers, servers, information terminals, etc. In the example of FIG. 1, the communication interface 41 is connected to the Internet N (see FIG. 7) and communicates with the information terminal 8 via the Internet N. The communication interface 41 also communicates with the communication interface 31 of the content management unit 3 within the content management server 1. Note that while FIG. 1 shows an example in which the video data Dv2 is directly transmitted from the information terminal 8 to the content management unit 3, the video data Dv2 may also be transmitted from the information terminal 8 to the content management unit 3 via the BFF 4.

[0048] The command processing unit 42 executes processing corresponding to commands from the mobile app of the information terminal 8. For example, BFF4 receives commands such as a "request to view drive logs and videos / still images," a "request to create a memory movie," and an "instruction to edit the drive log" from the mobile app of the information terminal 8, and the command processing unit 42 executes processing corresponding to these commands. Specifically, when the command processing unit 42 receives a "request to create a memory movie" from the information terminal 8, it notifies the application module 15 having a "memory movie creation function," receives the created memory movie from the application module 15, and performs processing to send it to the information terminal 8 (mobile app). Furthermore, when the command processing unit 42 receives a command from the information terminal 8 requesting to view drive logs and videos / still images, it retrieves the videos / still images corresponding to the command from the storage 33 and sends them to the information terminal 8.

[0049] <Device management server> 6, the device management server 5 includes a communication interface 51, a content management unit 52, and a storage 53. The device management server 5 acquires content data Dc (including positioning data Dp and video data Dv1) acquired by a drive recorder 6 under management through data linkage. Furthermore, for a drive recorder 6 that is a link target with the content management server 1, the device management server 5 performs data linkage between the content management server 1 and the content data Dc acquired from the drive recorder 6.

[0050] The communication interface 51 is a circuit or device connected to a network such as the Internet and used to communicate with other computers, servers, information terminals, etc. In the example of Fig. 1, the communication interface 51 is connected to the Internet N (see Fig. 7) and communicates with the content management server 1 and the drive recorder 6 via the Internet N. Data linkage with the drive recorder 6 and data linkage with the content management server 1 is performed via the communication interface 51.

[0051] The content management unit 52 manages the content data Dc in the storage 53. Specifically, the content management unit 52 stores the content data Dc received from the drive recorders 6 to be managed in the storage 53. FIG. 5 shows an example in which the content data Dc is received from each of the vehicles Q (Q1, Q2, Q3, . . . ) and stored in memory areas 53a, 53b, and 53c of the storage 53. The content management unit 52 also performs a process of retrieving the content data Dc to be transmitted from the storage 53 and transmitting it to the content management server 1 via the communication interface 51.

[0052] <Vehicle> Next, the configuration of the vehicle Q will be described with reference to Fig. 5. The vehicle Q in this example is equipped with a general in-vehicle system 7, and a drive recorder 6 is installed by a user U as a retrofit.

[0053] <Drive recorder> The drive recorder 6 is a device that acquires driving log data of the vehicle Q and includes a camera 61, an input unit 62, an output unit 63, a communication interface 64, a positioning system 65, and a storage unit 66. The drive recorder 6 acquires positioning data Dp using the positioning system and captures a predetermined range using the camera at a predetermined time (every predetermined period), and transmits the acquired positioning data Dp and the captured video data Dv1 to the device management server 5. The drive recorder 6 may be in the form of a drive recorder device dedicated to acquiring driving log data, or may be in the form of an information terminal such as a smartphone that has a mobile app for acquiring driving logs installed and is used as a drive recorder. The form in which an information terminal is used will be described later with reference to FIG. 12.

[0054] The camera 61 includes a front camera that captures an image of a predetermined range in front of the vehicle when a housing (not shown) of the drive recorder 6 is installed in a predetermined position on the vehicle (installed state). Note that the camera 61 may also include a rear camera that captures an image of a predetermined range behind the vehicle when the drive recorder 6 is installed, or may include an interior camera that captures an image of the interior of the vehicle Q to obtain interior video data. The video data Dv1 captured by the camera 61 is linked to the positioning data Dp acquired by the positioning system 65 and stored in the memory unit 66.

[0055] The input unit 62 accepts various inputs. Specifically, the input unit 62 includes, for example, a microphone that captures voices in the vehicle cabin and an operation accepting unit that accepts input operations from the user U. Examples of the operation accepting unit include a push button switch and a touch sensor touch panel. Note that the input operations from the user U may be accepted by voice recognition via the microphone. That is, the microphone may also serve as the operation accepting unit. In addition, in the present disclosure, the microphone arranged in the vehicle cabin may be a "microphone that is installed as standard in the vehicle as the in-vehicle system 7," a "microphone of an add-on device such as a drive recorder 6 that is added to the vehicle Q," or a "microphone provided on an information terminal 8 that the user U brings into the vehicle cabin when driving."

[0056] The output unit 63 is used to output various types of information. Specifically, examples of the output unit 63 include a display panel that displays output information on a display screen, a speaker that outputs audio information, and a liquid crystal display that presents information by turning on and off.

[0057] The communication interface 64 is a circuit connected to the Internet N (see FIG. 7) and communicates with the device management server 5 via the Internet N. The drive recorder 6 does not communicate with a communication interface of the in-vehicle system 7, which will be described later. In this example, the communication interface 64 does not communicate with the communication interfaces 21, 31, and 41 of the content management server 1.

[0058] The positioning system 65 can use a conventionally known configuration (for example, GPS), receives radio waves from an artificial satellite, and acquires positioning data Dp based on the radio waves from the artificial satellite. As described above, the positioning data Dp is linked to the video data Dv1 captured by the camera 61 from the drive recorder, and is stored in the storage unit 66.

[0059] The storage unit 66 is configured by, for example, a volatile memory such as RAM, or a non-volatile memory such as ROM or flash memory. A program for operating the drive recorder 6 is stored in the storage unit 66. The storage unit 66 also temporarily stores positioning data Dp acquired by the positioning system 65 and video data Dv1 captured by the camera 61. The positioning data Dp acquired by the positioning system 65 and the video data Dv1 captured by the camera 61 are data-linked with the device management server 5 via the communication interface 64.

[0060] <In-vehicle systems> The following briefly describes the parts of the in-vehicle system 7 that are relevant to the subject matter of the disclosed technology, and omits a description of the configuration that is less relevant to the subject matter of the disclosed technology. In this example, the in-vehicle system 7 includes an input unit 71, an output unit 72, a communication interface 73, a group of sensors 74, a group of controllers 75, a group of actuators 76, and a memory unit 77.

[0061] The input unit 71 accepts various inputs. Specifically, the input unit 71 includes, for example, a microphone that acquires audio from within the vehicle cabin, and an operation accepting unit that accepts input operations from the user U. Examples of the operation accepting unit include a push button switch and a touch sensor touch panel. Note that the input operations from the user U may be accepted by voice recognition via the microphone. In other words, the microphone may also serve as the operation accepting unit.

[0062] The output unit 72 is used to output various types of information. Specifically, examples of the output unit 72 include a display panel that displays output information on a display screen, a speaker that outputs audio information, and a liquid crystal display that presents information by turning on and off.

[0063] The communication interface 73 is a circuit or device connected to the Internet N (see FIG. 7) and used to communicate with other computers, servers, information terminals, etc. In the example of FIG. 1, the communication interface 73 does not communicate with any of the device management server 5, the drive recorder 6, and the content management server 1.

[0064] The sensor group 74 includes a camera 741 arranged in the vehicle and a positioning system 742 used for autonomous driving, driving assistance, or the like. The camera 741 includes an exterior camera that captures a predetermined range outside the vehicle, and an interior camera that captures the interior of the vehicle. Although not shown, the exterior camera is, for example, made up of multiple cameras, and is arranged so that when the capture ranges of each camera are combined, a 360-degree range around the vehicle can be captured.

[0065] The controller group 75 is made up of various controllers that control the in-vehicle systems. The controller group 75 is made up of, for example, ECUs (Electronic Control Units) arranged in various locations on the vehicle Q, and controls the actuator group 76 based on inputs from the input unit 71 and the sensor group 74. The controller group 75 may also include an ADAS (Advanced driver-assistance systems) 751 that assists in driving the vehicle Q. The actuator group 76 includes driving system actuators related to the driving of the vehicle Q, braking system actuators related to braking of the vehicle Q, and steering system actuators related to steering of the vehicle Q.

[0066] The storage unit 77 includes, for example, a memory and a storage. The memory includes, for example, a volatile memory such as a RAM, and a non-volatile memory such as a ROM or a flash memory. The storage includes, for example, a magnetic recording medium such as a hard disk drive (HDD), a semiconductor recording medium such as a solid state drive (SDD), and an optical recording medium such as a DVD. The storage unit 77 temporarily stores positioning data Dp acquired by the positioning system 742 and video data Dv1 captured by the camera 741.

[0067] <Operation of driving video data recording system> Next, a series of operational flows from the start of driving to the end of driving in the driving video data recording system M will be described with reference to the flowcharts of Figures 8 to 10. Figures 8 to 10 describe the operations and processing in the content management server 1.

[0068] When the power of the vehicle Q is turned on, power is supplied to the drive recorder 6, and the drive recorder 6 starts operating. Specifically, the drive recorder 6 starts capturing images with the camera 61 and acquiring positioning data Dp with the positioning system 65. The drive recorder 6 exchanges content data Dc including video data Dv1 captured by the camera 61 and positioning data Dp acquired by the positioning system 65 with the device management server 5.

[0069] When the device management server 5 receives content data Dc (including video data Dv1 and positioning data Dp) from a drive recorder 6 that is the subject of data exchange with the content management server 1, it sends an event notification to the content management server 1.

[0070] In step S1 of Fig. 8, when the device gateway 2 receives an event notification from the device management server 5, it determines whether the event notification indicates the acquisition of video data Dv1 (S2). The device gateway 2 also executes an additional event determination process and a message transmission process (S4). Note that, in the example of Fig. 8, an example is described in which the process of step S2 and the process of step S4 are executed in parallel, but step S2 and step S4 may also be executed in series. For example, step S4 may be executed after the process of step S2, or step S2 may be executed after the process of step S4.

[0071] [Video data acquisition and storage processing] In step S2, if the event notification is a notification regarding acquisition of the video data Dv1 (YES in S2), the content management server 1 executes acquisition processing and storage processing of the video data Dv1 in step S3. In the flow diagram, the process proceeds to step S12 in FIG.

[0072] FIG. 9 is a flowchart showing an example of the process of acquiring and saving video data.

[0073] In step S12, the device gateway 2 requests the device management server 5 to acquire the video data Dv1. The device management server 5 then transmits the video data Dv1 to the device gateway 2, and the device gateway 2 receives the video data Dv1 (S13). At this time, the positioning data Dp and the video data Dv1 associated with the positioning data Dp are received separately. The associated positioning data Dp and the video data Dv1 do not need to be received at the same time; they may be received at different times. The video data Dv1 received by the device gateway 2 is transmitted to the content management unit 3, and the positioning data Dp is transmitted as topic information Dm to the event hub 12.

[0074] In step S14, the content management unit 3 determines whether the received video data Dv1 is normal driving video (e.g., time lapse video) taken during normal vehicle driving, or event video taken based on a specified input at a timing different from the normal driving video.

[0075] -For normal driving video data- In step S14, if the video data Dv1 is normal driving video data, the flow proceeds to step S15.

[0076] In step S15, the content management unit 3 assigns a content ID to the video data Dv1 and transmits the content ID to the device gateway 2. The content ID of the video data Dv1 received by the device gateway 2 is transmitted to the event hub 12 as topic information Dm. The content management unit 3 also performs a virus check on the video data Dv1 to confirm the safety of the data. Once the safety of the data is confirmed, the video data Dv1 is stored in the second area 33b of the storage 33. The content management unit 3 also executes a process to acquire content information. The acquired content information is associated with the content ID created earlier and stored in the first area 33a of the storage 33. A specific example of content information is shown in FIG. 4 and has already been described. The flow then proceeds to step S5 in FIG. 8.

[0077] -For event video data- In step S14 of FIG. 9, if the video data Dv1 is event video data, the flow proceeds to step S16. In step S16, the same process as in step S15 is executed. In the next step S17, the content management unit 3 creates additional content based on the video data Dv1. The additional content is not particularly limited, but may be, for example, a thumbnail of the video data Dv1. The path of the additional content is stored in the first area 33a of the storage 33, and the video data of the additional content is stored in the second area 33b of the storage 33. Note that the processes of step S16 and step S17 may be executed in parallel. Thereafter, the flow proceeds to step S5 of FIG. 8.

[0078] In step S5 of Fig. 8, the device gateway 2 determines whether the state in which no event notification has been received (hereinafter referred to as the "no-reception state") has exceeded a predetermined drive end determination period for determining the end of the vehicle drive. If the duration of the state in which no event notification has been received is equal to or shorter than the drive end determination period (NO in S5), the processes in steps S1 to S5 described above are repeated. On the other hand, if the duration of the state in which no event notification has been received exceeds the drive end determination period (NO in S5), it is determined that the drive has ended, and in step S6, processing associated with the drive end determination is performed.

[0079] [Additional event determination processing and message transmission processing] Next, the process of determining whether an additional event has occurred and the process of sending a message in step S4 of Fig. 8 will be described. As described above, when an event notification is received (S1), the device gateway 2 executes the process of determining whether an additional event has occurred and the process of sending a message (S4). Fig. 10 is a flowchart showing the process of determining whether an additional event has occurred and the process of sending a message.

[0080] 10, the device gateway 2 determines whether or not there is an additional event. Here, an additional event refers to an additional event that is different from the event notification related to the normal acquisition of a driving log received from the device gateway 2. For example, when the device gateway 2 receives the first event notification after the start of driving the vehicle Q, the device gateway 2 determines that there is an additional event of "start of driving" described above.

[0081] If it is determined that there is an additional event, the flow proceeds from step S43 to step S44, and the device gateway 2 transmits a notification of the normal driving event and a notification of the additional event to the event hub 12 as topic information Dm. That is, the device gateway 2 transmits a notification of the event information to the event hub 12. The topic information Dm of the normal driving event may indicate, for example, "that photos and videos have been received from the drive record as normal driving log data," "that a specific content ID has been assigned to the content manager and saved," or "that positioning information has been received." Furthermore, the topic information Dm of the additional event may indicate, for example, "that the normal driving log data (photos and videos) is data indicating the start of a drive." The same applies when it is determined in step S6 of FIG. 8 (described later) that there is an additional event of "end of drive," and the device gateway 2 notifies the event hub 12 of the topic information Dm of the additional event, for example, "that the drive has ended."

[0082] Returning to FIG. 10, in the next step S46, the topic information Dm received by the event hub 12 is passed to the message router 13 via the topic for the input message. The message router 13 then determines to which function each event should be sent, i.e., the application module 15 to which each piece of event information (here, the normal driving event and the additional event) should be sent. Based on the determination of the message router 13, the event hub 12 sends each piece of event information to the application module 15 to which it should be sent. For example, the drive log management function and the memory movie editing function are notified of the additional events "normal driving event," "start of drive," and "end of drive" when they are received, or at a predetermined timing. The flow then proceeds to step S5 in FIG. 8.

[0083] On the other hand, if it is determined in step S42 that there is no additional event, the flow proceeds from step S43 to step S45, where the device gateway 2 transmits topic information Dm of a normal driving event to the event hub 12. For example, the normal driving log data from when the "drive starts" is determined to when the "drive ends" is determined generally corresponds to a state of "no additional event." In this case, the device gateway 2 transmits topic information Dm indicating a "normal driving event" to the event hub 12. A specific example of the topic information Dm of the normal driving event is the same as in step S44 described above. Thereafter, as in the case of "there is an additional event," in the next step S46, the topic information Dm received by the event hub 12 is passed to the message router 13, which determines the application module 15 to which the message is to be sent, and then passes the information back to the event hub 12. Then, based on the determination of the message router 13, the event hub 12 transmits the event information to the application module 15 to which the message is to be sent. For example, the normal driving event is notified to the drive log management function. The flow then proceeds to step S5 in FIG. 8.

[0084] [Transmission processing of video data from information terminal to content management server] 11 is a flowchart showing the operation when video data is transmitted from the information terminal 8 to the content management server 1. Here, the operation when video data Dv2 is transmitted from the information terminal 8 to the content management server 1 between the "start of driving" and the "end of driving" of the vehicle Q will be described.

[0085] In step S81, based on an instruction from a mobile app installed on the information terminal 8, the information terminal 8 transmits the video data Dv2 to the content management unit 3. At this time, the information terminal 8 transmits a notification to the BFF 4 indicating that the video data Dv2 has been transmitted. The video data Dv2 includes, as metadata, some or all of the following: the data acquisition date, the data acquisition time, location information (e.g., latitude and longitude), the vertical and horizontal sizes of the image, and the length of the video (in the case of a video).

[0086] In step S82, upon receiving the video data Dv2, the content management unit 3 assigns a content ID to the video data Dv2. The content processing unit 32 also performs a virus check on the video data Dv2 to confirm the safety of the data. After confirming the safety of the data, the content processing unit 32 performs predetermined processing on the video data Dv2. Specifically, the content processing unit 32 stores a content file of the video data Dv2 in the second area 33b. The content processing unit 32 also executes processing to obtain content information for the video data Dv2, and stores the content information in association with the content ID corresponding to the first area 33a of the storage 33 (step S83). A specific example of the content information is shown in FIG. 4 and has already been described.

[0087] In the next step S84, the content management unit 3 creates additional content based on the video data Dv2. A content file of the created additional content is stored in the second area 33b. The path of the created additional content is stored in the first area 33a of the storage 33 as content information of the original video data Dv2. The content of the additional content is not particularly limited, but may be, for example, a thumbnail of the video data Dv2.

[0088] In the next step S85, the content management unit 3 stores the content information of the video data Dv2 and the video data Dv2 and its thumbnail separately in the storage 33. That is, the content information of the video data Dv2 and the content file are managed separately. For example, the content information is stored in a first area 33a of the storage 33, and the content file of the video data Dv1 and its thumbnail image is stored in a second area 33b of the storage 33 (see FIG. 3).

[0089] 8, if it is determined that the drive has ended, processing associated with the drive end determination is performed in step S6. Specifically, the device gateway 2 notifies the event hub 12 that "the drive has ended" as topic information Dm. Then, for example, the event hub 12 issues an instruction to the application module 15, which has a drive log management function, to retrieve the drive end point from the storage 33, and the application module 15 operates in accordance with this instruction.

[0090] <Other embodiments> As described above, the embodiments have been described as examples of the technology disclosed in this application. However, the technology in this disclosure is not limited to these, and can be applied to embodiments in which appropriate modifications, substitutions, additions, omissions, etc. are made. Furthermore, it is also possible to combine the components described in the above embodiments to create new embodiments.

[0091] For example, instead of the configuration shown in Fig. 1, the driving video data recording system M may be provided with a plurality of interfaces of different types, as shown in Fig. 12. In Fig. 12, the same components as in Fig. 1 are given the same reference numerals, and the following description will focus on the differences from Fig. 1.

[0092] In the traveling video data recording system M of Fig. 12, the device gateway 2 is provided in an anti-corruption layer (ACL) 18 that is external to the content management server 1. The content management server 1 is also provided with a device endpoint 19 instead of the device gateway 2. Furthermore, the traveling video data recording system M includes, as application interfaces 17, a BFF (Backend for frontend) 171 for information terminals and a BFF (Backend for frontend) 172 for web services.

[0093] 12, the configuration and functions of the device gateway 2 are the same as those of the above-described embodiment, and are configured to be able to communicate with the device management server 5 (56 and 57 in FIG. 12). For example, the device gateway 2 receives content data Dc (video data Dv1 and positioning data Dp) through data linkage with the device management servers 56 and 57. Then, the device gateway 2 transmits the video data Dv1 to the content management unit 3 and transmits the topic information Dm to the messaging infrastructure 11.

[0094] The device endpoint 19 has a function as a data exchange window (similar to the function of the BFF 4 described above) with the device management server 58, drive recorder 6 (69 in FIG. 12), or information terminal 8 (P2 in FIG. 12) that is the connection destination, and a function as the device gateway 2 described above. The content management unit 3 has the same configuration and function as those in the above embodiment.

[0095] Three types of vehicles Q4, Q5, and Q6 are illustrated in the example of Fig. 12. Below, an outline of the configuration of the vehicles Q4, Q5, and Q6 and a brief description of the data flow in Fig. 12 will be given.

[0096] In vehicle Q4, an information terminal P1 is installed in vehicle Q and used as a drive recorder 6. In other words, in vehicle Q1, the information terminal P1 functions as a positioning system installed in the vehicle and a first camera installed in the vehicle. The information terminal P1 is connected to a device management server 56 and is data-linked with the device management server 56. That is, content data Dc (video data Dv1 and positioning data Dp) is transmitted from the information terminal P1 to the device management server 56. The device management server 56 and the device gateway 2 are data-linked, and the content data Dc acquired by the information terminal P1 is data-linked between the device management server 56 and the device gateway 2. The subsequent processing is the same as in the above-described embodiment.

[0097] Vehicle Q5 is equipped with a camera C1 of the drive recorder 68 and a camera C2 for the ADAS 751. In other words, in vehicle Q5, the drive recorder 68 and / or the ADAS 751 function as a positioning system disposed in the vehicle, and the camera C1 and / or the camera C2 function as a first camera disposed in vehicle Q. The video data Dv1 captured by the camera C1 is data-linked with the device management server 57, and the video data captured by the camera C2 is data-linked with the device management server 58. That is, the drive recorder 68 transmits content data Dc (video data Dv1 and positioning data Dp) acquired by the drive recorder 68 to the device management server 52. Similarly, the content data Dc (video data Dv1 and positioning data Dp) acquired by the ADAS 751 is transmitted from the in-vehicle system 7 equipped with the ADAS 751 to the device management server 58. The device management server 57 and the device gateway 2 are data-linked, and content data Dc acquired by the drive recorder 68 is transmitted from the device management server 57 to the device gateway 2. Subsequent processing is the same as in the above-described embodiment, and video data Dv1 captured by the camera C1 is stored in the storage 33 of the content management unit 3. The device management server 58 is data-linked with the device endpoint 19 and the content management unit 3. Of the content data Dc transmitted from the in-vehicle system 7 to the device management server 58, the video data Dv1 is transmitted to the content management unit 3, and the positioning data Dp is transmitted to the device endpoint 19. In the content management unit 3, the video data Dv1 received from the device management server 58 is integrated with the video data Dv1 captured by the above-described camera C1 and is then stored in the storage 33.

[0098] A camera C3 of a drive recorder 69 is installed in a vehicle Q6, and a user U of the vehicle Q6 has an information terminal P2. In other words, in the vehicle Q6, the drive recorder 69 functions as a positioning system installed in the vehicle, and the camera C3 functions as a first camera installed in the vehicle Q6. The camera of the information terminal P2 functions as a second camera. The video data Dv1 captured by the camera C3 and the video data Dv2 captured by the camera of the information terminal P2 are data-linked with the content management unit 3. The content management unit 3 integrates the video data Dv1 captured by the camera C3 and the video data Dv2 captured by the information terminal P2 and stores them in the storage 33. The positioning data Dp acquired by the drive recorder 69 is sent to the device endpoint 19 and then transmitted as topic information Dm to the messaging infrastructure 11. The processing of the topic information Dm in the messaging infrastructure 11 is the same as in the above-described embodiment.

[0099] 12, an application interface 17 corresponding to the BFF4 of the above-described embodiment is provided. The application interface 17 includes a BFF 171 having a function as a data exchange window with a mobile application implemented in the information terminal P3, and a BFF 172 having a function as a data exchange window with a web system W of a computer (not shown). Specific processes executed by the BFFs 171 and 172 are similar to those of the above-described BFF4.

[0100] Even when the configuration of FIG. 12 is adopted, the same effects as those of the configuration of FIG. 1 described above can be obtained.

[0101] The functions of the above-described embodiments need only be executed somewhere in the content management server 1, and do not need to be included in the blocks shown in the drawings. For example, the function of the event determination unit 22 may be implemented outside the device gateway 2.

[0102] The vehicle to which the driving video data recording system and driving video data recording method of the present disclosure are applicable is not limited to automobiles, but may be other vehicles such as bicycles, motorbikes, and railcars. Even when the vehicle is a bicycle, motorbike, or railcar, as shown in FIG. 1 or FIG. 12, a drive recorder or information terminal equipped with a positioning system and a camera (corresponding to a first camera) is installed on the bicycle, motorbike, railcar, or other vehicle. The content management server then acquires the positioning data and the first video data from the drive recorder or information terminal. Other configurations and operations are the same as those of the above-described embodiment.

[0103] As a reference embodiment, the technology of the present disclosure can also be applied to an aircraft. When an aircraft is the target, for example, a GPS or flight recorder mounted on the aircraft can be used as the positioning system and camera (corresponding to the first camera). In this case, too, the content management server acquires positioning data and first video data from the GPS or flight recorder. Other configurations and operations are the same as those of the above-described embodiment.

[0104] <Summary of the embodiment> As described above, the driving video data recording system M according to one embodiment of the present disclosure is a system that records video data Dv (Dv1, Dv2) of a vehicle Q while the vehicle Q is driving, and includes a content management server 1. The content management server 1 includes a communication interface 21 (corresponding to a first communication unit), a communication interface 31 (corresponding to a second communication unit), and a content management unit 3. The communication interface 21 separately receives positioning data Dp acquired by a positioning system (65, 742) installed in the vehicle Q and video data Dv1 captured by a camera (61, 741, corresponding to a first camera) installed in the vehicle Q and linked to the positioning data Dp. The communication interface 31 communicates with an information terminal 8 held by a user of the vehicle Q, and receives video data Dv2 (corresponding to second video data) captured by a camera 81 (corresponding to a second camera) of the information terminal 8 from the information terminal. The content management unit 3 has a storage 33, and stores the video data Dv1 received by the communication interface 21 and the video data Dv2 received by the communication interface 31 in an integrated form in the storage 33.

[0105] According to the above embodiment, the video data Dv1 captured by the onboard camera (61, 741) installed in the vehicle Q and the video data Dv2 captured by the information terminal 8 owned by the user are integrated and saved, allowing for centralized management of the video data Dv1 and Dv2. By centralizing the video data Dv1 and Dv2 in this way, for example, the information terminal 8 and the application module 15 that realizes functions such as creating a memorable movie can easily search for, refer to, and retrieve "content files" and "content information" according to their purpose. This allows for improved processing speeds in the application module 15 and the information terminal 8.

[0106] The content management unit 3 may assign a content ID as an identifier to the video data Dv1, acquire content information from the video data Dv1, and store the content ID and content information separately from the video data Dv1 in the storage 33. Similarly, the content management unit 3 may assign a content ID as an identifier to the video data Dv2, acquire content information for the video data Dv2 from the video data Dv2 or the metadata of the video data Dv2, and store the content ID and content information separately from the video data Dv2 in the storage 33. For example, the content ID and content information are stored in a first area 33a of the storage 33, and content files for the video data Dv1 and Dv2 are stored in a second area 33b of the storage 33.

[0107] This makes it easier to search for, refer to, and retrieve "content files" and "content information" even when a large amount of video data Dv is stored in the content management server 1. This improves the response speed to requests from the application module 15 and the information terminal 8, and ultimately improves the processing speed of the application module 15 and the information terminal 8.

[0108] The positioning data Dp received by the communication interface 21 may be transmitted to an application module 15 that realizes a predetermined function, and the content management unit 3 may assign a content ID as an identifier to the video data Dv, and the content ID may be transmitted to the application module 15. For example, the positioning data Dp and the content ID may be transmitted to the application module 15 as topic information Dm.

[0109] In this way, the video data Dv is integrated and stored in the storage 33 and provided to the application module 15 as a content ID, thereby ensuring ease of searching and referencing content and reducing traffic on the content management server 1. In other words, the response speed to requests from the application module 15 and the information terminal 8 is improved, and the processing speed of the content management server 1 is improved.

[0110] Between the communication interface 21 and the application module 15, an event hub 12 (corresponding to a routing module) may be provided for routing the positioning data Dp and the content ID.

[0111] By providing the above-mentioned routing module, even if multiple application modules 15 are installed, the positioning data Dp and content ID can be appropriately distributed, thereby improving the extensibility of the application modules 15 in the function group 14, i.e., the extensibility of the functions that can be realized by the function group 14.

[0112] The content management server 1 may be configured to be able to communicate with the device management server 5, which is the storage destination of the positioning data Dp and the video data Dv1, and to receive the positioning data Dp and the video data Dv1 via the device management server 5. The content management server 1 may also be configured to directly communicate with the drive recorder 6 and receive the positioning data Dp and the video data Dv1 from the drive recorder 6.

[0113] As described above, by providing a plurality of paths for the content management server 1 to receive the video data Dv1, the versatility of the interface of the content management server 1 is improved.

[0114] In one embodiment of the present disclosure, a driving video data recording method involves a content management server having storage receiving separately positioning data Dp acquired by a positioning system (65, 742) installed in vehicle Q and video data Dv1 captured by a camera (61, 741, corresponding to the first camera) installed in vehicle Q and linked to the positioning data Dp, communicating with an information terminal 8 held by a user U of vehicle Q to receive video data Dv2 captured by camera 81 of the information terminal 8, transmitting the positioning data Dp to an application module 15 that realizes a specified function, assigning a content ID as an identifier to the video data Dv (Dv1, Dv2), transmitting the content ID to the application module 15, and integrating and storing the video data Dv in storage 33.

[0115] According to the above embodiment, the video data Dv1 captured by the onboard camera (61, 741) installed in the vehicle Q and the video data Dv2 captured by the information terminal 8 owned by the user are integrated and saved, allowing for centralized management of the video data Dv1 and Dv2. By centrally managing the video data Dv1 and Dv2 in this manner, it becomes easier for the information terminal 8 and the application module 15, which provides functions such as creating memorable movies, to search for, refer to, and retrieve "content files" and "content information" according to their intended purpose. Furthermore, a content ID is assigned as an identifier to the video data Dv (Dv1, Dv2) before it is sent to the application module 15, making it easier to search for, refer to, and retrieve "content files" used for processing in the application module 15, thereby improving processing speed. [Industrial Applicability]

[0116] The technology disclosed herein is useful as a driving video data recording system that records video data while a vehicle is driving. [Explanation of symbols]

[0117] 1 Content Management Server 5 Device Management Server 6. Drive recorder 8 Information terminals 12 Event Hub (Routing Module) 15 Application Modules 21 Communication interface (first communication unit) 22 Event Judgment Department 31 Communication interface (second communication unit) 33 Storage 65 Positioning System 742 Positioning System Dv1 video data (first video data) Dv2 video data (second video data) Dp positioning data

Claims

1. A driving video data recording system that records video data while a vehicle is driving, Equipped with a content management server, The content management server a first communication unit that separately receives positioning data acquired by a positioning system arranged in the vehicle and first video data captured by a first camera arranged in the vehicle and linked to the positioning data; a second communication unit that communicates with an information terminal carried by a user of the vehicle and receives second video data captured by a second camera of the information terminal from the information terminal; A driving video data recording system having a storage and comprising: a content management unit that integrates the first video data received by the first communication unit and the second video data received by the second communication unit and stores the integrated data in the storage.

2. 2. The driving video data recording system according to claim 1, The content management unit assigning a content ID as an identifier to the first video data; acquiring content information of the first video data from the first video data; The content ID and the content information are stored separately from the first video data in the storage.

3. 2. The driving video data recording system according to claim 1, The content management unit assigning a content ID as an identifier to the second video data; acquiring content information of the second video data from the second video data or metadata of the second video data; The content ID and the content information are stored separately from the second video data in the storage.

4. 2. The driving video data recording system according to claim 1, the positioning data received by the first communication unit is transmitted to an application module that realizes a predetermined function; The content management unit assigns a content ID as an identifier to the first video data and the second video data, and the content ID is transmitted to the application module.

5. 5. The driving video data recording system according to claim 4, A driving video data recording system, wherein a routing module that routes the positioning data and the content ID is provided between the first communication unit and the application module.

6. 2. The driving video data recording system according to claim 1, A driving video data recording system, wherein the content management server is configured to be able to communicate with a device management server that stores the positioning data and the first video data, and receives the positioning data and the first video data via the device management server.

7. 2. The driving video data recording system according to claim 1, the first camera is a camera provided in a drive recorder, The content management server communicates directly with the drive recorder and receives the positioning data and the first video data from the drive recorder.

8. A driving video data recording method in which a content management server having a storage records video data of a vehicle while the vehicle is driving, comprising: The content management server receiving, separately, positioning data acquired by a positioning system arranged in the vehicle and first video data captured by a first camera arranged in the vehicle and linked to the positioning data; communicating with an information terminal carried by a user of the vehicle to receive second video data captured by a second camera of the information terminal; transmitting the positioning data to an application module that realizes a predetermined function; assigning a content ID as an identifier to the first video data and the second video data, and transmitting the content ID to the application module; a driving video data recording method for integrating and storing the first video data and the second video data in the storage;

Images