Communication processing system and communication processing method

Abstract

To enable a user to easily request acquisition of video data from a device having a camera mounted on a vehicle.SOLUTION: A communication processing system includes a device mounted on a vehicle and having a camera 21 for acquiring video data, a mobile terminal 4 held by a user of the vehicle, a first server 5 capable of communicating with the device, and a second server 6 capable of communicating with the first server 5 and the mobile terminal 4. When the second server 6 receives a first signal transmitted from the mobile terminal 4 and requesting acquisition of the video data, it outputs a second signal related to the first signal to the first server 5, and the first server 5 outputs a third signal related to the second signal to the device, and when the device receives the third signal from the first server 5, it acquires the video data using the camera 21.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology disclosed herein belongs to the technical field of a communication processing system and a communication processing method. [Background technology]

[0002] Patent Document 1 discloses an in-vehicle device that collects data including images captured by a camera mounted on the vehicle when an impact to the parked vehicle is detected. The in-vehicle device described in Patent Document 1 collects image data at regular intervals and stores each collected data in a storage area. Furthermore, in Patent Document 1, the in-vehicle device is a drive recorder installed inside the vehicle. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2022-124918 Summary of the Invention [Problem to be solved by the invention]

[0004] In Patent Document 1, a device with a camera is used to monitor events that are detrimental to the vehicle user, such as pranks and accidents. In response to this, the inventors of the present application have considered using such a device to obtain video data that is beneficial to the vehicle user, such as memorable images from travels by car or the like.

[0005] For example, in a car, a user can obtain video data at any time by directly pressing a button on the device or using the device's voice recognition function. However, as devices installed in the vehicle are becoming increasingly compact, the buttons are also relatively small. This makes it difficult for the user to operate the buttons while driving due to the shaking caused by the vehicle. Furthermore, even if voice recognition is used, music is often played on the in-car audio system during travel, which can cause the device to fail to recognize the user's instructions.

[0006] Furthermore, in railroad vehicles and airplanes, users are generally unable to operate the equipment equipped with a camera, and therefore are unable to obtain video data at any time desired by the user.

[0007] The technology disclosed here has been developed in consideration of these points, and its purpose is to enable users to easily request the acquisition of video data from equipment equipped with a camera mounted on a vehicle. [Means for solving the problem]

[0008] In order to solve the above-mentioned problems, a first aspect of the technology disclosed herein is directed to a communication processing system for acquiring video data while a vehicle is traveling. The communication processing system includes a device mounted on the vehicle and having a camera for acquiring the video data, an information terminal carried by a user of the vehicle, a first server capable of communicating with the device, and a second server capable of communicating with the first server and the information terminal, wherein the second server receives a first signal transmitted from the information terminal requesting acquisition of the video data and outputs a second signal related to the first signal to the first server, the first server outputs a third signal related to the second signal to the device upon receiving the second signal from the second server, and the device acquires the video data using the camera upon receiving the third signal from the first server.

[0009] According to the first aspect, a user can operate an information terminal to cause a device to acquire video data. Since the information terminal is basically held by the user when used, operating the information terminal is easier than operating buttons on the device. Furthermore, since instructions are issued through communication between the information terminal, the second server, the first server, and the device, it is less affected even if audio equipment or the like is in use. Therefore, the communication processing system allows the user to easily request the device to acquire video data.

[0010] In particular, because the information terminal communicates with the second server, even if the first server is changed, the user can easily request the device to acquire video data. That is, when the device is replaced with the latest one, the first server itself may become a different server from the one before the replacement. Because the information terminal sends the first signal to the second server and does not send the first signal directly to the first server, the user can operate the information terminal in the same way as before the device was replaced, and have the device acquire video data. Therefore, the communication processing system allows the user to easily request the device to acquire video data.

[0011] A second aspect of the technology disclosed herein is that in the first aspect, the first server identifies the information terminal, links the identified information terminal to the device, and when it receives the second signal related to the first signal transmitted from the identified information terminal, outputs the third signal to the device linked to the information terminal.

[0012] According to the second aspect, since it is only necessary to link the information terminals and the devices within the first server, by linking multiple information terminals and devices, it is possible to output a first signal from the multiple information terminals to cause the devices to acquire video data. When there are multiple users, the videos required by each user may differ. The communication processing system according to the second aspect allows each user to easily request the device to acquire the desired video data.

[0013] A third aspect of the technology disclosed herein is the first or second aspect, wherein the second server receives and stores the video data from the first server, edits the stored video data in accordance with instructions from a user via the information terminal, and transmits the edited video data to the information terminal.

[0014] According to the third aspect, for example, when the vehicle is an automobile, drive memory information or the like can be created based on the video data acquired based on the first signal from the information terminal. The communication processing system can effectively utilize the video data acquired by the device.

[0015] A fourth aspect of the technology disclosed herein is any one of the first to third aspects, wherein the device is capable of acquiring a request to acquire the video data from the user by voice recognition without going through the first server and the second server, and when the acquisition request is acquired without going through the first server and the second server, the device acquires the video data by the camera.

[0016] According to the fourth aspect, since the device uses voice recognition, there is a risk that a direct acquisition request from a user may not be recognized due to road noise, music from an audio system, etc. Therefore, the effect of enabling video data to be acquired by operating an information terminal can be more appropriately achieved.

[0017] A fifth aspect of the technology disclosed herein is any one of the first to third aspects, wherein the vehicle is an automobile and the device is a drive recorder.

[0018] According to the fifth aspect, a device that is normally used to monitor events that are detrimental to the user of the vehicle can be used to obtain video data that is beneficial to the user of the vehicle. The communication processing system enables the device to be used effectively for the user.

[0019] A sixth aspect of the technology disclosed herein is directed to a communication processing method for acquiring video data while the vehicle is traveling in a system including a device mounted on a vehicle and having a camera for acquiring video data, an information terminal carried by a user of the vehicle, a first server capable of communicating with the device, and a second server capable of communicating with the first server and the information terminal, the communication processing method including the steps of: outputting a first signal from the information terminal to the second server requesting acquisition of the video data; outputting a second signal related to the first signal from the second server to the first server; outputting a third signal related to the second signal from the first server to the device; and acquiring the video data using the camera of the device that has received the third signal. [Effects of the Invention]

[0020] As described above, according to the technology disclosed herein, a user can easily request a device to acquire video data. [Brief explanation of the drawings]

[0021] [Figure 1] FIG. 1 is a conceptual diagram of a communication processing system according to an exemplary embodiment. [Figure 2] FIG. 2 is a schematic diagram of the drive recorder. [Figure 3] FIG. 3 is a schematic configuration diagram of the first cloud server. [Figure 4] FIG. 4 is a schematic configuration diagram of the second cloud server. [Figure 5] FIG. 5 is a schematic diagram illustrating an example of information stored in the content storage unit. [Figure 6] FIG. 6 is a schematic diagram of a mobile terminal. [Figure 7] FIG. 7 is an example of an image displayed on a mobile terminal. [Figure 8] FIG. 8 is a diagram illustrating an example of a transmission path of video data between the first cloud server, the second cloud server, and the mobile terminal. [Figure 9] FIG. 9 is a flow diagram showing a process in which a mobile terminal of a user other than the driver is associated with a drive recorder in the second cloud server. [Figure 10] FIG. 10 is a flow diagram showing the process of acquiring video data in response to a request from a mobile terminal. DETAILED DESCRIPTION OF THE INVENTION

[0022] Exemplary embodiments will now be described in detail with reference to the drawings.

[0023] The following embodiments are merely illustrative, and the contents of the present disclosure are not limited by the presence or absence of descriptions or exemplified numerical values. Furthermore, the functions realized by the configurations described in this specification may be implemented in circuitry or processing circuitry, including general-purpose processors such as CPUs (Central Processing Units) and GPUs (Graphics Processing Units), application-specific processors, integrated circuits, ASICs (Application Specific Integrated Circuits), conventional circuits, and / or combinations thereof, programmed to realize the described functions. A processor includes transistors and other circuits and is considered to be circuitry or processing circuitry. A processor may be configured to execute a program stored in a memory. In other words, a system / module / device may be realized by a processor that executes computer-readable instructions (e.g., a program) to perform predetermined processing steps to perform specific functions.

[0024] (1) System configuration FIG. 1 is a conceptual diagram showing an example of the overall configuration of a communication processing system M according to the present disclosure. In the communication processing system M shown in FIG. 1, video data obtained while an automobile 1 is traveling is recorded by a drive recorder 2 mounted on the automobile 1. A user 3 of the automobile 1 records the video data using a mobile terminal 4. The user 3 includes the driver who drives the automobile 1 and passengers who ride in the automobile 1. The recorded video data includes videos and still images. The drive recorder 2 is an example of a device.

[0025] The communication processing system M includes two servers: a first server 5 and a second server 6. The first server 5 is a cloud server for the drive recorder 2 and communicates with the drive recorder 2. The drive recorder 2 transmits recorded video data to the first server 5. The second server 6 is a cloud server for an app for using this system and communicates between the first server 5 and a mobile terminal 4 held by a user 3 of the automobile 1. The mobile terminal 4 is an information terminal on which the app is downloaded. The mobile terminal 4 transmits the acquired video data to the second server 6.

[0026] The first server 5 receives the video data captured by the camera of the drive recorder 2 from the drive recorder 2 and temporarily stores it. The second server 6 receives the video data captured by the camera of the drive recorder 2 from the first server 5 and stores it. The second server 6 edits the stored video data in accordance with instructions from the user 3 via the mobile terminal 4, creating, for example, memory information about the drive, and transmits it to the mobile terminal 4. The second server 6 may also use the video data transmitted from the mobile terminal 4 to perform the editing process.

[0027] (1-1) Drive recorder 2 is a diagram showing an example of the configuration of the drive recorder 2. The drive recorder 2 includes a camera 21, a positioning unit 22, a microphone 23, a first interface 24, an input operation unit 25, and a storage unit 26. Note that the drive recorder 2 includes an information terminal owned by a user 3 in which an application that functions as a drive recorder is installed and operated.

[0028] The cameras 21 are positioned so as to capture at least an image in front of the automobile 1. The cameras 21 include a camera that captures a predetermined range in front of the automobile 1, a camera that captures a predetermined range behind the automobile 1, and a camera that captures the interior of the automobile 1. The cameras 21 capture optical images to generate video data Dv1. The video data Dv1 is not particularly limited. For example, the video data Dv1 may be a still image or a video. For example, the video data Dv1 may include "video data captured by a camera while the vehicle is traveling and linked to positioning data," "video data captured at the request of the driver or passenger," and "video data automatically captured when a specific state is observed by a sensor or the like." Examples of specific states include an excited atmosphere inside the vehicle and a state in which scenery or buildings at a tourist destination or the like are captured within the camera frame.

[0029] The positioning unit 22 acquires positioning data Dp such as the date and time of data acquisition by the camera 21, the position (including latitude and longitude) of the automobile 1, the traveling direction (including azimuth and direction) of the automobile 1, and the traveling speed of the automobile 1. The positioning unit 22 includes radars such as infrared radar and a global positioning system (GPS).

[0030] The microphone 23 has an output function of providing audio guidance to the user 3 of the automobile 1, and an input function of collecting the voice of the user 3 of the automobile 1, the voices of people other than the user 3, environmental sounds, etc. The audio data collected by the microphone 23 may be independent data as audio data, or may constitute part of the video data Dv1.

[0031] The first interface 24 is connected to the Internet and communicates with the first server 5. The first interface 24 transmits the video data Dv1 and positioning data Dp captured by the camera 21 to the first server 5. The first interface 24 receives signals such as a request to capture images transmitted from the first server 5.

[0032] The input operation unit 25 accepts various inputs from the user 3 and the first server 5. The input operation unit 25 operates the camera 21 and the microphone 23 according to instructions (signals) input from the user 3 and the first server 5. The input operation unit 25 includes a push button switch and a touch sensor touch panel provided on the main body of the drive recorder 2. The input operation unit 25 also includes a G sensor that detects an impact input to the automobile 1. When the G sensor detects an impact input to the automobile 1, the input operation unit 25 causes the camera 21 to capture images of the surroundings of the automobile 1 and the interior of the vehicle.

[0033] The storage unit 26 is configured, for example, with a volatile memory such as RAM, or a non-volatile semiconductor memory such as ROM or flash memory. The storage unit 26 temporarily stores the video data Dv1 acquired by the camera 21 and the positioning data Dp acquired by the positioning unit 22. The storage unit 26 stores the video data Dv1 and the positioning data Dp in association with each other. The video data Dv1 and the positioning data Dp stored in the storage unit 26 are transmitted to the first server 5 via the first interface 24. The video data Dv1 and the positioning data Dp stored in the storage unit 26 may be deleted from the storage unit 26 immediately after being transmitted to the first server 5, or may be deleted after a predetermined period of time has elapsed. The storage unit 26 may also store audio data when the audio data is independent data.

[0034] (1-2) First server 3 is a diagram showing an example of the configuration of the first server 5. The first server 5 includes a user authentication unit 51, a content management unit 52, a second interface 53, and a storage unit .

[0035] In response to a registration request from the second server 6, the user authentication unit 51 authenticates the user 3 who uses the second server 6 that has issued the registration request. As will be described in detail later, the user authentication unit 51 links information on the mobile terminal 4 of the user 3 with information on the drive recorder 2 used by the user 3.

[0036] The content management unit 52 has the function of centrally managing the content data Dc. The content management unit 52 manages video data, specifically the "content file," "content information," and "accompanying information" of the content data Dc. A "content file" is a file of the content data included in the content data Dc. "Content information" is information related to the content. "Accompanying information" is information attached to the content data Dc. For example, if the content data Dc is video data Dv1, the video file of the video data Dv1 corresponds to the "content file." "Content information" includes the file size, vertical and horizontal dimensions, resolution, video length, etc. of the video data Dv1. "Accompanying information" includes positioning data such as the shooting time or creation time of the video data Dv1, location information when the video was shot, the direction and orientation when the video was shot, and the shooting location (including the proper name of the shooting facility, etc.), as well as the identification number of the vehicle 1.

[0037] The second interface 53 is connected to the Internet and communicates with the drive recorder 2 and the second server 6 via the Internet. The second interface 53 also communicates with the portable terminal 4 of the user 3 authenticated by the user authentication unit 51. The second interface 53 receives the video data Dv1 and the positioning data Dp transmitted from the drive recorder 2. The second interface 53 transmits the video data Dv1 and the positioning data Dp to the second server 6. The second interface 53 receives signals such as a request to capture images transmitted from the second server 6. The second interface 53 transmits signals such as a request to capture images to the drive recorder 2.

[0038] The storage unit 54 is configured with, for example, a volatile memory such as RAM, or a non-volatile semiconductor memory such as ROM or flash memory. The storage unit 54 stores the video data Dv1 and positioning data Dp transmitted from the drive recorder 2 separately for each vehicle 1. For example, the storage unit 54 stores the video data Dv1 and positioning data Dp related to one vehicle in a separate folder from the video data Dv1 and positioning data Dp related to other vehicles in a separate folder. The video data Dv1 and positioning data Dp transmitted to the second server 6 may be deleted from the storage unit 54 immediately after being transmitted to the second server 6, or may be deleted after a preset period has elapsed.

[0039] (1-3) Second server 4 is a diagram showing an example of the configuration of the second server 6. The second server 6 includes a device gateway 61, a messaging basis 62, a contents manager 63, a backend for frontend (BFF) 64, and a function group 65.

[0040] The second server 6 may be configured as, for example, a cloud-based server, and configured to automatically link predetermined data using technologies such as API linkage and SFTP linkage. Although detailed explanation is omitted because it is outside the scope of the disclosed technology, the second server 6 is configured with hardware such as a processor, memory, and storage, and software such as control programs and data implemented in the memory. Each function of the second server 6, which will be described later, is realized by a processor such as a CPU or GPU executing a program stored in the memory. The second server 6 is not limited to a cloud server, and an on-premise server may also be used.

[0041] (1-3-1) Device Gateway As shown in FIG. 4, the device gateway 61 includes a third interface 61a, an event determination unit 61b, and a transmission unit 61c.

[0042] The third interface 61a is a circuit or device that is connected to a network such as the Internet and that communicates with other computers, servers, information terminals, etc. The third interface 61a is connected to the Internet and communicates with the first server 5 via the Internet.

[0043] The third interface 61a receives content data Dc acquired by the automobile 1. The content data Dc includes video data Dv1 acquired by the camera 21 (see FIG. 2) of the drive recorder 2 and positioning data Dp acquired by the positioning unit 22 (see FIG. 2) provided in the automobile 1. The third interface 61a receives the content data Dc including the video data Dv1 and the positioning data Dp. The video data Dv1 and the positioning data Dp are received separately as separate files.

[0044] The content data Dc may include data other than the video data Dv1 and the positioning data Dp. For example, the content data Dc may include "audio data acquired by a microphone placed in the passenger compartment of a vehicle" or "files or data in a specific format created by a specific application."

[0045] The event determination unit 61b determines events occurring inside the vehicle based on the content data Dc. The events determined by the event determination unit 61b include driving events related to the drive, such as vehicle location information and the journey (from the start of the drive to arriving at the destination), and in-vehicle events related to events that occur inside the vehicle during the drive. Here, a "drive" refers to a journey from a predetermined first point to a predetermined second point. For example, it may be a journey from a departure point (corresponding to the first point) to a destination point (corresponding to the second point) on a certain trip, or a journey from the departure point (corresponding to the first point) to the departure point (corresponding to the second point) via one or more destination points.

[0046] For example, the event determination unit 61b determines that an event of starting a drive of the automobile 1 has occurred when reception of positioning data Dp begins again after a predetermined period of time has elapsed without receiving positioning data Dp via the third interface 61a. Furthermore, for example, when a state where positioning data is received changes to a state where no data is received, and a predetermined time has elapsed since the state where no data is received, the event determination unit 61b determines that an event of ending a drive of the vehicle has occurred. The "predetermined period" for determining the occurrence of the events of starting a drive and ending a drive is not particularly limited and may be set in advance or may be configured to be configurable and changeable externally. Furthermore, the event determination unit 61b may be configured to accept input from the user 3 via the Internet, allowing the user 3 to set or change the predetermined period.

[0047] The transmitter 61c transmits part or all of the content data Dc received via the third interface 61a to the content management unit 63. In this example, the video data Dv1 and the positioning data Dp are transmitted from the transmitter 61c to the content management unit 63 as the content data Dc. As will be explained in detail later, the video data Dv1 transmitted from the transmitter 61c to the content management unit 63 is stored in the storage 63c. At this time, the transmitter 61c assigns a content ID as an identifier to each piece of content data Dc.

[0048] The transmitter 61c transmits topic information Dm, which serves as a key for transmitting and receiving messages, to the messaging infrastructure 62. The topic information Dm includes, for example, “simple location information acquired from the positioning data Dp,” “storage information indicating that video data assigned a content ID has been stored in the storage 63c of the content management unit 63,” “event information determined by the event determination unit 61b,” “status notification of the first server 5,” and “user usage association information.” The event information determined by the event determination unit 61b is embedded in, for example, the header of the message router 62b and transmitted. Note that, if drive start and drive end events are received from the outside via the third interface 61a, the transmitter 61c may transmit the received event information to the event hub 62a as the above-mentioned topic information. The topic information Dm is used by the message router 62b, described later, to determine to which application (hereinafter simply referred to as “function”) related to which function or service a message should be sent.

[0049] (1-3-2) Messaging infrastructure The messaging infrastructure 62 includes an event hub 62a and a message router 62b. The messaging infrastructure 62 is used by all functions provided as the function group 65, and is a messaging system used for exchanging messages between the functions included in the function group 65.

[0050] Specifically, the event hub 62a acquires the topic information Dm from the transmission unit 61c. As described above, the topic information Dm includes "information on saving the video data Dv1 to storage" and "information on the event determined by the event determination unit 61b." The topic information Dm acquired by the event hub 62a is passed to the message router 62b. The message router 62b determines to which function 15 the message (each piece of topic information Dm) should be sent, and passes it back to the event hub 62a. The event hub 62a passes the message including each piece of topic information Dm to the target function 15, in accordance with the determination of the message router 62b.

[0051] (1-3-3) Content Management Department The content management unit 63 includes a fourth interface 63a, a content processing unit 63b, and a storage 63c. Figure 5 shows an example of data and files stored in the storage 63c.

[0052] The content management unit 63 has the function of centrally managing the content data Dc. Specifically, it manages the “content files,” “content information,” and “accompanying information” of the content data Dc. “Management” here refers to enabling each function of the function group 65 and the mobile terminal 4 to search, reference, and extract the “content files,” “content information,” and “accompanying information” based on predetermined conditions. In this embodiment, the “content files,” “content information,” and “accompanying information” are managed separately. The “content files,” “content information,” and “accompanying information” are interrelated, for example, via content IDs. The content IDs and paths indicating the storage destinations of the content files are also managed separately from the “content files.” The content IDs are managed, for example, together with the “content information” and “accompanying information.” This configuration enables centralized management of the content data Dc. For example, when a mobile app on the mobile terminal 4 accesses the content management unit 63 to view videos or still images captured while driving, the search becomes easier, improving search speed and accuracy. The "content files" managed by the content management unit 63 are the same as those described above, and therefore a detailed description thereof will be omitted.

[0053] The fourth interface 63a is a circuit or device connected to a network such as the Internet and for communicating with other computers, servers, information terminals, etc. In the example of Fig. 1, the fourth interface 63a is connected to the Internet and communicates with the mobile terminal 4 via the Internet. In addition, the fourth interface 63a communicates with the third interface 61a of the device gateway 61 in the second server 6.

[0054] The content processing unit 63b performs predetermined processing on the content data Dc received from the device gateway 61. The content processing unit 63b generates a "content file" from the content data Dc. For example, the content processing unit 63b performs processing to separate data related to "content information" and "accompanying information" from the content data Dc. Note that if the content data Dc is already in the format of a content file, it is not necessary to generate a "content file."

[0055] Furthermore, the content processing unit 63b acquires or generates "content information" or "accompanying information" for the video data Dv1 based on the video data Dv1 or the positioning data Dp. Thereafter, the content processing unit 63b stores the "content file," the "content information," and the "accompanying information" in the storage 63c so that they are managed separately. The storage area for the "content file" and the storage area for the "content information" and "accompanying information" may be physically separated so that they are managed separately. The content processing unit 63b may also generate a thumbnail image based on the video data Dv1.

[0056] The storage 63c is a recording medium intended for long-term storage of digital data, and examples thereof include a magnetic recording medium such as a hard disk drive (HDD), a semiconductor recording medium such as a solid state drive (SDD), and an optical recording medium such as a DVD. The storage 63c may be a distributed storage, that is, the data to be stored may be stored in a distributed manner. As described above, the storage 63c stores "content files," "content information," and "accompanying information" so that they are managed separately.

[0057] (1-3-4)BBF The BBF 64 includes a fifth interface 64a and an instruction processing unit 64b. The BBF 64 functions as a data exchange window with a mobile application (hereinafter referred to as a "mobile app") installed on the portable terminal 4. Specifically, the fifth interface 64a receives and processes instructions from the mobile app installed on the portable terminal 4 of the user 3.

[0058] The fifth interface 64a is a circuit or device connected to a network such as the Internet and for communicating with other computers, servers, information terminals, etc. The fifth interface 64a is connected to the Internet and communicates with the mobile terminal 4 via the Internet. The fifth interface 64a also communicates with the fourth interface 63a of the content management unit 63 within the second server 6.

[0059] The command processing unit 64b executes processing corresponding to commands from the mobile app on the mobile terminal 4 of the user 3. For example, the BBF 64 receives commands from the mobile app, such as a request to view a drive log or videos and still images, a request to create a memory movie, an instruction to edit the drive log, a request to acquire video data, and a request to register a user with the first server, and the command processing unit 64b executes processing corresponding to these commands. Specifically, the command processing unit 64b transmits a command to create a memory movie to the corresponding function of the mobile app on the mobile terminal 4 and transmits the created memory movie to the mobile app. Furthermore, when the command processing unit 64b receives a command to view a drive log or videos and still images, it retrieves the videos and still images corresponding to the command from the storage 63c and transmits them to the mobile app. Furthermore, when the command processing unit 64b receives a request to register a user with the first server 5, it makes the user registration request to the first server 5.

[0060] (1-3-5) Functional section The function group 65 includes application programs for realizing various functions and services, and processors and memories for executing the application programs, and various functions are realized by executing the application programs. Examples of the functions realized by the function group 65 include, for example, a "user information management function," a "drive log management function," a "video data management function," a "memory movie creation and editing function," and a "registration request function to the first server."

[0061] As described above, each function obtains topic information Dm required to realize the respective function from the event hub 62a. In addition, various processing requests may be sent from the event hub 62a to the target function based on messages. Examples of processing requests include, for example, "a request to create a new record made to the drive log management function when a drive start event occurs," and "an instruction to retrieve the drive end point from the storage 33 made to the drive log management function when a drive end event occurs."

[0062] (1-4) Mobile devices 7 is a diagram showing an example of the configuration of the mobile terminal 4. The mobile terminal 4 includes a sixth interface 41, a camera 42, a touch screen 43, a microphone 44, a processor 45, and a storage unit 46.

[0063] The sixth interface 41 is connected to the Internet and communicates with the second server 6. The sixth interface 41 transmits video data Dv2 captured by the camera 42 and positioning data Dp to the second server 6. The sixth interface 41 transmits commands from the mobile app to the second server 6. The sixth interface 41 receives the memory movie transmitted from the second server 6.

[0064] The camera 42 is a camera attached to the main body of the mobile terminal 4. It captures an optical image to generate video data Dv2. The video data Dv2 is not particularly limited. For example, the video data Dv2 may be a still image or a video. The camera 42 acquires the video data Dv2 in response to a request from the user 3. The mobile terminal 4 may be provided with a plurality of cameras 42.

[0065] The touch screen 43 is a screen that constitutes the screen of the portable terminal 4. The touch screen 43 constitutes an operation input unit of the portable terminal 4. The user 3 operates the portable terminal 4 by performing a touch operation on the touch screen 43.

[0066] The microphone 44 has an output function of outputting voice to the user 3 and an input function of collecting the voice of the user 3, the voices of people other than the user 3, environmental sounds, etc. The microphone 44 includes a microphone for calls.

[0067] The processor 45 is composed of a CPU (Central Processing Unit) and an MPU (Micro Processing Unit). The processor 45 controls the mobile terminal 4 in accordance with instructions from the user 3 input via the touch screen 43 or microphone 44. In addition, the processor 45 displays a message or a memory movie on the touch screen 43 in response to a request from the second server 6.

[0068] The storage unit 46 is configured, for example, with a volatile memory such as RAM, or a non-volatile semiconductor memory such as ROM or flash memory. The storage unit 46 stores the video data Dv2 and the positioning data Dp acquired by the camera 42. The video data Dv2 and the positioning data Dp stored in the storage unit 46 are transmitted to the second server 6 via the sixth interface 41. The video data Dv2 and the positioning data Dp stored in the storage unit 46 may be deleted from the storage unit 46 immediately after being transmitted to the second server 6, or may be deleted after a preset period has elapsed.

[0069] Fig. 7 is an example of a screen displayed on the touch screen 43 of the mobile terminal 4. In the example of the screen in Fig. 7, the date and time of the drive, the route traveled by the automobile 1, and the captured video data Dv1 and video data Dv2 are displayed as memory information.

[0070] (2) Transmission and reception of data and signals FIG. 8 illustrates an example of the destinations of transmission and reception of various data and signals in the communication processing system M.

[0071] The video data Dv1 and positioning data Dp acquired by the drive recorder 2 are input to the content management unit 63 via the first server 5 and the device gateway 61. The message data transmitted from the first server 5 is input to the messaging infrastructure 62 via the device gateway 61. The messaging infrastructure 62 transmits the message to the appropriate function based on the topic information Dm attached to the message data.

[0072] The video data Dv2 and positioning data Dp transmitted from the mobile terminal 4 are input directly from the mobile terminal 4 to the content management unit 63. Signals from the mobile terminal 4, such as a user registration request, a request to acquire the video data Dv1, and a movie creation / editing request, are input from the BFF 64 to corresponding functions in the function group 65.

[0073] (3) Acquiring video data via a mobile device As described above, the drive recorder 2 acquires the video data Dv1 when the driver or a passenger requests acquisition of the video data Dv1 by operating the input operation unit 25. Furthermore, when the user 3 makes a voice request to acquire the video data Dv1, the drive recorder 2 recognizes the request by voice recognition via the microphone 23 and acquires the video data Dv1.

[0074] However, devices installed in the vehicle cabin, such as the drive recorder 2, are becoming increasingly miniaturized, and the size of the buttons constituting the input operation unit 25 is becoming smaller. If the buttons are small, it is difficult for passengers to directly operate the buttons due to shaking during driving, etc. Furthermore, when a passenger is seated in the back seat, the passenger is far away from the drive recorder 2, making it difficult for the passenger to operate the drive recorder 2. Furthermore, even if an attempt is made to use the voice recognition function of the drive recorder 2, the drive recorder 2 may not be able to recognize the voice when the passenger is seated in the back seat. Furthermore, even when the passenger is seated in the front passenger seat, the drive recorder 2 may not be able to acquire instructions from the passenger when there is relatively loud driving noise or when music is playing on the in-car audio system.

[0075] Therefore, in this embodiment, the passenger's mobile terminal 4 is used to make a request to acquire the video data Dv1 to the drive recorder 2. Specifically, when there is a request to acquire the video data Dv1 from the mobile terminal 4, the second server 6 and the first server 5 are used to cause the drive recorder 2 to acquire the video data Dv1.

[0076] (3-1) Linking a mobile device with a drive recorder In this embodiment, when a passenger in automobile 1 requests acquisition of video data Dv1 from the mobile terminal 4, the mobile terminal 4 of the passenger in automobile 1 is linked to the drive recorder 2 of the automobile 1 so that the video data Dv1 can be acquired by the drive recorder 2 installed in the automobile 1.

[0077] 9 illustrates a process of linking a mobile terminal carried by a passenger of an automobile 1 with the drive recorder 2 of the automobile 1. Hereinafter, the mobile terminal 4 carried by the driver is referred to as the first mobile terminal 4a, and the information terminal carried by the passenger is referred to as the second mobile terminal 4b. It is also assumed that the driver is registered as the main user of the drive recorder 2.

[0078] 9, the passenger selects an app on the second mobile terminal 4b and accesses the second server 6. The passenger operates the second mobile terminal 4b to request registration of the second mobile terminal 4b. The registration request function is included in the function group 65.

[0079] The command processing unit 64b of the second server 6 receives the registration request from the second mobile terminal 4b and sends the registration request to the first server 5 via the device gateway 61.

[0080] The first server 5 sends information about the drive recorders linked to the first server 5 to the second server 6. The second server 6 sends the received drive recorder information to the second mobile terminal 4b via the BFF 64. The drive recorder information is, for example, a list of the drive recorders linked to the first server 5.

[0081] The passenger selects a drive recorder that the passenger wants to associate with the second mobile terminal 4b. When the user selects a drive recorder, the second server 6 sends information about the selected drive recorder to the first server 5.

[0082] The first server 5 sends an approval request to the first portable terminal 4a asking whether to approve the registration of the second portable terminal 4b. The driver operates the first portable terminal 4a to select either approval or denial (approval is selected in this example).

[0083] If the driver approves, the user authentication unit 51 of the first server 5 authenticates the passenger as a user by linking the information of the second mobile terminal 4b with the information of the drive recorder 2. The storage unit 54 of the first server 5 stores the information of the second mobile terminal 4b in association with the information of the drive recorder 2.

[0084] The first server 5 notifies the second server 6 that the registration has been completed. The information notified by the first server 5 includes information about the drive recorder for which registration has been completed. Upon receiving the registration completion notification, the second server 6 may store the information about the second mobile terminal 4b and the information about the selected drive recorder in association with each other.

[0085] As a result, the information of the second portable terminal 4b is linked to the information of the drive recorder 2 of the automobile 1 within the first server 5. When the first server 5 receives a signal related to a signal requesting acquisition of the video data Dv1 from the second portable terminal 4b, it outputs a signal to the drive recorder 2 linked to the second portable terminal 4b to cause the drive recorder 2 to acquire the video data Dv1.

[0086] (3-2) Operation of the communication processing system 10, when a first signal requesting acquisition of video data Dv1 is sent from the second mobile terminal 4b to the second server 6, the command processing unit 64b of the second server 6 uses the functions of the function group 65 to send a second signal related to the first signal to the first server 5. The first signal is a signal requesting acquisition of the video data Dv1. The second signal may be a signal requesting acquisition of the video data Dv1, or may simply be a signal notifying that the first signal has been received.

[0087] Next, the first server 5, which has received the second signal, transmits a third signal to the drive recorder 2. The third signal may be a signal requesting the drive recorder 2 to acquire the video data Dv1, or may simply be a signal notifying the drive recorder 2 that the second signal has been received. Upon receiving the third signal, the drive recorder 2 acquires the video data Dv1.

[0088] When the drive recorder 2 acquires the video data Dv1, the drive recorder 2 transmits the acquired video data Dv1 to the first server 5. The first server 5 that has acquired the video data Dv1 transmits the video data Dv1 to the second server 6.

[0089] The second server 6 that has acquired the video data Dv1 stores the video data in the storage 63c of the content management unit 63. After storing the video data, the communication processing system M ends the processing.

[0090] The second server 6 records content accompanying information in the content management unit 63 so as to distinguish the video data Dv1 acquired in response to a request from the second mobile terminal 4b. In particular, the second server 6 records content accompanying information in the content management unit 63 so as to identify the second mobile terminal 4b that has requested the acquisition of the video data Dv1. The second server 6 may preferentially use the video data Dv1 acquired in response to a request from the second mobile terminal 4b in the above-mentioned movie editing.

[0091] When the drive recorder 2 receives the third signal from the first server 5 and acquires the video data Dv1, if an impact is detected by the G sensor of the input operation unit 25, the drive recorder 2 suspends acquisition of the video data Dv1 based on the third signal. After the suspension, the drive recorder 2 starts capturing images to acquire evidence data.

[0092] (3) Effects of the embodiment Therefore, in this embodiment, the system includes a drive recorder 2 mounted on an automobile 1 and having a camera 21 that acquires video data Dv1, a mobile terminal 4 carried by a user 3 of the automobile 1, a first server 5 that can communicate with the drive recorder 2 and in which the camera receives and temporarily stores the video data from the drive recorder 2, and a second server 6 that can communicate with the first server 5 and the mobile terminal 4, wherein the second server 6 receives a first signal transmitted from the mobile terminal 4 requesting acquisition of the video data Dv1 and outputs a second signal related to the first signal to the first server 5, and when the first server 5 receives the second signal from the second server 6, it outputs a third signal to the drive recorder 2, and when the drive recorder 2 receives the third signal from the first server 5, it acquires the video data Dv1 using the camera. In this way, the user 3 can operate the mobile terminal 4 to cause the drive recorder 2 to acquire the video data Dv1. Since the portable terminal 4 is basically held by the user 3 when in use, operating the portable terminal 4 is easier than operating the input operation unit of the drive recorder 2. Furthermore, since instructions are issued through communication between the portable terminal 4, the server, and the drive recorder 2, it is less affected even if audio equipment or the like is in use. Therefore, the communication processing system M allows the user 3 to easily request the drive recorder 2 to acquire the video data Dv1.

[0093] In particular, in this embodiment, the mobile terminal 4 sends the first signal to the second server 6, but does not send the first signal directly to the first server 5. Therefore, even if the drive recorder 2 is replaced and the first server 5 is changed, the user 3 can operate the mobile terminal 4 in the same way as before the drive recorder 2 was replaced, and cause the drive recorder 2 to acquire the video data Dv1. Therefore, the communication processing system M allows the user 3 to easily request the drive recorder 2 to acquire the video data Dv1.

[0094] In this embodiment, the first server 5 identifies the mobile terminal 4, links the identified mobile terminal 4 with the drive recorder 2, and when receiving a second signal related to the first signal transmitted from the identified mobile terminal 4, outputs a third signal to the drive recorder 2 linked with the mobile terminal 4. Since it is only necessary for the mobile terminal 4 and the drive recorder 2 to be linked within the first server 5, linking multiple mobile terminals 4 with the drive recorder 2 makes it possible to output the first signal from the multiple mobile terminals 4 to cause the drive recorder 2 to acquire the video data Dv1. Even if there are multiple users 3 and the video data Dv1 required by each user 3 differs, each user 3 can easily request the drive recorder 2 to acquire the desired video data Dv1.

[0095] In this embodiment, the second server 6 receives and stores the video data Dv1 from the first server 5, and edits and transmits the stored video data Dv1 to the mobile terminal 4 in accordance with instructions from the user 3 via the mobile terminal 4. Based on the video data Dv1 acquired based on the first signal from the mobile terminal 4, driving memory information and the like can be created. The communication processing system M can effectively utilize the video data Dv1 acquired by the drive recorder 2.

[0096] In particular, in this embodiment, the second server 6 can distinguish whether the video data Dv1 was acquired based on the first signal from the mobile terminal 4 by using the content-attached information. Because the video data Dv1 was acquired at the request of the user 3, it is highly likely that the user 3 recognizes it as important as memory information. By being able to distinguish the video data Dv1 from other video data Dv1, the video data Dv1 can be preferentially selected when creating memory information about a drive. This allows the communication processing system M to effectively utilize the video data Dv1 acquired by the drive recorder 2.

[0097] In this embodiment, the drive recorder 2 can receive a request for acquiring the video data Dv1 from the user 3 by voice recognition without going through the first server 5 or the second server 6, and also acquires the video data Dv1 by the camera 21 when the acquisition request is received without going through the first server 5 or the second server 6. Because the drive recorder 2 uses voice recognition, there is a risk that the drive recorder 2 may not be able to recognize a direct acquisition request from the user 3 due to road noise, music from the in-car audio, etc. Therefore, the effect of being able to acquire the video data Dv1 by operating the mobile terminal 4 can be more appropriately achieved.

[0098] Other Embodiments The technology disclosed herein is not limited to the above-described embodiments, and can be substituted within the scope of the claims.

[0099] In the above embodiment, the second server 6 has an editing function for the acquired video data Dv1, but the editing function is not essential. The second server 6 may simply store the video data Dv1.

[0100] In the above-described embodiment, the mobile terminal 4 and the drive recorder 2 are linked by the first server 5. The mobile terminal 4 and the drive recorder 2 may be linked by the second server 6. In this case, it is preferable that the second server 6 attaches information that can identify the mobile terminal 4 to the second signal.

[0101] In the above embodiment, the device having a camera is the drive recorder 2, but the device may be an ADAS camera mounted on the automobile 1.

[0102] In the above-described embodiment, the vehicle is an automobile 1. However, the vehicle is not limited to this, and may be a bicycle, a motorbike, a railroad vehicle, or the like. When the vehicle is a bicycle, a motorbike, or a railroad vehicle, the device equipped with a camera is a drive recorder. When the vehicle is a bicycle or a motorbike, the linking of the mobile terminal and the drive recorder can be performed in the same manner as in the above-described embodiment. When the vehicle is a railroad vehicle, the railway company approves the user registration when linking the mobile terminal and the drive recorder. The technology of the present disclosure can also be applied to aircraft. When the technology is applied to aircraft, the device equipped with a camera is a recorder installed on the aircraft. When linking the mobile terminal and the recorder, the airline company approves the user registration.

[0103] The above-described embodiments are merely examples and should not be construed as limiting the scope of the present disclosure. The scope of the present disclosure is defined by the claims, and all modifications and variations that fall within the scope of the claims equivalents are within the scope of the present disclosure. [Industrial Applicability]

[0104] The techniques disclosed herein are useful in communication processing systems. [Explanation of symbols]

[0105] 1 vehicle 2. Drive recorder 3 users 5 First Server 6 Second Server 21 Camera 42 Camera Dv1 video data M Communication Processing System

Claims

1. A communication processing system for acquiring video data while a vehicle is traveling, a device mounted on the vehicle and having a camera for acquiring the video data; an information terminal carried by a user of the vehicle; a first server capable of communicating with the device; a second server capable of communicating with the first server and the information terminal; the second server receives a first signal, which is transmitted from the information terminal and requests acquisition of the video data, and outputs a second signal related to the first signal to the first server; When the first server receives the second signal from the second server, the first server outputs a third signal associated with the second signal to the device; When the device receives the third signal from the first server, the device acquires the video data using the camera.

2. 2. The communication processing system according to claim 1, The first server Identifying the information terminal; Linking the identified information terminal with the device; When the second signal related to the first signal transmitted from the identified information terminal is received, the third signal is output to the device associated with the identified information terminal. Communications processing system.

3. 3. The communication processing system according to claim 1, A communication processing system in which the second server receives and stores the video data from the first server, edits the stored video data in accordance with instructions from a user via the information terminal, and transmits the edited video data to the information terminal.

4. 4. The communication processing system according to claim 1, The device is capable of acquiring a request to acquire the video data from the user by voice recognition without going through the first server and the second server, and when the acquisition request is acquired without going through the first server and the second server, the device acquires the video data using the camera.

5. 4. The communication processing system according to claim 1, the vehicle is an automobile, The communication processing system, wherein the device is a drive recorder.

6. A communication processing method for acquiring video data while the vehicle is traveling in a system including a device equipped with a camera for acquiring video data, an information terminal carried by a user of the vehicle, a first server capable of communicating with the device, and a second server capable of communicating with the first server and the information terminal, comprising: outputting a first signal from the information terminal to the second server requesting acquisition of the video data; outputting a second signal related to the first signal from the second server to the first server; outputting a third signal related to the second signal from the first server to the device; acquiring the video data by the camera of the device that received the third signal.

Images