Information providing device, operation management system, and program

The system addresses the challenge of identifying relevant video data by allowing users to modify extraction conditions and display specific items, enhancing operational management with detailed vehicle operation and positional information.

JP7726703B2Active Publication Date: 2025-08-20YAZAKI ENERGY SYSTEM CORP
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2021141553
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-08-31
Publication Date
2025-08-20
Estimated Expiration
2041-08-31

AI Technical Summary

Technical Problem

Existing video acquisition services struggle with large amounts of irrelevant video data or insufficient data meeting search criteria, making it difficult for fleet managers to identify desired video data effectively.

Method used

An information providing device and system that collects and analyzes vehicle operation data, including video data and positional information, allowing users to modify extraction conditions and select specific data items for display, providing relevant video data along with operational and positional information.

Benefits of technology

Enables users to efficiently identify and view desired video data, enhancing operational management by providing detailed information on vehicle operations and surrounding conditions at the time of alarms or events.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007726703000001
    Figure 0007726703000001
  • Figure 0007726703000002
    Figure 0007726703000002
  • Figure 0007726703000003
    Figure 0007726703000003
Patent Text Reader

Abstract

To provide a user with information useful for operation management.SOLUTION: A server 80 collects moving image data photographed by on-vehicle cameras 23A, 23B in association with accompanying information during photographing, and corrects a first extraction condition inputted to retrieve the collected moving image data to a second extraction condition (step S1). The server 80 extracts moving image data corresponding to the second extraction condition and accompanying information corresponding to the moving image data from the collected moving image and accompanying information. The server 80 presents an item to be a display object in at least one item included in the extracted accompanying information to a user in a selectable manner (step S2), and receives a selected input of the item to be the display object. The server 80 provides the user with the extracted moving image data together with data of the selected item.SELECTED DRAWING: Figure 5
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an information providing device for providing traffic management information, a traffic management system, and a program. [Background technology]

[0002] Some in-vehicle devices with both drive recorder and digital tachograph functions collect video data captured by an in-vehicle camera and transmit it to a fleet management server. The fleet management server stores and analyzes the received video data, and transmits it in response to a request from a device used by the fleet manager. With such a video acquisition service, the fleet manager can view the video data received on the device and use it for fleet management and safe driving support.

[0003] Incidentally, Patent Document 1 describes a system that utilizes image data collected by an onboard camera. This system includes a collection server, an analysis server, and a provision server. The collection server collects image data captured by the onboard camera in association with information about the location where the data was captured. The analysis server extracts and classifies characteristic information about people or vehicles from image data captured near a certain location. The provision server transmits the classified characteristic information to the user's PC. The system described in Patent Document 1 makes it possible to easily grasp, for example, the number of pedestrians passing near a specific location. In addition, the system disclosed in Patent Document 2 determines recommended products based on the dispersion of purchase amounts of shoppers, and displays a recommendation screen represented by screen data associated with the determined products on a touch panel. The system disclosed in Patent Document 2 can recommend products that will pique the shopper's interest. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2021-89639 [Patent Document 2] Patent Publication No. 2021-33459 Summary of the Invention [Problem to be solved by the invention]

[0005] In the video acquisition service, a list of video data collected by the in-vehicle device is displayed on the terminal. The fleet management server transmits to the terminal, from among the video data included in this list, video data that matches the search criteria set by the fleet manager on the terminal. The search criteria include, for example, whether the sensor values of the G sensor or gyro sensor are above a threshold, or whether trigger recording has been performed to detect and record an impact or sudden braking.

[0006] However, there are cases where there is a large amount of video data that meets the search criteria, making it difficult for the operations manager to identify the video data he or she wants to see, or conversely, there are cases where there is a small amount of video data that meets the search criteria, and the desired video data is not included. Note that Patent Documents 1 and 2 do not disclose how a user can obtain the image data they want.

[0007] The present invention has been made in view of the above-mentioned circumstances, and an object of the present invention is to provide an information providing device, an operation management system, and a program that can provide a user with information that is useful for operation management. [Means for solving the problem]

[0008] In order to achieve the above-mentioned object, an information providing device according to the present invention has the following features. a collection unit that collects video data captured by an in-vehicle camera in association with accompanying information at the time of capturing the video data; an extraction unit that modifies a first extraction condition input for searching the collected video data to a second extraction condition, and extracts the video data that meets the second extraction condition and the associated information corresponding to the video data from the video data and the associated information collected by the collection unit; a display condition generating unit that presents to a user a selectable item to be displayed from at least one item included in the extracted accompanying information; an input receiving unit that receives a selection input of the item to be displayed; a providing unit that provides the extracted video data to the user together with data of the selected item, the second extraction condition includes adding, as a search target, video data newly collected by the collection unit after the first extraction condition is input; The accompanying information includes operation data of the vehicle on which the vehicle-mounted camera is installed and operational data that is a result of analyzing the operation data. fruit , The operation data includes information indicating a positional relationship between the vehicle and surrounding workers at the time of the alarm generation, the information being obtained from position information of the vehicle at the time of the alarm generation and beacon position information of beacons located around the vehicle. Information provision device.

[0009] In order to achieve the above-mentioned object, the operation control system according to the present invention has the following features. the information providing device; an in-vehicle device mounted on a vehicle in which the in-vehicle camera is installed and capable of communicating with the information providing device; A traffic management system including a communication terminal capable of communicating with the information providing device and having an operation unit and a display unit, the in-vehicle device collects the video data captured by the in-vehicle camera in association with the operation data, and transmits the collected video data to the information providing device; The information providing device the collection unit collects the video data and the operation data by receiving them from the in-vehicle device, analyzes the operation data, and collects the operation data that is the analysis result; the operation data includes information indicating a positional relationship between the vehicle and surrounding workers at the time of the alarm generation, the information being obtained from position information of the vehicle at the time of the alarm generation and beacon position information of beacons located around the vehicle, the display condition generating unit presents the items to be displayed on the display unit in a selectable manner; the input receiving unit receives a selection input of the item to be displayed via the operation unit; the providing unit transmits the extracted video data and the data of the selected item to the communication terminal. Operation management system.

[0010] In order to achieve the above-mentioned object, the program according to the present invention has the following features. Computer, a collection unit that collects video data captured by the vehicle-mounted camera in association with accompanying information at the time of capturing the video data; an extraction unit that modifies a first extraction condition input for searching the collected video data to a second extraction condition, and extracts the video data that meets the second extraction condition and the associated information corresponding to the video data from the video data and the associated information collected by the collection unit; a display condition generating unit that presents to a user a selectable item to be displayed from at least one item included in the extracted accompanying information; an input receiving unit that receives a selection input of the item to be displayed; and a providing unit that provides the extracted video data to the user together with data of the selected item; A program for functioning as the second extraction condition includes adding, as a search target, video data newly collected by the collection unit after the first extraction condition is input; The accompanying information includes operation data of the vehicle on which the vehicle-mounted camera is installed and operational data that is a result of analyzing the operation data. fruit , The operation data includes information indicating a positional relationship between the vehicle and surrounding workers at the time of the alarm generation, the information being obtained from position information of the vehicle at the time of the alarm generation and beacon position information of beacons located around the vehicle. program. [Effects of the Invention]

[0011] According to the information providing device, operation management system, and program of the present invention, it is possible to provide information useful for operation management to a user.

[0012] The present invention has been briefly described above. The details of the present invention will become clearer by reading the following detailed description of the invention (hereinafter referred to as "embodiments") with reference to the accompanying drawings. [Brief explanation of the drawings]

[0013] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of an operation control system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a diagram showing an example of a display screen on the customer PC shown in FIG. [Figure 3] FIG. 3 is a diagram showing an example of a display screen on the customer PC shown in FIG. [Figure 4] FIG. 4 is a diagram showing an example of a display screen on the customer PC shown in FIG. [Figure 5] FIG. 5 is a flowchart showing an example of the operation of the server shown in FIG. DETAILED DESCRIPTION OF THE INVENTION

[0014] Specific embodiments of the present invention will be described below with reference to the accompanying drawings.

[0015] An example of the configuration of a traffic management system 1 according to one embodiment of the present invention is shown in Fig. 1. The traffic management system 1 shown in Fig. 1 is a traffic management system operated by a service provider whose customers (users) are businesses that manage the operation of vehicles such as trucks.

[0016] 1 includes a server 80 as an information providing device for managing vehicle operations, a plurality of on-board devices 10 used while mounted on vehicles such as trucks, and a customer PC 30 as a communication terminal. In the operation management system 1, the server 80 collects and stores video data captured by on-board cameras installed in vehicles and collected by the on-board devices 10, in association with accompanying information at the time of capture, and provides the video data and accompanying information to the customer PC 30 in response to a customer's request.

[0017] The customer PC 30 is installed in a designated office to manage each vehicle, driver, work content, etc. The server 80 is equipment on the service provider (support center) side that performs analysis based on vehicle operation information collected from the in-vehicle device 10 and provides various services to customers using the analysis results. The operation management system 1 includes multiple customer PCs 30 and multiple in-vehicle devices 10 installed in multiple customer offices, etc. The in-vehicle device 10 in this embodiment has a drive recorder function and a digital tachograph function.

[0018] In the in-vehicle device 10, vehicle operation information, including video data (image data) captured by the in-vehicle camera while the vehicle is in operation and operation data, which is an example of accompanying information at the time of capture, is recorded on a recording medium 65 such as a memory card. The operation data includes, for example, the vehicle's position, speed, engine RPM, alarm (in the case of a proximity alarm, the ID and location of a nearby beacon), trigger information such as a sharp turn, and is recorded in association with time information indicating the time the video data was captured. The vehicle operation information recorded on the recording medium 65 is read by the customer PC 30, for example, when the vehicle returns to the office after the day's operation is completed. The server 80 accumulates in a database the operation data transmitted from the in-vehicle devices 10 of each vehicle owned by multiple customers. The operation data is transmitted from the in-vehicle device 10 to the server 80 when requested by the customer PC 30, as described below, when requested by the server 80, or when automatic acquisition is set. Furthermore, when creating a video acquisition list, which will be described later, the server 80 acquires the relevant video data and the operation data associated with the video data from the vehicle-mounted device 10, and stores them in the database.

[0019] The vehicle video list stored in the server 80 can be accessed from the customer PC 30. The user can search the recorded data of the vehicle-mounted device 10 on the customer PC 30 to see if there is video data that the user wants to view.

[0020] The customer PC 30 is configured as a general-purpose computer device installed in an office. The customer PC 30 manages the vehicle's operating status, etc. The server 80 analyzes vehicle operation information, including video data and event information, collected by the vehicle-mounted device 10, and provides the information to the customer PC 30. In the example of FIG. 1 , data communication between the vehicle-mounted device 10 and the server 80 is performed via a base station 71. Data communication between the vehicle-mounted device 10 and the customer PC 30 is relayed by the base station 71, the server 80, and the network 70. Wireless communication between the base station 71 and the vehicle-mounted device 10 may be performed via a mobile communication network (cellular network) such as LTE (Long Term Evolution) / 5G (5th Generation) or a wireless LAN (Local Area Network). The network 70 is a network (packet communication network) such as the Internet, and relays data communication between the customer PC 30 and the server 80.

[0021] The vehicle-mounted device 10 includes various interfaces (I / F) 12A, 12B, 13, 14, 16, 19, and 29 to enable input or output of various signals. The speed I / F 12A has a function for inputting a vehicle speed pulse signal output from a vehicle speed sensor 51 mounted on the vehicle side. The engine rotation I / F 12B has a function for inputting an engine rotation pulse signal output from the vehicle side. The external input I / F 13 is used for inputting various external signals.

[0022] The sensor input I / F 14 is used to input signals from various sensors. In the example of FIG. 1, a G sensor 28 and a gyro sensor 52 are connected to the sensor input I / F 14. The G sensor 28 detects the magnitude of accelerations (front-rear G, right-left G, and up-down G) applied to the vehicle in which the in-vehicle device 10 is mounted, for example, in the front-rear, left-right, and up-down directions of the vehicle. The gyro sensor 52 detects the rotational angular velocities around the pitch axis, yaw axis, and roll axis of the vehicle in which the in-vehicle device 10 is mounted, and outputs signals indicating changes in the pitch angle, yaw angle, and roll angle. Based on the outputs of the gyro sensor 52 and the G sensor 28, the control unit 11 detects a sharp turn of the vehicle.

[0023] The analog input I / F 29 is used to input various analog signals. The camera I / F 16 has a function for connecting the cameras 23A and 23B. That is, the camera I / F 16 has a function for capturing the video signals output by the cameras 23A and 23B, respectively, and converting the signals into predetermined digital image data suitable for computer processing, thereby acquiring video data. The cameras 23A and 23B are imaging devices that capture images of the surroundings of the vehicle. The camera 23A captures images of the front and sides of the vehicle, for example, and the camera 23B captures images of the rear of the vehicle, for example. The number of cameras connected to the camera I / F 16 may be one or three or more. Furthermore, the camera connected to the camera I / F 16 may capture images of the interior of the vehicle, such as the driver's seat, for example.

[0024] The audio I / F 19 has a function of generating a predetermined audio signal that can be used for audio alerts and the like.

[0025] The control unit 11, which realizes the main functions of the vehicle-mounted device 10, is composed of electronic circuits mainly including a processor of a microcomputer (CPU). This microcomputer realizes the control functions of the vehicle-mounted device 10, which will be described later, by executing programs stored in advance in the non-volatile memory 26A or the like.

[0026] The above-mentioned interfaces 12A, 12B, 13, 14, 16, and 29 are connected to the input of the control unit 11. Also, a speaker 20 is connected to the output of the control unit 11 via an audio I / F 19.

[0027] In addition, the recording unit 17, the display unit 27, the power supply unit 25, the communication unit 24, the non-volatile memory 26A, the volatile memory 26B, the card I / F 18, the RTC unit 21, the beacon receiving unit 15, and the GPS receiving unit 9 are connected to the control unit 11.

[0028] The recording unit 17 records vehicle operation information, such as video data output by the cameras 23A and 23B, in a predetermined storage area (recording medium 65). The vehicle operation information will be described in detail later. The display unit 27 can be used to display visible information such as characters required for operating the vehicle-mounted device 10, and information to alert the driver regarding driving operations, so that the driver can see it.

[0029] The power supply unit 25 generates stable power supply based on power supply supplied from the vehicle side, and supplies the generated power supply to each circuit in the vehicle-mounted device 10 including the control unit 11. The communication unit 24 provides a wireless communication function for data communication between the vehicle-mounted device 10 and the base station 71 .

[0030] The nonvolatile memory 26A is made up of a semiconductor memory, and stores in advance programs that can be executed by the microcomputer of the control unit 11, various constant data required for control, tables, and the like. The volatile memory 26B is used to temporarily store data generated by the control unit 11 during processing.

[0031] A recording medium 65 carried by the driver is removably connected to the card I / F 18. The control unit 11 can read data from the recording medium 65 attached to the card I / F 18, and can also write various data generated by the control unit 11 to the recording medium 65 via the card I / F 18.

[0032] The RTC (real time clock) unit 21 is configured by an integrated circuit having a clock function, that is, the RTC unit 21 can generate information on the current time and grasp the elapsed time.

[0033] The beacon receiving unit 15 receives radio waves from beacons located within a predetermined range via the antenna 15a. Beacons include driver beacons, fixed beacons, and mobile beacons. A driver beacon is, for example, a card-type beacon carried by the driver, and emits a beacon signal including a driver ID. When a driver carrying a driver beacon approaches the in-vehicle device 10 (for example, sits in the driver's seat), the control unit 11 automatically recognizes the driver ID and identifies the driver. In other words, when the driver carries a driver beacon that stores his or her driver ID and gets into the driver's seat, the in-vehicle device 10 recognizes the driver ID, making it possible to manage data for each individual driver without requiring the driver to perform any specific operation.

[0034] Fixed beacons are fixedly placed at predetermined locations within a premises, for example, and are used to obtain information indicating the current location of a vehicle. Fixed beacons emit beacon signals containing identification information that specifies the location where they are placed. Mobile beacons are beacons carried by someone other than the driver of the vehicle, such as a worker, and are used to detect when someone approaches the vehicle. Mobile beacons emit beacon signals that contain identification information that specifies an individual, such as a driver ID or worker ID. In addition to using beacons, the control unit 11 may also perform positioning based on signals received by the GPS receiver 9, described below, to obtain information about the current location.

[0035] The GPS receiver 9 receives radio waves from multiple GPS (Global Positioning System) satellites via an antenna 9a. Based on the multiple received signals received by the GPS receiver 9, position information indicating the current position of the vehicle can be calculated and obtained. Furthermore, the position information based on the signals received by the GPS receiver 9 can be used to detect the movement of the vehicle. Furthermore, based on the signals received by the GPS receiver 9, time information can be obtained.

[0036] The customer PC 30 is a PC that runs on a general-purpose operating system. The customer PC 30 can be used as a management device for understanding and managing the vehicle's driving status, operating status, etc. The customer PC 30 has a control unit (CPU) 31, a communication unit 32, a display unit 33, a memory unit 34, a card I / F 35, an operation unit 36, an external I / F 37, and an audio I / F 38.

[0037] The control unit 31 comprehensively controls each unit of the client PC 30. The communication unit 32 is capable of communicating with the server 80 via the network . The display unit 33 can display various information that can be used for operation management of each vehicle. The storage unit 34 can acquire and manage data generated by the on-board device 10 installed in each vehicle.

[0038] A recording medium 65 is removably attached to the card I / F 35. The card I / F 35 is used to input various data recorded in the vehicle-mounted device 10 from the recording medium 65. The operation unit 36 has a keyboard, mouse, etc., and accepts operations from the administrator of the customer PC 30. The external I / F 37 can be connected to external storage devices (not shown) such as an operation data database (DB) and a hazard map database (DB). The audio I / F 38 is connected to a microphone 41 and a speaker 42. The administrator can also make voice calls using the microphone 41 and the speaker 42.

[0039] While viewing the screen displayed on the display unit 33 (see Figures 2 to 4), the administrator uses the operation unit 36 to input search conditions (first extraction conditions), select and input items to be displayed from the various items included in the operation data and operational data, and select and input video data that the administrator wishes to view.

[0040] The server 80 has a control unit (CPU) 81, a communication unit 82, a storage unit 83, and an external I / F 84. The communication unit 82 communicates with the vehicle-mounted device 10 via the base station 71. The communication unit 82 can also communicate with the customer PC 30 via the network 70. The storage unit 83 is a memory capable of storing various data. The external I / F 84 can be connected to a database (DB) 85, etc. The DB 85 stores accompanying information transmitted from multiple vehicle-mounted devices 10 as a vehicle video list. The DB 85 can store vehicle operation information including video data and accompanying information transmitted from multiple vehicle-mounted devices 10. The DB 85 may also store video data, etc. transmitted from the customer PC 30.

[0041] The control unit 81 comprehensively controls each unit of the server 80, analyzes vehicle operation data, and stores the analysis results, that is, operational data, in the DB 85 as accompanying information. An example of operational data analysis is shown below. The control unit 81 analyzes the type and number of alarms, and if the number of alarms of the same type exceeds a threshold, displays an increase in the number of alarms in a list or video data. The control unit 81 displays whether the vehicle's driving state at the time of the alarm was forward, up, or stopped. The control unit 81 creates a heat map using the worker's beacon position information, and compares the heat map with the time-series changes in the vehicle's position against the human proximity alarm to understand the positional relationship between the vehicle and the worker at the time of the alarm. The control unit 81 calculates a safety score based on the frequency of dangerous behavior, etc., from an analysis report that analyzes the operation data of each driver (crew member), and can be used for driver safety education.

[0042] The operation of the traffic management system 1 configured as above will be described with reference to Figs. 2 to 5. The operation of the traffic management system 1 is realized by executing the rear software pre-installed in the server 80, the customer PC 30, and the vehicle-mounted device 10. Figs. 2 to 4 are diagrams showing examples of display screens on the customer PC 30, and Fig. 5 is a flowchart showing an example of the operation of the server 80.

[0043] While the vehicle-mounted device 10 is operating, the vehicle-mounted device 10 records vehicle operation information in the recording medium 65 at predetermined time intervals (e.g., every 30 seconds). The vehicle operation information includes, for example, time information, video data, and sensor data. The time information indicates the time when the video data capture was completed. The video data is video data for a predetermined time period (e.g., 30 seconds) captured by each of the cameras 23A and 23B. The sensor data is data acquired by various sensors and includes location information, speed, engine RPM, gravitational acceleration data (G-value), etc. Furthermore, a vehicle image list is recorded in the recording medium 65. The vehicle image list is a list of vehicle operation information including video data, with time information as a title. The vehicle image list includes, for example, the recording start time, vehicle code, vehicle name, trigger indicating whether a trigger such as a sharp turn has occurred, speed, engine RPM, forward / rearward G, right / left G, up / down G, battery voltage value, and latitude and longitude (GPS). The vehicle image list is transmitted to the server 80 and stored in the DB 85 when the vehicle-mounted device 10 performs a retrieval process or whenever a request is received from the customer's PC 30 .

[0044] While the vehicle-mounted device 10 is operating, the server 80 collects search conditions for video data from the customer PC 30 (step S1), as shown in Fig. 5. When a user specifies a vehicle code and makes a list request on the customer PC 30, the server 80 creates a video acquisition list including past list requests made within a certain period of time and sends it to the customer PC 30. The customer PC 30 displays the video acquisition list on the display unit 33.

[0045] FIG. 2 shows an example of a video acquisition list displayed on the customer PC 30. The video acquisition list 101 displayed on the screen 100 includes a target button 102 for automatic acquisition. When the target button 102 is checked, i.e., on, the server 80 acquires operational data in addition to video data from the in-vehicle device 10 at regular intervals after the list request is made. The server 80 acquires and analyzes the operational data in addition to the video data to acquire operational data such as the vehicle driving status, safety score, the location of the alarm when it occurs, and the positional relationship of surrounding workers. The vehicle driving status indicates whether the vehicle is moving forward, backward, or stopped. The safety score indicates a score calculated based on the frequency of dangerous behavior, etc. The server 80 can determine the positional relationship between the vehicle and surrounding workers based on the vehicle's position information and the beacon position information of beacons located around the vehicle when the alarm occurs. The user can select the target button 102 for the vehicle for which data trend analysis is desired, and can exclude vehicles requested by mistake by selecting the target button 102. The server 80 acquires from the vehicle-mounted device 10 video data and operation data for a vehicle whose target button 102 is on in the video acquisition list 101. The server 80 may periodically acquire the video data and operation data collected by the vehicle-mounted device 10 while the vehicle-mounted device 10 is operating, store the data in the DB 85, and extract the corresponding video data and operation data when a target button is turned on in the video acquisition list.

[0046] In step S1, the server 80 further collects search conditions and display conditions for displaying a list of the acquired video data and operation data. FIG. 3 shows an example of an operation screen of the customer PC 30 for inputting search conditions and display conditions. Screen 110 is displayed on the customer PC 30 in response to an instruction from the server 80. Screen 110 includes an area 111 for inputting search conditions and an area 112 for inputting display conditions. By displaying screen 110 including area 112 on the customer PC 30, the server 80 presents the user with a selection of items to be displayed from among multiple items included in the operation data (step S2).

[0047] In area 111, search conditions related to location, vehicle, driver, and warning can be entered in addition to date, number of items to be extracted, and number of items to be displayed. By using search conditions related to location, vehicle, driver, and warning, the user can more easily find the video data they want. In area 112, items included in the operational data as well as the operation data are displayed as display conditions, and the user can select whether or not to display each condition by entering an on / off check box. Area 112 includes the following display conditions: location, driver, type and number of warnings, vehicle driving status, beacon position, and safety score, and it is possible to select whether or not to display each item. Including these items in the display conditions and being able to select whether or not to display each item makes it easier to perform data analysis according to the user's wishes.

[0048] When the server 80 receives the selection input of the display conditions, it extracts the video data and accompanying information (operation data and operational data) that meet the search conditions and display conditions, creates a list, and transmits it to the customer PC 30.

[0049] FIG. 4 shows an example of a list displayed on the customer PC 30. In the list displayed on the screen 120, the extracted video data is identified by the recording start time, and part of the accompanying information associated with this video data is displayed in an area 121. The screen 120 is provided with a preview button 122 and a video playback button 123. When one video data is selected in the list and the preview button 122 or the video playback button 123 is turned on, the server 80 extracts the selected video data from the DB 85. The server 80 then obtains data for the selected item of operation data associated with this video data from the DB 85 and transmits it together with the video data to the customer PC 30 (step S2). The customer PC 30 displays the received video data and operation data on the display unit 33.

[0050] The user can use the video data and accompanying information displayed on the display unit 33 to provide guidance to drivers, etc. If no video data is selected in the list and no video data is acquired by the customer PC 30 (NO in step S3), the server 80 returns to the processing of step S1.

[0051] On the other hand, when the customer PC 30 acquires video data (YES in step S3), the server 80 stores the items that are set as display conditions for the vehicle-mounted device 10 of the target vehicle that collected the acquired video data as search conditions (determination conditions) (step S4).

[0052] If the setting of the vehicle-mounted device 10 is affected (YES in step S5), the server 80 updates the setting of the vehicle-mounted device 10 (step S6), and if there is no effect (NO in step S5), the process returns to step S1. By having the vehicle-mounted device 10 memorize the judgment conditions desired by the user, the accuracy of judgment of warnings and triggers can be improved. Note that this information provision service may be a paid service, and the server 80 may charge the customer PC 30 when the video data is acquired by the customer PC 30.

[0053] As described above, according to the traffic management system 1 of this embodiment, the server 80 modifies the vehicle code and other search conditions entered by the user as search conditions for video data (first extraction conditions) to second extraction conditions. When the target button 102 is on, the second extraction condition is to add, as search targets, video data newly collected by the in-vehicle device 10 and stored in the server 80 after the first extraction conditions were entered. The server 80 accepts a selection input for which items included in the accompanying information to display, creates a list ( FIG. 4 ), and displays it on the customer PC 30. The list displays the items the user needs from the accompanying information, which includes various items, making it easy for the user to select the video data they want to view. The video data selected in the list and the data for the selected items of the accompanying information are provided to the user. Therefore, the user can grasp the details of the occurrence of an alarm, for example, by acquiring the video data at the time of the alarm together with the operational data and operation data. As described above, the traffic management system 1 improves the convenience of searching for video data and provides the user with information useful for traffic management.

[0054] The present invention is not limited to the above-described embodiment, and modifications, improvements, etc. are possible as appropriate. Furthermore, the material, shape, dimensions, numerical values, configuration, number, location, etc. of each component in the above-described embodiment are arbitrary and not limited as long as they can achieve the present invention. For example, in the above embodiment, the server 80 is the main body of the series of processes, but by transmitting and receiving the necessary data, part or all of the processes may be performed by the customer PC 30 or another communication terminal.

[0055] Here, the features of the embodiments of the information providing device, the operation management system, and the program according to the present invention will be briefly summarized and listed below in [1] to [8].

[0056] [1] A collection unit (CPU 81, communication unit 82) that collects video data captured by vehicle-mounted cameras (cameras 23A, 23B) in association with accompanying information at the time of capturing the video data; an extraction unit (CPU81) that modifies a first extraction condition input for searching the collected video data to a second extraction condition, and extracts the video data that meets the second extraction condition and the associated information corresponding to the video data from the video data and the associated information collected by the collection unit; a display condition generating unit (CPU 81, communication unit 82) that presents an item to be displayed on a user terminal (customer PC 30) in a selectable manner from at least one item included in the extracted associated information; an input receiving unit (CPU 81, communication unit 82) that receives a selection input of the items to be displayed; a providing unit (CPU 81, communication unit 82) that provides the extracted video data to the user terminal together with data of the selected item; Information providing device (server 80).

[0057] According to the information providing device having the configuration described in [1] above, video data and its associated information that meet second extraction conditions obtained by modifying the input first extraction conditions are extracted, and it becomes possible to select which items in the associated information to display. Furthermore, the video data that meets the second extraction conditions is provided to the user along with data for the selected items in the associated information. Therefore, necessary information from the associated information containing various items is provided along with the video data that the user wants to view. Therefore, the user can grasp the details of the occurrence of an alert by, for example, acquiring the video data and operation data at the time of the alert occurrence together. In this way, the information providing device described above can provide the user with information that is useful for operational management.

[0058] [2] The accompanying information includes operation data of the vehicle in which the in-vehicle camera is installed, The operation data includes position information of the vehicle, the extraction unit extracts the video data and the associated information that meet the second extraction condition related to the vehicle position information. The information providing device according to [1] above.

[0059] According to the information providing device configured as above [2], video data can be searched for using vehicle position information as an extraction condition.

[0060] [3] The accompanying information includes operational data that is the result of analyzing operational data of the vehicle in which the in-vehicle camera is installed, the operation data includes ID information for identifying beacons located around the vehicle and location information of the beacons; the extraction unit extracts the video data and the associated information that meet the second extraction condition related to the location information of the beacon. The information providing device according to [1] or [2] above.

[0061] According to the information providing device configured as described above in [3], video data can be searched using the location information of a beacon or the like carried by a worker as an extraction condition. Therefore, the user can grasp the positional relationship between his / her vehicle and workers located around his / her vehicle when, for example, a human proximity alarm is issued.

[0062] [4] The second extraction condition includes adding, as the search target, video data newly collected by the collection unit after the first extraction condition is input. The information providing device according to any one of the above [1] to [3].

[0063] According to the information providing device configured as above [4], desired video data can be searched for from newly collected video data.

[0064] [5] The providing unit provides the user terminal with a list (see FIG. 4) including information identifying each of the extracted plurality of video data and the selected items of the associated information associated with each video data; the input receiving unit receives a selection input of at least one of the video data included in the list provided to the user terminal; the providing unit provides the selected at least one piece of video data to the user together with data of the selected item. The information providing device according to any one of [1] to [4] above.

[0065] According to the information providing device having the above configuration [5], the user can select desired video data from the provided list and deselect unnecessary video data, thereby efficiently obtaining useful information.

[0066] [6] An information providing device (server 80) according to any one of [1] to [5] above; an in-vehicle device (10) mounted on a vehicle in which the in-vehicle camera is installed and capable of communicating with the information providing device; A traffic management system (1) including a communication terminal (customer PC 30) capable of communicating with the information providing device and having an operation unit and a display unit, the in-vehicle device collects the video data captured by the in-vehicle camera in association with the accompanying information, and transmits the collected video data to the information providing device; The information providing device the collection unit collects the video data and the associated information by receiving them from the vehicle-mounted device; the display condition generating unit presents the items to be displayed on the display unit in a selectable manner; the input receiving unit receives a selection input of the item to be displayed via the operation unit; the providing unit transmits the extracted video data and the data of the selected item to the communication terminal. Traffic management system (1).

[0067] According to the traffic management system having the configuration of [6] above, video data and its associated information that meet second extraction conditions obtained by modifying the first extraction conditions entered on the communication terminal are extracted, and the communication terminal can select which items in the associated information to display. Furthermore, the video data that meets the second extraction conditions is provided to the communication terminal along with data for the selected items of the associated information. Therefore, necessary information from the associated information containing various items is provided to the communication terminal along with the video data the user wants to view. Therefore, the user can grasp the details of the occurrence of an alert by, for example, acquiring the video data and operation data at the time of the alert occurrence together. In this way, the information providing device can provide the user with information useful for traffic management.

[0068] [7] Computer, a collection unit (CPU 81, communication unit 82) that collects video data captured by an in-vehicle camera in association with accompanying information at the time of capturing the video data; an extraction unit (CPU81) that modifies a first extraction condition input for searching the collected video data to a second extraction condition, and extracts the video data that meets the second extraction condition and the associated information corresponding to the video data from the video data and the associated information collected by the collection unit; a display condition generating unit (CPU 81, communication unit 82) that presents to the user a selectable item to be displayed from at least one item included in the extracted accompanying information; an input receiving unit (CPU 81, communication unit 82) that receives a selection input of the items to be displayed; a providing unit (CPU 81, communication unit 82) that provides the extracted video data to the user together with data of the selected item; A program to function as a

[0069] According to the program of the configuration [7] above, video data and its associated information that meet the second extraction conditions obtained by modifying the input first extraction conditions are extracted, and it becomes possible to select which items in the associated information to display. Furthermore, the video data that meets the second extraction conditions is provided to the user along with the data of the selected items in the associated information. Therefore, necessary information from the associated information containing various items is provided along with the video data that the user wants to view. Therefore, the user can grasp the details of the occurrence of an alert by, for example, acquiring the video data and operation data at the time of the alert occurrence together. In this way, the information providing device can provide the user with information that is useful for operation management.

[0070] [8] The first extraction condition includes at least one of identification information for identifying a vehicle in which the on-board camera is installed, the location of the vehicle, identification information for identifying a driver of the vehicle, and whether or not an alarm has been issued. The information providing device according to any one of the above [1] to [5]. [Explanation of symbols]

[0071] 1. Traffic management system 9 GPS receiver 10 Onboard equipment 11, 31, 81 Control unit (CPU) 15 Beacon receiver 23A, 23B In-vehicle camera 24, 32, 82 Communications Department 26A non-volatile memory 26B Volatile Memory 27, 33 Display section 28 G sensor 30 Customer PC 34, 83 Storage section 36 Operation section 65 Recording Media 70 Network 71 Base station 80 servers 85 Database (DB)

Claims

1. a collection unit that collects video data captured by an in-vehicle camera in association with accompanying information at the time of capturing the video data; an extraction unit that modifies a first extraction condition input for searching the collected video data to a second extraction condition, and extracts the video data that meets the second extraction condition and the associated information corresponding to the video data from the video data and the associated information collected by the collection unit; a display condition generating unit that presents to a user a selectable item to be displayed from at least one item included in the extracted accompanying information; an input receiving unit that receives a selection input of the item to be displayed; a providing unit that provides the extracted video data to the user together with data of the selected item, the second extraction condition includes adding, as a search target, video data newly collected by the collection unit after the first extraction condition is input, and The accompanying information includes operation data of the vehicle in which the on-board camera is installed and operational data that is a result of analyzing the operation data, The operation data includes information indicating a positional relationship between the vehicle and surrounding workers at the time of the alarm generation, the information being obtained from position information of the vehicle at the time of the alarm generation and beacon position information of beacons located around the vehicle. Information provision device.

2. The operation data includes position information of the vehicle, the extraction unit extracts the video data and the associated information that meet the second extraction condition related to the position information of the vehicle. The information providing device according to claim 1 .

3. the operation data includes ID information for identifying beacons located around the vehicle and location information of the beacons; the extraction unit extracts the video data and the associated information that meet the second extraction condition related to the location information of the beacon.

3. The information providing device according to claim 1 or 2.

4. the providing unit provides the user with a list including information identifying each of the extracted plurality of video data and the selected item of the associated information associated with each video data; the input receiving unit receives a selection input of at least one of the video data included in the list provided to the user; the providing unit provides the selected at least one piece of video data to the user together with data of the selected item. The information providing device according to any one of claims 1 to 3.

5. An information providing device according to any one of claims 1 to 4; an in-vehicle device mounted on a vehicle in which the in-vehicle camera is installed and capable of communicating with the information providing device; A traffic management system including a communication terminal capable of communicating with the information providing device and having an operation unit and a display unit, the in-vehicle device collects the video data captured by the in-vehicle camera in association with the operation data, and transmits the collected video data to the information providing device; The information providing device the collection unit collects the video data and the operation data by receiving them from the in-vehicle device, analyzes the operation data, and collects the operation data that is the analysis result; the operation data includes information indicating a positional relationship between the vehicle and surrounding workers at the time of the alarm generation, the information being obtained from position information of the vehicle at the time of the alarm generation and beacon position information of beacons located around the vehicle, the display condition generating unit presents the items to be displayed on the display unit in a selectable manner; the input receiving unit receives a selection input of the item to be displayed via the operation unit; the providing unit transmits the extracted video data and the data of the selected item to the communication terminal. Operation management system.

6. Computer, a collection unit that collects video data captured by the vehicle-mounted camera in association with accompanying information at the time of capturing the video data; an extraction unit that modifies a first extraction condition input for searching the collected video data to a second extraction condition, and extracts the video data that meets the second extraction condition and the associated information corresponding to the video data from the video data and the associated information collected by the collection unit; a display condition generating unit that presents to a user a selectable item to be displayed from at least one item included in the extracted accompanying information; an input receiving unit that receives a selection input of the item to be displayed; and a providing unit that provides the extracted video data to the user together with data of the selected item; A program for functioning as the second extraction condition includes adding, as a search target, video data newly collected by the collection unit after the first extraction condition is input, and The accompanying information includes operation data of the vehicle in which the on-board camera is installed and operational data that is a result of analyzing the operation data, The operation data includes information indicating a positional relationship between the vehicle and surrounding workers at the time of the alarm generation, the information being obtained from position information of the vehicle at the time of the alarm generation and beacon position information of beacons located around the vehicle. program.

Citation Information

Patent Citations

  • Information processor

    JP1996077192A

  • Electronic camera capable of photographing moving picture

    JP2004140433A

  • Image information sharing device, image information sharing system, and image information sharing method

    JP2019004373A

  • On-vehicle apparatus and system

    JP2020095596A

  • Merchandise recommendation device, information processing program and merchandise recommendation method

    JP2021033459A