Center device, video providing system, and video providing method

Abstract

To perform appropriate privacy protection according to a user who uses a video.SOLUTION: A center device according to an embodiment includes a controller. The controller collects, from an in-vehicle device managed by each of a plurality of users, a video captured by the in-vehicle device, acquires a video request from one user among the plurality of users, acquires a corresponding video corresponding to the video request from the collected videos, automatically performs concealment processing on personal information when the personal information not related to the one user is shown in the corresponding video, and performs arbitrary concealment processing on personal information related to the one user.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The disclosed embodiments relate to a center device, a video providing system, and a video providing method. [Background technology]

[0002] In the past, videos captured by drive recorders or the like managed by multiple users and stored in a central device have been shared and used among the multiple users. When the users are bus companies, taxi companies, transportation companies, etc., the videos are used as educational materials for safe driving instruction, etc. When the users are insurance companies, etc., the videos are used for verifying accident investigations, etc.

[0003] In such cases, the handling of personal information, i.e., privacy protection, can become an issue. To address this issue, a technology has been proposed that automatically applies mosaic processing to video portions that are inappropriate from the perspective of privacy protection and public order and morals (see, for example, Patent Document 1). Another technology has been proposed that performs object recognition on video captured by an in-vehicle camera and then processes it using AR (Augmented Reality), allowing the user to arbitrarily switch the display of each object on or off (see, for example, Patent Document 2). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2001-086407 [Patent Document 2] Japanese Patent Publication No. 2020-142792 Summary of the Invention [Problem to be solved by the invention]

[0005] However, when the technology disclosed in Patent Document 1 is used, there is a risk that unnecessary mosaic processing will be performed on footage used by a user for training within their own company, for example, footage that only shows objects related to the company and for which there is little need to protect privacy.

[0006] Furthermore, when the technology disclosed in Patent Document 2 is used, in cases where video is shared among multiple users, multiple users can freely switch the display of objects that are subject to privacy protection on and off, making the privacy protection essentially meaningless.

[0007] One aspect of the embodiment has been made in consideration of the above, and aims to provide a center device, a video provision system, and a video provision method that can provide appropriate privacy protection according to the user who uses the video. [Means for solving the problem]

[0008] According to one aspect of the embodiment, the center device includes a controller that collects video images captured by in-vehicle devices managed by a plurality of users, acquires a video request from one of the users, acquires video images corresponding to the video request from the collected video images, and automatically anonymizes personal information not related to the one user in the video images, and performs optional anonymization processing on personal information related to the one user. [Effects of the Invention]

[0009] According to one aspect of the embodiment, personal information that is not related to the user requesting the video and to which the user does not have authority for privacy reasons can be automatically anonymized, and personal information to which the user has authority can be arbitrarily anonymized. In other words, according to one aspect of the embodiment, appropriate privacy protection can be provided according to the user who uses the video. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram illustrating an outline of a video providing method according to an embodiment. [Figure 2] FIG. 2 is a diagram (part 1) showing a specific example in which company A requests a video. [Figure 3] FIG. 3 is a diagram (part 2) showing a specific example in which company A requests a video. [Figure 4] FIG. 4 is a diagram illustrating an example of the configuration of a video providing system according to the embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of the configuration of a drive recorder according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of the configuration of a center device according to the embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of the configuration of a user device according to the embodiment. [Figure 8] FIG. 8 is a flowchart showing the processing procedure of the video providing process executed by the center device according to the embodiment. [Figure 9] FIG. 9 is a flowchart showing the procedure of the anonymization determination process included in the video providing process. [Figure 10] FIG. 10 is a flowchart showing the processing procedure of the video providing process according to the modified example. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of the center device, video providing system, and video providing method disclosed in the present application will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to the following embodiments.

[0012] In the following description, the in-vehicle device according to the embodiment is a drive recorder 10 (see FIG. 1). The video providing system according to the embodiment is a video providing system 1 (see FIG. 1). The video providing system 1 is a system that collects and stores videos captured by drive recorders 10 managed by multiple users, and provides the corresponding videos to the users in response to their requests.

[0013] Furthermore, the video providing system 1 automatically performs anonymization processing on the video provided to the user if the video contains a privacy protection object not related to the user requesting the video, and performs optional anonymization processing on the privacy protection object related to the user requesting the video. The anonymization processing is processing for anonymizing personal information for privacy protection. An example of the anonymization processing is mosaic processing. The mosaic processing makes it easy to anonymize personal information.

[0014] In the following description, the center device according to the embodiment is assumed to be the center device 100 (see FIG. 1) included in the video providing system 1. The video providing method according to the embodiment is assumed to be executed by the controller 103 (see FIG. 6) of the center device 100.

[0015] In the following, when it is necessary to distinguish between multiple identical elements, a number in the form "-n" (n is a natural number equal to or greater than 1) may be added after the symbol indicating the element. When there is no particular need to distinguish between them, this numbering will not be used.

[0016] Furthermore, the expressions "specific," "predetermined," and "constant" in the following description may be read as "predetermined."

[0017] First, an overview of the video providing method according to the embodiment will be described with reference to Figs. 1 to 3. Fig. 1 is an explanatory diagram of the overview of the video providing method according to the embodiment. Fig. 2 is a diagram (part 1) showing a specific example of a case where company A requests a video. Fig. 3 is a diagram (part 2) showing a specific example of a case where company A requests a video.

[0018] As shown in FIG. 1, the video providing system 1 includes drive recorders 10 (10-1, 10-2, . . . 10-m), a center device 100, and user devices 200 (200-1, 200-2, . . . 200-n).

[0019] The drive recorder 10 is a video recording device mounted on a vehicle. The drive recorder 10 according to the embodiment includes an exterior camera 12a and an interior camera 12b. The exterior camera 12a is provided so as to be able to capture images of the area around the vehicle outside the vehicle. The interior camera 12b is provided so as to be able to capture images of the interior of the vehicle.

[0020] While the vehicle is running, the drive recorder 10 records vehicle data, including the vehicle exterior and interior images captured by the exterior camera 12a and the interior camera 12b, in a ring buffer memory in an overwritable manner for a certain period of time. The certain period is, for example, 24 hours. The vehicle data may include not only the vehicle exterior and interior images, but also various data indicating the vehicle's status, such as date and time information, location information, G-forces, and vehicle speed. Note that, hereinafter, vehicle data including at least the vehicle exterior and interior images may be simply referred to as "image."

[0021] The drive recorder 10 is also configured to be able to detect specific events that satisfy preset event conditions. For example, when detecting dangerous driving, the drive recorder 10 detects a specific event when a change in G-value or vehicle speed satisfies an event condition corresponding to the occurrence of an accident or a near miss.

[0022] When the drive recorder 10 detects this specific event, it sets the vehicle data for a certain period of time before and after the detection time to be overwritten. Alternatively, the drive recorder 10 records the vehicle data for a certain period of time before and after the detection time to another recording medium. Note that this overwriting prevention process or the process of recording to another recording medium may be performed in response to an instruction from the center device 100.

[0023] Furthermore, when the drive recorder 10 detects a specific event, it transmits the vehicle data set to be overwrite-prohibited to the center device 100 (steps S1 and S2).

[0024] The center device 100 collects and stores the vehicle data transmitted from each vehicle (step S3). In addition, in response to a request from each user device 200, the center device 100 retrieves the video corresponding to the request from the stored video and transmits it to the user device 200 that made the request.

[0025] 1, in the video providing system 1, the center device 100 is configured to be able to accept video requests from user devices 200 managed by a plurality of different users, such as company A, company B, ..., company X. In the video providing system 1, for example, the drive recorder 10-1 is managed by company A, the drive recorder 10-2 is managed by company B, and the drive recorder 10-m is managed by company X.

[0026] Through business partnerships or the like, Company A, Company B, ..., Company X can collectively store the videos captured by the drive recorders 10 managed by each company in the center device 100. Furthermore, through business partnerships or the like, Company A, Company B, ..., Company X can cross-sectionally use the videos stored in the center device 100 regardless of whether the videos were captured by their own drive recorders 10. In other words, in the video providing system 1, the videos stored in the center device 100 are shared among multiple users.

[0027] However, when video is shared among multiple users in this manner, there is a problem of privacy protection. For example, when user device 200-1 of company A requests video from center device 100 and receives the video from center device 100, it is undesirable for privacy protection targets related to company B or company X to appear in the video without being concealed. On the other hand, when user device 200-1 of company A requests video from center device 100 and receives the video from center device 100, it is undesirable for automatic mosaic processing or the like to be performed on the video even though only objects related to company A appear in the video.

[0028] Therefore, in the video provision method according to the embodiment, the controller 103 of the center device 100 collects video footage captured by the drive recorders 10 managed by multiple users, acquires a video request from one of the multiple users, acquires the video footage corresponding to the video request from the collected video footage, and if the video footage contains personal information not related to the one user, automatically performs an anonymization process on the personal information, and performs any anonymization process on personal information related to the one user.

[0029] 1, assume that a request for video is made from user device 200-1 of company A to center device 100 (step S4). Then, controller 103 of center device 100 acquires the video and automatically performs an anonymization process if a privacy protection object not related to company A is included in the video, and performs an optional anonymization process for a privacy protection object related to company A (step S5). Then, controller 103 transmits the video to user device 200-1, the requestor (step S6).

[0030] For example, the upper diagram in Figure 2 shows an example of video taken by drive recorder 10-1 of Company A without any concealment processing. Part M1 corresponds to the video outside the vehicle. Part M2 corresponds to the video inside the vehicle.

[0031] The M1 section shows other companies' vehicles and general vehicles traveling on the road where the vehicle of Company A is traveling, as well as signs of Company Z, which is not Company A. The M2 section shows an employee of Company A driving the vehicle of Company A.

[0032] In this case, the controller 103 of the center device 100 performs image recognition on the video and determines that the video in section M1 is a privacy protection target unrelated to Company A, such as another company's vehicle, a general vehicle, or a sign for Company Z. This determination is made, for example, by detecting an object that could be personal information (including corporate information) based on the image recognition results and determining whether the object matches pre-registered personal information of Company A (such as the license plate of Company A's vehicle, the logo design of Company A, signage, etc.). Furthermore, the controller 103 determines that the in-vehicle video in section M2 is a privacy protection target related to Company A, because it is an in-vehicle video of Company A, which is the source of the video request.

[0033] As a result, controller 103 automatically performs concealment processing such as mosaic processing on other companies' vehicles, general vehicles, and Z company signs that appear in the M1 area, as shown in the lower diagram of Fig. 2, and provides the results to user device 200-1. Note that treating the vehicle as personal information can prevent it from being identified, for example, from its license plate.

[0034] Furthermore, when the controller 103 automatically performs the anonymization process, the controller 103 does not grant, for example, Company A the editing authority for the anonymized video. This strengthens the security of the anonymization process automatically performed by the controller 103, and makes it possible to prevent, for example, personal information of other companies from being easily changed.

[0035] Furthermore, the controller 103 does not automatically perform the concealment process on the M2 portion, but the controller 103 can provide a user interface that enables arbitrary concealment process, such as "you can apply mosaic to the range selected with the mouse."

[0036] Here is another example. For example, the upper diagram of Figure 3 shows an example of video that was taken by Company A's drive recorder 10-1 and has not been concealed, similar to Figure 2. However, unlike the case of Figure 2, the M1 section shows Company A's vehicle, signboard, etc.

[0037] In this case, the controller 103 of the center device 100 performs image recognition on the video and determines that the vehicle and sign of Company A shown in part M1, as well as the in-car video in part M2, are subject to privacy protection related to Company A.

[0038] As a result, the controller 103 does not automatically perform anonymization processing on Company A's vehicles, Company A's signboards, in-car video, etc., as shown in the center diagram of Fig. 3. However, the controller 103 provides the user device 200-1 with a user interface that enables arbitrary anonymization processing, as shown in the bottom diagram of Fig. 2.

[0039] In response to this, if the operator of user device 200-1 moves cursor C1 or the like to arbitrarily specify the range to which the mosaic is to be applied, controller 103 will apply mosaic processing to the specified range, as shown in the lower diagram of FIG.

[0040] Note that, here, an example of a user interface that allows the user to specify the scope of application of mosaic processing has been given as an example of a user interface that allows arbitrary concealment processing, but arbitrary concealment processing also includes not performing concealment processing at all. Also, arbitrary concealment processing includes performing concealment processing automatically. Therefore, the controller 103 may provide a user interface that allows the user to select these concealment processing modes. This allows, for example, if the user is Company A, the user to freely handle personal information related to Company A.

[0041] As described above, in the video providing method according to the embodiment, the controller 103 of the center device 100 collects videos captured by the drive recorders 10 managed by a plurality of users. The controller 103 also acquires a video request from one of the plurality of users and acquires a video corresponding to the video request from the collected videos. If personal information not related to the one user is captured in the video, the controller 103 automatically performs an anonymization process on the personal information, and performs any anonymization process on personal information related to the one user.

[0042] Therefore, according to the video providing method of the embodiment, personal information that is not related to the user requesting the video and to which the user does not have authority for privacy reasons can be automatically concealed, and personal information to which the user has authority can be arbitrarily concealed. In other words, according to the video providing method of the embodiment, appropriate privacy protection can be provided according to the user who uses the video.

[0043] An example of the configuration of the video providing system 1 including the center device 100 to which the video providing method according to the above-described embodiment is applied will be described in more detail below.

[0044] Fig. 4 is a diagram showing an example of the configuration of a video providing system 1 according to an embodiment. As shown in Fig. 4, the video providing system 1 includes drive recorders 10-1, 10-2, ... 10-m (m is a natural number equal to or greater than 1), a center device 100, and user devices 200-1, 200-2, ... 200-n (n is a natural number equal to or greater than 1).

[0045] Each drive recorder 10, the center device 100, and each user device 200 are connected to each other so as to be able to communicate with each other via a network N1, which may be the Internet, a mobile phone network, a C-V2X (Cellular Vehicle to Everything) communication network, or the like.

[0046] As described above, the drive recorder 10 records vehicle data including interior and exterior images captured by the exterior camera 12a and the interior camera 12b, as well as various data indicating the vehicle's status, in a ring buffer memory in an overwritable manner for a certain period of time.

[0047] Furthermore, if the drive recorder 10 detects a specific event such as an accident or a near miss while the vehicle is running, the drive recorder 10 sets the vehicle data for a certain period of time before and after the detection time to be prohibited from being overwritten, or records the vehicle data for a certain period of time before and after the detection time to another recording medium.

[0048] Furthermore, when the drive recorder 10 detects a specific event, it transmits the vehicle data set to be overwrite-protected to the center device 100. The video included in this vehicle data is provided to the user by the center device 100, so that the user can use the video to investigate the situation when an accident or near miss occurs, for example, or to create educational materials related to the situation.

[0049] 1, each drive recorder 10 is managed by, for example, a plurality of different users. In the video providing system 1, for example, the drive recorder 10-1 is managed by company A, the drive recorder 10-2 is managed by company B, and the drive recorder 10-m is managed by company X. However, each drive recorder 10 may be managed collectively by, for example, the same user.

[0050] The center device 100 is realized as, for example, a cloud server and is managed by a business operator that operates the video providing system 1. The center device 100 collects and stores vehicle data transmitted from each drive recorder 10. In addition, in response to a request from a user device 200, the center device 100 transmits the corresponding video to the user device 200 that has made the request.

[0051] Furthermore, the center device 100 automatically performs an anonymization process on the video to be transmitted to the user device 200 if the video contains a privacy protection object that is not related to the user requesting the video. Furthermore, the center device 100 performs an arbitrary anonymization process on the privacy protection object that is related to the user requesting the video.

[0052] User device 200 is a computer used by a user, and is realized by a server, a PC (Personal Computer), a smartphone, etc. In addition to these, user device 200 may also be realized by, for example, a tablet terminal, a wearable device, etc.

[0053] As explained in FIG. 1, each user device 200 is managed by a plurality of different users. In the video providing system 1, for example, user device 200-1 is managed by company A, user device 200-2 is managed by company B, and user device 200-n is managed by company X. While FIG. 4 illustrates an example in which each company manages one user device 200, the number of user devices 200 managed by each company is not limited. The same applies to the drive recorder 10.

[0054] Next, a configuration example of the drive recorder 10 will be described. Fig. 5 is a diagram showing a configuration example of the drive recorder 10 according to the embodiment. As shown in Fig. 5, the drive recorder 10 has an HMI (Human Machine Interface) unit 11, a sensor unit 12, a communication unit 13, a storage unit 14, and a controller 15.

[0055] The HMI unit 11 is a component that provides interface components related to input and output to an operator who operates the drive recorder 10. The HMI unit 11 includes an input interface that accepts input operations from the operator. The input interface is realized by, for example, a touch panel. The input interface may also be realized by a microphone or the like. The input interface may also be realized by software components.

[0056] The HMI unit 11 also includes an output interface that presents visual and audio information to the operator. The output interface is realized by, for example, a display, a speaker, etc. The HMI unit 11 may also provide the operator with an input interface and an output interface integrated into one, for example, by a touch panel display.

[0057] The sensor unit 12 is a group of various sensors mounted on the drive recorder 10. The sensor unit 12 includes, for example, an exterior camera 12a, an interior camera 12b, a GPS (Global Positioning System) sensor 12c, and a G sensor 12d.

[0058] The exterior camera 12a is provided so as to be able to capture images of the area around the vehicle outside the vehicle, and is attached near the windshield, the dashboard, the rear window, or the like.

[0059] In-vehicle camera 12b is installed so that it can capture images of the interior of the vehicle. In-vehicle camera 12b is attached near the windshield or dashboard, for example, so that at least the driver's face is included in the capture range. Note that exterior camera 12a and in-vehicle camera 12b do not necessarily need to be separate and may be integrated into one camera, for example, a 360-degree camera.

[0060] The GPS sensor 12c measures the GPS position of the vehicle. The G sensor 12d measures the G value, which is the acceleration value applied to the vehicle.

[0061] In addition to the sensor unit 12, the drive recorder 10 is also connected to an in-vehicle sensor 5, which is a group of various sensors mounted on the vehicle. The in-vehicle sensor 5 includes, for example, a vehicle speed sensor, an accelerator sensor, a brake sensor, etc. The in-vehicle sensor 5 is connected to the drive recorder 10 via an in-vehicle network such as a CAN (Controller Area Network).

[0062] The communication unit 13 is realized by a network adapter etc. The communication unit 13 is wirelessly connected to the network N1 and transmits and receives information to and from the center device 100 via the network N1.

[0063] The storage unit 14 is realized by a storage device such as a read-only memory (ROM), a random access memory (RAM), a flash memory, etc. In the example of Fig. 5, the storage unit 14 stores a vehicle data DB 14a, event condition information 14b, and an image recognition model 14c.

[0064] The vehicle data DB 14a is a database of vehicle data recorded by the drive recorder 10. The event condition information 14b is information in which predetermined event conditions for detecting the above-mentioned specific events are set. The event conditions are transmitted as appropriate from, for example, the center device 100 and stored in the event condition information 14b.

[0065] The image recognition model 14c corresponds to an AI (Artificial Intelligence) model for image recognition. After being read into the controller 15 as an AI model, the image recognition model 14c is configured to be able to detect various objects and the like that appear in each frame when each frame of an outside-vehicle image or an inside-vehicle image is input to the controller 15. The event condition information 14b described above can set an event condition that combines, for example, the object detection results using the image recognition model 14c.

[0066] The controller 15 corresponds to a so-called processor. The controller 15 is realized by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphical Processing Unit), or the like. The controller 15 executes a program according to an embodiment (not shown) stored in the storage unit 14, using RAM as a work area. The controller 15 can also be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0067] The controller 15 records vehicle data including vehicle exterior images and vehicle interior images acquired by the on-board sensors 5 and the sensor unit 12 while the vehicle is running.

[0068] Furthermore, the controller 15 detects a specific event that satisfies a preset event condition based on the vehicle data acquired by the on-board sensor 5 and the sensor unit 12 and the event condition information 14b.

[0069] Furthermore, when the controller 15 detects a specific event, it sets vehicle data for a certain period of time before and after the detection time to be prohibited from being overwritten, and transmits the vehicle data to the center device 100.

[0070] Next, a configuration example of the center device 100 will be described. Fig. 6 is a diagram showing a configuration example of the center device 100 according to the embodiment. As shown in Fig. 6, the center device 100 includes a communication unit 101, a storage unit 102, and a controller 103. An HMI unit 50 is also connected to the center device 100.

[0071] The HMI unit 50 is a component that provides interface components related to input and output to an operator or the like who operates the center device 100. The HMI unit 50 includes an input interface that accepts input operations from an operator or the like. The input interface is realized by, for example, a touch panel. The input interface may also be realized by a keyboard, a mouse, a pen tablet, a microphone, or the like. The input interface may also be realized by software components.

[0072] The HMI unit 50 also includes an output interface that presents visual information and audio information to the operator, etc. The output interface is realized by, for example, a display, a speaker, etc. The HMI unit 50 may also be configured to provide the operator, etc. with an input interface and an output interface as a single unit by, for example, a touch panel display.

[0073] The communication unit 101 is realized by a network adapter etc. The communication unit 101 is connected to the network N1 by wire or wirelessly, and transmits and receives information between the drive recorder 10 and the user device 200 via the network N1.

[0074] The storage unit 102 is realized by a storage device such as a ROM, a RAM, a flash memory, an HDD (Hard Disk Drive), etc. In the example of Fig. 6, the storage unit 102 stores a collected information DB 102a, a user management information DB 102b, an image recognition model 102c, and anonymization processing information 102d.

[0075] The collected information DB 102a is a database that stores vehicle data collected from each drive recorder 10. The user management information DB 102b is a database of various information for managing users.

[0076] The various information for managing users includes identification information for identifying each user. The various information for managing users also includes identification information for identifying the vehicle, drive recorder 10, user device 200, etc. managed by each user. The various information for managing users also includes personal information about each user that should be protected from the viewpoint of privacy protection.

[0077] The image recognition model 102c is an AI model for image recognition. Like the image recognition model 14c described above, the image recognition model 102c is a DNN model trained using, for example, a deep learning algorithm.

[0078] The image recognition model 102c is loaded into the controller 103 as a DNN model, and is configured to be able to detect various objects, etc. contained in each frame image when each frame image of an outside or inside vehicle image is input to the controller 103.

[0079] The image recognition model 102c is configured to be able to detect, for example, people and various objects other than people when each frame image is input. Furthermore, the image recognition model 102c is configured to be able to detect various objects, such as vehicles, vehicle license plates, road signs, traffic lights, and signboards. Furthermore, the image recognition model 102c is configured to be able to detect characters and the like written on these detected various objects. By detecting characters written on various objects, it is possible to identify vehicles managed by each user from, for example, license plates. Alternatively, it is possible to anonymize, for example, place names in the anonymization process.

[0080] The concealment processing information 102d is information in which various parameters used when the concealment processing is performed by the controller 103. For example, if the concealment processing is a mosaic processing, the various parameters include parameters related to the mosaic processing.

[0081] The controller 103 corresponds to a so-called processor. The controller 103 is realized by a CPU, an MPU, a GPU, or the like. The controller 103 executes a program according to an embodiment (not shown) stored in the storage unit 102, using a RAM as a work area. The controller 103 can also be realized by an integrated circuit such as an ASIC or an FPGA.

[0082] The controller 103 provides the user device 200 with a user interface, such as a video search screen, list screen, or selection screen, for transmitting a video request, which is data requesting a video from the user device 200, via the communication unit 101. The controller 103 also executes a video providing process based on the video request from the user device 200 via the user interface, according to the processing procedures shown in Figures 8 and 9. An explanation using Figures 8 and 9 will be given later.

[0083] Next, a description will be given of an example configuration of the user device 200. Fig. 7 is a diagram showing an example configuration of the user device 200 according to the embodiment. As shown in Fig. 7, the user device 200 includes an HMI unit 201, a communication unit 202, a storage unit 203, and a controller 204.

[0084] The HMI unit 201 is a component that provides interface components related to input and output to an operator or the like who operates the user device 200. The HMI unit 201 is a component similar to the HMI units 11 and 50 already described, and therefore further description will be omitted.

[0085] The communication unit 202 is realized by a network adapter etc. The communication unit 202 is connected to the network N1 by wire or wirelessly, and transmits and receives information to and from the center device 100 via the network N1.

[0086] The storage unit 203 is realized by a storage device such as a ROM, a RAM, a flash memory, a HDD, etc. In the example of Fig. 7, the storage unit 203 stores user information 203a.

[0087] The user information 203a includes information that allows the center device 100 to identify the user and the user device 200. When the user device 200 transmits a video request to the center device 100, the user device 200 includes the user information 203a in the video request.

[0088] The controller 204 corresponds to a so-called processor. The controller 204 is realized by a CPU, an MPU, a GPU, or the like. The controller 204 executes a program according to an embodiment (not shown) stored in the storage unit 203, using the RAM as a work area. The controller 204 can also be realized by an integrated circuit such as an ASIC or an FPGA.

[0089] The controller 204 displays the above-mentioned user interface provided by the center device 100 on the HMI unit 201. The controller 103 also generates a video request to the center device 100 based on an input to this user interface via the HMI unit 201. The controller 103 also transmits the generated video request to the center device 100 via the communication unit 202.

[0090] The controller 204 also receives, from the center device 100, a video corresponding to the video request transmitted to the center device 100, via the communication unit 202. The controller 204 also causes the HMI unit 201 to display the video received from the center device 100.

[0091] Furthermore, the controller 204 accepts any concealment processing for the displayed video based on input via the HMI unit 201. When any concealment processing is accepted, the controller 204 requests the center device 100 to perform concealment processing based on the accepted content, receives the video that has been concealed in response to the request from the center device 100, and causes the HMI unit 201 to display it.

[0092] Next, the processing procedure of the video provision processing executed by the center device 100 will be described with reference to Fig. 8 and Fig. 9. Fig. 8 is a flowchart showing the processing procedure of the video provision processing executed by the center device 100 according to the embodiment. Fig. 9 is a flowchart showing the processing procedure of the anonymization determination processing included in the video provision processing.

[0093] 8, the controller 103 of the center device 100 first receives a video request from the user device 200 (step S101). Then, the controller 103 receives and analyzes the video captured by the vehicle (i.e., the drive recorder 10) that corresponds to the request from the videos stored in the collected information DB 102a (step S102).

[0094] Then, the controller 103 executes an anonymization determination process based on the analysis result (step S103). In the anonymization determination process, the controller 103 determines whether or not a privacy protection object unrelated to the requesting user who requested the video is shown based on the analysis result of step S102, as shown in Fig. 9 (step S201).

[0095] For example, if the requesting user is Company A, privacy protection targets not related to the requesting user include vehicles of other companies (e.g., Company B or Company X), general vehicles, pedestrians, etc. If a privacy protection target not related to the requesting user is captured (step S201, Yes), the controller 103 automatically executes anonymization processing (step S203) and terminates the anonymization determination processing.

[0096] On the other hand, if a privacy protection object not related to the requesting user is not shown (step S201, No), the controller 103 determines whether or not the requesting user has designated any concealment process (step S202).

[0097] If an arbitrary anonymization process is designated (step S202, Yes), the controller 103 executes the arbitrary anonymization process with the designated contents (step S203) and ends the anonymization determination process. On the other hand, if an arbitrary anonymization process is not designated (step S202, No), the controller 103 ends the anonymization determination process without executing the anonymization process.

[0098] Returning to the description of Fig. 8, after the anonymization determination process is executed, the controller 103 transmits the video corresponding to the request to the request source (step S104), and the process ends.

[0099] In addition, when an event occurs, in addition to the footage taken by the company's vehicle involved in the event, the company's vehicle may also appear in footage taken by surrounding vehicles at the time of the event. In such cases, it is desirable to also utilize the footage taken by surrounding vehicles for accident investigations, etc.

[0100] Next, a processing procedure of a modified example in which video images captured by surrounding vehicles are also acquired will be described. Fig. 10 is a flowchart showing the processing procedure of the video providing process according to the modified example.

[0101] 10, the controller 103 of the center device 100 receives a request for a video of the user's company vehicle from the user device 200 (step S301). Then, the controller 103 retrieves and analyzes the video of the vehicle corresponding to the request from the videos stored in the collected information DB 102a (step S302).

[0102] Furthermore, the controller 103 determines whether or not there is any video footage of the surrounding vehicles at the time of the event occurrence in the collected information DB 102a based on, for example, date and time information and location information included in the analysis result (step S303). If there is any video footage of the surrounding vehicles (step S303, Yes), the controller 103 acquires and analyzes the video footage (step S304).

[0103] Then, the controller 103 executes a loop process the number of times equal to the total number of videos acquired in steps S302 and S304 (step S305). In this loop process, the controller 103 executes the anonymization determination process described with reference to Fig. 9 (step S306).

[0104] Then, when the controller 103 exits the loop processing, it creates a list of the videos (step S307). Then, the controller 103 transmits the list to the request source, transmits the video selected from the list to the request source (step S308), and ends the processing. Note that by listing the videos and making them selectable by the user, the user can easily select the video they want to use.

[0105] Furthermore, if there is no video of the surrounding vehicle when the event occurred (step S303, No), the controller 103 executes the anonymization determination process described with reference to Fig. 9 (step S309). Then, the controller 103 transmits the video after the anonymization determination process to the request source (step S310), and ends the process.

[0106] Furthermore, with this modified example of the video provision process, the user can compare and view not only the video seen from the perspective of the person involved at the time the event occurred, but also the video of vehicles traveling in the vicinity, allowing for detailed confirmation of the situation.

[0107] As described above, the center device 100 according to the embodiment includes the controller 103. The controller 103 collects video images captured by the drive recorders 10 (corresponding to an example of an "in-vehicle device") managed by a plurality of users. The controller 103 also acquires a video request from one of the plurality of users, and acquires a video image corresponding to the video request from the collected video images. If personal information not related to the one user is captured in the video image, the controller 103 automatically performs an anonymization process on the personal information, and performs any anonymization process on personal information related to the one user.

[0108] Therefore, the center device 100 according to the embodiment can automatically conceal personal information that is not related to the user requesting the video and to which the user does not have authority for privacy protection, and can perform arbitrary concealment processing for personal information to which the user has authority. In other words, the video providing method according to the embodiment can provide appropriate privacy protection according to the user who uses the video.

[0109] Further advantages and modifications will readily occur to those skilled in the art. Therefore, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents. [Explanation of symbols]

[0110] 1. Video provision system 5. In-vehicle sensors 10 Drive Recorder 11 HMI section 12 Sensor section 13 Communications Department 14 Storage section 15 Controller 50 HMI section 100 Center Device 101 Communications Department 102 Storage section 103 Controller 200 User Device 201 HMI Department 202 Communications Department 203 Storage section 204 Controller

Claims

1. Collecting images captured by in-vehicle devices managed by a plurality of users, acquiring a video request from one of the plurality of users; Obtaining a corresponding image corresponding to the image request from the collected images; If the video contains personal information not related to the user, the personal information is automatically concealed; a controller that performs the optional anonymization process on personal information related to the one user; A center device comprising:

2. the optional concealment processing includes not performing the concealment processing and automatically performing the concealment processing; The controller providing a user interface that allows the one user to select any one of the concealment processes; The center device according to claim 1 .

3. The controller When the masking process is performed automatically, the one user is not granted editing authority for the video after the masking process. The center device according to claim 2 .

4. The in-vehicle device capturing the video when an event that satisfies a predetermined event condition occurs; The center device according to claim 1 .

5. The controller determining whether or not there is any video footage taken by another in-vehicle device that was present around the in-vehicle device that took the video footage at the time the event occurred, based on date and time information and location information included in the video footage; If the photographed video exists, and if personal information not related to the one user is captured in the photographed video, the anonymization process is automatically performed on the personal information; Any of the above-mentioned anonymization processes is performed on personal information related to the one user. The center device according to claim 4.

6. The controller The video and the captured video after the anonymization process are listed and provided to the one user in a selectable manner. The center device according to claim 5 .

7. The concealment process includes a mosaic process. The center device according to claim 1 .

8. The personal information includes vehicles managed by each of the plurality of users. The center device according to any one of claims 1 to 7.

9. The system includes an in-vehicle device managed by each of a plurality of users, a user device used by each of the plurality of users, and a center device, The in-vehicle device Taking a video and transmitting it to the center device, The center device Collecting the video transmitted from the in-vehicle device; acquiring a video request from the user device used by one of the plurality of users; Obtaining a corresponding image corresponding to the image request from the collected images; If the video contains personal information not related to the user, the personal information is automatically concealed; Any of the above-mentioned anonymization processes is performed on personal information related to the one user. Video provision system.

10. A video providing method executed by a controller included in a center device, comprising: collecting images captured by in-vehicle devices managed by a plurality of users; obtaining a video request from one of the plurality of users; Obtaining a corresponding video corresponding to the video request from the collected videos; If personal information not related to the one user is shown in the video, the personal information is automatically concealed; performing any of the anonymization processes on personal information related to the one user; A video provision method including:

Images