Information processing system, information processing method, and program

Abstract

To provide a moving image in which only a part to be concealed is hardly visually recognized and a necessary part is easily visually recognized.SOLUTION: The information processing system includes an information processing device configured to acquire a basic moving image that is a moving image of a predetermined length corresponding to a first point and a first time designated by a user, the basic moving image being captured by an in-vehicle camera mounted on a predetermined vehicle, generate a first moving image by performing a first process of reducing a resolution of the entire basic moving image on the basic moving image, display the first moving image, and perform a second process of reducing a visibility of a specific object included in the basic moving image on the basic moving image when a request is received from a user. A second moving image is generated, and the second moving image is displayed.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to surveillance systems. [Background technology]

[0002] There is a technology for monitoring using a mobile object equipped with a camera. In this regard, for example, Patent Document 1 discloses a disaster report information display device that includes an input unit that inputs first disaster report information including location information of a reported disaster, a receiving unit that receives second disaster report information including second location information that has been input to another disaster report information display device, and a display unit that displays a map of the location where the disaster occurred. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-16207 [Patent Document 2] Japanese Patent Application Publication No. 2023-128156 Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure aims to protect privacy in a surveillance system that acquires video from a vehicle. [Means for solving the problem]

[0005] One aspect of the present disclosure is The device has a control unit that executes the following operations: acquiring a basic video image, which is a video image of a predetermined length captured by an on-board camera mounted on a predetermined vehicle and corresponding to a first location and a first time specified by a user; performing a first process on the basic video image to reduce the overall resolution of the basic video image, thereby generating a first video image; displaying the first video image; and, when a request is received from the user, performing a second process on the basic video image to reduce the visibility of a specific object included in the basic video image, thereby generating a second video image; and displaying the second video image. It is an information processing system.

[0006] Another aspect of the present disclosure is The method includes the steps of: acquiring a basic video, which is a video of a predetermined length captured by an on-board camera mounted on a predetermined vehicle and corresponding to a first location and a first time specified by a user; generating a first video by performing a first process on the basic video to reduce the overall resolution of the basic video; displaying the first video; when a request is received from the user, generating a second video by performing a second process on the basic video to reduce the visibility of a specific object included in the basic video; and displaying the second video. It is an information processing method.

[0007] Another aspect is a program for causing a computer to execute the information processing method, or a computer-readable storage medium that non-temporarily stores the program. [Effects of the Invention]

[0008] According to the present disclosure, it is possible to make only the parts that should be concealed difficult to see, and to make the necessary parts easily visible. Images can be provided. [Brief explanation of the drawings]

[0009] [Figure 1]10 is a diagram showing a process in which a server device according to an embodiment of the present disclosure provides a first video image and a second video image. [Figure 2] 2 is a diagram illustrating components of an in-vehicle device, a server device, and a terminal device according to an embodiment. FIG. [Figure 3] FIG. 3 is a sequence diagram of processes executed by the in-vehicle device, the server device, and the terminal device according to the embodiment. [Figure 4] FIG. 4 is a flowchart of a process executed by a control unit of the server device according to the embodiment. [Figure 5] 3A and 3B are diagrams showing examples of a first video sequence and a second video sequence. [Figure 6] FIG. 10 is a diagram showing an example of an object whose visibility is to be reduced in the second video. DETAILED DESCRIPTION OF THE INVENTION

[0010] (overview) In recent years, automobiles have become increasingly connected, with an increasing number of vehicles equipped with communication functions and in-vehicle cameras.

[0011] In relation to this, by making it possible for designated agencies to access footage captured by cameras (such as dashcams) mounted on vehicles, it can be useful in the initial response to incidents and accidents.

[0012] For example, when a call is made to 110 or 119, relevant authorities can quickly confirm the situation at the scene by obtaining dashcam footage from a vehicle that was traveling near the relevant location around the time the incident occurred.

[0013] A known monitoring system for this purpose is one that maps icons representing the driving positions of multiple vehicles at a specific time in the past onto a map and presents them to an operator. By selecting one of the icons, the operator can view video captured at the position corresponding to the icon.

[0014] In this case, from the viewpoint of privacy protection, it is conceivable to provide a moving image with a lowered overall resolution so that the faces of people or license plates of vehicles that are reflected in the image cannot be identified.

[0015] However, when a monitoring system operator wants to check the scene of a traffic accident, etc., if only video images with a lowered overall resolution are available, the operator may not be able to clearly identify objects such as the involved vehicle. For example, by checking low-resolution video images, the operator may determine that a person has fallen on the road and that a traffic accident may have occurred at that location. However, it may actually be the case that some kind of fallen object has simply fallen on the road, and no traffic accident has occurred at that location.

[0016] To solve this problem, it is preferable that the surveillance system can provide video images in which the visibility of only objects that need to be concealed is reduced while maintaining high visibility of the entire video image. For example, the surveillance system can solve the above problem by maintaining high resolution of the entire video image while reducing the visibility of objects that need to be concealed, such as the faces of passersby or the license plates of vehicles.

[0017] An information processing system according to one embodiment of the present disclosure includes: The device has a control unit that performs the following operations: acquires a basic video, which is a video of a predetermined length captured by an onboard camera mounted on a predetermined vehicle and corresponds to a first location and a first time specified by a user; generates a first video by performing a first process on the basic video to reduce the overall resolution of the basic video; displays the first video; and, when a request is received from the user, generates a second video by performing a second process on the basic video to reduce the visibility of a specific object included in the basic video; and displays the second video.

[0018] A basic video is a video of a series of videos captured by an on-board camera that corresponds to a first location, which is a location designated by a user, and a first time, which is a time designated by the user. For example, a basic video is a video of a predetermined length that is captured at a first location at a first time by an on-board camera mounted on an arbitrary vehicle.

[0019] The first processing refers to processing that reduces the overall resolution of the basic video sequence.

[0020] The first video refers to a basic video that has been subjected to the first processing. The first video is a video obtained by reducing the overall resolution, and is generated based on the basic video.

[0021] The second process is a process for reducing the visibility of a specific object included in the basic video. In the second process, the resolution of the entire basic video is not reduced, and a process for reducing the visibility is performed only on the portion corresponding to the specific object. Examples of the process for reducing the visibility include a process for reducing the resolution of the specific object or a process for masking the specific object.

[0022] The second video refers to the basic video that has been subjected to the second processing. The second video is a video in which the visibility of only the portion corresponding to a specific object is reduced, and is generated based on the basic video.

[0023] An information processing system according to one embodiment of the present disclosure generates and displays a first moving image in which the overall resolution of a basic moving image is reduced, and upon receiving a request from a user, further generates and displays a second moving image in which the visibility of a specific object included in the basic moving image is reduced.

[0024] According to this configuration, it is possible to provide a moving image in which only the portions that should be concealed are made difficult to see and the necessary portions are easily seen. The information processing system according to one aspect of the present disclosure provides a moving image in which the visibility of only the objects that need to be concealed is reduced and the resolution of the other portions is maintained high, thereby allowing the user to accurately check the current status of roads, etc.

[0025] In addition, the control unit may display an interface for accepting the request from the user while the first moving image is being played back, and when an operation on the interface is detected, perform the second processing for a predetermined time range of the basic moving image that includes the timing specified by the operation.

[0026] For example, when the user performs an operation to specify a time range while checking the first moving image, the control unit executes the second processing for that time range and generates the second moving image. This makes it possible to perform the second processing only for the time range that the user determines is necessary, thereby reducing the amount of processing required to generate the second moving image.

[0027] Furthermore, the control unit may perform, as the second processing, processing to mask the specific object or processing to reduce the resolution of the specific object.

[0028] An information processing method according to one embodiment of the present disclosure includes the steps of acquiring a basic moving image, which is a moving image of a predetermined length captured by an onboard camera mounted on a predetermined vehicle and corresponding to a first location and a first time specified by a user; generating a first moving image by performing a first processing on the basic moving image to reduce the overall resolution of the basic moving image; displaying the first moving image; and, when a request is received from the user, generating a second moving image by performing a second processing on the basic moving image to reduce the visibility of a specific object included in the basic moving image; and displaying the second moving image.

[0029] As a result, the information processing method according to one aspect of the present disclosure can achieve the same effects as the information processing system.

[0030] Specific embodiments of the present disclosure will be described below with reference to the accompanying drawings. Unless otherwise specified, the hardware configuration, module configuration, functional configuration, etc. described in each embodiment are not intended to limit the technical scope of the disclosure to those configurations.

[0031] (First embodiment) [Outline of processing performed by the server device] An overview of a system according to an embodiment will be described with reference to FIG. 1. FIG. 1 is a diagram illustrating a process in which a server device 2 according to an aspect of the present disclosure provides a first video and a second video. The system according to this embodiment is realized as a system including, for example, an in-vehicle device 1, the server device 2, and a terminal device 3. In this embodiment, the server device 2 receives video captured by an in-vehicle camera from the in-vehicle device 1 provided in a vehicle 40. The server device 2 then processes the received video and provides it to the terminal device 3 used by a user.

[0032] First, an on-board camera mounted on vehicle 40 captures a moving image. Hereinafter, the captured moving image will be referred to as a basic moving image. A basic moving image is a moving image of a predetermined length that has not been processed in any way and is captured by the on-board camera.

[0033] Next, the server device 2 acquires basic moving images captured by an in-vehicle camera from the in-vehicle device 1 installed in the vehicle 40. For example, the server device 2 periodically performs wireless communication with the in-vehicle device 1, acquires the basic moving images and location information from the in-vehicle device, and stores them.

[0034] The server device 2 provides video images captured by an on-board camera to a terminal device 3, which is a terminal used by a user. First, the server device 2 causes the terminal device 3 to display icons indicating the locations where each of the multiple vehicles received by the server device 2 has traveled on a map for each time. When the user performs an operation on the terminal device 3 to designate a specific icon, the server device 2 identifies the basic moving image acquired at the position and time corresponding to the icon, and performs the following process.

[0035] First, the server device 2 applies processing to the identified basic video to reduce the overall resolution of the video. Here, the video with the reduced overall resolution of the basic video is referred to as the first video. Then, the server device 2 displays the first video on the terminal device 3. At the same time, the server device 2 displays an interface 70 on the terminal device 3 along with the first video.

[0036] The interface 70 is a user interface for a user to specify a specific time range of the first video and request a new second video. Here, the second video refers to a video generated by performing processing on a basic video to reduce the visibility of only a specific object, rather than reducing the overall resolution. By specifying a specific time range of the first video via the interface 70, the user can request the server device 2 to generate a second video corresponding to the specified time range.

[0037] When the server device 2 detects a request for a second video on the terminal device 3, the server device 2 generates a second video from the basic video by reducing the visibility of only a specific object. Then, the server device 2 causes the terminal device 3 to display the second video.

[0038] As described above, the server device 2 first provides the user with a first moving image in which the overall resolution has been reduced. Then, upon request, the server device 2 subsequently provides the user with a second moving image, which is a moving image corresponding to a time range specified by the user and in which the visibility of only a specific object has been reduced. This allows the server device 2 to provide the user with an image in which the image content is easier to view than before, with high image quality for the parts of the image other than those to be concealed.

[0039] [Configuration of information processing system] Next, the hardware and software configurations of the devices constituting the information processing system will be described. Fig. 2 is a diagram illustrating the components of the in-vehicle device 1, server device 2, and terminal device 3 according to the embodiment.

[0040] The in-vehicle device 1 can be configured as a computer having a processor (CPU, GPU, etc.), a main memory device (RAM, ROM, etc.), and an auxiliary memory device (EPROM, hard disk drive, removable media, etc.). The auxiliary memory device stores an operating system (OS), various programs, various tables, etc., and by executing the programs stored therein, various functions (software modules) that match predetermined purposes, as described below, can be realized. However, some or all of the functions may be realized as hardware modules using hardware circuits such as ASICs, FPGAs, etc.

[0041] The in-vehicle device 1 includes a control unit 11, a storage unit 12, a communication unit 13, a position information acquisition unit 14, and a camera 15.

[0042] The control unit 11 is a computing unit that executes predetermined programs to realize various functions of the in-vehicle device 1. The control unit 11 can be realized by, for example, a hardware processor such as a CPU. The control unit 11 may also be configured to include RAM, ROM (Read Only Memory), cache memory, etc.

[0043] In this embodiment, the control unit 11 of the in-car device 1 is configured to have three software modules: a photographing unit 111, a notification unit 112, and a provision unit 113. Each software module may be realized by the control unit 11 (CPU, etc.) executing a program stored in the storage unit 12. Note that the information processing executed by the software modules is synonymous with the information processing executed by the control unit 11 (CPU, etc.).

[0044] While the device is in operation, the photographing unit 111 photographs moving images (in-vehicle images) using the camera 15 and stores the obtained data in the storage unit 12. The photographing unit 111 receives power supply from the vehicle and photographs continuously, and records the obtained moving image data in the storage unit 12.

[0045] Video data is made up of multiple video files. There is an upper limit to the length of a video corresponding to one file, and if the upper limit is exceeded, a new video file is generated. In this embodiment, a video file is generated every minute. If the storage capacity is insufficient, the shooting unit 111 deletes the oldest video file to secure free space and then continues shooting. In this embodiment, each video file is associated with an identifier (date and time ID) that identifies the date and time when the video file was generated (i.e., the date and time when shooting started). The date and time ID may uniquely identify the year, month, day, hour, minute, and second. The video data captured by the imaging unit 111 is the basic video image described above.

[0046] When the image capturing unit 111 is activated, the in-vehicle device 1 functions as a drive recorder.

[0047] The notification unit 112 periodically generates data related to the traveling of the vehicle (hereinafter referred to as vehicle data) and transmits it to the server device 2. In this embodiment, the vehicle data includes the position information of the vehicle 10, the traveling direction of the vehicle 10, and a date and time ID indicating the date and time when the position information was acquired.

[0048] In this embodiment, the vehicle data includes an identifier (vehicle ID) that uniquely identifies the vehicle 10, the date and time when the vehicle data was generated, an identifier (date and time ID) that uniquely identifies the date and time, location information, and information indicating the direction of travel. The location information and direction of travel can be acquired from the location information acquisition unit 14, which will be described later.

[0049] The vehicle data is generated and transmitted at a predetermined cycle. The predetermined cycle may be measured independently, or may be linked to the image capturing unit 111. For example, the notification unit 112 may generate vehicle data at the timing when the image capturing unit 111 generates a new video file (for example, at one-minute intervals). In this case, the date and time indicated by the vehicle data will be the same as the date and time when the new video file was generated.

[0050] The providing unit 113 periodically transmits the video data generated by the shooting unit 111 to the server device 2. For example, when the timing for periodically providing the basic video arrives, the providing unit 113 acquires the video data of the basic video from the storage unit 22 and transmits it to the server device 2. The video data transmitted to the server device 2 is used by the server device 2 to generate the first video and the second video.

[0051] The storage unit 12 is a means for storing information, and is configured with storage media such as RAM, a magnetic disk, a flash memory, etc. The storage unit 12 stores programs executed by the control unit 11, data used by the programs, etc.

[0052] The communication unit 13 is a wireless communication interface for connecting the in-vehicle device 1 to an external network. The communication unit 13 is configured to be able to communicate with the server device 2 via, for example, a wireless LAN or a cellular communication network such as 3G, 4G, or 5G.

[0053] The position information acquisition unit 14 acquires position information of the vehicle 10. The position information acquisition unit 14 includes a GPS antenna and a positioning module for determining the position information. The GPS antenna is an antenna that receives positioning signals transmitted from positioning satellites (also referred to as GNSS satellites). The positioning module is a module that calculates position information based on the signals received by the GPS antenna. The position information acquisition unit 14 may determine the traveling direction of the vehicle 10 based on the transition of the position information.

[0054] The camera 15 is an optical unit including an image sensor for acquiring images, and is mounted, for example, facing forward of the vehicle 10.

[0055] Next, the server device 2 will be described.

[0056] Like the in-vehicle device 1, the server device 2 can be configured as a computer having a processor (CPU, GPU, etc.), a main memory device (RAM, ROM, etc.), and an auxiliary memory device (EPROM, hard disk drive, removable media, etc.).

[0057] The server device 2 includes a control unit 21, a storage unit 22, and a communication unit .

[0058] The control unit 21 is a computing unit that executes predetermined programs to realize various functions of the server device 2. The control unit 21 can be realized by, for example, a hardware processor such as a CPU. The control unit 21 may also be configured to include RAM, ROM, cache memory, etc.

[0059] In this embodiment, the control unit 21 of the server device 2 is configured to have four software modules: an acquisition unit 211, a first processing unit 212, a second processing unit 213, and an information providing unit 214. Each software module may be realized by the control unit 11 (CPU, etc.) executing a program stored in the storage unit 22. Note that the information processing executed by the software modules is synonymous with the information processing executed by the control unit 21 (CPU, etc.).

[0060] The acquisition unit 211 acquires basic moving images from the in-car device 1. For example, the acquisition unit 211 may acquire basic moving images that are periodically transmitted from the in-car device 1. The acquisition unit 211 stores the acquired basic moving images in the storage unit 22.

[0061] Furthermore, the acquisition unit 211 receives vehicle data from a plurality of vehicles 40 (on-vehicle devices 1) and stores the vehicle data in the storage unit 22. For example, the acquisition unit 211 may store the vehicle data received from a plurality of vehicles 40 in a table (referred to as a vehicle data table).

[0062] The first processing unit 212 performs a first process on the basic video to generate a first video. Here, the first process is a process of reducing the resolution of the entire basic video. When the first processing unit 212 receives information for identifying an icon designated by the user of the terminal device 3 (hereinafter, icon selection information) from the video acquisition unit 312, the first processing unit 212 acquires a basic video corresponding to the icon from the storage unit 22, and performs a first process on the basic video to generate a first video.

[0063] The second processing unit 213 performs a second process on the basic video to generate a second video. Here, the second process is a process of reducing the visibility of only a specific object included in the basic video. The second video is a video in which the visibility of only the specific object is reduced, while everything other than the specific object is displayed with high image quality. When the second processing unit 213 receives a second video request from the video acquisition unit 312 of the terminal device 3, it performs the second process on the basic video corresponding to the time range specified in the request to generate a second video.

[0064] The information providing unit 214 provides information to the terminal device 3 based on the information stored in the storage unit 22. Specifically, the information providing unit 214 performs the following two types of processing.

[0065] (1) Providing information on vehicle location The vehicle data table stores location information of the vehicle 40 equipped with the in-vehicle device 1 that functions as a drive recorder, in association with date and time information. By referring to this, it is possible to extract vehicles that have traveled within a specified area within a specified time range.

[0066] When a request is received from the terminal device 3, the information providing unit 214 extracts vehicles that have traveled within a specified area within a specified time period, and transmits pairs of location information and date and time information to the terminal device 3. As a result, an icon corresponding to the vehicle is displayed on the terminal device 3 side. The location information can be mapped on a map. The location information may include information indicating the direction of travel.

[0067] (2) In-car video broadcasting The information providing unit 214 provides the first moving image generated by the first processing unit 212 that has received the icon selection information to the terminal device 3. The icon selection information includes information that identifies the target vehicle and the target date and time. Furthermore, the information providing unit 214 provides the terminal device 3 with the second video generated by the second processing unit 213 upon receiving the second video request.

[0068] The storage unit 22 is a means for storing information, and is configured with storage media such as RAM, a magnetic disk, a flash memory, etc. The storage unit 22 stores programs executed by the control unit 21, data used by the programs, etc.

[0069] The storage unit 22 also stores a table (vehicle data table) for storing data received from the in-vehicle device 1.

[0070] The communication unit 23 is a communication interface for connecting the server device 2 to a network. The communication unit 23 is configured to be able to communicate with the network via, for example, Ethernet (registered trademark), a wireless LAN, a cellular communication network, or the like.

[0071] Next, the terminal device 3 will be described. Like the in-vehicle device 1 and the server device 2, the terminal device 3 can be configured as a computer having a processor (CPU, GPU, etc.), a main memory device (RAM, ROM, etc.), and an auxiliary memory device (EPROM, hard disk drive, removable media, etc.).

[0072] The terminal device 3 includes a control unit 31, a storage unit 32, a communication unit 33, and an input / output unit .

[0073] The control unit 31 is a computing unit that executes predetermined programs to realize various functions of the terminal device 3. The control unit 31 can be realized by a hardware processor such as a CPU, for example. The control unit 31 may also be configured to include RAM, ROM, cache memory, etc.

[0074] In this embodiment, the control unit 31 of the terminal device 3 is configured to have two software modules: a display control unit 311 and a video acquisition unit 312. Each software module may be realized by the control unit 11 (CPU, etc.) executing a program stored in the storage unit 32. Note that the information processing executed by the software module is synonymous with the information processing executed by the control unit 31 (CPU, etc.).

[0075] The display control unit 311 generates a user interface (GUI) for requesting acquisition of in-vehicle video and outputs it via the input / output unit 34, which will be described later. In this embodiment, the display control unit 311 generates and outputs a user interface including a road map image based on road map data stored or acquired in advance. Furthermore, the display control unit 311 displays a user interface that displays an icon corresponding to the position where the basic video image was acquired on the road map based on information acquired from the server device 2.

[0076] Specifically, the display control unit 311 receives from the user the setting of the target area and target period for which the road map is to be displayed. Then, the display control unit 311 requests the server device 2 to provide a vehicle list for the set target area and target period. Next, the display control unit 311 Based on the received vehicle list, an icon corresponding to the position and time of the vehicle that captured the basic moving image is displayed on the road map.

[0077] When the user selects one of the mapped icons, the video acquisition unit 312 transmits, to the server device 2, icon selection information for requesting a first moving image generated from the basic moving image acquired at the position corresponding to the selected icon. The video acquisition unit 312 also plays the first moving image transmitted from the server device 2. The video acquisition unit 312 also generates and outputs an interface 70 on a playback screen for the first moving image.

[0078] The interface 70 is a user interface for a user to specify a specific time range of the first video and newly request a second video. For example, the interface 70 may be configured with a component for specifying the start timing of the second video, a component for specifying the end timing of the second video, and a component for requesting generation of the second video.

[0079] When the video acquisition unit 312 detects via the interface 70 that a specific time range of the first video has been designated, it transmits a second video request to the server device 2 to request the second video corresponding to that time range. In addition, the video acquisition unit 312 plays the second video transmitted from the server device 2.

[0080] The storage unit 32 is a means for storing information, and is configured with storage media such as RAM, a magnetic disk, a flash memory, etc. The storage unit 32 stores programs executed by the control unit 31, data used by the programs, etc.

[0081] The communication unit 33 is a communication interface for connecting the terminal device 3 to an external network. The communication unit 33 may be an interface for wireless communication or an interface for wired communication. The communication unit 33 is configured to be able to communicate with the server device 2 via, for example, a wireless LAN or a cellular communication network such as 3G, 4G, or 5G.

[0082] The input / output unit 34 is a unit that receives input from a user of the device and presents information to the user. Specifically, the input / output unit 34 is composed of a touch panel and its control means, and a liquid crystal display and its control means. In this embodiment, the touch panel and the liquid crystal display are composed of a single touch panel display.

[0083] 2 is an example, and all or part of the illustrated functions may be performed using a dedicated circuit. Also, programs may be stored or executed using a combination of a main memory and an auxiliary memory other than those illustrated.

[0084] [Information Processing System Processing] Next, a specific content of the process performed by the information processing system according to an embodiment of the present disclosure will be described. Fig. 3 is a sequence diagram of the process performed by the in-vehicle device 1, the server device 2, and the terminal device 3 according to the embodiment.

[0085] First, the process of transmitting vehicle data and video data (basic video images) from the in-vehicle device 1 to the server device 2 (steps S11 to S13) will be described.

[0086] The in-vehicle device 1 periodically starts step S11 after the vehicle 40 equipped with the in-vehicle device 1 starts traveling. The period may be determined by the notification unit 112, or may be determined by the notification unit 112 in response to a notification from the image capture unit 111. For example, the image capture unit 111 may notify the notification unit 112 every time a video file is switched (for example, every minute). In response to this, the notification unit 112 may start step S11.

[0087] First, in step S11, the in-vehicle device 1 (notification unit 112) acquires vehicle data and video data. In this embodiment, the notification unit 112 acquires the position information and traveling direction of the vehicle from the position information acquisition unit 14, and generates vehicle data by combining the identifier of the vehicle with date and time information. Then, the notification unit 112 acquires the latest video data generated by the imaging unit 111 by capturing video using the camera 15. The acquired vehicle data and video data are transmitted to the server device 2 (step S12).

[0088] In step S13, the server device 2 (acquisition unit 211) receives the vehicle data and video data, and stores the vehicle data and video data in a vehicle data table in the storage unit 22. Furthermore, the acquisition unit 211 may update the data stored in the vehicle data table with newly received vehicle data, etc.

[0089] By executing the above-described process for multiple vehicles 10, the server device 2 can collect and manage past location information for multiple vehicles under its management. Furthermore, by referencing the vehicle data table stored in the server device 2, the server device 2 can search for vehicles that were traveling at a specific location on a specific date and time. It can also acquire video data captured by the vehicle. Because each vehicle records on-board video while traveling, it is possible to search for vehicles that are likely to have captured video of a specific event (for example, an event related to a report, such as a traffic accident).

[0090] Next, a process (steps S21 to S34) will be described in which the terminal device 3 outputs a road map onto which vehicle position information is mapped and plays back the first and second moving images. This process is started, for example, when the terminal device 3 (display control unit 311) displays a road map.

[0091] In step S21, the terminal device 3 (display control unit 311) determines whether or not it is necessary to redraw the icon. For example, if a road map is displayed for the first time, or if an operation to change the display range of the road map or an operation to change the target period has been performed, this step will result in a positive determination. For example, if the user of the terminal device 3 has performed an operation to display a road map and specified a target period, it will be necessary to redraw the icon.

[0092] If the determination in this step is positive, the terminal device 3 generates a vehicle list generation request and transmits it to the server device 2 (step S22). The vehicle list generation request includes information indicating the display range of the road map set by the terminal device 3 and information indicating the target period specified by the user.

[0093] In step S23, the server device 2 generates a list (vehicle list) of vehicles that have traveled within the specified range during the specified period based on the vehicle data table updated in S13, and transmits the generated vehicle list to the terminal device 3.

[0094] In step S24, the terminal device 3 (display control unit 311) draws an icon corresponding to the position and time at which the basic video was acquired on the road map based on the received vehicle list, and outputs it via the input / output unit 34.

[0095] Next, the terminal device 3 (image acquisition unit 312) determines whether or not an icon on the road map has been selected (step S25). This step results in a positive determination if the image acquisition unit 312 determines that an icon on the road map has been selected.

[0096] If the determination in this step is affirmative, the process proceeds to step S26.

[0097] If the determination in this step is negative, the process returns to step S25. That is, if the determination in this step is negative, the terminal device 3 waits until an icon is selected.

[0098] When the process proceeds to step S26, the video acquisition unit 312 transmits information for identifying the selected icon (icon selection information) to the server device 2. The icon selection information includes, for example, a vehicle ID, a date and time ID, etc.

[0099] Next, the server device 2 (first processing unit 212) performs a first process on the basic moving image acquired at the position and time corresponding to the icon specified in the icon selection information to generate a first moving image (step S27). The first processing unit 212 performs a process to reduce the resolution of the entire moving image on the basic moving image acquired at the position and time corresponding to the selected icon to generate the first moving image.

[0100] Then, in step S28, server device 2 (information provider 214) transmits the first moving image to terminal device 3.

[0101] Next, in step S29, the terminal device 3 displays the received first video and the interface 70. For example, the terminal device 3 (display control unit 311) plays back the first video and displays the interface 70 alongside the playback screen of the first video. The interface 70 is an interface for specifying a specific time range in the first video and requesting a second video corresponding to that time range.

[0102] Next, in step S30, the terminal device 3 (video acquisition unit 312) determines whether or not a predetermined operation has been performed on the interface 70. This step results in a positive determination if the video acquisition unit 312 determines that a predetermined operation has been performed on the interface 70. Here, the predetermined operation includes an operation to specify the start and end points of the second video.

[0103] If the determination in this step is affirmative, the process proceeds to step S31.

[0104] If the determination in this step is negative, the processing ends. That is, the terminal device 3 ends the processing if a predetermined operation is not performed on the interface 70. Note that the terminal device 3 may end the processing after continuing to display the first moving image for a certain period of time.

[0105] When the process transitions to step S31, the terminal device 3 (video acquisition unit 312) transmits information (second video request) for requesting the second video generated by an operation on the interface 70 to the server device 2. The video acquisition unit 312 transmits, as the second video request, information indicating the time range specified via the interface 70 and information indicating that the second video should be generated.

[0106] Next, in step S32, the second processing unit 213 of the server device 2 generates a second video based on the received second video request. Based on information indicating a specified time range included in the second video request, the second processing unit 213 performs a second process on the video of the basic video corresponding to the specified time range to generate a second video. Here, the second process is a process of reducing the visibility of only a specific object included in the basic video. The specific object is automatically recognized by the second processing unit 213 using an image analysis method or the like.

[0107] Subsequently, in step S33, server device 2 (information provider 214) transmits the second moving image to terminal device 3.

[0108] Then, the terminal device 3 (display control unit 311) displays (plays) the received second moving image.

[0109] Next, the processing shown in Fig. 4 will be described. Fig. 4 is a flowchart of processing executed by the control unit 21 of the server device 2 according to the embodiment. The processing shown in Fig. 4 is processing in which the server device 2 provides the first moving image and the second moving image to the terminal device 3. Fig. 4 provides a detailed explanation of the processing executed by the server device 2 in Fig. 3.

[0110] 4 is executed when the terminal device 3 receives a signal from the in-vehicle device 1. The signal may be a trigger signal indicating that the in-vehicle device 1 is to transmit the vehicle data and video data it has acquired.

[0111] First, in step S40, the acquisition unit 211 of the server device 2 acquires basic moving images, which are moving images captured by an in-vehicle camera mounted on the vehicle 40, and vehicle data. The server device 2 communicates with the in-vehicle device 1 mounted on the vehicle 40, and acquires the basic moving images.

[0112] Next, in step S41, when the information providing unit 214 receives a request to generate a vehicle list from the terminal device 3, it causes the terminal device 3 to display an icon corresponding to the position of the vehicle 40 on a road map. The information providing unit 214 transmits pairs of position information and date and time information of the multiple vehicles 40 as a vehicle list, and causes the terminal device 3 to display the history of the traveling positions of each of the multiple vehicles 40 on the road map.

[0113] Subsequently, in step S42, the first processing unit 212 determines whether icon selection information has been transmitted from the terminal device 3 or not.

[0114] If the first processing unit 212 determines that the terminal device 3 has received icon selection information from the terminal device 3, the determination in this step is affirmative.

[0115] If the determination in this step is affirmative, the process proceeds to step S43.

[0116] If the determination in this step is negative, the process ends.

[0117] When the process proceeds to step S43, first processing unit 212 generates a first moving image by reducing the resolution of the entire moving image corresponding to the selected icon. Here, the moving image corresponding to the selected icon refers to a basic moving image captured at a position corresponding to the selected icon. First processing unit 212 performs a first process to reduce the resolution of the entire moving image on the basic moving image captured at that position to generate the first moving image. Step S43 corresponds to step S27 in FIG. 3.

[0118] 5A and 5B are diagrams showing examples of a first video sequence and a second video sequence. Part (a) of Fig. 5 shows an example of the first video sequence. As shown in part (a) of Fig. 5, the first video sequence includes, for example, a vehicle 40a, a person 50a, and a person 50b, but the resolution of the entire screen including these objects is reduced in the first video sequence.

[0119] Returning to FIG. 4 again, the explanation will be continued.

[0120] Next, in step S44, the information providing unit 214 causes the terminal device 3 to display the first moving image. The information providing unit 214 transfers the first moving image to the terminal device 3 and causes the terminal device 3 to display the first moving image.

[0121] Next, in step S45, the information providing unit 214 causes the terminal device 3 to display the interface 70 together with the first moving image. For example, the information providing unit 214 causes the terminal device 3 to display the interface 70 for an operation to request the second moving image and specify a specific time range of the first moving image alongside the playback screen of the first moving image.

[0122] Next, in step S46, the second processing unit 213 determines whether a second video request has been received from the terminal device 3.

[0123] If the second processing unit 213 determines that a second video request has been received from the terminal device 3, the determination in this step is affirmative.

[0124] If the determination in this step is affirmative, the process proceeds to step S47.

[0125] If the determination in this step is negative, the process ends.

[0126] When the process proceeds to step S47, the second processing unit 213 performs a process for reducing the visibility of a specific object included in a predetermined time range of the basic video corresponding to the first video in the specified time range, thereby generating a second video. The second processing unit 213 performs a second process for reducing the visibility of only a specific object included in the basic video in the specified time range, which corresponds to the first video in the specified time range, to generate the second video. Step S47 corresponds to step S32 in FIG. 3.

[0127] The following description will be given again with reference to Figure 5. Figure 5(b) shows an example of the second moving image. The second moving image is a moving image in which the visibility of only area 60a, which is the face of person 50a, area 60b, which is the face of person 50b, and area 60c, which is the license plate of vehicle 40a, is reduced. In contrast to the first moving image, the resolution of the entire screen is not reduced in the second moving image, and only the visibility of specific areas is reduced.

[0128] 6 shows a specific example of an object whose visibility is reduced in the second video sequence. As described above, the visibility of the license plate 80 of the vehicle 40a or the face 90 of a person may be reduced as a specific object in the second video sequence.

[0129] Note that the process of reducing the visibility of a specific object in the second moving image may be a process of lowering the resolution of the specific object or a process of masking the specific object.

[0130] Returning to FIG. 4 again, the explanation will be continued.

[0131] In step S48, the information providing unit 214 causes the terminal device 3 to display the second moving image. The information providing unit 214 transfers the second moving image to the terminal device 3 and causes the terminal device 3 to display the second moving image. Step S48 corresponds to steps S33 and S34 in FIG. 3.

[0132] By doing as described above, the server device 2 can provide the first moving image with a reduced overall resolution to the terminal device 3, and then provide the second moving image with a reduced visibility of only a specific object in response to a request from the user. This allows the server device 2 to provide a moving image in which only specific parts related to privacy are concealed and parts necessary for assessing the situation are easily visible.

[0133] (Other variations) The above-described embodiment is merely an example, and the present disclosure may be modified as appropriate within the scope of the present disclosure. For example, the processes and means described in the present disclosure may be freely combined as long as no technical contradiction occurs.

[0134] The present disclosure can also be realized by providing a computer program implementing the functions described in the above embodiments to a computer, and having one or more processors in the computer read and execute the program. Such a computer program may be provided to the computer via a non-transitory computer-readable storage medium connectable to the computer's system bus or via a network. Non-transitory computer-readable storage media include, for example, any type of disk, such as a magnetic disk (e.g., a floppy disk, a hard disk drive (HDD), etc.), an optical disk (e.g., a CD-ROM, a DVD disk, a Blu-ray disk), a read-only memory (ROM), a random-access memory (RAM), an EPROM, an EEPROM, a magnetic card, a flash memory, an optical card, or any type of medium suitable for storing electronic instructions. [Explanation of symbols]

[0135] 1...In-vehicle device 2. Server device 3. Terminal device 11, 21, 31...Control unit 12, 22, 32...Storage section 13, 23, 33... Communications Department 14...Location information acquisition unit 15. Camera 34...Input / output section 40, 40a... Vehicle 50a, 50b...person 60a, 60b, 60c... area 70···Interface 80... license plate 90...Face 111···Photography Department 112...Notification Department 113...Providing Department 211...Acquisition Department 212 First processing section 213...Second processing section 214...Information Department 311 Display control unit 312...Video acquisition unit

Claims

1. Acquiring a basic video, which is a video of a predetermined length captured by an on-board camera mounted on a predetermined vehicle and corresponding to a first location and a first time designated by a user; generating a first video sequence by performing a first process on the basic video sequence to reduce the overall resolution of the basic video sequence; displaying the first moving image; Upon receiving a request from the user, generating a second video by performing a second process on the basic video to reduce the visibility of a specific object included in the basic video; displaying the second moving image; a control unit that executes the following: Information processing system.

2. The control unit displaying an interface for receiving the request from the user during playback of the first moving image; when an operation on the interface is detected, the second processing is performed on the basic video for a predetermined time range including a timing designated by the operation. The information processing system according to claim 1 .

3. The control unit As the second processing, a processing of masking the specific object or a processing of reducing the resolution of the specific object is performed. The information processing system according to claim 1 .

4. acquiring a basic video image, which is a video image of a predetermined length corresponding to a first location and a first time specified by a user, captured by an on-board camera mounted on a predetermined vehicle; generating a first video by performing a first process on the basic video to reduce the overall resolution of the basic video; displaying the first moving image; Upon receiving a request from the user, generating a second video by performing a second process on the basic video to reduce the visibility of a specific object included in the basic video; displaying the second moving image; Including, Information processing methods.

5. A program for causing a computer to execute the information processing method according to claim 4.

Images