Information processing system, information processing method, and program product

Abstract

The invention relates to an information processing system, an information processing method, and a program product. The present disclosure provides a moving image in which only a portion that should be hidden is not readily visible and a desired portion is readily visible. The information processing system executes the following operations: acquiring a basic moving image which is a moving image of a predetermined length corresponding to a first point and a first time specified by a user and captured by an in-vehicle camera mounted on a predetermined vehicle; generating a first moving image by performing a first process on the basic moving image, the first process being a process for reducing the overall resolution of the basic moving image; displaying the first dynamic image; generating a second moving image by performing a second process on the basic moving image when a request is received from the user, the second process being a process for reducing the visibility of a specific target included in the basic moving image; and displaying the second dynamic image.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to an information processing system, an information processing method, and a program product. BACKGROUND

[0002] There is a technology for performing monitoring with a mobile body on which a camera is mounted. In relation to this, for example, Patent Literature 1 discloses a disaster notification information display device that has an input section that inputs first disaster notification information including position information of a disaster for which notification is accepted, a reception section that receives second disaster notification information including second position information input to another disaster notification information display device, and a display section that displays a map of a place where a disaster has occurred.

[0003] PRIOR ART DOCUMENTS

[0004] PATENT LITERATURE

[0005] Patent Literature 1: Japanese Patent Application Publication No. 2013-16207

[0006] Patent Literature 2: Japanese Patent Application Publication No. 2023-128156 SUMMARY

[0007] An object of the present disclosure is to protect privacy in a monitoring system that acquires an image by a vehicle.

[0008] One aspect of the present disclosure is an information processing system that has a control section that performs the following actions: acquires a basic dynamic image, in which the basic dynamic image is a dynamic image of a prescribed length corresponding to a first place and a first time specified by a user, which is captured by a vehicle-mounted camera mounted on a prescribed vehicle; generates a first dynamic image by performing first processing on the basic dynamic image, in which the first processing is processing that reduces the resolution of the entire basic dynamic image; displays the first dynamic image; in the case where a request is received from the user, generates a second dynamic image by performing second processing on the basic dynamic image, in which the second processing is processing that reduces the visual recognition of a specific target included in the basic dynamic image; and displays the second dynamic image.

[0009] Further, another aspect of the present disclosure is an information processing method including the steps of: acquiring a basic dynamic image, wherein the basic dynamic image is a dynamic image of a prescribed length corresponding to a first place and a first time specified by a user, which is captured by a vehicle-mounted camera mounted on a prescribed vehicle; generating a first dynamic image by performing first processing on the basic dynamic image, wherein the first processing is processing that reduces the resolution of the entire basic dynamic image; displaying the first dynamic image; in a case where a request is received from the user, generating a second dynamic image by performing second processing on the basic dynamic image, wherein the second processing is processing that reduces the visual recognition degree of a specific target included in the basic dynamic image; and displaying the second dynamic image.

[0010] Further, as another aspect, there can be mentioned a program for causing a computer to execute the above information processing method or a computer-readable storage medium that stores the program non-transitorily.

[0011] Effects of Invention

[0012] According to the present disclosure, it is possible to provide a dynamic image in which only a portion that should be hidden is not easily visually recognized and a desired portion is easily visually recognized. BRIEF DESCRIPTION OF DRAWINGS

[0013] Figure 1 is a diagram showing processing of a server device that is one aspect of the present application to provide a first dynamic image and a second dynamic image.

[0014] Figure 2 is a diagram showing constituent elements of a vehicle-mounted device, a server device, and a terminal device of an embodiment.

[0015] Figure 3 is a sequence diagram of processing performed by a vehicle-mounted device, a server device, and a terminal device of an embodiment.

[0016] Figure 4 is a flowchart of processing performed by a control section of a server device of an embodiment.

[0017] Figure 5 is a diagram showing examples of a first dynamic image and a second dynamic image.

[0018] Figure 6 is a diagram showing examples of a target that is an object whose visual recognition degree is to be reduced in a second dynamic image.

[0019] Explanation of Reference Signs

[0020] 1: Vehicle-mounted device; 2: Server device; 3: Terminal device; 11, 21, 31: Control unit; 12, 22, 32: Storage unit; 13, 23, 33: Communication unit; 14: Location information acquisition unit; 15: Camera; 34: Input / output unit; 40, 40a: Vehicle; 50a, 50b: Person; 60a, 60b, 60c: Area; 70: Interface; 80: License plate; 90: Face; 111: Shooting unit; 112: Notification unit; 113: Providing unit; 211: Acquisition unit; 212: First processing unit; 213: Second processing unit; 214: Information providing unit; 311: Display control unit; 312: Image acquisition unit. Detailed Implementation

[0021] (summary)

[0022] In recent years, the connectivity of automobiles has been advancing, and the number of vehicles with communication capabilities is increasing. In addition, the number of vehicles equipped with in-vehicle cameras is also increasing.

[0023] In this regard, enabling access to footage captured by cameras (such as dashcams) mounted on vehicles from designated authorities can aid in the initial response to incidents and accidents.

[0024] For example, in the event of a 110 or 119 emergency call, relevant authorities can quickly confirm the situation at the scene by obtaining dashcam footage from vehicles that were driving near the corresponding location before and after the incident.

[0025] As a monitoring system for this purpose, a system is known that maps icons representing the driving positions of multiple vehicles at a specified past time onto a map and presents these icons to an operator. The operator can view a dynamic image acquired at the location corresponding to one of the multiple icons.

[0026] From a privacy perspective, it is advisable to provide dynamic images with reduced overall resolution to make it impossible to identify faces of people or license plates of vehicles.

[0027] However, when operators of surveillance systems want to confirm the scene of a traffic accident, they may not be able to clearly identify objects such as vehicles involved in the accident if they can only use dynamic images with reduced overall resolution. For example, by reviewing low-resolution dynamic images, operators may sometimes determine that someone is lying on the road and conclude that a traffic accident may have occurred at that location. However, it is also possible that in reality, it is just some object that has fallen onto the road, and no traffic accident has occurred at that location.

[0028] To solve such a problem, it is preferable that the monitoring system can provide a moving image in which the visual recognition degree of the entire moving image is maintained high, but the visual recognition degree of only a target to be hidden is decreased. For example, by the monitoring system, the resolution of the entire moving image is made high, and the visual recognition degree of a part such as a face of a pedestrian or a license plate of a vehicle, which is a target to be hidden, is decreased, the above-described problem can be solved.

[0029] The information processing system of one aspect of the present disclosure has a control section that performs the following actions: acquires a basic moving image, wherein the basic moving image is a moving image of a prescribed length corresponding to a first place and a first time specified by a user, which is captured by a vehicle-mounted camera mounted on a prescribed vehicle; generates a first moving image by performing first processing on the basic moving image, wherein the first processing is processing that decreases the resolution of the entire basic moving image; displays the first moving image; in a case where a request is received from the user, generates a second moving image by performing second processing on the basic moving image, wherein the second processing is processing that decreases the visual recognition degree of a specific target included in the basic moving image; and displays the second moving image.

[0030] The basic moving image is a moving image corresponding to a place specified by a user, i.e., a first place, and a time specified by a user, i.e., a first time, among a series of moving images captured by a vehicle-mounted camera. For example, the basic moving image is a moving image of a prescribed length captured by a vehicle-mounted camera mounted on an arbitrary vehicle at a first place at a first time.

[0031] The first processing refers to processing that decreases the resolution of the entire basic moving image.

[0032] The first moving image refers to a basic moving image on which the first processing is performed. The first moving image is a moving image in which the resolution of the entire basic moving image is decreased, and is generated based on the basic moving image.

[0033] The second processing is processing that decreases the visual recognition degree of a specific target included in the basic moving image. In the second processing, the resolution of the entire basic moving image is not decreased, and only the part corresponding to the specific target is subjected to processing for decreasing the visual recognition degree. As the processing for decreasing the visual recognition degree, for example, there is processing that decreases the resolution of the specific target or processing that masks the specific target.

[0034] The second moving image refers to a basic moving image on which the second processing is performed. The second moving image is a moving image in which only the visual recognition degree of the part corresponding to the specific target is decreased, and is generated based on the basic moving image.

[0035] The information processing system of one aspect of the present disclosure generates and displays a first dynamic image in which the resolution of the entire basic dynamic image is reduced, and further generates and displays a second dynamic image in which the visual recognition degree of a specific target included in the basic dynamic image is reduced, in a case where a request is accepted from a user.

[0036] According to this configuration, a dynamic image in which only a portion that should be hidden is not easily visually recognized and a portion that is needed is easily visually recognized can be provided. The information processing system of one aspect of the present disclosure provides a dynamic image in which only the visual recognition degree of a target that needs to be hidden is reduced and the resolution of a portion other than this is kept high, and a user can accurately confirm the current situation of a road or the like.

[0037] Further, it can also be that, in reproduction of the first dynamic image, the control section displays an interface for accepting the request from the user, and in a case where an operation on the interface is sensed, the control section performs the second processing on a prescribed time range of the basic dynamic image that includes a timing specified by the operation.

[0038] For example, when the user performs an operation for specifying a time range while confirming the first dynamic image, the control section performs the second processing on this time range and generates the second dynamic image. Thereby, the second processing can be performed only on a time range that the user judges to be needed, and the processing amount for generating the second dynamic image can be reduced.

[0039] Further, it can also be that the control section performs processing of masking the specific target or processing of reducing the resolution of the specific target as the second processing.

[0040] The information processing method of one aspect of the present disclosure includes the steps of acquiring a basic dynamic image that is a dynamic image of a prescribed length corresponding to a first place and a first time specified by a user, which is captured by a vehicle-mounted camera mounted on a prescribed vehicle, generating a first dynamic image by performing first processing on the basic dynamic image, the first processing being processing of reducing the resolution of the entire basic dynamic image, displaying the first dynamic image, in a case where a request is received from the user, generating a second dynamic image by performing second processing on the basic dynamic image, the second processing being processing of reducing the visual recognition degree of a specific target included in the basic dynamic image, and displaying the second dynamic image.

[0041] Thereby, the information processing method of one aspect of the present disclosure can have the same effects as the above information processing system.

[0042] Hereinafter, specific embodiments of the present disclosure will be described based on the accompanying drawings. Unless otherwise specified, the hardware configuration, module configuration, functional configuration, etc., described in each embodiment are not intended to limit the scope of the disclosed technology.

[0043] (First Implementation)

[0044] [Summary of the processing performed by the server device]

[0045] Reference Figure 1 The outline of the system for implementing the method is described. Figure 1 This diagram illustrates the processing of a first and a second moving image by a server device 2, representing a scheme of this disclosure. The system of this embodiment is implemented, for example, as a system including an in-vehicle device 1, a server device 2, and a terminal device 3. In this embodiment, the server device 2 receives moving images captured by an in-vehicle camera from the in-vehicle device 1 of the vehicle 40. The server device 2 then processes the received moving images and provides them to the terminal device 3 used by the user.

[0046] First, an onboard camera mounted on vehicle 40 captures dynamic images. These captured dynamic images are then referred to as basic dynamic images. Basic dynamic images are dynamic images of a predetermined length that have not undergone any processing on the images captured by the onboard camera.

[0047] Next, the server device 2 acquires basic dynamic images captured by the vehicle-mounted camera from the vehicle-mounted device 1 installed in the vehicle 40. For example, the server device 2 periodically communicates wirelessly with the vehicle-mounted device 1 to acquire and store basic dynamic images and location information from the vehicle-mounted device 1.

[0048] Server device 2 provides dynamic images captured by the vehicle-mounted camera to terminal device 3, which is used by the user. First, server device 2 instructs terminal device 3 to display icons on a map representing the locations of multiple vehicles that have passed through, received by server device 2, at each moment.

[0049] When a user performs a specified operation on a specific icon on the terminal device 3, the server device 2 determines the basic dynamic image acquired at the location and time corresponding to the icon, and performs the following processing.

[0050] First, server device 2 performs a process on the basic motion image to reduce the overall resolution of the determined motion image. Here, the motion image whose overall resolution is reduced is referred to as the first motion image. Then, server device 2 causes terminal device 3 to display the first motion image. Furthermore, server device 2 causes terminal device 3 to display interface 70 simultaneously with the first motion image.

[0051] The interface 70 is a user interface for the user to specify a specific time range in the first dynamic image to newly request a second dynamic image. Here, the second dynamic image refers to a dynamic image generated by performing a process of only reducing the visual recognition of a specific target, not a process of reducing the resolution of the entire in the base dynamic image. The user can request the server device 2 to generate a second dynamic image corresponding to the specified time range by specifying a specific time range in the first dynamic image through the interface 70.

[0052] When the server device 2 senses the request operation of the second dynamic image performed on the terminal device 3, the server device 2 generates a second dynamic image in which only the visual recognition of a specific target is reduced from the base dynamic image. Then, the server device 2 causes the terminal device 3 to display the second dynamic image.

[0053] As described above, the server device 2 first provides the user with a first dynamic image in which the resolution of the entire is reduced. And, in the case of a request thereafter, a second dynamic image is provided, which is a dynamic image corresponding to the time range specified by the user, and is a dynamic image in which only the visual recognition of a specific target is reduced. Thereby, the server device 2 can provide the user with an image in which the part other than the part that should be hidden is high quality, and the captured content is easily visually recognized compared to the past.

[0054] [Configuration of Information Processing System]

[0055] Next, the hardware configuration and the software configuration of each device configuring the information processing system will be described. Figure 2 is a diagram explaining the configuration elements possessed by the in-vehicle device 1, the server device 2, and the terminal device 3 of the embodiment.

[0056] The in-vehicle device 1 can be configured as a computer having a processor (CPU (Central Processing Unit), GPU (Graphics Processing Unit), etc.), a main storage device (RAM (Random Access Memory), ROM (Read Only Memory), etc.), and an auxiliary storage device (EPROM (Erasable Programmable Read Only Memory), a hard disk drive, a removable medium, etc.). An operating system (OS), various programs, various tables, etc. are stored in the auxiliary storage device, and by executing the programs stored in the auxiliary storage device, various functions (software modules) conforming to the prescribed purpose as described later can be realized. However, a part or all of the functions can also be realized as hardware modules by a hardware circuit such as an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), etc.

[0057] The in-vehicle device 1 is configured to include a control section 11, a storage section 12, a communication section 13, a position information acquisition section 14, and a camera 15.

[0058] The control section 11 is an arithmetic unit that realizes various functions of the in-vehicle device 1 by executing a prescribed program. The control section 11 can be realized by a hardware processor such as a CPU, for example. In addition, the control section 11 can also be configured to include a RAM, a ROM (Read Only Memory), a cache memory, etc.

[0059] In the present embodiment, the control section 11 possessed by the in-vehicle device 1 is configured to have three software modules of a photographing section 111, a notification section 112, and a providing section 113. Each software module can be realized by the control section 11 (CPU, etc.) executing a program stored in the storage section 12. Note that the information processing performed by the software module is the same as the information processing performed by the control section 11 (CPU, etc.).

[0060] The photographing section 111 performs photographing of a moving image (in-vehicle video) using the camera 15 in the operation of the device, and saves the obtained data in the storage section 12. The photographing section 111 performs photographing at all times by accepting power supply from the vehicle, and records the obtained moving image data in the storage section 12.

[0061] The moving image data is constituted by a plurality of moving image files. The length of the moving image corresponding to one file has an upper limit, and when the upper limit is exceeded, a new moving image file is generated. In the present embodiment, it is set that a moving image file is generated every minute. Note that in the case where the storage capacity is insufficient, the photographing section 111 continues photographing on the basis of deleting the oldest moving image file to secure free capacity. In the present embodiment, each moving image file is associated with an identifier (date and time ID) for identifying the date and time (i.e., the date and time of starting photographing) at which the moving image file was generated. The date and time ID can be an identifier that uniquely identifies the year, month, day, hour, minute, and second. The moving image data photographed by the photographing section 111 is the basic dynamic image described above.

[0062] By the photographing section 111 functioning, the in-vehicle device 1 functions as a drive recorder.

[0063] The notification section 112 periodically generates data related to the travel of the host vehicle (hereinafter, vehicle data) and transmits it to the server device 2. In the present embodiment, the vehicle data contains the position information of the vehicle 40, the direction of travel of the vehicle 40, and a date and time ID indicating the date and time at which the position information was acquired.

[0064] The vehicle data in the present embodiment is configured to contain information that presents an identifier (vehicle ID) uniquely representing the vehicle 40, the date and time at which the vehicle data was generated, an identifier (date and time ID) uniquely representing the date and time, the position information, and the direction of travel. The position information and the direction of travel can be acquired from the position information acquisition section 14 described later.

[0065] The vehicle data is generated and transmitted at a prescribed period. The prescribed period can be measured independently, but can also be linked with the photographing section 111. For example, it can also be set that the notification section 112 generates the vehicle data at the timing at which the photographing section 111 generates a new moving image file (e.g., at a period of one minute). In this case, the date and time represented by the vehicle data is the same as the date and time at which the new moving image file was generated.

[0066] The provision section 113 periodically transmits the moving image data generated by the photographing section 111 to the server device 2. For example, in the case where the timing at which the basic dynamic image is periodically provided has come, the provision section 113 acquires the moving image data of the basic dynamic image from the storage section 12 and transmits it to the server device 2. The moving image data transmitted to the server device 2 is used by the server device 2 to generate the first dynamic image and the second dynamic image.

[0067] The storage section 12 is a unit that stores information, and is constituted by a RAM, a disk, a flash memory, or the like. In the storage section 12, a program for the control section 11 to execute, data for the program to utilize, and the like are stored.

[0068] The communication section 13 is a wireless communication interface for connecting the in-vehicle device 1 to an external network. The communication section 13 is configured to be able to communicate with the server device 2 via a wireless LAN (Local Area Network), a cellular communication network such as 3G (3rd Generation), 4G (4th Generation), or 5G (5th Generation), or the like, for example.

[0069] The position information acquisition section 14 acquires position information of the vehicle 40. The position information acquisition section 14 includes a GPS (Global Positioning System) antenna and a position measurement module for measuring the position information. The GPS antenna is an antenna that receives a position measurement signal transmitted from a positioning satellite (also referred to as a GNSS (Global Navigation Satellite System) satellite). The position measurement module is a module that calculates position information based on a signal received by the GPS antenna. Note that the position information acquisition section 14 can also determine the traveling direction of the vehicle 40 based on the movement of the position information.

[0070] The camera 15 is an optical unit including an image sensor for acquiring an image. The camera 15 is mounted toward the front of the vehicle 40, for example.

[0071] Next, the server device 2 will be described.

[0072] Like the in-vehicle device 1, the server device 2 can be configured as a computer having a processor (CPU, GPU, or the like), a main storage device (RAM, ROM, or the like), and an auxiliary storage device (EPROM, a hard disk drive, a removable medium, or the like).

[0073] The server device 2 is configured to include a control section 21, a storage section 22, and a communication section 23.

[0074] The control section 21 is an arithmetic unit that realizes various functions of the server device 2 by executing a prescribed program. The control section 21 can be realized by a hardware processor such as a CPU, for example. In addition, the control section 21 can also be configured to include a RAM, a ROM, a cache memory, or the like.

[0075] In the present embodiment, the control section 21 of the server device 2 is configured to have four software modules, an acquisition section 211, a first processing section 212, a second processing section 213, and an information providing section 214. Each of the software modules can be realized by the control section 21 (CPU or the like) executing a program stored in the storage section 22. Note that the information processing performed by the software modules has the same meaning as the information processing performed by the control section 21 (CPU or the like).

[0076] The acquisition section 211 acquires the basic dynamic image from the in-vehicle device 1. For example, the acquisition section 211 can acquire the basic dynamic image periodically transmitted from the in-vehicle device 1. The acquisition section 211 causes the storage section 22 to store the acquired basic dynamic image.

[0077] Further, the acquisition section 211 receives the vehicle data from the plurality of vehicles 40 (in-vehicle devices 1) and causes the storage section 22 to store the vehicle data. For example, the acquisition section 211 can store the vehicle data received from the plurality of vehicles 40 in a table (referred to as a vehicle data table).

[0078] The first processing section 212 performs first processing on the basic dynamic image to generate a first dynamic image. Here, the first processing is processing that reduces the resolution of the entire basic dynamic image. In a case where the image acquisition section 312 receives information for identifying an icon specified by the user of the terminal device 3 (hereinafter referred to as icon selection information), the first processing section 212 acquires the basic dynamic image corresponding to the icon from the storage section 22 and performs first processing on the basic dynamic image to generate a first dynamic image.

[0079] The second processing section 213 performs second processing on the basic dynamic image to generate a second dynamic image. Here, the second processing is processing that reduces the visual recognition degree of only a specific target included in the basic dynamic image. The second dynamic image is a dynamic image in which, on the one hand, only the visual recognition degree of the specific target is reduced, and on the other hand, targets other than the specific target are presented in high-precision quality. In a case where the image acquisition section 312 of the terminal device 3 receives a second dynamic image request, the second processing section 213 performs second processing on the basic dynamic image corresponding to the time range specified in the request to generate a second dynamic image.

[0080] The information providing section 214 performs information provision to the terminal device 3 on the basis of information stored in the storage section 22. Specifically, the information providing section 214 performs the following two kinds of processing.

[0081] (1) Information provision related to the travel position of the vehicle

[0082] In the vehicle data table, the position information of the vehicle 40 equipped with the in-vehicle device 1 having the function as a drive recorder is stored in association with the date and time information in a state. By referring to the position information, it is possible to extract a vehicle having a record of traveling in a specified area within a specified time width.

[0083] Upon a request from the terminal device 3, the information providing section 214 extracts a vehicle having a record of traveling in a specified area within a specified time width, and transmits the position information and the date and time information to the terminal device 3. Thereby, on the terminal device 3 side, it is possible to map an icon corresponding to the vehicle in a map. The position information can also include information indicating a traveling direction.

[0084] (2) Relay of in-vehicle video

[0085] The information providing section 214 provides the first moving image generated by the first processing section 212 that received the icon selection information to the terminal device 3. The icon selection information includes information identifying the subject vehicle and the subject date and time.

[0086] Further, the information providing section 214 provides the second moving image generated by the second processing section 213 that received the second moving image request to the terminal device 3.

[0087] The storage section 22 is a unit that stores information, and is constituted by a RAM, a disk, a flash memory, or the like. In the storage section 22, a program for the control section 21 to execute, data for the program to utilize, and the like are stored.

[0088] Further, in the storage section 22, a table (vehicle data table) that stores data received from the in-vehicle device 1 is stored.

[0089] The communication section 23 is a communication interface for connecting the server device 2 to a network. The communication section 23 is configured to be able to communicate with the network via, for example, Ethernet (registered trademark), wireless LAN, a cellular communication network, or the like.

[0090] Next, the terminal device 3 will be described.

[0091] Like the in-vehicle device 1 and the server device 2, the terminal device 3 can be configured as a computer having a processor (CPU, GPU, or the like), a main storage device (RAM, ROM, or the like), and an auxiliary storage device (EPROM, a hard disk drive, a removable medium, or the like).

[0092] The terminal device 3 is configured to include a control section 31, a storage section 32, a communication section 33, and an input / output section 34.

[0093] The control section 31 is an arithmetic unit that realizes various functions of the terminal device 3 by executing a prescribed program. The control section 31 can be realized by a hardware processor such as a CPU, for example. Further, the control section 31 can also be configured to include a RAM, a ROM, a cache memory, and the like.

[0094] In the present embodiment, the control section 31 possessed by the terminal device 3 is configured to have two software modules, a display control section 311 and an image acquisition section 312. Each of the software modules can be realized by executing a program stored in the storage section 32 by the control section 31 (CPU or the like). Note that the information processing performed by the software modules has the same meaning as the information processing performed by the control section 31 (CPU or the like).

[0095] The display control section 311 generates a user interface (GUI: Graphical User Interface) for requesting acquisition of the in-vehicle image, and outputs the user interface via the input / output section 34 described later. In the present embodiment, the display control section 311 generates and outputs a user interface including a road map based on the road map data stored or acquired in advance. Further, the display control section 311 displays a user interface in which an icon corresponding to the position at which the basic dynamic image is acquired is displayed on the road map based on the information acquired from the server device 2.

[0096] Specifically, the display control section 311 accepts a setting of an object region and an object period for which the road map is to be displayed from the user. Then, the display control section 311 entrusts the server device 2 with providing a list of vehicles in the set object region and object period. Next, the display control section 311 displays an icon corresponding to the position and time of the vehicle that captured the basic dynamic image on the road map based on the received list of vehicles.

[0097] In a case where any one of the mapped icons is selected by the user, the image acquisition section 312 transmits icon selection information for requesting a first dynamic image to the server device 2, the first dynamic image being an image generated from the basic dynamic image acquired at the position corresponding to the icon. Further, the image acquisition section 312 reproduces the first dynamic image transmitted from the server device 2. Further, the image acquisition section 312 generates and outputs the interface 70 in the reproduction screen of the first dynamic image.

[0098] The interface 70 is a user interface for allowing the user to specify a specific time range in the first dynamic image to newly request a second dynamic image. For example, the interface 70 can be constituted by a section that specifies the start timing of the second dynamic image, a section that specifies the end timing of the second dynamic image, and a section that requests generation of the second dynamic image.

[0099] In a case where it is sensed via the interface 70 that a specific time range in the first moving image has been designated, the image acquisition section 312 transmits a second moving image request for requesting a second moving image corresponding to the time range to the server device 2. Further, the image acquisition section 312 reproduces the second moving image transmitted from the server device 2.

[0100] The storage section 32 is a unit that stores information, and is constituted by a RAM, a disk, a flash memory, or the like. In the storage section 32, a program for the control section 31 to execute, data for the program to utilize, and the like are stored.

[0101] The communication section 33 is a communication interface for connecting the terminal device 3 to an external network. The communication section 33 can be an interface for wireless communication, or an interface for wired communication. The communication section 33 is configured to be able to communicate with the server device 2 via a wireless LAN, a cellular communication network such as 3G, 4G, or 5G, or the like, for example.

[0102] The input / output section 34 is a unit that accepts input from a user of the device and presents information to the user. Specifically, the input / output section 34 is constituted by a touch panel and a control unit thereof, a liquid crystal display and a control unit thereof. In the present embodiment, the touch panel and the liquid crystal display are constituted by one touch panel display.

[0103] Note that, Figure 2 The configuration illustrated is one example, and all or a part of the functions illustrated can also be executed using a circuit designed specifically for that purpose. Further, the storage or execution of a program can also be performed by a combination of a main storage device and an auxiliary storage device other than those illustrated.

[0104] [Process by information processing system]

[0105] Next, the specific contents of the process performed by the information processing system of one aspect of the present disclosure will be described. Figure 3 is a sequence diagram of the process performed by the in-vehicle device 1, the server device 2, and the terminal device 3 of the embodiment.

[0106] First, the process of transmitting vehicle data and moving image data (basic moving image) from the in-vehicle device 1 to the server device 2 (step S11 to step S13) will be described.

[0107] After the vehicle 40 on which the in-vehicle device 1 is mounted starts traveling, the in-vehicle device 1 starts step S11 periodically. The period can be decided by the notification section 112, or can be decided by the notification section 112 in response to a notification from the photographing section 111. For example, it can be that, every time a switching of a moving image file occurs (for example, every minute), a notification is transmitted from the photographing section 111 to the notification section 112, and the communication section 112 starts step S11 in response thereto.

[0108] First, in step Sll, the in-vehicle device 1 (notification section 112) acquires vehicle data and moving image data. In the present embodiment, the notification section 112 acquires the position information and the traveling direction of the host vehicle from the position information acquisition section 14, and generates the vehicle data by combining the identifier of the host vehicle with the date and time information. Then, the notification section 112 acquires the latest moving image data from among the moving image data generated by the imaging section 111 using the camera 15 to capture an image. The acquired vehicle data and moving image data are transmitted to the server device 2 (step S12).

[0109] In step S13, the server device 2 (acquisition section 211) receives the vehicle data and the moving image data, and stores the vehicle data and the moving image data in the vehicle data table in the storage section 22. Further, the acquisition section 211 can update the data stored in the vehicle data table using the newly received vehicle data and the like.

[0110] By executing the above-described processing for a plurality of vehicles 40, the server device 2 can collect and manage the past position information of a plurality of vehicles under management. Further, by referring to the vehicle data table stored in the server device 2, the server device 2 can search for a vehicle that traveled at a prescribed place on a prescribed date and time. Further, it is possible to acquire the moving image data captured by the vehicle. Since each vehicle travels while capturing an in-vehicle image, it is possible to thereby find a vehicle with a high possibility of capturing a specific phenomenon (for example, a traffic accident or the like related to a report) by an image.

[0111] Next, the processing of outputting a road map on which the position information of the vehicle is mapped and reproducing the first dynamic image and the second dynamic image by the terminal device 3 (steps S21 to S34) will be described. This processing starts, for example, when the display of the road map is performed in the terminal device 3 (display control section 311).

[0112] In step S21, the terminal device 3 (display control section 311) determines whether or not the icon needs to be redrawn. For example, in a case where the road map is displayed for the first time, in a case where an operation of changing the display range of the road map is performed, an operation of changing the object period is performed, or the like, this step is a positive determination. For example, in a case where an operation of displaying the road map is performed by the user of the terminal device 3 and the designation of the object period is performed, the icon needs to be redrawn.

[0113] In the case of affirmative determination in this step, the terminal device 3 generates a generation request of a vehicle list, and transmits the generation request to the server device 2 (step S22). The generation request of the vehicle list includes information indicating the display range of the road map set by the terminal device 3 and information indicating the object period specified by the user.

[0114] In step S23, the server device 2 generates a list of vehicles having a record of traveling in the specified range during the specified period based on the vehicle data table updated in S13 (vehicle list), and transmits the generated vehicle list to the terminal device 3.

[0115] In step S24, the terminal device 3 (display control section 311) depicts an icon corresponding to the position and time at which the basic dynamic image was acquired on the road map based on the received vehicle list, and outputs it via the input / output section 34.

[0116] Next, the terminal device 3 (image acquisition section 312) determines whether the icon on the road map is selected (step S25). In the case where the image acquisition section 312 determines that the icon on the road map is selected, this step is affirmative determination.

[0117] In the case of affirmative determination in this step, the processing shifts to step S26.

[0118] In the case of negative determination in this step, the processing shifts to step S25 again. That is, in the case of negative determination in this step, the terminal device 3 stands by until the icon is selected.

[0119] In the case where the processing shifts to step S26, the image acquisition section 312 transmits information for identifying the selected icon (icon selection information) to the server device 2. The icon selection information includes, for example, a vehicle ID, a date, and a time ID, and the like.

[0120] Next, the server device 2 (first processing section 212) generates a first dynamic image by performing first processing on the basic dynamic image acquired at the position and time corresponding to the icon specified by the icon selection information (step S27). The first processing section 212 performs processing of reducing the resolution of the entire dynamic image on the basic dynamic image acquired at the position and time corresponding to the selected icon to form the first dynamic image.

[0121] Then, in step S28, the server device 2 (information providing section 214) transmits the first dynamic image to the terminal device 3.

[0122] Next, in step S29, the terminal device 3 displays the received first moving image and an interface 70. For example, the terminal device 3 (image acquisition section 312) reproduces the first moving image, and displays the interface 70 side by side with the reproduced image of the first moving image. The interface 70 is an interface for designating a specific time range in the first moving image to request a second moving image corresponding to the time range.

[0123] Next, in step S30, the terminal device 3 (image acquisition section 312) determines whether a prescribed operation has been performed on the interface 70. In a case where the image acquisition section 312 determines that a prescribed operation has been performed on the interface 70, this step is affirmative. Here, the prescribed operation includes an operation of designating a start time point and an end time point of the second moving image.

[0124] In a case where this step is affirmative, the processing shifts to step S31.

[0125] In a case where this step is negative, the processing ends. That is, in a case where a prescribed operation has not been performed on the interface 70, the terminal device 3 ends the processing. Note that the terminal device 3 can also end the processing after the first moving image has been displayed for a certain period.

[0126] In a case where the processing shifts to step S31, the terminal device 3 (image acquisition section 312) transmits information for requesting a second moving image generated by an operation on the interface 70 (second moving image request) to the server device 2. The image acquisition section 312 transmits information indicating a time range designated via the interface 70 and information indicating the gist that the second moving image is to be generated as the second moving image request.

[0127] Next, in step S32, the second processing section 213 of the server device 2 generates a second moving image based on the received second moving image request. The second processing section 213 performs a second processing on a moving image of a corresponding time range in the basic moving image based on the information indicating the designated time range included in the second moving image request, thereby forming a second moving image. Here, the second processing is a processing of degrading only the visual recognition of a specific target included in the basic moving image. The specific target is automatically recognized by the second processing section 213 using an image analysis method or the like.

[0128] Next, in step S33, the server device 2 (information providing section 214) transmits the second moving image to the terminal device 3.

[0129] Then, the terminal device 3 (image acquisition section 312) displays (reproduces) the received second moving image.

[0130] Next, to Figure 4The illustrated processing is processing performed by the server device 2 of the embodiment. Figure 4 is a flowchart of processing performed by the control section 21 of the server device 2 of the embodiment. Figure 4 The illustrated processing is processing in which the server device 2 provides the first dynamic image and the second dynamic image to the terminal device 3. Figure 4 is a diagram in which the processing performed by the server device 2 in Figure 3 is explained in detail.

[0131] Figure 4 The illustrated processing is executed when a signal is received from the terminal device 3, from the in-vehicle device 1. The signal can be a trigger signal indicating the gist of transmitting the vehicle data and the moving image data acquired by the in-vehicle device 1.

[0132] First, in step S40, the acquisition section 211 of the server device 2 acquires a basic dynamic image and vehicle data, where the basic dynamic image is a dynamic image captured by a vehicle-mounted camera mounted on the vehicle 40. The server device 2 communicates with the in-vehicle device 1 mounted on the vehicle 40, and acquires the basic dynamic image.

[0133] Next, in step S41, in a case where a generation request of a vehicle list is received from the terminal device 3, the information providing section 214 causes the terminal device 3 to display an icon corresponding to the position of the vehicle 40 on a road map. The information providing section 214 transmits a pair of the position information of the plurality of vehicles 40 and the date and time information as a vehicle list, and causes the terminal device 3 to display the history of the travel positions of the plurality of vehicles 40 on the road map.

[0134] Next, in step S42, the first processing section 212 determines whether icon selection information is transmitted from the terminal device 3.

[0135] In a case where the first processing section 212 determines that the icon selection information is received from the terminal device 3, this step is affirmative determination.

[0136] In a case where this step is affirmative determination, the processing proceeds to step S43.

[0137] In a case where this step is negative determination, the processing ends.

[0138] In a case where the processing proceeds to step S43, the first processing section 212 generates a first dynamic image by reducing the resolution of the entire dynamic image corresponding to the selected icon. Here, the dynamic image corresponding to the selected icon refers to the basic dynamic image captured at the position corresponding to the selected icon. The first processing section 212 forms the first dynamic image by performing the first processing of reducing the resolution of the entire dynamic image on the basic dynamic image captured at the position. Step S43 corresponds to the processing of the server device 2 of the embodiment. Figure 3corresponds to step S27 of

[0139] Figure 5 is a diagram showing an example of the first dynamic image and the second dynamic image. Figure 5 (a) of FIG. 10 shows an example of the first dynamic image. As shown in (a) of FIG. 10, in the first dynamic image, there are presented, for example, a vehicle 40a, a person 50a, and a person 50b, but in the first dynamic image, the resolution of the entire screen including them is lowered. Figure 5

[0140] Returning again to Figure 4 , the description will be continued.

[0141] Next, in step S44, the information providing section 214 causes the terminal device 3 to display the first dynamic image. The information providing section 214 transmits the first dynamic image to the terminal device 3, and causes the terminal device 3 to display the first dynamic image.

[0142] Next, in step S45, the information providing section 214 causes the terminal device 3 to display the interface 70 while displaying the first dynamic image. For example, the information providing section 214 causes the terminal device 3 to display the interface 70 for requesting the second dynamic image and designating a specific time range in the first dynamic image, side by side with the reproduction screen of the first dynamic image.

[0143] Next, in step S46, the second processing section 213 determines whether or not the second dynamic image request is received from the terminal device 3.

[0144] In a case where the second processing section 213 determines that the second dynamic image request is received from the terminal device 3, this step is affirmative determination.

[0145] In a case where this step is affirmative determination, the processing shifts to step S47.

[0146] In a case where this step is negative determination, the processing ends.

[0147] In a case where the processing shifts to step S47, the second processing section 213 performs the processing of lowering the visual recognition of the specific target included in the basic dynamic image corresponding to the first dynamic image of the designated time range, in a prescribed time range of the basic dynamic image, and generates the second dynamic image. The second processing section 213 performs the second processing of lowering only the visual recognition of the specific target included in the basic dynamic image, in the basic dynamic image of the time range corresponding to the first dynamic image of the designated time range, to form the second dynamic image. Step S47 corresponds to step S32 of Figure 3

[0148] The description will be continued again in Figure 5 .​​Figure 5 (b) shows an example of the second dynamic image. The second dynamic image is a dynamic image in which the visual recognizability of only the region 60a that is a part of the face of the person 50a, the region 60b that is a part of the face of the person 50b, and the region 60c that is a part of the license plate of the vehicle 40a is lowered. In comparison with the first dynamic image, the resolution of the entire screen of the second dynamic image is not lowered, and only the visual recognizability of the specific part is lowered.

[0149] Figure 6 A specific example of a target to be made to have the visual recognizability lowered in the second dynamic image is shown. As described above, the license plate 80 of the vehicle 40a or the face 90 of the person can be taken as the specific target, and the visual recognizability thereof can be lowered in the second dynamic image.

[0150] Note that the processing of lowering the visual recognizability of the specific target in the second dynamic image can be either the processing of lowering the resolution of the specific target or the processing of masking the specific target.

[0151] Returning again to Figure 4 , the description will be continued.

[0152] In step S48, the information providing section 214 causes the terminal device 3 to display the second dynamic image. The information providing section 214 transmits the second dynamic image to the terminal device 3, and causes the terminal device 3 to display the second dynamic image. Step S48 corresponds to step S33, step S34 of Figure 3 .

[0153] By doing so as described above, the server device 2 can provide the second dynamic image in which only the visual recognizability of the specific target is lowered in response to the request from the user after providing the first dynamic image in which the entire resolution is lowered to the terminal device 3. Thereby, the server device 2 can provide a dynamic image in which only the specific part related to privacy is hidden, and the part required in the situation judgment and the like is easily visually recognizable.

[0154] (Other Modified Examples)

[0155] The above-described embodiments are merely examples, and the present disclosure can be appropriately changed and implemented without departing from the gist thereof. For example, the processing, the units described in the present disclosure can be freely combined and implemented, as long as no technical contradiction arises.

[0156] The present disclosure can also be realized by providing a computer program that realizes the functions described in the above-described embodiments to a computer, and reading out and executing the program by one or more processors possessed by the computer. Such a computer program can be provided to the computer through a non-transitory computer-readable storage medium that can be connected to a system bus of the computer, or can be provided to the computer via a network. The non-transitory computer-readable storage medium includes, for example, any type of disk (a floppy disk (registered trademark), a hard disk drive (HDD: Hard Disk Drive), and the like), a compact disc (CD-ROM: Compact Disc Read Only Memory), a digital versatile disc (DVD: Digital Versatile Disc), a Blu-ray disc, and the like), a read only memory (ROM), a random access memory (RAM), an EPROM, an EEPROM (Electrically Erasable Programmable Read Only Memory), a magnetic card, a flash memory, an optical card, and the like, which are suitable for storing electronic instructions.

Claims

1. An information processing system comprising a control unit, the control unit performing the following actions: Obtain basic dynamic images, where, The basic dynamic image is a dynamic image of a specified length captured by an onboard camera mounted on a specified vehicle, corresponding to a first location and a first moment specified by the user. A first dynamic image is generated by performing a first processing on the basic dynamic image, wherein the first processing is a process that reduces the overall resolution of the basic dynamic image. Display the first dynamic image; Upon receiving a request from the user, a second motion image is generated by performing a second processing on the basic motion image, wherein the second processing is a process that reduces the visual recognizability of a specific target contained in the basic motion image; and The second animated image is displayed.

2. The information processing system according to claim 1, wherein, During the reproduction of the first dynamic image, the control unit displays an interface for handling the request from the user. Upon sensing an operation on the interface, the control unit performs the second processing on a predetermined time range of the basic motion image, including the timing specified by the operation.

3. The information processing system according to claim 1, wherein, The control unit performs a process to either mask the specific target or reduce the resolution of the specific target as the second process.

4. An information processing method, comprising the following steps: Acquire a basic dynamic image, wherein the basic dynamic image is a dynamic image of a specified length captured by an onboard camera mounted on a specified vehicle, corresponding to a first location and a first moment specified by the user; A first dynamic image is generated by performing a first processing on the basic dynamic image, wherein the first processing is a process that reduces the overall resolution of the basic dynamic image. Display the first dynamic image; Upon receiving a request from the user, a second motion image is generated by performing a second processing on the basic motion image, wherein the second processing is a process that reduces the visual recognizability of a specific target contained in the basic motion image; and The second animated image is displayed.

5. A program product comprising a program for causing a computer to perform the information processing method of claim 4.

Images