Information provision device, information provision method, and information provision program

Abstract

When providing images, protect information about the source of the images. [Solution] The information providing device 10 has a collection unit 151, a provision unit 152, and an acquisition unit 153. The collection unit 151 collects image metadata. The acquisition unit 153 acquires images via the network that satisfy the conditions indicating that they are displayable and that correspond to specified metadata among the metadata. The provision unit 152 provides the images acquired by the acquisition unit 153. For example, the acquisition unit 153 acquires images whose source is not designated as a protected object as images that satisfy the conditions.

Description

Technical Field

[0001] The present invention relates to an information providing apparatus, an information providing method, and an information providing program.

Background Art

[0002] Conventionally, a technique for showing the driving history of a vehicle and information related to an image on a map based on video data captured by an imaging device mounted on the vehicle is known (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the conventional technology, there is a problem that information regarding the source of an image may not be protected when providing the image.

[0005] For example, when an image is provided together with location information, even if the personal information of the image provider is not made public, the movement route and behavior pattern of the provider may be inferred by matching the contents and location information of multiple images.

[0006] The present invention has been made in view of the above, and an object thereof is to protect information regarding the source of an image when providing the image.

Means for Solving the Problems

[0007] To solve the above-mentioned problems and achieve the objective, the information providing device of the present invention is characterized by comprising: a collection unit that collects image metadata; an acquisition unit that acquires images that satisfy conditions indicating that they are displayable, and which correspond to specified metadata from the metadata, via a network; and a providing unit that provides the images acquired by the acquisition unit. [Effects of the Invention]

[0008] According to the present invention, when providing images, information regarding the source of the images can be protected. [Brief explanation of the drawing]

[0009] [Figure 1] Figure 1 is a diagram illustrating the overview of an information providing device according to the first embodiment. [Figure 2] Figure 2 shows an example of the configuration of an information providing device according to the first embodiment. [Figure 3] Figure 3 shows an example of a metadata table according to the first embodiment. [Figure 4] Figure 4 shows an example of an unprotected image source table according to the first embodiment. [Figure 5] Figure 5 shows an example of a table of protected image providers according to the first embodiment. [Figure 6] Figure 6 is a flowchart showing the flow of the data collection process according to the first embodiment. [Figure 7] Figure 7 is a flowchart showing the flow of the synchronization process according to the first embodiment. [Figure 8] Figure 8 is a flowchart showing the flow of the map display process according to the first embodiment. [Figure 9] Figure 9 is a diagram illustrating the map according to the first embodiment. [Figure 10] Figure 10 shows an example of a screen according to the first embodiment. [Figure 11] Figure 11 is a flowchart showing the image display processing flow according to the first embodiment. [Figure 12] FIG. 12 is a diagram showing a configuration example of a computer that executes a program.

Embodiment for Carrying Out the Invention

[0010] Hereinafter, an information providing apparatus, an information providing method, and an information providing program according to the present application will be described in detail based on the drawings. Note that the present invention is not limited to the embodiments described below.

[0011] [First Embodiment] FIG. 1 is a diagram for explaining an outline of an information providing apparatus according to the first embodiment. The information providing apparatus 10 shown in FIG. 1 provides stored images to a user. The image may be a still image or a moving image.

[0012] The images provided by the information providing apparatus 10 are captured by devices (hereinafter referred to as image providers) included in the image provider group 20. The image provider has a function of capturing an image and a data communication function. For example, the image provider group 20 includes a vehicle 40_1 equipped with a camera (for example, a drive recorder), a smartphone 40_2, a surveillance camera 40_3, a vehicle 40_4, etc. as image providers. Note that the image provider is not limited to the devices described here. Also, the image provider may be denoted as the image provider 40 without distinction.

[0013] The information providing apparatus 10 collects metadata from the image provider 40 via the network N. The network N is an LTE (Long Term Evolution) network. Also, the information providing apparatus 10 provides information to the user via the terminal 30.

[0014] The exchange of data between the information providing apparatus 10 and the image provider group 20 may be performed via a system base different from that of the information providing apparatus 10.

[0015] The information providing device 10 provides information regarding metadata. Further, the information providing device 10 receives a request for image display from the terminal 30 according to the information regarding the provided metadata. The information providing device 10 acquires an image from the image provider group 20 according to the received request. Further, the information providing device 10 provides the acquired image.

[0016] That is, the information providing device 10 can acquire an image from the image provider group 20 as needed without holding the image, and provide the acquired image. Thereby, the information providing device 10 can reduce the resources for storing data.

[0017] The configuration of the information providing device 10 will be described with reference to FIG. 2. FIG. 2 is a diagram showing a configuration example of the information providing device according to the first embodiment. As shown in FIG. 2, the information providing device 10 includes a communication unit 11, an input unit 12, an output unit 13, a storage unit 14, and a control unit 15.

[0018] The communication unit 11 is an interface for communicating with other devices including the terminal 30. For example, the communication unit 11 is a NIC (Network Interface Card).

[0019] The input unit 12 is an interface for receiving input of data. For example, the input unit 12 is connected to input devices such as a keyboard and a mouse.

[0020] The output unit 13 is an interface for outputting data. For example, the output unit 13 is connected to output devices such as a display and a speaker.

[0021] The storage unit 14 is a storage device such as an HDD (Hard Disk Drive), SSD (Solid State Drive), or optical disc. Alternatively, the storage unit 14 may be a rewritable semiconductor memory such as RAM (Random Access Memory), flash memory, or NVSRAM (Non-Volatile Static Random Access Memory). The storage unit 14 stores the OS (Operating System) and various programs executed by the information providing device 10.

[0022] The storage unit 14 stores the metadata table 141, the unprotected image provider table 142, and the protected image provider table 143.

[0023] Metadata table 141 contains the collected metadata. Figure 3 shows an example of a metadata table according to the first embodiment. As shown in Figure 3, metadata table 141 has columns for "Image ID", "Image Source ID", "Timestamp", "Latitude", "North-South", "Longitude", "East-West", "Number of Satellites Used", "Size", "Length", and "Display Flag".

[0024] The "Image ID" column stores information that identifies the image. The "Image Source ID" column stores information that identifies the image source. The "Timestamp" column stores the date and time related to the image (for example, the date and time the image was taken). The "Latitude" column stores the latitude of the location where the image was taken.

[0025] The "North-South" column stores the north-south latitude. The "Longitude" column stores the longitude of the location where the image was captured. The "East-West" column stores the east-west longitude. Note that latitude and longitude are calculated by satellite positioning. The "Number of Satellites Used" column stores the number of satellites used to determine the position (latitude and longitude). The "Size" column stores the size of the image data. The "Length" column stores the length of the image if it is a moving image. The "Display Flag" column stores a flag used to determine whether or not to display the image in a specific process.

[0026] Each record in metadata table 141 is metadata corresponding to each image. The metadata includes time information (timestamp) and location information (latitude, longitude, and satellite number). The location information is obtained by a GNSS (Global Navigation Satellite System) (e.g., GPS (Global Positioning System)) module installed in the image source 40.

[0027] Location information may be based on NMEA (National Marine Electronics Association) sentences obtained by image provider 40. Furthermore, the columns of metadata table 141 are not limited to those described in Figure 3, but may include other items from the NMEA sentences.

[0028] For example, Figure 3 shows that the image identified as "A1001" was provided by the image provider identified as "U11," and that its timestamp is "2024-11-01 05:24:19.00." It also shows that the image identified as "A1001" has a latitude of "3539.314624°N," a longitude of "13945.64118°E," and uses 7 satellites. Furthermore, it shows that the image identified as "A1001" has a size of "134KB," a length of "00:00:05," and a display flag of "1."

[0029] The unprotected image source table 142 contains information on image sources that are not designated as protected. On the other hand, the protected image source table 143 contains information on image sources that are designated as protected.

[0030] Figure 4 shows an example of an unprotected image source table according to the first embodiment. Figure 4 shows that the image sources identified as "U11" and "U13" are not designated as protected.

[0031] Figure 5 shows an example of a protected image source table according to the first embodiment. Figure 5 shows that the image sources identified as "U12" and "U14" are designated as protected.

[0032] The control unit 15 controls the entire information providing device 10. The control unit 15 is, for example, an electronic circuit such as a CPU (Central Processing Unit), MPU (Micro Processing Unit), or GPU (Graphics Processing Unit), or an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array).

[0033] The control unit 15 has internal memory for storing programs and control data that define various processing procedures, and executes each process using the internal memory. In addition, the control unit 15 functions as various processing units when various programs are run. For example, the control unit 15 has a collection unit 151, a supply unit 152, and an acquisition unit 153.

[0034] The collection unit 151 collects image metadata from the image source group 20. The provision unit 152 provides information about the metadata. The acquisition unit 153 acquires images from the image source group 20. In doing so, the acquisition unit 153 acquires images via the network N that satisfy the conditions indicating that they are displayable (for example, the metadata display flag is "1") and that correspond to the specified metadata. Furthermore, the provision unit 152 provides the images acquired by the acquisition unit 153.

[0035] Furthermore, the images and other information provided by the information provision device 10 may be used to check road conditions along the travel route, etc.

[0036] The collection process by the collection unit 151 will be explained using Figure 6. Figure 6 is a flowchart showing the flow of the collection process according to the first embodiment.

[0037] As shown in Figure 6, the collection unit 151 collects metadata from the image provider 40 (step S11). The collection unit 151 may also collect metadata online in real time in response to notifications from the image provider 40.

[0038] Here, the collection unit 151 determines whether the image provider 40 corresponding to the collected metadata is subject to protection (step S12). The collection unit 151 determines that the image provider 40 is subject to protection if the image provider ID notified by the image provider 40 exists in the protected image provider table 143. The collection unit 151 determines that the image provider 40 is not subject to protection if the image provider ID notified by the image provider 40 does not exist in the protected image provider table 143 (or exists in the unprotected image provider table 142).

[0039] If the collection unit 151 determines that the image provider 40 is subject to protection (step S12: Yes), it stores the collected metadata in the metadata table 141 and sets the display flag to "0" (step S14).

[0040] If the collection unit 151 determines that the image provider 40 is not subject to protection (step S12: No), it stores the collected metadata in the metadata table 141 and sets the display flag to "1" (step S13).

[0041] A display flag of "1" means that the image will be displayed to the user. Conversely, a display flag of "0" means that the image will not be displayed to the user.

[0042] In this way, the collection unit 151 sets a flag in the metadata that indicates the source of the image corresponding to the collected metadata is not designated as a protected object, i.e., a display flag. Note that setting the display flag is equivalent to setting the display flag to "1".

[0043] Here, the synchronization process by the data collection unit 151 will be explained using Figure 7. Figure 7 is a flowchart showing the flow of the synchronization process according to the first embodiment.

[0044] As shown in Figure 7, the collection unit 151 waits until a batch processing trigger occurs (step S21: No). When a batch processing trigger occurs (step S21: Yes), the collection unit 151 updates the display flag to "1" for metadata in the metadata table 141 whose display flag is "0" and for which the synchronization interval has elapsed since the timestamp date and time (step S22).

[0045] The synchronization interval is a predetermined time, such as 30 minutes or 1 hour. Through the data collection process in Figure 6 and the synchronization process in Figure 7, images that are not protected will have their metadata collected and will be displayed to the user in real time. On the other hand, images that are protected will not be displayed to the user at the time their metadata is collected, but will be displayed to the user when the batch processing trigger occurs, provided that the synchronization interval has elapsed since the image was captured. The batch processing trigger can be either a time interval or a manual operation.

[0046] In this way, the collection unit 151 sets a display flag on metadata for which a predetermined amount of time has elapsed since the date and time indicated in the metadata, among the metadata for which a display flag has not been set.

[0047] The process by which the providing unit 152 provides metadata information will be explained using Figure 8. Figure 8 is a flowchart showing the flow of the map display process according to the first embodiment. Here, the providing unit 152 displays a map containing metadata information on the screen of the terminal 30.

[0048] As shown in Figure 8, first, the providing unit 152 accepts a location specification (step S101). Here, the providing unit 152 accepts a general location. For example, the providing unit 152 accepts a specification of a circular or rectangular area centered on the current location of the terminal 30.

[0049] Next, the providing unit 152 refers to the metadata table 141 and identifies the metadata from the collected metadata that corresponds to the specified location (step S102). For example, the providing unit 152 identifies the metadata that falls within the specified range of the location indicated by the location information.

[0050] Next, the providing unit 152 displays pins on the map that correspond to the metadata with a display flag of "1" among the identified metadata (step S103). A pin is a graphic that represents a location on the map.

[0051] Here, the providing unit 152 divides the map into multiple areas using a virtual mesh (grid). The providing unit 152 selects one of the unselected meshes on the map (step S104).

[0052] If metadata does not exist in the selected mesh (step S105: No), the providing unit 152 proceeds to step S108. If metadata exists in the selected mesh (step S105: Yes), the providing unit 152 determines whether the existing metadata consists of only one metadata with a display flag of "0" (step S106).

[0053] If the only metadata present is one with a display flag of "0" (Step S106: Yes), the providing unit 152 proceeds to Step S108. If the metadata present is not just one with a display flag of "0" (Step S106: No), the providing unit 152 fills the mesh and displays the pins corresponding to the metadata with a display flag of "0" within the mesh on the map (Step S107). Note that filling includes overlaying a transparent pattern (such as shading) onto the mesh area. In addition, the providing unit 152 may perform any other processing to change the display manner so that the mesh is emphasized (for example, by changing the thickness of the border lines).

[0054] In other words, the providing unit 152 fills in meshes that are associated with multiple images regardless of the display flag, or with only one image whose display flag is "1". On the other hand, the providing unit 152 does not fill in meshes that are associated with only one image whose display flag is "0".

[0055] Thus, the providing unit 152 provides map images in which the display mode of a map divided into multiple regions is changed for regions where one or more images satisfying the conditions are associated, and for regions where multiple images not satisfying the conditions are associated.

[0056] If there are unselected meshes (step S108: Yes), the supply unit 152 returns to step S104 and repeats the process. If there are no unselected meshes (step S108: No), the supply unit 152 terminates the process.

[0057] Figure 9 illustrates a map according to the first embodiment. Map 80 is provided by the supply unit 152. Meshes are identified by horizontally arranged letters (A-G) and vertically arranged numbers (1-6) shown on the outside of Map 80. The letters and numbers are illustrated for illustrative purposes only. For example, a mesh corresponding to "A" and "1" is represented as mesh A1.

[0058] Map 80 displays pins 801, 802, 803, 804, 805, 806, 807, 808, and 809. Pin 810 is included for illustrative purposes only and is not actually displayed.

[0059] Mesh B2 has metadata with a display flag of "1," and pin 801, which corresponds to that metadata, is displayed. Therefore, mesh B2 is filled in.

[0060] Assume that the display flag for the metadata corresponding to pin 806 of mesh B5 is "0", and the display flag for the metadata corresponding to pin 807 is "1". Therefore, mesh B5 is filled in. Also, pin 806 is hidden at step S103, but becomes visible in step S107.

[0061] Assume that the display flags for the metadata corresponding to pins 808 and 809 of mesh C5 are both "0". In this case, since multiple pins exist, mesh C5 is filled in. Also, pins 808 and 809 are hidden at step S103 but are displayed in step S107.

[0062] Assume the metadata display flag for pin 810 of mesh D5 is "0". In this case, mesh D5 will not be filled. Also, as mentioned above, pin 810 will not actually be displayed.

[0063] Figure 10 shows an example of a screen according to the first embodiment. The supply unit 152 displays screen 60 on the terminal 30. Screen 60 displays an image 70 and a map 80. Initially, image 70 is hidden.

[0064] The image display process will be explained using Figure 11. Figure 11 is a flowchart showing the flow of the image display process according to the first embodiment.

[0065] As shown in Figure 11, the acquisition unit 153 accepts the specification of a pin on the map 80 (step S201). The acquisition unit 153 acquires an image corresponding to the specified pin from the image provider group 20 (step S202). The provision unit 152 displays the image acquired by the acquisition unit 153 on the screen 60 (step S203). Note that specifying a pin is an operation to specify location information from the metadata.

[0066] Before the synchronization process is performed, the acquisition unit 153 acquires images whose source is not designated as a protected image as images that meet the conditions. Whether or not the conditions are met is determined by a display flag that changes during the synchronization process. In other words, the acquisition unit 153 acquires images corresponding to metadata with a set display flag as images that meet the conditions.

[0067] [Effects of the first embodiment] As explained above, the collection unit 151 collects image metadata. The acquisition unit 153 acquires images via the network that satisfy the conditions indicating they are displayable and that correspond to specified metadata. The provision unit 152 provides the images acquired by the acquisition unit 153. For example, the acquisition unit 153 acquires images whose source is not designated as protected as images that satisfy the conditions.

[0068] As a result, the information providing device 10 can control conditions using flags or the like depending on whether the image provider is protected or not, thereby preventing information about the image provider from being inferred from metadata including location information or from the image itself, as needed. Consequently, according to this embodiment, information about the image provider is protected.

[0069] The collection unit 151 sets a display flag in the metadata to indicate that the source of the image corresponding to the collected metadata is not designated as a protected item. The acquisition unit 153 acquires the image corresponding to the metadata with the display flag set as an image that satisfies the conditions. This allows the information providing device 10 to clearly determine whether or not the source is a protected item.

[0070] The collection unit 151 sets a display flag on metadata that does not have a display flag set, and for which a predetermined amount of time has elapsed since the date and time indicated in the metadata. For example, even if an image and metadata are viewed a certain amount of time after the image was captured by a vehicle, it is difficult to accurately determine the current location of that vehicle. For this reason, the information providing device 10 can provide necessary information while adequately protecting the information of the provider.

[0071] The providing unit 152 provides map images that are divided into multiple regions, and which change the display mode of regions where one or more images satisfying the conditions are associated, and regions where multiple images that do not satisfy the conditions are associated. As a result, the information providing device 10 can provide necessary information in an intuitively understandable manner while adequately protecting the information of the provider.

[0072] [System configuration, etc.] Each component of the illustrated device is a functional concept and does not necessarily have to be physically configured as shown. In other words, the specific forms of distribution and integration of each device are not limited to those shown, and all or part of them can be functionally or physically distributed or integrated in any unit according to various loads and usage conditions. Furthermore, each processing function performed by each device can be implemented, all or any part of it, by a CPU and a program that is analyzed and executed by that CPU, or by hardware using wired logic. Note that the program may be executed not only by the CPU but also by other processors such as a GPU.

[0073] Furthermore, among the processes described in the embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by known methods. In addition, the processing procedures, control procedures, specific names, and information including various data and parameters shown in the above document and drawings can be arbitrarily changed unless otherwise specified.

[0074] [program] In one embodiment, the information providing device 10 can be implemented by installing a program that performs the above processing as packaged software or online software on a desired computer. For example, by having the above program run on an information processing device, the information processing device can be made to function as the information providing device 10. The information processing device referred to here includes desktop or notebook personal computers. In addition, mobile communication terminals such as tablet terminals and smartphones are also included in the category of information processing devices.

[0075] Furthermore, the information providing device 10 may be implemented as a web server, or it may be implemented as a cloud service that provides the above-mentioned processing services through outsourcing.

[0076] Figure 12 shows an example configuration of a computer running a program. Computer 1000 has, for example, memory 1010 and a CPU 1020. Computer 1000 also has a hard disk drive interface 1030, a disk drive interface 1040, a serial port interface 1050, a video adapter 1060, and a network interface 1070. These components are connected by a bus 1080.

[0077] Memory 1010 includes ROM (Read Only Memory) 1011 and RAM (Random Access Memory) 1012. ROM 1011 stores, for example, a boot program such as BIOS (Basic Input Output System). The hard disk drive interface 1030 is connected to the hard disk drive 1090. The disk drive interface 1040 is connected to the disk drive 1100. For example, a removable storage medium such as a magnetic disk or optical disk is inserted into the disk drive 1100. The serial port interface 1050 is connected to, for example, a mouse 1110 and a keyboard 1120. The video adapter 1060 is connected to, for example, a display 1130.

[0078] The hard disk drive 1090 stores, for example, the OS 1091, application programs 1092, program modules 1093, and program data 1094. That is, the programs that define each process of the information providing device 10 are implemented as program modules 1093 in which executable code for a computer is written. The program modules 1093 are stored, for example, in the hard disk drive 1090. For example, a program module 1093 for performing processes similar to the functional configuration of the information providing device 10 is stored in the hard disk drive 1090. Note that the hard disk drive 1090 may be replaced by an SSD (Solid State Drive).

[0079] Furthermore, the configuration data used in the processing of the above-described embodiment is stored as program data 1094 in, for example, memory 1010 or hard disk drive 1090. The CPU 1020 then reads the program module 1093 and program data 1094 stored in memory 1010 or hard disk drive 1090 into RAM 1012 as needed and executes the processing of the above-described embodiment.

[0080] Furthermore, the program module 1093 and program data 1094 are not limited to being stored in the hard disk drive 1090; for example, they may be stored in a removable storage medium and read by the CPU 1020 via a disk drive 1100 or the like. Alternatively, the program module 1093 and program data 1094 may be stored in another computer connected via a network (LAN (Local Area Network), WAN (Wide Area Network), etc.). The program module 1093 and program data 1094 may then be read by the CPU 1020 from the other computer via a network interface 1070. [Explanation of Symbols]

[0081] N Network 10 Information provision device 11 Communications Department 12 Input section 13 Output section 14 Storage section 15 Control Unit 20 Image Sources 30 devices 40 Image source Vehicles 40_1 and 40_4 40_2 Smartphone 40_3 Surveillance camera, 141 Metadata Tables 142 Table of Sources of Unprotected Images 143 Table of Sources of Protected Images 151 Collection Department 152 Provision Department 153 Acquisition Department

Claims

1. A collection unit that collects image metadata, An acquisition unit that acquires an image via a network that satisfies the conditions indicating that it is displayable, and which corresponds to a specified metadata from the metadata, The acquiring unit provides the image acquired by the acquiring unit, An information providing device characterized by having the following features.

2. The acquisition unit acquires images whose source is not designated as protected as images that satisfy the above conditions. The information providing device according to feature 1.

3. The collection unit sets a flag in the metadata indicating that the source of the image corresponding to the collected metadata is not designated as a protected object. The acquisition unit acquires the image corresponding to the metadata for which the flag has been set as an image that satisfies the conditions. The information providing device according to feature 1.

4. The collection unit sets the flag on metadata that does not have the flag set, for metadata where a predetermined amount of time has elapsed since the date and time indicated in the metadata. The information providing device according to feature 3.

5. The providing unit provides map images that are divided into multiple regions, and which change the display mode of regions where one or more images satisfying the above conditions are associated, and regions where multiple images that do not satisfy the above conditions are associated. The information providing device according to feature 1.

6. An information provision method performed by an information provision device, The collection process involves gathering image metadata, An acquisition step of acquiring an image via a network that satisfies the conditions indicating that it is displayable, and which corresponds to a specified metadata from the metadata; The acquisition step includes a provision step that provides the acquired image, A method of providing information characterized by including the following.

7. A collection step to collect image metadata, An acquisition step of acquiring an image via a network that satisfies the conditions indicating that it is displayable, and which corresponds to a specified metadata from the metadata; The acquisition step includes providing the acquired image, An information provision program characterized by causing a computer to execute a command.

Images