Information provision device, information provision method, and information provision program

Abstract

An information provision device (10) comprises a collection unit (151), a provision unit (152), and an acquisition unit (153). The collection unit (151) collects metadata of an image. The acquisition unit (153) acquires, via a network, an image which satisfies a condition indicating displayability and which corresponds to designated metadata among items of metadata. The provision unit (152) provides the image which has been acquired by the acquisition unit (153). For example, the acquisition unit (153) acquires, as the image which satisfies the condition, an image, the provider of which is not designated to be protected.

Description

Information Providing Device, Information Providing Method, and Information Providing Program

[0001] The present invention relates to an information providing device, an information providing method, and an information providing program.

[0002] Conventionally, a technique for showing the driving history of a vehicle and information related to an image on a map based on video data captured by an imaging device mounted on the vehicle is known (see, for example, Patent Document 1).

[0003] Japanese Unexamined Patent Application Publication No. 2024 - 25846

[0004] However, in the conventional technique, there is a problem that information regarding the source of an image may not be protected when providing the image.

[0005] For example, when an image is provided together with location information, even if the personal information of the image provider is not made public, by comparing the contents and location information of a plurality of images, the provider's movement route and behavior pattern may be inferred.

[0006] The present invention has been made in view of the above, and an object thereof is to protect information regarding the source of an image when providing the image.

[0007] In order to solve the above problems and achieve the object, the information providing device of the present invention includes a collection unit that collects metadata of an image, an acquisition unit that acquires, via a network, an image that satisfies a condition indicating that it is displayable and that corresponds to specified metadata among the metadata, and a provision unit that provides the image acquired by the acquisition unit.

[0008] According to the present invention, information regarding the source of an image can be protected when providing the image.

[0009] Figure 1 is a diagram illustrating the overview of an information providing device according to the first embodiment. Figure 2 is a diagram showing an example configuration of the information providing device according to the first embodiment. Figure 3 is a diagram showing an example of a metadata table according to the first embodiment. Figure 4 is a diagram showing an example of an unprotected image source table according to the first embodiment. Figure 5 is a diagram showing an example of a protected image source table according to the first embodiment. Figure 6 is a flowchart showing the flow of the collection process according to the first embodiment. Figure 7 is a flowchart showing the flow of the synchronization process according to the first embodiment. Figure 8 is a flowchart showing the flow of the map display process according to the first embodiment. Figure 9 is a diagram illustrating a map according to the first embodiment. Figure 10 is a diagram showing an example of a screen according to the first embodiment. Figure 11 is a flowchart showing the flow of the image display process according to the first embodiment. Figure 12 is a diagram showing an example configuration of a computer that executes a program.

[0010] The information provision device, information provision method, and information provision program relating to this application will be described in detail below with reference to the drawings. However, the present invention is not limited to the embodiments described below.

[0011] [First Embodiment] Figure 1 is a diagram illustrating the outline of an information providing device according to the first embodiment. The information providing device 10 shown in Figure 1 provides stored images to the user. The images may be still images or moving images.

[0012] The images provided by the information providing device 10 are captured by devices included in the image provider group 20 (hereinafter referred to as image providers). Each image provider has the function of capturing images and the function of data communication. For example, the image provider group 20 includes a vehicle 40_1 equipped with a camera (e.g., a dashcam), a smartphone 40_2, a surveillance camera 40_3, and a vehicle 40_4 as image providers. Note that image providers are not limited to the devices described herein. Also, image providers may sometimes be referred to as image provider 40 without distinction.

[0013] The information providing device 10 collects metadata from the image provider 40 via the network N. Network N is an LTE (Long Term Evolution) network. The information providing device 10 also provides information to the user via the terminal 30.

[0014] The exchange of data between the information providing device 10 and the image source group 20 may be carried out via a system infrastructure different from that of the information providing device 10.

[0015] The information providing device 10 provides metadata information. The information providing device 10 also receives an image display request from the terminal 30 in accordance with the metadata information it has provided. The information providing device 10 acquires an image from the image source group 20 in accordance with the received request. Furthermore, the information providing device 10 provides the acquired image.

[0016] In other words, the information providing device 10 can acquire images from the image source group 20 as needed and provide the acquired images without having to store the images itself. This allows the information providing device 10 to reduce the resources required for storing data.

[0017] The configuration of the information providing device 10 will be explained using Figure 2. Figure 2 is a diagram showing an example of the configuration of the information providing device according to the first embodiment. As shown in Figure 2, the information providing device 10 has a communication unit 11, an input unit 12, an output unit 13, a storage unit 14, and a control unit 15.

[0018] The communication unit 11 is an interface for communicating with other devices, including the terminal 30. For example, the communication unit 11 is a NIC (Network Interface Card).

[0019] The input unit 12 is an interface for receiving data input. For example, the input unit 12 is connected to input devices such as a keyboard and a mouse.

[0020] The output unit 13 is an interface for outputting data. For example, the output unit 13 is connected to output devices such as a display and a speaker.

[0021] The storage unit 14 is a storage device such as an HDD (Hard Disk Drive), SSD (Solid State Drive), or optical disc. Alternatively, the storage unit 14 may be a rewritable semiconductor memory such as RAM (Random Access Memory), flash memory, or NVSRAM (Non-Volatile Static Random Access Memory). The storage unit 14 stores the OS (Operating System) and various programs executed by the information providing device 10.

[0022] The storage unit 14 stores the metadata table 141, the unprotected image provider table 142, and the protected image provider table 143.

[0023] The metadata table 141 contains the collected metadata. Figure 3 shows an example of a metadata table according to the first embodiment. As shown in Figure 3, the metadata table 141 has columns for "Image ID", "Image Source ID", "Timestamp", "Latitude", "North-South", "Longitude", "East-West", "Number of Satellites Used", "Size", "Length", and "Display Flag".

[0024] The "Image ID" column stores information that identifies the image. The "Image Source ID" column stores information that identifies the source of the image. The "Timestamp" column stores the date and time related to the image (for example, the date and time the image was taken). The "Latitude" column stores the latitude of the location where the image was taken.

[0025] The "North-South" column stores the north-south latitude. The "Longitude" column stores the longitude of the location where the image was captured. The "East-West" column stores the east-west longitude. Note that latitude and longitude are calculated by satellite positioning. The "Number of Satellites Used" column stores the number of satellites used to determine the position (latitude and longitude). The "Size" column stores the size of the image data. The "Length" column stores the length of the image if it is a moving image. The "Display Flag" column stores a flag used to determine whether or not to display the image in a specific process.

[0026] Each record in the metadata table 141 is metadata corresponding to each image. The metadata includes time information (timestamp) and location information (latitude, longitude, and satellite number). The location information is obtained by a GNSS (Global Navigation Satellite System) (e.g., GPS (Global Positioning System)) module installed in the image provider 40.

[0027] The location information may be based on NMEA (National Marine Electronics Association) sentences obtained by the image provider 40. Furthermore, the columns of the metadata table 141 are not limited to those described in Figure 3, and may include other items from the NMEA sentences.

[0028] For example, Figure 3 shows that the image identified as "A1001" was provided by the image provider identified as "U11," and that its timestamp is "2024-11-01 05:24:19.00." It also shows that the latitude of the image identified as "A1001" is "3539.314624 N," its longitude is "13945.64118 E," and that it uses 7 satellites. Furthermore, it shows that the size of the image identified as "A1001" is "134KB," its length is "00:00:05," and its display flag is "1."

[0029] The unprotected image provider table 142 contains information on image providers that are not designated as protected. On the other hand, the protected image provider table 143 contains information on image providers that are designated as protected.

[0030] Figure 4 shows an example of an unprotected image source table according to the first embodiment. Figure 4 shows that the image sources identified as "U11" and "U13" are not designated as protected.

[0031] Figure 5 shows an example of a protected image source table according to the first embodiment. Figure 5 shows that the image sources identified as "U12" and "U14" are designated as protected.

[0032] The control unit 15 controls the entire information providing device 10. The control unit 15 is, for example, an electronic circuit such as a CPU (Central Processing Unit), MPU (Micro Processing Unit), or GPU (Graphics Processing Unit), or an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array).

[0033] The control unit 15 has an internal memory for storing programs and control data that define various processing procedures, and executes each process using the internal memory. In addition, the control unit 15 functions as various processing units when various programs are run. For example, the control unit 15 has a collection unit 151, a supply unit 152, and an acquisition unit 153.

[0034] The collection unit 151 collects image metadata from the image source group 20. The provision unit 152 provides information about the metadata. The acquisition unit 153 acquires images from the image source group 20. In doing so, the acquisition unit 153 acquires images via the network N that satisfy the conditions indicating that they are displayable (for example, the metadata display flag is "1") and that correspond to the specified metadata. Furthermore, the provision unit 152 provides the images acquired by the acquisition unit 153.

[0035] Furthermore, the images and other information provided by the information provision device 10 may be used to check road conditions along the travel route, etc.

[0036] The collection process by the collection unit 151 will be explained using Figure 6. Figure 6 is a flowchart showing the flow of the collection process according to the first embodiment.

[0037] As shown in Figure 6, the collection unit 151 collects metadata from the image provider 40 (step S11). The collection unit 151 may also collect metadata online in real time in response to notifications from the image provider 40.

[0038] Here, the collection unit 151 determines whether the image provider 40 corresponding to the collected metadata is subject to protection (step S12). The collection unit 151 determines that the image provider 40 is subject to protection if the image provider ID notified by the image provider 40 exists in the protected image provider table 143. The collection unit 151 determines that the image provider 40 is not subject to protection if the image provider ID notified by the image provider 40 does not exist in the protected image provider table 143 (or exists in the unprotected image provider table 142).

[0039] If the collection unit 151 determines that the image provider 40 is subject to protection (step S12: Yes), it stores the collected metadata in the metadata table 141 and sets the display flag to "0" (step S14).

[0040] If the collection unit 151 determines that the image provider 40 is not subject to protection (step S12: No), it stores the collected metadata in the metadata table 141 and sets the display flag to "1" (step S13).

[0041] A display flag of "1" means that the image will be displayed to the user. Conversely, a display flag of "0" means that the image will not be displayed to the user.

[0042] In this way, the collection unit 151 sets a flag in the metadata that indicates the source of the image corresponding to the collected metadata is not designated as a protected object, i.e., a display flag. Note that setting the display flag is equivalent to setting the display flag to "1".

[0043] Here, the synchronization process by the collection unit 151 will be explained using Figure 7. Figure 7 is a flowchart showing the flow of the synchronization process according to the first embodiment.

[0044] As shown in FIG. 7, the collection unit 151 waits until a trigger for batch processing occurs (step S21: No). When a trigger for batch processing occurs (step S21: Yes), the collection unit 151 updates the display flag of the metadata in which the time of the synchronization interval has elapsed from the date and time of the timestamp among the metadata whose display flag in the metadata table 141 is "0" to "1" (step S22).

[0045] The synchronization interval is a predetermined time such as 30 minutes or 1 hour. By the collection process of FIG. 6 and the synchronization process of FIG. 7, images that are not protection targets will have their metadata collected and be displayed to the user in real time. On the other hand, images that are protection targets are not displayed to the user when the metadata is collected, but when a trigger for batch processing occurs, if the synchronization interval has elapsed since imaging, they will be displayed to the user. Note that the trigger for batch processing may be the passage of time or a manual operation.

[0046] Thus, the collection unit 151 sets the display flag for the metadata in which a predetermined time has elapsed from the date and time indicated in the metadata among the metadata for which the display flag is not set.

[0047] Using FIG. 8, the process of providing information regarding metadata by the providing unit 152 will be described. FIG. 8 is a flowchart showing the flow of the map display process according to the first embodiment. Here, the providing unit 152 displays a map including information regarding metadata on the screen of the terminal 30.

[0048] As shown in FIG. 8, first, the providing unit 152 accepts a position specification (step S101). Here, the providing unit 152 accepts a rough position. For example, the providing unit 152 accepts the specification of a range of a circle or rectangle centered on the current position of the terminal 30.

[0049] Next, the providing unit 152 refers to the metadata table 141 and identifies the metadata from the collected metadata that corresponds to the specified location (step S102). For example, the providing unit 152 identifies the metadata that falls within the specified range of the location indicated by the location information.

[0050] Next, the providing unit 152 displays pins on the map that correspond to metadata with a display flag of "1" among the identified metadata (step S103). A pin is a graphic that represents a location on the map.

[0051] Here, the providing unit 152 divides the map into multiple areas using a virtual mesh (grid). The providing unit 152 selects one of the unselected meshes on the map (step S104).

[0052] If metadata does not exist in the selected mesh (step S105: No), the providing unit 152 proceeds to step S108. If metadata exists in the selected mesh (step S105: Yes), the providing unit 152 determines whether the existing metadata consists of only one metadata with a display flag of "0" (step S106).

[0053] If the only metadata present is one with a display flag of "0" (step S106: Yes), the providing unit 152 proceeds to step S108. If the metadata present is not just one with a display flag of "0" (step S106: No), the providing unit 152 fills in the mesh and displays the pins corresponding to the metadata with a display flag of "0" within the mesh on the map (step S107). Note that filling includes overlaying a transparent pattern (such as shading) onto the mesh area. In addition, the providing unit 152 may perform any other processing to change the display manner so that the mesh is emphasized (for example, by changing the thickness of the border lines).

[0054] In other words, the providing unit 152 fills in meshes that are associated with multiple images regardless of the display flag, or with only one image whose display flag is "1". On the other hand, the providing unit 152 does not fill in meshes that are associated with only one image whose display flag is "0".

[0055] In this way, the providing unit 152 provides map images in which the display mode of a map divided into multiple regions is changed for regions where one or more images satisfying the conditions are associated, and for regions where multiple images that do not satisfy the conditions are associated.

[0056] If there are unselected meshes (step S108: Yes), the providing unit 152 returns to step S104 and repeats the process. If there are no unselected meshes (step S108: No), the providing unit 152 terminates the process.

[0057] Figure 9 illustrates a map according to the first embodiment. Map 80 is provided by the supply unit 152. Meshes are identified by horizontally arranged letters (A to G) and vertically arranged numbers (1 to 6) shown on the outside of map 80. The letters and numbers are illustrated for illustrative purposes only. For example, a mesh corresponding to "A" and "1" is represented as mesh A1.

[0058] Map 80 shows pins 801, 802, 803, 804, 805, 806, 807, 808, and 809. Pin 810 is shown for illustrative purposes only and is not actually displayed.

[0059] Mesh B2 has metadata with a display flag of "1," and pin 801, which corresponds to that metadata, is displayed. Therefore, mesh B2 is filled in.

[0060] Assume that the display flag for the metadata corresponding to pin 806 of mesh B5 is "0", and the display flag for the metadata corresponding to pin 807 is "1". Therefore, mesh B5 is filled in. Also, pin 806 is hidden at step S103, but becomes visible in step S107.

[0061] Assume that the display flags for the metadata corresponding to pins 808 and 809 of mesh C5 are both "0". In this case, since multiple pins exist, mesh C5 is filled in. Also, pins 808 and 809 are hidden at step S103 but are displayed in step S107.

[0062] Assume the metadata display flag for pin 810 of mesh D5 is "0". In this case, mesh D5 will not be filled. Also, as mentioned above, pin 810 will not actually be displayed.

[0063] Figure 10 shows an example of a screen according to the first embodiment. The display unit 152 displays the screen 60 on the terminal 30. The screen 60 displays an image 70 and a map 80. In the initial state, the image 70 is hidden.

[0064] The image display process will be explained using Figure 11. Figure 11 is a flowchart showing the flow of the image display process according to the first embodiment.

[0065] As shown in Figure 11, the acquisition unit 153 accepts the specification of a pin on the map 80 (step S201). The acquisition unit 153 acquires an image corresponding to the specified pin from the image provider group 20 (step S202). The provision unit 152 displays the image acquired by the acquisition unit 153 on the screen 60 (step S203). Note that specifying a pin is an operation to specify location information from the metadata.

[0066] Before the synchronization process is performed, the acquisition unit 153 acquires images whose source is not designated as a protected image as images that satisfy the conditions. Whether or not the conditions are met is determined by a display flag that changes during the synchronization process. In other words, the acquisition unit 153 acquires images corresponding to metadata with a set display flag as images that satisfy the conditions.

[0067] [Effects of the First Embodiment] As described above, the collection unit 151 collects image metadata. The acquisition unit 153 acquires images via the network that satisfy the conditions indicating that they are displayable and that correspond to specified metadata among the metadata. The provision unit 152 provides the images acquired by the acquisition unit 153. For example, the acquisition unit 153 acquires images whose source is not designated as a protected object as images that satisfy the conditions.

[0068] As a result, the information providing device 10 can control conditions using flags or the like depending on whether the image provider is protected or not, thereby preventing information about the image provider from being inferred from metadata including location information or from the image itself, as needed. Consequently, according to this embodiment, information about the image provider is protected.

[0069] The collection unit 151 sets a display flag in the metadata to indicate that the source of the image corresponding to the collected metadata is not designated as a protected item. The acquisition unit 153 acquires the image corresponding to the metadata with the display flag set as an image that satisfies the conditions. As a result, the information providing device 10 can clearly determine whether or not the source is a protected item.

[0070] The collection unit 151 sets a display flag on metadata that does not have a display flag set, and for which a predetermined amount of time has elapsed since the date and time indicated in the metadata. For example, even if an image and metadata are viewed a certain amount of time after the image was captured by a vehicle, it is difficult to accurately determine the current location of that vehicle. For this reason, the information providing device 10 can provide necessary information while adequately protecting the information of the provider.

[0071] The providing unit 152 provides map images that are divided into multiple regions, and which change the display mode of regions where one or more images satisfying the conditions are associated, and regions where multiple images that do not satisfy the conditions are associated. As a result, the information providing device 10 can provide necessary information in an intuitively understandable manner while sufficiently protecting the information of the provider.

[0072] [System Configuration, etc.] The components of each illustrated device are functionally conceptual and do not necessarily need to be physically configured as shown. In other words, the specific forms of distribution and integration of each device are not limited to those shown, and all or part of them can be functionally or physically distributed or integrated in any unit according to various loads and usage conditions. Furthermore, each processing function performed by each device can be implemented, in whole or in any part, by a CPU and a program that is analyzed and executed by that CPU, or by hardware using wired logic. Note that the program may be executed not only by the CPU but also by other processors such as a GPU.

[0073] Furthermore, among the processes described in the embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by known methods. In addition, the processing procedures, control procedures, specific names, and information including various data and parameters shown in the above document and drawings can be arbitrarily changed unless otherwise specified.

[0074] [Program] In one embodiment, the information providing device 10 can be implemented by installing a program that performs the above processing as packaged software or online software on a desired computer. For example, by having the above program run on an information processing device, the information processing device can be made to function as the information providing device 10. The information processing device referred to here includes desktop or notebook personal computers. In addition, mobile communication terminals such as tablet terminals and smartphones are also included in the category of information processing devices.

[0075] Furthermore, the information providing device 10 may be implemented as a web server, or it may be implemented as a cloud service that provides the above-mentioned processing services through outsourcing.

[0076] Figure 12 shows an example configuration of a computer running a program. Computer 1000 has, for example, memory 1010 and a CPU 1020. Computer 1000 also has a hard disk drive interface 1030, a disk drive interface 1040, a serial port interface 1050, a video adapter 1060, and a network interface 1070. These components are connected by a bus 1080.

[0077] Memory 1010 includes ROM (Read Only Memory) 1011 and RAM (Random Access Memory) 1012. ROM 1011 stores, for example, a boot program such as BIOS (Basic Input Output System). The hard disk drive interface 1030 is connected to the hard disk drive 1090. The disk drive interface 1040 is connected to the disk drive 1100. For example, a removable storage medium such as a magnetic disk or optical disk is inserted into the disk drive 1100. The serial port interface 1050 is connected to, for example, a mouse 1110 and a keyboard 1120. The video adapter 1060 is connected to, for example, a display 1130.

[0078] The hard disk drive 1090 stores, for example, the OS 1091, application programs 1092, program modules 1093, and program data 1094. That is, the programs that define each process of the information providing device 10 are implemented as program modules 1093 in which executable code for a computer is written. The program modules 1093 are stored, for example, in the hard disk drive 1090. For example, a program module 1093 for performing processes similar to the functional configuration of the information providing device 10 is stored in the hard disk drive 1090. Note that the hard disk drive 1090 may be replaced by an SSD (Solid State Drive).

[0079] Furthermore, the configuration data used in the processing of the above-described embodiment is stored as program data 1094 in, for example, memory 1010 or hard disk drive 1090. The CPU 1020 then reads the program module 1093 and program data 1094 stored in memory 1010 or hard disk drive 1090 into RAM 1012 as needed and executes the processing of the above-described embodiment.

[0080] Furthermore, the program module 1093 and program data 1094 are not limited to being stored in the hard disk drive 1090; for example, they may be stored in a removable storage medium and read by the CPU 1020 via a disk drive 1100 or the like. Alternatively, the program module 1093 and program data 1094 may be stored in another computer connected via a network (LAN (Local Area Network), WAN (Wide Area Network), etc.). The program module 1093 and program data 1094 may then be read by the CPU 1020 from the other computer via a network interface 1070.

[0081] N Network 10 Information provision device 11 Communication unit 12 Input unit 13 Output unit 14 Storage unit 15 Control unit 20 Image provider group 30 Terminal 40 Image provider 40_1, 40_4 Vehicle 40_2 Smartphone 40_3 Surveillance camera 141 Metadata table 142 Unprotected image provider table 143 Protected image provider table 151 Collection unit 152 Provision unit 153 Acquisition unit

Claims

1. An information providing device comprising: a collection unit for collecting image metadata; an acquisition unit for acquiring images via a network that satisfy conditions indicating they are displayable and that correspond to specified metadata from the metadata; and a provision unit for providing the images acquired by the acquisition unit.

2. The information providing device according to claim 1, characterized in that the acquisition unit acquires images whose source is not designated as a protected object as images that satisfy the above conditions.

3. The information providing device according to claim 1, characterized in that the collection unit sets a flag in the metadata indicating that the source of the image corresponding to the collected metadata is not designated as a protected object, and the acquisition unit acquires the image corresponding to the metadata on which the flag has been set as an image that satisfies the conditions.

4. The information providing device according to claim 3, characterized in that the collection unit sets the flag on metadata for which the flag has not been set, and for which a predetermined amount of time has elapsed from the date and time indicated in the metadata.

5. The information providing device according to claim 1, characterized in that the providing unit provides map images in which the display mode of a map divided into a plurality of regions is changed for regions in which one or more images satisfying the above conditions are associated, and for regions in which multiple images not satisfying the above conditions are associated.

6. An information provision method performed by an information provision device, comprising: a collection step of collecting image metadata; an acquisition step of acquiring an image via a network that satisfies conditions indicating that it is displayable, and which corresponds to a specified metadata from the metadata; and a provision step of providing the image acquired by the acquisition step.

7. An information provision program characterized by causing a computer to perform the following steps: a collection step of collecting image metadata; an acquisition step of acquiring an image via a network that satisfies conditions indicating that it is displayable and corresponds to a specified metadata from the metadata; and a provision step of providing the image acquired in the acquisition step.

Images