Information processing apparatus, information processing method, and information processing program

Abstract

To support posting of an image by a user.SOLUTION: An information processing device according to the present invention includes an extraction unit and a proposal unit. The extraction unit extracts a relevant image that is an image relevant to an event of a news article distributed by a news site, from among images stored in a terminal of a user. The proposal unit proposes posting of the related image extracted by the extraction unit to a comment field of the news article.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] Conventionally, there are techniques for accepting comments on news articles distributed on news sites, etc. Patent Document 1 discloses a technique for accepting, via a weather forecast application, images (photos) related to the weather in a user's current location. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2024-43931 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the conventional technology, users themselves have to select the images to post, and there is room for improvement in terms of supporting image posting.

[0005] The present invention has been made in view of the above, and aims to provide an information processing device, an information processing method, and an information processing program that can support the posting of images. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the object, an information processing device according to the present invention includes an extraction unit and a suggestion unit. The extraction unit extracts related images from images stored in a user's terminal device that are related to events in news articles distributed on a news site. The suggestion unit suggests posting the related images extracted by the extraction unit to a comment section of the news article. [Effects of the Invention]

[0007] According to the present invention, it is possible to support the posting of images. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of information processing according to an embodiment. [Figure 2] FIG. 2 is a block diagram illustrating an example of the configuration of the information processing device according to the embodiment. [Figure 3] FIG. 3 is a diagram illustrating an example of information stored in a content storage unit according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of information stored in a user information storage unit according to the embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of a proposal screen according to the embodiment. [Figure 6] FIG. 6 is a flowchart illustrating an example of a processing procedure of the proposal processing according to the embodiment. [Figure 7] FIG. 7 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the information processing device according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an information processing device, an information processing method, and an information processing program according to the present application will be described in detail with reference to the drawings. Note that the information processing device, the information processing method, and the information processing program according to the present application are not limited to the embodiments.

[0010] [Embodiment] [1. Information Processing] First, an example of information processing according to the embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of information processing according to the embodiment. Note that the information processing according to the embodiment is realized by an information processing device 1 shown in Fig. 1.

[0011] 1 is an information processing device that operates various web media such as news sites, etc. The information processing device 1 is realized by, for example, a cloud system or a server.

[0012] 1 is a terminal device owned by a user U. For example, the user U operates the user terminal 100 to provide the user U with various contents such as news articles through a news site provided by the information processing device 1. Furthermore, the user terminal 100 can post comments on news articles based on the user U's operation. Although FIG. 1 illustrates an example in which the user terminal 100 is a smartphone, the user terminal 100 may be other devices such as a PC (Personal Computer).

[0013] Incidentally, for example, when a user U posts an image or the like on a social networking service or the like, the user U himself or herself selects the image to post. On the other hand, for example, when a user U posts an image on a news site, the user U posts an image corresponding to the news article he or she is viewing.

[0014] For example, an image posted by a user U is provided to other users U as supplementary information for a news article. To give a specific example, suppose that a user U views a news article about a traffic accident, and a photo of the area around the accident site is stored in the user terminal 100 of the user U.

[0015] In such a case, if a user U posts a photo of the accident scene in a comment on a news article, other users U can understand the situation at the accident scene. In this way, by encouraging users to post images related to the news article, the news article can be made more substantial.

[0016] Based on this premise, when user U posts an image on a news site, the image must be related to the news article. However, it is time-consuming for user U to select the image to post. Therefore, this task becomes a hurdle for user U when posting an image.

[0017] Therefore, in the information processing according to the embodiment, related images that are images related to the events in the news article are extracted, and a suggestion is made to post the related images to the user U. Specifically, in the information processing according to the embodiment, matching is made between the events in the news article and images that the user U has saved in the user terminal 100, and support is provided when the user U selects an image to post.

[0018] 1, the information processing device 1 acquires metadata of each image stored in the user terminal 100, which is a terminal device of the user U (step S1). For example, the information processing device 1 acquires metadata of each image when a news app installed in the user terminal 100 is permitted to access an image folder of the user terminal 100.

[0019] The metadata is data that indicates the attributes of each image stored in the user terminal 100. More specifically, the metadata includes data related to the time the image was captured, the location where the image was captured, the objects (e.g., people, objects, etc.) appearing in the image, the background of the objects, and the weather.

[0020] For example, the user terminal 100 can assign these metadata to images when capturing the images, and the information processing device 1 acquires the metadata of each image analyzed by the user terminal 100. Note that the user terminal 100 does not need to provide the information processing device 1 with the metadata of all images, and may provide the information processing device 1 with only the metadata of some of the images. Also, the user terminal 100 does not need to provide the information processing device 1 with all types of metadata, and may provide the information processing device 1 with only some of the types of metadata.

[0021] Alternatively, the user U may select images for which metadata is to be shared in advance, and the information processing device 1 may acquire only the metadata of the images selected by the user U as the images to be shared. That is, the information processing device 1 may perform the following processing on images for which the user U has given permission in advance.

[0022] Next, the information processing device 1 extracts related images, which are images related to events in the news articles distributed on the news site, based on the metadata of each image (step S2). For example, the information processing device 1 extracts related images related to the news article currently being viewed by the user U.

[0023] The extraction of related images is performed, for example, by comparing the metadata of a news article with the metadata of each image. Specifically, the information processing device 1 extracts, as related images, images for which the similarity between the metadata of the news article and the metadata of the image exceeds a threshold. In this way, the information processing device 1 selects related images on behalf of the user U by comparing the metadata of the news article and the image.

[0024] Then, the information processing device 1 suggests to the user U via the user terminal 100 that the user U post a related image to the news article corresponding to the related image (step S3). This allows the user U to easily post a related image in the comment section of the news article.

[0025] In the above example, a case where a related image corresponding to the news article being viewed by the user U is extracted has been described, but the present invention is not limited to this. That is, the information processing device 1 may extract related images related to other news articles distributed through a news site.

[0026] For example, in such a case, the information processing device 1 extracts related images related to the events of the news article to be extracted from the user terminal 100 of each user U. Then, the information processing device 1 may suggest to each user terminal 100 from which the related images have been extracted that the news article be viewed and related images be posted.

[0027] [2. Information Processing Device] Next, a configuration example of the information processing device 1 according to the embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the configuration example of the information processing device 1 according to the embodiment. As shown in Fig. 2, the information processing device 1 includes a communication unit 2, a storage unit 3, and a control unit 4. Note that the information processing device 1 may also include an input unit (e.g., a keyboard or a mouse) that accepts various operations from an administrator who uses the information processing device 1, and a display unit (e.g., a liquid crystal display) that displays various information.

[0028] The communication unit 2 is realized by, for example, a network interface card (NIC), etc. The communication unit 2 is connected to a communication network such as 4G (4th Generation) or 5G (5th Generation) by wire or wirelessly, and transmits and receives information to and from each of the user terminals 100, etc. via the communication network.

[0029] The storage unit 3 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 3 includes a content storage unit 31 and a user information storage unit 32.

[0030] The content storage unit 31 stores information related to content. In the present disclosure, content includes news articles and comments and images posted in comment sections. Fig. 3 is a diagram showing an example of information stored in the content storage unit 31 according to the embodiment.

[0031] As shown in FIG. 3, the content storage unit 31 stores information items such as "content ID," "content body," "metadata," and "comments" in association with one another.

[0032] The "Content ID" field stores an identifier for identifying each piece of content. The "Content Body" field stores the body of the content identified by the corresponding content ID. The content body includes the title of the news article, a thumbnail image, and a summary.

[0033] The "Metadata" item stores metadata for the content identified by the corresponding content ID. The metadata is attribute information for the news article, and includes, for example, information about the events in the news article, the location and time of the events, etc.

[0034] The "Comment" item stores comments posted to the content identified by the corresponding content ID. The comments include text and images (especially related images).

[0035] Returning to the explanation of Fig. 2, the user information storage unit 32 will be explained. The user information storage unit 32 stores user information. In the present disclosure, user information is information about users registered with a news site that distributes news articles.

[0036] 4 is a diagram illustrating an example of information stored in the user information storage unit 32 according to the embodiment. As shown in FIG. 4, the user information storage unit 32 stores information items such as "user ID" and "image metadata" in association with each other.

[0037] The "user ID" item stores an identifier for identifying each user U. The user ID may be an identifier for identifying the user terminal 100 of each user U. The "image metadata" item stores metadata for each image stored in the user terminal 100 of the user U identified by the corresponding user ID. The user information storage unit 32 may store each image itself stored in the user terminal 100 instead of the "image metadata."

[0038] Returning to the explanation of Fig. 2, the control unit 4 will now be described. The control unit 4 is a controller, and is realized, for example, by a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) using RAM as a work area to execute various programs (corresponding to examples of information processing programs) stored in a storage device inside the information processing device 1. The control unit 4 is also, for example, a controller, and is realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0039] As shown in Fig. 2, the control unit 4 includes an acquisition unit 41, an extraction unit 42, and a proposal unit 43, and realizes or executes the functions and actions of the information processing described below. The internal configuration of the control unit 4 is not limited to the configuration shown in Fig. 2, and may be other configurations as long as they perform the information processing described below. Furthermore, the connection relationship between the processing units included in the control unit 4 is not limited to the connection relationship shown in Fig. 2, and may be other connection relationships.

[0040] The acquisition unit 41 acquires various types of information. For example, the acquisition unit 41 acquires news articles distributed through a news site from a producer terminal that creates the news articles, and registers the news articles in the content storage unit 31.

[0041] Furthermore, the acquisition unit 41 acquires, from each user terminal 100, information relating to images stored in each user terminal 100. For example, the acquisition unit 41 acquires metadata of each image as information relating to the image.

[0042] More specifically, when the user U grants permission to access the photo folder to a news app installed on each user terminal 100, the metadata of the photo file is shared with the news app. The acquisition unit 41 acquires the metadata shared with the news app from each user terminal 100.

[0043] The acquisition unit 41 also registers the metadata of each acquired image in the user information storage unit 32 as image metadata.

[0044] The extraction unit 42 extracts related images, which are images related to events in news articles distributed on news sites, from among the images stored in the user terminal 100, which is a terminal device of the user.

[0045] First, the extraction unit 42 sets metadata for each news article before extracting related images. For example, the extraction unit 42 extracts key keywords from the text of each news article and sets metadata for each news article based on the extracted keywords. For example, the metadata includes the events in the news article, the location where the events occurred, the time of occurrence, etc.

[0046] Next, the extraction unit 42 compares the metadata (image metadata) of the images stored in each user terminal 100 with the metadata of each news article, and extracts related images from each image stored in the user terminal 100 that are related to events in the news article distributed on the news site.

[0047] The extraction unit 42 calculates the similarity between the metadata of the news article from which the related image is to be extracted and each metadata of each image, and extracts the image with the highest calculated similarity that exceeds a threshold as the related image.

[0048] In this case, the extraction unit 42 performs a process of extracting related images starting from a news article, or a process of extracting related images starting from an image. First, a process of extracting related images starting from a news article will be described.

[0049] The extraction unit 42 sets the news article currently being viewed by the user U as the news article from which related images are to be extracted, and extracts related images of the news article from among the images on the user terminal 100 of the user U.

[0050] In such a case, the information processing device 1 can suggest that the user U post a related image to the news article that the user U is viewing.

[0051] In addition, the extraction unit 42 may set news articles that satisfy certain conditions, such as the number of views exceeding a certain value, as news articles from which related images are to be extracted, in addition to the news articles currently being viewed by the user U.

[0052] For example, in such a case, the extraction unit 42 extracts related images of the set news article from each image on the user terminal 100 of the user U, and the suggestion unit 43, which will be described later, will suggest to the user U to post related images by push notification or the like.

[0053] Next, a process for extracting related images starting from an image will be described. In such a case, first, the user U selects an image at the user terminal 100. Based on the image selected by the user U, the extraction unit 42 picks out news articles for which the selected image is a related image.

[0054] In other words, in such a case, if there is an event in a news article related to the image selected by the user, the extraction unit 42 will extract the image as a related image. This allows the user U to easily identify news articles to which the user U can post his or her own image.

[0055] In either case, the extraction unit 42 extracts, as related images, images taken near the location where the event described in the news article occurred or images taken near the location around the time of the event described in the news article. Note that the vicinity of the location of occurrence is defined based on the distance from the location of occurrence, such as within several hundred meters of the location of occurrence.

[0056] That is, the extraction unit 42 extracts images that supplement the events of the news article as related images. This allows the content of the news article to be enriched by the posting of related images by the user U.

[0057] The suggestion unit 43 suggests posting the related image extracted by the extraction unit 42 to the comment section of the news article. For example, the suggestion unit 43 suggests to the user U that the user U post a related image related to the news article that the user U is viewing.

[0058] 5 is a diagram illustrating an example of a proposal screen according to the embodiment. For example, when the extraction unit 42 extracts related images related to a news article that the user U is viewing, the proposal unit 43 proposes to the user U to post the related images through the proposal screen illustrated in FIG.

[0059] As shown in FIG. 5, for example, the proposal screen displays text encouraging user U to post related images and related images (here, images 1 to 3). For example, user U can post related images by selecting an image to post through the proposal screen and selecting the post button. Note that when posting related images, user U may also be able to post a comment.

[0060] Furthermore, when a news article that satisfies a predetermined condition other than the news article currently being viewed by the user U is set as a news article from which related images are to be extracted, the suggestion unit 43 may suggest posting of related images together with the news article, for example, by a push notification to the user terminal 100. Furthermore, such a notification may be sent by a banner or the like, for example, the next time the user U views a news site.

[0061] In addition, for example, if there is a news article related to the image selected by the user U, the suggestion unit 43 can suggest to the user U that the image be posted as a related image to the target news article.

[0062] [3. Processing flow] Next, a processing procedure executed by the information processing device 1 according to the embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart showing an example of the processing procedure of the proposal processing according to the embodiment. Note that the processing shown below is repeatedly executed by the information processing device 1 at a predetermined cycle.

[0063] 6, first, the information processing device 1 acquires metadata for each image stored in each user terminal 100 (step S101). Next, the information processing device 1 compares each metadata of each news article with each metadata of each image, and extracts related images related to the news article from each image (step S102).

[0064] Next, the information processing device 1 suggests posting the extracted related images to the user U who owns the related images (step S103), and ends the process.

[0065] [4. Modifications] In the above-described embodiment, the information processing device 1 extracts related images related to a news article and suggests posting them, but the present invention is not limited to this. That is, news articles may be expanded to include various types of content. For example, various types of content include information posted on various reservation sites such as social networking sites, blogs, and restaurants.

[0066] [5. Effects] The information processing device 1 according to the embodiment includes an extraction unit 42 that extracts related images from among the images stored in the user's terminal device, which are images related to events in a news article distributed on a news site, and a suggestion unit 43 that suggests posting the related images extracted by the extraction unit 42 to the comment section of the news article.

[0067] Furthermore, the extraction unit 42 extracts related images that are related to the events of the news article that the user is currently viewing, and the suggestion unit 43 suggests that the user post the images to the comments section of the news article that the user is currently viewing.

[0068] The extraction unit 42 also extracts, as related images, images taken near the location where an event in a news article occurred. If there is an event in a news article related to an image selected by the user, the extraction unit 42 extracts the image as a related image. The extraction unit 42 also extracts related images based on image metadata assigned by the terminal device.

[0069] By performing any one or a combination of the above-described processes, the information processing device according to the present application can support the posting of images.

[0070] [6. Hardware Configuration] The information processing device 1 according to the embodiment described above is realized by, for example, a computer 1000 configured as shown in Fig. 7. Fig. 7 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device according to the embodiment. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, an HDD 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.

[0071] The CPU 1100 operates and controls each unit based on programs stored in the ROM 1300 or the HDD 1400. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 starts up, programs that depend on the hardware of the computer 1000, and the like.

[0072] The HDD 1400 stores programs executed by the CPU 1100, data used by such programs, etc. The communication interface 1500 receives data from other devices via a network (communication network) N and sends the data to the CPU 1100, and transmits data generated by the CPU 1100 to other devices via the network N.

[0073] The CPU 1100 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse (in FIG. 7, the output devices and input devices are collectively referred to as "input / output devices") via the input / output interface 1600. The CPU 1100 acquires data from the input devices via the input / output interface 1600. The CPU 1100 also outputs generated data to the output devices via the input / output interface 1600.

[0074] Media interface 1700 reads a program or data stored in recording medium 1800 and provides it to CPU 1100 via RAM 1200. CPU 1100 loads the program or data from recording medium 1800 onto RAM 1200 via media interface 1700 and executes the loaded program. Recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase Change Rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0075] For example, when the computer 1000 functions as the information processing device according to the embodiment, the CPU 1100 of the computer 1000 executes programs loaded onto the RAM 1200 to realize the functions of the control unit 4. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, the CPU 1100 may obtain these programs from another device via the network N.

[0076] [7. Other] Although the embodiments of the present application have been described above, the present invention is not limited to the contents of these embodiments. Furthermore, the above-described components include those that can be easily imagined by a person skilled in the art, those that are substantially the same, and those that are within the scope of so-called equivalents. Furthermore, the above-described components can be combined as appropriate. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the spirit of the above-described embodiments.

[0077] Furthermore, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using a known method. In addition, the information including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.

[0078] Furthermore, the components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

[0079] For example, the above-mentioned information processing device may be realized using multiple server computers, and depending on the function, the configuration can be flexibly changed, such as by calling an external platform using an API (Application Programming Interface) or network computing.

[0080] Furthermore, the above-described embodiments and modifications can be combined as appropriate within the scope of not causing any contradiction in the processing content.

[0081] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit," etc. For example, an acquisition unit can be read as an acquisition means or an acquisition circuit. [Explanation of symbols]

[0082] 1. Information processing equipment 2. Communications Department 3 Storage section 4. Control Unit 31 Content storage unit 32 User information storage unit 41 Acquisition Department 42 Extraction part 43 Proposal Department 100 user terminals U User

Claims

1. an extracting unit that extracts, from among the images stored in the user's terminal device, related images that are images related to events in news articles distributed on the news site; a suggestion unit that suggests posting the related image extracted by the extraction unit to a comment section of the news article; An information processing device comprising:

2. The extraction unit extracting the related images that are related to events in the news article that the user is viewing; The proposal unit Suggesting comments to be posted to the news article that the user is viewing 2. The information processing device according to claim 1,

3. The extraction unit extracting, as the related image, the image taken in the vicinity of the location where the event in the news article occurred; 2. The information processing device according to claim 1,

4. The extraction unit If there is an event in a news article related to the image selected by the user, the image is extracted as the related image.

2. The information processing device according to claim 1,

5. The extraction unit Extracting the related images based on the metadata of the images added by the terminal device.

2. The information processing device according to claim 1,

6. 1. A computer-implemented information processing method, comprising: an extraction step of extracting related images, which are images related to events in news articles distributed on news sites, from among the images stored in the user's terminal device; a suggestion step of suggesting posting of the related image extracted by the extraction step to a comment section of the news article; An information processing method comprising:

7. an extraction step of extracting related images, which are images related to events in news articles distributed on news sites, from among the images stored in the user's terminal device; a suggestion step of suggesting posting the related image extracted by the extraction step to a comment section of the news article; An information processing program characterized by causing a computer to execute the above.

Images