Information processing apparatus, control method of information processing apparatus, and program

Abstract

This invention provides an information processing apparatus, a control method for the information processing apparatus, and a program. Typically, when multiple tags automatically provided for content are arranged and displayed in a random order, the visibility of the tag information deteriorates. The information processing apparatus provided by this invention determines first relevant information about the content and acquires multiple second relevant information about the content. Then, based on the first relevant information, the order of the multiple second relevant information is set, and screen information is generated so that the multiple second relevant information are arranged and displayed on the screen according to the set order.

Description

Technical Field

[0001] This invention relates to a technique for displaying a list of multiple pieces of relevant information about content. Background Technology

[0002] Typically, images are analyzed to automatically provide multiple tag information as information about the image, and a list of multiple tag information is displayed (Patent Document 1).

[0003] Reference List

[0004] Patent documents

[0005] PTL 1: Japanese Patent Application Publication No. 2013-235457 Summary of the Invention

[0006] When multiple tags are automatically provided for an image and displayed in a random order, the following problem arises: due to the lack of a specific sorting standard, it is difficult for users to determine which tag information has been provided or to find the tag information they need.

[0007] Solution to the problem

[0008] According to one aspect of the present invention, an information processing apparatus includes: a determining unit configured to determine first related information about content; an acquiring unit configured to acquire a plurality of second related information about the content; a setting unit configured to set an order of the plurality of second related information based on the first related information; and a generating unit configured to generate screen information such that the plurality of second related information are arranged and displayed on a screen according to the set order.

[0009] According to the present invention, multiple tags automatically provided for the content are arranged and displayed according to specific criteria based on content characteristics, rather than in a random order. This improves the visibility of the tag information. Attached Figure Description

[0010] Figure 1 This is a block diagram illustrating an example configuration of a content management system according to an exemplary embodiment of this invention.

[0011] Figure 2 This is a block diagram illustrating an example configuration of a computer device according to an exemplary embodiment of the present invention.

[0012] Figure 3 This is a flowchart illustrating an example of an operation performed by a first information processing device 101 according to an exemplary embodiment of the present invention.

[0013] Figure 4AThis is an example diagram illustrating a table representing a score indicating the relevance between category information and label information according to an exemplary embodiment of the present invention.

[0014] Figure 4B This is an example diagram illustrating a table representing a score indicating the relevance between category information and label information according to an exemplary embodiment of the present invention.

[0015] Figure 5 This is an illustration showing an example of a content display screen according to an exemplary embodiment of the present invention. Detailed Implementation

[0016] Preferred exemplary embodiments of the invention are described in detail below with reference to the accompanying drawings. However, the components described in the exemplary embodiments are merely illustrative, and these descriptions are not intended to limit the scope of the invention.

[0017] (First exemplary embodiment)

[0018] Figure 1 This is a block diagram illustrating an example configuration of a content management system according to the present invention.

[0019] The first information processing device 101 and the second information processing device 102 are implemented by a server computer device. The electronic device 104 is implemented by a computer device such as a personal computer or a smartphone. The first information processing device 101 can communicate with each of the second information processing device 102 and the electronic device 104 via a network 103.

[0020] Figure 2 This is a block diagram illustrating an example configuration of a computer device including a first information processing device 101 and an electronic device 104. Both the first information processing device 101 and the electronic device 104 can be implemented by a single computer device. Alternatively, the functions of the first information processing device 101 and the electronic device 104 can be distributed among multiple computer devices as needed, allowing the first information processing device 101 and the electronic device 104 to be implemented by multiple computer devices. In the case of multiple computer devices, connecting them via a local area network (LAN) enables them to communicate with each other.

[0021] exist Figure 2In this configuration, control unit 201 comprehensively controls the first information processing device 101, and control unit 231 comprehensively controls the electronic device 104. Control units 201 and 231 are, for example, central processing units (CPUs). Read-only memories (ROMs) 202 and 232 store programs and parameters that do not need to be changed. Random access memories (RAMs) 203 and 233 temporarily store programs and data provided from devices such as external devices. External storage devices 204 and 234 are hard disk drives (HDDs) fixedly disposed in the first information processing device 101 and the electronic device 104, respectively. Optionally, external storage devices 204 and 234 can both be solid-state drives (SSDs) including flash memory, hybrid drives combining HDDs and flash memory, or memory cards. External storage devices 204 and 234 both store programs such as operating systems (OS). Input interfaces 205 and 235 both receive operations from the user and are connected to input devices for inputting data, such as pointing devices and keyboards. Bit movement units (BMUs) 206 and 236 control data transmission, for example, between memories (e.g., between video random access memory (VRAM) 207 and other memories, and between VRAM 237 and other memories), and between memories and their respective input / output (I / O) devices (e.g., network interfaces 209 and 239). VRAMs 207 and 237 draw images to be displayed on corresponding display devices 211 and 241. Images generated in VRAMs 207 and 237 are transmitted to display devices 211 and 241 respectively based on predetermined rules, thereby displaying the images. Network interfaces 209 and 239 are connected to a network 103 such as the Internet. System bus 212 enables each of units 201 to 209 to communicateably connect, and system bus 242 enables each of units 231 to 239 to communicateably connect.

[0022] External storage devices 204 and 234 both store content such as image files and music files.

[0023] Furthermore, the configuration of the second information processing device 102 is similar to that of the first information processing device 101.

[0024] Figure 3 This is a flowchart illustrating an example of the operations performed by the first information processing device 101 to generate display screen information for displaying content, category information (first related information), and tag information (second related information) on the electronic device 104. The control unit 201 of the first information processing device 101 performs the following operations by reading programs such as the OS stored in the external storage device 204, executing the programs, and controlling each unit.

[0025] In step S301, the control unit 201 receives content from the electronic device 104 via the network 103 and stores the received content in the external storage device 204. In step S302, the control unit 201 determines information about the content based on a first learning model of machine learning.

[0026] Next, in step S303, the control unit 201 sends the content to the second information processing device 102 via network 103. In step S304, the control unit 201 receives tag information about the content from the second information processing device 102. Here, the second information processing device 102 determines multiple tag information about the content based on a second learning model using machine learning. The second learning model is generated by using input data and training data different from those of the first learning model and adjusting them with different parameters. Therefore, even if the content is the same, the tag information determined based on the second learning model includes information different from the category information determined based on the first learning model.

[0027] In step S305, the control unit 201 sets the display order of the multiple tag information received in step S304 based on the category information determined in step S302. Specifically, in the first information processing device 101, the following are pre-stored in the external storage device 204: Figure 4A and Figure 4B The table shown represents a score indicating the relevance between each category and label information, determined by the first learning model. Because... Figure 4A Category information and Figure 4B The differences in the labels mean that even though the label information is the same, Figure 4A The correlation score in Figure 4B The difference lies in the following steps. In step S305, the control unit 201 reads the table of category information determined in step S302 from the external storage device 204, thereby obtaining the relevance score of each tag information received in step S304, and sets the display order of the tag information to descending order of the relevance scores.

[0028] In step S306, the control unit 201 generates content display screen information, which arranges and displays the content, the category information determined in step S302, and the multiple tag information received in step S304 according to the display order set in step S305. Then, the control unit 201 sends the content display screen information to the electronic device 104 via network 103. The content display screen information may not include all the multiple tag information received in step S304. For example, it may display a predetermined number of tag information items with high relevance among the multiple tag information items. Alternatively, it may display tag information items with a relevance level of a threshold or higher.

[0029] Figure 5This is an example of a content display screen 500 displayed on the display device 241 of the electronic device 104. The content received in step S301 is displayed in the content display area 501. The category information determined in step S302 is displayed in the category display area 502. In the label display area 503, multiple label messages received in step S304 are arranged and displayed according to the display order set in step S305.

[0030] In step S302, machine learning can be used to determine category information about the content. For example, if the content is an image file, category information can be determined based on metadata such as the time and location of the video capture. Alternatively, the user can input optional category information.

[0031] If the content is a moving image file or a music file, the tag information may change based on the playback time. In this case, in step S305, the display order can also be set based on the time of appearance or the frequency of appearance.

[0032] Optionally, in step 305, a score of the relevance between the category information and the label information can be calculated each time label information is received, instead of referring to a pre-reserved table. In this case, for example, an algorithm used to calculate language similarity can be used to calculate the score.

[0033] Furthermore, in step S304, the control unit 201 receives the reliability of each of the multiple tag information items from the second information processing device 102. However, reliability only indicates the degree of certainty of each tag information item estimated by a machine learning model, and the user cannot determine its standard. Therefore, even when multiple tag information items are arranged and displayed based on reliability, it appears to the user as if the tag information items are arranged and displayed in a random order. In this exemplary embodiment, multiple tag information items are displayed in a display order different from the reliability order, based on content characteristics (content information). This improves the user's overview of the tag information.

[0034] This exemplary embodiment has been described using the case where the first information processing device 101, the second information processing device 102, and the electronic device 104 are all implemented as independent devices. However, this exemplary embodiment is not limited thereto. This exemplary embodiment can be applied, as appropriate, to the case where the first information processing device 101, the second information processing device 102, and the electronic device 104 are implemented as a single device with corresponding functions. For example, the functions of the first information processing device 101 and the second information processing device 102 can be implemented by a single device, the functions of the first information processing device 101 and the electronic device 104 can be implemented by a single device, or the functions of the first information processing device 102 and the electronic device 104 can be implemented by a single device. Alternatively, the functions of the first information processing device 101, the second information processing device 102, and the electronic device 104 can be implemented by a single device.

[0035] Furthermore, the first information processing device 101, the second information processing device 102, and the electronic device 104 can be connected via LAN or short-range wireless communication instead of public lines such as the Internet.

[0036] This invention is not limited to the embodiments described above, and various changes and modifications can be made without departing from the spirit and scope of the invention. Therefore, in order to disclose the scope of the invention, the following claims are set forth.

[0037] This application claims priority to Japanese Patent Application No. 2019-154618, filed on August 27, 2019, the entire contents of which are incorporated herein by reference.

Claims

1. An information processing apparatus capable of communicating with an external information processing apparatus and an external electronic apparatus via a network, the information processing apparatus comprising: a determination unit configured to determine first related information about content received from the external electronic apparatus based on a first learning model based on machine learning; an acquisition unit configured to acquire, from the external information processing apparatus, a plurality of pieces of second related information about the content, the external information processing apparatus determining the plurality of pieces of second related information based on a second learning model different from the first learning model based on machine learning; a setting unit configured to set an order of the plurality of pieces of second related information based on the first related information; and a generation unit configured to generate screen information so that the plurality of pieces of second related information are arranged and displayed on a screen in accordance with the set order, wherein the first related information is category information, and the second related information is tag information. The determination unit determines the first related information based on metadata of the content, and the acquisition unit acquires the second related information determined based on a learning model based on machine learning.

2. The information processing apparatus according to claim 1, wherein 3.The information processing apparatus according to claim 1, The determination unit determines the first related information based on an input of a user, and wherein wherein the acquisition unit acquires the second related information determined based on a learning model based on machine learning. The order to be set is different from an order based on a degree of certainty estimated from a learning model based on machine learning of the second related information.

4. The information processing apparatus according to claim 1, wherein 5.The information processing apparatus according to any one of claims 1 to 4, further comprising a storage unit configured to store a degree of relevance of each of the first related information to the plurality of pieces of second related information, The setting unit sets the order based on a level of the degree of relevance. wherein 6.The information processing apparatus according to any one of claims 1 to 4, further comprising a calculation unit configured to calculate a degree of relevance between the first related information and each of the plurality of pieces of second related information based on a predetermined algorithm, The setting unit sets the order based on a level of the degree of relevance. wherein 7.The information processing apparatus according to any one of claims 1 to 4, further comprising: a transmission unit configured to transmit the screen information to the electronic apparatus. The acquisition unit acquires the second related information from another external information processing apparatus. 8.The information processing apparatus according to any one of claims 1 to 4, wherein 9.A control method of an information processing apparatus capable of communicating with an external information processing apparatus and an external electronic apparatus via a network, the control method comprising: determining first related information about content received from the external electronic apparatus based on a first learning model based on machine learning; acquiring, from the external information processing apparatus, a plurality of pieces of second related information about the content, the external information processing apparatus determining the plurality of pieces of second related information based on a second learning model different from the first learning model based on machine learning; setting an order of the plurality of pieces of second related information in accordance with the first related information; and ​ generate screen information so that the plurality of pieces of second related information are arranged and displayed on a screen in the set order, wherein the first related information is category information and the second related information is tag information. 10.A computer program product that causes a computer to function as each unit of the information processing apparatus according to any one of claims 1 to 8. 11.A non-transitory computer-readable storage medium storing a program that, when executed by a processor, causes the processor to perform operations comprising: determining first related information about content received from an external electronic device based on a first learning model of machine learning; acquiring, from an external information processing apparatus, a plurality of pieces of second related information about the content, the external information processing apparatus determining the plurality of pieces of second related information based on a second learning model different from the first learning model of machine learning; setting an order of the plurality of pieces of second related information based on the first related information; and generating screen information so that the plurality of pieces of second related information are arranged and displayed on a screen in the set order, wherein the first related information is category information and the second related information is tag information.

Images