Display information acquisition program, communication apparatus, display information acquisition method, and display information acquisition system

Abstract

The present invention identifies a channel in which content is reproduced.　Provided is a display information acquisition system for not only identifying display content but also identifying a display channel therefor in a display device that is capable of displaying content in a plurality of channels including one or more broadcast channels and one or more communication channels, and that has an OS and a processor, wherein the display information acquisition system comprises: a channel identification unit provided to the display device, the channel identification unit identifying, on the basis of information ascertained by using a function of an OS of the display device, which channel from among the plurality of channels is the display channel for the display content; a content identification unit for identifying the display content on the basis of sound from a speaker of the display device; and an association unit for associating the identified display channel and the identified display content.

Description

Display information acquisition program, communication device, display information acquisition method, and display information acquisition system

[0001] The present invention relates to a display information acquisition program, a communication device, a display information acquisition method, and a display information acquisition system.

[0002] A technology for identifying content based on the audio of the content is known (Patent Document 1). Incidentally, in recent years, the channels through which content is viewed have become more diverse. For example, when viewing a certain content on television, it is possible to view the content not only via terrestrial broadcasting but also via a distribution service. There are also many distribution services available (YouTube, Netflix, and Hulu (all registered trademarks)).

[0003] Special table 2019-507533 publication

[0004] The object of the present invention is to identify on which channel the content is being played.

[0005] According to one aspect of the present invention, there is provided a display information acquisition system for not only identifying display content but also identifying the display channel in a display device capable of displaying content on multiple channels including one or more broadcast channels and one or more communication channels, the display information acquisition system comprising: a channel identification unit provided in the display device that identifies which of the multiple channels the display channel of the display content is on the basis of information grasped by a function of the OS of the display device; a content identification unit that identifies the display content on the basis of audio from a speaker of the display device; and an association unit that associates the identified display channel with the identified display content.

[0006] [2] In the display information acquisition system according to [1], the associating unit may associate the identified display content with which of the plurality of channels the display content was displayed.

[0007] [3] In the display information acquisition system described in [1] or [2], the communication channel is provided by a distribution service that becomes available when a communication content control program is executed by a processor of the display device, and the information grasped by a function of the OS of the display device may include the operating status of the distribution service or the execution status of the communication content control program.

[0008] [4] In the display information acquisition system according to any one of [1] to [3], the channel identification unit may be realized by installing a program on the display device and executing it by a processor of the display device.

[0009] [5] In the display information acquisition system described in any one of [1] to [4], the association unit may be provided in a display information management server, and may include a transmission unit provided in the display device that transmits the identified display channel to the display information management server in response to a user operation to turn the display device on or off.

[0010] According to one aspect of the present invention, [6] there is provided a display information acquisition program to be installed on a display device capable of displaying content on multiple channels including one or more broadcast channels and one or more communication channels, the display information acquisition program functioning as a channel identification unit that identifies which of the multiple channels is the display channel for the displayed content based on information grasped by a function of the OS of the display device.

[0011] According to one aspect of the present invention, [7] there is provided a display information acquisition method for not only identifying display content but also identifying the display channel in a display device capable of displaying content on a plurality of channels including one or more broadcast channels and one or more communication channels, and having an OS and a processor, the display information acquisition method including: a channel identification step in which a channel identification unit provided in the display device identifies which of the plurality of channels the display channel of the display content is, based on information grasped by a function of the OS of the display device; a content identification step in which the display content is identified based on audio from a speaker of the display device; and an association step in which the identified display channel and the identified display content are associated.

[0012] According to one aspect of the present invention, [8] there is provided a display information acquisition system for identifying not only the display content but also the display channel in a display device capable of displaying content on multiple channels including one or more communication channels and having a communication function, the display information acquisition system comprising: a channel identification unit that identifies the display channel of the display content based on communication data sent or received by the display device; a content identification unit that identifies the display content based on audio from a speaker of the display device; and an association unit that associates the identified display channel with the identified display content.

[0013] [9] In the display information acquisition system described in [8], the display device may be connected to a network with a communication device having a router function and communicate via this communication device, and the channel identification unit may identify the display channel of the display content based on communication data transmitted by the display device via the communication device or communication data received by the display device via the communication device.

[0014] According to one aspect of the present invention,

[10] there is provided a display information acquisition system for identifying not only display content but also the display channel in a display device capable of displaying content on multiple channels including one or more communication channels, wherein the communication channel is provided by a distribution service provided by a communication content control device connected to the display device, the display information acquisition system comprising: a channel identification unit that identifies the display channel of the display content based on communication data sent or received by the communication content control device; a content identification unit that identifies the display content based on audio from a speaker of the display device; and an association unit that associates the identified display channel with the identified display content.

[0015]

[11] In the display information acquisition system described in

[10] , the communication content control device is connected to a communication device having a router function via a network, and communicates via this communication device, and the channel identification unit may identify the display channel of the display content based on communication data transmitted by the communication content control device via the communication device or communication data received by the communication content control device via the communication device.

[0016]

[12] In the display information acquisition system according to any one of [8] to

[11] , the associating unit may associate the identified display content with which of the plurality of channels the content was displayed on.

[0017]

[13] In the display information acquisition system described in any one of [8] to

[12] , the channel identification unit may identify the display channel of the display content based on at least one of an IP address, a communication pattern, and a communication destination included in the communication data.

[0018]

[14] In the display information acquisition system described in

[13] , the communication channel is provided by a distribution service that receives and plays content data from a distribution server, and if there is a distribution server that corresponds to the IP address, the channel identification unit may identify the display channel as a communication channel provided by the distribution service that corresponds to that distribution server.

[0019]

[15] In the display information acquisition system described in

[14] , the channel identification unit identifies the display channel as a broadcast channel when there is no distribution server corresponding to the IP address.

[0020]

[16] In the display information acquisition system described in

[13] , the channel identification unit may identify the display channel using a classifier that has previously learned the relationship between communication patterns and distribution services.

[0021] According to one aspect of the present invention,

[17] there is provided a display information acquisition method for identifying not only display content but also its display channel in a display device capable of displaying content on a plurality of channels including one or more communication channels and having a communication function, the display information acquisition method including: a channel identification step of identifying the display channel of the display content based on communication data transmitted or received by the display device; a content identification step of identifying the display content based on audio from a speaker of the display device; and an association step of associating the identified display channel with the identified display content.

[0022] According to one aspect of the present invention,

[18] there is provided a display information acquisition method for identifying not only display content but also its display channel in a display device capable of displaying content on multiple channels including one or more communication channels, wherein the communication channel is provided by a distribution service provided by a communication content control device connected to the display device, the display information acquisition method comprising: a channel identification step of identifying the display channel of the display content based on communication data sent or received by the communication content control device; a content identification step of identifying the display content based on audio from a speaker of the display device; and an association step of associating the identified display channel with the identified display content.

[0023] According to one aspect of the present invention,

[19] there is provided a communication device connected to a display device capable of displaying content on a plurality of channels including one or more communication channels, the communication device comprising a channel identification unit that identifies a display channel for the displayed content based on communication data transmitted to or received from the display device.

[0024] According to one aspect of the present invention,

[20] there is provided a communication device connected to a display device, one or more communication content control devices each corresponding to a communication channel, and one or more distribution servers each corresponding to the communication channels, the communication device comprising a channel identification unit that identifies a display channel for a display content based on communication data sent or received between the one or more communication content control devices and / or the one or more distribution servers.

[0025] You can identify which channel the content is playing on.

[0026] 1A 。 FIG. 1B is a block diagram showing a schematic configuration of a display information acquisition system according to the first embodiment. FIG. 1C is a block diagram showing a schematic configuration of a display information acquisition system that is a first modified example of FIG. 1A. FIG. 1D is a block diagram showing a schematic configuration of a display information acquisition system that is a second modified example of FIG. 1A. FIG. 1E is a diagram showing a schematic example of the structure of fingerprint database 41. FIG. 1F is a diagram showing a schematic example of the structure of fingerprint database 41. FIG. 1G is a diagram showing a schematic example of the structure of content database 60. FIG. 1H is a diagram showing information collected by display information management server 5. FIG. 1I is a block diagram showing a schematic configuration of a display information acquisition system according to a second embodiment. FIG. 1I is a diagram showing a schematic example of the structure of fingerprint database 41. FIG. 1J is a block diagram showing a schematic configuration of a display information acquisition system according to a modified example of the second embodiment.

[0027] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0028] (First embodiment) In the first embodiment, in a display device capable of displaying content on multiple channels including one or more broadcast channels and one or more communication channels, not only is the display content identified, but also the display channel is identified.

[0029] Here, "displaying content on a broadcast channel" means receiving content data from a broadcast station or the like via broadcast waves and displaying the content. Also, "displaying content on a communication channel" means receiving content data from a distribution server or the like via communication and displaying the content.

[0030] Furthermore, the "display content" may be content that is being displayed on the display device in real time, or may be content that was displayed at some point in the past.

[0031] "Specifying a display channel" may mean specifying whether the display content is displayed on a broadcast channel or a communication channel. More specifically, it may mean specifying which broadcast station (e.g., NHK (registered trademark), Fuji Television (registered trademark), etc.) among the broadcast channels on which the display content is displayed, or which distribution service (e.g., YouTube, Netflix, Hulu, etc.) among the communication channels on which the display content is displayed.

[0032] 1A is a block diagram showing a schematic configuration of a display information acquisition system according to a first embodiment. The display information acquisition system includes a display device 1, a microphone 2 as a voice acquisition unit, a content identification device 3, a fingerprint management server 4, and a display information management server 5.

[0033] The display device 1 is, for example, a television set installed in each home, and includes a display 11, a speaker 12, a broadcast wave processing unit 13, a communication processing unit 14, a processor 15, a memory 16, and the like.

[0034] The broadcast wave processing means 13 is composed of an antenna, a tuner, an encoder, etc. The broadcast wave processing means 13 receives broadcast waves on which content data from one or more broadcast stations is superimposed, and performs appropriate processing such as channel selection and decoding to play back the content. Playing back broadcast content includes displaying images (moving or still images) that make up the content on the display 11 and outputting audio that makes up the content from the speaker 12.

[0035] The communication processing means 14 transmits and receives various data and information to and from external devices such as the display information management server 5, distribution servers 91A to 91C, etc. There are no particular limitations on the communication means, and it may be, for example, internet communication (including Wi-Fi (registered trademark)).

[0036] The display device 1 of this embodiment is premised on having an OS (Operating System) 70 stored in the memory 16. The OS 70 is, for example, Android (registered trademark) or iOS (registered trademark), or may be an OS unique to the display device 1.

[0037] The memory 16 also stores a broadcast content control program 71. The processor 15 executes the broadcast content control program 71 to implement a broadcast content control unit 61. It can be said that the display device 1 has the broadcast content control unit 61, or that the processor 15 functions as the broadcast content control unit 61.

[0038] The broadcast content control unit 61 controls the broadcast wave processing means 13 to display broadcast content on the display 11. As a specific example, the broadcast content control unit 61 receives a broadcast station selection instruction from the user (for example, pressing a specific station selection button on a remote control), selects content data from the broadcast station corresponding to the instruction, and displays the broadcast content on the display 11.

[0039] The memory 16 also stores a communication content control program 72A. When the processor 15 executes the communication content control program 72A, a communication content control unit 62A that uses distribution service A is realized. It can be said that the display device 1 has the communication content control unit 62A, or that the processor 15 functions as the communication content control unit 62A. It can also be said that the display device 1 has distribution service A built-in.

[0040] The communication content control unit 62A receives content data distributed (e.g., streaming distributed) from the distribution server 91A via the communication processing means 14, and plays the communication content by the distribution service A. The communication content playback also includes displaying the images (moving or still images) that make up the content on the display 11 and outputting the sounds that make up the content from the speaker 12.

[0041] As a specific example, the communication content control unit 62A receives an instruction to start distribution service A from the user (for example, pressing a button on a remote control to start distribution service A) and starts distribution service A. Furthermore, the communication content control unit 62A transmits a content data acquisition request to the distribution server 91A to acquire content selected by the user from the content distributed by the distribution server 91A. In response to this request, the communication content control unit 62A receives the content data distributed from the distribution server 91A and plays the communication content.

[0042] The same applies to the communication content control program 72B and the communication content control program 72C. Each of the distribution services A to C is, for example, YouTube, NetFlix, Hulu, etc., but may be any other service. It can also be said that each of the distribution servers 91A to 91C corresponds to one communication channel.

[0043] The communication content control programs 72A to 72C may be installed on the display device 1 at the time of shipment of the display device 1, or may be installed by the user as desired. In this embodiment, three distribution services A to C are illustrated, but there is no limit to the number, as long as there is one or more.

[0044] One of the functions of the OS 70 is to keep track of the operation status (log) of the broadcast content control unit 61 and the communication content control units 62A to 62C (distribution services A to C). It can also be said that the OS 70 keeps track of the execution status (log) of the broadcast content control program 71 and the communication content control programs 72A to 72C.

[0045] More specifically, the functions of the OS 70 include determining whether the broadcast content control unit 61 is (or was) displaying broadcast content (currently or at a predetermined time in the past) on the display 11. In addition, the functions may include determining from which broadcast station the broadcast content control unit 61 is (or was) displaying broadcast content on the display 11.

[0046] Another function of the OS 70 includes grasping the start / end times of the distribution services A to C. It also includes grasping whether each of the communication content control units 62A to 62C is (or was) displaying communication content on the display 11 (currently or at a predetermined time in the past).

[0047] The memory 16 also stores a display information acquisition program 73, which is one of the features of this embodiment. The processor 15 executes the display information acquisition program 73 to realize the display information acquisition unit 63. It can be said that the display device 1 has the display information acquisition unit 63, or that the processor 15 functions as the display information acquisition unit 63. The display information acquisition program 73 may be installed in the display device 1 at the time of shipment of the display device 1, or may be installed after shipment.

[0048] The display information acquisition unit 63 can be composed of a channel identification unit 64 and a transmission unit 65 .

[0049] The channel identification unit 64 identifies the display channel of the displayed content based on information obtained by the functions of the OS 70. Normally, content is not played simultaneously on two or more channels among one or more broadcast channels and one or more communication channels. Therefore, the channel identification unit 64 can identify the display channel as follows.

[0050] When identifying the display channel of the currently displayed content, the channel identification unit 64 acquires the current operating status of the broadcast content control unit 61 and the communication content control units 62A to 62C from the functions of the OS 70. Then, based on the operating status, the channel identification unit 64 identifies the display channel.

[0051] For example, if the information obtained by the functions of the OS 70 indicates that the broadcast content control unit 61 is receiving broadcast waves and playing broadcast content, the displayed channel is identified as a broadcast channel. If the OS 70 can determine which broadcast station the broadcast content control unit 61 is playing back, the channel identification unit 64 may identify which broadcast station's broadcast channel the content is from. As an example, the OS 70 may obtain which channel selection button on a remote control has been pressed.

[0052] Furthermore, when the information grasped by the function of OS 70 indicates that distribution service A is running, or indicates that content data is being received from distribution server 91A and communication content is being played back, the displayed channel is identified as the communication channel of distribution service A. As an example, OS 70 may obtain which button on the remote control has been pressed to start a particular distribution service.

[0053] When identifying the display channel of content that was displayed at a predetermined time in the past, the channel identification unit 64 acquires the operating status of the broadcast content control unit 61 and the communication content control units 62A to 62C at that predetermined time in the past from the functions of the OS 70. Then, based on the operating status, the channel identification unit 64 identifies the display channel. Specific examples of the identification method are the same as those described above. Note that the display channel can also be identified in a similar manner when a single screen is divided and multiple contents are displayed on the single screen.

[0054] The transmitting unit 65 transmits information indicating the display channel identified by the channel identifying unit 64 to the display information management server 5. This information indicates, for example, which channel is being displayed at a certain time or hour.

[0055] The timing of the transmission is arbitrary. For example, transmission may be performed periodically at a predetermined time (e.g., 10:00 AM every day). However, the display device 1 frequently goes into a sleep state (e.g., a home television is often turned off when the whole family goes out). Therefore, if the display device 1 is in a sleep state at the predetermined time, transmission may not be possible. Therefore, for example, the transmission unit 65 may detect that the display device 1 is about to be turned off based on the function of the OS 70, and may perform transmission before the display device 1 is turned off. In other words, transmission may be performed in response to a user operation to turn off the display device 1, such as pressing a power button on a remote control. Alternatively, transmission may be performed in response to a user operation to turn on the display device 1.

[0056] Next, a description will be given of content identification by the content identification device 3. The content identification device 3 has a content identification unit 31 and a transmission unit 32, and can also be called a survey device.

[0057] The content identification unit 31 identifies the display content based on the sound from the speaker 12. More specifically, the microphone 2 is placed in a position where it can acquire sound from the speaker 12 of the display device 1 (i.e., the sound of the display content), and the content identification unit 31 identifies the content based on the sound acquired by the microphone 2. Note that data communication between the microphone 2 and the display device 1 may be via a wired connection such as a USB cable, or via a wireless connection such as Bluetooth (registered trademark).

[0058] An example of processing by content identification unit 31 is as follows: Content identification unit 31 processes the audio from microphone 2 to generate an audio fingerprint (hereinafter simply referred to as a "fingerprint"). This fingerprint corresponds to at least a part of the content being played when microphone 2 picked up the audio. Content identification unit 31 then transmits the fingerprint to fingerprint management server 4, which has fingerprint database 41.

[0059] 2A, the correspondence between fingerprints and content is stored in fingerprint database 41. For example, if the generated fingerprint is F2, this means that the audio captured by microphone 2 belongs to content C2.

[0060] Here, it is desirable that a fingerprint corresponding to every piece of content be stored in fingerprint database 41. In particular, since the broadcast content displayed on a broadcast channel is limited, it is desirable that a fingerprint corresponding to all content broadcast within a predetermined period (for example, from the present to one week ago) be stored. The broadcast station and broadcast date and time may be further associated with the content.

[0061] On the other hand, the amount of content displayed on communication channels is enormous, and it is difficult to store fingerprints corresponding to all of them in fingerprint database 41. Therefore, it is decided to store at least fingerprints corresponding to target content (for example, content that is the subject of an investigation into how much it has been displayed).

[0062] Fingerprint management server 4 refers to fingerprint database 41 to identify the content corresponding to the received fingerprint. For example, according to fingerprint database 41 in Fig. 2A, if the fingerprint is "F2", the corresponding content is "C2". Fingerprint management server 4 then transmits information indicating the identified content to content identification unit 31.

[0063] In this way, the content identification unit 31 can identify the display content that was being played back when the microphone 2 picked up the sound.

[0064] The transmitting unit 32 transmits information indicating the content identified by the content identifying unit 31 to the display information management server 5 .

[0065] Next, a description will be given of the display information management server 5. The display information management server 5 includes an association unit 51 and a display information database 52.

[0066] The associating unit 51 associates the display channel identified by the channel identifying unit 64 with the display content identified by the content identifying unit 31. For example, if it is identified that the display channel at a certain point in time was channel X and the display content at the same time was content Y, the associating unit 51 associates the content Y with channel X to indicate that the content Y was displayed on channel X.

[0067] In this way, it is possible to associate the identified display content with which of the multiple channels it was displayed on.

[0068] For example, suppose that the content to be investigated is a specific commercial message (CM), and that this CM may be played back as broadcast content, or as communication content for distribution service A, distribution service B, or distribution service C.

[0069] If only the content were identified, it would be possible to determine the number of times the commercial in question was played (the total number of times it was played on the broadcast content and on each of distribution services A to C), but it would not be possible to determine on which channel it was played.

[0070] In contrast to this, in this embodiment, not only is the content identified, but also the channel on which the content was played is identified, so that it is possible to know on which channel and how many times the CM being investigated was played.

[0071] The display information database 52 stores information about which content was displayed on which channel based on the association process performed by the association unit 51. It can also be said that the display information management server 5 associates the display channel identified by the channel identification unit 64 with the display content identified by the content identification unit 31 and stores the information in the display information database 52.

[0072] The display device 1 is, for example, a television set installed in each home. In this case, information indicating which content was displayed on which channel is transmitted from the display device 1 installed in each home to the display information management server 5. The display information management server 5 may then perform appropriate processing as necessary and store the information in the display information database 52.

[0073] As an example, as shown in FIG. 3, the display information management server 5 may tally up information on which channel each content has been reproduced.

[0074] For example, as shown in Figure 3, the content being investigated is CM1, which has been played 100 times on broadcast channels, but has been played very few times on distribution services A to C. If this information is known, it will be possible to consider measures such as abandoning the placement of CM1 on distribution services A to C.

[0075] Furthermore, the content being investigated is CM2, which has been played over 100 times on broadcast channel, distribution service A, and distribution service C, but only 20 times on distribution service B. Knowing this makes it possible to consider measures such as increasing advertising of CM2 on distribution service B.

[0076] As described above, in the first embodiment, by installing the predetermined display information acquisition program 73 in the display device 1 having the OS 70, it becomes possible to know which content has been reproduced on which channel.

[0077] Fig. 1B is a block diagram showing a schematic configuration of a display information acquisition system that is a first modified example of Fig. 1A. As shown in the figure, a content specifying unit 31 may be provided in a display information management server 5'.

[0078] Fig. 1C is a block diagram showing a schematic configuration of a display information acquisition system that is a second modified example of Fig. 1A. The differences from Fig. 1A are that the contents stored in fingerprint database 41 are different from the structure shown in Fig. 2A, and that the display information acquisition system includes content management server 6.

[0079] 2B, fingerprint database 41 stores, for broadcast content, a correspondence relationship between a fingerprint, a broadcast station, and a broadcast date and time. Also, for communication content, a correspondence relationship between a fingerprint, communication content, and time (within the content) is stored. For example, the broadcast date and time and the time unit may be 6 seconds.

[0080] In Figure 2B, for example, if the generated fingerprint is F11, this means that the audio captured by microphone 2 is the audio of the broadcast content broadcast by broadcasting station A from 11:00:00 on April 1, 2023 to 11:00:06 on the same day.

[0081] Furthermore, if the generated fingerprint is F14, it means that the audio picked up by microphone 2 is the audio from 00 minutes 00 seconds to 00 minutes 06 seconds in communication content C10.

[0082] In this way, if the displayed content is communication content, the communication content can be identified simply by referring to fingerprint database 41. On the other hand, if the displayed content is broadcast content, the broadcast content cannot be identified simply by referring to fingerprint database 41; only the broadcast date and time and the broadcast station can be identified.

[0083] As shown in Fig. 1C, the content management server 6 has a content database 60. As shown in Fig. 2C, the content database 60 stores correspondence between broadcast stations, broadcast dates and times, and broadcast content. For example, content C11 is content broadcast by broadcast station A from 11:00:00 on April 1, 2023 to 11:30:00 on the same day. The broadcast dates and times in the content database 60 do not need to be in constant units and may be separated by the time of each content.

[0084] The display information acquisition system in Figure 1C acquires content as follows: Content identification unit 31 in content identification device 3 processes the audio from microphone 2 and generates a fingerprint. This fingerprint corresponds to at least a portion of the content being played when microphone 2 acquired the audio. However, it is not known at this point whether the displayed content is broadcast content or communication content.

[0085] Then, content specifying unit 31 transmits the fingerprint to fingerprint management server 4 having fingerprint database 41 .

[0086] The fingerprint management server 4 refers to the fingerprint database 41 to identify the broadcasting station and broadcast date and time (if the displayed content is broadcast content) corresponding to the received fingerprint, or the communication content (if the displayed content is communication content distributed at a specific date and time).

[0087] First, an example will be given in which the display content is broadcast content. According to fingerprint database 41 in FIG. 2B , for example, when the fingerprint is "F13," the corresponding broadcast station is broadcast station B, and the corresponding broadcast date and time is from 11:00:00 to 11:00:06 on April 2, 2023. Fingerprint management server 4 then transmits information indicating the identified broadcast station and broadcast date and time to content identification unit 31.

[0088] Next, content specifying unit 31 transmits the broadcast station and broadcast date and time from fingerprint management server 4 to content management server 6 .

[0089] The content management server 6 refers to the content database 60 to identify broadcast content corresponding to the received broadcast station and broadcast date and time. For example, according to the content database 60 of FIG. 2C , if the broadcast station is broadcast station B and the broadcast date and time is from 11:00:00 to 12:00:00 on April 2, 2023, the corresponding broadcast content is C13. The content management server 6 then transmits information indicating the identified content to the content identification unit 31.

[0090] Next, an example will be given in which the displayed content is communication content. According to fingerprint database 41 in FIG. 2B , for example, if the fingerprint is “F14,” the corresponding content is “C10.” Fingerprint management server 4 then transmits information indicating the identified content to content identification unit 31.

[0091] In this way, the content identification unit 31 can identify the display content that was being played back when the microphone 2 acquired the sound. The rest is the same as the display information acquisition system shown in FIG.

[0092] Second Embodiment In the first embodiment described above, the display channel is identified by using the functions of the OS 70. In the second embodiment described below, the display channel can be identified without using the functions of the OS 70, even in a display device 1 that does not have the OS 70, and even in a display device 1 that cannot install the display information acquisition program 73 described in the first embodiment. Hereinafter, explanations of points common to the first embodiment may be omitted or simplified.

[0093] FIG. 4 is a block diagram showing a schematic configuration of a display information acquisition system according to the second embodiment, and functional units common to the first embodiment are assigned the same reference numerals as in FIG. 1A.

[0094] The display device 1 in this embodiment may not have the OS 70 in the first embodiment, or even if it does have the OS 70, it may not have the functions mentioned in the first embodiment. Furthermore, it may not store the display information acquisition program 73 in the first embodiment. In other words, the display information acquisition program 73 may not / may not be installed on the display device 1. The rest is the same as in the first embodiment, and distribution services A to C are built in.

[0095] In this embodiment, the display information acquisition system includes a communication device 8 that is connected to the display device 1 via a network (e.g., Wi-Fi). The communication device 8 includes a communication processing means 81 and a display information acquisition unit 63. The communication device 8 may be configured as a single device or as a plurality of devices. At least some of the functions of each means and each unit of the communication device 8 may be located, for example, in the display information management server 5 or in the display device 1. At least some of the functions of each means and each unit of the content identification device 3 may be located in the communication device 8 or in the display information management server 5.

[0096] The communication processing means 81 provides a router function and relays data between the display device 1 and the distribution servers 91A to 91C. For example, a content data acquisition request is sent from the communication processing means 14 in the display device 1 to the distribution servers 91A to 91C via the communication device 8. In addition, content data from the distribution servers 91A to 91C is sent to the communication processing means 81 in the display device 1 via the communication device 8.

[0097] The display information acquisition unit 63 includes a channel identification unit 64 and a transmission unit 65 .

[0098] The channel identification unit 64 identifies the display channel of the display content, but the identification method is different from that in the first embodiment, and the display channel is identified based on communication data (communication log) sent or received by the display device 1.

[0099] Specifically, the channel identification unit 64 acquires communication data relayed by the communication processing means 81. More specifically, communication data (e.g., a content data acquisition request) transmitted from the display device 1 via the communication device 8 may include an IP address identifying the destination device. Furthermore, communication data (e.g., content data) received by the display device 1 via the communication device 8 may include an IP address identifying the source device. For example, if the IP address included in communication data acquired at a certain point in time corresponds to distribution server 91A, the display channel for the display content at that point in time is identified as the communication channel for distribution service A.

[0100] Note that the display device 1 and distribution servers 91A-91C may also perform some type of short-term communication unrelated to content distribution. To avoid mistaking such communication for content distribution, the channel identification unit 64 may determine that content distribution is occurring from the corresponding distribution server when communication data containing the same IP address continues for a predetermined period of time or more. In other words, even if the communication data includes a certain IP address, the channel identification unit 64 may determine that the displayed channel is not a communication channel if communication data containing that IP address does not continue for a predetermined period of time or more.

[0101] When communication data including the same IP address continues for a predetermined period or longer, the channel identification unit 64 may identify the start of the continuous period as the start of content playback on the communication channel of the corresponding distribution service. Also, the channel identification unit 64 may identify the end of the continuous period as the end of content playback on the communication channel of the corresponding distribution service.

[0102] Furthermore, the relationship between IP addresses and distribution servers (or the relationship between IP addresses and distribution services, the same applies below) may be stored as a database within the communication device 8. In this case, the channel identification unit 64 can identify the display channel by referring to the database within the communication device 8.

[0103] The relationship between the IP address and the distribution server may be stored as a database in another device, such as the display information management server 5. In this case, the channel identification unit 64 transmits the acquired communication data (or the IP address contained therein) to the other device. The other device then refers to the database to receive information indicating the distribution server or distribution service identified by the channel identification unit 64, thereby enabling the channel identification unit 64 to identify the display channel.

[0104] The channel identification unit 64 may identify the display channel based on data other than the IP address in the communication data. For example, if the communication data includes data that can identify a distribution server or a distribution service, the display channel can be identified from that data.

[0105] Furthermore, content is not normally played simultaneously on two or more of one or more broadcast channels and one or more communication channels. Therefore, if the communication channel cannot be identified based on the communication data (for example, if the communication data does not include an IP address corresponding to distribution servers 91A-91C), channel identification unit 64 may identify the displayed channel as a broadcast channel.

[0106] Furthermore, the channel identification unit 64 may identify a distribution service from a communication pattern by machine learning, etc. To do this, for example, it is sufficient to learn in advance the relationship between communication patterns and distribution services and generate a classifier.

[0107] The channel identification unit 64 may also identify a distribution service based on the communication destination (such as a CDN (Content Delivery Network), a domain name of a distribution source, etc.) In addition, the identification may be performed by combining two or more of the above-mentioned IP address, communication pattern, and communication destination.

[0108] Content identification device 3 may be the same as in the first embodiment. However, the fingerprint database in fingerprint management server 4 referenced by content identification device 3 may associate fingerprints with broadcast stations and broadcast dates and times in addition to the correspondence between fingerprints and content (see FIG. 5 ).

[0109] For example, suppose that fingerprint F2 is generated based on the audio captured by microphone 2 at 8:30 on February 1. In this case, the displayed content is identified as C2 based on the fingerprint database in FIG.

[0110] 5, the broadcast date and time of content C2 was from 7:00 to 8:00 on February 3rd, which does not match the time at 8:30 on February 1st when the audio was picked up by microphone 2. Therefore, content identification unit 31 and channel identification unit 64 can determine that display content C2 at 8:30 on February 1st was not played on a broadcast channel but was played on a communication channel.

[0111] As another example, suppose that fingerprint F3 was generated based on the audio captured by microphone 2 at 8:30 on February 4. In this case, the displayed content is identified as C3 based on the fingerprint database in FIG.

[0112] 5, content C3 was broadcast on the broadcast channel of broadcast station C from 8:00 to 9:00 on February 4th. In other words, 8:30 on February 4th, when the audio was picked up by microphone 2, is included in the broadcast date and time of the identified content C3. In this case, it is highly likely that the displayed content C3 at 8:30 on February 4th was played on the broadcast channel of broadcast station C. Therefore, the channel identification unit 64 may not only identify that the displayed channel is a broadcast channel, but also identify that it is a broadcast channel by broadcast station C.

[0113] In this way, when the content identification unit 31 not only identifies the display content at a certain point in time but also identifies its broadcast date and time and broadcast station, the channel identification unit 64 can also identify which broadcast station is broadcasting the channel based on the relationship between the certain point in time and the broadcast date and time.

[0114] The method for identifying the display content is not limited to the above. For example, first, the channel identification unit 64 attempts to identify the display channel, and if the display channel is identified, it determines that the communication channel identified by the channel identification unit 64 (i.e., one of the distribution services A to C) is the display channel. Then, the content identification device 3 identifies the display content.

[0115] On the other hand, if the display channel cannot be identified by channel identification unit 64, the display channel is likely to be a broadcast channel. Therefore, content identification device 3 refers to fingerprint database 41 to identify the display content and the broadcast station.

[0116] In this way, when specifying a display channel, a communication channel may be specified with priority, and if a communication channel cannot be specified, a broadcast channel may be specified.

[0117] As described above, in the second embodiment, it is possible to determine which content was played on which channel by providing a communication device 8, without using the display information acquisition program 73 described in the first embodiment. Note that in the second embodiment, it is sufficient that the content can be displayed on at least two communication channels; it is not necessary that the content can be displayed on a broadcast channel. Furthermore, as described with reference to FIG. 1B, the content identification unit 31 may be provided within the display information management server 5. Alternatively, as described with reference to FIGS. 1C, 2B, and 2C, a fingerprint management server 4 and a content management server 6 may be provided.

[0118] The display information acquisition system may include at least the channel identification unit 64, the content identification unit 31, and the association unit 51, and these may be provided anywhere, or may be distributed across multiple devices that can communicate with each other. For example, the channel identification unit 64 may be provided within the display information management server 5.

[0119] 6 is a block diagram showing a schematic configuration of a display information acquisition system according to a modification of the second embodiment. While the second embodiment has built-in distribution services A to C, this modification provides external communication content control devices 92A to 92C that have the function of providing distribution services A to C, respectively, to play the content of distribution services A to C.

[0120] The communication content control devices 92A to 92C are recorders, game consoles, dongles, personal computers, etc. The communication content control devices 92A to 92C are connected to an external input terminal such as an HDMI (registered trademark) of the display device 1. The communication content control devices 92A to 92C are also network-connected (e.g., connected via Wi-Fi) to the communication device 8, receive content data from distribution servers 91A to 91C via the communication device 8, and display the content on the display device 1. It can also be said that each of the communication content control devices 92A to 92C corresponds to a communication channel.

[0121] In this case, the channel identification unit 64 may identify the display channel based on communication data transmitted or received by the communication content control devices 92A to 92C via the communication device 8. The rest is the same as in the second embodiment.

[0122] According to the configuration of FIG. 6, even if the display device 1 does not have a communication function or does not have a built-in distribution service, it is possible to know which content has been reproduced on which channel.

[0123] Any part or all of the functional units described in this specification may be realized by a program. The program mentioned in this specification may be distributed by being non-temporarily recorded on a computer-readable recording medium, or may be distributed via a communication line (including wireless communication) such as the Internet, or may be distributed in a state where it is installed on any terminal.

[0124] Based on the above description, a person skilled in the art may be able to conceive additional effects and various modifications of the present invention, but the aspects of the present invention are not limited to the individual embodiments described above. Various additions, modifications, and partial deletions are possible within the scope of the conceptual idea and spirit of the present invention, which is derived from the content defined in the claims and their equivalents.

[0125] For example, what is described herein as a single device (or component, the same applies hereinafter) (including what is depicted as a single device in the drawings) may be realized by multiple devices. Conversely, what is described herein as multiple devices (including what is depicted as multiple devices in the drawings) may be realized by a single device. Alternatively, some or all of the means and functions included in a certain device (e.g., a server) may be included in another device (e.g., a user terminal).

[0126] Furthermore, not all of the features described in this specification are essential requirements. In particular, features described in this specification but not included in the claims can be considered optional additional features.

[0127] It should be noted that the applicant is merely aware of the inventions disclosed in the documents listed in the "Prior Art Documents" section of this specification, and the present invention does not necessarily aim to solve the problems of the disclosed inventions. The problem that the present invention aims to solve should be determined by taking into consideration the entire specification. For example, if this specification states that a specific configuration achieves a certain effect, it can also be said that the present invention solves a problem that is the reverse of that effect. However, it is not necessarily intended that such a specific configuration be an essential requirement.

[0128] REFERENCE SIGNS LIST 1 Display device 2 Microphone 3 Content identification device 31 Content identification unit 32 Transmission unit 4 Fingerprint management server 41 Fingerprint database 5 Display information management server 51 Association unit 52 Display information database 6 Content management server 60 Content database 11 Display 12 Speaker 13 Broadcast wave processing means 14 Communication processing means 15 Processor 16 Memory 70 OS 71 Broadcast content control program 72A to 72C Communication content control program 73 Display information acquisition program 61 Broadcast content control unit 62A to 62C Communication content control unit 63 Display information acquisition unit 64 Channel identification unit 65 Transmission unit 8 Communication device 81 Communication processing means 91A to 91C Distribution server 92A to 92C Communication content control device

Claims

1. A display information acquisition system for identifying not only a display content but also a display channel in a display device having a communication function and capable of displaying content on multiple channels including one or more communication channels, the display information acquisition system comprising: a channel identification unit that identifies the display channel of the display content based on communication data transmitted or received by the display device; a content identification unit that identifies the display content based on audio from a speaker of the display device; and an association unit that associates the identified display channel with the identified display content.

2. The display information acquisition system of claim 1, wherein the display device is connected to a communication device having a router function via a network and communicates through the communication device, and the channel identification unit identifies the display channel of the display content based on communication data transmitted by the display device via the communication device or communication data received by the display device via the communication device.

3. A display information acquisition system for not only identifying display content but also identifying the display channel in a display device capable of displaying content on multiple channels including one or more communication channels, wherein the communication channel is provided by a distribution service provided by a communication content control device connected to the display device, the display information acquisition system comprising: a channel identification unit that identifies the display channel of the display content based on communication data transmitted or received by the communication content control device; a content identification unit that identifies the display content based on audio from a speaker of the display device; and an association unit that associates the identified display channel with the identified display content.

4. The display information acquisition system of claim 3, wherein the communication content control device is connected to a communication device having a router function via a network and communicates through the communication device, and the channel identification unit identifies the display channel of the display content based on communication data transmitted by the communication content control device via the communication device or communication data received by the communication content control device via the communication device.

5. A display information acquisition system according to any one of claims 1 to 4, wherein the associating unit associates the identified display content with on which of the plurality of channels the content was displayed.

6. A display information acquisition system according to any one of claims 1 to 4, wherein the channel identification unit identifies the display channel of the display content based on at least one of an IP address, a communication pattern, and a communication destination included in the communication data.

7. The display information acquisition system of claim 6, wherein the communication channel is provided by a distribution service that receives and plays content data from a distribution server, and when there is a distribution server corresponding to the IP address, the channel identification unit identifies the display channel as a communication channel provided by the distribution service corresponding to that distribution server.

8. The display information acquisition system according to claim 7, wherein the channel identification unit identifies the displayed channel as a broadcast channel if there is no distribution server corresponding to the IP address.

9. The display information acquisition system according to claim 6, wherein the channel identification unit identifies the display channel using a classifier that has previously learned the relationship between communication patterns and distribution services.

10. A display information acquisition method for identifying not only a display content but also a display channel in a display device having a communication function and capable of displaying content on multiple channels including one or more communication channels, the display information acquisition method including: a channel identification step for identifying the display channel of the display content based on communication data transmitted or received by the display device; a content identification step for identifying the display content based on audio from a speaker of the display device; and an association step for associating the identified display channel with the identified display content.

11. A display information acquisition method for identifying not only a display content but also a display channel in a display device capable of displaying content on multiple channels including one or more communication channels, wherein the communication channel is provided by a distribution service provided by a communication content control device connected to the display device, the display information acquisition method comprising: a channel identification step for identifying the display channel of the display content based on communication data transmitted or received by the communication content control device; a content identification step for identifying the display content based on audio from a speaker of the display device; and an association step for associating the identified display channel with the identified display content.

12. A communications device connected to a display device capable of displaying content on multiple channels including one or more communication channels, the communications device comprising a channel identification unit that identifies a display channel for the displayed content based on communication data transmitted to or received from the display device.

13. A communications device connected to a display device, one or more communications content control devices each corresponding to a communications channel, and one or more distribution servers each corresponding to said communications channels, the communications device having a channel identification unit that identifies a display channel for a display content based on communication data transmitted or received between said one or more communications content control devices and / or said one or more distribution servers.

14. A display information acquisition system capable of displaying content on multiple channels including one or more broadcast channels and one or more communication channels, for not only identifying a display content but also identifying its display channel in a display device having an OS and a processor, comprising: a channel identification unit provided in the display device that identifies which of the multiple channels the display channel of the display content is based on information grasped by a function of the OS of the display device; a content identification unit that identifies the display content based on audio from a speaker of the display device; and an association unit that associates the identified display channel with the identified display content.

15. The display information acquisition system according to claim 14, wherein the associating unit associates the identified display content with on which of the plurality of channels the content was displayed.

16. A display information acquisition system as described in claim 14 or 15, wherein the communication channel is provided by a distribution service that becomes available when a communication content control program is executed by a processor of the display device, and the information grasped by the OS function of the display device includes the operation status of the distribution service or the execution status of the communication content control program.

17. A display information acquisition system as described in claim 14 or 15, wherein the channel identification unit is realized by installing a program on the display device and executing it by a processor of the display device.

18. A display information acquisition system as described in claim 14 or 15, wherein the association unit is provided in a display information management server, and the display device includes a transmission unit that transmits the identified display channel to the display information management server in response to a user operation to turn the display device on or off.

19. A display information acquisition program installed on a display device capable of displaying content on multiple channels, including one or more broadcast channels and one or more communication channels, which causes the display device to function as a channel identification unit that identifies which of the multiple channels the display channel of the displayed content is, based on information grasped by the OS function of the display device.

20. A display information acquisition method for not only identifying a display content but also its display channel in a display device capable of displaying content on multiple channels including one or more broadcast channels and one or more communication channels, the display information acquisition method including a channel identification step in which a channel identification unit provided in the display device identifies which of the multiple channels the display channel of the display content is based on information grasped by a function of the OS of the display device; a content identification step in which the display content is identified based on audio from a speaker of the display device; and an association step in which the identified display channel is associated with the identified display content.

Images