Display information acquisition program, communication apparatus, display information acquisition method, and display information acquisition system

Abstract

To identify on which channel content is being played.SOLUTION: A display information acquisition system is for identifying not only display content but also a display channel in a display device that can display content on a plurality of channels including one or more broadcast channels and one or more communication channels and has an OS and a processor. The display information acquisition system includes a channel identification unit that is provided in the display device and identifies which of the plurality of channels the display channel of the display content is based on information grasped by a function of the OS of the display device, a content identification unit that identifies the display content based on audio from a speaker of the display device, and an association unit that associates the identified display channel with the identified display content.SELECTED DRAWING: Figure 1A

Description

[Technical field]

[0001] The present invention relates to a display information acquisition program, a communication device, a display information acquisition method, and a display information acquisition system. [Background technology]

[0002] A technology for identifying content based on the sound of the content is known (Patent Document 1). Incidentally, in recent years, the channels through which content is viewed have become more diverse. For example, when viewing a certain content on a television, it is possible to view the content not only through terrestrial broadcasting but also through a distribution service. There are also many distribution services (YouTube, Netflix, Hulu (all registered trademarks)). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2019-507533 Summary of the Invention [Problem to be solved by the invention]

[0004] The problem with the present invention is to identify on which channel the content is being played. [Means for solving the problem]

[0005] According to one aspect of the present invention, [1] A display information acquisition system for identifying not only a display content but also a display channel in a display device capable of displaying content on a plurality of channels including one or more broadcast channels and one or more communication channels, the display information acquisition system including an OS and a processor, the display information acquisition system comprising: a channel identification unit provided in the display device, which identifies which of the plurality of channels the display channel of the display content is, based on information grasped by a function of an OS of the display device; a content identification unit that identifies the display content based on a sound from a speaker of the display device; There is provided a display information acquisition system including an association unit that associates the identified display channel with the identified display content.

[0006] [2] In the display information acquisition system according to [1], The associating unit may associate on which of the plurality of channels the specified display content was displayed.

[0007] [3] In the display information acquisition system according to [1] or [2], the communication channel is provided by a distribution service that is made available by a processor of the display device executing a communication content control program; The information grasped by the function of the OS of the display device may include the operation status of the distribution service or the execution status of the communication content control program.

[0008] [4] [1] to [3], the display information acquisition system according to any one of the above, The channel identification unit may be realized by installing a program on the display device and executing it by a processor of the display device.

[0009] [5] [1] to [4], the display information acquisition system according to any one of the above, The association unit is provided in a display information management server, The display device may further include a transmission section provided in the display device, which transmits the identified display channel to the display information management server in response to a user operation for turning the display device on or off.

[0010] According to one aspect of the present invention, [6] A display information acquisition program installed on a display device capable of displaying content on a plurality of channels including one or more broadcast channels and one or more communication channels, comprising: There is provided a display information acquisition program that causes the display device to function as a channel identification unit that identifies which of the multiple channels the display channel of the display content is based on information grasped by a function of the OS of the display device.

[0011] According to one aspect of the present invention, [7] A display information acquisition method for identifying not only a display content but also a display channel in a display device capable of displaying content on a plurality of channels including one or more broadcast channels and one or more communication channels and having an OS and a processor, comprising: a channel identification step of identifying which of the plurality of channels the display channel of the display content is based on information grasped by a function of an OS of the display device by a channel identification unit provided in the display device; a content specifying step of specifying the display content based on a sound from a speaker of the display device; There is provided a display information obtaining method including an associating step of associating the identified display channel with the identified display content.

[0012] According to one aspect of the present invention, [8] A display information acquisition system for identifying not only a display content but also a display channel in a display device having a communication function, the display information acquisition system being capable of displaying content on a plurality of channels including one or more communication channels, the display information acquisition system comprising: a channel identification unit that identifies the display channel of the display content based on communication data transmitted or received by the display device; a content identification unit that identifies the display content based on a sound from a speaker of the display device; There is provided a display information acquisition system including an association unit that associates the specified display channel with the specified display content.

[0013] [9] In the display information acquisition system according to [8], The display device is connected to a network via a communication device having a router function, and the display device communicates with the communication device; The channel identification unit may identify the display channel of the display content based on communication data transmitted by the display device via the communication device or communication data received by the display device via the communication device.

[0014] According to one aspect of the present invention,

[10] A display information acquisition system for identifying not only a display content but also a display channel in a display device capable of displaying content on a plurality of channels including one or more communication channels, comprising: the communication channel is provided by a distribution service provided by a communication content control device connected to the display device; a channel identification unit that identifies the display channel of the display content based on communication data transmitted or received by the communication content control device; a content identification unit that identifies the display content based on a sound from a speaker of the display device; There is provided a display information acquisition system including an association unit that associates the specified display channel with the specified display content.

[0015]

[11]

[10] The display information acquisition system according to the present invention, The communication content control device is connected to a network with a communication device having a router function, and performs communication via the communication device, The channel identification unit may identify the display channel of the display content based on communication data transmitted by the communication content control device via the communication device or communication data received by the communication content control device via the communication device.

[0016]

[12] [8] to

[11] , wherein the display information acquisition system comprises: The associating unit may associate the identified display content with on which of the plurality of channels the display content was displayed.

[0017]

[13] [8] to

[12] , wherein the display information acquisition system comprises: The channel identification unit may identify the display channel of the display content based on at least one of an IP address, a communication pattern, and a communication destination included in the communication data.

[0018]

[14]

[13] The display information acquisition system according to the present invention, the communication channel is provided by a distribution service that receives content data from a distribution server and plays the content data; When there is a distribution server corresponding to the IP address, the channel identification unit may identify the displayed channel as a communication channel provided by a distribution service corresponding to the distribution server.

[0019]

[15]

[14] The display information acquisition system according to the present invention, When there is no distribution server corresponding to the IP address, the channel identification unit The display information acquisition system according to

[14] , wherein the displayed channel is identified as a broadcast channel.

[0020]

[16]

[13] The display information acquisition system according to the present invention, The channel identification unit may identify the display channel using a classifier that has previously learned a relationship between a communication pattern and a distribution service.

[0021] According to one aspect of the present invention,

[17] A display information acquisition method for identifying not only a display content but also a display channel in a display device having a communication function and capable of displaying content on a plurality of channels including one or more communication channels, comprising: a channel identification step of identifying the display channel of the display content based on communication data transmitted or received by the display device; a content specifying step of specifying the display content based on a sound from a speaker of the display device; There is provided a display information obtaining method including an associating step of associating the identified display channel with the identified display content.

[0022] According to one aspect of the present invention,

[18] A display information acquisition method for identifying not only a display content but also a display channel in a display device capable of displaying content on a plurality of channels including one or more communication channels, comprising: the communication channel is provided by a distribution service provided by a communication content control device connected to the display device; a channel specifying step of specifying the display channel of the display content based on communication data transmitted or received by the communication content control device; a content specifying step of specifying the display content based on a sound from a speaker of the display device; There is provided a display information obtaining method including an associating step of associating the identified display channel with the identified display content.

[0023] According to one aspect of the present invention,

[19] A communication device connected to a display device capable of displaying content on a plurality of channels including one or more communication channels, There is provided a communication device including a channel identification unit that identifies a display channel of a display content based on communication data transmitted to or received from the display device.

[0024] According to one aspect of the present invention,

[20] A communication device connected to a display device, the communication device being connected to one or more communication content control devices each corresponding to a communication channel, and one or more distribution servers each corresponding to the communication channels, the communication device comprising: There is provided a communication device including a channel specifying unit that specifies a display channel of a display content based on communication data transmitted to or received from the one or more communication content control devices and / or the one or more distribution servers. Effect of the Invention

[0025] You can identify which channel the content is playing on. [Brief description of the drawings]

[0026] [Figure 1A] 1 is a block diagram showing a schematic configuration of a display information acquisition system according to a first embodiment. [Figure 1B]FIG. 1B is a block diagram showing a schematic configuration of a display information acquisition system which is a first modified example of FIG. 1A. [Figure 1C] FIG. 1B is a block diagram showing a schematic configuration of a display information acquisition system which is a second modified example of FIG. 1A. [Figure 2A] FIG. 2 is a diagram illustrating an example of the structure of a fingerprint database 41. [Figure 2B] FIG. 13 is a diagram showing a schematic diagram of another example of the structure of the fingerprint database 41. [Figure 2C] FIG. 2 is a diagram showing an example of the structure of a content database 60. [Diagram 3] FIG. 4 is a diagram showing a schematic diagram of information collected by a display information management server 5. [Figure 4] FIG. 11 is a block diagram showing a schematic configuration of a display information acquisition system according to a second embodiment. [Diagram 5] FIG. 2 is a diagram illustrating an example of the structure of a fingerprint database 41. [Figure 6] FIG. 13 is a block diagram showing a schematic configuration of a display information acquisition system according to a modified example of the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] Hereinafter, an embodiment of the present invention will be specifically described with reference to the drawings.

[0028] (First embodiment) The first embodiment is directed to a display device capable of displaying content on a plurality of channels including one or more broadcast channels and one or more communication channels, and not only specifies the display content but also specifies the display channel.

[0029] Here, "displaying content on a broadcast channel" means receiving content data from a broadcast station or the like via broadcast waves and displaying the content. Also, "displaying content on a communication channel" means receiving content data from a distribution server or the like via communication and displaying the content.

[0030] Moreover, the "display content" may be content that is being displayed on the display device in real time, or may be content that was displayed at some point in the past.

[0031] "Specifying a display channel" may mean specifying whether the display content is displayed on a broadcast channel or a communication channel. More specifically, it may be specified which broadcasting station (e.g., NHK (registered trademark), Fuji Television (registered trademark), etc.) among the broadcast channels on which the display content is displayed, or which distribution service (e.g., YouTube, Netflix, Hulu, etc.) among the communication channels on which the display content is displayed.

[0032] The specific details will be explained below. 1A is a block diagram showing a schematic configuration of a display information acquisition system according to a first embodiment. The display information acquisition system includes a display device 1, a microphone 2 as a voice acquisition unit, a content identification device 3, a fingerprint management server 4, and a display information management server 5.

[0033] The display device 1 is, for example, a television set installed in each home, and includes a display 11, a speaker 12, a broadcast wave processing means 13, a communication processing means 14, a processor 15, a memory 16, and the like.

[0034] The broadcast wave processing means 13 is composed of an antenna, a tuner, an encoder, etc. The broadcast wave processing means 13 receives broadcast waves on which content data from one or more broadcast stations is superimposed, and performs appropriate processing such as channel selection and decoding to play back the content. Playing back the broadcast content includes displaying images (moving or still images) constituting the content on the display 11 and outputting sounds constituting the content from the speaker 12.

[0035] The communication processing means 14 transmits and receives various data and information to and from external devices such as the display information management server 5, the distribution servers 91A to 91C, etc. There are no particular limitations on the communication means, and it may be, for example, Internet communication (including WiFi (registered trademark)).

[0036] The display device 1 of this embodiment is premised on having an OS (Operating System) 70 stored in the memory 16. The OS 70 is, for example, Android (registered trademark) or iOS (registered trademark), or may be an OS unique to the display device 1.

[0037] The memory 16 also stores a broadcast content control program 71. The processor 15 executes the broadcast content control program 71 to implement a broadcast content control unit 61. It can be said that the display device 1 has the broadcast content control unit 61, or that the processor 15 functions as the broadcast content control unit 61.

[0038] The broadcast content control unit 61 controls the broadcast wave processing means 13 to display the broadcast content on the display 11. As a specific example, the broadcast content control unit 61 accepts a broadcast station selection instruction from a user (for example, pressing a specific station selection button on a remote control), selects content data from a broadcast station corresponding to the instruction, and displays the broadcast content on the display 11.

[0039] The memory 16 also stores a communication content control program 72A. The processor 15 executes the communication content control program 72A to realize a communication content control unit 62A that uses the distribution service A. It can be said that the display device 1 has the communication content control unit 62A, or that the processor 15 functions as the communication content control unit 62A. It can also be said that the display device 1 has the distribution service A built-in.

[0040] The communication content control unit 62A receives content data distributed (e.g., streaming) from the distribution server 91A via the communication processing means 14, and plays the communication content by the distribution service A. The communication content playback also includes displaying images (moving or still images) constituting the content on the display 11, and outputting sounds constituting the content from the speaker 12.

[0041] As a specific example, the communication content control unit 62A receives an instruction to start distribution service A from the user (for example, pressing a button for starting distribution service A provided on a remote control) and starts distribution service A. Furthermore, the communication content control unit 62A transmits a content data acquisition request to the distribution server 91A to acquire content selected by the user from the contents distributed from the distribution server 91A. In response to this request, the communication content control unit 62A receives the content data distributed from the distribution server 91A and plays the communication content.

[0042] The same applies to the communication content control program 72B and the communication content control program 72C. The distribution services A to C are, for example, YouTube, NetFlix, Hulu, etc., but may be any other service. It can also be said that each of the distribution servers 91A to 91C corresponds to one communication channel.

[0043] The communication content control programs 72A to 72C may be installed in the display device 1 at the time of shipment of the display device 1, or may be installed by the user as desired. In this embodiment, three distribution services A to C are illustrated, but the number is not limited as long as it is one or more.

[0044] One of the functions of the OS 70 is to grasp the operation status (log) of the broadcast content control unit 61 and the communication content control units 62A to 62C (distribution services A to C). It can also be said that the OS 70 grasps the execution status (log) of the broadcast content control program 71 and the communication content control programs 72A to 72C.

[0045] More specifically, the functions of the OS 70 include grasping whether the broadcast content control unit 61 is (had been) displaying broadcast content (currently or at a predetermined time in the past) on the display 11. In addition, the functions may include grasping from which broadcast station the broadcast content control unit 61 is (had been) displaying broadcast content on the display 11.

[0046] Another function of the OS 70 includes grasping the start / end times of the distribution services A to C. Also includes grasping whether each of the communication content control units 62A to 62C is (was) displaying communication content on the display 11 (currently or at a predetermined time in the past).

[0047] The memory 16 also stores a display information acquisition program 73, which is one of the features of this embodiment. The processor 15 executes the display information acquisition program 73 to realize a display information acquisition unit 63. It can be said that the display device 1 has the display information acquisition unit 63, or that the processor 15 functions as the display information acquisition unit 63. The display information acquisition program 73 may be installed in the display device 1 at the time of shipment of the display device 1, or may be installed after shipment.

[0048] The display information acquisition unit 63 may be composed of a channel identification unit 64 and a transmission unit 65 .

[0049] The channel identification unit 64 identifies the display channel of the display content based on information grasped by the functions of the OS 70. Normally, content is not simultaneously played back on two or more channels among one or more broadcast channels and one or more communication channels. Therefore, the channel identification unit 64 can identify the display channel as follows.

[0050] When identifying the display channel of the currently displayed content, the channel identification unit 64 acquires the current operation status of the broadcast content control unit 61 and the communication content control units 62A to 62C from the functions of the OS 70. Then, based on the operation status, the channel identification unit 64 identifies the display channel.

[0051] For example, when information obtained by a function of the OS70 indicates that the broadcast content control unit 61 is receiving broadcast waves and playing broadcast content, the display channel is identified as a broadcast channel. When the OS70 can determine which broadcast station the broadcast content control unit 61 is playing back, the channel identification unit 64 may identify which broadcast station the broadcast channel is from. As an example, the OS70 may obtain which channel selection button on a remote control has been pressed.

[0052] In addition, when the information grasped by the function of the OS 70 indicates that the distribution service A is running, or when the content data is received from the distribution server 91A and the communication content When the display channel indicates that a broadcast is being played back, the display channel is specified as a communication channel for distribution service A. As an example, the OS 70 may obtain information on which button on the remote control has been pressed to start up a distribution service.

[0053] When identifying the display channel of the content displayed at a specific time point in the past, the channel identification unit 64 acquires the operation status of the broadcast content control unit 61 and the communication content control units 62A to 62C at the specific time point in the past from the functions of the OS 70. Then, based on the operation status, the channel identification unit 64 identifies the display channel. An example of a specific identification method is the same as above. Note that, even when one screen is divided and multiple contents are displayed on one screen, the display channel can be identified in a similar manner.

[0054] The transmitting unit 65 transmits information indicating the display channel identified by the channel identifying unit 64 to the display information management server 5. This information indicates, for example, which is the display channel at a certain time or hour.

[0055] The timing of the transmission is arbitrary. For example, the transmission may be performed periodically at a predetermined time (for example, 10:00 a.m. every day). However, the display device 1 frequently goes into a sleep state (for example, a home television is often turned off when all the family members go out). Therefore, if the display device 1 is in a sleep state at the predetermined time, the transmission may not be possible. Therefore, for example, the transmitting unit 65 may know that the display device 1 is going to be turned off based on the function of the OS 70, and may perform the transmission before the display device 1 is turned off. That is, the transmission may be performed in response to a user operation for turning off the display device 1, such as pressing a power button on a remote control. Alternatively, the transmission may be performed in response to a user operation for turning on the display device 1.

[0056] Next, there will be described how content is identified by the content identification device 3. The content identification device 3 has a content identification unit 31 and a transmission unit 32, and can also be called a survey device.

[0057] The content identification unit 31 identifies the display content based on the sound from the speaker 12. More specifically, the microphone 2 is disposed at a position where it can acquire sound from the speaker 12 in the display device 1 (i.e., the sound of the display content), and the content identification unit 31 identifies the content based on the sound acquired by the microphone 2. Note that data communication between the microphone 2 and the display device 1 may be by a wired connection such as a USB cable, or may be by a wireless connection such as Bluetooth (registered trademark).

[0058] An example of processing by content identification unit 31 is as follows. Content identification unit 31 processes the audio from microphone 2 to generate an audio fingerprint (hereinafter simply referred to as a "fingerprint"). This fingerprint corresponds to at least a part of the content being played when microphone 2 picked up the audio. Content identification unit 31 then transmits the fingerprint to fingerprint management server 4 which has fingerprint database 41.

[0059] 2A, the correspondence between fingerprints and contents is stored in fingerprint database 41. For example, if the generated fingerprint is F2, it means that the sound captured by microphone 2 belongs to content C2.

[0060] Here, it is desirable that the fingerprints corresponding to all kinds of contents are stored in fingerprint database 41. In particular, since the broadcast contents displayed on a broadcast channel are limited, it is possible to store the fingerprints corresponding to all kinds of contents in a predetermined period (for example, from the present to one week before). Preferably, for every piece of content that is broadcast, a corresponding fingerprint is stored, and the content may further be associated with the broadcast station and broadcast date and time.

[0061] On the other hand, the amount of content displayed on a communication channel is enormous, and it is difficult to store fingerprints corresponding to all of the content in fingerprint database 41. Therefore, at least fingerprints corresponding to target content (e.g., content that is the subject of an investigation into how much it has been displayed) are stored.

[0062] Fingerprint management server 4 refers to fingerprint database 41 and identifies the content corresponding to the received fingerprint. For example, according to fingerprint database 41 in Fig. 2A, when the fingerprint is "F2", the corresponding content is "C2". Then, fingerprint management server 4 transmits information indicating the identified content to content identification unit 31.

[0063] In this manner, the content identification unit 31 can identify the display content that was being reproduced when the microphone 2 picked up the sound.

[0064] The transmission unit 32 transmits information indicating the content identified by the content identification unit 31 to the display information management server 5.

[0065] Next, a description will be given of the display information management server 5. The display information management server 5 includes an association unit 51 and a display information database 52.

[0066] The associating unit 51 associates the display channel identified by the channel identifying unit 64 with the display content identified by the content identifying unit 31. For example, when it is identified that the display channel at a certain point in time was channel X and the display content at the same time was content Y, the associating unit 51 associates that content Y was displayed on channel Y.

[0067] In this manner, it is possible to associate on which of a plurality of channels the identified display content was displayed.

[0068] For example, assume that the content to be investigated is a specific commercial message (CM), and that this CM may be played back as broadcast content, or as communication content of distribution service A, or as communication content of distribution service B, or as communication content of distribution service C.

[0069] If the survey only identified the content, it would be possible to determine the number of times the commercial was played (the total number of times it was played on broadcast content and on each of distribution services A to C), but it would not be possible to determine on which channel it was played.

[0070] In contrast, in the present embodiment, not only is the content identified, but also the channel on which the content was played is identified, so that it is possible to know on which channel and how many times the surveyed CM was played.

[0071] The display information database 52 stores information on which content was displayed on which channel based on the association process performed by the association unit 51. The display information management server 5 It can also be said that the display channel specified by the channel specifying unit 64 and the display content specified by the content specifying unit 31 are stored in the display information database 52 in association with each other.

[0072] The display device 1 is, for example, a television installed in each home. In this case, information indicating which content was displayed on which channel is transmitted from the display device 1 installed in each home to the display information management server 5. Then, the display information management server 5 may perform appropriate processing as necessary and store the information in the display information database 52.

[0073] As an example, as shown in FIG. 3, the display information management server 5 may collect information on which channel each piece of content has been reproduced.

[0074] For example, according to Figure 3, the content under investigation is CM1, which has been played 100 times on broadcast channels, but has only a very small number of plays on distribution services A to C. Knowing this makes it possible to consider measures such as abandoning the placement of CM1 on distribution services A to C.

[0075] Furthermore, the content under investigation is CM2, which has been played over 100 times on broadcast channels, distribution service A, and distribution service C, but only 20 times on distribution service B. Knowing this makes it possible to consider measures such as increasing advertising of CM2 on distribution service B.

[0076] As described above, in the first embodiment, by installing the predetermined display information acquisition program 73 in the display device 1 having the OS 70, it becomes possible to know which content has been reproduced on which channel.

[0077] Fig. 1B is a block diagram showing a schematic configuration of a display information acquisition system which is a first modified example of Fig. 1A. As shown in the figure, a content specifying unit 31 may be provided in a display information management server 5'.

[0078] Fig. 1C is a block diagram showing a schematic configuration of a display information acquisition system which is a second modified example of Fig. 1A. The difference from Fig. 1A is that the contents stored in fingerprint database 41 are different from the structure shown in Fig. 2A, and the display information acquisition system includes content management server 6.

[0079] As shown in Fig. 2B, fingerprint database 41 stores, for broadcast content, a correspondence relationship between a fingerprint, a broadcast station, and a broadcast date and time. Also, for communication content, a correspondence relationship between a fingerprint, communication content, and time (within the content) is stored. As an example, the broadcast date and time and the unit of time can be 6 seconds.

[0080] In Figure 2B, for example, if the generated fingerprint is F11, it means that the audio captured by microphone 2 is the audio of the broadcast content broadcast by broadcasting station A from 11:00:00 to 11:00:06 on April 1, 2023.

[0081] Moreover, if the generated fingerprint is F14, it means that the audio picked up by microphone 2 is the audio from 00 minutes 00 seconds to 00 minutes 06 seconds in communication content C10.

[0082] In this way, when the display content is communication content, the fingerprint data The communication content can be identified simply by referring to base 41. On the other hand, if the display content is broadcast content, the broadcast content cannot be identified simply by referring to fingerprint database 41, and only the broadcast date and time and the broadcast station can be identified.

[0083] As shown in Fig. 1C, the content management server 6 has a content database 60. As shown in Fig. 2C, the content database 60 stores correspondence between broadcast stations, broadcast dates and times, and broadcast content. For example, content broadcast by broadcast station A from 11:00:00 to 11:30:00 on April 1, 2023 is content C11. The unit of broadcast dates and times in the content database 60 does not need to be constant, and may be divided by the time of each content.

[0084] The display information acquisition system in Fig. 1C acquires content as follows. Content identification unit 31 in content identification device 3 processes the audio from microphone 2 and generates a fingerprint. This fingerprint corresponds to at least a part of the content being played when microphone 2 acquired the audio. However, it is not known at this point whether the displayed content is broadcast content or communication content.

[0085] Then, content identification unit 31 transmits the fingerprint to fingerprint management server 4 which has fingerprint database 41 .

[0086] The fingerprint management server 4 refers to the fingerprint database 41 to identify the broadcasting station and broadcast date and time (if the display content is broadcast content), or the communication content (if the display content is communication content delivered at a specific date and time) corresponding to the received fingerprint.

[0087] First, a case where the display content is a broadcast content will be illustrated. According to fingerprint database 41 in Fig. 2B, for example, when the fingerprint is "F13", the corresponding broadcast station is broadcast station B, and the corresponding broadcast date and time is from 11:00:00 to 11:00:06 on April 2, 2023. Then, fingerprint management server 4 transmits information indicating the identified broadcast station and broadcast date and time to content identification unit 31.

[0088] Next, content identification unit 31 transmits the broadcast station and broadcast date and time from fingerprint management server 4 to content management server 6.

[0089] The content management server 6 refers to the content database 60 to identify broadcast content corresponding to the received broadcast station and broadcast date and time. For example, according to the content database 60 of FIG. 2C, if the broadcast station is broadcast station B and the broadcast date and time is from 11:00:00 to 12:00 on April 2, 2023, the corresponding broadcast content is C13. Then, the content management server 6 transmits information indicating the identified content to the content identification unit 31.

[0090] Next, a case where the display content is a communication content will be illustrated. According to fingerprint database 41 in Fig. 2B, for example, when the fingerprint is "F14", the corresponding content is "C10". Then, fingerprint management server 4 transmits information indicating the identified content to content identification unit 31.

[0091] In this manner, the content identification unit 31 can identify the display content that was being reproduced when the microphone 2 acquired the sound. The rest is the same as the display information acquisition system shown in FIG.

[0092] Second embodiment The first embodiment described above identifies the display channel by utilizing the functions of the OS 70. The second embodiment described below is intended to identify the display channel without utilizing the functions of the OS 70, even in a display device 1 that does not have the OS 70, and even in a display device 1 in which the display information acquisition program 73 described in the first embodiment cannot be installed. Hereinafter, explanations of points common to the first embodiment may be omitted or simplified.

[0093] FIG. 4 is a block diagram showing a schematic configuration of a display information acquisition system according to the second embodiment, and functional units common to the first embodiment are denoted by the same reference numerals as in FIG. 1A.

[0094] The display device 1 in this embodiment may not have the OS 70 in the first embodiment, and even if it has the OS 70, it may not have the functions mentioned in the first embodiment. In addition, it may not store the display information acquisition program 73 in the first embodiment. In other words, the display information acquisition program 73 does not have to be / cannot be installed in the display device 1. The rest is the same as the first embodiment, and the delivery services A to C are built in.

[0095] In this embodiment, the display information acquisition system includes a communication device 8 that is network-connected (e.g., connected via WiFi) to the display device 1. The communication device 8 includes a communication processing means 81 and a display information acquisition unit 63. The communication device 8 may be configured as a single device or as a plurality of devices. At least some of the functions of each means and each unit of the communication device 8 may be located, for example, in the display information management server 5 or in the display device 1. At least some of the functions of each means and each unit of the content identification device 3 may be located in the communication device 8 or in the display information management server 5.

[0096] The communication processing means 81 provides a router function and relays data between the display device 1 and the distribution servers 91A-91C. For example, a content data acquisition request is transmitted from the communication processing means 14 in the display device 1 to the distribution servers 91A-91C via the communication device 8. In addition, content data is transmitted from the distribution servers 91A-91C to the communication processing means 81 in the display device 1 via the communication device 8.

[0097] The display information acquisition unit 63 includes a channel identification unit 64 and a transmission unit 65 .

[0098] The channel identification unit 64 identifies the display channel of the display content, but the identification method differs from that in the first embodiment, and identifies the display channel based on communication data (communication log) transmitted or received by the display device 1.

[0099] Specifically, the channel identification unit 64 acquires communication data relayed by the communication processing means 81. More specifically, the communication data (e.g., a content data acquisition request) transmitted from the display device 1 via the communication device 8 may include an IP address identifying a destination device. Furthermore, the communication data (e.g., content data) received by the display device 1 via the communication device 8 may include an IP address identifying a source device. For example, if the IP address included in the communication data acquired at a certain point in time corresponds to the distribution server 91A, the display channel of the display content at that point in time is identified as the communication channel by the distribution service A.

[0100] Note that the display device 1 and the distribution servers 91A to 91C may perform some kind of short-term communication unrelated to content distribution. In order to avoid mistaking such communication for content distribution, the channel identification unit 64 may determine that content distribution is being performed from the corresponding distribution server when communication data including the same IP address continues for a predetermined period of time or more. In other words, even if the communication data includes a certain IP address, if the communication data including that IP address does not continue for a predetermined period of time or more, the channel identification unit 64 may determine that the displayed channel is not a communication channel.

[0101] When communication data including the same IP address continues for a predetermined period or more, the channel identification unit 64 may identify the time point corresponding to the start of the continuous period as the start of content playback on the communication channel of the corresponding distribution service. Also, the channel identification unit 64 may identify the time point corresponding to the end of the continuous period as the end of content playback on the communication channel of the corresponding distribution service.

[0102] Furthermore, the relationship between the IP address and the distribution server (or the relationship between the IP address and the distribution service, the same applies below) may be stored as a database in the communication device 8. In this case, the channel identification unit 64 can identify the display channel by referring to the database in the communication device 8.

[0103] The relationship between the IP address and the distribution server may be stored as a database in another device, such as the display information management server 5. In this case, the channel identification unit 64 transmits the acquired communication data (or the IP address contained therein) to the other device. Then, the channel identification unit 64 receives information indicating the distribution server or distribution service identified by the other device by referring to the database, and thereby the channel identification unit 64 can identify the display channel.

[0104] The channel identification unit 64 may identify the display channel based on data other than the IP address in the communication data. For example, if data that can identify a distribution server or a distribution service is included in the communication data, the display channel can be identified from that data.

[0105] Furthermore, content is not normally played simultaneously on two or more of one or more broadcast channels and one or more communication channels. Therefore, when a communication channel cannot be identified based on communication data (for example, when the communication data does not include an IP address corresponding to distribution servers 91A-91C), channel identification unit 64 may identify the displayed channel as a broadcast channel.

[0106] Furthermore, the channel identification unit 64 may identify a distribution service from a communication pattern by machine learning, etc. To do so, for example, a relationship between a communication pattern and a distribution service may be learned in advance to generate a classifier.

[0107] In addition, the channel identification unit 64 is a communication destination (CDN (Content Delivery Network), The delivery service may be identified based on the original domain name, etc. In addition, the identification may be performed by combining two or more of the above-mentioned IP address, communication pattern, and communication destination.

[0108] Content identification device 3 may be the same as in the first embodiment. However, the fingerprint database in fingerprint management server 4 referred to by content identification device 3 may associate a fingerprint with a broadcast station and a broadcast date and time in addition to the correspondence between the fingerprint and the content (see FIG. 5).

[0109] For example, suppose that fingerprint F2 was generated based on the voice captured by microphone 2 at 8:30 on February 1. In this case, the displayed content is identified as C2 based on the fingerprint database in FIG.

[0110] 5, the broadcast date and time of content C2 was from 7:00 to 8:00 on February 3, which does not match 8:30 on February 1 when the audio was picked up by microphone 2. Therefore, content identification unit 31 and channel identification unit 64 can determine that display content C2 at 8:30 on February 1 was not played on a broadcast channel, but was played on a communication channel.

[0111] As another example, suppose that fingerprint F3 was generated based on the audio captured by microphone 2 at 8:30 on February 4. In this case, the displayed content is identified as C3 based on the fingerprint database in FIG.

[0112] 5, content C3 was broadcast on the broadcast channel of broadcast station C from 8:00 to 9:00 on February 4th. That is, 8:30 on February 4th, when the microphone 2 picked up the audio, is included in the broadcast date and time of the identified content C3. In this case, it is highly likely that the display content C3 at 8:30 on February 4th was played on the broadcast channel of broadcast station C. Therefore, the channel identification unit 64 may not only identify that the display channel is a broadcast channel, but also identify that it is a broadcast channel by broadcast station C.

[0113] In this way, when the content identification unit 31 not only identifies the display content at a certain point in time but also identifies its broadcast date and time and broadcast station, the channel identification unit 64 can also identify which broadcast station is broadcasting the channel based on the relationship between the certain point in time and the broadcast date and time.

[0114] The method of identifying the display content is not limited to the above. For example, first, the channel identification unit 64 attempts to identify the display channel, and if the display channel is identified, it is determined that the communication channel identified by the channel identification unit 64 (i.e., any one of the distribution services A to C) is the display channel. Then, the content identification device 3 identifies the display content.

[0115] On the other hand, if the channel identification unit 64 cannot identify the display channel, the display channel is likely to be a broadcast channel. Therefore, the content identification device 3 refers to the fingerprint database 41 to identify the display content and the broadcast station.

[0116] In this way, when identifying a display channel, a communication channel may be preferentially identified, and if a communication channel cannot be identified, a broadcast channel may be identified.

[0117] As described above, in the second embodiment, it is possible to know which content has been reproduced on which channel by providing the communication device 8 without using the display information acquisition program 73 described in the first embodiment. Note that in the second embodiment, it is sufficient that the content can be displayed on at least two communication channels, and it is not necessary that the content can be displayed on a broadcast channel. Also, as described using FIG. 1B, the content identification unit 31 may be provided in the display information management server 5. Alternatively, as described using FIG. 1C, FIG. 2B, and FIG. 2C, the fingerprint management server 4 and the content management server 6 may be provided.

[0118] The display information acquisition system may include at least the channel identification unit 64, the content identification unit 31, and the association unit 51, and these may be provided anywhere, or may be provided in a distributed manner in a plurality of devices that can communicate with each other. For example, the channel identification unit 64 may be provided in the display information management server 5.

[0119] FIG. 6 is a block diagram showing a schematic configuration of a display information acquisition system according to a modified example of the second embodiment. In the second embodiment, distribution services A to C are built in, but in this modified example, By providing external communication content control devices 92A to 92C each having a function of providing services A to C, the contents of the distribution services A to C are reproduced.

[0120] The communication content control devices 92A-92C are recorders, game machines, dongles, personal computers, etc. The communication content control devices 92A-92C are connected to an external input terminal such as an HDMI (registered trademark) of the display device 1. The communication content control devices 92A-92C are also network-connected (e.g., connected by WiFi) to the communication device 8, receive content data from the distribution servers 91A-91C via the communication device 8, and display the content on the display device 1. It can also be said that each of the communication content control devices 92A-92C corresponds to a communication channel.

[0121] In this case, the channel identification unit 64 may identify the display channel based on communication data transmitted or received by the communication content control devices 92A to 92C via the communication device 8. The rest is the same as in the second embodiment.

[0122] According to the configuration of FIG. 6, even if the display device 1 does not have a communication function or does not have a built-in distribution service, it is possible to know which content has been reproduced on which channel.

[0123] Any part or all of the functional units described in this specification may be realized by a program. The program mentioned in this specification may be distributed in a non-temporary manner recorded on a computer-readable recording medium, or may be distributed via a communication line (including wireless communication) such as the Internet, or may be distributed in a state in which it is installed on any terminal.

[0124] Based on the above description, a person skilled in the art may be able to conceive additional effects and various modifications of the present invention, but the aspects of the present invention are not limited to the individual embodiments described above. Various additions, modifications, and partial deletions are possible within the scope of the conceptual idea and intent of the present invention derived from the contents defined in the claims and their equivalents.

[0125] For example, what is described in this specification as one device (or member, the same applies below) (including what is depicted in the drawings as one device) may be realized by multiple devices. Conversely, what is described in this specification as multiple devices (including what is depicted in the drawings as multiple devices) may be realized by one device. Alternatively, some or all of the means and functions included in a certain device (e.g., a server) may be included in another device (e.g., a user terminal).

[0126] Furthermore, not all of the features described in this specification are essential requirements, and in particular, any feature described in this specification but not included in the claims may be considered as optional additional features.

[0127] It should be noted that the applicant is merely aware of the inventions disclosed in the documents in the "Prior Art Documents" column of this specification, and the present invention does not necessarily aim to solve the problems of the inventions disclosed in the documents. The problems that the present invention aims to solve should be identified by taking into consideration the entire specification. For example, if the specification states that a specific effect is achieved by a specific configuration, it can also be said that the problem that is the reverse of the specific effect is solved. However, it is not necessarily intended that such a specific configuration is an essential requirement. [Explanation of symbols]

[0128] 1 Display device 2. Microphone 3 Content Identification Device 31 Content Identification Section 32 Transmitter 4. Fingerprint Management Server 41 Fingerprint Database 5. Display information management server 51 Association section 52 Display Information Database 6 Content Management Server 60 Content Database 11 Display 12 Speaker 13 Broadcast wave processing means 14 Communication processing means 15 Processors 16 Memory 70 OS 71 Broadcast Content Control Program 72A~72C Communication content control program 73 Display information acquisition program 61 Broadcast Content Control Unit 62A to 62C Communication content control unit 63 Display information acquisition unit 64 Channel Identification Part 65 Transmitter 8. Communications Equipment 81 Communication processing means 91A~91C Distribution Server 92A~92C Communication content control device

Claims

1. A communication device connected to a display device capable of displaying content on multiple channels, including one or more communication channels, A communication device comprising a channel identification unit that identifies the display channel of the display content based on communication data transmitted to or received from the aforementioned display device.

2. A communication device connected to a display device, each of which corresponds to a communication channel, and one or more distribution servers, each of which corresponds to the aforementioned communication channel, A communication device comprising a channel identification unit that identifies the display channel of a display content based on communication data transmitted or received between the one or more communication content control devices and / or the one or more distribution servers.

Images