Control program, control device and control method, and view quality output program, view quality output device and view quality output method

Abstract

To provide a control program, a control device and a control method, and a view quality output program, a view quality output device and a view quality output method which image a viewing area of a television and perform various processes.SOLUTION: According to one aspect of the present invention, a control device comprises: a viewer detection unit which detects a state of a viewer within a viewing area of a television on the basis of an image obtained from a camera arranged to image the viewing area; and an equipment control unit which controls equipment to be controlled on the basis of the state of the viewer.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a control program, a control device, and a control method, as well as a viewing quality output program, a viewing quality output device, and a viewing quality output method.

Background Art

[0002] Patent Document 1 discloses a technique of arranging a camera so as to image a viewing area of a television and quantifying the number of people present in the viewing area and the number of people engaged in the video in the viewing area from the obtained image data.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] An object of the present invention is to provide a control program, a control device, and a control method for photographing a viewing area of a television and performing various processes, as well as a viewing quality output program, a viewing quality output device, and a viewing quality output method.

Means for Solving the Problems

[0005] According to one aspect of the present invention, there is provided a control device including a viewer detection unit that detects a state of a viewer in the viewing area based on video from a camera arranged to photograph the viewing area of a display, and a device control unit that controls a device to be controlled based on the state of the viewer.

[0006] A display state detection unit that detects the state of the display based on the audio information from the display is provided, and the device control unit may control the device to be controlled based on the state of the viewer and the state of the display.

[0007] The display state detection unit detects the content being played on the display as the state of the display, and the device control unit may control the device to be controlled based on the content being played on the display.

[0008] The device to be controlled is the viewer's mobile terminal, and the device control unit may perform control so that information regarding the content being played on the display is displayed on the viewer's mobile terminal.

[0009] The device to be controlled is an interactive speaker, and the device control unit may perform control so that information regarding the content being played on the display is output from the interactive speaker.

[0010] The viewer detection unit detects whether or not the viewer is gazing at the display as the state of the viewer, and the device control unit may control the device to be controlled based on whether or not the viewer is gazing at the display.

[0011] The device to be controlled is the viewer's mobile terminal, and the viewer detection unit detects whether or not the viewer is looking at the mobile terminal as the state of the viewer, and when the viewer is looking at the mobile terminal, the device control unit may control the mobile terminal.

[0012] According to one aspect of the present invention, there is provided a control program that causes a computer to function as a viewer detection unit that detects the state of a viewer in a viewing area based on an image from a camera arranged to photograph the viewing area of a display, and a device control unit that controls a device to be controlled based on the state of the viewer.

[0013] According to one aspect of the present invention, based on an image from a camera arranged to photograph a viewing area of a display, the state of a viewer in the viewing area is detected, and based on the state of the viewer, a control method for controlling a device to be controlled is provided.

[0014] According to one aspect of the present invention, a computer is caused to function as setting reception means for receiving at least one setting among a broadcasting station, a period, content, and viewer attributes, acquisition means for acquiring a viewing quality value corresponding to the received setting from storage means that stores viewing quality values in association with viewer attributes for each broadcasting station and date and time, or for each content, and output control means for outputting information regarding the viewing quality value according to the received setting, and a viewing quality output program is provided.

[0015] The output control means may display information regarding the viewing quality value on a display.

[0016] The output control means may display viewing quality information corresponding to information regarding the viewing quality value on the display, where a day of the week is set in a predetermined direction and a time axis is set in a direction orthogonal to the predetermined direction, and the display mode at a position corresponding to each day of the week and each time zone corresponds to the information regarding the viewing quality value.

[0017] The setting reception means may receive a setting of an aggregation time, and the unit of the time axis may correspond to the aggregation time.

[0018] When the received setting includes a selection of a broadcasting station, the output control means may display the viewing quality information for each of the selected broadcasting stations on the display.

[0019] According to one aspect of the present invention, a computer is caused to function as acquisition means for acquiring a viewing quality value from storage means storing the viewing quality value of a viewer for each broadcasting station and date and time, or for each content, and output control means for outputting viewing quality information in which a display mode of a position corresponding to each day of the week and each time zone is set in a predetermined direction and a time axis is set in a direction orthogonal to the predetermined direction, and the display mode of the position corresponding to each day of the week and each time zone corresponds to information regarding the viewing quality value. A viewing quality output program is provided.

[0020] The output control means may display the viewing quality information on a display.

[0021] The position corresponding to each day of the week and each time zone may be a color that becomes darker as the viewing quality value is higher, or a color according to information regarding the viewing quality value.

[0022] The output control means may display information regarding the viewing quality value at positions corresponding to each day of the week and each time zone.

[0023] The output control means may display the viewing quality information on a display for each of all the broadcasting stations.

[0024] According to one aspect of the present invention, a computer is caused to function as acquisition means for acquiring a viewing quality value from storage means storing the viewing quality value of a viewer for each of contents reproduced a plurality of times, and output control means for outputting, in a graph, a change in information regarding the viewing quality value of each of the contents reproduced a plurality of times. A viewing quality output program is provided. The first axis of the graph may indicate time, and the second axis of the graph may indicate a value regarding the viewing quality value of the content reproduced at the time indicated by the first axis.

[0025] The first axis of the graph may be a value obtained by integrating the viewing rates when a specific content is displayed, and the second axis of the graph may be a value regarding the viewing quality value with respect to the value indicated by the first axis.

[0026]

[0027] According to one aspect of the present invention, there is provided a viewing quality output device including: setting reception means for receiving at least one setting among a broadcasting station, a period, content, and viewer attributes; acquisition means for acquiring a viewing quality value corresponding to the received setting from storage means that stores viewing quality values in association with viewer attributes for each broadcasting station and date / time or for each content; and output control means for outputting information regarding the viewing quality value according to the received setting.

[0028] According to one aspect of the present invention, there is provided a viewing quality output method including: receiving at least one setting among a broadcasting station, a period, content, and viewer attributes; acquiring a viewing quality value corresponding to the received setting from storage means that stores viewing quality values in association with viewer attributes for each broadcasting station and date / time or for each content; and outputting information regarding the viewing quality value according to the received setting.

[0029] According to one aspect of the present invention, there is provided a viewing quality output device including: acquisition means for acquiring a viewing quality value from storage means that stores a viewer's viewing quality value for each broadcasting station and date / time or for each content; and output control means for outputting viewing quality information in which a display mode at a position corresponding to each day of the week and each time zone corresponds to information regarding the viewing quality value, with the day of the week set in a predetermined direction and the time axis set in a direction orthogonal to the predetermined direction.

[0030] According to one aspect of the present invention, there is provided a viewing quality output method including: acquiring a viewing quality value from storage means that stores a viewer's viewing quality value for each broadcasting station and date / time or for each content; and outputting viewing quality information in which a display mode at a position corresponding to each day of the week and each time zone corresponds to information regarding the viewing quality value, with the day of the week set in a predetermined direction and the time axis set in a direction orthogonal to the predetermined direction.

[0031] According to one aspect of the present invention, there is provided a viewing quality output device including: an acquisition unit that acquires a viewing quality value from storage means storing the viewing quality value of a viewer for each of contents played back a plurality of times; and an output control unit that outputs, in a graph, changes in information regarding the viewing quality value of each of the contents played back a plurality of times.

[0032] According to one aspect of the present invention, there is provided a viewing quality output method including: a step of acquiring a viewing quality value from storage means storing the viewing quality value of a viewer for each of contents played back a plurality of times; and a step of outputting, in a graph, changes in information regarding the viewing quality value of each of the contents played back a plurality of times.

Advantages of the Invention

[0033] The viewing area of a television can be photographed and various processes can be performed.

Brief Description of the Drawings

[0034]

Figure 1

Figure 2

Figure 3A

Figure 3B

Figure 3C

Figure 3D

Figure 4A

Figure 4B

Figure 5

Figure 6

Figure 7A

Figure 7B

Figure 7C

Figure 7D

Figure 8A

Figure 8B

Figure 9

Figure 10A

Figure 10B

Figure 10C

Mode for Carrying Out the Invention

[0035] Hereinafter, embodiments of the present invention will be specifically described with reference to the drawings.

[0036] (First Embodiment) The first embodiment is to photograph the viewing area of a television with a camera and control an arbitrary device based on the obtained video. FIG. 1 is a diagram schematically showing a control system according to the first embodiment. This control system includes a camera 21, a microphone 22, and a control device 23. FIG. 1 also shows a television 100 installed in the living room and its viewing area in front.

[0037] The camera 21 is arranged to photograph the viewing area of the television 100, such as the frame of the television 100 or the ceiling of the living room. The microphone 22 is arranged to acquire the sound from the television 100, such as near the speaker of the television 100. The control device 23 controls an arbitrary controlled device 24 based on the video photographed by the camera 21 and / or the sound acquired by the microphone 22. Note that when the control device 23 can directly acquire the audio information from the television 100 (for example, when the earphone jack or the audio output terminal of the television 100 can be connected to the control device 23), the microphone 22 may not be provided.

[0038] FIG. 2 is a block diagram showing a schematic configuration of a control system according to the first embodiment. The control device 23 in this control system includes a communication unit 231, a viewer detection unit 232, a television state detection unit 233, and a device control unit 234. The control device 23 may be a computer having a processor and a memory, and some or all of the functions of these units may be realized by the processor executing a predetermined program stored in the memory.

[0039] The communication unit 231 communicates with the camera 21, the microphone 22, and the controlled device 24. There is no particular limitation on the type of communication, and it may be wired communication or wireless communication such as short-range wireless communication or wireless LAN. Specifically, the communication unit 231 receives information from the camera 21 and the microphone 22. In addition, the communication unit 231 transmits information for controlling the camera 21, the microphone 22, and the controlled device 24.

[0040] The viewer detection unit 232 detects the state of viewers in the viewing area based on the video from the camera 21. As a specific example of the process, the viewer detection unit 232 identifies viewers in the viewing area (or that there are no viewers in the viewing area) by performing face recognition on the video from the camera 21. The viewer detection unit 232 may perform human body recognition, which is a part of object recognition, extract the face included in the detected human body, and perform matching with a pre-registered face photo. Then, the viewer detection unit 232 detects whether each viewer is gazing at the TV 100 or whether each viewer is looking at their own mobile terminal (such as a smartphone or tablet). Note that in this specification, a person in the viewing area of the TV may be referred to as a "viewer" (regardless of whether they are actually watching).

[0041] In addition, the viewer detection unit 232 may detect the attributes (such as gender and age) of each identified viewer and expressions such as emotions of joy, anger, sorrow, and happiness. Additionally, the viewer detection unit 232 may detect the number of viewers in the viewing area, the time each viewer gazes at the TV 100, the distance between the TV 100 and the viewers, etc. as the state of the viewers. The viewer detection unit 232 may perform the detection process by utilizing artificial intelligence or by using a known method.

[0042] The TV state detection unit 233 detects the state of the TV 100 based on the audio information from the TV 100. The state of the TV 100 includes whether the TV 100 is on or off, which content is being played, and so on. The content may be a program, a commercial, or a specific scene (such as a certain event or accident), and the unit of the content is arbitrary. Also, the content here may be the one being broadcast currently (in real time) or the one that has been recorded. Further, as the content, the content may be specified, or the genre of the content (such as sports, movies, news, etc.) may be detected. Also, the content is not limited to that by broadcast waves and includes the content provided via the Internet (in this case, it may be just a display instead of the TV 100). An example of the method for specifying the content being played on the TV 100 is described in the second embodiment.

[0043] The device control unit 234 controls the device to be controlled 24 based on the detection results by the viewer detection unit 232 and / or the TV state detection unit 233. More specifically, the device control unit 234 generates control information for controlling the device to be controlled 24 and controls the device to be controlled 24 by transmitting the control information via the communication unit 231. The device to be controlled 24 may be, for example, the TV 100 itself, a speaker other than the TV, lighting (in the living room or other rooms where the TV is installed), the viewer's mobile terminal, an interactive speaker (a so-called "smart speaker" having an AI assistant function), and so on.

[0044] Here, the device control unit 234 may directly control the controlled device 24 (such as a TV, speaker, lighting, etc. installed in the home) that is not network-connected to an external device by transmitting a control signal via short-range wireless communication or a home LAN. Also, for the controlled device 24 (such as a mobile terminal, interactive speaker, etc.) that is network-connected to an external device such as a server, the device control unit 234 may indirectly control the controlled device 24 (that is, the external device controls the controlled device 24 according to the control signal from the device control unit 234) by transmitting a control signal to the external device such as a server via the Internet line.

[0045] Note that it is desirable for the device control unit 234 to previously grasp the correspondence relationship between the viewer (such as the father or mother in the home where the TV is installed, etc.) that can be identified by the viewer detection unit 232 and the mobile terminal used by the viewer in order to control the mobile terminal of the specific viewer individual.

[0046] As described above, by using the camera 21, the viewer in the viewing area can be detected, and by using the microphone 22, the state of the TV 100 can be detected. Therefore, the device control unit 234 may control the controlled device 24 using both of them. Alternatively, the device control unit 234 may control the controlled device 24 using only one of them. Hereinafter, specific examples of the control by the device control unit 234 will be given.

[0047] For example, when the TV 100 is on even though there is no viewer in the viewing area, the device control unit 234 may turn off the TV 100 or turn off the lighting in the room where the TV 100 is installed. Alternatively, when the state changes from there being no viewer in the viewing area to there being a viewer, the device control unit 234 may turn on the TV 100. Also, when the state changes from there being no viewer in the viewing area to there being a viewer and the viewer is gazing at the TV 100, the device control unit 234 may turn on the TV 100.

[0048] Also, the device control unit 234 may control the content of the TV 100. For example, when the viewer is not looking at the TV 100, an image to attract the viewer's attention may be displayed on at least a part of the display of the TV 100, or a sound may be output from the speaker of the TV 100. Such an image or sound may be predetermined or may be tailored to the attributes and preferences of the viewer.

[0049] Also, the device control unit 234 may control the controlled device 24 based on the content being played on the TV 100. As a specific example, the device control unit 234 may cause information about the content to be output from the interactive speaker or displayed on the viewer's mobile terminal. More specifically, the device control unit 234 transmits information indicating the content being played to an external server connected to the mobile terminal or the interactive speaker. As a result, under the control from the external server, information about the content is recommended from the interactive speaker, or an advertisement related to the content is displayed on the viewer's mobile terminal.

[0050] Also, when the viewer is looking at the mobile terminal, the device control unit 234 may control the mobile terminal. Alternatively, when the viewer is not looking at the TV, the device control unit 234 may control the mobile terminal on the assumption that the viewer may be looking at the mobile terminal. As a specific example, the device control unit 234 may cause information about the CM being played on the TV to be displayed on the mobile terminal in real time. As a result, even if the viewer is not looking at the CM being played on the TV, the viewer can be shown an advertisement with the same content or related content as this CM.

[0051] As described above, in the first embodiment, the viewing area of the television 100 is photographed by the camera 21, and the control target device 24 is controlled based on the obtained video. Therefore, depending on various situations in the viewing area, such as whether there is a viewer in the viewing area, and if so, what kind of viewer, and whether the television is being watched, the control target device 24 can be appropriately controlled. Further, in the first embodiment, by controlling the control target device 24 in consideration of the state of the television 100 obtained from the sound of the television 100, more diverse control becomes possible.

[0052] (Second Embodiment) Conventionally, the "household audience rating" has been widely used as a measure indicating the proportion of households that watched a specific TV program. However, the household audience rating only corresponds to the proportion of households in which the TV program is tuned in, and does not necessarily correlate with the proportion of households that are actually watching the TV program.

[0053] In recent years, the audience rating has also been obtained on an individual basis rather than in units of the proportion of households. The individual-based audience rating records that a person has watched a program by providing buttons associated with each family member to a predetermined device and the person watching the TV selects the button associated with themselves. However, regarding the individual-based audience rating, it is not always the case that the person is actually watching the TV, and there is also a possibility that the TV is simply left on without any particular intention. On the other hand, Patent Document 1 mentioned above focuses on the "quality" of viewing and discloses a technique for quantifying the number of people present in the viewing area in front of the display and the number of people engaged with the video in the viewing area. However, Patent Document 1 only discloses quantifying these numbers and does not consider at all how they should be presented to the user.

[0054] The second embodiment described below is to make it possible to present the viewing quality more clearly.

[0055] The second embodiment to be described next is to make it possible to present the viewing quality more clearly.

[0056] In the second embodiment, the viewing quality is quantified as a viewing quality value. As an example of the viewing quality, an index of how many viewers were able to watch the TV (Viewability Index, hereinafter referred to as "VI value") and an index of how many viewers watched the TV attentively (Attention Index, hereinafter referred to as "AI value") are used. The VI value indicates the degree of stay of the viewers, and the higher the value, the more viewers were positioned in front of one TV. On the other hand, the AI value indicates the degree of attention of the viewers, and the higher the value, the more viewers paid attention to the TV content at that viewing rate.

[0057] First, an example of the method for obtaining the VI value and the AI value will be described. FIG. 3A is a block diagram showing a schematic configuration of a viewing quality acquisition system. The viewing quality acquisition system includes a viewing information acquisition device 1, a channel - broadcast time database 2, and a viewing quality management device 3. The viewing information acquisition device 1 is installed for each household, and it is assumed that the viewing quality management device 3 aggregates the information from the viewing information acquisition device 1 of each household.

[0058] The viewing information acquisition device 1 is installed for each household. Also, the persons belonging to each household (household members) are predetermined. Hereinafter, it will be described assuming that a household in which the viewing information acquisition device 1 is installed includes three household members A, B, and C.

[0059] The viewing information acquisition device 1 includes a camera 11, an IR sensor 12, a viewer detection unit 13, a microphone 14, a TV state detection unit 15, and a transmission unit 16.

[0060] The camera 11 photographs the TV viewing area (in front of the TV) and supplies the camera image to the viewer detection unit 13.

[0061] The IR sensor 12 includes a light emitting unit that irradiates the viewing area with infrared rays, and a light receiving unit that detects the infrared rays reflected from an object (particularly, a viewer). Then, based on the infrared rays detected by the light receiving unit, the IR sensor 12 generates a depth image indicating the distance between the light emitting unit and the object and supplies it to the viewer detection unit 13.

[0062] The viewer detection unit 13 includes a stay detection unit 131 and a gaze detection unit 132.

[0063] The stay detection unit 131 detects the viewers staying in the viewing area by performing face recognition from the camera image and the depth image, or based on the way of walking, body shape, etc. More specifically, the stay detection unit 131 identifies which of the household members A to C the stayers are. Then, the stay detection unit 131 generates stay information indicating which viewer was staying at each time.

[0064] Fig. 3B schematically shows the stay information. As shown in the figure, the stay information indicates whether each of the household members A to C was staying in the viewing area at each time. The circles in the figure indicate staying, and the crosses indicate not staying. For example, the household member A was staying in the viewing area at 19:00:00 on January 3, 2020, 19:00:05 on the same day, and 19:00:10 on the same day.

[0065] It can also be said that the stay information indicates the number of stayers at each time. In Fig. 3B, the stayers are detected in units of 5 seconds, but there is no particular limitation on the unit.

[0066] The gaze detection unit 132 detects the viewers who are gazing at the TV by analyzing the gestures, movements, face directions, and gaze movements of the viewers from the camera image and the depth image. More specifically, the gaze detection unit 132 identifies which of the household members A to C the gazers are. Then, the gaze detection unit 132 generates gaze information indicating which viewer was gazing at the TV at each time.

[0067] Figure 3C schematically shows viewer information. As shown in the figure, the viewer information indicates whether each of household members A to C was watching TV at each time. The circles in the figure indicate that the person was watching, and the crosses indicate that the person was not watching. For example, household member A was watching TV at 19:00:00 on January 3, 2020 and at 19:00:10 on the same day, but was not watching TV at 19:00:05 on the same day.

[0068] It can also be said that the viewer information indicates the number of viewers at each time. In addition, in FIG. 3B, viewers are detected in units of 5 seconds, but the unit is not particularly limited.

[0069] Returning to FIG. 3A, the microphone 14 collects the sound reproduced from the TV and supplies it to the TV state detection unit 15.

[0070] The TV state detection unit 15 acquires the state of the TV based on the audio information from the TV. Specifically, the TV state detection unit 15 includes a fingerprint generation unit 151 and a channel / broadcast time information acquisition unit 152.

[0071] The fingerprint generation unit 151 processes the sound from the microphone 14 to generate an audio fingerprint (hereinafter simply referred to as "fingerprint") F.

[0072] The channel / broadcast time information acquisition unit 152 acquires the state of the TV at each time based on the channel / broadcast time database 2 that stores the correspondence between the fingerprint F and the channel (broadcast station) and the broadcast time, and generates TV state information. The TV state information indicates the broadcast station and the broadcast date and time of the content displayed on the TV at each time.

[0073] As an example of specific processing, the channel broadcast time information acquisition unit 152 transmits the generated fingerprint F to a service having the channel broadcast time database 2. Then, the channel broadcast time information acquisition unit 152 receives information indicating the channel and broadcast time specified by the service based on the fingerprint F.

[0074] FIG. 4A is a diagram showing an example of the structure of the channel broadcast time database 2. As shown in the figure, the fingerprint is stored in association with the broadcasting station, the broadcast date and time, and the viewing date and time. For example, at a specific time, if the fingerprint generated by the fingerprint generation unit 151 in FIG. 3A is the fingerprint F2, it can be seen that the program being played on the TV was broadcast by the broadcasting station Q from 19:00:00 on January 3, 2020 to 19:00:05 on the same day. It can be understood that it was the program being broadcast.

[0075] FIG. 3D schematically shows the TV state information. For example, at 19:00:00 on January 3, 2020 and 19:00:05 on the same day, the contents broadcast by the broadcasting station X at 19:00:00 on January 3, 2020 and 19:00:05 on the same day are respectively displayed on the TV. In addition, although the TV state is detected in units of 5 seconds in FIG. 3D, there is no particular limitation on the unit.

[0076] Returning to FIG. 3A, the transmission unit 16 of the viewing information acquisition device 1 transmits the occupant information (FIG. 3B), the viewer information (FIG. 3C), and the TV state information (FIG. 3D) to the viewing quality management device 3. Similar information is transmitted to the viewing quality management device 3 from each viewing information acquisition device 1.

[0077] Note that the viewing information acquisition device 1 in FIG. 3A does not necessarily require all the configurations shown. For example, the IR sensor 12 may be omitted, and the viewer detection unit 132 may detect viewers only from the camera images.

[0078] Next, the viewing quality management device 3 will be described. The viewing quality management device 3 includes an attribute detection unit 31, a program information acquisition unit 32, a VI value calculation unit 33, an AI value calculation unit 34, a database writing unit 35, a program database 36, and a viewing quality database 37.

[0079] The attribute detection unit 31 detects the attributes of viewers. Specifically, the attribute detection unit 31 is associated with each viewing information acquisition device 1, and the attributes (such as gender, age, annual income, etc.) of the household members of the household where the viewing information acquisition device 1 is installed are set. For example, the attributes of the three household members A to C described above are set. Then, the attribute detection unit 31 identifies the attributes of the viewers staying in the viewing area at each time and the viewers watching the TV at each time based on the stay information and gaze information from the viewing information acquisition device 1. As for age and gender, for example, it may be identified which of the categories (C, T, M1 to M3, F1 to F3) used in marketing.

[0080] The program information acquisition unit 32 refers to the program database 36 that stores the correspondence between channels (broadcast stations) and broadcast times and programs, and identifies the programs being broadcast on the channels (broadcast stations) and at the broadcast times indicated by the TV status information.

[0081] FIG. 4B is a diagram showing an example of the structure of the program database 36. As shown in the figure, the broadcast stations and broadcast times are stored in association with the programs broadcast by each broadcast station at each broadcast time. For example, the program broadcast by broadcast station Q from 19:00 to 21:00 on January 3, 2020 is professional baseball B.

[0082] As described above, the TV status detection unit 15 and the program information acquisition unit 32 cooperate to acquire the content being played on the TV. Depending on the structure of the database, the program may be directly identified from the fingerprint F without specifying the channel and broadcast time. Alternatively, it may only be necessary to specify the channel and broadcast time.

[0083] According to the method of identifying a program using the fingerprint F, not only a program being broadcast in real time but also a program that has been recorded and viewed in time-shift can be identified.

[0084] Although FIG. 4B shows an example stored in the program database 36 in units of content, it may be stored in the program database 36 in units finer than content (so-called programs, content in the narrow sense), for example, CM or a specific scene in the content (content in the broad sense). It may be stored.

[0085] Returning to FIG. 3A, the VI value calculation unit 33 totals the number of staying persons based on the staying person information from each viewing information acquisition device 1, and calculates the VI value in association with the attributes of the viewers for each broadcasting station and date and time (or for each content, the same applies hereinafter). The AI value calculation unit 34 totals the number of viewers based on the viewer information from each viewing information acquisition device 1, and calculates the AI value in association with the attributes of the viewers for each broadcasting station and date and time. The database writing unit 35 writes the VI value and the AI value in association with the attributes of the viewers into the viewing quality database 37 for each broadcasting station and date and time.

[0086] FIG. 5 is a diagram showing an example of the structure of the viewing quality database 37. In the illustrated example, for each program (broadcasting date and time and broadcasting station), the VI value and the AI value are stored in association with the attributes of the viewers (here, gender, age, and income). For example, the AI value for viewers with an income of 3 million yen or less in the M1 layer for "News A" broadcast by broadcasting station P from 7:00 pm to 7:30 pm on January 3, 2020 is 0.2, and the VI value is 0.15.

[0087] In the above manner, information on the viewing quality values is stored in the viewing quality database 37. Note that the above description is only an example, and it is sufficient to be able to store the viewing quality values for each broadcasting station and date and time, and appropriate changes are possible. For example, as attributes, one or two of gender, age, and annual income may be used, other elements may be included, or the attributes may be omitted. Also, as the viewing quality values, indicators other than the VI value and the AI value may be applied.

[0088] Next, the display of viewing quality will be described. FIG. 6 is a block diagram showing a schematic configuration of a viewing quality display system according to the second embodiment. The viewing quality display system includes a viewing quality display device 5 and the viewing quality database 37 of FIG. 1.

[0089] The viewing quality display device 5 may be any computer such as a personal computer, a smartphone, or a tablet, and has an input interface 51, a display 52, a setting reception unit 53, a viewing quality acquisition unit 54, and an output control unit 55. At least part of the functions of the setting reception unit 53, the viewing quality acquisition unit 54, and the output control unit 55 may be realized by the processor of the viewing quality display device 5 executing a predetermined program.

[0090] The setting reception unit 53 receives from the user via the input interface 51 a setting of what viewing quality to display (that is, the target of the viewing quality to be displayed). This setting may include, for example, at least one of a broadcasting station, a period, a program, an attribute of a viewer, and an aggregation time. The viewing quality acquisition unit 54 accesses the viewing quality database 37 and acquires a viewing quality value corresponding to the setting received by the setting reception unit 53. The output control unit 55 outputs a screen for receiving the above setting and information indicating the viewing quality value acquired by the viewing quality acquisition unit 54.

[0091] The output control unit 55 may display information indicating the viewing quality value on the display 52, may print it with a printer (not shown), may generate and output an electronic file such as a CSV, or may output it externally via an API as electronic data. Hereinafter, an example in which the output control unit 55 displays information indicating the viewing quality value on the display 52 will be mainly described, but similar printing may be performed, or an electronic file or electronic data for displaying a similar screen may be output.

[0092] Figure 7A is an example of a screen displayed on the display 52 to receive the setting of a broadcasting station. As shown in the figure, a checkbox is provided for each broadcasting station, and one or more checkboxes can be checked. Through the input interface 51, the user selects a broadcasting station by checking the checkbox of the broadcasting station for which the viewing quality value is to be displayed. . The viewing quality acquisition unit 54 acquires the viewing quality value for the program of the selected broadcasting station.

[0093] Note that the setting of the broadcasting station is optional, and the viewing quality display device 5 may display the viewing quality values of all broadcasting stations that can be broadcast in a specific area without setting the broadcasting station.

[0094] Figure 7B is an example of a screen displayed on the display 52 to receive the setting of a period. Figure 7B is an example of specifying a period in units of one week, and a field for inputting which week of which year and month the viewing quality value is to be displayed is provided. Through the input interface 51, the user specifies the period by inputting the period for which the viewing quality is to be displayed. The viewing quality acquisition unit 54 acquires the viewing quality value within the specified period.

[0095] Note that there is no restriction on the method of setting the period. The start date and end date can be specified by date or date and time, and the unit of the period is not limited to one week, and it may be a specific day or one month. A calendar or clock may be displayed to select the start date and end date of the period. Also, the setting of the period is optional, and the viewing quality display device 5 may display the viewing quality values of a predetermined period such as the most recent week without setting the period.

[0096] In addition, the setting reception unit 53 may receive a selection in units of programs instead of specifying a broadcasting station and a period. Also, selections may be received not only in units of individual programs but also in units of genres such as news and sports.

[0097] Figure 7C is an example of a screen displayed on the display 52 to receive the setting of an attribute.

[0098] As shown in FIG. 7C(a), regarding the setting of the viewer's gender, radio buttons are provided for each of "male", "female", and "both", and only one radio button can be selected exclusively. Through the input interface 51, the user selects the gender for which the viewing quality value is to be displayed. The viewing quality acquisition unit 54 acquires the viewing quality value for the selected gender (regardless of gender if "both" is selected).

[0099] As shown in FIG. 7C(b), regarding the selection of the viewer's age, check boxes are provided for each age group, and one or more check boxes can be checked. Through the input interface 51, the user designates the age group by checking the check box for the age group for which the viewing quality value is to be displayed. The viewing quality acquisition unit 54 acquires the viewing quality value for the designated age group. Note that the user may arbitrarily designate the age in one-year increments.

[0100] Note that it may be possible to simultaneously set the gender and age group in categories such as C, T, M1 to M3, and F1 to F3.

[0101] As shown in FIG. 7C(c), regarding the setting of the viewer's income, check boxes are provided for each income level, and one or more check boxes can be checked. Through the input interface 51, the user designates the income level by checking the check box for the income level for which the viewing quality value is to be displayed. The viewing quality acquisition unit 54 acquires the viewing quality value for the designated income level.

[0102] Note that the setting of attributes is optional, and the viewing quality display device 5 may display the viewing quality values of all viewers without setting attributes. Also, it may be possible to set one or two of gender, age, and income, or other attributes may be set according to the configuration of the viewing quality database 37.

[0103] FIG. 7D is an example of a screen displayed on the display 52 to receive the setting of the aggregation time. As shown in the figure, a field for inputting the aggregation time is provided. Through the input interface 51, the user inputs the time that is the unit for aggregating the viewing quality values. The viewing quality acquisition unit 54 acquires the viewing quality values and aggregates the viewing quality values in units of the set aggregation time. For example, if the aggregation time is 1 hour, the viewing quality acquisition unit 54 aggregates the viewing quality values in units of 1 hour, and if the aggregation time is 1 day, the viewing quality acquisition unit 54 aggregates the viewing quality values in units of 1 day. The unit of aggregation is arbitrary and may be in units of 1 minute, 10 minutes, 1 hour, or 1 day.

[0104] Note that the setting of the aggregation time is arbitrary, and the viewing quality display device 5 may aggregate the viewing quality values at a predetermined aggregation time such as 2 hours without setting the aggregation time.

[0105] FIG. 8A is an example of a screen for displaying information indicating the viewing quality values. In this figure, it is assumed that the broadcast station P, the first week of March 2020, and 1 hour as the aggregation time are set by the setting reception unit 53. Also, it is assumed that M2 (men aged 35 to 49) is specified as the attribute, and for the sake of convenience, the viewing quality values (here, VI values) are shown only for some dates and times.

[0106] As the viewing quality information 6, the days of the week are set horizontally, and the time axis is set vertically. The time axis is in units corresponding to the aggregation time (in this example, since the aggregation time is 1 hour, it is in units of 1 hour). And the display mode of the positions corresponding to each day of the week and each time zone corresponds to the viewing quality values in that day of the week and time zone.

[0107] As the display mode, the viewing quality values themselves may be displayed at the positions corresponding to each day of the week and each time zone. For example, in FIG. 8A, the viewing quality value at around 5 o'clock on Monday is 0.3, and the viewing quality value at around 5 o'clock on Tuesday is 0.35 (the illustration of other days of the week and other time zones is omitted).

[0108] In addition, as a display mode, the color and color density of the positions (cells) corresponding to each day of the week and each time zone may correspond to the viewing quality value. As a specific example, the higher the viewing quality value, the darker the color may be. The viewing quality value and the display mode may correspond one-to-one, or may be in a specific display mode when the viewing quality value is within a certain range (for example, every time the viewing quality value increases by 0.1, the color becomes one step darker).

[0109] In FIG. 8A, for convenience, spots with higher density are marked for higher viewing quality values. According to such a display, the outline of the viewing quality values for each day of the week and each time zone can be intuitively grasped. According to FIG. 8A, generally, it can be seen that the viewing quality is high after 19:00 when returning home from work, and then the viewing quality is high at 7-8 o'clock on Saturdays and Sundays and before going to work.

[0110] FIG. 8B is another screen example for displaying information indicating the viewing quality value. The difference from FIG. 8A is that F2 (women aged 35-49) is specified as an attribute. Different from FIG. 8A where M2 is specified as an attribute, it can be seen that the viewing quality is high during the daytime time zone.

[0111] In this way, by setting the attribute by the user, the tendency of the viewing quality according to the attribute can be grasped. For example, when considering the TV commercial release for middle-aged men's products, it is better to display the viewing quality information 6 in FIG. 8A. On the other hand, when considering the TV commercial release for middle-aged women's products, it is better to display the viewing quality information 6 in FIG. 8B.

[0112] When a plurality of broadcasting stations are selected, for each of them, the output control unit 55 displays the viewing quality information 6 shown in FIG. 8. Also, when the number of broadcasting stations is not so large, the output control unit 55 may display the viewing quality information 6 for all (broadcasting stations that can be broadcast in a specific area). 。

[0113] FIG. 9 is another example of a screen for displaying information indicating the viewing quality value. Different from the viewing quality information 6 in FIG. 8, the days of the week set in the horizontal direction are divided into two categories: weekdays and weekends. That is, the value obtained by summarizing the viewing quality values from Monday to Friday (for example, the average value) is used as the viewing quality value for weekdays, and the value obtained by summarizing the viewing quality values for Saturday and Sunday (for example, the average value) is used as the viewing quality value for weekends. Also, the time axis set in the vertical direction does not have to be equally spaced.

[0114] As described above, the user sets the target for which the viewing quality value is to be displayed, and the output control unit 55 displays the viewing quality information 6 according to the setting. Therefore, the user can display the viewing quality value desired by the user. Also, in the present embodiment, since the output control unit 55 shows the viewing quality value in a matrix form for each day of the week and each time zone, the user can easily grasp the viewing quality value for each day of the week and each time zone.

[0115] Note that the viewing quality values for a plurality of broadcasting stations or periods may be collectively aggregated and displayed. For example, for a specific information program in the morning, the viewing quality value aggregated for a specified predetermined period may be displayed. Alternatively, for programs of a specific genre, the viewing quality value aggregated across broadcasting stations may be displayed. It is possible to accept from the user the setting of what kind of aggregation is to be performed.

[0116] Subsequently, in the content that is played back multiple times, an aspect of displaying the transition of the viewing quality of the content as a line graph will be described. Here, the content that is played back multiple times can be, for example, a CM that is repeatedly broadcast, a serial drama, a rebroadcast program, etc., but in the following, it is assumed to be a CM.

[0117] FIG. 10A is an example of a screen for displaying the viewing quality as a line graph. The solid line is the CM related to beverage A, the dashed line is the CM related to beverage B, and the dotted line is the average of these. The horizontal axis of the line graph indicates time (in FIG. 10A, in units of one month), and in FIG. 10A, one month is used as the unit of time. The vertical axis of the line graph indicates a value related to the viewing quality value of the content played back at the time indicated by the corresponding horizontal axis (in FIG. 10A, the product of the VI value and the AI value).

[0118] For example, arrow F in FIG. 10A is the product of the VI value and the AI value of the CM for beverage A played in June. If the CM for beverage A is played multiple times in the same month, it may be the average value or the cumulative value for each time.

[0119] For such a line graph, for each piece of content played multiple times, the viewing quality value of the TV viewer is stored in the viewing quality database 37 (FIG. 6), and the viewing quality acquisition unit 54 acquires the necessary viewing quality information, and then it is displayed by the output control unit 55. Here, "for each piece of content" may be for each play, or it may be aggregated over a specific period (such as one day, one week, one month, etc.).

[0120] Note that the time unit on the horizontal axis is not limited to one month, and it may be one week or one year. Also, the setting reception unit 53 may receive the setting of the time unit from the user via the input interface 51, and the output control unit 55 may set the horizontal axis according to the received time unit. Also, the viewing quality value on the vertical axis may be the aggregated value of multiple broadcasting stations or periods.

[0121] Also, the setting reception unit 53 may receive from the user the designation of any part in the line graph via the input interface 51, and the output control unit 55 may display the detailed information corresponding to the designated part.

[0122] For example, as shown in FIG. 10B, when the user designates April (for example, when the user moves the cursor to the area corresponding to April on the display 52), the output control unit 55 may display the viewing quality values of beverage A and beverage B numerically. Also, as shown in FIG. 10C, when the user designates beverage A (for example, when the user moves the cursor to the area corresponding to beverage A on the display 52), the output control unit 55 may display the viewing quality values of each month of beverage A numerically.

[0123] In addition, the output control unit 55 may display the CM, the program in which the CM was played, and the time when the CM was played. For example, when the user designates September for Beverage A, the program and time in which the CM for Beverage A was played may be displayed. Such display enables speculation on the reasons for high or low viewing quality values.

[0124] In this way, by displaying the viewing quality value as a line graph, it becomes possible to grasp the transition of the viewing quality value.

[0125] In addition, as shown in FIG. 5, when storing the viewing quality in association with attributes, it is also possible to track the viewing trends of viewers with specific attributes. For example, by tracking content with a high viewing quality value for the M1 layer, the content directed to the M1 layer can be grasped.

[0126] Also, as an attribute, by conducting a questionnaire in advance for each viewer, the hobbies and preferences of each viewer can be obtained. In this case, it is also possible to track the viewing trends of viewers with specific hobbies and preferences. For example, by tracking the CM with a high viewing quality value for smokers, it is possible to grasp which brands smokers are paying attention to.

[0127] In the second embodiment described above, the VI value and the AI value are mainly exemplified as the viewing quality, but other indicators may be used. For example, at least one of the following indicators regarding the number of viewers (unique reach), viewing rate (unique reach rate), cumulative attention number, cumulative attention rate, attention content rate, and number of viewings may be used as the viewing quality. Also, similar to the first embodiment, it may be a display provided via the Internet instead of a television.

[0128] The number of viewers is the total number of people who watched a specific piece of content. Also, for example, the viewing rate is the ratio of the number of viewers to a reference value (e.g., the total number of panels or the number of people with a specific attribute). Here, people who watched a specific piece of content for even a very short time may be included in the number of viewers, but it is desirable to include only those who watched for a predetermined time or longer. As the predetermined time, for example, when the content is a commercial of about 15 seconds, it can be set to 3 seconds. According to the findings of the inventors of the present application, this is because when the viewing time is 3 seconds or more, the recognition of the commercial progresses. This predetermined time may be a fixed value, a value according to the length of the content, or a value that can be arbitrarily set by the user. Also, when a specific piece of content is viewed a predetermined number of times or more, it may be included in the number of viewers, and this predetermined number of times may be arbitrarily set by the user.

[0129] For example, assuming that the above-mentioned predetermined time is 3 seconds and the reference value is 2,000 people, and 100 people watched a specific piece of content for 3 seconds or more. In this case, the number of viewers is 100 people, and the viewing rate is 5% (100 / 2,000).

[0130] Also, the cumulative viewing rate is the value obtained by accumulating the viewing rates of each piece of content in content that is played multiple times. The viewing inclusion rate is the cumulative viewing rate with respect to the value obtained by accumulating the viewing rates of each piece of content in content that is played multiple times. Content that is played multiple times includes, for example, commercials that are repeatedly broadcast, serial dramas, programs that are rebroadcast, and the like.

[0131] For example, assume that a certain commercial is broadcast 3 times, and its viewing rates are 10%, 15%, and 20% respectively, and its viewing rates are 5%, 6%, and 7% respectively. In this case, the cumulative viewing rate is 18 (=5 + 6 + 7)%. Also, the viewing inclusion rate is 60 (= (5 + 6 + 7) / (10 + 15 + 20))%.

[0132] The index for the number of gazes is also an index called "frequency". Frequency refers to regarding the act of gazing at specific content (typically a commercial) for a predetermined time (e.g., 3 seconds) as one gaze, and the number or proportion of people whose number of gazes is equal to or more than a predetermined number (e.g., 3 times). There is an opinion that commercials cannot be associated with recognition unless they are viewed a certain number of times, but frequency can be an index for measuring to what extent commercials are recognized.

[0133] In order to obtain the gaze rate, cumulative gaze rate, gaze content rate, and frequency, for example, the gaze counter unit 132 in the viewer detection unit 13 of FIG. 3A measures the time each viewer gazes at the TV, and the gaze time of each viewer is transmitted to the viewing information management device 3. Then, a gaze information calculation unit is provided in the viewing information management device 3 of FIG. 3A, and the gaze rate, cumulative gaze rate, and gaze content rate may be calculated based on the gaze time of each viewer.

[0134] The gaze rate, cumulative gaze rate, gaze content rate, and frequency can be said to be viewing qualities related to the number of viewing qualities that have gazed at the content for a predetermined time or more. Such viewing qualities can also be presented to the user in the same manner as FIGS. 8A, 8B, and 9 via the same interface as FIGS. 7A to 7D.

[0135] In addition, as the viewing quality value, it may be the product of the AI value and the VI value, the ratio to the reference value of the AI value or the VI value, the value obtained by summing up the household viewing rates, etc.

[0136] Also, although the horizontal axis in FIGS. 10A and 10B is time, other parameters may be used as the horizontal axis.

[0137] For example, the output control unit 55 may display a line graph with the horizontal axis being GRP (a value obtained by integrating the audience rating when a specific content or the like is displayed (cumulative audience rating)) and the vertical axis being the viewing quality value (for example, an AI value). Further, the output control unit 55 may display a line graph with the horizontal axis being the number of contacts (the number of times of contacting a specific content) and the vertical axis being the viewing quality value. Alternatively, the output control unit 55 may display a line graph with the horizontal axis being the elapsed time (the elapsed time since a specific content started) and the vertical axis being the viewing quality value. In this way, the horizontal axis can be arbitrarily set to display the change in information regarding the viewing quality value in a graph.

[0138] Note that part or all of the above-described first embodiment may be incorporated into the second embodiment, or part or all of the second embodiment may be incorporated into the first embodiment. Also, in the above-described embodiments, the processing for each program has been mainly described, but the processing may be performed in any unit as content, such as for each CM or for each specific scene.

[0139] The above-described embodiments are described for the purpose of enabling a person having ordinary knowledge in the technical field to which the present invention pertains to implement the present invention. Various modifications of the above embodiments can be naturally made by those skilled in the art, and the technical idea of the present invention can also be applied to other embodiments. Therefore, the present invention should not be limited to the described embodiments, but should be in the broadest scope in accordance with the technical idea defined by the claims.

Explanation of Reference Numerals

[0140] 21 Camera 22 Microphone 23 Control Device 231 Communication Unit 232 Viewer Detection Unit 233 TV State Detection Unit 234 Equipment Control Unit 24 Controlled Equipment 1 Viewing Information Acquisition Device 11 Camera 12 IR Sensor 13 Viewer Detection Unit 131 Occupant Detection Unit 132 Gaze Detection Unit 14 Microphone 15 TV State Detection Unit 151 Fingerprint Generation Unit 152 Channel / Broadcast Time Information Acquisition Unit 16 Transmitter 2 Channel / Broadcast Time Database 3 Viewing Quality Management Device 31 Attribute Detection Unit 32 Program Information Acquisition Unit 33 VI Value Calculation Unit 34 AI Value Calculation Unit 35 Database Writing Unit 36 Program Database 37 Viewing Quality Database 5 Viewing Quality Display Device 51 Input Interface 52 Display 53 Setting Reception Unit 54 Viewing Quality Acquisition Unit 55 Output Control Unit 6 Viewing Quality Information

Claims

1. A computer, an acquisition means for acquiring a viewing quality value from a storage means storing the viewing quality values of viewers for each broadcasting station and each date and time, or for each content; a viewing quality output program that functions as an output control means for outputting viewing quality information in which a display mode at a position corresponding to each day of the week and each time zone corresponds to information regarding the viewing quality value, where the day of the week is set in a predetermined direction and the time axis is set in a direction orthogonal to the predetermined direction.

2. The viewing quality output program according to claim 1, wherein the output control means causes the viewing quality information to be displayed on a display.

3. The viewing quality output program according to claim 1 or 2, wherein the position corresponding to each day of the week and each time zone is a color that becomes darker as the viewing quality value is higher, or a color corresponding to information regarding the viewing quality value.

4. The viewing quality output program according to any one of claims 1 to 3, wherein the output control means causes information regarding the viewing quality value to be displayed at positions corresponding to each day of the week and each time zone.

5. The viewing quality output program according to any one of claims 1 to 4, wherein the output control means causes the viewing quality information to be displayed on a display for each of all the broadcasting stations.

6. A computer, an acquisition means for acquiring a viewing quality value from a storage means storing the viewing quality values of viewers for each of the contents reproduced a plurality of times; a viewing quality output program that functions as an output control means for outputting, in a graph, changes in information regarding the viewing quality value of each of the contents reproduced a plurality of times.

7. A first axis of the graph indicates time, and a second axis of the graph indicates a value regarding the viewing quality value of the content reproduced at the time indicated by the first axis. The viewing quality output program according to claim 6.

8. A first axis of the graph is a value obtained by integrating the audience rating when a specific content is displayed, and a second axis of the graph is a value regarding the viewing quality value with respect to the value indicated by the first axis. The viewing quality output program according to claim 7.

9. an acquisition means for acquiring a viewing quality value from a storage means storing the viewing quality values of viewers for each broadcasting station and each date and time, or for each content; a viewing quality output device comprising an output control means for outputting viewing quality information in which a display mode at a position corresponding to each day of the week and each time zone corresponds to information regarding the viewing quality value, where the day of the week is set in a predetermined direction and the time axis is set in a direction orthogonal to the predetermined direction.

10. Obtain the viewing quality value from the storage means that stores the viewing quality value of the viewer for each broadcasting station, date and time, or for each content. A viewing quality output method in which a day of the week is set in a predetermined direction, a time axis is set in a direction orthogonal to the predetermined direction, and a display mode of a position corresponding to each day of the week and each time zone outputs viewing quality information corresponding to information regarding the viewing quality value. **Claim 11** An acquisition means for acquiring the viewing quality value from the storage means that stores the viewing quality value of the viewer for each of the contents reproduced a plurality of times; A viewing quality output device comprising output control means for outputting, in a graph, a change in information regarding the viewing quality value of each of the contents reproduced a plurality of times. **Claim 12** A step of obtaining the viewing quality value from the storage means that stores the viewing quality value of the viewer for each of the contents reproduced a plurality of times; A viewing quality output method comprising a step of outputting, in a graph, a change in information regarding the viewing quality value of each of the contents reproduced a plurality of times.

Images