Content distribution method, content distribution program, and content distribution system

The content distribution system captures viewer reactions during content consumption to assign status flags, improving recommendation accuracy and user engagement by visualizing reactions and enhancing poster motivation.

JP2024168180AInactive Publication Date: 2024-12-05ARROWHEADS CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023084634
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-23
Publication Date
2024-12-05
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing content distribution systems fail to accurately gauge viewer reactions to content, limiting the ability to personalize recommendations and enhance user engagement.

Method used

A content distribution system that includes a viewer terminal with a photographing device to capture viewer reactions during content consumption, determining if the viewer is in a preset target state, and assigning a status flag to the content based on this determination, allowing for real-time notification to viewers and posters.

Benefits of technology

Enables visualization of viewer reactions, improving content recommendation accuracy and enhancing user engagement through personalized content suggestions and increased poster motivation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024168180000001_ABST
    Figure 2024168180000001_ABST
Patent Text Reader

Abstract

To visualize a viewer's reaction to a content.SOLUTION: A content distribution method to be executed by a content distribution system including a viewer terminal and a content distribution device includes: a content distribution step of distributing a content to the viewer terminal; a content display step of displaying the content on a display device of the viewer terminal; a viewer imaging step of imaging the viewer using the viewer terminal's imaging device on the side of the display device during the display of the content; a state determination step of determining whether the viewer imaged by the imaging device is in a previously set object state; and a flag adding step of adding a state flag to the content when it is determined that the viewer is in the object state.SELECTED DRAWING: Figure 16
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a content distribution method, a content distribution program, and a content distribution system. [Background technology]

[0002] In recent years, systems that deliver content such as videos to viewers have been widely used. In these systems, it is common to analyze the content viewed by the viewer and recommend content that matches the viewer's preferences. For example, Cited Document 1 describes a technology that recommends content to a viewer based on the viewer's content viewing history and content information. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2021-149556 A Summary of the Invention [Problem to be solved by the invention]

[0004] The technology described in the cited document 1 does not allow for knowledge of how a viewer responded to the content that the viewer viewed.

[0005] The present invention has been made in consideration of the above problems, and has an object to visualize viewer reactions to content. [Means for solving the problem]

[0006] A content delivery method according to one embodiment is a content delivery method executed by a content delivery system including a viewer terminal and a content delivery device, and includes a content delivery step of delivering content to the viewer terminal, a content display step of displaying the content on a display device of the viewer terminal, a viewer photographing step of photographing the viewer with a photographing device on the display device side of the viewer terminal while the content is being displayed, a status determination step of determining whether the viewer photographed by the photographing device is in a predetermined target state, and a flag assignment step of assigning a status flag to the content if it is determined that the viewer is in the target state. Effect of the Invention

[0007] According to one embodiment, viewer reactions to content can be visualized. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 illustrates an example of a configuration of a content distribution system 1000. [Diagram 2] 1 is a diagram illustrating an example of a hardware configuration of a content distribution device 1. [Diagram 3] 2 is a diagram showing an example of a hardware configuration of a viewer terminal 2. FIG. [Figure 4] FIG. 2 is a diagram illustrating an example of a hardware configuration of a poster terminal 3. [Diagram 5] 1 is a diagram illustrating an example of a functional configuration of a content distribution device 1. FIG. [Figure 6] FIG. 2 is a diagram showing an example of user information 121. [Figure 7] FIG. 2 is a diagram showing an example of content information 122. [Figure 8] 13 is a diagram showing an example of determination result information 124. FIG. [Figure 9] 13 is a diagram showing an example of status flag information 125. FIG. [Figure 10] 2 is a diagram illustrating an example of a functional configuration of a viewer terminal 2. FIG. [Figure 11]FIG. 2 is a diagram illustrating an example of a functional configuration of a poster terminal 3. [Figure 12] 13 is a flowchart showing an example of processing executed by the content distribution system 1000. [Figure 13] FIG. 2 is a diagram showing an example of a content list display screen s1. [Figure 14] FIG. 2 is a diagram showing an example of a content display screen s2. [Figure 15] FIG. 13 is a diagram showing an example of time-series data of evaluation value E. [Figure 16] FIG. 13 is a diagram showing an example of a method for notifying a viewer. [Figure 17] FIG. 13 is a diagram showing an example of a method for notifying a viewer. [Figure 18] FIG. 13 is a diagram showing an example of an analysis result display screen s3. [Figure 19] FIG. 13 is a diagram showing an example of a target state history display screen s4. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, each embodiment of the present invention will be described with reference to the accompanying drawings. In the description of the specification and drawings of each embodiment, components having substantially the same functional configuration are designated by the same reference numerals, and redundant description will be omitted.

[0010] <Overview of Content Distribution System 1000> First, an overview of a content delivery system 1000 according to this embodiment will be described. The content delivery system 1000 is an information processing system that provides a content delivery service that delivers content posted by a contributor to viewers. The content referred to here is, for example, a single image, a series of consecutive images such as a cartoon, or a video, but is not limited to these.

[0011] The content distribution system 1000 determines whether a viewer viewing content is in a target state, and if determined to be in the target state, assigns a status flag to the content and notifies the viewer and contributor of the content that the status flag has been assigned.

[0012] The target state is a preset state of the viewer. The target state is, for example, a facial expression, an emotion, a posture, or a combination thereof. The facial expression is, for example, an emotion expressing surprise, laughter, fear, disgust, contempt, anger, or sadness. The emotion is, for example, an emotion of surprise, laughter, fear, disgust, contempt, anger, or sadness. The posture is, for example, a position and distance from the terminal on which the content is displayed, the straightness of the back, the tilt of the neck, the position of the arms, or a combination thereof. One or more target states may be set.

[0013] The status flag is information indicating whether or not the viewer has been determined to be in a target status when viewing the content. If multiple target statuses are set, a status flag is prepared and assigned for each target status.

[0014] For example, if only a smile (laughing expression) is set as the target state, the content distribution system 1000 determines whether the viewer watching the content is smiling, and if it determines that the viewer is smiling, it assigns a state flag corresponding to a smile to the content and notifies the viewer and the contributor of the content that a state flag corresponding to a smile has been assigned.

[0015] Furthermore, when a smiling face and a surprised face are set as the target state, the content delivery system 1000 determines whether the viewer watching the content is smiling or has a surprised face, respectively. When the content delivery system 1000 determines that the viewer is smiling, it assigns a state flag corresponding to a smiling face to the content, and notifies the viewer and the contributor of the content that the state flag corresponding to a smiling face has been assigned. Similarly, when the content delivery system 1000 determines that the viewer has a surprised face, it assigns a state flag corresponding to a surprised face to the content, and notifies the viewer and the contributor of the content that the state flag corresponding to a surprised face has been assigned.

[0016] Furthermore, when the content delivery system 1000 determines that the viewer has a smile and a surprised expression, it may assign a status flag corresponding to a smile and a status flag corresponding to a surprised expression to the content, and notify the viewer and the contributor of the content that the status flag corresponding to a smile and a status flag corresponding to a surprised expression have been assigned. Furthermore, the content delivery system 1000 may alternatively select one of the target states based on the determination result r of each target state.

[0017] Furthermore, the content delivery system 1000 can recommend new content to the viewer and analyze the viewer's tendency toward content based on the determination result r of the target state. This content delivery system 1000 is used as a video delivery platform or a social networking service (SNS).

[0018] <Configuration of Content Distribution System 1000> Fig. 1 is a diagram showing an example of the configuration of a content delivery system 1000. As shown in Fig. 1, the content delivery system 1000 includes a content delivery device 1, a viewer terminal 2, and a contributor terminal 3, which are communicably connected to each other via a network N. The network N is, for example, a wired LAN (Local Area Network), a wireless LAN, the Internet, a public line network, a mobile data communication network, or a combination of these. In the example of Fig. 1, the content delivery system 1000 includes one each of the content delivery device 1, the viewer terminal 2, and the contributor terminal 3, but may include multiple each.

[0019] The content distribution device 1 is an information processing device that stores content posted by a contributor and distributes the stored content to viewers. The content distribution device 1 also performs notification of the determination result r of the target state, content recommendations, and analysis of viewer trends. The content distribution device 1 is, for example, a PC (Personal Computer), a smartphone, a tablet terminal, a server device, or a microcomputer, but is not limited to these.

[0020] The viewer terminal 2 is an information processing device used by a viewer. The viewer here refers to one of the users of the content distribution system 1000 who views the content distributed from the content distribution device 1.

[0021] The viewer terminal 2 includes a display device 206D that displays content, and an imaging device 205C (so-called in-camera) that images the display device 206D side of the viewer terminal 2. The viewer views the content displayed on the display device 206D. The imaging device 205C images the display device 206D side of the viewer terminal 2 while the content is being displayed by the display device 206D. This images the viewer while viewing the content. The viewer terminal 2 determines whether the viewer is in a target state based on the image of the viewer while viewing the content captured by the imaging device 205C. The viewer terminal 2 is, for example, but is not limited to, a PC, a smartphone, or a tablet terminal.

[0022] The contributor terminal 3 is an information processing device used by a contributor. The contributor here refers to a user of the content distribution system 1000 who contributes content to the content distribution device 1.

[0023] A contributor posts (sends) content saved in the contributor terminal 3 to the content distribution device 1 via the network N. The content distribution device 1 saves the content posted (received) from the contributor terminal 3 and delivers (sends) it to the viewer terminal 2. The content may be created using the contributor terminal 3, or content created on another information processing device may be saved in the contributor terminal 3. The contributor terminal 3 is, for example, but is not limited to, a PC, a smartphone, or a tablet terminal.

[0024] In the above description, the contributor and the viewer are distinguished for convenience, but the user of the content distribution system 1000 may be both a viewer and a contributor at the same time. In this case, one information processing device functions as both the viewer terminal 2 and the contributor terminal 3 at the same time.

[0025] <Hardware Configuration of Content Distribution Device 1> Next, a description will be given of the hardware configuration of the content distribution device 1. Fig. 2 is a diagram showing an example of the hardware configuration of the content distribution device 1. As shown in Fig. 2, the content distribution device 1 includes a processor 101, a memory 102, a storage 103, a communication I / F 104, an input device 105, an output device 106, and a drive device 107, which are connected to each other via a bus B.

[0026] The processor 101 loads into the memory 102 various programs including an OS (Operating System) and a content distribution program stored in the storage 103 and executes them, thereby controlling each component of the content distribution device 1 and realizing the functions of the content distribution device 1. The processor 101 is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), or a DSP (Digital Signal Processor), but is not limited to these.

[0027] The memory 102 is, for example, a Read Only Memory (ROM), a Random Access Memory (RAM), or a combination thereof. The ROM is, for example, a Programmable ROM (PROM), an Erasable Programmable ROM (EPROM), an Electrically Erasable Programmable ROM (EEPROM), or a combination thereof. The RAM is, for example, but is not limited to, a Dynamic RAM (DRAM) or a Static RAM (SRAM).

[0028] The storage 103 stores various programs and data including an OS and a content distribution program. The storage 103 is, for example, a flash memory, a hard disk drive (HDD), a solid state drive (SSD), or a storage class memory (SCM), but is not limited to these.

[0029] The communication I / F 104 is an interface for connecting the content distribution device 1 to an external device via the network N and controlling communication. The communication I / F 104 is, for example, Bluetooth (registered trademark), Wi-Fi (registered trademark), ZigBee (registered trademark), or Ethernet (registered trademark), but is not limited to these.

[0030] The input device 105 is a device for inputting information to the content distribution device 1. The input device 105 is, for example, a mouse, a keyboard, a touch panel, a microphone, a scanner, a photographing device (camera), various sensors, or an operation button, but is not limited to these.

[0031] The output device 106 is a device for outputting information from the content distribution device 1. The output device 106 is, for example, a display device, a projector, a printer, a speaker, or a vibrator, but is not limited to these.

[0032] The drive device 107 is a device that reads and writes data to the recording medium 108. The drive device 107 is, for example, but not limited to, a magnetic disk drive, an optical disk drive, a magneto-optical disk drive, or an SD card reader. The recording medium 108 is, for example, but not limited to, a CD (Compact Disc), a DVD (Digital Versatile Disc), a FD (Floppy Disk), an MO (Magneto-Optical disk), a BD (Blu-ray (registered trademark) Disc), a USB (registered trademark) memory, or an SD card.

[0033] In this embodiment, the content distribution program may be written into memory 102 or storage 103 during the manufacturing stage of the content distribution device 1, or may be provided to the content distribution device 1 via the network N, or may be provided to the content distribution device 1 via a non-transitory computer-readable recording medium such as recording medium 108.

[0034] <Hardware configuration of viewer device 2> Next, a description will be given of the hardware configuration of the viewer terminal 2. Fig. 3 is a diagram showing an example of the hardware configuration of the viewer terminal 2. As shown in Fig. 3, the viewer terminal 2 includes a processor 201, a memory 202, a storage 203, a communication I / F 204, an input device 205, and an output device 206, which are interconnected via a bus B2.

[0035] The processor 201 loads into the memory 202 various programs including an OS and a content distribution program stored in the storage 203 and executes them, thereby controlling each component of the viewer terminal 2 and realizing the functions of the viewer terminal 2. The processor 201 is, for example, a CPU, an MPU, a GPU, an ASIC, or a DSP, but is not limited to these.

[0036] The memory 202 may be, for example, a ROM, a RAM, or a combination thereof. The ROM may be, for example, a PROM, an EPROM, an EEPROM, or a combination thereof. The RAM may be, for example, but is not limited to, a DRAM or an SRAM.

[0037] The storage 203 stores various programs and data including an OS and a content distribution program. The storage 203 is, for example, a flash memory, a HDD, an SSD, or an SCM, but is not limited to these.

[0038] The communication I / F 204 is an interface for connecting the viewer terminal 2 to an external device via the network N and controlling communication. The communication I / F 204 is, for example, Bluetooth (registered trademark), Wi-Fi (registered trademark), ZigBee (registered trademark), or Ethernet (registered trademark), but is not limited to these.

[0039] The input device 205 is a device for inputting information to the viewer terminal 2. The input device 205 is, for example, but not limited to, a mouse, a keyboard, a touch panel, a microphone, a scanner, an image capturing device (camera), various sensors, or an operation button. The viewer terminal 2 includes an image capturing device 205C as the input device 205.

[0040] The output device 206 is a device for outputting information from the viewer terminal 2. The output device 206 is, for example, but is not limited to, a display device (display), a projector, a printer, a speaker, or a vibrator. The viewer terminal 2 includes a display device 206D as the output device 206.

[0041] In this embodiment, the content distribution program may be written into the memory 202 or the storage 203 during the manufacturing stage of the viewer terminal 2, or may be provided to the viewer terminal 2 via the network N.

[0042] <Hardware configuration of poster terminal 3> Next, a description will be given of the hardware configuration of the poster terminal 3. Fig. 4 is a diagram showing an example of the hardware configuration of the poster terminal 3. As shown in Fig. 4, the poster terminal 3 includes a processor 301, a memory 302, a storage 303, a communication I / F 304, an input device 305, and an output device 306, which are connected to each other via a bus B3.

[0043] Processor 301 loads into memory 302 various programs including an OS and a content distribution program stored in storage 303 and executes them to control each component of poster terminal 3 and realize the functions of poster terminal 3. Processor 301 is, for example, a CPU, MPU, GPU, ASIC, or DSP, but is not limited to these.

[0044] The memory 302 may be, for example, a ROM, a RAM, or a combination thereof. The ROM may be, for example, a PROM, an EPROM, an EEPROM, or a combination thereof. The RAM may be, for example, but is not limited to, a DRAM or an SRAM.

[0045] The storage 303 stores various programs and data including an OS and a content distribution program. The storage 303 is, for example, a flash memory, a HDD, an SSD, or an SCM, but is not limited to these.

[0046] The communication I / F 304 is an interface for connecting the poster terminal 3 to an external device via the network N and controlling communication. The communication I / F 304 is, for example, Bluetooth (registered trademark), Wi-Fi (registered trademark), ZigBee (registered trademark), or Ethernet (registered trademark), but is not limited to these.

[0047] The input device 305 is a device for inputting information to the poster terminal 3. The input device 305 is, for example, but is not limited to, a mouse, a keyboard, a touch panel, a microphone, a scanner, an image capturing device (camera), various sensors, or an operation button. The poster terminal 3 is equipped with an image capturing device 305C as the input device 305.

[0048] The output device 306 is a device for outputting information from the poster terminal 3. The output device 306 is, for example, a display device, a projector, a printer, a speaker, or a vibrator, but is not limited to these.

[0049] In this embodiment, the content distribution program may be written into memory 302 or storage 303 during the manufacturing stage of the contributor terminal 3, or may be provided to the contributor terminal 3 via the network N.

[0050] <Functional configuration of content distribution device 1> Next, a description will be given of a functional configuration of the content distribution device 1. Fig. 5 is a diagram showing an example of the functional configuration of the content distribution device 1. As shown in Fig. 5, the content distribution device 1 includes a communication unit 11, a storage unit 12, and a control unit 13.

[0051] The communication unit 11 is realized by the communication I / F 104. The communication unit 11 transmits and receives information to and from an external device via the network N. The communication unit 11 distributes content to, for example, the viewer terminal 2. In addition, the communication unit 11 receives content from, for example, the contributor terminal 3.

[0052] The storage unit 12 is realized by the memory 102 and the storage 103. The storage unit 12 stores therein user information 121, content information 122, content data 123, judgment result information 124, status flag information 125, and analysis result information 126.

[0053] The user information 121 is information relating to users (viewers and contributors) of the content distribution system 1000. The user information 121 is stored for each user.

[0054] Fig. 6 is a diagram showing an example of the user information 121. The user information 121 in Fig. 6 includes information items such as "UID", "name", "attributes", "viewing history", and "posting history".

[0055] "UID" is identification information that uniquely identifies a user. In the example of Fig. 6, "UID" is U001. Hereinafter, a user, a viewer, and a poster whose "UID" is UXXX will be referred to as user XXX, viewer XXX, and poster XXX, respectively.

[0056] "Name" is information indicating the name of the user. In the example of Fig. 6, "Name" is N1.

[0057] "Attribute" is information indicating the attribute of a user. The attribute is, for example, age, sex, date of birth, address, email address, or telephone number, but is not limited to these. In the example of FIG. 6, the "attribute" is F1.

[0058] "Viewing history" is information indicating the history of content viewed by a user. "Viewing history" includes "viewing date and time" and "CID". "Viewing date and time" is information indicating the date and time when the user viewed the content. "CID" is identification information that uniquely identifies the content viewed by the user. In the example of FIG. 6, the "viewing date and time" are T1, T2, and T3, and the "CID" is C001, C002, and C005. This indicates that user 001 viewed content with "CID" of C001, C002, and C005 at dates and times T1, T2, and T3, respectively. Hereinafter, content with "CID" CXXX will be referred to as content XXX.

[0059] "Posting history" is information indicating the history of content posted by a user. "Posting history" includes "posting date and time" and "CID." "Posting date and time" is information indicating the date and time when a user posted content. "CID" is identification information that uniquely identifies content posted by a user. In the example of FIG. 6, the "posting date and time" is T4 and the "CID" is C002. This indicates that user 001 posted content 002 at date and time T4.

[0060] It should be noted that the user information 121 is not limited to the example in Fig. 6. The user information 121 may not include some of the above information items, and may include information items other than those described above.

[0061] The content information 122 is information related to the content distributed by the content distribution system 1000. The content information 122 is stored for each piece of content.

[0062] Fig. 7 is a diagram showing an example of the content information 122. The content information 122 in Fig. 7 includes information items such as "CID", "name", "attribute", "image", "distribution history", and "posting history".

[0063] "CID" is identification information that uniquely identifies a content. In the example of Fig. 7, "CID" is C002.

[0064] "Name" is information indicating the name of the content. In the example of FIG. 6, the "Name" is N2.

[0065] "Attribute" is information indicating the attribute of the content. The attribute is, for example, a content type (music, image, video, etc.), a genre (news, drama, comedy, movie, etc.), a hashtag, a data format, or a data size, but is not limited to these. In the example of FIG. 7, the "attribute" is F2.

[0066] "Image" is data of a thumbnail image of the content. In the example of Fig. 7, "Image" is P2.

[0067] "Distribution history" is information indicating the history of content distribution by the content distribution device 1. "Distribution history" includes "distribution date and time" and "UID". "Distribution date and time" is information indicating the date and time when the content distribution device 1 distributed the content. "UID" is identification information that uniquely identifies the user to whom the content distribution device 1 distributed the content. In the example of Figure 7, the "distribution date and time" are T2, T6, and T7, and the "UID" are U001, U004, and U005. This indicates that the content distribution device 1 distributed content 002 to viewers 001, 004, and 005 at dates and times T2, T6, and T7, respectively.

[0068] "Posting history" is information indicating the history of content posted by a user. "Posting history" includes "posting date and time" and "UID." "Posting date and time" is information indicating the date and time when a user posted content. "UID" is identification information that uniquely identifies the user who posted the content. In the example of Figure 7, the "posting date and time" is T4 and the "UID" is U001. This indicates that user 001 posted content 002 at date and time T4.

[0069] It should be noted that the content information 122 is not limited to the example in Fig. 7. The content information 122 may not include some of the above information items, and may include information items other than those described above.

[0070] The content data 123 is data on the content itself. The content data 123 is stored in association with the content information 122.

[0071] The determination result information 124 is information related to the determination result r as to whether the viewer is in the target state. The determination result information 124 is stored for each viewer and for each content.

[0072] Fig. 8 is information showing an example of the determination result information 124. In the example of Fig. 8, determination results r1 to r9 are shown when the viewers 001, 002, and 003 viewed the contents 001, 002, and 003. The determination result r will be described in detail later.

[0073] The status flag information 125 is information related to the status flag. The status flag information 125 is stored for each viewer and for each content.

[0074] FIG. 9 is information showing an example of the status flag information 125. In the example of FIG. 9, the status flags when viewers 001, 002, and 003 viewed the contents 001, 002, and 003 are shown. "Y" in FIG. 9 indicates that the status flag was assigned (the user was determined to be in the target state), "N" indicates that the status flag was not assigned (the user was not determined to be in the target state), and "-" indicates that the user is not viewing the content. In the example of FIG. 9, it is shown that the viewer 001 was determined to be in the target state (e.g., smiling) when viewing the content 001, was not determined to be in the target state when viewing the content 002, and did not view the content 003.

[0075] The analysis result information 126 is information that indicates the tendency of the viewer to view content. The analysis result information 126 is stored for each viewer. The analysis result information 126 will be described in detail later.

[0076] The control unit 13 is realized by the processor 101 reading and executing a program from the memory 102 and cooperating with other hardware configurations. The control unit 13 controls the overall operation of the content distribution device 1. The control unit 13 includes an information acquisition unit 131, a content recommendation unit 132, a content distribution unit 133, a status flag assignment unit 134, a flag notification unit 135, and a trend analysis unit 136.

[0077] The information acquisition unit 131 acquires information from an external device via the communication unit 11. The information acquisition unit 131 acquires content from the poster terminal 3, for example.

[0078] The content recommendation unit 132 recommends content to the viewer based on the judgment result r of the target state of the viewer when the viewer viewed the content. The content recommendation method will be described in detail later.

[0079] The content delivery unit 133 delivers content to the viewer. More specifically, the content delivery unit 133 delivers content to the viewer terminal 2 in response to a content delivery request transmitted from the viewer terminal 2 in response to an operation by the viewer.

[0080] The status flag assigning unit 134 assigns a status flag to the content based on the determination result r of the target state. Specifically, if the viewer is determined to be in the target state, the status flag assigning unit 134 assigns a status flag to the content, and if the viewer is not determined to be in the target state, the status flag assigning unit 134 does not assign a status flag to the content.

[0081] The flag notification unit 135 notifies the viewer and contributor of the content that a status flag has been added to the content.

[0082] The tendency analysis unit 136 analyzes the tendency of the viewer with respect to the content based on the judgment result r of the target state. The method of analyzing the tendency will be described in detail later.

[0083] The functional configuration of the content distribution device 1 is not limited to the above example. For example, the content distribution device 1 may have part of the functional configuration described above, and the viewer terminal 2 may have the rest. The content distribution device 1 may also have functional configurations other than those described above. Each functional configuration of the content distribution device 1 may be realized by software as described above, or may be realized by hardware such as an IC chip, a SoC (System on Chip), an LSI (Large Scale Integration), a microcomputer, etc.

[0084] <Functional configuration of viewer terminal 2> Next, a description will be given of the functional configuration of the viewer terminal 2. Fig. 10 is a diagram showing an example of the functional configuration of the viewer terminal 2. As shown in Fig. 10, the viewer terminal 2 includes a communication unit 21, a storage unit 22, and a control unit 23.

[0085] The communication unit 21 is realized by the communication I / F 204. The communication unit 21 transmits and receives information to and from an external device via the network N. The communication unit 21 receives content from the content distribution device 1, for example.

[0086] The storage unit 22 is realized by a memory 202 and a storage 203. The storage unit 22 stores therein user information 221, content information 222, content data 223, video data 224, and analysis result information 225.

[0087] User information 221 is user information about the viewer himself / herself. Since the user information is as described above, a description thereof will be omitted.

[0088] The content information 222 is content information on the content distributed or recommended from the content distribution device 1. The content information is as described above, and therefore a description thereof will be omitted. Note that the content information 222 does not necessarily have to include the "distribution history" and the "posting history".

[0089] The content data 223 is data of the content itself distributed from the content distribution device 1.

[0090] The video data 224 is video data captured by the camera 205C of the viewer terminal 2.

[0091] The analysis result information 225 is information that indicates the viewer's tendency toward the content. The analysis result information 225 will be described in detail later.

[0092] The control unit 23 is realized by the processor 201 reading and executing a program from the memory 202 and working in cooperation with other hardware configurations. The control unit 23 controls the overall operation of the viewer terminal 2. The control unit 23 includes an information acquisition unit 231, a display control unit 232, a viewer shooting unit 233, a state determination unit 234, and a viewer notification unit 235.

[0093] The information acquisition unit 231 acquires information from an external device via the communication unit 21. The information acquisition unit 231 acquires, for example, from the content distribution device 1, content and a notification of the addition of a status flag.

[0094] The display control unit 232 controls the image displayed on the display device 206D. The display control unit 232, for example, causes the display device 206D to display content.

[0095] Viewer photographing section 233 activates photographing device 205C while the content is being displayed, and photographs the viewer viewing the content.

[0096] The state determination unit 234 determines whether the viewer is in a target state based on the video data 224 of the viewer captured by the imaging device 205C while the content is being displayed.

[0097] When it is determined that the viewer of the content is in the target state and a state flag is assigned to the content viewed by the viewer, the viewer notification unit 235 notifies the viewer that a state flag has been assigned.

[0098] The functional configuration of the viewer terminal 2 is not limited to the above example. For example, the viewer terminal 2 may have some of the functional configurations described above, and the content distribution device 1 may have the rest. The viewer terminal 2 may also have functional configurations other than those described above. Each functional configuration of the viewer terminal 2 may be realized by software as described above, or may be realized by hardware such as an IC chip, SoC, LSI, or microcomputer.

[0099] <Functional configuration of contributor terminal 3> Next, a description will be given of the functional configuration of the poster terminal 3. Fig. 11 is a diagram showing an example of the functional configuration of the poster terminal 3. As shown in Fig. 11, the poster terminal 3 includes a communication unit 31, a storage unit 32, and a control unit 33.

[0100] The communication unit 31 is realized by the communication I / F 304. The communication unit 31 transmits and receives information to and from an external device via the network N. The communication unit 31 posts content to the content distribution device 1, for example.

[0101] The storage unit 32 is realized by a memory 302 and a storage 303. The storage unit 32 stores user information 321, content information 322, and content data 323.

[0102] User information 321 is user information about the poster himself / herself. The user information is as described above, so a detailed explanation is omitted here.

[0103] The content information 322 is content information on the content posted to the content distribution device 1. The content information is as described above, and therefore a detailed description will be omitted. Note that the content information 322 does not necessarily have to include the "CID", "distribution history", and "posting history".

[0104] The content data 323 is data of the content itself to be posted to the content distribution device 1.

[0105] The control unit 33 is realized by the processor 301 reading and executing a program from the memory 302 and working in cooperation with other hardware configurations. The control unit 33 controls the overall operation of the poster terminal 3. The control unit 33 includes an information acquisition unit 331, a display control unit 332, and a poster notification unit 333.

[0106] The information acquisition unit 331 acquires information from an external device via the communication unit 31. The information acquisition unit 331 acquires, for example, from the content distribution device 1 a notification that a status flag has been assigned.

[0107] The display control unit 332 controls the image displayed on the display device 306D. The display control unit 332, for example, causes the display device 306D to display content.

[0108] When it is determined that the viewer of the content is in the target state and a state flag is assigned to the content viewed by the viewer, the contributor notification unit 333 notifies the contributor of the content that the state flag has been assigned.

[0109] The functional configuration of the poster terminal 3 is not limited to the above example. For example, the poster terminal 3 may have some of the functional configuration described above, and the content distribution device 1 may have the rest. The poster terminal 3 may also have functional configurations other than those described above. Each functional configuration of the poster terminal 3 may be realized by software as described above, or may be realized by hardware such as an IC chip, SoC, LSI, or microcomputer.

[0110] <Processing Executed by Content Distribution System 1000> Next, a description will be given of a process executed by the content delivery system 1000. Fig. 12 is a flowchart showing an example of a process executed by the content delivery system 1000. In the following, a case will be described in which the target state is a smile, and a viewer 001 views a content 001 posted by a contributor 002.

[0111] (Step S101) First, the contributor 002 posts the content 001 from the contributor terminal 3 to the content distribution device 1 (step S101). Specifically, the contributor terminal 3 transmits user information 321, content information 322 of the content 001, and content data 323 to the content distribution device 1 in response to an operation of the contributor 002.

[0112] (Step S102) When the content distribution device 1 accepts the posting of the content 001 from the contributor terminal 3, it stores the posted content 001 (step S102). Specifically, the information acquisition unit 131 of the content distribution device 1 associates the content information 322 and the content data 323 received from the contributor terminal 3, and stores them in the storage unit 12 as the content information 122 and the content data 123. At this time, the "CID" and "posting history" are added to the content information 122.

[0113] A large number of contributors post content, and the processes of steps S101 and S102 are repeated, whereby a large number of deliverable contents are accumulated in the content delivery device 1.

[0114] (Step S103) The information acquisition unit 231 of the viewer terminal 2 of the viewer 001 requests a list of contents from the content distribution device 1 in response to an operation from the viewer 001 (step S103).

[0115] (Step S104) When a list of contents is requested from the viewer terminal 2, the content recommendation unit 132 of the content distribution device 1 selects a plurality of contents to be recommended to the viewer 001 (step S104). The method of selecting the contents to be recommended will be described in detail later.

[0116] (Step S105) Then, the content recommendation unit 132 transmits the content information 122 of the selected multiple pieces of content to the viewer terminal 2, and recommends the content to the viewer 001 (step S105).

[0117] (Step S106) When the information acquisition unit 231 of the viewer terminal 2 of the viewer 001 acquires the content information 122 from the content distribution device 1, it stores it in the storage unit 22 as content information 222. When the content information 222 is stored, the display control unit 232 refers to the stored content information 222 and displays a list of recommended contents on the display device 206D (step S106).

[0118] Fig. 13 is a diagram showing an example of a content list display screen s1. The content list display screen s1 is a screen for displaying a list of contents recommended by the content distribution device 1, and is displayed on the display device 206D. The content list display screen s1 in Fig. 13 displays the number of followed people s11, the number of followers s12, the number of smiles s13, and a thumbnail image s14.

[0119] The following count s11 is the number of users the viewer 001 is following. The follower count s12 is the number of users who are following the viewer 001. The smile count s13 is the number of status flags assigned to the content posted by the viewer 001. The thumbnail image s14 is a thumbnail image of the recommended content. In the example of FIG. 13, thumbnail images 14 of nine contents are displayed.

[0120] (Step S107) The information acquisition unit 131 requests the content distribution device 1 to distribute the content 001 in response to an operation by the viewer 001 (step S107). In the example of Fig. 13, when the viewer 001 selects the thumbnail image s14 of the content 001, distribution of the content 001 is requested.

[0121] (Step S108) When the content distribution unit 133 is requested to distribute the content 001, it reads the content data 123 of the content 001 from the storage unit 12, and distributes the content data 123 of the content 001 to the viewer terminal 2 (step S108).

[0122] (Step S109) When the information acquisition unit 231 of the viewer terminal 2 acquires the content data 123 of the content 001 from the content distribution device 1, it stores it as content data 223 in the storage unit 22. When the content data 223 is stored, the display control unit 232 displays the stored content data 223 of the content 001 on the display device 206D (step S109).

[0123] Fig. 14 is a diagram showing an example of the content display screen s2. The content display screen s2 is a screen for displaying (playing) content, and is displayed on the display device 206D. The content display screen s2 in Fig. 14 displays content s21, a shooting button s22, the number of smiles s23, and poster information s24.

[0124] The content s21 is the content 001 distributed from the content distribution device 1. The photographing button s22 is a button for the viewer 001 to switch photographing by the photographing device 205C on / off. When the photographing button s22 is on, photographing is performed by the photographing device 205C, and when the photographing button s22 is off, photographing is not performed by the photographing device 205C. In the example of FIG. 14, photographing is set to on. The number of smiles s23 is the number of status flags assigned to the displayed content 001. The poster information s24 is information about the poster 002 of the displayed content 001. In the example of FIG. 14, an image and name of the poster 002 are displayed as the poster information s24.

[0125] (Step S110) When the content 001 is displayed, the viewer photographing unit 233 starts the photographing device 205C and photographs the viewer 001 who is watching the content 001 (step S110). Data of the moving image photographed by the photographing device 205C is sequentially stored in the storage unit 22 as the moving image data 224. The viewer photographing unit 233 continues photographing the viewer 001 until the display of the content 001 ends or the viewer 001 sets the photographing button s22 to OFF.

[0126] (Step S111) When the video data 224 is saved in the storage unit 22, the state determination unit 234 determines whether the viewer 001 is smiling (target state) based on the video data 224. Specifically, the state determination unit 234 first executes face detection processing on the video data 224, and if a face is detected, executes expression determination processing on the detected face and calculates a smile evaluation value E (step S111). The state determination unit 234 continues calculating the evaluation value E until the display of the content 001 ends or the viewer 001 sets the capture button s22 to off. Therefore, by step S111, time-series data of the smile evaluation value E is generated while the content 001 is being displayed.

[0127] The state determination unit 234 may execute face detection processing for all frames of the video data 224, or may execute face detection processing at a predetermined frame interval. The face detection processing is, for example, an inference processing using a trained face detection model, but is not limited to this. Also, the facial expression estimation processing is, for example, an inference processing using a trained facial expression estimation model, but is not limited to this.

[0128] The evaluation value E of the smile (target state) is a value indicating the degree of the smile (target state) determined by the facial expression estimation process. When the facial expression estimation process is an inference process using a trained facial expression estimation model, the evaluation value E is obtained, for example, as the output of the facial expression estimation model.

[0129] Fig. 15 is a diagram showing an example of time-series data of evaluation value E. In the example of Fig. 15, evaluation value E is a value between 0 and 1, and the closer to 1 the value is, the higher the degree of smiling. When video data 224 is at 30 fps and an evaluation value is calculated every 10 frames, Fig. 15 corresponds to the time-series data of evaluation value E when content 001 is displayed for 4 seconds.

[0130] The calculation interval, range and magnitude relationship of the evaluation value E are not limited to the above examples. The evaluation value E may be calculated by a calculation method according to the target state. For example, when the target state is a facial expression, the evaluation value E may be calculated by a facial expression estimation process. When the target state is an emotion, the evaluation value E may be calculated by an emotion estimation process. When the target state is a posture, the posture of the viewer may be estimated by a posture estimation process, and the closeness between the estimated posture and the posture set as the target state may be calculated as the evaluation value E. The evaluation value E may be calculated by a combination of one or more of the facial expression estimation process, the emotion estimation process and the posture estimation process.

[0131] (Step S112) Next, the state determination unit 234 determines whether the viewer 001 is smiling (target state) based on the calculated evaluation value E (step S112). The state determination unit 234 may perform the determination in real time while the content 001 is being displayed, or may perform the determination after the display of the content 001 has ended.

[0132] First, a method for making a determination in real time will be described.

[0133] [Judgment method 1] For example, when the evaluation value E becomes equal to or greater than a threshold, the state determination unit 234 determines that the viewer 001 is smiling. In the example of Fig. 15, the threshold is set to 0.7. In this case, the state determination unit 234 may determine that the viewer 001 is smiling every time the evaluation value E becomes equal to or greater than the threshold while the content 001 is being displayed, or may end the determination when the evaluation value E becomes equal to or greater than the threshold once and it is determined that the viewer 001 is smiling.

[0134] [Judgment method 2] The state determination unit 234 may determine that the viewer 001 is smiling when the evaluation value E is equal to or greater than a threshold value for a predetermined period of time. If the predetermined period is a period during which the evaluation value E is calculated twice, the state determination unit 234 determines that the viewer 001 is smiling at the display time t8 in FIG.

[0135] [Judgment method 3] The state determination unit 234 may determine that the viewer 001 is smiling when the moving average of the evaluation value E for a predetermined period of time is equal to or greater than a threshold value. If the predetermined period is a period during which the evaluation value E is calculated three times, the state determination unit 234 determines that the viewer 001 is smiling at the display time t8 in FIG.

[0136] [Judgment method 4] The state determination unit 234 may determine that the viewer 001 is smiling when the rate of change in the evaluation value E is equal to or greater than a threshold value.

[0137] [Judgment method 5] The state determination unit 234 may determine whether the viewer 001 is smiling by combining one or more of the above determination methods 1 to 4. For example, the state determination unit 234 may determine that the viewer 001 is smiling when the evaluation value E is equal to or greater than a threshold and the rate of change in the evaluation value E is also equal to or greater than a threshold.

[0138] Next, a method for making a determination after the end of displaying the content will be described.

[0139] [Judgment method 6] For example, when the evaluation value E is equal to or greater than a threshold value a predetermined number of times, the state determination unit 234 determines that the viewer 001 is smiling. When the predetermined number of times is two, in the example of Fig. 15, the viewer 001 is determined to be smiling. Note that the evaluation values ​​E that are equal to or greater than the threshold value do not have to be consecutive.

[0140] [Judgment method 7] When the evaluation value E is equal to or greater than the threshold value for a predetermined period of time or more, the state determination unit 234 determines that the viewer 001 is smiling. When the predetermined period is a period during which the evaluation value E is calculated twice, in the example of FIG. 15, the viewer 001 is determined to be smiling.

[0141] [Judgment method 8] The state determination unit 234 may determine that the viewer 001 is smiling when the moving average of the evaluation value E for a predetermined period of time is equal to or greater than a threshold value. When the predetermined period is a period during which the evaluation value E is calculated three times, in the example of FIG. 15, the viewer 001 is determined to be smiling.

[0142] [Judgment method 9] The state determination unit 234 may determine that the viewer 001 is smiling when the average value of the evaluation values ​​E during the display of the content 001 is equal to or greater than a threshold value. In this case, in the example of Fig. 15, it is determined that the viewer 001 is not smiling.

[0143] [Judgment method 10] The state determination unit 234 may determine that the viewer 001 is smiling when the rate of change in the evaluation value E is equal to or greater than a threshold value.

[0144] [Judgment method 11] The state determination unit 234 may determine whether the viewer 001 is smiling by combining one or more of the above determination methods 6 to 10. For example, the state determination unit 234 may determine that the viewer 001 is smiling when the evaluation value E becomes equal to or greater than a threshold value a predetermined number of times or more, and the rate of change in the evaluation value E also becomes equal to or greater than a threshold value.

[0145] The determination method is not limited to the above example. In addition, for the thresholds of the evaluation value E, the rate of change, the number of times, the period, etc., a common threshold may be set in advance among users, or a different value may be set for each viewer.

[0146] (Step S113) When the state determination unit 234 determines whether the viewer 001 is smiling, the state determination unit 234 transmits the determination result r to the content distribution device 1 in association with the user information 221 and the content information 222 of the content 001 being displayed (step S113). The determination result r includes information indicating whether the viewer 001 is smiling. The determination result r may also include an evaluation value E. More specifically, the determination result r may include the evaluation value E on which the determination was based, or may include the maximum value, moving average, and rate of change of the evaluation value E, or may include all of the time-series data of the evaluation value E. When the information acquisition unit 131 of the content distribution device 1 acquires the determination result r, the information acquisition unit 131 stores the acquired determination result r in the storage unit 12 as the determination result information 124 (determination result r1 in FIG. 8) of the viewer 001 of the content 001.

[0147] (Step S114) When the determination result r1 is saved, the status flag assignment unit 134 checks whether the viewer 001 is determined to be smiling by referring to the determination result r1 (step S114). If the viewer 001 is determined to be smiling (step S114: YES), the process proceeds to step S115. If the viewer 001 is determined to be not smiling (step S114: NO), the process proceeds to step S120.

[0148] (Step S115) If it is determined that the viewer 001 is smiling, the status flag assigning unit 134 assigns a status flag to the content 001 (step S115). Specifically, the status flag assigning unit 134 sets the value of the viewer 001 of the content 001 in FIG. 9 to “Y”.

[0149] In step S115, the reaction of the viewer 001 to the content 001 can be visualized on the content distribution system 1000. This allows the content distribution system 1000 to provide various services (such as content recommendations and analysis of viewer trends) that take into account the viewer's reaction to the content.

[0150] (Step S116) When the status flag is added to the content 001, the flag notification unit 135 transmits a status flag addition notification to the viewer terminal 2 of the viewer 001, and notifies the viewer 001 that a status flag has been added to the content 001 (step S116).

[0151] (Step S117) When the viewer notification unit 235 of the viewer terminal 2 of the viewer 001 receives the status flag assignment notification from the content distribution device 1, it notifies the viewer 001 that a status flag has been assigned to the content 001 (step S117). The notification to the viewer 001 may be performed by push notification, by vibration of the viewer terminal 2, or by increasing the number of smiles s23 of the content 001 together with a predetermined effect. In addition, when the status flag is assigned in real time while the content 001 is being displayed, the notification to the viewer 001 may be performed by displaying a predetermined effect on the content display screen s2 displaying the content 001.

[0152] Fig. 16 is a diagram showing an example of a method of notifying a viewer. In the example of Fig. 16, an image s25 indicating that a status flag has been added is overlaid on the entire content display screen s2 displaying the content 001. By performing such an effect for a predetermined period (for example, one second), the viewer notifying unit 235 can notify the viewer 001 that a status flag has been added to the content 001.

[0153] Fig. 17 is a diagram showing an example of a method of notifying a viewer. In the example of Fig. 17, an icon s26 indicating that the viewer 001 has been determined to be in a target state is displayed in a corner of the content display screen s2 displaying the content 001. By displaying such an icon s26, the viewer notification unit 235 can notify the viewer 001 that a status flag has been assigned to the content 001.

[0154] Also, depending on the determination result in step S112, the viewer notification unit 235 can notify the state of the viewer 001 in real time by switching between an icon (a smiling icon in the example of FIG. 17) s26 indicating that the viewer has been determined to be in the target state and an icon (for example, a blank expression icon) indicating that the viewer has not been determined to be in the target state. When multiple target states are set, the icon corresponding to each target state can be switched and displayed depending on the determination result of the target state.

[0155] Steps S116 and S117 make it possible to visualize the viewer 001's reaction to the content 001. This allows the viewer 001, who is unaware of his or her reaction to the content 001, to become aware of his or her reaction. In addition, it is possible to provide the viewer 001 with the experience of seeing his or her own unconscious reaction reflected in the content, thereby improving the entertainment value of the content distribution service.

[0156] The notification that a status flag has been assigned to the content 001 may also be sent to viewers other than the viewer 001 who is viewing the content 001. An example of such a viewer is a forwarder. A forwarder is a viewer who forwards (shares) the content 001 that he or she has viewed to another viewer. For example, if the viewer 001 who viewed the content 001 forwards the content 001 to a friend, viewer 003, the viewer 001 becomes the forwarder of the content 001. In this case, when the viewer 003 assigns a status flag to the content 001, the viewer 001 who is the forwarder is notified of this fact.

[0157] This configuration allows users to have the experience of transferring (sharing) their favorite content among viewers and sharing each other's reactions to the transferred content, thereby improving the entertainment value of the content distribution service.

[0158] Notification to viewers other than viewer 001 may be performed by push notification, by vibration of the viewer terminal, or by increasing the number of smiles s23 of content 001 along with a specified effect.

[0159] (Step S118) On the other hand, when the status flag is added to the content 001, the flag notification unit 135 transmits a status flag addition notification to the contributor terminal 3 of the contributor 002, notifying the contributor 002 that a status flag has been added to the content 001 (step S118).

[0160] (Step S119) When the contributor notification unit 333 of the contributor terminal 3 of the contributor 002 receives the status flag assignment notification from the content distribution device 1, the contributor notification unit 333 notifies the contributor 002 that a status flag has been assigned to the content 001 (step S119). The notification to the contributor 002 may be performed by a push notification, by vibration of the contributor terminal 3, or by increasing the number of smiling faces of the content 001 together with a predetermined effect.

[0161] Steps S118 and S119 make it possible for the contributor 002 to visualize the reactions of the viewers 001 to the content 001. This can improve the motivation of the contributor 002 to post content. In addition, the contributor 002 can be provided with the experience of seeing the unconscious reactions of the viewers reflected in his / her content 001, thereby improving the entertainment value of the content distribution service.

[0162] (Step S120) The viewer 001 can request the analysis result of his / her tendency toward content at any timing (step S120). The information acquisition unit 231 of the viewer terminal 2 of the viewer 001 requests the analysis result from the content distribution device 1 in response to the operation of the viewer 001.

[0163] (Step S121) The tendency analysis unit 136 of the content distribution device 1 that has received the analysis result analyzes the tendency of the viewer 001 with respect to the content based on the determination result r of the target state (step S121). The tendency analysis unit 136 stores the analysis result in the storage unit 12 as the analysis result information 126. Here, an example of the analysis method will be described.

[0164] The determination result r included in the determination result information 124 is expressed by the following matrix R.

[0165]

number

[0166] n is the number of users, and m is the number of contents. r may be a value of 0 or 1 indicating whether or not it has been determined to be a smile, or may be an evaluation value of 1 or multiple values.

[0167] The trend analysis unit 136 decomposes this matrix R into the following matrices using a method such as matrix decomposition.

[0168]

number

[0169]

number

[0170] The matrix U corresponds to a k-dimensional vector representing the judgment results of the target states of n viewers. The matrix C corresponds to a k-dimensional vector representing the judgment results of the target states of m pieces of content. k is a natural number that can be set arbitrarily, and R=U×C holds.

[0171] In this case, each value of the k dimensions corresponds to a feature related to the target state and the content. For example, if the target state is a smile, each value corresponds to a feature corresponding to an "attribute of laughter." In other words, each row of the matrix U is a viewer vector indicating the degree to which each viewer smiled in response to k types of "attributes of laughter" (humor preferences). Each column of the matrix C is a content vector indicating the degree to which each content contains k types of "attributes of laughter" (humor genre).

[0172] Therefore, by setting the attributes of the k-dimensional target state in advance, the tendency analysis unit 136 can analyze the tendency of each viewer and each piece of content regarding the target state based on the determination result r.

[0173] (Step S122) When the analysis of the tendency of the viewer 001 is completed, the tendency analysis unit 136 transmits the obtained analysis result to the viewer terminal 2 of the viewer 001 (step S122). The analysis result is, for example, a viewer vector of the viewer 001, but is not limited to this. For example, the analysis result may include information on the content for which the smile evaluation value of the viewer 001 is the highest, or may include information on the content for which the smile evaluation value of the viewer 001 is equal to or higher than a threshold. The analysis of the viewer tendency may be performed in advance and stored in the storage unit 12 as the analysis result information 126.

[0174] (Step S123) When the information acquisition unit 231 of the viewer terminal 2 of the viewer 001 receives the analysis result from the content distribution device 1, the information acquisition unit 231 stores the received analysis result in the storage unit 22 as analysis result information 225. Then, the display control unit 232 displays the stored analysis result on the display device 206D.

[0175] Fig. 18 is a diagram showing an example of an analysis result display screen s3. In the example of Fig. 18, the tendency of viewer 001 with respect to six types of "laughter attributes", namely "surreal", "chaos", "erotic", "dark humor", "relaxing" and "intelligent", is shown in a radar chart as an analysis result s31 (six-dimensional viewer vector). According to Fig. 18, it can be seen that viewer 001 is likely to smile at "surreal" content.

[0176] In this way, by displaying the analysis results of content tendencies, the viewer 001 can be informed of his / her own tendencies objectively. Furthermore, by making it possible to share the analysis results with other users, the entertainment value of the content distribution service can be improved.

[0177] In this embodiment, the tendency of the viewers toward the content is analyzed and displayed, but a similar analysis may be performed for each content and displayed. For example, the content vector may be displayed in a radar chart for a preset "attribute of laughter."

[0178] Furthermore, the display control unit 232 may display, on the viewer terminal 2, the history in which the viewer 001 was determined to be in the target state as time-series data.

[0179] Fig. 19 is a diagram showing an example of the target state history display screen s4. In the example of Fig. 19, the number of times that the viewer 001 was determined to be in the target state in one day is displayed for one week as the target state history s41. The number of times that the viewer 001 was determined to be in the target state can be tallied for any period, such as one hour, one day, or one week. In addition, the period for displaying the target state can be set arbitrarily, such as one day, one week, or one month.

[0180] In this way, by displaying the history of the target state, the viewer 001 can objectively know to what extent he or she has been in the target state. Furthermore, when the number of times of the target state determined in a certain period of time falls below a threshold value, the viewer notification unit 235 may notify the viewer 001 to that effect.

[0181] <How to recommend content> Finally, a method for recommending content to viewers by the content recommendation unit 132 will be described in detail.

[0182] [Recommendation method 1] The content recommendation unit 132 generates a ranking model that learns the above-mentioned viewer vectors and content vectors so as to minimize the list-wise loss, generates a ranking of contents for each viewer using this ranking model, and recommends the top-ranked contents to the viewer. This allows the content recommendation unit 132 to recommend contents to the viewer, taking into account the viewer's humor preferences.

[0183] [Recommendation method 2] The content recommendation unit 132 may cluster the viewer vectors to generate groups of viewers with similar humor preferences, create a ranking of popular content for each group, and recommend the top-ranked content to the viewers. This allows the content recommendation unit 132 to recommend content to the viewers, taking into account the humor preferences of the viewers in each group.

[0184] [Recommendation method 3] The content recommendation unit 132 may recommend content to a viewer by using both the above recommendation methods 1 and 2. This makes it possible to recommend content to a viewer while taking into consideration the humorous preferences of each individual and group.

[0185] <Summary> As described above, according to the present embodiment, a content delivery method is provided which is executed by a content delivery system 1000 including a viewer terminal 2 and a content delivery device 1, and includes step S108 of delivering content to the viewer terminal 2, step S109 of displaying the content on the display device 206D of the viewer terminal 2, step S110 of photographing the viewer with the image capture device 205C on the display device side of the viewer terminal 2 while the content is being displayed, step S112 of determining whether the viewer photographed by the image capture device 205C is in a preset target state (e.g., smiling), and step S115 of assigning a state flag to the content if it is determined that the viewer is in the target state (step S114: YES). Also provided is a content delivery program and a content delivery system 1000 which executes this content delivery method.

[0186] According to this content distribution method, the viewer's reaction to the content can be visualized on the content distribution system 1000. As a result, the content distribution system 1000 can provide various services (content recommendations and analysis of viewer trends) that take into account the viewer's reaction to the content.

[0187] <Additional Notes> The present embodiment includes the following disclosure.

[0188] (Appendix 1) A content distribution method executed by a content distribution system including a viewer terminal and a content distribution device, a content delivery step of delivering content to the viewer terminal; a content display step of displaying the content on a display device of the viewer terminal; a viewer photographing step of photographing the viewer with a photographing device on the display device side of the viewer terminal while the content is being displayed; a state determination step of determining whether the viewer photographed by the photographing device is in a predetermined target state; a flagging step of assigning a status flag to the content when it is determined that the viewer is in the target status; Content delivery methods including:

[0189] (Appendix 2) The method further includes a viewer notification step of notifying the viewer that the status flag has been assigned to the content. 2. A content distribution method as described in claim 1.

[0190] (Appendix 3) The method further includes a contributor notification step of notifying a contributor of the content that the status flag has been assigned to the content. 2. A content distribution method as described in claim 1.

[0191] (Appendix 4) The content is an image or a video. 2. A content distribution method as described in claim 1.

[0192] (Appendix 5) The target state is a facial expression, an emotion, or a posture. 2. A content distribution method as described in claim 1.

[0193] (Appendix 6) The target state is a smile 2. A content distribution method as described in claim 1.

[0194] (Appendix 7) The method further includes a content recommendation step of recommending content to the viewer based on the result of the determination of the target state. 2. A content distribution method as described in claim 1.

[0195] (Appendix 8) a tendency analysis step of analyzing the tendency of the viewer with respect to the content based on the result of the determination of the target state; The method further includes a trend display step of displaying the analysis result on the display device of the viewer terminal. 2. A content distribution method as described in claim 1.

[0196] (Appendix 9) The state determination step includes calculating an evaluation value of the target state, and determining whether the viewer is in the target state based on the evaluation value. 2. A content distribution method as described in claim 1.

[0197] (Appendix 10) The determination result of the target state includes at least one of the evaluation value and information indicating whether the viewer is determined to be in the target state. 10. The content distribution method according to claim 9.

[0198] (Appendix 11) A content distribution system including a viewer terminal and a content distribution device, a content delivery step of delivering content to the viewer terminal; a content display step of displaying the content on a display device of the viewer terminal; a viewer photographing step of photographing the viewer with a photographing device on the display device side of the viewer terminal while the content is being displayed; a state determination step of determining whether the viewer photographed by the photographing device is in a predetermined target state; a flagging step of assigning a status flag to the content when it is determined that the viewer is in the target status; A content distribution program for executing a content distribution method including the steps of:

[0199] (Appendix 12) A content distribution system including a viewer terminal and a content distribution device, a content delivery unit that delivers content to the viewer terminal; a content display unit that displays the content on a display device of the viewer terminal; a viewer photographing unit that photographs the viewer with a photographing device on the display device side of the viewer terminal while the content is being displayed; a state determination unit that determines whether the viewer photographed by the photographing device is in a predetermined target state; a flag setting unit that sets a status flag to the content when the viewer is determined to be in the target status; A content delivery system comprising:

[0200] The embodiments disclosed herein are illustrative in all respects and should not be considered as limiting. The scope of the present invention is indicated by the claims, not by the above meaning, and is intended to include all modifications within the meaning and scope of the claims. The present invention is not limited to the above-mentioned embodiments, and various modifications are possible within the scope of the claims, and embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. [Explanation of symbols]

[0201] 1: Content distribution device 2: Viewer terminal 3: Poster's terminal 11: Communications Department 12: Storage part 13: Control unit 121: User information 122: Content information 123: Content data 124: Judgment result information 125: Status flag information 126:Analysis result information 131: Information acquisition department 132: Content Recommendation Department 133: Content Distribution Department 134: Status flag assignment unit 135: Flag notification section 136: Trend analysis department 1000: Content distribution system

Claims

1. A content distribution method executed by a content distribution system including a viewer terminal and a content distribution device, a content delivery step of delivering content to the viewer terminal; a content display step of displaying the content on a display device of the viewer terminal; a viewer photographing step of photographing the viewer with a photographing device on the display device side of the viewer terminal while the content is being displayed; a state determination step of determining whether the viewer photographed by the photographing device is in a predetermined target state; a flagging step of assigning a status flag to the content when it is determined that the viewer is in the target status; Content delivery methods including:

2. The method further includes a viewer notification step of notifying the viewer that the status flag has been assigned to the content. The content distribution method according to claim 1 .

3. The method further includes a contributor notification step of notifying a contributor of the content that the status flag has been assigned to the content. The content distribution method according to claim 1 .

4. The content is an image or a video. The content distribution method according to claim 1 .

5. The target state is a facial expression, an emotion, or a posture. The content distribution method according to claim 1 .

6. The target state is a smile The content distribution method according to claim 1 .

7. The method further includes a content recommendation step of recommending content to the viewer based on the result of the determination of the target state. The content distribution method according to claim 1 .

8. a tendency analysis step of analyzing the tendency of the viewer with respect to the content based on the result of the determination of the target state; The method further includes a trend display step of displaying the analysis result on the display device of the viewer terminal. The content distribution method according to claim 1 .

9. The state determination step includes calculating an evaluation value of the target state, and determining whether the viewer is in the target state based on the evaluation value. The content distribution method according to claim 1 .

10. The determination result of the target state includes at least one of the evaluation value and information indicating whether the viewer is determined to be in the target state. The content distribution method according to claim 9.

11. A content distribution system including a viewer terminal and a content distribution device, a content delivery step of delivering content to the viewer terminal; a content display step of displaying the content on a display device of the viewer terminal; a viewer photographing step of photographing the viewer with a photographing device on the display device side of the viewer terminal while the content is being displayed; a state determination step of determining whether the viewer photographed by the photographing device is in a predetermined target state; a flagging step of assigning a status flag to the content when it is determined that the viewer is in the target status; A content distribution program for executing a content distribution method including the steps of:

12. A content distribution system including a viewer terminal and a content distribution device, a content delivery unit that delivers content to the viewer terminal; a content display unit that displays the content on a display device of the viewer terminal; a viewer photographing unit that photographs the viewer with a photographing device on the display device side of the viewer terminal while the content is being displayed; a state determination unit that determines whether the viewer photographed by the photographing device is in a predetermined target state; a flag setting unit that sets a status flag to the content when the viewer is determined to be in the target status; A content delivery system comprising:

Citation Information

Patent Citations

  • Information processing device, information processing method, and information processing program

    JP2021149556A