Live Streaming System
The live streaming system addresses the lack of real-time viewer feedback by using sensors to detect body movements and transmit enthusiasm signals, allowing broadcasters to engage with audiences more effectively.
Patent Information
- Application Number
- JP2022041961
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-03-17
- Publication Date
- 2026-01-22
- Estimated Expiration
- 2042-03-17
AI Technical Summary
Conventional live streaming systems fail to provide real-time feedback on viewer reactions to broadcasters.
A live streaming system that includes a distributor terminal device, a live streaming server, and viewer terminal devices equipped with sensors to detect body movements, determining enthusiastic responses and transmitting these signals to the server for real-time analysis.
Enables broadcasters to grasp viewer interest in real time, enhancing engagement and interaction with the audience.
Smart Images

Figure 0007804182000001 
Figure 0007804182000002 
Figure 0007804182000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to a live distribution system. [Background technology]
[0002] BACKGROUND ART Conventionally, a system has been known in which live viewers can view live video distributed over the Internet in real time on a PC (personal computer) or the like (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2004-15749 Summary of the Invention [Problem to be solved by the invention]
[0004] However, with conventional systems, the broadcaster was unable to grasp the reactions of the audience viewing the live broadcast content in real time. [Means for solving the problem]
[0005] According to one aspect of the present invention, a live streaming system includes a distributor terminal device that provides live streaming content related to a live event, a live streaming server that live-streams the provided live streaming content, and a plurality of viewer terminal devices for viewing the live streaming content live-streamed by the live streaming server, all connected via a communication network. Each viewer terminal device includes a seating unit equipped with a sensor that detects body movements of a seated live viewer, a presentation unit that presents video and audio of the live streaming content distributed via the communication network to the live viewer, a determination unit that determines whether the body movements detected by the sensor are enthusiastic body movements caused by the influence of the live streaming content and outputs a determination signal if the body movements are enthusiastic body movements, and a communication unit that transmits the determination signal to the live streaming server. [Effects of the Invention]
[0006] According to the present invention, a distributor can grasp in real time the state of interest of viewers viewing live distribution content. [Brief explanation of the drawings]
[0007] [Figure 1] FIG. 1 is a block diagram showing an example of a live distribution system. [Figure 2] FIG. 2 is a diagram showing the appearance of the viewer terminal device. [Figure 3] FIG. 3 is a diagram showing the arrangement of the pressure sensor and the vibration device. [Figure 4] FIG. 4 is a diagram showing an example of the relationship between body movement and detected pressure values. [Figure 5] FIG. 5 is a flowchart showing an example of a glue state determination program. [Figure 6] FIG. 6 is a flowchart showing an example of the glue determination process. [Figure 7] FIG. 7 is a diagram showing a display unit on which a level meter is displayed. [Figure 8] FIG. 8 is a diagram illustrating the second modification. DETAILED DESCRIPTION OF THE INVENTION
[0008] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The following description and drawings are examples for explaining the present invention, and appropriate omissions and simplifications have been made for clarity of explanation. Furthermore, in the following description, identical or similar elements and processes are given the same reference numerals, and duplicate explanations may be omitted. Note that the content described below merely shows an example of an embodiment of the present invention, and the present invention is not limited to the following embodiment, and can be implemented in various other forms.
[0009] Figure 1 is a block diagram showing the schematic configuration of a live streaming system according to this embodiment. The live streaming system 1000 includes a broadcaster terminal device 1, a live streaming server 2, and multiple viewer terminal devices 3, all of which are connected via a communication network 4 such as the Internet. Note that while only one viewer terminal device 3 is shown in Figure 1, multiple viewer terminal devices 3 are actually connected to the communication network 4.
[0010] (Distributor terminal device 1) The broadcaster terminal device 1 used by a live broadcaster includes photographing equipment 11 such as a camera and microphone for filming the live event, lighting equipment 12 and speakers 13 installed at the live venue, a control device 14 for controlling the lighting equipment 12 and speakers 13, a display device 15, and a communication device 16 for connecting to the Internet. The live event video (including audio) filmed by the photographing equipment 11 is transmitted as live distribution content to a live distribution server 2 via the Internet 4. Control by the control device 14 and the functions of the display device 15 will be described later.
[0011] (Viewer terminal device 3) The viewer terminal device 3 used by a user viewing live streaming content includes a seat 30, a control device 31, and an information terminal 32. The information terminal 32 for viewing live streaming content may be an information terminal device connectable to the Internet 4, such as a smartphone, a tablet PC (Personal Computer), a notebook PC, or a desktop PC. A live streaming app is installed on the information terminal 32. The information terminal 32 includes a computer having a CPU 320, a memory 321 such as ROM and RAM, a display unit 322 that displays live video, a communication unit 323, an audio device 324 such as a microphone and speaker, and other peripheral circuits. The CPU 320 includes a determination setting unit 325 as a functional component. The information terminal 32 can connect to the Internet 4 and communicate wirelessly with the control device 31 via the communication unit 323.
[0012] The seat 30 is provided with a speaker 304, a pressure sensor PS, and a vibration device V. The speaker 304, the pressure sensor PS, and the vibration device V are connected to the control device 31. As will be described in detail later, the pressure sensor PS is a sensor that detects the pressure on the seat 30 when a viewer is seated on the seat 30, i.e., body movement. The pressure detection value of the pressure sensor PS is input to the control device 31. Note that although a pressure sensor has been exemplified as a sensor that detects body movement, the sensor may be of another type, such as a capacitance sensor. Furthermore, when measuring pressure, a pressure distribution sensor may also be used.
[0013] The control device 31 drives and controls the speaker 304 based on the audio signal transmitted from the information terminal 32. As will be described later, the determination unit 310 of the control device 31 determines whether or not the seated person viewing the live streaming content is enjoying the atmosphere of the live streaming content and the rhythm of the music, based on the pressure detection value of the pressure sensor PS. The determination result is transmitted to the live streaming server 2 by the communication unit 323 of the information terminal 32 connected to the Internet 4.
[0014] (Live streaming server 2) The live streaming server 2 includes a computer having a CPU 20, a memory 21 such as a ROM and a RAM, a communication unit 22, and other peripheral circuits. The CPU 20 includes, as a functional component, a mood level calculation unit 200. The mood level calculation unit 200 will be described in detail later. The memory 21 includes, as a functional component, a distributor database (distributor DB) 210 and a viewer database (viewer DB) 211.
[0015] The distributor DB 210 stores user information of each pre-registered distributor in association with the distributor ID. The user information includes the distributor's content, interest level information about the content, etc. The viewer DB 211 stores user information of each pre-registered viewer in association with the viewer ID. The user information in the viewer DB 211 includes each viewer's viewer ID, attributes such as age, gender, and hometown, content viewing history, etc.
[0016] Fig. 2 is a diagram showing the appearance of the viewer terminal device 3. The viewer terminal device 3 includes a seat 30 on which a viewer sits, a control device 31 provided in the seat 30, and a terminal device 32 on which live streaming content is displayed. The seat 30 includes a seat cushion section 301, a seat back section 302, and a headrest section 303. The control device 31 is disposed below the seat cushion section 301. In Fig. 2, the front-rear direction and the left-right direction are defined as shown, with reference to the user (occupant) seated in the seat 30.
[0017] A pressure sensor (see FIG. 3) that detects pressure exerted on the seat cushion 301 by the body of the seated occupant is provided in the hatched region R1 of the seat cushion 301, as will be described later. A pressure sensor is also provided in the hatched region R2 of the seat back 302. Furthermore, a vibration device that makes the seated occupant feel vibrations is provided in each of the seat cushion 301 and the seat back 302 (see FIG. 3). A speaker 304 is provided in the headrest 303. The pressure sensor, vibration device, and speaker 304 described above are connected to the control device 31. The speaker 304 may be provided at the shoulder of the seat back 302. Furthermore, instead of the speaker 304, speakers of a stereo system may be arranged on the left and right front of the seat 30.
[0018] As described above, the terminal device 32 may be a general-purpose terminal device that can connect to the Internet 4, such as a smartphone or a tablet PC. Although not shown in the figure, the terminal device 32 is provided with the display unit 322, communication unit 323, and audio device 324 shown in FIG. 1. In the terminal device 32 shown in FIG. 2, a touch operation icon displayed on the display screen of the display unit functions as an input operation unit. The terminal device 32 is supported by a support ST and placed in front of the seat 30. As described above, a live streaming app is installed in the terminal device 32, a live video is displayed on the display unit 322, and live audio is output from the speaker 304. The terminal device 32 is also provided with a speaker, an audio output terminal, etc., so that live audio may be output from the speaker of the terminal device 32 or the live audio may be listened to through headphones connected to the audio output terminal.
[0019] FIG. 3 shows the arrangement of pressure sensors PS (PS1 to PS12) and vibration devices V (V1 to V2) provided on the seat cushion 301 and the seat back 302. Six pressure sensors PS (PS1 to PS6) are provided on the seat cushion 301. The pressure sensors PS1 to PS3 and the pressure sensors PS4 to PS6 are arranged symmetrically on the seat surface of the seat cushion 301. The pressure sensors PS1, PS2, PS4, and PS5 are arranged in positions on the seat cushion 301 corresponding to the buttocks of the seated occupant. The pressure sensors PS1 and PS4 are arranged in positions corresponding to the lowest part of the seat bones of the seated occupant. The pressure sensors PS3 and PS6 are located under the thighs of the seated occupant to detect pressure from their thighs. The vibration devices V1 and V2 are arranged symmetrically on the seat surface of the seat cushion 301. The vibration devices V1 and V2 are provided to apply vibrations to the thighs of both legs of the seated person.
[0020] Six pressure sensors PS7 to PS12 are provided on the seat back 302. Pressure sensors PS7 to PS9 and pressure sensors PS10 to PS12 are arranged symmetrically on the left and right sides of the seat surface of the seat back 302. Pressure sensors PS7, PS8, PS10, and PS11 detect pressure from the waist area of the seated occupant. Pressure sensors PS9 and PS12 detect pressure from the shoulder blade area of the seated occupant. Vibration device V3 provided on the seat back 302 is provided to apply vibrations to the back of the seated occupant.
[0021] In the viewer terminal device 3 shown in Figures 1 to 3, a smartphone, tablet PC, etc. is used as the information terminal 32. However, for example, the control device 31 may be configured to include the functions of an information terminal, such as a desktop PC, and a monitor for viewing may be connected to the control device 31.
[0022] (Explanation of the operation of the viewer terminal device 3) The operation of the viewer terminal device 3 will now be described. As described above, the pressure sensors PS (PS1 to PS12) provided on the seat 30 are provided to determine whether or not the seated person viewing the live streaming content is in a state of being immersed in the atmosphere of the live streaming content and the rhythm of the music (hereinafter referred to as a "groovy state"). The pressure detection value of the pressure sensor PS changes depending on the body movement of the seated person.
[0023] FIG. 4 shows an example of the relationship between body movement and the pressure detection values of the pressure sensors PS when a seated occupant is determined to be in a groove state and when they are not. Body movement pattern a is when a seated occupant in a groove state moves their upper body from side to side on the seat 30, rocking their body from side to side, i.e., when the center of gravity vibrates from side to side. When the body is tilted to the left, the pressure detection values of the pressure sensors PS (PS4 to PS6 or PS10 to PS12) on the left side of the seat cushion or seat back increase, and the pressure detection values of the pressure sensors PS (PS1 to PS3 or PS7 to PS9) on the right side decrease. Conversely, when the body is tilted to the right, the pressure detection values of the pressure sensors PS (PS1 to PS3 or PS7 to PS9) on the right side increase, and the pressure detection values of the pressure sensors PS (PS4 to PS6 or PS10 to PS12) on the left side decrease.
[0024] In a state of groove due to such body movement pattern a, the magnitude of the pressure detection values of the left pressure sensor PS and the right pressure sensor PS (left sensor detection value, right sensor detection value) alternates as follows: (large, small) → (small, large) → (large, small) → (small, large). The cycle of body swaying and movement in a state of groove, that is, the time from (large, small) to the next (large, small), depends on the tempo of the music, but is thought to be about 1 to 5 seconds, for example. In other words, when such a detection value pattern is detected, it is determined that the person is in a state of groove.
[0025] Body movement pattern b in the groove state occurs when the seated occupant moves their upper body back and forth, rocking their body back and forth, causing the center of gravity to oscillate back and forth. In the case of such body movement, it is estimated that the magnitude of the pressure detection values of the front pressure sensors PS (PS3, PS6) and the rear pressure sensors PS (PS1, PS4 or PS2, PS5) of the seat cushion unit 301 (front sensor detection value, rear sensor detection value) alternates in the following order: (large, small) → (small, large) → (large, small) → (small, large). When such a detection value pattern is detected, it is determined that the seated occupant is in the groove state.
[0026] Body movement pattern c in the riding state occurs when the seated occupant moves their upper body up and down, causing the center of gravity to move up and down. In the case of such body movement, it is estimated that the magnitude of the pressure detection values of all the pressure sensors PS (PS1 to PS6) of the seat cushion portion 301 alternates in the order of (large) → (small) → (large) → (small). When such a detection value pattern is detected, it is determined that the seated occupant is in the riding state.
[0027] Body movement patterns when not in a groove d For example, the case of a body movement unrelated to the riding state, such as the seated person crossing their legs, is an example. The change in the magnitude of the pressure detection value is irregular, and in such a case, it is determined that the riding state is not present.
[0028] The determination of the enthusiasm state as described above in the viewer terminal device 3 is executed by the determination unit 310 of the control device 31, and the determination result is transmitted from the control device 31 to the information terminal 32. Figures 5 and 6 are flowcharts showing an example of an enthusiasm state determination program executed in the control device 31. The enthusiasm state determination program in Figure 5 starts in response to a command from the live distribution app executed on the information terminal 32.
[0029] 5, it is determined whether or not an end signal has been received from the information terminal 32. If an end signal has been received from the information terminal 32, the glue state determination program is terminated, and if not, the process proceeds to step S20.
[0030] In step S20, it is determined whether or not the pressure detection values of the left and right pressure sensors PS of the seat cushion portion 301 or the seatback portion 302 have detected (left sensor detection value, right sensor detection value) = (large, small). Here, the pressure determination value for the seat cushion portion 301 will be described as an example. If the determination in step S20 is yes (detected), the process proceeds to step S30, where a glide determination process is executed. The details of the glide determination process will be described later. If the determination in step S20 is no (not detected), the process proceeds to step S40.
[0031] In step S40, it is determined whether or not the pressure detection values of the left and right pressure sensors PS of the seat cushion portion 301 are equal to (left sensor detection value, right sensor detection value) = (small, large). If the determination in step S40 is yes (detected), the process proceeds to step S50, where a glue determination process is executed. The details of the glue determination process will be described later. If the determination in step S40 is no (not detected), the process proceeds to step S60.
[0032] In step S60, it is determined whether or not the pressure detection values of the front and rear pressure sensors PS of the seat cushion portion 301 are equal to (front sensor detection value, rear sensor detection value) = (large, small). If the determination in step S60 is yes (detected), the process proceeds to step S70, where a glide determination process is executed. The details of the glide determination process will be described later. If the determination in step S60 is no (not detected), the process proceeds to step S80.
[0033] In step S80, it is determined whether or not the pressure detection values of the front and rear pressure sensors PS of the seat cushion portion 301 are equal to (front sensor detection value, rear sensor detection value) = (small, large). If the determination in step S80 is yes (detected), the process proceeds to step S90, where a glide determination process is executed. The details of the glide determination process will be described later. If the determination in step S80 is no (not detected), the process proceeds to step S100.
[0034] In step S100, it is determined whether or not (all sensor detection values) = (large) is detected for the pressure detection values of all pressure sensors PS of the seat cushion portion 301. If the determination in step S100 is yes (detected), the process proceeds to step S110, where a glue determination process is executed. The glue determination process will be described in detail later. If the determination in step S100 is no (not detected), the process proceeds to step S120.
[0035] In step S120, it is determined whether or not (all sensor detection values) = (small) is detected for the pressure detection values of all pressure sensors PS of the seat cushion portion 301. If the determination in step S120 is yes (detected), the process proceeds to step S130 and a glue determination process is executed. The glue determination process will be described in detail later. If the determination in step S120 is no (not detected), the process returns to step S10.
[0036] (Details of glue detection process) Fig. 6 is a flowchart showing an example of detailed processing of the glue determination process. First, the meanings of the reverse pattern in step S200 and the forward pattern in step S230 will be explained. In the glue determination process of step S30 in Fig. 5, the forward pattern is (left sensor detection value, right sensor detection value) = (large, small), and the reverse pattern is (left sensor detection value, right sensor detection value) = (small, large). In the glue determination process of step S50 in Fig. 5, the forward pattern is (left sensor detection value, right sensor detection value) = (small, large), and the reverse pattern is (left sensor detection value, right sensor detection value) = (large, small).
[0037] In the case of the glue determination process in step S70 in Fig. 5, the normal pattern is (front sensor detection value, rear sensor detection value) = (large, small), and the reverse pattern is (front sensor detection value, rear sensor detection value) = (small, large). In the case of the glue determination process in step S90 in Fig. 5, the normal pattern is (front sensor detection value, rear sensor detection value) = (small, large), and the reverse pattern is (front sensor detection value, rear sensor detection value) = (large, small).
[0038] In the case of the glue determination process in step S110 of Fig. 5, the normal pattern is (detected values of all sensors) = (large), and the reverse pattern is (detected values of all sensors) = (small). In the case of the glue determination process in step S130 of Fig. 5, the normal pattern is (detected values of all sensors) = (small), and the reverse pattern is (detected values of all sensors) = (large).
[0039] In step S200 of the glue determination process in Fig. 6, it is determined whether a pattern opposite to the detection pattern in the determination step immediately before entering the glue determination process has been detected. For example, when proceeding from step S20 to step S30 in Fig. 5, the opposite pattern is (left sensor detection value, right sensor detection value) = (small, large), as described above.
[0040] If step S200 returns no (not detected), the process proceeds to step S250, where it is determined whether the elapsed time since step S20 detected (left sensor detection value, right sensor detection value) = (large, small) has reached the determination process interruption condition t2. Here, the determination process interruption condition t2 is a time parameter for determining whether the time from the detection of a normal or reverse pattern to the detection of the next pattern is too long and therefore continuation of the groove determination process is unnecessary. Therefore, the determination process interruption condition t2 is set to a time sufficiently longer than half the period of the body swaying and movement in a groove state. As described above, the period of the body swaying and movement in a groove state is about 1 to 5 seconds, so the determination process interruption condition t2 is set to a time sufficiently longer than 2.5 seconds, for example, about 8 seconds.
[0041] If step S250 returns yes (t2 has elapsed), that is, if the reverse pattern of "left and right (small, large)" is not detected within t2=8 seconds after "left and right (large, small)" is detected in step S20, the glue determination process is interrupted and the process returns to step S10 in Fig. 5. On the other hand, if step S250 returns no (t2 has not elapsed), the process returns to step 200 and the reverse pattern detection determination is performed again.
[0042] If step S200 returns "yes" (detected), the process proceeds to step S210. In step S210, it is determined whether the elapsed time Δt1 since step S20 detected (left sensor detection value, right sensor detection value) = (large, small) is equal to or less than the groove determination condition t1. The groove determination condition t1 is half the period of the body swaying and movement in the groove state described in FIG. 4, i.e., half the time from (large, small) → (small, large) → (large, small). As described above, the period is about 1 to 5 seconds, so the groove determination condition t1 is set to, for example, about 3 seconds. If step S210 returns "yes" (Δt1≦t1), the process proceeds to step S220. If step S210 returns "no" (Δt1>t1), the groove determination process of FIG. 6 is interrupted, and the process returns to step S10 of FIG. 5.
[0043] The length of the groove determination condition t1 may be changed according to the rhythm of the music being played live. The determination setting unit 325 of the information terminal 32 sets the groove determination time according to the rhythm of the music. For example, the information terminal 32 calculates the groove determination condition t1 based on the rhythm of the music being played based on audio data, and transmits the calculated groove determination condition t1 to the control device 31. The control device 31 executes groove determination processing based on the groove determination condition t1 received from the information terminal 32. This configuration makes it possible to perform appropriate groove determination processing for each song.
[0044] In step S220, it is determined whether a normal pattern has been detected. If the determination in step S220 is no (not detected), the process proceeds to step S260, where it is determined whether the elapsed time since the detection of the reverse pattern in step S200 has reached the determination process interruption condition t2. If the determination in step S260 is no (not elapsed), the process returns to step S220, and if the determination is yes (elapsed), the glue determination process in FIG. 6 is interrupted and the process returns to step S10 in FIG. 5.
[0045] In step S230, it is determined whether the elapsed time Δt2 since the reverse pattern was detected in step S200 is less than or equal to the groove determination condition t1. If the determination in step S230 is yes (Δt2≦t1), the process proceeds to step S240, but if the determination is no (Δt1>t1), the groove determination process in FIG. 6 is interrupted and the process returns to step S10 in FIG. 5. In step S240, a groove signal indicating that it has been determined that the user is in a groove state is output to the information terminal 32. The groove signal is linked to the ID of the live distribution content, the output time of the groove signal, and the viewer's ID.
[0046] In the glue determination process shown in Fig. 6, a glued state is determined when a pattern change of one cycle, such as (large, small) → (small, large) → (large, small), is detected. However, the determination criteria are not limited to this. For example, to more reliably determine the glued state, a glued state may be determined when a pattern change longer than one cycle is detected.
[0047] The information terminal 32 receives the groove signal from the control device 31 and transmits the groove signal in real time to the live distribution server 2. As will be described later, the live distribution server 2 transmits the groove level based on the groove signal received from each viewer terminal device 3 to the distributor terminal device 1 and each viewer terminal device 3 at predetermined time intervals ΔT. The information terminal 32 performs the following control based on the groove level received from the live distribution server 2 at time intervals ΔT. The groove level and time intervals ΔT will be described later.
[0048] As an example of control of the information terminal 32 by the live streaming app based on the received enthusiasm level, for example, as shown in FIG. 7, a level meter 327 indicating the level of excitement of the audience (spectators at the venue or viewers) is displayed on the display unit 322 along with live video 326. The level display of the level meter 327 is changed in accordance with real-time changes in the enthusiasm level received from the live streaming server 2. This allows other viewers viewing the live stream on other viewer terminal devices 3 to share the excitement. In addition, synthesized sounds such as applause and cheers may be output from the speaker 304 of the seat 30 or the audio device 324 of the information terminal 32, and processing such as color changes may be applied to the actual live video.
[0049] Furthermore, to further enhance the viewer's state of interest, vibrations corresponding to the level of interest may be generated by the vibration devices V (V1 to V3) provided on the seat 30. In this case, it is preferable to synchronize the period of the vibrations with the rhythm of the music or the period of body movement.
[0050] (Explanation of the operation of Live Streaming Server 2) As described above, the live streaming server 2 receives groove signals from multiple viewer terminal devices 3. The live streaming server 2 stores the groove signals received from the viewer terminal devices 3 as viewer information in the viewer DB 210 for each live streaming content. The groove level calculation unit 200 of the live streaming server 2 calculates the groove level based on the groove signals received from the multiple viewer terminal devices 3 as follows:
[0051] First, the total number Sn of groove signals received from each viewer terminal device 3 during the time interval ΔT = ΔTn = Tn - Tn - 1 (n = 1, 2, 3, ...) is calculated, using the start time T0 of the live distribution as a reference. In this embodiment, the total number Sn of groove signals is referred to as the groove level. Then, the groove levels Sn calculated successively at the time interval ΔT are stored in the distributor DB 211 in association with the live distribution content, and are simultaneously transmitted to the distributor terminal device 1 and each viewer terminal device 3. The groove level Sn is linked to the time Tn, making it possible to identify the groove level at which time in the live distribution content.
[0052] The time interval ΔT is set to twice the groove determination condition t1 used for the groove determination described above, i.e., longer than the maximum period of the center of gravity shift in the groove state described above (about 5 seconds), but it is preferable to keep it to a length that allows you to determine which parts of the song are exciting. For example, ΔT is set to about 10 seconds. Since the groove level Sn changes every ΔT, which is the time interval for aggregation, the level display of the level meter 327 shown in Figure 7 also changes at the time interval ΔT.
[0053] (Explanation of the operation of distributor terminal device 1) The control device 14 of the distributor terminal device 1 can perform the following control, for example, based on the enthusiasm level received from the live distribution server 2. As an example of real-time use at a live event, a display similar to the level meter 327 shown in FIG. 7, which indicates the level of excitement, can be displayed on the display device 15 installed at the live venue. This allows the performers and the audience at the venue to be impressed by the excitement of the viewers of the live distribution, and the performers, the audience at the venue, and the viewers can all get excited together. In addition, the lighting device 12 at the venue may be configured to produce lighting effects according to the level of enthusiasm, or the speaker 13 may be configured to output synthesized sounds of applause or cheers according to the viewers' excitement.
[0054] Furthermore, after a live event, the level of enthusiasm can be used to evaluate which scenes and songs were popular during the event based on the time series changes in enthusiasm during the event. Differences in enthusiasm depending on the attributes of viewers can also be used for marketing purposes.
[0055] (Variation 1) In the above-described embodiment, the seat 30 provided in the viewer terminal device 3 shown in Figures 1 to 3 is a seat of the type installed in a room, but it can also be applied to a vehicle seat. For example, if the seat 30 shown in Figure 2 is applied to a rear seat of a vehicle, the information terminal 32 will be provided on the back of the front seat. The other configurations are the same as those shown in Figures 1 to 3, but instead of providing the speaker 304 in the headrest 303, a speaker that is installed as standard equipment in the vehicle may be used.
[0056] In addition to the above-mentioned examples, methods of utilizing the degree of attraction in the viewer terminal device 3 when applied to a vehicle seat may also include controlling the color and light intensity of a dimmer device installed on the door trim or the like inside the vehicle cabin according to the degree of attraction.
[0057] (Variation 2) FIG. 8 is a diagram illustrating Modification 2. In Modification 2, pressure sensors PS1 to PS6 are provided and a cushion 80 is used instead of the seat 30 provided in the viewer terminal device 3 shown in FIGS. 1 and 2. In the example shown in FIG. 8, the cushion 80 is placed on the seat surface 700 of a chair 70, and the user sits on it. The pressure sensors PS1 to PS6 provided on the cushion 80 are arranged in the same manner as the seat cushion part 301 shown in FIG. 3 and are connected to the control device 31 by wiring 800. Therefore, even when the cushion 80 is used, it is possible to perform the glue determination shown in FIG. 4. Note that the chair 70 is not a chair dedicated to the viewer terminal device 3, but an ordinary chair found in a home is used. Of course, the cushion 80 is not limited to the chair 70, and the user may sit on the cushion 80 placed on a bench or a box.
[0058] In this way, in Modification 2, the cushion 80 with a simple configuration is used instead of the seat 30 in Fig. 2, thereby reducing costs. Also, Modification 2 has the advantage that the weight and size of the viewer terminal device 3 are reduced, making it easy to carry.
[0059] According to the embodiment and the modified example of the present invention described above, the following advantageous effects can be achieved.
[0060] (C1) As shown in Figures 1 to 3, a live streaming system 1000 includes a distributor terminal device 1 that provides live streaming content, a live streaming server 2 that live streams the live streaming content, and multiple viewer terminal devices 3 for viewing the live streaming content, all connected via a communications network called the Internet 4. Each viewer terminal device 3 includes a seat 30 having a seat cushion 301 that serves as a seating area and is equipped with a pressure sensor PS that detects body movements of a seated live viewer, a display unit 223, an audio device 324, and a speaker 304 that serve as presentation units that present video and audio of the live streaming content distributed via the Internet 4 to the live viewer, a determination unit 310 that determines whether the body movement detected by the pressure sensor PS is a groove-state body movement caused by the influence of the live streaming content and outputs a groove-state body movement if it is determined to be a groove-state body movement, and a communication unit 323 that transmits the groove signal to the live streaming server 2.
[0061] In this way, in the live streaming system 1000, a groove signal indicating the groove state and body movements of a viewer seated in seat 30 is transmitted from viewer terminal device 3 to live streaming server 2. By receiving the groove signal in real time from live streaming server 2 via the Internet 4, the live streamer can recognize the viewer's groove state. As a result, the viewer's groove can be reflected in the live event in real time, and in subsequent live streaming services.
[0062] (C2) In (C1) above, as shown in Figures 1, 4 to 6, etc., if the period of center of gravity movement of the live viewer seated on the seat cushion portion 301 of the seat 30 is equal to or less than a predetermined threshold value 2t1 (twice the groove determination condition t1), that is, if a positive pattern, a negative pattern, and a positive pattern indicating center of gravity movement, which is a groove state body movement, are detected in this order during the time 2t1, which is the groove determination period, the determination portion 310 determines that the seated viewer is in a groove state. In this way, by providing the pressure sensor PS on the seat 30, it is possible to determine the groove state of the seated viewer.
[0063] (C3) In (C2) above, as shown in FIG. 1 etc., the determination setting unit 325 provided in the information terminal 32 sets the groove determination condition t1, which corresponds to half the predetermined threshold, according to the rhythm of the audio in the live streaming content. Generally, the rhythm of each song being played is different, and when a viewer is enjoying the music, the period of the center of gravity movement often also differs slightly from song to song. Therefore, by setting the groove determination condition t1 according to the rhythm of the audio of the content, it becomes possible to perform more optimal groove determination processing.
[0064] (C4) In (C1) above, as shown in Fig. 1 etc., the live streaming server 2 includes a groove level calculation unit 200 that calculates the groove level, which is the total number of groove signals received from multiple viewer terminal devices 3 during a predetermined time interval ΔT. As a result, the groove level of the live streaming content can be grasped for each time interval ΔT.
[0065] (C5) In (C4) above, as shown in Figures 1, 7, etc., the enthusiasm level is transmitted from the live distribution server 2 to the viewer terminal device 3 via the Internet 4, and the display unit 322, audio device 324, and speaker 304, which are presentation units, present the viewer with a visual display and / or audio representing the enthusiasm level. For example, by displaying a level meter 327 as shown in Figure 7 on the display unit 322, the viewer can grasp the enthusiasm levels of other viewers, and feel a sense of unity with the other viewers.
[0066] (C6) In (C4) above, as shown in FIG. 1 and other figures, the enthusiasm level is transmitted from the live streaming server 2 to the distributor terminal device 1 via the Internet 4, and the distributor terminal device 1 includes a display device 15 and a lighting device 12 as transmission devices for transmitting the enthusiasm level to the live event performers. For example, by displaying a display similar to the level meter 327 shown in FIG. 7, which indicates the level of excitement, on the display device 15 installed at the live venue, the excitement of the live streaming viewers can be appealed to the performers and the audience at the venue, and the performers, the audience at the venue, and the viewers can all get excited together. In addition, the lighting device 12 at the venue may be configured to change the lighting depending on the enthusiasm level, or a speaker 13 may be configured to output synthesized sounds of applause or cheers depending on the viewers' excitement.
[0067] (C7) In the above (C1), as shown in Fig. 1 etc., the viewer terminal device 3 is provided in a vehicle, and the seating portion constitutes a part of a vehicle seat provided in the vehicle. For example, the seat 30 shown in Fig. 2 is used as a rear seat of the vehicle, and the seat cushion portion 301 constitutes the seating portion of the seat 30. With this configuration, even in the vehicle, it is possible not only to view live streaming content but also to share the level of interest with other viewers.
[0068] (C8) In (C1) above, as shown in FIG. 8 etc., the seating portion may be configured with a cushion 80 equipped with a pressure sensor PS. For example, the cushion 80 is placed on the seat surface 700 of the chair 70, and the viewer sits on it. By configuring the seating portion with the cushion 80 in this way, it is possible to reduce the cost of the viewer terminal device 3 and improve its portability. Also, the cushion 80 shown in FIG. 8 may be placed on the seating surface of a standard rear seat provided in a vehicle to serve as the seating portion.
[0069] The various embodiments and modifications described above are merely examples, and the present invention is not limited to these unless the features of the invention are impaired. Other embodiments that are conceivable within the scope of the technical idea of the present invention are also included within the scope of the present invention. [Explanation of symbols]
[0070] 1...Distributor terminal device, 2...Live streaming server, 3...Viewer terminal device, 4...Communication network, 11...Filming equipment, 12...Lighting device, 13,304...Speaker, 14,31...Control device, 15...Display device, 16...Communication device, 22,323...Communication unit, 30...Seat, 32...Information terminal, 200...Enthusiasm calculation unit, 210...Distributor database, 211...Viewer database, 301...Seat cushion unit, 302...Seat back unit, 303...Headrest unit, 310...Determination unit, 322...Display unit, 324...Audio device, 325...Determination setting unit, 1000...Live streaming system, PS, PS1 to PS12...Pressure sensor, V, V1, V2...Vibration device
Claims
1. A live streaming system in which a distributor terminal device that provides live streaming content related to a live event, a live streaming server that live-streams the provided live streaming content, and a plurality of viewer terminal devices for viewing the live streaming content live-streamed by the live streaming server are connected via a communication network, The viewer terminal device a seating section provided with a sensor for detecting body movements of a seated live viewer; a presentation unit that presents video and audio of the live streaming content delivered via the communication network to the live viewers; a determination unit that determines whether the body movement detected by the sensor is a state of being in a groove caused by the influence of the live distribution content, and outputs a determination signal when the body movement is determined to be a state of being in a groove; a communication unit that transmits the determination signal to the live distribution server.
2. The live distribution system according to claim 1, The determination unit determines that the live viewer's body movement is in a groove state when the period of the center of gravity movement of the live viewer seated on the seating section is equal to or less than a predetermined threshold.
3. The live distribution system according to claim 2, The live distribution system further comprises a setting unit that sets the predetermined threshold value according to the rhythm of the audio in the live distribution content.
4. The live distribution system according to claim 1, The live streaming server A live distribution system comprising: an enthusiasm level calculation unit that calculates an enthusiasm level, which is the total number of the determination signals received from the plurality of viewer terminal devices during a predetermined time interval.
5. The live distribution system according to claim 4, the enthusiasm level is transmitted from the live distribution server to the viewer terminal device via the communication network; The presentation unit presents a video display and / or audio representing the enthusiasm level, in a live distribution system.
6. The live distribution system according to claim 4, the enthusiasm level is transmitted from the live streaming server to the broadcaster terminal device via the communication network; A live distribution system in which the distributor terminal device is equipped with a transmission device that transmits the enthusiasm level to live event performers.
7. The live distribution system according to claim 1, the viewer terminal device is provided in a vehicle, A live distribution system in which the seating portion constitutes a part of a vehicle seat provided in a vehicle.
8. The live distribution system according to claim 1, A live distribution system, wherein the seating portion is a cushion that can be placed on the seat surface.
Citation Information
Patent Citations
Live distribution server, and live distribution method
JP2004015749A
Content providing system
JP2006293979A
Image data transmission device, image display device, video server device, image display program, image display support program, and image display system
JP2009118273A
Image display system, image display method, and image display device
JP2016092510A
Image processing device, display system, program, and image processing method
JP2021093577A