Information processing apparatus
The information processing apparatus uses user healthcare data to manage comment distribution based on stress levels, addressing the challenge of real-time comment timing issues and reducing offensive content in online services.
Patent Information
- Application Number
- JP2023221690
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-27
- Publication Date
- 2025-07-09
AI Technical Summary
Existing technologies fail to effectively control the distribution of real-time comments in online services, particularly in video distribution, where users may miss the timing for comment transmission, leading to frustration and the potential distribution of uncomfortable or offensive remarks.
An information processing apparatus that acquires user healthcare information, such as heart rate, to determine the user's state at the time of comment input, allowing the server to control the distribution of comments based on stress levels, preventing the transmission of comments made in frustrated or angry states.
Prevents the distribution of comments made in frustrated states, ensuring a more controlled and comfortable viewing experience by detecting and managing user stress levels during comment input, thereby reducing the likelihood of offensive content being shared.
Smart Images

Figure 2025103936000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an information processing apparatus that controls comment distribution based on user health care information (such as heart rate) in a distribution system.
Background Art
[0002] Wearable terminals equipped with biosensors such as wristwatches, glasses, and rings to acquire user health care information are becoming popular. For example, Patent Document 1 discloses a technique for calculating a user's stress state based on biological information acquired by a wearable terminal.
[0003] Currently, online distribution services are booming, with numerous distribution apps available, and distribution viewers enjoy communication with distributors by sending real-time comments.
[0004] However, among the comments, there are users who make defamatory or offensive remarks to distributors or distribution viewers based on their emotions, and maintaining the security of the entire distribution is increasingly becoming the responsibility of the distributor.
[0005] Patent Document 2 discloses a technique for preventing the transmission of texts that make others uncomfortable by forcibly setting a cooling-down time when detecting emotional irritation in the field of e-mails.
Prior Art Documents
Patent Documents
[0006]
Patent Document 1
Patent Document 2
Summary of the Invention
Problems to be Solved by the Invention
[0007] However, when applying the technology of Patent Document 2, in services that emphasize real-time nature for comment transmission, such as video distribution, there is a problem that viewers may miss the timing when they wanted to send a comment. In addition, users who miss the timing of comment transmission may become even more frustrated.
[0008] Therefore, there is a need for a method of controlling distributed comments that maintains real-time transmission while preventing the distribution of comments that would discomfort the distributor or other viewers.
[0009] An object of the present invention is to provide an information processing apparatus capable of appropriately controlling the distribution of comments input in a frustrated state on the distribution server side by the client transmitting the user's health care information at the time of comment input.
Means for Solving the Problems
[0010] In order to achieve the above object, the information processing apparatus of the present invention is an information processing apparatus (client apparatus) capable of viewing online distribution, comprising: a health care information acquisition means for acquiring the user's health care information; a comment input means for inputting a comment on the distribution being viewed; and a comment transmission means for transmitting the input comment and the user state at the time of comment input.
Effects of the Invention
[0011] According to the present invention, by the client transmitting the user's health care information at the time of comment input, the distribution server side can appropriately control the distribution of comments input in a frustrated state.
Brief Description of the Drawings
[0012]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Embodiments for Carrying Out the Invention
[0013] Hereinafter, preferred embodiments of the present invention will be described based on the accompanying drawings.
[0014] Note that the embodiments described below are examples of the means for realizing the present invention, and may be appropriately modified or changed depending on the configuration of the device to which the present invention is applied and various conditions. Also, it is possible to appropriately combine the respective embodiments.
[0015] (First Embodiment) In this embodiment, for example, comments from users in a high stress state are not distributed. In this embodiment, an example will be described in the case of the information processing apparatuses of claims 1 to 4 (hereinafter, client apparatuses) and the information processing apparatuses of claims 9 to 11 and 13 (hereinafter, server apparatuses).
[0016] (Configuration of Each Device) FIG. 1 is a block diagram showing the configuration of the entire system of this embodiment.
[0017] A100 is a client apparatus in this embodiment. The client apparatus A100 is, for example, a smartphone, a notebook PC, a game machine, or the like. Also, the client apparatus A100 is used to view the distributed video or to transmit the video for distribution to the server apparatus B100. The server apparatus B100 is, for example, a personal computer or the like. Also, the server apparatus B100 is used to distribute videos. C100 is a wearable terminal in this embodiment. The wearable terminal C100 is, for example, a smartwatch, a mouse, a game controller, or the like.
[0018] First, the client apparatus A100 will be described.
[0019] The control unit A101 controls each part of the client apparatus A100 according to the input signals and programs. Note that instead of the control unit A101 controlling the entire apparatus, a plurality of hardware may share the processing to control the entire apparatus.
[0020] The memory A102 is used as a buffer memory for temporarily holding various data and as a work area for the control unit A101.
[0021] The non-volatile memory A103 is a non-volatile memory that can be electrically erased and recorded, and stores programs and the like executed by the control unit A101.
[0022] The operation unit A104 is used to receive instructions from the user for the client device A100. The operation unit A104 includes, for example, a power button for the user to instruct the ON / OFF of the power of the client device A100 and operation buttons for instructing screen transitions. Also, the touch panel formed on the display unit A105 described later is also included in the operation unit A104.
[0023] The display unit A105 performs GUI (Graphical User Interface) display for interactive operations. Note that the display unit A105 does not necessarily have to be built into the client device A100. The client device A100 only needs to have at least a display control function for controlling the display content.
[0024] The recording medium A106 can record various data. The recording medium B106 may be configured to be detachable from the client device A100 or may be built into the client device A100. That is, the client device A100 only needs to have at least means for accessing the recording medium A106.
[0025] The wireless LAN unit A112 is a communication unit for realizing wireless communication. The wireless LAN unit A112 is composed of an antenna for wireless communication and a communication controller for processing wireless signals, and realizes wireless communication according to the IEEE802.11 standard. The control unit A101 controls the wireless LAN unit A112 and realizes communication with the server device B100 via the wireless LAN access point E100 and the public network D100. The client device A100 of the present embodiment transmits and receives video data from the server device B100 according to the HTTP (Hypertext Transfer Protocol) protocol, for example, via the wireless LAN unit A112. Also, the client device A100 of the present embodiment may use a protocol other than the aforementioned protocol when transmitting and receiving video data.
[0026] The short-range wireless communication unit A113 is composed of, for example, an antenna for wireless communication, a modulation / demodulation circuit for processing wireless signals, and a communication controller. The short-range wireless communication unit A113 outputs a modulated wireless signal from the antenna and demodulates the wireless signal received by the antenna to realize short-range wireless communication according to the IEEE802.15 standard (so-called Bluetooth (registered trademark)). The control unit A101 controls the short-range wireless communication unit A113 and realizes communication with the wearable terminal C100. The client device A100 of the present embodiment receives biometric information data from the wearable terminal C100 via the short-range wireless communication unit A113.
[0027] The above is the description of the client device A100.
[0028] Next, the server device B100 will be described.
[0029] The control unit B101 controls each part of the server device B100 according to the input signal and the program. Note that instead of the control unit B101 controlling the entire device, a plurality of hardware may share the processing to control the entire device.
[0030] Memory B102 is used as a buffer memory for temporarily holding various data, a working area of the control unit B101, etc.
[0031] Non-volatile memory B103 is an electrically erasable and recordable non-volatile memory, and stores programs executed by the control unit B101, etc.
[0032] The operation unit B104 is used to receive instructions from the user for the server device B100. The operation unit B104 includes, for example, a power button for the user to instruct the ON / OFF of the power of the server device B100.
[0033] The recording medium B106 can record various data. The recording medium B106 may be configured to be detachable from the server device B100, or may be built into the server device B100. That is, the server device B100 only needs to have means for accessing at least the recording medium B106.
[0034] The communication unit B111 is a unit for realizing communication with external devices (for example, the server 301, personal computer 305, smartphone 305, etc. described later). The communication unit B111 is composed of, for example, an antenna and a communication controller for realizing wireless communication according to IEEE802.11a·b·g·n·ac·ax.
[0035] The control unit B101 controls the communication unit B111 and realizes communication with the client device A100 via the public network D100 and the wireless LAN access point E100. The server device B100 of the present embodiment transmits and receives video data to and from the client device A100 according to the HTTP (Hypertext Transfer Protocol) protocol via the communication unit B111. Also, the client device A100 of the present embodiment may use a protocol other than the above-mentioned protocol when transmitting and receiving video data.
[0036] The above is the description of the server device B100.
[0037] Next, the wearable terminal C100 will be described.
[0038] The control unit C101 controls each part of the wearable terminal C100 according to the input signal and the program. Instead of the control unit C101 controlling the entire device, a plurality of hardware components may share the processing to control the entire device.
[0039] The biological sensor C107 is a sensor that acquires biological information such as blood pressure, heart rate, and sweating.
[0040] The short-range wireless communication unit C113 is composed of, for example, an antenna for wireless communication, a modulation / demodulation circuit for processing wireless signals, and a communication controller. The short-range wireless communication unit C113 outputs the modulated wireless signal from the antenna and demodulates the wireless signal received by the antenna to realize short-range wireless communication according to the IEEE802.15 standard (so-called Bluetooth (registered trademark)). The control unit C101 controls the short-range wireless communication unit C113 to realize communication with the client device A100. The wearable terminal C100 of the present embodiment transmits biological information data to the client device A100 via the short-range wireless communication unit C113.
[0041] The above is the description of the wearable terminal C100.
[0042] <Operations of Each Device> The operations of the client device A100 and the server device B100 in the present embodiment will be described with reference to the flowcharts of FIGS. 2 to 3 and the diagrams of FIGS. 4 to 5.
[0043] SA201 to SA214 in FIG. 2 represent the operations of the client device A100 that transmits the distribution video in the present embodiment. The processes shown in this flowchart are realized by the control unit A101 of the client device A100 controlling each part of the client device A100 according to the input signal and the program.
[0044] In FIG. 2, steps SA201 to SA208 are general operations as a client device for transmitting a distribution video to a video distribution server. Further, steps SA209 to SA214 are operations characteristic of the client device according to claims 1 to 4.
[0045] In step SA201, the control unit A101 determines whether it has received a video distribution operation from the user via the operation unit A104. If the control unit A101 determines that it has received a video playback distribution operation, it proceeds to the process of step SA202; otherwise, it repeats the process of step S201 again.
[0046] In step SA202, the control unit A101 transmits a video distribution request to the server device B100 via the wireless LAN unit A112.
[0047] In step SA203, the control unit A101 determines whether it has received a video distribution response from the server device B100 via the wireless LAN unit A112. The video distribution response includes information such as a stream key, for example. If the control unit A101 determines that it has received a video response, it proceeds to the process of step SA204; otherwise, it repeats the process of SA203 again.
[0048] In step SA204, the control unit A101 starts video distribution using the stream key included in the video distribution response received in step SA203.
[0049] In step SA205, the control unit A101 transmits video information to the server device B100 via the wireless LAN unit A112.
[0050] In step SA206, the control unit A101 determines whether it has received a video stop operation from the user via the operation unit A104. If the control unit A101 determines that it has received a distribution stop operation, it proceeds to the process of step SA207; otherwise, it proceeds to the process of SA209.
[0051] In step SA207, the control unit A101 transmits a distribution stop request to the server device B100 via the wireless LAN unit A112.
[0052] In step SA208, the control unit A101 determines whether it has received a distribution stop response from the server device B100 via the wireless LAN unit A112. If the control unit A101 determines that it has received the distribution stop response, the process ends; otherwise, the process of step SA207 is repeated.
[0053] In step SA209, the control unit A101 determines whether the user is performing a comment input operation via the operation unit A104. If the control unit A101 detects a comment input operation, it proceeds to the process of step SA210; otherwise, it proceeds to the process of step SA213.
[0054] In step SA210, the control unit A101 receives health care information from the wearable terminal C100 via the short-range wireless unit 113. The health care information is, for example, the heart rate.
[0055] In step SA211, the control unit A101 determines whether the user has sent a comment via the operation unit A104. If the control unit A101 detects a comment sending operation, it proceeds to the process of step SA212; otherwise, it proceeds to step SA205.
[0056] In step SA212, the control unit A101 transmits comment information to the server device B100 via the wireless LAN unit A112. The comment information includes, for example, the user's account information (such as ID) and the health care information obtained in step SA210.
[0057] In step SA213, control unit A100 determines whether it has received a comment control request from operation unit A104. If control unit A101 determines that it has received a comment control information request, it proceeds to the process of step SA214; otherwise, it proceeds to the process of step SA205. The comment control request is information that requests, for example, not to transmit a specified comment to the server.
[0058] In step SA214, control unit A101 transmits comment control information to server device B100 via wireless LAN unit A112. The comment control information is, for example, the comment information included in the comment control request received from operation unit A104 in step SA213.
[0059] The above is the description of the operation of the client device for transmitting a distribution video in the present embodiment.
[0060] Subsequently, SB201 to SB212 in FIG. 2 represent the operation of server device B100 that distributes the video of the present embodiment. The processes shown in this flowchart are realized by control unit B101 of server device B100 controlling each part of server device B100 according to an input signal and a program.
[0061] In FIG. 2, steps SB201 to 204 and steps SB210 to SB212 are general operations as a server device that distributes videos. Also, SB205 to SB209 are operations characteristic of the server devices of claims 9 to 11 and 13.
[0062] In step SB201, control unit B101 determines whether it has received a video distribution request from client device A100 via communication unit B111. If control unit B101 determines that it has received a video distribution request, it proceeds to the process of step SB202; otherwise, it repeats the process of step SB201 again.
[0063] In step SB202, the control unit B101 transmits a video distribution response to the client device A100 via the communication unit B111. The video distribution response includes information such as a stream key.
[0064] In step SB203, the control unit B100 determines whether it has received a distribution video from the client device A100 via the communication unit B111. If the control unit B100 has received the distribution video, it proceeds to the process of step SB204; otherwise, it proceeds to the process of step SB205.
[0065] In step SB204, the control unit B100 records the distribution video received in step SB203 in the storage medium B106. The distribution video recorded in the storage medium B106 is distributed in response to requests from each client device.
[0066] In step SB205, the control unit B101 determines whether it has received comment control information from the client device A100 via the communication unit B111. If the control unit B101 determines that it has received the comment control information, it proceeds to the process of step SB206; otherwise, it proceeds to the process of SB207.
[0067] In step SB206, the control unit B101 updates the distribution comment information based on the comment control information received in step SB205.
[0068] Figure 4 is an example of the information stored in the memory B102 of the server device B100.
[0069] The distribution comment management table 400 shown in Figure 4 is a table for managing the comment information during distribution. The distribution comment management table 400 is composed of at least a combination of a comment ID 401, a poster ID 402, a stress state at the time of posting 403, distribution availability information 404, and a comment content 405.
[0070] The comment ID 401 is information for uniquely identifying the comment received during distribution.
[0071] The submitter ID 402 represents the user information of the user who submitted the comment, and is the user ID of the client device that sent the comment.
[0072] The stress state 403 at the time of submission represents the stress state of the user when inputting the comment who sent the comment from the client device. The stress state corresponds to the one calculated in step SB206 in FIG. 2.
[0073] The distribution permission information 404 is information for determining whether to distribute the comment. For example, a comment registered with the distribution permission information 404 as "no" will not be distributed to client devices other than the submitter, and will not be displayed on the distribution comment screen of each viewer.
[0074] The comment content 405 is the comment content sent by the user. The content entered in the comment input field 504 at the timing when the user presses the comment send button 505 in FIG. 5 corresponds to this.
[0075] An example of the update of the distributed comment information in step SB206 will be described with reference to FIG. 4.
[0076] For example, consider the case where the control unit A101 sends a setting of "do not distribute the comment with comment ID = 5" in step SA214. At this time, the control unit B101 sets the "distribution permission information of comment ID = 5" in the distributed comment management table 400 from "yes" to "no". The control unit B101 performs processing such that a comment with the distribution permission information being "no" in the distributed comment management table 400 is not displayed in the comment column of distribution viewers other than the comment submitter.
[0077] Return to the flowchart of FIG. 2. At step SB207, control unit B101 determines whether it has received comment information from client device A100 via communication unit B112. If control unit B101 determines that it has received the comment information, it proceeds to the process of step SB208; otherwise, it proceeds to the process of SB210.
[0078] At step SB208, control unit B101 calculates the stress state of the user based on the healthcare information included in the comment information received in step SB207. Note that a known algorithm is applied for calculating the stress state, and the description thereof is omitted here.
[0079] At step SB209, control unit B101 updates the distributed comment information.
[0080] The update of the distributed comment information in step SB209 will be described with reference to FIG. 4.
[0081] First, comment information up to comment ID = 1, 2 is registered in distribution comment table 400. In step SB207, for example, it receives "poster ID = userC" and "comment content = 'useless'" together with healthcare information. Next, assume that in step SB208, the stress state is calculated as "high" from the healthcare information. At this time, control unit B101 sets "comment ID = 3, poster ID = userC, stress state at posting = high, distributable = no, comment content = 'useless'" in the distributed comment management table. Thus, when registering in the distributed comment management table, it is a feature of this embodiment to pre-set the distributable setting to "no" when the stress state = high.
[0082] FIG. 5 is an example of the distributed comment screens of distributor userA, viewers userB and userC during distribution.
[0083] The distribution comment screens A500, B500, and C500 are each composed of at least a combination of a poster icon 501, a comment display box 502, and a stress state at the time of comment posting 503.
[0084] A501, B501, and C501 are icons displayed on the distribution comment screens of userA, userB, and userC respectively. The poster status display 503 corresponds to the stress information on the distribution comment management table 400.
[0085] The comment poster icon 501 is the icon of the account that posted the comment. The comment poster icon 501 corresponds to the poster ID on the distribution comment management table.
[0086] The comment display box 502 is a UI that displays the comment content.
[0087] The stress state at the time of comment posting 503 represents the stress state of the user at the time of comment posting. The content of the comment display box 502 corresponds to the comment content on the distribution comment management table 400. The stress state at the time of comment posting 503 can be displayed mainly only by the distributor.
[0088] The comment input box 504 is a UI for inputting comments.
[0089] The comment send button 505 is a button for sending comments. When the client device A100 detects the pressing of the comment send button 505 while a value is input in the comment input box, it determines that it is a comment sending operation by the user. The client device A100 transmits the content input in the comment input box to the server device B100 based on the determination of the comment sending operation.
[0090] Using FIG. 5, the display results of the processes in steps SB205 to SB209 will be described.
[0091] The distribution comment screen A500 of the distributor userA can display stress information 503 associated with each comment simultaneously with the poster icon 501 and the comment content 502, separately from viewers userB and userC.
[0092] By the process of step SB204, the comment with comment ID = 5 in the distribution comment management table 400 (「The subsequent development is △△」@userC) is displayed on the distribution comment screen C500 of the poster himself / herself, but not on the distribution comment screen B500 of other viewers.
[0093] Also, by the process of step SB205, the comment with comment ID = 3 in the distribution comment management table 400 (「Useless」@userC) is displayed on the distribution comment screen C500 of the poster himself / herself, but not on the distribution comment screen B500 of other viewers.
[0094] Returning to Figure 2, in step SB210, the control unit B101 determines whether it has received a distribution stop request from the client device A100 via the communication unit B111. If the control unit B101 determines that it has received the distribution stop request, it proceeds to the process of step SB211; otherwise, it proceeds to the process of step SB203.
[0095] In step SB211, the control unit B101 stops the distribution. The distribution stop process performs, for example, a process of stopping the reception of video responses for distribution viewing. Also, depending on the settings of the distributor, an archiving operation or the like may be performed.
[0096] In step SB212, the control unit B101 transmits a distribution stop response to the client device A100 via the communication unit B111. After transmitting the distribution stop response, the control unit B101 returns to the process of step SB201.
[0097] The above is the description regarding the operation of the server device B100 that distributes the video in Figure 2 of the present embodiment.
[0098] SA301 to SA314 in FIG. 3 represent the operations of the client device A100 that views the distribution in this embodiment. Note that the processes shown in this flowchart are realized by the control unit A101 of the client device A100 controlling each part of the client device A100 according to an input signal and a program.
[0099] In FIG. 3, steps SA301 to SA306 are general operations as a client device for viewing video distribution. Also, steps SA307 to SA312 are operations characteristic of the client device according to claims 1 to 4.
[0100] In step SA301, the control unit A101 determines whether it has received a video playback operation from the user via the operation unit A104. If the control unit A101 determines that it has received a video playback operation, it proceeds to the process of step SA302; otherwise, it repeats the process of step S301 again.
[0101] In step SA302, the control unit A101 transmits a video request to the server device B100 via the wireless LAN unit A112.
[0102] In step SA303, the control unit A101 determines whether it has received a video response from the server device B100 via the wireless LAN unit A112. If the control unit A101 determines that it has received a video response, it proceeds to the process of step SA304; otherwise, it repeats the process of SA303 again.
[0103] In step SA304, the control unit A101 starts playing the video included in the video response received in step SA303.
[0104] In step SA305, the control unit A101 determines whether it has received a video stop operation from the user via the operation unit A104. If the control unit A101 determines that it has received a video stop operation, it proceeds to the process of step SA306; otherwise, it proceeds to the process of SA307.
[0105] In step SA306, the control unit A101 performs operation playback stop processing (such as updating video playback information).
[0106] Since step SA307 is the same as step SA209, the description thereof is omitted.
[0107] Since step SA308 is the same as step SA210, the description thereof is omitted.
[0108] Since step SA309 is the same as step SA211, the description thereof is omitted.
[0109] Since step SA310 is the same as step SA212, the description thereof is omitted.
[0110] Since step SA311 is the same as step SA213, the description thereof is omitted.
[0111] Since step SA312 is the same as step SA214, the description thereof is omitted.
[0112] The above is the description of the operation of the client device for viewing the distributed video in this embodiment.
[0113] Subsequently, SB301 to SB307 in FIG. 3 represent the operations of the server device B100 that distributes the video of this embodiment. Note that the server device B100 described in FIG. 3 is the same device as the server device B100 described in FIG. 2.
[0114] In FIG. 3, steps SB301 to 302 are general operations as a server device that distributes video. Also, SB303 to SB307 are operations characteristic of the server device of claims 9 to 11, 13.
[0115] In step SB301, the control unit B101 determines whether it has received a video request from the client device A100 via the communication unit B111. If the control unit B101 determines that it has received the video request, the process proceeds to step SB302. Otherwise, the process of step SB301 is repeated again.
[0116] In step SB302, the control unit B101 transmits a video response to the client device A100 via the communication unit B111.
[0117] Step SB303 is the same as step SB205, so the description is omitted.
[0118] Step SB304 is the same as step SB206, so the description is omitted.
[0119] Step SB305 is the same as step SB207, so the description is omitted.
[0120] Step SB306 is the same as step SB208, so the description is omitted.
[0121] Step SB307 is the same as step SB209, so the description is omitted.
[0122] The above is the description of the operation of the server device B100 that distributes the video in FIG. 3 of the present embodiment.
[0123] Thus, the client device A100 of this embodiment acquires health care information (such as heart rate) when the user posts a comment and transmits it to the server device B100. Further, the server device B100 calculates the stress state from the health care information received from the client device. Then, the server device B100 determines whether the comment can be distributed based on the calculated stress state. Thereby, it is possible to prevent other users from seeing comments (such as unpleasant comments like slander and libel) made by the user when angry. In addition, the client device A100 can confirm the reaction of the user during distribution together with the comment text by displaying the stress state at the time of comment posting only to the distributor. Thereby, it is possible to quickly detect a user who may become radical as the distribution progresses even though there seems to be no problem in the text, and it is possible to control the comment distribution of the corresponding user in advance.
[0124] (Second Embodiment) In this embodiment, for example, comments from users with a high stress state are not distributed. In this embodiment, an example will be described in the case of the information processing apparatus according to claims 1 to 3 and 5 (hereinafter, the client device) and the information processing apparatus according to claims 9, 11 to 13 (hereinafter, the server device).
[0125] The main processing is the same as that in the first embodiment. The difference from the first embodiment is that the client device A100 calculates stress information and transmits it to the server device B100.
[0126] <Configuration of Each Device> Since the client device A100, the server device B100, and the controller C100 in this embodiment are the same as those in the first embodiment, the description thereof will be omitted.
[0127] <Configuration and Operation of Each Device> The operations of the client device A100 and the server device B100 in this embodiment will be described with reference to the flowcharts of FIGS. 6 to 7. Since the distributed comment management table and the example of the distributed comment screen in this embodiment are the same as those in the first embodiment, the description thereof will be omitted.
[0128] SA601 to SA615 in FIG. 6 represent the operations of the client device A100 that transmits the distribution video in the present embodiment. Note that the processes shown in this flowchart are realized by the control unit A101 of the client device A100 controlling each part of the client device A100 according to an input signal and a program.
[0129] In FIG. 6, steps SA601 to SA608 are general operations as a client device for transmitting the distribution video to the video distribution server. Also, steps SA607 to SA215 are characteristic operations of the client device according to claims 1 to 3 and 5.
[0130] Step SA601 is the same as step SA201, so the description is omitted.
[0131] Step SA602 is the same as step SA202, so the description is omitted.
[0132] Step SA603 is the same as step SA203, so the description is omitted.
[0133] Step SA604 is the same as step SA204, so the description is omitted.
[0134] Step SA605 is the same as step SA205, so the description is omitted.
[0135] Step SA606 is the same as step SA206, so the description is omitted.
[0136] Step SA607 is the same as step SA207, so the description is omitted.
[0137] Step SA608 is the same as step SA208, so the description is omitted.
[0138] Step SA609 is the same as step SA209, so the description is omitted.
[0139] Step SA610 is the same as step SA210, so the description thereof is omitted.
[0140] In step SA611, the control unit A101 calculates the stress state of the user based on the healthcare information obtained in step SA610. Note that a known algorithm is applied for calculating the stress state, and the description thereof is omitted here.
[0141] Step SA612 is the same as step SA211, so the description thereof is omitted.
[0142] In step SA613, the control unit A101 transmits comment information to the server device B100 via the wireless LAN unit A112. The comment information includes, for example, the user's account information (such as ID) and the stress state calculated in step SA611.
[0143] Step SA614 is the same as step SA213, so the description thereof is omitted.
[0144] Step SA615 is the same as step SA214, so the description thereof is omitted.
[0145] The above is the description regarding the operation of the client device for transmitting the distribution video in the present embodiment.
[0146] Subsequently, SB601 to SB611 in FIG. 6 represent the operation of the server device B100 for distributing the video of the present embodiment. Note that the processing shown in this flowchart is realized by the control unit B101 of the server device B100 controlling each part of the server device B100 according to an input signal and a program.
[0147] In FIG. 6, steps SB601 to 604 and steps SB609 to SB611 are general operations as a server device for distributing a video. Further, SB605 to SB608 are operations characteristic of the server device according to claims 9, 11 to 13.
[0148] Step SB601 is the same as step SB201, so the description thereof is omitted.
[0149] Step SB602 is the same as step SB202, so the description thereof is omitted.
[0150] Step SB603 is the same as step SB203, so the description thereof is omitted.
[0151] Step SB604 is the same as step SB204, so the description thereof is omitted.
[0152] Step SB605 is the same as step SB205, so the description thereof is omitted.
[0153] Step SB606 is the same as step SB206, so the description thereof is omitted.
[0154] In step SB607, the control unit B101 determines whether it has received comment information from the client device A100 via the communication unit B112. If the control unit B101 determines that it has received the comment information, it proceeds to the process of step SB608; otherwise, it proceeds to the process of SB609. The comment information includes, for example, the stress state calculated in step SA611.
[0155] Step SB609 is the same as step SB210, so the description thereof is omitted.
[0156] Step SB610 is the same as step SB211, so the description thereof is omitted.
[0157] Step SB610 is the same as step SB212, so the description thereof is omitted.
[0158] The above is the description of the operation of the server device B100 that distributes the video of the present embodiment in FIG. 6.
[0159] SA701 to SA713 in FIG. 7 represent the operations of the client device A100 that views the distributed video in the present embodiment. Note that the processes shown in this flowchart are realized by the control unit A101 of the client device A100 controlling each part of the client device A100 according to an input signal and a program.
[0160] In FIG. 2, steps SA701 to SA706 are general operations as a client device for transmitting a distributed video to a video distribution server. Also, steps SA707 to SA713 are characteristic operations of the client devices of claims 1 to 3 and 5.
[0161] Step SA701 is the same as step SA301, so the description is omitted.
[0162] Step SA702 is the same as step SA302, so the description is omitted.
[0163] Step SA703 is the same as step SA303, so the description is omitted.
[0164] Step SA704 is the same as step SA304, so the description is omitted.
[0165] Step SA705 is the same as step SA305, so the description is omitted.
[0166] Step SA706 is the same as step SA306, so the description is omitted.
[0167] Step SA707 is the same as step SA307, so the description is omitted.
[0168] Step SA708 is the same as step SA308, so the description is omitted.
[0169] Step SA709 is the same as step SA611, so the description is omitted.
[0170] Step SA710 is the same as step SA311, so the description thereof is omitted.
[0171] Step SA711 is the same as step SA312, so the description thereof is omitted.
[0172] The above is the description of the operation of the client device A100 that views the distributed video in the present embodiment.
[0173] Subsequently, SB701 to SB706 in FIG. 7 represent the operation of the server device B100 that distributes the video of the present embodiment. Note that the processes shown in this flowchart are realized by the control unit B101 of the server device B100 controlling each part of the server device B100 according to an input signal and a program.
[0174] In FIG. 7, steps SB701 to 702 are general operations as a server device that distributes a video. Also, SB704 to SB706 are operations characteristic of the server device according to claims 9, 11 to 13.
[0175] Step SB701 is the same as step SB301, so the description thereof is omitted.
[0176] Step SB702 is the same as step SB302, so the description thereof is omitted.
[0177] Step SB703 is the same as step SB303, so the description thereof is omitted.
[0178] Step SB704 is the same as step SB304, so the description thereof is omitted.
[0179] Step SB705 is the same as step SB607, so the description thereof is omitted.
[0180] Step SB706 is the same as step SB608, so the description thereof is omitted.
[0181] The above is a description of the operation of the server device B100 that distributes moving images according to this embodiment in FIG.
[0182] In this way, the client device A100 in this embodiment calculates the stress state of the user at the time of posting a comment and transmits it to the server device B100. The server device B100 also determines whether to distribute the comment based on the stress state received from the client device. This makes it possible to prevent comments posted by a user in an angry state (unpleasant comments such as slander) before they are seen by other users. Furthermore, the client device A100 displays the stress state at the time of posting the comment only to the distributor, so that the user's reaction while watching the distribution can be confirmed along with the comment text. This makes it possible to quickly detect users who may seem fine in terms of their text but who are likely to become more extreme as the distribution progresses, and to control the distribution of comments from the relevant users in advance.
[0183] (Third embodiment) In this embodiment, for example, whether or not to distribute a comment is determined based on the unpleasantness level of a viewed comment. For example, whether or not to distribute a comment is determined based on the unpleasantness level of a viewed comment.
[0184] In this embodiment, a case will be described as an example in which the information processing devices of claims 6 to 8 (hereinafter, client devices) and the information processing device of claim 14 (hereinafter, server device) are used.
[0185] <Configuration of each device> FIG. 8 is a block diagram showing the overall configuration of the system according to this embodiment.
[0186] In the description of the client device A100, the description of the same parts as those in the A100 of the first embodiment will be omitted, and only the differences will be described. The server device B100 and the wearable device C100 are the same as those in the first embodiment, and therefore the description will be omitted.
[0187] The line-of-sight detection unit A807 is a processing unit that detects the line of sight and blinks of the user during video distribution under the control of the control unit A101. The control unit A101 detects, for example, by a method called the corneal reflection method. The corneal reflection method is a method of detecting the direction and position of the line of sight from the positional relationship between the reflected light (especially the reflected light reflected by the cornea) of the infrared light reflected by the user's eyeball and the pupil of the eyeball. Note that various methods for specifying the direction and position of the line of sight can be used, not limited to the corneal reflection method. Also, the user's line of sight may be detected for the operation of the client device A100.
[0188] The above is the description of the client device A100 in the present embodiment.
[0189] <Operations of Each Device> The operations of the client device A100 and the server device B100 in the present embodiment will be described with reference to the flowchart of FIG. 9 and the diagrams of FIGS. 10 to 12.
[0190] SA901 to SA915 in FIG. 9 represent the operations of the client device A100 that transmits the distribution video in the present embodiment. Note that the processing shown in this flowchart is realized by the control unit A101 of the client device A100 controlling each part of the client device A100 according to an input signal and a program.
[0191] In FIG. 9, steps SA901 to SA908 are general operations as a client device for transmitting the distribution video to the video distribution server. Also, steps SA909 to SA915 are operations characteristic of the client device according to claims 6 to 8.
[0192] Step SA901 is the same as step SA601, so the description is omitted.
[0193] Step SA902 is the same as step SA602, so the description is omitted.
[0194] Step SA903 is the same as step SA603, so the description is omitted.
[0195] Step SA904 is the same as step SA604, so the description is omitted.
[0196] Step SA905 is the same as step SA605, so the description is omitted.
[0197] Step SA906 is the same as step SA606, so the description is omitted.
[0198] Step SA907 is the same as step SA607, so the description is omitted.
[0199] Step SA908 is the same as step SA608, so the description is omitted.
[0200] In step SA909, the control unit A101 detects the viewer's line-of-sight information via the line-of-sight detection unit A102. The line-of-sight information is the viewer's line-of-sight position.
[0201] In step SA910, the control unit A101 uses the line-of-sight information detected in step SA909 and the display position information of the comment displayed on the display unit A105 to detect the viewed comment (= the comment the user is looking at). When the control unit A101 detects the viewed comment, it proceeds to the process of step SA911, and otherwise returns to the process of step SA905.
[0202] Step SA911 is the same as step SA610, so the description is omitted.
[0203] Step SA912 is the same as step SA611, so the description is omitted.
[0204] In step SA913, the control unit A101 transmits the viewing comment information to the server device B100 via the wireless LAN unit A112. The viewing comment information includes, for example, the comment ID of the viewing comment detected in step SA910 and the stress information calculated in step SA912.
[0205] Step SA914 is the same as step SA614, so the description is omitted.
[0206] Step SA915 is the same as step SA615, so the description is omitted.
[0207] The above is the description of the operation of the client device A100 that transmits the distribution video in this embodiment.
[0208] Subsequently, SB901 to SB912 in FIG. 9 represent the operation of the server device B100 that distributes the video of this embodiment. The processes shown in this flowchart are realized by the control unit B101 of the server device B100 controlling each part of the server device B100 according to an input signal and a program.
[0209] In FIG. 9, steps SB901 to 904 and steps SB910 to SB912 are general operations as a server device that distributes video. Also, SB905 to SB909 are operations characteristic of the server device of claim 14.
[0210] Step SB901 is the same as step SB601, so the description is omitted.
[0211] Step SB902 is the same as step SB602, so the description is omitted.
[0212] Step SB903 is the same as step SB603, so the description is omitted.
[0213] Step SB904 is the same as step SB604, so the description is omitted.
[0214] Step SB905 is the same as step SB605, so the description thereof is omitted.
[0215] Step SB906 is the same as step SB606, so the description thereof is omitted.
[0216] In step SB907, the control unit B101 determines whether it has received the view comment information from the client device A100 via the communication unit B112. If the control unit B101 determines that it has received the view comment information, it proceeds to the process of step SB908; otherwise, it proceeds to the process of SB910.
[0217] In step SB908, the control unit B101 calculates a view comment impression value using the comment ID received in step SB907 and the stress information. The view comment impression value is, for example, the degree of discomfort when viewing a comment, and is expressed as a score from 0 to 100. The method for calculating the view comment impression value is, for example, when the received stress information is "high", a process of adding a predetermined value to the score of the view impression value (degree of discomfort).
[0218] In step SB909, the control unit B101 updates the distributed comment information using the view comment impression value calculated in step SB908.
[0219] FIG. 10 is an example of information stored in the memory B102 of the server device B100.
[0220] The distributed comment management table 1000 shown in FIG. 10 is a table for managing comment information during distribution. The distributed comment management table 1000 is composed of at least a combination of a comment ID 1001, a poster ID 1002, a view comment impression value (degree of discomfort) 1003, distribution permission information 1004, and a comment content 1005.
[0221] The comment ID 1001 is the same as the comment ID 401, so the description thereof is omitted.
[0222] Since Submitter ID 1002 is the same as Submitter ID 402, the explanation thereof is omitted.
[0223] The view comment impression value (discomfort level) 1003 represents the impression (e.g., whether the user feels uncomfortable) when the user views a comment. The view comment impression value (discomfort level) corresponds to the value calculated in step SB908 in FIG. 9.
[0224] Since the distribution availability information 1004 is the same as the distribution availability information 404, the explanation thereof is omitted.
[0225] Since the comment content 1005 is the same as the comment content 405, the explanation thereof is omitted.
[0226] An example of the update of the distributed comment information in step SB909 will be described with reference to FIG. 10.
[0227] For example, assume that in the process of step SB908, the view comment impression value (discomfort level) for the comment with Comment ID = 5 (「useless」@userC) is updated from 「20」 to 「79」. At this time, the control unit B101 sets the 「distribution availability information for Comment ID = 3」 in the distributed comment management table 1000 from 「yes」 to 「no」. Also, assume that the threshold value of the view comment impression value (discomfort level) for which the control unit B101 updates the distribution availability information can be set by the user in advance. The control unit B101 performs processing such that comments with 「no」 in the distribution availability information in the distributed comment management table 1000 are not displayed in the comment columns of distribution viewers other than the comment submitter.
[0228] Thus, a feature of this embodiment is that when the view comment impression value (discomfort level) becomes equal to or greater than a predetermined threshold value, the distribution availability information of the comment is automatically updated.
[0229] FIG. 11 is an example of the comment screens of the distributor at the time of distribution, the viewer before the update of the distribution availability information, and the viewer after the distribution availability information is updated by step SB909, respectively.
[0230] The distribution comment screens A1100, B1100, and C1100 are each composed of at least a combination of a poster icon 1101, a comment display box 1102, and a comment impression value 1103.
[0231] A1101, B1101, and C1101 are icons displayed on the distribution comment screens of userA, userB, and userC respectively. The comment impression value 1103 corresponds to the viewed comment impression value (discomfort level) on the distribution comment management table 1100.
[0232] Since the comment poster icon 1101 is the same as the comment poster icon 501, the description thereof is omitted.
[0233] Since the comment display box 1102 is the same as the comment display box 502, the description thereof is omitted.
[0234] The comment impression value 1103 represents the impression when the user views the comment. The comment impression value 1103 can mainly be displayed only by the distributor.
[0235] Since the comment input box 1104 is the same as the comment input box 504, the description thereof is omitted.
[0236] Since the comment send button 1105 is the same as the comment send button 505, the description thereof is omitted.
[0237] Using FIG. 11, the display results of the processes in steps SB907 to SB909 will be described.
[0238] The distributor's distribution comment screen A1100 can display the comment impression value 1103 associated with each comment simultaneously with the poster icon 1101 and the comment content 1102 separately from the viewers' distribution comment screens B1100 and C1100.
[0239] First, assume that the comment with comment ID=3 in broadcast comment management table 1100 ("Poorly written" @userC) has a viewed comment impression value (displeasure level) of "20" / broadcast suitability information = "OK". At this time, the comment with comment ID=3 ("Poorly written" @userC) is displayed on broadcast comment screen A1100 and broadcast comment screen B1100. Next, by processing in step SB909, the viewed comment impression value (displeasure level) is updated to "79" / broadcast suitability information = "No". As a result, the comment with comment ID=3 ("Poorly written" @userC) in broadcast comment management table 1000 will not be displayed on the viewer's broadcast comment screen C1100 after the broadcast suitability information has been updated.
[0240] Returning to FIG. 9, step SB910 is similar to step SB609, and therefore the description thereof will be omitted.
[0241] Step SB911 is similar to step SB610, so the description thereof will be omitted.
[0242] Step SB912 is similar to step SB611, so the description thereof will be omitted.
[0243] The above is a description of the operation of the server device B100 that distributes moving images in FIG. 9 according to this embodiment.
[0244] In this way, the client device A100 in this embodiment calculates the stress state of the user when viewing the comment and transmits it to the server device B100. Furthermore, the server device B100 determines whether or not to distribute the comment based on the stress state when viewing the comment received from the client device. This makes it possible to detect and hide comments that offend other users even if the comment has been distributed. This makes it possible to reduce the number of users who view the offending comments. Furthermore, since the distributor can check the reaction of users to the comments while viewing the distribution, it is possible to prevent comments that offend the viewer from being distributed in advance.
[0245] (Embodiment 4) This embodiment controls the display of comments based on, for example, the unpleasantness of the viewed comments.
[0246] In this embodiment, in the client device and the server device similar to those in Example 3, different display examples of the distributed comment screen will be described.
[0247] The distributed comment screen described in Example 3 exists separately from the distributed video screen as shown in FIG. 11, and is an example in the case where the layout of each comment is fixed.
[0248] In this embodiment, in the case of a display where the distributed comment information is superimposed on the distributed video as shown in FIG. 13, a display example when the comment superimposition position is changed based on the impression value (for example, unpleasantness) at the time of viewing the comment will be described.
[0249] <Configuration of Each Device> Since the client device A100, the server device B100, and the controller C100 in this embodiment are the same as those in Example 3, the description thereof will be omitted.
[0250] <Operations of Each Device> Since the operations of the client device A100 and the server device B100 in this embodiment are the same as those in Example 3, the description thereof will be omitted, and only the changes in the distributed comment screen before and after the distributed comment management table 1100 is updated will be described.
[0251] FIG. 12 is an example of information stored in the memory B102 of the server device B100.
[0252] The distributed comment management tables A1200 and B1200 shown in FIGS. 12(A) to (B) are tables for managing the comment information during distribution. It is composed of a combination of a comment ID 1201, a poster ID 1202, a viewed comment impression value (unpleasantness) 1203, and a comment content 1204.
[0253] Since the comment ID 1201 is the same as the comment ID 401, the description thereof will be omitted.
[0254] Since the contributor ID 1202 is the same as the contributor ID 402, the explanation is omitted.
[0255] Since the view comment impression value (discomfort level) 1203 is the same as the view comment impression value (discomfort level) 1003, the explanation is omitted.
[0256] Since the comment content 1004 is the same as the comment content 405, the explanation is omitted.
[0257] Figures 13(A) to (B) show the viewer's distribution comment screen displayed on the display unit A105 of the client device A100.
[0258] Figure 13(A) shows the distribution screen immediately after the comments with comment IDs = 1 to 5 are registered in the distribution comment management table A1200, that is, before the view comment impression value (discomfort level) is updated.
[0259] Figure 13(B) shows the distribution screen after the view comment impression value (discomfort level) is updated for each comment as shown in the distribution picture comment management table B1200 by the processing of the control unit B101.
[0260] A1300 and B1300 are the distribution screens before and after the view comment impression value (discomfort level) is updated, respectively.
[0261] A1301 and B1301 are the display results superimposed on the distribution screen based on the view impression value (discomfort level) of comment ID = 2 ("Amazing!" @userB) in Figures 12(A) to (B), respectively.
[0262] A1302 and B1302 are the display results superimposed on the distribution screen based on the view impression value (discomfort level) of comment ID = 5 ("Terrible" @userC) in Figures 12(A) to (B), respectively.
[0263] An operation example when displaying the distributed comments in this embodiment will be described with reference to FIGS. 12 and 13.
[0264] The distributed comment management table A1200 shows a situation where comments with comment IDs = 1 to 5 are registered in the distributed comment management table A1200 at substantially the same timing. At this time, the viewing impression value (discomfort level) of each comment is set to an initial value (for example, "0").
[0265] As a result, on the viewer distributed comment screen A1300, the comments with comment IDs = 1 to 5 in FIG. 12(A) are superimposed at an appropriate position (for example, a position where the comment contents do not overlap) with the same character size.
[0266] Next, when the comments are distributed to the client devices of the distributed viewers, various viewers view the comments. And it is assumed that the viewing impression value (discomfort level) of each comment is updated to a value as shown in the distributed comment management table B1200 by the process (step SB909) of the control unit B101. For example, as a result of the update, the viewing impression value (discomfort level) of comment ID = 2 ("Amazing!" @userB) becomes lower than other values, and the viewing impression value (discomfort level) of comment ID = 3 ("Terrible" @userC) becomes higher as a result of the update.
[0267] As a result, the display of comment ID = 2 ("Amazing!" @userB) is superimposed at a position larger than A1301 and easier for the viewer to notice as shown in B1301. On the contrary, the display of comment ID = 3 ("Terrible" @userC) is superimposed at a position smaller than A1302 and harder for the viewer to notice as shown in B1302.
[0268] The above is the description of the display example when changing the comment superimposition position based on the viewing impression value (discomfort level) of the comments in this embodiment.
[0269] In this way, the server device B100 in the present embodiment determines the superimposed size and position of the comment using the impression information when viewing the distributed comment. That is, without making the comment itself that makes other viewers uncomfortable invisible, it makes it difficult for other viewers to recognize the comment content.
[0270] As a result, even in a distribution where it is difficult to reduce the number of display comments on the screen that superimpose comments on the distribution screen, it is possible to suppress viewers from seeing comments that make them uncomfortable.
[0271] As described above, the preferred embodiments of the present invention have been described. However, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist thereof.
Description of reference numerals
[0272] A100 Client device A101 Control unit A102 Memory A103 Non-volatile memory A104 Operation unit A106 Recording medium A112 Wireless LAN unit A113 Short-range wireless unit
Claims
1. A client device capable of viewing online distribution, comprising: a healthcare information acquisition means for acquiring user's healthcare information; a comment input means for inputting a comment on the distribution being viewed; a comment transmission means for transmitting the input comment and the user state at the time of comment input, characterized in that it is an information processing device.
2. The client device according to claim 1, wherein the healthcare information includes at least a pulse / heart rate, characterized in that it is an information processing device.
3. The client device according to claim 1 or 2, comprising: a communication means for communicating with an external wearable controller; wherein the healthcare information acquisition means acquires healthcare information from the wearable controller via the communication means, characterized in that it is an information processing device.
4. The client device according to any one of claims 1 to 3, wherein the user state transmitted by the comment transmission means is the healthcare information obtained from the healthcare information acquisition means, characterized in that it is an information processing device.
5. The client device according to any one of claims 1 to 3, comprising a stress state acquisition means for acquiring a stress state from the healthcare information; wherein the user state transmitted by the comment transmission means is the stress state acquired by the stress state acquisition means, characterized in that it is an information processing device.
6. The client device according to any one of claims 1 to 5, comprising a gaze detection means for detecting the user's gaze; a viewed comment detection means for detecting a comment viewed by the user from the user's gaze; a viewed comment transmission means for transmitting the viewed comment and the healthcare information at the time of comment viewing as the user state; characterized in that it is an information processing device.
7. The client device according to any one of claims 1 to 6, comprising a comment overall impression reception means for receiving a comment overall impression value calculated from the user state; a comment overall impression display means for displaying the comment impression received from the comment impression reception means; characterized in that it is an information processing device.
8. The client device according to any one of claims 1 to 7, comprising a comment control transmission means for transmitting comment control information from the user, characterized in that it is an information processing device.
9. A server device for performing online distribution of content and comments, Distribution means for distributing content to one or more client devices Comment receiving means for receiving comments from each client device during distribution and the user state at the time of comment input Stress state acquisition means for acquiring the stress state of the user from the user state Comment distribution control means for controlling the comment distribution destination for comments whose stress state is equal to or higher than a threshold value An information processing apparatus comprising the same
10. The server device according to claim 9, An information processing apparatus characterized in that the user state acquired by the comment acquisition means is the user's healthcare information
11. The server device according to claim 10, An information processing apparatus characterized in that the healthcare information includes at least the pulse / heart rate
12. The server device according to claim 9, An information processing apparatus characterized in that the user state acquired by the comment acquisition means is the stress state of the user
13. The server device according to any one of claims 9 to 12, Comment control reception means for receiving comment control information from the user Comment distribution control means for controlling the comment distribution destination from the comment control information An information processing apparatus comprising the same
14. The server device according to any one of claims 9 to 13, Viewing comment receiving means for receiving the user state at the time of viewing comments Comment comprehensive impression acquisition means for acquiring the comprehensive impression value of the comment from the user state at the time of viewing the comment Comment comprehensive impression transmission means for transmitting the impression value of the comment to a specific user An information processing apparatus comprising the same
15. An online distribution system, An information processing system comprising the client device according to claims 1 to 4, 6 to 7 And the server device according to claims 9 to 11, 13 to 14
16. An online distribution system, An information processing system comprising the client device according to claims 1 to 3, 5 to 7 And the server device according to claims 9, 11 to 14
Citation Information
Patent Citations
Stress state evaluation apparatus, stress state evaluation system, and program
JP2019195427A
Information processing apparatus, information processing method, and program for information processing
JP2020013328A