Program, computer readable recording medium, system, and method
By allowing users to reflect their reactions through image insertion in live streams, the program enhances user participation and immersion in live broadcasts.
Patent Information
- Application Number
- JP2023083358
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-19
- Publication Date
- 2024-11-29
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
In existing live distribution via the Internet, users often feel isolated and unable to participate in the broadcast, lacking a sense of immersion due to unilateral viewing.
A program and system that allows users to reflect their reactions on a first application to a live distribution image of a second application through a chat function with reaction buttons, enabling the insertion of images into the live stream to enhance participation and immersion.
Users can more easily feel involved in the live distribution by seeing their reactions reflected in the live stream, deepening their sense of participation and immersion in the virtual community.
Smart Images

Figure 2024166924000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a program, a computer-readable recording medium, a system and a method. [Background technology]
[0002] 2. Description of the Related Art Conventionally, as disclosed in Patent Document 1, a technique has been known in which a distributor performs live distribution via the Internet. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent Publication No. 2022-75401 Summary of the Invention [Problem to be solved by the invention]
[0004] However, the technology for live streaming over the Internet as described in Patent Document 1 has the problem that the live streaming tends to be viewed one-sidedly by users, making it difficult for users watching the live streaming to feel like they are participating in the streaming.
[0005] The present invention has been made to solve such problems, and aims to provide a program, a computer-readable recording medium, a system, and a method that make it easier for users to get the feeling that they are participating in a live broadcast. [Means for solving the problem]
[0006] In order to achieve the above-mentioned objective, according to one embodiment of the present invention, there is provided a program for reflecting a user's reaction on a first application in a live streaming image used in a second application, wherein the first application has a chat function, a function for posting a specific post on the chat using an API, and a function for placing a reaction button within the specific post as a button for receiving a user's reaction, and the second application has a function for live streaming using the live streaming image, and the program is characterized by causing a computer to execute a function for placing the reaction button, which has a function for reflecting a specific image in the live streaming image of the second application, on the specific post in the chat of the first application. According to one embodiment of the present invention configured as described above, the program causes a computer to execute a function of placing the reaction button, which has a function of reflecting a predetermined image in the live streaming image of the second application in response to an operation by a specific user, in the predetermined post in the chat of the first application. This makes it easier for a user to feel like they are participating in a live streaming event by inserting a predetermined image from the predetermined post in the chat of the first application into the live streaming image of the second application. In addition, it is easier for a user to feel more immersed in a virtual community formed by live streaming and chat.
[0007] According to one embodiment of the present invention, preferably, the program causes the computer to execute a function of placing the reaction button, having a function of reflecting a predetermined image in the live streaming image of the second application, in the predetermined posted article in the chat of the first application, by executing the following steps: a posting step of posting the predetermined posted article equipped with the reaction button in a chat; a monitoring step of monitoring whether the reaction button of the predetermined posted article has been pressed by a user; and, when it is recognized by the monitoring step that the reaction button has been pressed, a combining step of combining an image corresponding to the pressed reaction button with the live streaming image used in the second application. According to one embodiment of the present invention configured as described above, the program allows a computer to execute a step of synthesizing an image corresponding to a pressed reaction button on the live streaming image used in the second application based on information that a reaction button of a posted article in a chat of the first application has been pressed. This allows the user's reaction to the reaction button on the first application to be reflected in the live streaming image used in the second application. Therefore, it is possible for a user to more easily get the feeling that he or she is participating in a live streaming by reflecting a predetermined image from a predetermined posted article on the chat of the first application on the live streaming image of the second application. In addition, it is possible to more easily deepen the sense of immersion in a virtual community formed by users' live streaming and chat.
[0008] According to one embodiment of the present invention, preferably, the monitoring step continues to monitor the reaction button of the specified posted article posted by the posting step, even if another article is posted on the chat of the first application by means other than the program. According to one embodiment of the present invention configured in this manner, the monitoring step continues to monitor the reaction button of the specific posted article posted by the posting step even if another article is posted on the chat of the first application by a means other than the program. This allows the program to continue to monitor the specific posted article with the reaction button set even if another article is posted, and allows the user's reaction operation to a specific article to be reflected more directly in the live broadcast.
[0009] According to one embodiment of the present invention, preferably, when the posting step causes another specified posted article to be posted on the chat, the program terminates the monitoring step and the compositing step that have already been executed, and again executes a monitoring step of monitoring whether the reaction button of the other specified posted article has been pressed by the user, and a compositing step of compositing an image corresponding to the pressed reaction button with the live streaming image used in the second application when it is recognized by this monitoring step that the reaction button has been pressed. According to an embodiment of the present invention configured as described above, when the program posts another predetermined post on the chat by the posting step, the program terminates the monitoring step and the compositing step that have already been executed, and executes again a monitoring step of monitoring whether the reaction button of the other predetermined post is pressed by the user, and a compositing step of compositing an image corresponding to the pressed reaction button with the live streaming image used in the second application when the program recognizes that the reaction button is pressed by the monitoring step. In this way, the program does not simply monitor the timeline on the chat in chronological order, but can monitor whether the reaction button is pressed by the user for the posted predetermined post. Therefore, it is possible to clearly show to the user that he or she can participate in the live streaming from a specific post on the chat, and the participation window for the user to input an image into the live streaming can be made clearer, and compared to a case where the text on the timeline on the chat is automatically posted, it is possible to easily give the user the awareness that he or she is participating in (or influencing) the live streaming by his or her own operation.
[0010] According to one embodiment of the present invention, preferably, the predetermined post posted in the posting step is provided with a plurality of reaction buttons. According to one embodiment of the present invention configured in this manner, a predetermined post article posted in the posting step is provided with a plurality of reaction buttons. This allows a user to express a variety of reactions when inputting a predetermined image into the live distribution image, making it easier for the user to participate in the live distribution by expressing a variety of intentions. For example, a variety of intentions can be expressed, such as expressing the emotions of a character or voting for or against. This can further enhance the user's immersion in the live distribution.
[0011] According to one embodiment of the present invention, the reaction button preferably includes an image icon indicating an image to be composited with the live distribution image. According to one embodiment of the present invention configured as described above, the reaction button includes an image icon showing an image to be combined with the live distribution image, which allows an unspecified number of users to easily participate and allows users to react intuitively to the image.
[0012] According to one embodiment of the present invention, preferably, in the compositing step, an image corresponding to the reaction button stored in a server executing the compositing step is composited with the image for live distribution. According to an embodiment of the present invention configured as described above, the combining step combines the image corresponding to the reaction button stored in the server that executes the combining step with the image for live streaming. This allows the image corresponding to the reaction button to be combined with the image for live streaming at a faster processing speed than when the image corresponding to the reaction button is stored in a server other than the server that executes the combining step. This improves the responsiveness from the user's operation on the reaction button to the image for live streaming of the image corresponding to the reaction button, making it easier for the user to feel like they are participating in live streaming. For example, as soon as the user presses the reaction button, the image for live streaming is combined with the image corresponding to the reaction button that was operated and displayed, making it easier for the user to feel like they are participating in live streaming.
[0013] According to one embodiment of the present invention, the synthesis step preferably changes the display position of the image corresponding to the reaction button to be synthesized in the live streaming image based on the manner in which the reaction button is pressed or the attributes of the reaction button. According to one embodiment of the present invention configured as described above, the combining step changes the display position of the image corresponding to the reaction button to be combined in the live streaming image based on the manner in which the reaction button is pressed or the attributes of the reaction button. Based on the manner in which the reaction button is pressed or the attributes of the reaction button, the user can sense the change in the display of a predetermined image, making it easier for the user to feel like they are participating in a live streaming.
[0014] According to one embodiment of the present invention, the image icon used for the reaction button can preferably be set to any image by loading it from a specified server, and the program can composite a specified image corresponding to this arbitrary image into the live streaming image. According to one embodiment of the present invention configured in this manner, an arbitrary image can be set for the image icon used for the reaction button by reading from a predetermined server, and the program can composite a predetermined image corresponding to this arbitrary image into the live streaming image. This allows an arbitrary image to be used as the image to be composited into the reaction button of a predetermined post article posted in the posting step or the image for live streaming. Therefore, a person who prepares the image for composite (e.g., a person who prepares an image for distribution or a distributor) or a user can use an arbitrary image, making it easier for the user to feel like they are participating in a live streaming. For example, an image related to the content of the live streaming itself, an image related to an event related to the live streaming, etc. can be set as the image icon for the reaction button or the image to be composited into the image for live streaming, and unlike the case of using a generally registered image, emoticon, etc., the user can feel like they are participating in a live streaming more easily.
[0015] According to an embodiment of the present invention, preferably, a computer-readable recording medium having a predetermined program recorded thereon is provided. According to one embodiment of the present invention configured as described above, a user can easily feel as if he or she is participating in a live broadcast by inputting a predetermined image from the predetermined post in the chat of the first application into the live broadcast image of the second application based on a computer-readable recording medium having a program recorded therein. Also, it is possible to more easily deepen the sense of immersion in a virtual community formed by users' live broadcasts and chats.
[0016] According to one embodiment of the present invention, there is provided a system, preferably comprising a computer executing a program. According to one embodiment of the present invention, the system includes a computer that executes a program, and allows a user to easily feel as if he or she is participating in a live broadcast by inputting a predetermined image from the predetermined post in the chat of the first application into the live broadcast image of the second application. Also, the user can easily feel more immersed in the virtual community formed by the live broadcasts and chats.
[0017] According to one embodiment of the present invention, there is provided a method, preferably executed by one or more computers, for reflecting a user's reaction on a first application in a live streaming image used in a second application, wherein the first application has a chat function, a function for posting a specified post on the chat using an API, and a function for placing a reaction button within the specified post as a button for receiving a user's reaction, and the second application has a function for live streaming using the live streaming image, and the method includes a posting step of posting the specified post with the reaction button on the chat, a monitoring step of monitoring whether the reaction button of the specified post has been pressed by a user, and a combining step of combining an image corresponding to the pressed reaction button with the live streaming image used in the second application when it is recognized by the monitoring step that the reaction button has been pressed. According to one embodiment of the present invention configured as described above, a method executed by a computer can execute a step of synthesizing an image corresponding to a pressed reaction button on a posted article in a chat of a first application with the live streaming image used in the second application based on information that the reaction button of the posted article in the chat of the first application has been pressed. This allows the user's reaction to the reaction button on the first application to be reflected in the live streaming image used in the second application. Therefore, it is possible for a user to more easily get the feeling that he or she is participating in a live streaming by reflecting a predetermined image from a posted article in the chat of the first application on the live streaming image of the second application. In addition, it is possible to more easily deepen the sense of immersion in a virtual community formed by a user's live streaming and chat. Effect of the Invention
[0018] The program, computer-readable recording medium, system, and method of the present invention make it easier for users to get the feeling that they are participating in a live broadcast. [Brief description of the drawings]
[0019] [Figure 1] 1 is a diagram illustrating the overall configuration of a system including a computer that executes a program according to an embodiment of the present invention. [Diagram 2] 2 is a block diagram showing a hardware configuration of a first server in one embodiment of the present invention. FIG. [Diagram 3] FIG. 2 is a block diagram showing a hardware configuration of a second server according to an embodiment of the present invention. [Figure 4] FIG. 11 is a diagram showing an example of a screen of a first application on which a predetermined article is posted by a program of one embodiment of the present invention. [Diagram 5] 5 is an enlarged view showing a state in which a reaction button for a given posted article on the screen of the first application in FIG. 4 is pressed. FIG. [Figure 6]5 is an enlarged view showing a state in which a reaction button for a given posted article on the screen of the first application in FIG. 4 is pressed. FIG. [Figure 7] FIG. 11 is a diagram showing an example of a screen of a second application in one embodiment of the present invention. [Figure 8] FIG. 13 is a diagram showing an example of a screen of an image reflection application in the embodiment of the present invention. [Figure 9] 4 is a block diagram showing an execution function unit in a second server that executes a program according to an embodiment of the present invention. FIG. [Figure 10] FIG. 11 is a flowchart showing the process of an image reflection application according to an embodiment of the present invention. [Figure 11] FIG. 13 is a diagram showing an example of an image to be synthesized generated by an image reflection application in one embodiment of the present invention. [Figure 12] FIG. 13 is a diagram showing an example of an image to be synthesized generated by an image reflection application in one embodiment of the present invention. [Figure 13] FIG. 13 is a diagram showing an example of an image to be synthesized generated by an image reflection application in one embodiment of the present invention. [Figure 14] FIG. 13 is a diagram showing an example of an image to be synthesized generated by an image reflection application in one embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0020] Hereinafter, a system 1 including a computer that executes a program according to an embodiment of the present invention will be described with reference to the accompanying drawings. First, Fig. 1 is a diagram showing the overall configuration of a system including a computer that executes a program according to one embodiment of the present invention. Fig. 2 is a block diagram showing the hardware configuration of a first server according to one embodiment of the present invention. Fig. 3 is a block diagram showing the hardware configuration of a second server according to one embodiment of the present invention. Fig. 4 is a diagram showing an example of a screen of a first application on which a predetermined article is posted by a program according to one embodiment of the present invention.
[0021] As shown in FIG. 1, a system 1 according to an embodiment of the present invention includes one or more servers functioning as a computer. The system 1 includes, for example, a first server 2 and a second server 4. The first server 2 and the second server 4 are electrically connected via the Internet 6. The number and configuration of the servers included in the system 1 can be changed arbitrarily. For example, a second application described later may be placed on a server other than the second server 4 and connected via the Internet. In addition, the system 1 may include the first server 2 and the second server 4 as a single server, and the program of this embodiment may be executed by processing within the computer without using the Internet 6. The program of this embodiment may be placed in a computer-readable recording medium and executed by one or more servers functioning as a computer. The computer-readable recording medium is, for example, a USB memory.
[0022] The first server 2 includes a processor 8, a display device 10, an input device 12, a storage device 14, and a communication device 16. Each of these components is connected by a bus 17. An interface is provided between the bus 17 and each of the components as necessary. The first server 2 is, for example, a personal computer. The first server 2 may be a tablet computer, a smartphone, another electronic information terminal device, a home game console, a smart watch, a wearable device, or another electronic device.
[0023] The processor 8 controls the overall operation of the first server 2. The processor 8 is, for example, a CPU. Note that an electronic circuit such as an MPU may be used as the processor 8. The processor 8 executes various processes by reading and executing programs and data stored in the storage device 14. The processor 8 executes, for example, a chat function of the first application 28. The processor 8 is composed of, for example, a plurality of processors. The processor 8, together with the storage device 14, causes the first server 2 to function as a control unit of the first application 28.
[0024] The display device 10 is, for example, a display monitor. Under the control of the processor 8, the display device 10 displays a first application screen to the user.
[0025] The input device 12 is a user interface that accepts operational input from a user to the first server 2. The input device 12 is, for example, a keyboard that accepts keyboard operation input and a mouse.
[0026] The storage device 14 includes a main storage device and an auxiliary storage device. The main storage device is, for example, a volatile memory capable of reading and writing information at high speed, and is used as a storage area and a working area when the processor 8 processes information. The auxiliary storage device stores various programs and data used by the processor 8 when executing each program. The auxiliary storage device is a non-volatile storage or non-volatile memory, for example, a flash memory such as eMMC, UFS, or SSD, and may be removable. The storage device 14 is, for example, a storage device included in a general personal computer including a volatile memory and a non-volatile memory. The storage device 14 stores a program for executing the first application 28 in this embodiment, various data, and the like.
[0027] The communication device 16 is a module, device, or apparatus capable of transmitting and receiving data to and from other servers such as the second server 4 via the Internet 6. The communication device 16 may be a device or module for wireless communication, or may be a device or module for wired communication.
[0028] The second server 4 includes a processor 18, a display device 20, an input device 22, a storage device 24, and a communication device 26. Each of these components is connected by a bus 27. An interface is provided between the bus 27 and each of the components as necessary. The second server 4 is, for example, a personal computer. The second server 4 may be a tablet computer, a smartphone, another electronic information terminal device, a home game console, a smart watch, a wearable device, or another electronic device.
[0029] The processor 18 controls the entire operation of the second server 4. The processor 18 is, for example, a CPU. Note that an electronic circuit such as an MPU may be used as the processor 18. The processor 18 executes various processes by reading and executing programs and data stored in the storage device 24. The processor 18 executes, for example, a live distribution function of the second application 32. The processor 18 is composed of, for example, a plurality of processors. The processor 18, together with the storage device 24, causes the second server 4 to function as a control unit for an image reflection program 44 or the like.
[0030] The display device 20 is, for example, a display monitor. Under the control of the processor 18, the display device 20 displays a program screen and a second application screen to the user.
[0031] The input device 22 is a user interface that accepts operational input from a user to the second server 4. The input device 22 is, for example, a keyboard that accepts keyboard operation input and a mouse.
[0032] The storage device 24 includes a main storage device and an auxiliary storage device. The main storage device is, for example, a volatile memory capable of reading and writing information at high speed, and is used as a storage area and a working area when the processor 18 processes information. The auxiliary storage device stores various programs and data used by the processor 18 when executing each program. The auxiliary storage device is a non-volatile storage or non-volatile memory, for example, a flash memory such as eMMC, UFS, or SSD, and may be removable. The storage device 24 is, for example, a storage device that is included in a general personal computer, including a volatile memory and a non-volatile memory. The storage device 24 stores the program in this embodiment, the program for executing the second application 32, various data, and the like.
[0033] The communication device 26 is a module, device, or apparatus capable of transmitting and receiving data to and from other servers such as the first server 2 via the Internet 6. The communication device 26 may be a device or module for wireless communication, or may be a device or module for wired communication.
[0034] Next, the first application 28 executed in the first server 2, the image reflection application 30 executed in the second server 4, and the second application 32 will be described with reference to FIG. The first server 2 includes a first application 28. The first application 28 is executed on a web browser on the first server 2. The first application 28 may be executed as application software installed on the first server 2. The first application 28 may be configured such that the results of execution on another server are displayed on the first server 2.
[0035] As shown in Fig. 4, the first application 28 has a function of a chat 34. The chat 34 is a text chat that can be simultaneously viewed by an unspecified number of users and that can post to, and the posted articles are arranged and displayed in the order of posting. The first application 28 further has a function of posting a specific article 36 to the chat 34 using an API, and a function of arranging a reaction button 38 as a button for receiving a user's reaction within the specific article 36. In this way, the first application 28 has a function of accepting the arrangement of the reaction button 38. In Fig. 4, the specific article 36 is surrounded by a virtual dashed line for easy understanding.
[0036] In the first application 28, a plurality of reaction buttons 38 are arranged side by side. The reaction buttons 38 are set so that the user can select various reactions. The reaction buttons 38 are provided using API technology, and when the user clicks them, the click state and the number of clicks are counted. In addition, the state of the reaction buttons 38, such as the count number, can be read out as a log to another server, etc. For example, as shown in Fig. 4 and Fig. 5, reaction button 38a of reaction buttons 38 has an image (first image 39) of a character expressing an emotion of joy. Fig. 5 shows a display in a state where reaction button 38 is pressed (user's reaction is made). Note that when reaction button 38 is pressed, the display of "Reacted" as shown in Fig. 5 may be omitted, and image reflection program 44 may recognize the fact that the button has been pressed and perform the corresponding processing. 4 and 6, the reaction button 38b of the reaction buttons 38 includes an image (first image 39) of a character expressing emotion with tears in its eyes. FIG. 6 shows a display in a state where the reaction button 38 is pressed (the user has reacted). Note that when the reaction button 38 is pressed, the display of "Reacted" as shown in FIG. 6 may be omitted, and the image reflection program 44 may recognize the fact that the button has been pressed and perform the corresponding processing.
[0037] In this way, for example, the reaction button 38 can be set to a button with an image (first image 39) of a character expressing various emotions, or a button with an image (first image 39) showing various intentions such as for or against, to reflect the user's opinion or feeling. Therefore, the reaction button 38 can be used as a button that reflects the user's opinion or feeling. The reaction button 38 also functions as a participation window that reflects the user's various intentions such as for or against on the live distribution. The first image 39 can be set to any image according to the intention of the person (e.g., the person who prepares the second image 46 for synthesis using the image reflection application 30 or the user.
[0038] 1, the second server 4 includes an image reflection application 30 having an image reflection program 44, and a second application 32. The image reflection application 30 and the second application 32 may be provided on different servers and electrically connected to each other via the Internet.
[0039] First, the second application 32 will be described with reference to FIG. 7. The second application 32 has a function of performing live distribution using the live distribution image 40. The second application 32 is application software that realizes live distribution such as YouTube (registered trademark) and TWITCH (registered trademark). The second application 32 can be software or a platform that has a function of performing live distribution using the live distribution image 40. The second application 32 performs live distribution in a streaming format such as real-time distribution, but may also be application software that realizes video distribution that distributes recorded images and videos. That is, the second application 32 may perform video distribution in a download format. In addition, for example, the second application 32 may be application software for distribution of Internet programs or application software for TV broadcasting. The second application 32 distributes the live distribution image 40 in the distribution screen area 42. Therefore, the user can view the live distribution image 40 distributed via the Internet in the distribution screen area 42.
[0040] Next, the image reflection application 30 will be described with reference to FIGS. The image reflecting application 30 includes an image reflecting program 44 as a program for reflecting a user's reaction on the first application 28 as shown in Fig. 4 in a live streaming image 40 used in the second application 32 as shown in Fig. 7. The image reflecting application 30 is also software for preparing an image to be composited into the live streaming image 40.
[0041] As shown in Figs. 4 and 8, the image reflection program 44 of the image reflection application 30 causes the second server 4 as a computer to execute a function of opening a user participation window for reflecting a predetermined image 46 on the live streaming image 40 of the second application 32 as a predetermined post 36 on the chat 34 of the first application 28. More specifically, the image reflection program 44 causes the second server 4 as a computer to execute a function of placing a reaction button 38 having a function of reflecting and displaying a predetermined second image 46 (see Fig. 11) on the live streaming image 40 of the second application 32 in response to an operation of a specific user who performed an operation of pressing the reaction button 38, in a predetermined post 36 on the chat 34 of the first application 28 (see Fig. 4). As shown in Fig. 11, the predetermined second image 46 is an image corresponding to the first image 39 (see Fig. 4) displayed on the pressed reaction button 38, and is an image of approximately the same design. The predetermined second image 46 is larger than the size of the first image 39 attached to the reaction button 38, for example, 1.5 to 5 times larger in area. Note that the image reflection program 44, which is a program according to this embodiment, does not include the first application 28 (such as the basic chat providing function of the first application 28) and the second application 32 (such as the basic live streaming providing function of the second application 32) as components, and constitutes a program that reflects the user's reaction on the first application 28 in the live streaming image used in the second application 32.
[0042] 8 and 9, the second server 4 includes a posting step execution function unit 51 that executes a posting step 50 of posting a predetermined post 36 having a reaction button 38 on the chat 34 on the second server 4 by the image reflection program 44 of the image reflection application 30, a monitor step execution function unit 53 that executes a monitor step 52 of monitoring whether the reaction button 38 of the predetermined post 36 has been pressed by a user, and a composition step execution function unit 55 that executes a composition step 54 of combining an image corresponding to the pressed reaction button 38 with a live distribution image 40 used in the second application 32 when it is recognized that the reaction button 38 has been pressed by the monitor step 52. Note that some of the posting step execution function unit 51, the monitor step execution function unit 53, and the composition step execution function unit 55 may be executed in a server other than the second server 4. Also, some of the posting step execution function unit 51, the monitor step execution function unit 53, and the composition step execution function unit 55 may be executed in different application software. The posting step execution function unit 51, the monitor step execution function unit 53, and the synthesis step execution function unit 55 each execute their respective steps by the processor 18 of the second server 4.
[0043] As shown in FIG. 4, a plurality of reaction buttons 38 are provided in a predetermined post article 36 posted by a posting step 50 executed by the posting step execution function unit 51. The reaction button 38 has an image icon showing a first image 39 corresponding to a second image 46 to be superimposed on the live streaming image. The first image 39 used in the reaction button 38 can be set to any design by reading it from a predetermined server. The image reflection program 44 has information on the second image 46 corresponding to this first image 39 as a data table. In this way, in addition to the design image prepared in advance, any design image newly added by a person who prepares an image for streaming, a distributor, a user, or the like can be used for the first image 39 and the second image 46. That is, the person who prepares an image for streaming, or the like can set the first image 39 and the second image 46 so that a user can participate in live streaming using any second image 46. The second image 46 is an image that operates to move on the image for live streaming. The second image 46 moves, for example, from above to below on the image for live streaming.
[0044] The monitor step 52 executed by the monitor step execution function unit 53 continues to monitor the reaction button 38 of the predetermined posted article 36 posted in the posting step 50, without switching to monitoring the latest article posting of only normal text, even if an article is posted on the chat 34 of the first application 28 by a means other than the image reflection program 44, for example, an article posting of only normal text by another user. The monitor step 52 monitors the reaction button 38 while being electrically connected to the first application 28.
[0045] The synthesis step 54 executed by the synthesis step execution function unit 55 synthesizes the second image 46 stored in the second server 4 executing the synthesis step 54 with the live distribution image 40. The synthesis step 54 can change the display position of the predetermined second image 46 to be synthesized on the live distribution image 40 based on the way the reaction button 38 is pressed and the attribute of the reaction button 38. For example, in a case where the reaction button 38a is the first image 39 with an image of approval and the reaction button 38b is the first image 39 with an image of disapproval, the second image 46 for the reaction button 38a may be displayed in the left half area of the screen, and the second image 46 for the reaction button 38b may be displayed in the right half area of the screen. In addition, the display position (the falling start position) of the second image 46 on the live distribution image 40 can be arranged, for example, randomly. Furthermore, the size of the second image 46 can be changed (for example, randomly) according to the display position, timing, etc. of each second image 46. The way and speed of the second images 46 falling can also be varied for each individual second image 46 (for example, randomly).
[0046] When an existing specified post 36 has already been posted by the posting step 50 and another specified post is to be posted on the chat 34, the image reflection program 44 terminates the monitoring step 52 and the compositing step 54 that have already been executed, and newly executes the posting step 50 for the other specified post, the monitoring step 52 for monitoring whether the reaction button 38 of the other specified post has been pressed by the user, and the compositing step 54 for compositing a specified second image 46 corresponding to the pressed reaction button 38 with the live streaming image 40 used in the second application 32 when it is recognized by the monitoring step 52 that the reaction button 38 has been pressed.
[0047] Next, a series of operations of the image reflection program 44 will be described with reference to FIG. The image reflection method using the image reflection program 44 in this embodiment will be described below. As shown in FIG. 10, the image reflection application 30 executed by the second server 4 (for example, the processor 18 of the second server 4) proceeds to S1 to start preparation for a series of operations by the image reflection program 44. In S1, the image reflection application 30 executes a preparation step 49. In the preparation step 49, the server (server address) 56 executing the first application 28 and its channel (channel address) 58 are specified in a setting window of the image reflection application 30 as shown in FIG. 8. In addition, a message 60 that will be the article content of a specific posted article 36 is specified, and further, the presence or absence and number of reaction buttons 38 and the defined reaction buttons 38 are specified in a reaction button setting window 62. By specifying the defined reaction button 38, data of the reaction button 38 having a specific image is read from a specific server and is arranged in the specific posted article 36 as a reaction button 38 with a specific first image 39 (see FIG. 4).
[0048] After the preparation step 49 of S1 is completed, when the message posting button 61 (see FIG. 8) is pressed in S2, the processor 18 of the second server 4 posts the set message 60 to the first application 28 as a predetermined post 36 in the specified server 56 and its channel 58 based on the contents set in the setting window of the image reflection program 44 by the posting step 50 by the posting step execution function unit 51, as shown in FIG. 4. The predetermined post 36 is a post in a text chat, and the posted predetermined post 36 has a set reaction button 38 arranged therein. The reaction button 38 has a predetermined first image 39. For example, when a live broadcast program starts in the second application 32, the message 60 of the predetermined post 36 can include text such as "The program of XX is about to start, so please add your reaction to it." Then, a plurality of reaction buttons 38 to which the user can react are arranged in the predetermined post 36. When the posting step 50 of S2 is completed, the image reflection application 30 proceeds to S3.
[0049] In S3, the image reflection application 30 executed in the second server 4 executes a monitor step 52 by the monitor step execution function unit 53 to monitor whether the reaction button 38 of a specific posted article 36 has been pressed by the user. In the monitor step 52, the image reflection application 30 monitors whether the multiple reaction buttons 38 have been pressed by the user. When the reaction button 38 has been pressed by the user, the image reflection application 30 acquires a log 64 indicating that the reaction button 38 has been pressed by text information. Therefore, the second server 4 can acquire data on which reaction button 38 has been pressed more quickly than when acquiring image data of the first image 39. When the reaction button 38 has been pressed by the user and the log 64 has been acquired, the image reflection application 30 proceeds to S4.
[0050] In S4, the image reflection application 30 executes a synthesis step 54 by the synthesis step execution function unit 55. The image reflection application 30 reads the acquired contents of the log 64, that is, the second image 46 corresponding to the pressed reaction button 38, from the storage device 24 of the second server 4 that executes the synthesis step 54, and synthesizes it with the live streaming image 40. As shown in FIG. 11, the second server 4 places the second image 46, for example, at a position above the live streaming image 40, controls it to fall from that position, and synthesizes the movement of the second image 46 with the live streaming image 40. Here, for the sake of explanation, FIG. 11 virtually illustrates an image for synthesis with the live streaming image 40. Also, in FIG. 11, the main movement direction of the second image 46 is illustrated by an arrow A. Since it is an image for synthesis, the background is set to black (a state in which no background image is set), and only the movement of the second image 46 is displayed. 11 is superimposed on the live streaming image 40 before distribution and the two are digitally combined to form the final image to be distributed. In this way, the movement of the second image 46 in the image to be composited is reflected in the final image to be distributed. Note that the movement of the second image may be directly composited onto the live streaming image 40 and reflected in the final image to be distributed without creating an image to be composited.
[0051] As shown in FIG. 11, the image reflection application 30 drops the second image 46, for example, from a predetermined position above the live streaming image 40. Furthermore, when the reaction button 38 is pressed by the user, the second server 4 places another second image 46, for example, at a position above the live streaming image 40 and starts dropping it. In this way, when the reaction button 38 is pressed by various users, the second images 46 are generated one after another on the image for synthesis and are synthesized with the image for live streaming 40. Note that the image for synthesis is synthesized with the image for live streaming 40 in real time, and the movement of the second image 46 is reflected in real time in the live streaming. As shown in FIG. 12, the second image 46 gradually drops from the display position. When a predetermined time has passed since the appearance of the second image 46, the second image 46 falls to the bottom as shown in FIG. 13. In FIG. 12 as well, the main movement direction of the second image 46 is illustrated by the arrow A.
[0052] The synthesis step 54 randomly changes the display position of the predetermined second image 46 on the synthesis image. The synthesis step 54 may change the display position of the predetermined second image 46 corresponding to the reaction button 38 based on the manner in which the reaction button 38 is pressed or the attributes of the reaction button 38. When the reaction button 38 is pressed by many users, many second images 46 are displayed and moved on the synthesis image as shown in FIG. 14. The second images 46 may be tilted or rolled while falling. The second images 46 are automatically erased after a predetermined time has elapsed since their appearance. Therefore, the second server 4 can live-stream the synthesized live-streaming image 40 by the second application 32. Therefore, a user who has not participated to the extent of appearing in the live-streaming can participate in the live-streaming relatively easily by displaying an image on the live-streaming image 40 via the text chat 34. In addition, the user's reaction can be conveyed by displaying images instead of text in the live distribution image 40, which can enhance the sense of unity and immersion between the distributor and the user during distribution. When S4 ends, the second server 4 proceeds to END and ends the series of processes.
[0053] According to one embodiment of the present invention configured in this manner, the image reflection program 44 causes the computer to execute a function of placing a reaction button 38 having a function of causing a predetermined second image 46 to appear in the live streaming image 40 of the second application 32 in response to an operation by a specific user in a predetermined post 36 in the chat 34 of the first application 28. This makes it easier for a user to feel as if they are participating in a live stream by inputting a predetermined second image 46 from a predetermined post 36 in the chat 34 of the first application 28 into the live streaming image 40 of the second application 32. It also makes it easier for a user to feel more immersed in the virtual community formed by the live streaming and chat 34.
[0054] According to an embodiment of the present invention configured as described above, the image reflection program 44 can execute a step of synthesizing the second image 46 corresponding to the pressed reaction button 38 of the posted article 36 on the chat 34 of the first application 28 on the live streaming image 40 used in the second application 32 based on information that the reaction button 38 of the posted article 36 on the chat 34 of the first application 28 has been pressed, into the live streaming image 40 used in the second application 32. Therefore, it is possible for a user to more easily get the feeling that he or she is participating in a live streaming by reflecting a predetermined second image 46 from a predetermined posted article 36 on the chat 34 of the first application 28 on the live streaming image 40 of the second application 32. In addition, it is possible to more easily deepen the user's immersion in the virtual community formed by the live streaming and the chat 34.
[0055] According to one embodiment of the present invention configured in this manner, the monitor step 52 continues to monitor the reaction button 38 of the predetermined post 36 posted in the posting step 50, even if another article is posted on the chat 34 of the first application 28 by a means other than the image reflection program 44. As a result, the image reflection program 44 continues to monitor the predetermined post 36 in which the reaction button 38 is set, even if another article is posted, and the user's reaction operation to a specific article can be reflected more directly in the live broadcast.
[0056] According to one embodiment of the present invention configured as described above, when posting another predetermined post 36 on the chat 34 in the posting step 50, the image reflection program 44 ends the already executed monitoring step 52 and compositing step 54, and executes again the monitoring step 52 of monitoring whether or not the reaction button 38 of the other predetermined post 36 has been pressed by the user, and the compositing step 54 of compositing the second image 46 corresponding to the pressed reaction button 38 with the live streaming image 40 used in the second application 32, when it is recognized in the monitoring step 52 that the reaction button 38 has been pressed. In this way, the image reflection program 44 does not simply monitor the timeline on the chat 34 in chronological order, but can monitor whether or not the reaction button 38 has been pressed by the user for the posted predetermined post 36. This makes it clear to users that they can participate in the live broadcast through a specific post on chat 34, makes the window for users to participate in the live broadcast by uploading images clearer, and makes it easier for users to feel that they are participating in (or influencing) the live broadcast through their own actions, compared to when text on the timeline on chat 34 is automatically posted.
[0057] According to one embodiment of the present invention configured in this manner, a predetermined post 36 posted in the posting step 50 is provided with a plurality of reaction buttons 38. This allows the user to express a variety of reactions when inputting a predetermined second image 46 into the live streaming image 40, making it easier for the user to participate in the live streaming by expressing a variety of intentions. For example, a variety of intentions can be expressed, such as expressing the emotions of a character, or voting for or against. This can further enhance the user's immersion in the live streaming.
[0058] According to one embodiment of the present invention configured in this manner, the reaction button 38 is provided with an image icon showing an image to be superimposed on the live streaming image 40. This allows an opportunity to set up an easy way for an unspecified number of users to participate, and allows users to react intuitively to the image.
[0059] According to an embodiment of the present invention configured as described above, the combining step 54 combines the second image 46 corresponding to the reaction button 38 stored in the server that executes the combining step 54 with the image 40 for live streaming. As a result, the second image 46 corresponding to the reaction button 38 can be combined with the image 40 for live streaming at a faster processing speed than when the second image 46 corresponding to the reaction button 38 is stored in a server other than the server that executes the combining step 54. This improves the responsiveness from the user's operation on the reaction button 38 to the reflection of the second image 46 corresponding to the reaction button 38 in the image 40 for live streaming, making it easier for the user to feel like they are participating in live streaming. For example, as soon as the user presses the reaction button 38, the second image 46 corresponding to the operated reaction button 38 is combined with the image 40 for live streaming and displayed, making it easier for the user to feel like they are participating in live streaming.
[0060] According to one embodiment of the present invention configured in this manner, the synthesis step 54 changes the display position of the second image 46 corresponding to the synthesized reaction button 38 in the live streaming image 40 based on the manner in which the reaction button 38 is pressed and the attributes of the reaction button 38. Based on the manner in which the reaction button 38 is pressed and the attributes of the reaction button 38, the user can sense a change in the display of a given second image 46, making it easier for the user to feel as if they are participating in a live streaming event.
[0061] According to one embodiment of the present invention configured in this manner, a user can easily get the feeling of participating in a live broadcast by inputting a predetermined second image 46 from a predetermined post 36 on the chat 34 of the first application 28 into the live broadcast image 40 of the second application 32 based on a computer-readable recording medium having an image reflection program 44 recorded therein. Also, it is possible to more easily deepen the sense of immersion in the virtual community formed by the user's live broadcast and chat 34.
[0062] According to one embodiment of the present invention configured in this manner, the system 1 including a computer executing the image reflection program 44 allows a user to easily get the feeling of participating in a live broadcast by inputting a predetermined second image 46 from a predetermined post 36 on the chat 34 of the first application 28 into the live broadcast image 40 of the second application 32. It also makes it easier for users to feel more immersed in the virtual community formed by the live broadcast and chat 34.
[0063] According to an embodiment of the present invention configured as described above, a method executed by a computer can execute a step of synthesizing a second image 46 corresponding to a pressed reaction button 38 of a posted article 36 in the chat 34 of the first application 28, into a live streaming image 40 used in the second application 32, based on information that the reaction button 38 of the posted article 36 in the chat 34 of the first application 28 has been pressed. This allows the user's reaction to the reaction button 38 in the first application 28 to be reflected in the live streaming image 40 used in the second application 32. Therefore, it is possible for a user to more easily get the feeling that he or she is participating in a live streaming by reflecting a predetermined second image 46 from a predetermined posted article 36 in the chat 34 of the first application 28 into the live streaming image 40 of the second application 32. In addition, it is possible to more easily deepen the user's sense of immersion in a virtual community formed by live streaming and the chat 34. [Explanation of symbols]
[0064] 1: System 2: First server 4: Second server 28: First application 30: Image reflection application 32: Second application 34: Chat 36: Posted Article 38: Reaction button 39: First image 40: Live streaming images 44: Image reflection program 46: 2nd image 50: Posting step 52: Monitor step 54: Synthesis step 56: Server
Claims
1. A program for reflecting a user's reaction on a first application in a live streaming image used in a second application, the first application having a chat function, a function for posting a predetermined post on the chat using an API, and a function for arranging a reaction button as a button for receiving a user's reaction in the predetermined post, the second application having a function for live streaming using the live streaming image, the program comprising: A program that causes a computer to execute a function of placing the reaction button, which has a function of reflecting a specified image in the live streaming image of the second application, in the specified post on the chat of the first application.
2. The program causes the computer to execute a function of arranging the reaction button having a function of reflecting the predetermined image in the live streaming image of the second application on the predetermined posted article in the chat of the first application, a posting step of posting the predetermined post having the reaction button on the chat; a monitoring step of monitoring whether the reaction button of the predetermined posted article is pressed by a user; The program according to claim 1, further comprising: a synthesis step of synthesizing an image corresponding to the pressed reaction button onto the live streaming image used for the second application when the monitoring step recognizes that the reaction button has been pressed.
3. The program described in claim 2, wherein the monitoring step continues to monitor the reaction button of the specified posted article posted by the posting step even if another article is posted on the chat of the first application by means other than the program.
4. When another predetermined posted article is posted on the chat by the posting step, the program terminates the monitoring step and the merging step that have already been executed, and monitors again whether or not the reaction button of the other predetermined posted article has been pressed by a user; The program as described in claim 2, further comprising: a synthesis step of synthesizing an image corresponding to the pressed reaction button onto the live streaming image used for the second application when the monitoring step recognizes that the reaction button has been pressed.
5. The program according to claim 2 , wherein the predetermined post posted in the posting step is provided with a plurality of the reaction buttons.
6. The program according to claim 2 , wherein the reaction button includes an image icon indicating an image to be superimposed on the live streaming image.
7. The program according to claim 2 , wherein the combining step combines an image corresponding to the reaction button stored in a server that executes the combining step with the image for live distribution.
8. The program according to claim 2 , wherein the combining step changes a display position of the image corresponding to the reaction button to be combined on the live streaming image based on how the reaction button is pressed or an attribute of the reaction button.
9. The program according to claim 2, wherein the image icon used for the reaction button can be set to any image by loading it from a specified server, and the program can synthesize the specified image corresponding to this arbitrary image into the image for live streaming.
10. A computer-readable recording medium on which the program according to any one of claims 1 to 9 is recorded.
11. A system comprising a computer that executes the program according to any one of claims 1 to 9.
12. A method executed by one or more computers for reflecting a user's reaction on a first application in a live streaming image used in a second application, wherein the first application has a chat function, a function for posting a predetermined post on the chat using an API, and a function for arranging a reaction button within the predetermined post as a button for receiving a user's reaction, and the second application has a function for live streaming using the live streaming image, and the method includes: a posting step of posting the predetermined post having the reaction button on the chat; a monitoring step of monitoring whether the reaction button of the predetermined posted article is pressed by a user; and a synthesis step of, when it is recognized by the monitoring step that the reaction button has been pressed, synthesizing an image corresponding to the pressed reaction button with the live streaming image used for the second application.
Citation Information
Patent Citations
System, method, and program for providing live distribution service
JP2022075401A
