Method and device for displaying user's emotional expression in video content
The method and apparatus provide differentiated emotional expression display in video content, enhancing user participation and recognition through customizable visual effects in separate display areas, addressing the lack of differentiation in existing platforms.
Patent Information
- Application Number
- JP2023043829
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2022-05-10
- Filing Date
- 2023-03-20
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2043-03-20
AI Technical Summary
Existing video platforms lack differentiation in emotional expression display, making it difficult for users to distinguish their expressions from others, and simple 2D motion fails to enhance the bond between broadcasters and viewers.
A method and apparatus that outputs video content in a first area, chat content in a second area, and user emotional expressions in a third area, with customizable visual effects in response to user input, allowing differentiation and increased engagement.
Enhances user participation and differentiation of emotional expressions, encouraging active engagement and easy recognition of cumulative emotional responses.
Smart Images

Figure 0007586527000001 
Figure 0007586527000002 
Figure 0007586527000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a method and apparatus for displaying a user's emotional expression in video content, and in particular to a method and apparatus for outputting visual effects associated with a user's emotional expression when playing video content. [Background technology]
[0002] Recently, with the development of social networking services (SNS) and video distribution platforms, the consumption of video contents such as live internet broadcasting has become very active. In live internet broadcasting, functions that allow viewers to express their emotions and associated effects are provided for communication between broadcasters and viewers. For example, when a "Like" button is clicked, an associated effect is displayed on the screen.
[0003] The problem with these effects is that the effects associated with each viewer's "Like" are the same or similar to each other, making it difficult for service users to distinguish between their own and other viewers' effects. In addition, the generalization of simple 2D motions means there is a lack of differentiation between video distribution platforms. This limits the bond that can be formed between broadcasters and viewers. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Korean Patent Application Publication No. 2012-0108485 Summary of the Invention [Problem to be solved by the invention]
[0005] The present disclosure provides a method, a computer program, and an apparatus (system) for displaying a user's emotional expression in video content to solve the above problems. [Means for solving the problem]
[0006] According to one embodiment of the present disclosure, a method for displaying a user's emotional expression in video content performed by at least one processor of a user terminal includes the steps of outputting the video content in a first area on a display of the user terminal, outputting chat content associated with the video content in a second area on the display, receiving user input associated with the user's emotional expression in a third area on the display, and outputting a first visual effect associated with the emotional expression in the second area in response to receiving the user input.
[0007] A computer-readable computer program for executing a method for displaying a user's emotion expression according to an embodiment of the present disclosure on a computer is provided.
[0008] A user terminal according to an embodiment of the present disclosure includes a communication module, a memory, a display, and at least one processor coupled to the memory and configured to execute at least one computer-readable program contained in the memory, the at least one program including instructions for: outputting video content in a first region on the display, outputting chat content associated with the video content in a second region on the display, receiving user input associated with a user's emotional expression in a third region on the display, and outputting a first visual effect associated with the emotional expression in the second region in response to receiving the user input. Effect of the Invention
[0009] According to some embodiments of the present disclosure, by encouraging users to actively click the "Like" button, it is possible to induce users to actively participate in content in addition to participating in chats.
[0010] According to some embodiments of the present disclosure, a user can easily distinguish his / her own emotional expressions from the emotional expressions of other users.
[0011] According to some embodiments of the present disclosure, a live broadcast host, a viewer user, or the like can visually confirm the increase in the number of accumulated emotional expressions and can easily confirm that the number of accumulated emotional expressions has reached a target value.
[0012] The effects of the present disclosure are not limited to these, and other effects not mentioned herein will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains (hereinafter referred to as a "person skilled in the art") from the description in the claims. [Brief description of the drawings]
[0013] BRIEF DESCRIPTION OF THE DRAWINGS Examples of the present disclosure will now be described with reference to the accompanying drawings, in which like reference numerals refer to like elements, without limitation, and in which: FIG. [Figure 1] FIG. 13 is a diagram showing an example of displaying an emotional expression of a user according to an embodiment of the present disclosure. [Diagram 2] 1 is a schematic diagram showing a configuration in which an information processing system according to an embodiment of the present disclosure is connected so as to be communicable with a plurality of user terminals. [Diagram 3] 2 is a block diagram showing an internal configuration of a user terminal and an information processing system according to an embodiment of the present disclosure. FIG. [Figure 4] FIG. 2 illustrates a detailed area of a user interface according to one embodiment of the present disclosure. [Diagram 5] FIG. 11 is a diagram showing an example in which an effect associated with an emotional expression of a user is displayed according to an embodiment of the present disclosure. [Figure 6] FIG. 13 is a diagram illustrating an example of an output of a visual effect according to an increase in the number of accumulated emotional expressions according to an embodiment of the present disclosure. [Figure 7] A figure showing an example of setting values of visual effects displayed in an area where chat content is output in accordance with an embodiment of the present disclosure. [Figure 8]FIG. 11 is a diagram showing an example of setting values of visual effects associated with the cumulative number of emotional expressions of video content according to an embodiment of the present disclosure. [Figure 9] 1 is a flowchart illustrating a method for displaying a user's emotional expression in video content according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0014] Hereinafter, specific contents for carrying out the present disclosure will be described in detail with reference to the accompanying drawings. However, in the following description, detailed descriptions of known functions and configurations will be omitted if there is a risk of unnecessarily obscuring the gist of the present disclosure.
[0015] In the accompanying drawings, the same or corresponding components are given the same reference numerals. In addition, in the following description of the embodiments, duplicated descriptions of the same or corresponding components may be omitted. However, even if the description of a component is omitted, it should not be intended that such a component is not included in a certain embodiment.
[0016] The advantages and features of the disclosed embodiments and the methods of achieving them will become apparent from the following examples, taken in conjunction with the accompanying drawings. However, the present disclosure is not limited to the embodiments disclosed below, and may be embodied in various different forms. However, the embodiments are provided only to complete the disclosure and to allow those skilled in the art to accurately recognize the category of the invention.
[0017] The terms used in this disclosure will be briefly explained, and the disclosed embodiments will be specifically described. The terms used in this specification are currently selected as widely used as possible while taking into consideration the functions in this disclosure, but this may change depending on the intentions or precedents of engineers engaged in related fields, the emergence of new technologies, etc. In addition, in certain cases, there may be terms arbitrarily selected by the applicant, but the meanings of these will be described in detail in the description of the invention. Therefore, the terms used in this disclosure should be defined based on the meanings of the terms and the overall content of this disclosure, rather than simply the names of the terms.
[0018] In this disclosure, unless otherwise clearly specified in the context, singular expressions include plural expressions, and plural expressions include singular expressions. Throughout the specification, when a part "comprises" a certain element, this does not exclude other elements, and means that other elements may also be included, unless otherwise specified to the contrary.
[0019] In addition, the term "module" or "unit" as used in the specification means a software or hardware component, and the "module" or "unit" performs a certain function. However, the term "module" or "unit" is not limited to software or hardware. The "module" or "unit" may be configured to be in an addressable storage medium or to execute one or more processors. Thus, by way of example, a "module" or "unit" may include at least one of a software component, an object-oriented software component, a class component, a task component, and a process, a function, an attribute, a procedure, a subroutine, a program code segment, a driver, firmware, microcode, a circuit, data, a database, a data structure, a table, an array, or a variable. The components and "modules" or "units" may be combined into fewer components and "modules" or "units" or further separated into additional components and "modules" or "units" where the functions provided therein are further provided.
[0020] According to an embodiment of the present disclosure, a "module" or a "unit" may be embodied with a processor and a memory. A "processor" should be broadly construed to include a general purpose processor, a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), a controller, a microcontroller, a state machine, and the like. In some environments, a "processor" may also refer to an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), and the like. A "processor" may also refer to a combination of processing devices, such as, for example, a combination of a DSP and a microprocessor, a combination of multiple microprocessors, a combination of one or more microprocessors in conjunction with a DSP core, or any other such configuration. Additionally, a "memory" should be broadly construed to include any electronic component capable of storing electronic information. "Memory" may refer to various types of processor-readable media such as Random Access Memory (RAM), Read Only Memory (ROM), Non-Volatile Random Access Memory (NVRAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), flash memory, magnetic or optical data storage devices, registers, etc. Memory is said to be in electronic communication with the processor if the processor can read / write information from the memory or write information to the memory. Memory that is integrated into a processor is in electronic communication with the processor.
[0021] In this disclosure, a "user" may refer to a user watching a live video, and "other users" may refer to other users watching the same live video.
[0022] 1 is a diagram illustrating an example of displaying a user's emotional expression according to an embodiment of the present disclosure. As shown in the figure, a user terminal 110 can display a screen in which video content is played on a display 120. In one embodiment, the video content can be live video, a recorded video of a live video, a pre-stored video, etc.
[0023] In one embodiment, the user 100 can click a button associated with an emotional expression when the video content is played. For example, when the video content is played, a "Like" button 130 that allows the user to input positive feedback is displayed on the display 120 of the user terminal 110 together with the video content. The user 100 can input positive feedback by touching or clicking the "Like" button 130 on the display 120. Additionally, the user 100 can communicate with the live broadcast host, other viewers, etc. by inputting text through a chat input window on the display 120.
[0024] In one embodiment, when the user 100 selects the "Like" button 130, the user terminal 110 can output a visual effect 140 associated with an emotional expression. For example, the user terminal 110 can output the visual effect 140 in an area on the display where the chat content is output. In this case, the visual effect 140 can be output in a layer below the layer where the chat content is output. The visual effect 140 can have any size, any hue, or any transparency, and can be output at any position within the area on the display where the chat content is output. The visual effect 140 can be output for a predetermined time or any time on the display 120, and a blurred image can be used. In addition, the user 100 can select the "Like" button 130 several times, and in this case, multiple visual effects can be output on the display 120.
[0025] When the user 100 selects the "Like" button 130, the visual effect 140 can be displayed in the same or similar manner not only on the user terminal 110 of the user 100 but also on the user terminals of other users watching the same video content and the user terminal of the live broadcast host. Also, when other users watching the same video content click the "Like" button, the visual effect can be output on the display 120 of the user terminal 110 so that the user 100 can confirm that the other users have clicked the "Like" button.
[0026] With this configuration, users watching the video content can be encouraged to actively click the "Like" button 130, and thus users can be induced to actively express their emotions in addition to participating in chat. Also, users can check the emotions of viewers without being disturbed while watching the video content and chat content. In live video content, such visual effects 140 can have a similar effect to that of the glow sticks of audience members at an offline concert.
[0027] In one embodiment, the user terminal 110 can output visual effects 150 associated with the cumulative number of emotional expressions related to video content. For example, the user terminal 110 can output visual effects 150 associated with the cumulative number of "Likes" clicked by users watching the same video content. The visual effects 150 can be output to a layer below the layer to which the chat content is output. Also, the visual effects 150 can be output to the same layer as the visual effects 140 or a layer below it.
[0028] In one embodiment, the visual attributes of the visual effect 150 may change based on the number of cumulative emotional expressions associated with the video content. For example, the visual effect 150 may increase in size as the number of cumulative emotional expressions increases. This configuration allows the user 100 to intuitively check the number of cumulative emotional expressions associated with the video content.
[0029] 2 is a schematic diagram illustrating a configuration in which an information processing system 230 according to an embodiment of the present disclosure is connected to a plurality of user terminals 210_1, 210_2, and 210_3 so as to be communicable with them. As shown in the figure, a plurality of user terminals 210_1, 210_2, and 210_3 are connected to an information processing system 230 capable of providing a video content service via a network 220. Here, the plurality of user terminals 210_1, 210_2, and 210_3 may include terminals of users to which the video content service is provided. In one embodiment, the information processing system 230 may include one or more server devices and / or databases capable of storing, providing, and executing computer executable programs (e.g., downloadable applications) and data associated with the video content service, or one or more distributed computing devices and / or distributed databases based on a cloud computing service.
[0030] The video content service provided by the information processing system 230 may be provided to users via a video content playback application or a web browser installed in each of the user terminals 210_1, 210_2, and 210_3. For example, the information processing system 230 may provide information corresponding to a video content playback request, a request for information related to the video content, or a user input associated with a user's emotional expression received from the user terminals 210_1, 210_2, and 210_3, or perform a corresponding process, via the video content playback application.
[0031] A plurality of user terminals 210_1, 210_2, and 210_3 can communicate with the information processing system 230 via the network 220. The network 220 can be configured to enable communication between the plurality of user terminals 210_1, 210_2, and 210_3 and the information processing system 230. The network 220 can be composed of a wired network such as Ethernet (registered trademark), PLC (Power Line Communication), telephone line communication device, and RS-serial communication, a mobile communication network, a wireless network such as WLAN (Wireless LAN), Wi-Fi (registered trademark), Bluetooth (registered trademark), and ZigBee, or a combination thereof, depending on the installation environment. The communication method is not limited, and includes not only a communication method utilizing a communication network (e.g., a mobile communication network, a wired Internet, a wireless Internet, a broadcast network, a satellite network, etc.) that can include the network 220, but also a short-distance wireless communication between the user terminals 210_1, 210_2, and 210_3.
[0032] 2, a mobile phone terminal 210_1, a tablet terminal 210_2, and a PC terminal 210_3 are shown as examples of user terminals, but are not limited thereto, and the user terminals 210_1, 210_2, and 210_3 may be any computing device capable of wired and / or wireless communication and capable of installing and executing a video content playback application or a web browser, etc. For example, the user terminals may include smartphones, mobile phones, navigation systems, computers, notebooks, digital broadcasting terminals, PDAs (Personal Digital Assistants), PMPs (Portable Multimedia Players), tablet PCs, game consoles, wearable devices, IoT (internet of things) devices, VR (virtual reality) devices, AR (augmented reality) devices, set-top boxes, etc. Also, in FIG. 2, three user terminals 210_1, 210_2, and 210_3 are shown communicating with the information processing system 230 via the network 220, but this is not limited thereto, and a different number of user terminals may be configured to communicate with the information processing system 230 via the network 220.
[0033] According to one embodiment, the information processing system 230 can receive user inputs associated with user emotional expressions from a plurality of user terminals 210_1, 210_2, 210_3, and can then provide each user input, the number of accumulated emotional expressions associated with video content, or data or setting values associated with visual effects to the plurality of user terminals 210_1, 210_2, 210_3.
[0034] FIG. 3 is a block diagram showing the internal configuration of a user terminal 210 and an information processing system 230 according to an embodiment of the present disclosure. The user terminal 210 may refer to any computing device capable of executing a video content playback application or a web browser and capable of wired / wireless communication, and may include, for example, a mobile phone terminal 210_1, a tablet terminal 210_2, and a PC terminal 210_3 of FIG. 2. As shown in the figure, the user terminal 210 may include a memory 312, a processor 314, a communication module 316, and an input / output interface 318. Similarly, the information processing system 230 may include a memory 332, a processor 334, a communication module 336, and an input / output interface 338. As shown in FIG. 3, the user terminal 210 and the information processing system 230 may be configured to communicate information and / or data via the network 220 using the respective communication modules 316 and 336. Additionally, the input / output device 320 may be configured to input information and / or data to the user terminal 210 and output information and / or data generated by the user terminal 210 via the input / output interface 318 .
[0035] The memories 312 and 332 may include any non-transitory computer-readable recording medium. According to an embodiment, the memories 312 and 332 may include a permanent mass storage device such as a read only memory (ROM), a disk drive, a solid state drive (SSD), and a flash memory. As another example, a permanent mass storage device such as a ROM, an SSD, a flash memory, and a disk drive may be included in the user terminal 210 or the information processing system 230 as a separate permanent storage device separate from the memory. In addition, the memories 312 and 332 may store an operating system and at least one program code (e.g., code for a video content playback application installed and operated in the user terminal 210).
[0036] Such software components can be loaded from a computer-readable recording medium separate from the memory 312, 332. Such separate computer-readable recording medium can include a recording medium directly connectable to such user terminal 210 and information processing system 230, and can include, for example, a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, and a memory card. As another example, the software components, etc. can be loaded into the memory 312, 332 via a communication module rather than a computer-readable recording medium. For example, at least one program can be loaded into the memory 312, 332 based on a computer program to be installed by a file provided via the network 220 by a developer or a file distribution system that distributes an installation file of an application.
[0037] The processor 314, 334 may be configured to process computer program instructions by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to the processor 314, 334 by the memory 312, 332 or the communication module 316, 336. For example, the processor 314, 334 may be configured to execute instructions received by program code stored in a storage device, such as the memory 312, 332.
[0038] The communication modules 316, 336 may provide a configuration or function for the user terminal 210 and the information processing system 230 to communicate with each other via the network 220, and may provide a configuration or function for the user terminal 210 and / or the information processing system 230 to communicate with other user terminals or other systems (e.g., separate cloud systems, etc.). As an example, a request or data (e.g., a video content playback request, a user input associated with a user's emotional expression, or data associated therewith, etc.) generated by the processor 314 of the user terminal 210 via a program code stored in a storage device such as the memory 312 may be transmitted to the information processing system 230 via the network 220 under the control of the communication module 316. Conversely, a control signal or command provided by the processor 334 of the information processing system 230 may be received by the user terminal 210 via the communication module 316 of the user terminal 210 via the communication module 336 and the network 220. For example, the user terminal 210 can receive data associated with emotional expressions of other users, or data associated with the cumulative number of emotional expressions related to video content, from the information processing system 230 via the communication module 316.
[0039] The input / output interface 318 may be a means for interfacing with the input / output device 320. For example, the input device may include a device such as a camera including an audio sensor and / or an image sensor, a keyboard, a microphone, a mouse, etc., and the output device may include a device such as a display, a speaker, a haptic feedback device, etc. As another example, the input / output interface 318 may be a means for interfacing with a device having a configuration or function for performing input and output integrated into one, such as a touch screen. For example, when the processor 314 of the user terminal 210 processes an instruction of a computer program loaded in the memory 312, a service screen configured using information and / or data provided by the information processing system 230 or another user terminal may be displayed on the display via the input / output interface 318. In FIG. 3, the input / output device 320 is shown not to be included in the user terminal 210, but is not limited thereto, and may be configured integrally with the user terminal 210. In addition, the input / output interface 338 of the information processing system 230 may be a means for interfacing with a device for input or output (not shown) that is connected to the information processing system 230 or may be included in the information processing system 230. Although the I / O interfaces 318, 338 are shown in FIG. 3 as separate components from the processors 314, 334, this is not limiting and the I / O interfaces 318, 338 may also be included within the processors 314, 334.
[0040] The user terminal 210 and the information processing system 230 may include more components than those shown in FIG. 3. However, it is not necessary to explicitly show most of the conventional technical components. According to an embodiment, the user terminal 210 may be embodied to include at least a part of the above-mentioned input / output device 320. The user terminal 210 may further include other components such as a transceiver, a global positioning system (GPS) module, a camera, various sensors, and a database. For example, if the user terminal 210 is a smartphone, it may include components that a smartphone generally has, and may be embodied to further include various components such as an acceleration sensor, a gyro sensor, a camera module, various physical buttons, a button using a touch panel, an input / output port, and a vibrator for vibration.
[0041] 4 is a diagram illustrating detailed regions of a user interface 400 according to an embodiment of the present disclosure. As shown in the figure, the user interface 400 may include a first region 410, a second region 420, and a third region 430. Each of the regions 410, 420, and 430 is not limited thereto, and may be configured to have a different position and size than those shown in FIG.
[0042] The first area 410 can output video content. The second area 420 can output chat content associated with the video content. The chat content can include real-time chat between users watching the video content, notices, and main notifications. The second area 420 can include a first layer on which the chat content is output, and a second layer on which visual effects are output. Here, the first layer can be a higher layer than the second layer.
[0043] The visual effects output to the second layer may include visual effects associated with emotions that are output when a user or the like viewing the video content selects the "Like" button, and visual effects associated with the number of accumulated emotions related to the video content. As described above, the visual effects associated with the number of accumulated emotions related to the video content may change visual attributes based on the number of accumulated emotions. The second layer may have a background color / background image and a default transparency. In one example, the transparency of the second layer increases from the bottom to the top.
[0044] In one embodiment, the first area 410 where the video content is output and the second area 420 where the chat content is output may partially overlap. In this case, the second area 420 may further include a third layer where a part of the video content is output. The second layer may be a layer higher than the third layer. With this configuration, the first area 410 where the video content is displayed is maximized, and at the same time, the user can check both the chat content and the visual effects through the second area 420.
[0045] In the third area 430, various buttons / icons including a "Like" button may be displayed. When a user clicks the "Like" button in the third area 430, a visual effect associated with an emotional expression may be output in the second area 420. Additionally or alternatively, when a user clicks the "Like" button in the third area 430, an effect associated with an emotional expression may be output in the third area 430, which will be described below with reference to FIG. 5. In one embodiment, the first area 410 where the video content is output and the third area 430 may partially overlap. In this case, various buttons / icons included in the third area 430 may be output on the video content.
[0046] FIG. 5 is a diagram showing an example in which an effect associated with an emotional expression of a user according to an embodiment of the present disclosure is displayed. A first operation 510 shows an example in which, when another user viewing the video content selects the "Like" button, a first visual effect 512 associated with the emotional expression of the other user is output to a second area 514 of the display. A plurality of visual effects associated with the emotional expressions of the other user, etc. can be output to the second area 514. With this configuration, the user can visually grasp the degree of response of the other user, etc. to the video content. As shown in the figure, when the other user selects the "Like" button, no visual effect is output to the third area 516.
[0047] In one embodiment, if the number of "Like" buttons clicked by a user or the like viewing video content within a certain period of time exceeds a predetermined threshold, the size or duration of the first visual effect 512 may be reduced. This configuration can prevent problems such as the first visual effect 512 being excessively output in the second area or occupying too much area, and prevent visual fatigue of the user.
[0048] A second operation 520 shows an example in which, when a user selects the "Like" button 524, a second visual effect 526 associated with the user's emotional expression is output in the second area 514 of the display, and a third visual effect 528 associated with the user's emotional expression is output in the third area 516 of the display. For example, the third visual effect 528 output in the third area 516 of the display may be an animation including a motion in which at least one visual effect (e.g., a heart-shaped visual effect) rises from the lower part to the upper part of the third area. With such a configuration, the user can easily distinguish his / her own emotional expression from the emotional expressions of other users, and such a configuration can induce the user to actively click the "Like" button 524, thereby inducing the user's active emotional expression in addition to participating in a chat.
[0049] In one embodiment, third visual effect 528 output in third area 516 of display may have different attributes than first visual effect 512 and second visual effect 526 output in second area 514 of display. For example, third visual effect 528 may have a different shape, hue, transparency, degree of blurring, size, animation effects, etc. than first and second visual effects 512, 526. Additionally or alternatively, third visual effect 528 may be output for a longer duration than first and second visual effects 512, 526.
[0050] In one embodiment, third visual effect 528 can be output in a top layer of third area 516. Thus, third visual effect 528 is not obscured by the various buttons / icons displayed in third area 516, and the user can easily see the feedback associated with the “Like” button that he or she clicked.
[0051] As described above, by making the visual effect different when the user selects the "Like" button and when other users select the "Like" button, and particularly emphasizing the user's visual effect, the user can recognize that his / her emotional expression is differentiated from the emotional expressions of other users. That is, the user can immediately check his / her emotional expression by the visual effect displayed in the third area 516 of the display, and can immediately check the emotional expressions of all users watching the video content by the visual effect displayed in the second area 514 of the display.
[0052] 6 is a diagram illustrating an example of output of visual effects 612, 622, 634, and 636 according to an increase in the number of cumulative emotional expressions according to an embodiment of the present disclosure. As shown in the first operation 610 and the second operation 620, as the number of cumulative emotional expressions of the video content increases, the magnitude of the visual effects 612 and 622 also increases. Also, as shown in the third operation 630, when the number of cumulative emotional expressions of the video content reaches a predetermined target value, the visual effects 634 and 636 associated therewith may be output. With this configuration, a live broadcast host, a user, or the like can intuitively confirm that the number of cumulative emotional expressions of the video content increases and reaches the target value.
[0053] A first operation 610 illustrates an example in which a visual effect 612 associated with the number of accumulated emotional expressions of the video content is output in a second area 614 of the display at the start of the video content. Here, the number of accumulated emotional expressions of the video content is 0, and as the number of accumulated emotional expressions increases, the size of the visual effect 612 also increases. The visual effect 612 can be output at any position within the second area 614, and preferably at the center of the second area 614.
[0054] A second operation 620 illustrates an example in which the number of accumulated emotions of the video content increases as the video content progresses, and a visual effect 622 larger than the initial visual effect 612 is output in the second area 614 of the display. In one embodiment, the size of the visual effect 622 may be determined based on a ratio between the current number of accumulated emotions and a target value. For example, if the target value is 1,000 and the current number of accumulated emotions is 500, the size of the visual effect 622 may be half of the maximum size. In FIG. 6, the size of the visual effect 622 is shown to be larger than the size of the visual effect 612, but is not limited thereto, and visual attributes such as the hue, transparency, or blurring degree of the visual effect may change as the number of accumulated emotions of the video content increases. For example, as the number of accumulated emotions increases, the transparency of the visual effect may gradually decrease, and the visual effect may be output more clearly.
[0055] A third operation 630 shows an example in which the number of accumulated emotional expressions reaches a predetermined target value (e.g., 1,000) and visual effects 634, 636 are output in a first area 632 of the display. In one embodiment, the visual effect 634 has a predetermined shape, size, and hue, and a predetermined animation effect is applied. The visual effect 634 can be output at any position within the first area 632 where the video content is output, and can be output at the center of the first area 632.
[0056] In one embodiment, a visual effect 636 (e.g., text, an image, etc.) indicating a predetermined goal value may be displayed along with visual effect 634. For example, visual effect 636 may display a number in the form of "1,000," "1K," "1M," etc., or may display a symbol or graphic that the user should recognize as indicating a particular number (e.g., multiple star-shaped graphics each representing 100).
[0057] In one embodiment, the first area 632 may include a first layer on which video content is output and a second layer on which visual effects 634, 636 are output. Here, the second layer may be a layer higher than the first layer. With this configuration, the user can clearly recognize that the number of accumulated emotional expressions has reached a predetermined target value.
[0058] In one embodiment, before outputting the visual effect 634 in the first area 632 and after outputting the visual effect in the second area 614, a connecting visual effect can be output to seamlessly connect the visual effect output in the second area 614 and the visual effect 634 output in the first area 632. For example, the visual effect 634 can be output after the visual effect output in the second area 614 rises to the first area 632. With this configuration, connectivity between the visual effects output in the second area 614 and the first area 632 can be provided when the number of accumulated emotional expressions reaches a target value.
[0059] 7 is a diagram illustrating an example of setting values 700 of visual effects displayed in an area where chat contents are output according to an embodiment of the present disclosure. As illustrated in the figure, the setting values 700 may include at least one of the type of visual effect, the size range, the transparency range, the blurring range, or the duration range. A video content service administrator or a video content administrator may modify or delete a part of the setting values 700, or add new data to the setting values 700. For example, in the case of video content that is expected to attract a large number of viewers, the administrator may set the duration interval of the visual effect to be shorter than the basic value.
[0060] When video content is played back via a user terminal, visual effects based on the data in the setting values 700 can be output on the display of the user terminal. The user terminal can receive all or part of the setting values 700 from the information processing system, or receive video or visual effect data reflecting all or part of the setting values 700, and output visual effects based on the data in the setting values 700 together with the video content.
[0061] The data in the setting value 700 shown in Fig. 7 are merely examples and are not limited thereto. For example, the types of visual effects are not limited to a heart shape or a star shape, but may include various shapes such as a circle shape. Similar to the setting value 700, various setting values associated with the visual effects to be output in the third area of the display may be stored by a video content service administrator or a video content administrator.
[0062] FIG. 8 is a diagram illustrating an example of a setting value 800 of a visual effect associated with the number of accumulated emotional expressions of a video content according to an embodiment of the present disclosure. As illustrated in the figure, the setting value 800 may include a type of visual effect, an initial position, a subsequent position, a maximum size, a hue, a transparency, a blurring process, a number of target user inputs, a size conversion interval, and the like. Based on the setting value 800 and the number of accumulated emotional expressions, visual attributes of the visual effect associated with the number of accumulated emotional expressions of the video content may change. A video content service administrator or a video content administrator may modify or delete a part of the setting value 800 or add new data to the setting value 800. For example, when an influx of a large number of viewers is expected, the administrator may set a target value for the number of accumulated emotional expressions higher than the basic value.
[0063] When video content is played back via a user terminal, visual effects based on the data in the setting values 800 can be output on the display of the user terminal. The user terminal can receive all or part of the setting values 800 from the information processing system, or receive video or visual effect data reflecting all or part of the setting values 800, and output visual effects based on the data in the setting values 800 together with the video content.
[0064] In one embodiment, the set value 800 may include information associated with the positions of visual effects before and after the number of accumulated emotional expressions reaches a predetermined target value. For example, the set value 800 may include information related to the positions of visual effects associated with the number of accumulated emotional expressions and the positions of visual effects associated with the reaching of the target number of accumulated emotional expressions. The information related to the positions may include, but is not limited to, coordinate values (e.g., X: 150, Y: 30), and may include any type of information that can identify a position. In addition, the set value 800 may include various position information to include various movements, as well as the initial position and subsequent positions.
[0065] In one embodiment, the set value 800 may include information on a target value for the number of accumulated emotions and a detailed section in which the visual attribute of the visual effect changes. For example, the target value may be set to 2,000, the first section value to 500, the second section value to 1,000, and the third section value to 1,500. In this case, the visual effect increases in magnitude every time the number of accumulated emotions reaches 500, 1,000, and 1,500, respectively, and when it reaches 2,000, a visual effect associated with the achievement of the goal may be output. The number of detailed sections may be set by an administrator, and the detailed sections may be set so that the visual attribute changes in proportion to the number of accumulated emotions without dividing the detailed sections. Also, the detailed sections may be set so that the visual attribute does not change until the target value is reached, and the visual effect associated with the achievement of the target value is output at the same time as the target value is reached. The detailed section value may be expressed as the number of accumulated emotions (e.g., 500) as described above, or as a percentage value with the target value as the maximum value. For example, if the target value is 2,000 and the interval value is 30%, when the cumulative number of emotional expressions reaches 600, the visual attributes of the visual effect may change.
[0066] The data in the setting values 800 shown in Fig. 8 are merely examples and are not limited thereto. For example, the types of visual effects are not limited to heart shapes and star shapes, but may include various shapes such as circles.
[0067] 9 is a flow chart illustrating a method 900 for displaying a user's emotional expression in video content according to one embodiment of the present disclosure. The method 900 may be performed by at least one processor of a user terminal. The method 900 may begin by the processor outputting the video content in a first region on a display of the user terminal (S910). The processor may then output chat content associated with the video content in a second region on the display (S920).
[0068] The processor may then receive user input associated with the user's emotional expression in a third region on the display (S930). In response to receiving the user input, the processor may output a first visual effect associated with the emotional expression in the second region (S940), where the first visual effect may have at least one of any size, any hue, or any transparency and may be output at any location within the second region. Alternatively, in response to receiving the user input, the processor may output a second visual effect associated with the user's emotional expression in the third region simultaneously with outputting the first visual effect in the second region.
[0069] In one embodiment, the second area may include a first layer in which chat content is output and a second layer in which a first visual effect is output. In this case, the first layer may be a layer higher than the second layer. In addition, the first area in which video content is output and the second area in which chat content is output may partially overlap, and the second area may further include a third layer in which a part of the video content is output. In this case, the second layer may be a layer higher than the third layer.
[0070] In one embodiment, the processor may output a third visual effect associated with the emotional expression of the other user in the second region, and when the processor outputs the third visual effect associated with the emotional expression of the other user in the second region, the visual effect associated with the emotional expression of the other user is not output in the third region.
[0071] In one embodiment, the processor may output a fourth visual effect in the second region, the fourth visual effect having a varying visual attribute based on the number of accumulated emotional expressions associated with the video content. Here, the fourth visual effect increases in magnitude with an increase in the number of accumulated emotional expressions associated with the video content. In this case, the second region may include a first layer in which chat content is output and a second layer in which the fourth visual effect is output. The first layer may be a layer higher than the second layer.
[0072] In one embodiment, in response to determining that the number of cumulative emotional expressions associated with the video content reaches the predetermined target value, the processor can output a fifth visual effect in the first region. In this case, the first region can include a fourth layer in which the video content is output and a fifth layer in which the fifth visual effect is output. The fifth layer can be a layer higher than the fourth layer. Also, before outputting the fifth visual effect and after outputting the fourth visual effect, the processor can output a sixth visual effect for seamlessly connecting the fourth visual effect output in the second region and the fifth visual effect output in the first region. Additionally, the processor can output a seventh visual effect indicating the predetermined target value together with the fifth visual effect in the first region.
[0073] 9 and the above description are merely illustrative and may be implemented in different ways in some embodiments, for example, one or more steps may be omitted, the order of the steps may be changed, one or more steps may overlap, or one or more steps may be repeated multiple times.
[0074] The above-mentioned method may be provided as a computer program stored in a computer-readable recording medium for execution by a computer. The medium may be a medium for continuously storing a computer-executable program or a medium for temporarily storing the program for execution or download. The medium may be various recording means or storage means in the form of a single or multiple hardware components combined, and may be distributed over a network without being limited to a medium directly connected to a computer system. Examples of the medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, ROMs, RAMs, flash memories, etc., configured to store program instructions. Other examples of the medium include recording media or storage media managed by app stores that distribute applications, and other sites, servers, etc. that supply or distribute various software.
[0075] The methods, operations, or techniques of the present disclosure may be embodied in a variety of ways. For example, such techniques may be embodied in hardware, firmware, software, or a combination thereof. Those skilled in the art will appreciate that the various exemplary logical blocks, modules, circuits, and algorithmic steps described in the present disclosure may be embodied in electronic hardware, computer software, or a combination of both. To clearly illustrate such interchangeability between hardware and software, the various exemplary components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is embodied as hardware or software will vary depending on the particular application and design requirements imposed on the overall system. Those skilled in the art may also embody the described functionality in a variety of ways for each particular application, but such embodying should not be interpreted as departing from the scope of the present disclosure.
[0076] In a hardware implementation, the processing units used to perform the techniques may be embodied as one or more ASICs, DSPs, digital signal processing devices (DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), processors, controllers, microcontrollers, microprocessors, electronic devices, other electronic units, computers designed to perform the functions described in this disclosure, or any combination thereof.
[0077] Thus, the various example logic blocks, modules, and circuits described in this disclosure may be embodied or performed with a general purpose processor, a DSP, an ASIC, an FPGA or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination designed to perform the functions described herein. A general purpose processor may be a microprocessor, but alternatively, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be embodied with a combination of computing devices, such as a DSP and a microprocessor, multiple microprocessors, one or more microprocessors in conjunction with a DSP core, or any other configuration.
[0078] In a firmware and / or software implementation, the techniques may be embodied with instructions stored on a computer-readable medium, such as random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable PROM (EEPROM), flash memory, compact disc (CD), magnetic or optical data storage devices, etc. The instructions are executable by one or more processors to cause the processors or others to perform certain aspects of the functions described in this disclosure.
[0079] Although the above embodiments have been described as utilizing aspects of the presently disclosed subject matter on one or more stand-alone computer systems, the present disclosure is not limited thereto and may be embodied in any computing environment, such as a network or distributed computing environment. Additionally, aspects of the subject matter in the present disclosure may be embodied in multiple processing chips or devices, and storage may be similarly affected across multiple devices. Such devices may include PCs, network servers, and handheld devices.
[0080] Although the present disclosure has been described in the present specification by way of some embodiments, various modifications and alterations can be made within the scope of the present disclosure that can be understood by those skilled in the art to which the present disclosure pertains. In addition, such modifications and alterations should be understood to fall within the scope of the claims attached hereto. [Explanation of symbols]
[0081] 100 users 110 User terminal 120 Display 130 "Like" button 140 Visual Effects Associated with User Emotion Expressions 150 Cumulative emotes and associated visual effects
Claims
1. A method for displaying a user's emotional expression in video content, the method being performed by at least one processor of a user terminal, comprising: outputting the video content in a first area on a display of the user terminal; outputting chat content associated with the video content in a second area on the display; receiving a user input associated with a user's emotional expression at a third area on the display; and in response to receiving the user input, outputting in the second area a first visual effect associated with the emotional expression, and outputting in the third area a second visual effect associated with the emotional expression.
2. 2. The method of claim 1, wherein in response to receiving the user input, the first visual effect is output in the second area while the second visual effect is output in the third area.
3. 2. The method for displaying a user's emotional expression in video content according to claim 1, wherein the first visual effect has at least one of an arbitrary size, an arbitrary hue, and an arbitrary transparency, and is output at an arbitrary position within the second area.
4. the second area includes a first layer on which the chat content is output and a second layer on which the first visual effect is output; The method for displaying a user's emotional expression in video content according to claim 1 , wherein the first layer is a layer higher than the second layer.
5. a first area to which the video content is output and a second area to which the chat content is output partially overlap each other; the second area further includes a third layer through which a portion of the video content is output; The method for displaying a user's emotional expression in video content according to claim 4 , wherein the second layer is a layer higher than the third layer.
6. The method of claim 1 , further comprising the step of outputting a third visual effect associated with the emotional expression of another user in the second area.
7. 7. The method for displaying a user's emotional expression in video content as described in claim 6, wherein when a third visual effect associated with the emotional expression of the other user is output in the second area, a visual effect associated with the emotional expression of the other user is not output in the third area.
8. 2. The method of claim 1, further comprising: outputting, in the second region, a fourth visual effect whose visual attribute changes based on a number of accumulated emotional expressions associated with the video content.
9. The method of claim 8 , wherein the fourth visual effect increases in magnitude with an increase in a number of cumulative emotions associated with the video content.
10. the second area includes a first layer to which the chat content is output and a second layer to which the fourth visual effect is output; The method for displaying a user's emotional expression in video content according to claim 8 , wherein the first layer is a layer higher than the second layer.
11. 9. The method of claim 8, further comprising the step of: outputting a fifth visual effect in the first area in response to determining that a number of cumulative emotional expressions associated with the video content has reached a predetermined target value.
12. the first area includes a fourth layer to which the video content is output and a fifth layer to which the fifth visual effect is output; The method for displaying a user's emotional expression in video content according to claim 11, wherein the fifth layer is a layer higher than the fourth layer.
13. The method for displaying a user's emotional expression in video content as described in claim 11, further comprising the step of outputting a sixth visual effect before outputting the fifth visual effect and after outputting the fourth visual effect, for seamlessly connecting the fourth visual effect output in the second area and the fifth visual effect output in the first area.
14. 12. The method for displaying a user's emotional expression in video content according to claim 11, further comprising the step of outputting, in the first area, a seventh visual effect indicating the predetermined target value together with the fifth visual effect.
15. A computer-readable computer program for executing the method for displaying a user's emotional expression in video content according to any one of claims 1 to 14 on a computer.
16. A user terminal, A communication module; Memory, A display and at least one processor coupled to the memory and configured to execute at least one computer readable program contained in the memory; The at least one program comprises: outputting video content in a first area on the display; outputting chat content associated with the video content in a second area on the display; receiving a user input associated with a user's emotional expression at a third area on the display; and in response to receiving the user input, outputting in the second area a first visual effect associated with the emotional expression, and outputting in the third area a second visual effect associated with the emotional expression.
Citation Information
Patent Citations
Operation method of terminal for instant messaging service
JP2020009445A
Information processing system and control program
JP2020127126A
Information processing system, information processing apparatus, and control program
JP2020127127A
System, method and program for distributing live video
JP2021027583A
KR2012-0108485
