Method and electronic device for controlling playback of content

Abstract

This disclosed electronic device comprises a memory for storing one or more instructions and at least one processor including a circuit device, wherein the one or more instructions are individually or collectively executed by the at least one processor such that the electronic device is configured to: acquire real-time characteristics of content being played back; acquire a viewing environment of the electronic device which is playing back the content; and on the basis that a delay time of the content being played back in the electronic device exceeds a threshold delay time, control playback of the content on the basis of at least one of the real-time characteristics or the viewing environment.

Description

Method for controlling content playback and electronic device

[0001] The present disclosure relates to an electronic device and a method of operating the same. Specifically, the present disclosure relates to a method for controlling the playback of content, an electronic device, and a server.

[0002] With the popularization of media streaming alongside the proliferation of OTT (Over-the-Top) services, the number of users watching media via streaming services has increased significantly. Additionally, real-time live streaming services for major events such as sports matches or concerts have been introduced. Since streaming services download content via the Internet Protocol network, it may be difficult to play content stably depending on network conditions.

[0003] If an electronic device detects an increase in content latency, it can compensate for the delay by playing the content at a faster speed than specified in the streaming data. However, this method can lead to a degradation of the user experience. Conversely, if the device compensates for latency with playback speeds so subtle that the viewer does not perceive them, it takes a significant amount of time to recover the delay, which may result in the loss of the purpose and advantages of low-latency streaming.

[0004] The present invention aims to provide an electronic device for controlling the playback of content according to a disclosed embodiment and a method of operation thereof.

[0005] An electronic device according to one embodiment of the present disclosure may include at least one processor comprising a memory for storing at least one instruction and a circuit device. By executing at least one instruction individually or collectively by at least one processor, the electronic device may acquire real-time characteristics of content being played. By executing at least one instruction individually or collectively by at least one processor, the electronic device may acquire a viewing environment of the electronic device playing content. By executing at least one instruction individually or collectively by at least one processor, the electronic device may control the playback of content based on at least one of real-time characteristics or a viewing environment, based on whether the delay time of content being played on the electronic device exceeds a threshold delay time.

[0006] A method of operation of an electronic device according to one embodiment of the present disclosure may include an operation of obtaining real-time characteristics of content being played. A method of operation of an electronic device according to one embodiment of the present disclosure may include an operation of obtaining a viewing environment of an electronic device playing content. A method of operation of an electronic device according to one embodiment of the present disclosure may include an operation of controlling the playback of content based on at least one of real-time characteristics or a viewing environment, based on the fact that the delay time of content being played on the electronic device exceeds a threshold delay time.

[0007] In a computer-readable recording medium having at least one instruction recorded according to one embodiment of the present disclosure, the at least one instruction is executed individually or collectively by at least one processor to obtain real-time characteristics of content being played, obtain a viewing environment of an electronic device playing content, and control the playback of content based on at least one of the real-time characteristics or the viewing environment based on the delay time of content being played on the electronic device exceeding a threshold delay time.

[0008] FIG. 1 is a reference diagram illustrating an example of an electronic device that controls the playback of content according to one embodiment of the present disclosure.

[0009] FIG. 2 is a block diagram showing the configuration of an electronic device according to one embodiment of the present disclosure.

[0010] FIG. 3 is a block diagram illustrating a method for controlling the playback of content through a module included in a memory according to one embodiment of the present disclosure.

[0011] FIG. 4 is a flowchart illustrating a method for controlling the playback of content according to one embodiment of the present disclosure.

[0012] FIG. 5 is a reference diagram for explaining a method of controlling the playback of content in sections where the real-time characteristics of the content exist and sections where they do not exist, according to one embodiment of the present disclosure.

[0013] FIG. 6 is a reference diagram for explaining a method of controlling the playback of content when an independent section of content is identified according to one embodiment of the present disclosure.

[0014] FIG. 7 is a reference diagram for explaining a case in which real-time characteristics of content according to one embodiment of the present disclosure are included in a playlist of content.

[0015] FIG. 8 is a reference diagram for explaining a case in which real-time characteristics of content according to one embodiment of the present disclosure are included in the metadata of the content.

[0016] FIG. 9 is a drawing for illustrating the operation of a sensor of an electronic device according to one embodiment of the present disclosure.

[0017] FIG. 10a is a flowchart illustrating a method for controlling the playback of content based on a viewing environment according to one embodiment of the present disclosure.

[0018] FIG. 10b is a flowchart for explaining detailed operations included in operation 1030 according to one embodiment of the present disclosure.

[0019] FIG. 11 is a reference diagram for explaining an example of determining the concentration rate based on the viewing environment according to one embodiment of the present disclosure.

[0020] FIG. 12 is a block diagram illustrating the configuration of a server according to one embodiment of the present disclosure.

[0021] FIG. 13 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0022] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments.

[0023] In relation to the description of the drawings, similar reference numerals may be used for similar or related components.

[0024] The singular form of the noun corresponding to the item may include one or multiple items, unless the relevant context clearly indicates otherwise.

[0025] In this document, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "at least one of A, B, or C" may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof.

[0026] The term “and / or” includes a combination of multiple related described components or any of the multiple related described components.

[0027] Terms such as "first," "second," or "first" or "second" may be used simply to distinguish a component from another component and do not limit the components in other aspects (e.g., importance or order).

[0028] Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0029] Terms such as “include” or “have” are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in this document, and do not preclude the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0030] When it is said that one component is “connected,” “combined,” “supported,” or “in contact” with another component, this includes not only cases where the components are directly connected, combined, supported, or in contact, but also cases where they are indirectly connected, combined, supported, or in contact through a third component.

[0031] When it is said that a component is located “on” another component, this includes not only cases where one component is in contact with the other, but also cases where another component exists between the two components.

[0032] It should be understood that the blocks in each flowchart and combinations of flowcharts can be executed by one or more computer programs containing computer-executable instructions. One or more computer programs may be stored all in a single memory or may be partitioned and stored in multiple different memories.

[0033] One embodiment of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented by various numbers of hardware and / or software configurations that execute specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more microprocessors or by circuit configurations for a specific function. Additionally, for example, the functional blocks of the present disclosure may be implemented in various programming or scripting languages. The functional blocks may be implemented as algorithms executed on one or more processors. Furthermore, the present disclosure may employ prior art for electronic configuration, signal processing, and / or data processing, etc.

[0034] All functions or operations described in this document may be processed by a single processor or a combination of processors. A single processor or a combination of processors is a circuitry that performs processing and may include circuitry such as an AP (Application Processor), CP (Communication Processor), GPU (Graphical Processing Unit), NPU (Neural Processing Unit), MPU (Microprocessor Unit), SoC (System on Chip), IC (Integrated Chip), etc.

[0035] The present disclosure will be described in detail below with reference to the attached drawings.

[0036] FIG. 1 is a reference diagram illustrating an example of an electronic device that controls the playback of content according to one embodiment of the present disclosure.

[0037] Referring to FIG. 1, an electronic device (100) according to one embodiment can play content (110). The electronic device (100) may play content (110) stored in the electronic device (100), or may play content (110) received from an external electronic device or server. For example, the content (110) may include broadcast, VOD (Video on Demand), OTT streaming service, real-time sports game, live concert, music broadcast, news, music and radio, game, educational content, etc.

[0038] The electronic device (100) can acquire content (110) through an Internet Protocol (IP) network. The electronic device (100) can acquire content through a low-latency streaming protocol network to reduce latency. When acquiring content through a low-latency streaming protocol network, the electronic device (100) may not be able to buffer a large amount of data due to the characteristics of the low-latency streaming protocol. In this case, the electronic device (100) may react sensitively to changes in network conditions (e.g., unstable network connection) during the playback of the content (110).

[0039] The electronic device (100) can calculate the latency of the content (110) being played. Latency may represent the time taken from when the content is transmitted from the server until it is actually output (or played). In real-time streaming, latency may represent the time it takes for the content to reach the viewer (e.g., smartphone, computer, etc.) from the creator (e.g., camera or broadcasting system). The shorter the latency, the closer the viewer can see the scene with the actual event.

[0040] If the latency increases due to unstable network conditions or limitations in device performance, viewers may experience a situation where real-time streaming through the electronic device (100) becomes increasingly slow. In this case, a time difference may occur between the event being broadcast and the content being viewed by the viewer, which may compromise the real-time nature of the real-time streaming. Since real-time streaming is originally meant to deliver content to the user almost immediately the moment it is created, the longer this latency becomes, the less the streaming can be considered real-time in the true sense.

[0041] For example, if the delay time increases in a real-time sports match, viewers may end up watching the game later than the actual game situation. As a result, when an important moment (e.g., a goal, a score) occurs during the game, the user experience or immersion may be degraded due to spoilers from other viewers. For example, a situation may occur where someone else is already announcing the game result through shouts or messages, but the viewer is not yet able to watch that moment through the electronic device (100).

[0042] The electronic device (100) can perform an operation to recover the delay time by adjusting the playback speed based on the calculated delay time. For example, the electronic device (100) can acquire time information (timestamp) of the content (110) currently being played and compare the actual time of the content currently being played with the delayed time. If the electronic device (100) detects that the delay time exceeds a threshold delay time, the electronic device (100) can recover the delay time by playing the content (110) faster than the playback speed of the content included in the streaming data to recover the delay time. However, if the content (110) is played faster than the playback speed of the content included in the streaming data, the user may perceive that the content is being played faster than the playback speed, which may degrade the user experience.

[0043] An electronic device (100) according to one embodiment of the present disclosure can adaptively recover a delay time based on the delay time of content being played exceeding a threshold delay time. The electronic device (100) can adaptively perform (or determine) a delay time recovery operation by reflecting at least one of the real-time characteristics (120) of the content being played or the viewing environment (130).

[0044] In one embodiment, the electronic device (100) can improve the user experience by adaptively compensating for the delay time based on the real-time characteristics (120) of the content being played.

[0045] In one embodiment, the real-time characteristic (120) of the content may indicate whether the content reflects an ongoing event or activity in real time. The real-time characteristic (120) of the content may indicate whether the content is broadcast in real time. The real-time characteristic (120) of the content may indicate whether the content is not pre-produced or stored, but is created simultaneously at the time the content is played. For example, content having a real-time characteristic may include at least one of a broadcast corresponding to an event taking place in real time, such as a live sports match, a live concert, or a live music broadcast. For example, content not having a real-time characteristic may include at least one of a pre-recorded broadcast or an advertisement.

[0046] In one embodiment, the electronic device (100) can acquire real-time characteristics (120) of the content in various ways. For example, the electronic device (100) can acquire real-time characteristics (120) of the content by recognizing (or identifying, analyzing) a scene of the content (110) being played. For example, the electronic device (100) can identify real-time characteristics (120) of the content included in at least one of the metadata of the content (110) or the playlist of the content (110).

[0047] In one embodiment, the electronic device (100) can acquire real-time characteristics (120) for each playback section of the content being played. For example, the electronic device (100) can identify that the first section of the content being played is a section where real-time characteristics exist, the second section is a section where real-time characteristics do not exist, and the third section is a section where real-time characteristics exist.

[0048] In one embodiment, the electronic device (100) can control the playback of the content (110) based on real-time characteristics (120) for each acquired playback section. In one embodiment, the electronic device (100) can play the sections of the content (110) being played that have real-time characteristics at a first speed. The electronic device (100) can play the sections that do not have real-time characteristics at a second speed higher than the first speed. For example, the electronic device (100) can play the sections that have real-time characteristics at 1x speed and the sections that do not have real-time characteristics at 1.2x speed. For example, the electronic device (100) can play the sections that have real-time characteristics at 1.05x speed and the sections that do not have real-time characteristics at 1.15x speed.

[0049] In one embodiment, by adjusting at least one of whether to play the content at a faster speed or the playback speed based on real-time characteristics of each playback section of the content, the delay time can be recovered without degrading the user experience.

[0050] In one embodiment, the electronic device (100) can identify an independent section corresponding to a specified content characteristic among sections where the real-time characteristic of the content (110) is absent. The independent section may be a section having a specified content characteristic different from other playback sections.

[0051] In one embodiment, if the content (110) is content obtained through real-time streaming, the independent section may represent a section corresponding to a specific function or purpose during the real-time broadcast. The independent section may represent a section included in the content (110) provided through real-time streaming that exists logically and structurally separated from the section having real-time characteristics. For example, the independent section may correspond to a purpose or nature different from the subject or content of the section having real-time characteristics. For example, the independent section may include pre-produced content that does not require real-time characteristics. The independent section may be configured to allow insertion, replacement, or independent processing by the broadcaster or platform operator. The electronic device (100) may manage the independent section so that it can be distinguished from the section having real-time characteristics through at least one of an identifier, metadata, or tag. For example, the independent section may include an advertisement section during a real-time sports match or a pre-recorded singer interview video during a real-time music broadcast.

[0052] For example, the purpose of a real-time segment, such as a live sports match, is to broadcast the game, while the primary purpose of an independent advertising segment may be to promote products or services. For instance, a real-time segment, such as a live music broadcast, is intended to broadcast a singer's performance, whereas the primary purpose of an independent segment, such as a pre-recorded singer interview video, may be to provide background information about the singer or behind-the-scenes stories about the music production process.

[0053] In one embodiment, the electronic device (100) may skip and play independent sections. For example, the electronic device (100) may play the content by jumping to the end point of the independent section based on identifying the start point of the independent section during the playback of the content (110). In one embodiment, the electronic device (100) may play the content (110) of the section having real-time characteristics at a normal speed based on identifying the independent section. For example, the normal speed may be 1x speed. For example, the normal speed may be a playback speed that is not played at a multiplier. In one embodiment, the electronic device (100) may play the content (110) of the section having real-time characteristics at a specified playback speed based on identifying the independent section. The specified playback speed may be a playback speed included (e.g., specified) in the streaming data of the content (110). For example, the specified playback speed may be 1.01x speed, 1.05x speed, etc., but is not limited to the examples described.

[0054] In one embodiment, by skipping independent sections of the content and playing them, latency can be recovered without degrading the user experience.

[0055] In one embodiment, the electronic device (100) can improve the user experience by adaptively compensating for the delay time based on the viewing environment (130) of the electronic device (100) that plays the content.

[0056] In one embodiment, the viewing environment (130) may represent physical conditions or situations in which a viewer views content. The viewing environment (130) may include various information related to the surrounding environment or the viewer when the electronic device plays content. For example, the viewing environment (130) may include at least one of the following: the number of viewers (e.g., whether it is a single viewer or multiple users), the direction of the viewer's gaze or the position and direction of the viewer's face, the viewer's actions or posture (e.g., sitting, moving, leaving, etc.), the viewer's voice response or surrounding acoustic characteristics, ambient brightness, lighting color temperature, temperature, or noise level; physical environmental conditions such as the distance between the electronic device (100) and the viewer or the viewing angle, or the type of viewing location (e.g., living room, outdoors, inside a vehicle, etc.). In one embodiment, the electronic device (100) may acquire the viewing environment (130) of the electronic device (100) playing content (110) based on sensor data acquired by a sensor (e.g., camera, microphone, motion sensor, light sensor).

[0057] For example, sensor data may include at least one of image, sound, motion data, or illuminance data around the electronic device (100) acquired by a camera. Based on the image around the electronic device (100) acquired by the camera, the electronic device (100) may acquire at least one of the number of viewers watching the content, the movements of the viewers, or the gaze of the viewers. In one embodiment, the electronic device (100) may acquire the concentration rate of the viewers based on a plurality of elements included in the viewing environment (130).

[0058] In one embodiment, the electronic device (100) may control the playback of content (110) based on the viewing environment (130). In one embodiment, the electronic device (100) may control the playback of content (110) based on the viewer's concentration rate. In one embodiment, the electronic device (100) may perform a catch-up or passive catch-up that prioritizes playback quality by playing the content (110) at a third speed based on the viewer's concentration rate exceeding a threshold concentration rate. In one embodiment, the electronic device (100) may perform a catch-up or active catch-up that prioritizes latency recovery by playing the content (110) at a fourth speed higher than the third speed based on the viewer's concentration rate being below the threshold concentration rate. Here, the third speed and the fourth speed are terms used to distinguish between the third speed and the fourth speed. The third speed and the fourth speed do not necessarily have to be different from the first speed and the second speed. The third speed and the fourth speed may be the same as or different from the first speed and the second speed.

[0059] For example, the electronic device (100) can play content (110) at 1.05 times speed based on the viewer's concentration rate exceeding a threshold concentration rate, and play content (110) at 1.2 times speed based on the viewer's concentration rate being below a threshold concentration rate. The electronic device (100) can make up for delay time without degrading the user experience by performing a fast catch-up based on the viewer's concentration rate being below a threshold value.

[0060] In one embodiment of the present disclosure, the electronic device (100) can compensate for latency without degrading the user experience by adjusting the playback speed based on the viewing environment (130). Through this, the electronic device (100) can support low-latency real-time streaming that can improve the user experience while flexibly responding to network conditions.

[0061] Hereinafter, we will examine in detail a method for controlling the playback of content based on at least one of the real-time characteristics (120) of the content being played by an electronic device (100) according to one embodiment of the present disclosure or the viewing environment (130) of the electronic device (100) playing the content.

[0062] FIG. 2 is a block diagram showing the configuration of an electronic device according to one embodiment of the present disclosure.

[0063] According to one embodiment of the present disclosure, an electronic device (100) is a device capable of displaying an image or data upon a user's request and may include a memory (210) and a processor (220).

[0064] The electronic device (100) can be implemented in various forms. The electronic device (100) can be any type of device that performs functions including a processor and memory. The electronic device (100) can be a stationary or portable device. For example, the electronic device (100) may represent a device equipped with a display capable of displaying image content, video content, game content, graphic content, etc. The electronic device (100) may include various types of electronic devices capable of receiving and outputting content, such as televisions like network TV, smart TV, internet TV, web TV, and IPTV; computers like desktops, laptops, and tablets; smart monitors; digital signage; large displays; 360-degree projectors; smartphones; cellular phones; game players; music players; video players; medical equipment; and home appliances. The electronic device (100) may be referred to as a display device in terms of displaying content, and may also be referred to as a content providing device, a computing device, etc.

[0065] The electronic device (100) can output various forms of content provided by content providers. The content may include still images, video such as video, audio, subtitles, and other additional information. A content provider may refer to a content production company that provides various types of content to consumers, a terrestrial broadcasting station, a cable broadcasting station, a satellite broadcasting station, or an IPTV (Internet Protocol Television) service provider or an OTT (Over the Top) service provider. A content provider may produce various types of content such as dramas, movies, entertainment programs, news, games, audio, etc.

[0066] In one embodiment, the electronic device (100) may be implemented without a display. The electronic device (100) may include, but is not limited to, a set-top box, a desktop PC, etc., that can be connected to a separate external display. In this case, the electronic device (100) may be configured to be connected to an external display device through an input / output section such as an HDMI port to transmit video / audio signals to the external display device. Alternatively, the electronic device (100) may be connected to the external display device through short-range wireless communication or long-range wireless communication such as wired communication, wireless LAN (W-LAN), Wi-Fi, or Bluetooth.

[0067] The memory (210) can store a program for processing and controlling the processor (220), and can store data that is input to or output from the electronic device (100). Additionally, the memory (210) can store data necessary for the operation of the electronic device (100).

[0068] The memory (210) may include at least one type of storage medium among flash memory type, hard disk type, multimedia card micro type, card type memory (e.g., SD or XD memory, etc.), RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk, and optical disk.

[0069] The memory (210) may not exist separately but may be configured to be included in the processor (220). The memory (210) may be composed of volatile memory, non-volatile memory, or a combination of volatile and non-volatile memory. The memory (210) may store a program or at least one instruction for performing operations according to the embodiments described below. The memory (210) may provide stored data to the processor (220) upon the request of the processor (220).

[0070] The processor (220) controls the overall operation of the electronic device (100). The processor (220) is configured to control a series of processes to enable the electronic device (100) to operate according to the embodiments described below, and may be composed of one or more processors. The one or more processors included in the processor (220) may be circuitry such as a System on Chip (SoC) or an Integrated Circuit (IC). The one or more processors included in the processor (220) may be a general-purpose processor such as a CPU (Central Processing Unit), MPU (Micro Processor Unit), AP (Application Processor), or DSP (Digital Signal Processor); a graphics-dedicated processor such as a GPU (Graphic Processing Unit) or VPU (Vision Processing Unit); an artificial intelligence-dedicated processor such as an NPU (Neural Processing Unit); or a communication-dedicated processor such as a CP (Communication Processor). If one or more processors included in the processor (220) are artificial intelligence dedicated processors, the artificial intelligence dedicated processors may be designed with a hardware structure specialized for processing a specific artificial intelligence model.

[0071] The processor (220) can write data to memory (210) or read data stored in memory (210), and in particular, can process data according to a predefined operation rule or artificial intelligence model by executing a program or at least one instruction stored in memory (210). Accordingly, the processor (220) can perform operations described in subsequent embodiments, and operations described as being performed by the electronic device (100) or detailed elements included in the electronic device (100) in subsequent embodiments can be seen as being performed by the processor (220) unless otherwise specified.

[0072] For example, the processor (220) may perform the function of the electronic device (100) described in the present disclosure by individually or collectively executing at least one instruction stored in the memory (210). Alternatively, according to one embodiment, the electronic device (100) may perform the function described in the present disclosure by individually or collectively executing at least one instruction stored in the memory (210) by the processor (220).

[0073] In one embodiment, the processor (220) can obtain real-time characteristics of the content being played by executing at least one instruction stored in memory (210) individually or collectively.

[0074] In one embodiment, the processor (220) can obtain a viewing environment of the electronic device that plays the content by executing at least one instruction stored in memory (210) individually or collectively.

[0075] In one embodiment, the processor (220) can control the playback of content based on at least one of real-time characteristics or viewing environment by executing at least one instruction stored in memory (210) individually or collectively, based on whether the delay time of the content being played on the electronic device exceeds a threshold delay time.

[0076] In one embodiment, the processor (220) can play the content of a playback section having real-time characteristics at a first speed by executing at least one instruction stored in memory (210) individually or collectively.

[0077] In one embodiment, the processor (220) can play the content of a playback section that is not real-time at a second speed higher than the first speed by executing at least one instruction stored in memory (210) individually or collectively.

[0078] In one embodiment, at least one of the metadata of the content or the playlist of the content obtained by the processor (220) individually or collectively executing at least one instruction stored in the memory (210) may include real-time characteristics.

[0079] In one embodiment, the processor (220) can recognize a scene of content and acquire real-time characteristics by executing at least one instruction stored in memory (210) individually or collectively.

[0080] In one embodiment, the processor (220) can identify independent sections having specified content characteristics among sections where real-time characteristics are absent by executing at least one instruction stored in memory (210) individually or collectively.

[0081] In one embodiment, the processor (220) can skip independent sections and play the content being played on the electronic device (100) by executing at least one instruction stored in memory (210) individually or collectively, based on the delay time of the content being played on the electronic device (100) exceeding a threshold delay time.

[0082] In one embodiment, the processor (220) can play the content of a section having real-time characteristics at a specified playback speed based on the identification of an independent section by executing at least one instruction stored in memory (210) individually or collectively. In one embodiment, the processor (220) can play the content by jumping to the end point of an independent section based on the identification of the start point of an independent section during playback of the content by executing at least one instruction stored in memory (210) individually or collectively, based on the fact that the delay time of the content being played on the electronic device (100) exceeds a threshold delay time.

[0083] In one embodiment, the processor (220) can determine independent sections by identifying silent sections of content by executing at least one instruction stored in memory (210) individually or collectively.

[0084] In one embodiment, the processor (220) can obtain a viewing environment based on sensor data obtained by a sensor by executing at least one instruction stored in memory (210) individually or collectively. The viewing environment may include at least one of the number of viewers, the movements of viewers, the gaze of viewers, or ambient brightness.

[0085] In one embodiment, the processor (220) can determine the concentration rate of a viewer watching content based on the viewing environment by executing at least one instruction stored in memory (210) individually or collectively.

[0086] In one embodiment, the processor (220) can control the playback of content based on the viewer's concentration rate by executing at least one instruction stored in memory (210) individually or collectively.

[0087] In one embodiment, the processor (220) can play the content at a third speed based on the viewer's concentration rate exceeding a threshold concentration rate by executing at least one instruction stored in memory (210) individually or collectively.

[0088] In one embodiment, the processor (220) can play the content at a fourth speed higher than the third speed based on the viewer's concentration rate being below a threshold concentration rate by executing at least one instruction stored in memory (210) individually or collectively.

[0089] In one embodiment, the processor (220) can play the content at the normal speed based on the delay time of the content being less than or equal to the threshold time by executing at least one instruction stored in the memory (210) individually or collectively.

[0090] FIG. 3 is a block diagram for explaining a module that controls the playback of content according to one embodiment of the present disclosure.

[0091] The content playback control module (300) may include a real-time characteristic acquisition module (310), a viewing environment acquisition module (320), a playback control module (330), a playback speed processing module (340), a latency calculation module (350), a decoding module (360), and a rendering module (370). The modules (310, 320, 330, 340, 350, 360, 370) included in the content playback control module (300) of FIG. 3 are configurations classified based on function or role.

[0092] A content playback control module (300) may be included in an electronic device. According to one embodiment, the content playback control module (300) may include appropriate logic, circuits, interfaces, and / or code that can be operated to control the playback of content.

[0093] According to one embodiment, the modules (310, 320, 330, 340, 350, 360, 370) of the content playback control module (300) of FIG. 3 may be software configurations implemented by the processor (220) of the electronic device (100) executing a program stored in memory (210), and may also be virtual configurations in which no actual matching hardware device exists. In other words, the operations performed by the processor (220) of the electronic device (100) by executing a program or instruction stored in memory (210) may be classified into multiple groups according to function or purpose, and the entities performing the operations included in each classified group may be represented as the modules (310, 320, 330, 340, 350, 360, 370) of FIG. 3. Accordingly, the operations described as being performed by the modules (310, 320, 330, 340, 350, 360, 370) of the content playback control module (300) illustrated in FIG. 3 can actually be seen as being performed by the processor (220) of the electronic device (100) by executing a program or instruction stored in memory (210).

[0094] In FIG. 3, a content playback control module (300) of a single electronic device is shown to include all modules (310, 320, 330, 340, 350, 360, 370), but is not limited thereto. At least some of the modules (310, 320, 330, 340, 350, 360, 370) may be implemented to be included in a separate device, and any one module may be implemented to be included in another module.

[0095] In addition, at least some of the modules (310, 320, 330, 340, 350, 360, 370) may be implemented to be included in multiple different memories, or a memory containing one module may be implemented to be included in a memory containing another module. As such, at least some of the modules (310, 320, 330, 340, 350, 360, 370) included in an electronic device according to one embodiment of the present disclosure may be a hardware configuration or a software configuration, and may be implemented in various forms of electronic devices (e.g., a single electronic device or a combination of two or more electronic devices).

[0096] The block diagram of the content playback control module (300) illustrated in FIG. 3 is a block diagram for one embodiment. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the electronic device actually implemented. For example, two or more components may be combined into one component as needed, or one component may be subdivided into two or more components. Furthermore, the functions performed in each block are for the purpose of describing embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.

[0097] In one embodiment, the real-time characteristic acquisition module (310) can acquire the real-time characteristic of the content being played. The real-time characteristic acquisition module (310) may acquire the real-time characteristic of the content inside the electronic device (100) or outside the electronic device (100). The real-time characteristic acquisition module (310) can acquire the real-time characteristic for each playback section of the content.

[0098] In one embodiment, the real-time characteristic acquisition module (310) can receive real-time characteristics of the content from an external device. In one embodiment, the real-time characteristic acquisition module (310) can acquire real-time characteristics of the content by analyzing the content. For example, the real-time characteristics may be data acquired by the real-time characteristic acquisition module (310) by recognizing a scene of the content. For example, the real-time characteristics of the content may be data acquired by the real-time characteristic acquisition module (310) based on segment information of the content.

[0099] When the real-time characteristic acquisition module (310) receives real-time characteristics of content from the server, the real-time characteristics may be data acquired from the content section processing module of the server, which will be described with reference to FIG. 12. When the electronic device (100) analyzes the content and acquires real-time characteristics, the electronic device (100) may acquire real-time characteristics based on the content output from the rendering module (370).

[0100] In one embodiment, the real-time characteristic acquisition module (310) can determine a strategy to recover the delay time of the content based on the real-time characteristics of the content.

[0101] In one embodiment, the viewing environment acquisition module (320) can acquire the viewing environment of an electronic device that plays content. For example, the viewing environment acquisition module (320) can acquire the viewing environment of an electronic device that plays content in real-time. For example, the viewing environment acquisition module (320) can acquire the viewing environment of the electronic device (100) based on sensor data acquired by a sensor. The sensor may include a camera, a microphone, a motion sensor, and a motion sensor, but is not limited to the examples described above. The sensor may or may not be physically connected to the electronic device (100).

[0102] In one embodiment, the viewing environment may include at least one of the number of viewers (or the presence or absence of viewers), the movements of viewers, the gaze of viewers, or ambient brightness. The viewing environment acquisition module (320) can acquire the viewing environment of an electronic device (100) that plays content by synthesizing sensor data. In one embodiment, the viewing environment acquisition module (320) can determine the concentration rate of viewers based on the viewing environment.

[0103] In one embodiment, the playback control module (330) can control the playback of content. In one embodiment, the playback of content can be controlled based on data obtained from at least one of the real-time characteristic acquisition module (310), the viewing environment acquisition module (320), or the latency calculation module (350). In one embodiment, if the playback control module (330) determines that the latency received from the latency calculation module (350) exceeds a threshold latency, the playback control module (330) can determine a strategy to recover the latency of content based on the real-time characteristics obtained from the real-time characteristic acquisition module (310) and the viewing environment obtained from the viewing environment acquisition module (320).

[0104] The playback control module (330) can control the playback method for each playback section of the content to compensate for the delay time. For example, the playback control module (330) can control the playback method so that the first section of the content is played at a normal speed, the second section of the content is played at a speed faster than the normal speed, and the third section of the content is skipped and played. For example, the playback control module (330) can control the playback method so that the first section of the content is played at an arbitrary specified playback speed, the second section of the content is played at a speed faster than the arbitrary specified playback speed, and the third section of the content is skipped and played.

[0105] The playback control module (330) can determine a strategy to recover the delay time without degrading the user experience based on the delay time to be recovered, the real-time characteristics of each playback segment of the content, and the viewing environment.

[0106] In one embodiment, if the playback control module (330) determines that the delay time received from the delay time calculation module (350) is less than or equal to the threshold delay time, the playback method can be adjusted to play the content at a normal speed.

[0107] In one embodiment, the playback speed processing module (340) may operate when playing content at a specific speed according to the processing result of the playback control module (330). For example, the playback speed processing module (340) may match the timing of audio and video so that the content can be played at a speed higher than 1x speed or at a speed slower than 1x speed, and may adjust so that the voice is not distorted. The playback speed processing module (340) may process the content so that it can play content at a speed that matches the speed by using an algorithm that adjusts the spacing between frames or adjusts the pitch of the voice so that the voice and video can be heard and seen naturally even during playback at a specific speed.

[0108] In one embodiment, the delay time calculation module (350) can calculate the delay time of the content being played. By obtaining time information (time stamp) of the content being played from the decoding module (360) and the rendering module (370), it can determine how much the delay time has increased compared to the start time of playback. In one embodiment, the delay time calculation module (350) can calculate the delay time by analyzing the time difference at the stage where the decoding module (360) decodes the content and the rendering module (370) outputs the content.

[0109] Latency can also be expressed as waiting time, latency, or response speed. Therefore, short latency (or a small latency value) can mean no or almost no delay (or a fast response speed), while long latency (or a large latency value) can mean significant delay or a slow response speed.

[0110] In one embodiment, the delay time calculation module (350) can transmit the calculated delay time to the playback control module (330).

[0111] In one embodiment, the decoding module (360) can decode the compressed content. The decoding module (360) can transmit the decoded content to the rendering module (370). The decoding module (360) can decode the compressed content based on data obtained from the playback control module (330) and the playback speed processing module (340). The decoding module (360) can transmit a timestamp of the content decoding step to the delay time calculation module (350).

[0112] In one embodiment, the rendering module (370) can output decoded content. Specifically, it can output decoded video data to a display and decoded audio data to a speaker. The rendering module (370) can transmit a timestamp of the step of outputting content to the delay time calculation module (350). The rendering module (370) can transmit the outputted content to the real-time feature acquisition module (310).

[0113] In one embodiment, the rendering module (370) can output the decoded content obtained from the decoding module (360) based on the timing of the frames processed by the speed playback processing module (340). In one embodiment, the rendering module (370) can synchronize the audio and video during speed playback.

[0114] Below, a method for controlling the playback of content using some or all of the functions of the above modules (310, 320, 330, 340, 350, 360, 370) will be described in detail.

[0115] FIG. 4 is a flowchart illustrating a method for controlling the playback of content according to one embodiment of the present disclosure.

[0116] In operation 410, the electronic device (100) can acquire the real-time characteristic of the content being played.

[0117] In one embodiment, the electronic device (100) can acquire real-time characteristics corresponding to each of a plurality of playback sections of content. For example, the electronic device (100) can identify whether real-time characteristics corresponding to each of a plurality of playback sections of content exist. For example, the electronic device (100) can identify (or classify) sections in the content where real-time characteristics exist and sections where real-time characteristics do not exist.

[0118] In one embodiment, the real-time characteristic may be included in at least one of the metadata of the content or the playlist of the content.

[0119] Metadata can represent data that describes content. Metadata may refer to data that describes the content or structure of the information of the content. For example, if the content is real-time streaming content, the metadata may include at least one of the length and timestamp of each segment, whether each segment is real-time streaming data, the date and time each segment was recorded, or the reload cycle of the playlist. Metadata may indicate whether real-time attributes exist for each segment based on tags.

[0120] A playlist may represent a file that defines at least one of an arrangement method or a playback method of multiple segments of content. Based on the segment information included in the playlist, the electronic device (100) can identify a segment having real-time characteristics among a plurality of segments. For example, if the content is real-time streaming content, the playlist may include at least one of the starting point of a discontinuous segment, the length of each segment, the nature of each segment, or the nature of the entire content.

[0121] An example in which the real-time characteristics of the content are included in the metadata of the content will be described with reference to FIG. 7, and an example in which the real-time characteristics of the content are included in the playlist of the content will be described with reference to FIG. 8. For brevity, redundant descriptions are omitted here.

[0122] In one embodiment, the electronic device (100) can recognize a scene of content to obtain real-time characteristics of the content. For example, the electronic device (100) can identify a point in time when the content of the content changes to identify the start and / or end point of a section where real-time characteristics exist or the start and / or end point of a section where real-time characteristics do not exist. For example, the electronic device (100) can utilize artificial intelligence technology, such as object recognition, when recognizing a scene of content.

[0123] In one embodiment, the electronic device (100) can acquire real-time characteristics of the content by recognizing a section of the content. For example, the electronic device (100) can identify the point in time when a scene of the content changes to identify the start and / or end point of a section in which real-time characteristics exist or a section in which real-time characteristics do not exist. For example, the electronic device (100) can identify the point in time when the playback speed specified in the streaming data of the content changes to identify the start and / or end point of a section in which real-time characteristics exist or a section in which real-time characteristics do not exist.

[0124] In operation 420, the electronic device (100) can obtain a viewing environment of the electronic device playing content. In one embodiment, the viewing environment may include at least one of the number of viewers, the movements of the viewers, the gaze of the viewers, or ambient brightness. Specific embodiments of obtaining the viewing environment will be described with reference to operation 1010 of FIGS. 9 and FIGS. 10a, and redundant descriptions are omitted here for brevity.

[0125] In operation 430, the electronic device (100) can determine whether the delay time of the content being played on the electronic device (100) exceeds a threshold delay time. For example, the electronic device (100) can calculate the delay time by comparing the time information of the content being decoded with the time information of the content being rendered. The threshold delay time may be a predetermined value, a value specified by a user, or a value that changes in real time.

[0126] In operation 440, the electronic device (100) can control the playback of content based on at least one of real-time characteristics or viewing environment, based on the delay time of the content being played on the electronic device exceeding a threshold delay time.

[0127] In one embodiment, the electronic device (100) can control the playback of content based on real-time characteristics based on the delay time of the content being played on the electronic device exceeding a threshold delay time.

[0128] For example, the electronic device (100) can play content of a playback section having real-time characteristics at a first speed. For example, the electronic device (100) can play content of a playback section not having real-time characteristics at a second speed higher than the first speed.

[0129] Hereinafter, with reference to FIG. 5, an embodiment in which an electronic device (100) controls the playback of content based on the real-time characteristics of the content will be described in detail.

[0130] FIG. 5 is a reference diagram for explaining a method of controlling the playback of content in sections where real-time characteristics of the content exist and sections where they do not exist, according to one embodiment of the present disclosure.

[0131] In one embodiment, the electronic device (100) can identify a first section (510) in which real-time characteristics exist, a section (520) in which real-time characteristics do not exist, and a second section (530) in which real-time characteristics exist in the content.

[0132] In one embodiment, the electronic device (100) can identify the start time (522) and / or end time (524) of a section (520) in which real-time characteristics are not present in the content. In one embodiment, the electronic device (100) can identify the start time and / or end time of a section (510, 530) in which real-time characteristics are present in the content.

[0133] For example, the electronic device (100) can identify the start time (522) and / or end time (524) of a section (520) where real-time characteristics do not exist based on at least one of the metadata of the content or the playlist of the content. For example, the electronic device (100) can identify the start time and / or end time of a section (510, 530) where real-time characteristics exist based on at least one of the metadata of the content or the playlist of the content.

[0134] For example, the electronic device (100) can identify the start time (522) and / or end time (524) of a section (520) where real-time characteristics do not exist by identifying a scene of content. For example, the electronic device (100) can identify the start time and / or end time of a section (510, 530) where real-time characteristics exist by identifying a scene of content.

[0135] In one embodiment, the electronic device (100) can identify that the delay time of the content being played exceeds a threshold time. For example, the electronic device (100) can identify that the delay time of the content being played exceeds a threshold time at a first point in time (512). The electronic device (100) can play the content at a normal speed (e.g., 1x speed) before the first point in time (512). The electronic device (100) can play the content at a specified playback speed (e.g., 1.05x speed) before the first point in time (512).

[0136] In one embodiment, the electronic device (100) can play a first section (510) with real-time characteristics at a first speed. If the electronic device (100) plays the first section (510) with real-time characteristics at a faster speed, the user experience may be degraded. For example, if the first section (510) with real-time characteristics corresponds to a real-time sports match, if the first section (510) with real-time characteristics is played at a speed higher than 1x speed, viewers may feel that the match scene is unnatural.

[0137] In one embodiment, the first speed may be a normal speed. The first speed may be a value between the normal speed and the second speed. Meanwhile, while the electronic device (100) is playing the first section (510) having real-time characteristics at the first speed, if the delay time is recovered (for example, if it is identified that the delay time is less than or equal to a threshold time), the first section (510) having real-time characteristics may be played at the normal speed.

[0138] In one embodiment, the electronic device (100) can play a section (520) in which real-time characteristics are absent at a second speed. In one embodiment, the second speed may be a higher value than the first speed. Even if the section (520) in which real-time characteristics are absent is played at a faster speed, the impact on the user experience may be relatively less compared to the section in which real-time characteristics are present.

[0139] In one embodiment, the playback speed specified in the streaming data corresponding to the section (520) where real-time characteristics do not exist may be lower than the playback speed specified in the streaming data corresponding to the section (510, 530) where real-time characteristics exist. For example, the section (520) where real-time characteristics do not exist in the streaming data may be described as playing the content at 0.8x speed, and the section (510, 530) where real-time characteristics exist may be described as playing at 1x speed. In this case, even if the electronic device (100) plays the section (520) where real-time characteristics do not exist at a speed higher than 1x speed, the user may not be able to perceive whether the playback is being played at a higher speed.

[0140] For example, if the content of a section (520) in which real-time characteristics do not exist in the streaming data is specified to be played at 0.8x speed, and the electronic device (100) plays it at 1.2x speed, the final playback speed may be 0.8 * 1.2 = 0.96x speed. Since the final playback speed is close to 1x speed, viewers may not feel that the game scene is unnatural.

[0141] In one embodiment, the section (520) where real-time characteristics are absent may be a section in which a portion of the section (510, 530) where real-time characteristics are present is played back at a speed different from the playback speed specified in the streaming data corresponding to the section (510, 530) where real-time characteristics are present. For example, the section (520) where real-time characteristics are absent may be a replay section of a real-time sports match. For example, the section (520) where real-time characteristics are absent may be a section in which a specific event during a real-time news broadcast is played back in slow motion. For example, the section (520) where real-time characteristics are absent may be a section in which an important play during a real-time game broadcast is played back in slow motion and analyzed in detail.

[0142] In one embodiment, the section (520) where real-time characteristics are absent may be any content inserted between the first section (510) where real-time characteristics are present and the second section (530) where real-time characteristics are present. For example, the section (520) where real-time characteristics are absent may be a video introducing a singer at a live concert. For example, the section (520) where real-time characteristics are absent may be a section showing a player's previous game clip during a live game stream. For example, the section (520) where real-time characteristics are absent may be a news briefing or a clip summarizing past events inserted during a real-time news broadcast. For example, the section (520) where real-time characteristics are absent may be an advertisement video during an e-sports match or a video highlighting past matches.

[0143] From now on, we will explain the case where the section (520) where real-time characteristics do not exist is a replay section of a scene where a player scores a goal in a real-time sports match. The replay section can be configured to slow down the playback of the scene where a player scores a goal during a real-time sports match so that viewers can see the scene of scoring a goal in detail. For example, the playback speed specified in the streaming data corresponding to the replay section may be 0.8x speed, and the playback speed specified in the streaming data corresponding to the real-time sports match may be 1x speed.

[0144] In one embodiment, even if the electronic device (100) plays the replay section faster than the playback speed specified in the streaming data (e.g., at 1.2x speed), the final playback speed is 0.8*1.2=0.96x speed, so the viewer may not be aware of whether the electronic device (100) is playing the replay section at a faster speed.

[0145] In one embodiment, the electronic device (100) can compensate for the delay time of the content being played without degrading the user experience by selectively applying accelerated playback in sections where real-time characteristics are absent. In one embodiment, the electronic device (100) can compensate for the delay time of the content being played without degrading the user experience by adjusting the degree of accelerated playback in sections where real-time characteristics are absent.

[0146] Meanwhile, the electronic device (100) can play the section (520) where real-time characteristics are absent at a second speed while playing the section (520) where real-time characteristics are absent at a normal speed if the delay time is recovered (for example, if it is identified that the delay time is less than or equal to a threshold time).

[0147] The embodiment for the first section (510) having real-time characteristics described above can be applied as is to the second section (530) having real-time characteristics, and for brevity, redundant descriptions will be omitted.

[0148] In one embodiment, the electronic device (100) may skip and play a section (520) where real-time characteristics are not present. The operation of the electronic device (100) skipping and playing a section (520) where real-time characteristics are not present may be performed by the same or similar principle as the operation of skipping and playing an independent section (620) described with reference to FIG. 6, and for brevity, redundant descriptions are omitted here.

[0149] Hereinafter, with reference to FIG. 6, an embodiment in which an electronic device (100) controls the playback of content including independent sections will be described in detail.

[0150] FIG. 6 is a reference diagram for explaining a method of controlling the playback of content when an independent section of content is identified according to one embodiment of the present disclosure.

[0151] Since the embodiment for identifying a section with real-time characteristics and the embodiment for controlling the playback of a section with real-time characteristics have been described above with reference to FIG. 5, a redundant description will be omitted.

[0152] In one embodiment, the electronic device (100) can identify an independent section (620) in the content. In one embodiment, the electronic device (100) can identify an independent section (620) among sections where the real-time nature of the content does not exist. In one embodiment, the electronic device (100) can identify the start time (622) and / or end time (624) of the independent section (620) in the content.

[0153] For example, the electronic device (100) can identify the start time (622) and / or end time (624) of an independent segment (620) based on at least one of the metadata of the content or the playlist of the content. The independent segment (620) may appear in a form in which a tag indicating the existence of a specified content characteristic is added to the metadata or playlist corresponding to the segment where real-time is not present.

[0154] For example, the electronic device (100) can identify the scene of the content to identify the start time (622) and / or end time (624) of the independent section (620). For example, the electronic device (100) can identify the start time (622) and / or end time (624) of the independent section (620) by identifying at least one of the time when the scene of the content changes, the time when the content of the content changes, or the time when the path through which the content was acquired changes.

[0155] In one embodiment, the electronic device (100) can identify that the delay time of the content being played exceeds a threshold time. For example, the electronic device (100) can identify that the delay time of the content being played exceeds a threshold time at a first point in time (612). Before the first point in time (612), the electronic device (100) can play the content at a specified playback speed (e.g., 1x speed, 1.05x speed).

[0156] In one embodiment, based on the identification of an independent section (620), the electronic device (100) may play the content of the section (610, 630) that has real-time characteristics at a normal speed or a designated playback speed. This may be because playing the content of the section (610, 630) that has real-time characteristics at a normal speed or a designated playback speed and skipping the independent section (620) can improve the user experience. In one embodiment, the normal speed may be 1x speed. For example, the normal speed may be a speed that does not play at a multiplier. In one embodiment, the designated playback speed may be any playback speed that does not impair the user experience, such as 1.05x speed or 1.1x speed, which is close to 1x speed. For example, the designated playback speed may be a playback speed specified in the streaming data.

[0157] In one embodiment, the electronic device (100) can skip and play an independent section (620) (e.g., jump playback). In one embodiment, the electronic device (100) can jump to the end point (624) of the independent section (620) and play the content following the end point based on the identification of the start point (622) of the independent section (620) during the playback of the content. The electronic device (100) can skip and play the independent section if it is determined to be an unnecessary section or content that the user is not interested in.

[0158] In one embodiment, the electronic device (100) can analyze an independent section (620) within the content in real time, automatically identify the independent section, and then skip the independent section (620) and continue playback. For example, if the independent section (620) is an advertisement video, the user can skip the advertisement and quickly access the desired main content. Through this, the electronic device (100) can reduce unnecessary waiting time and increase viewing convenience. By doing so, the electronic device (100) can dynamically control a specific section of the content, thereby maximizing playback flexibility while compensating for latency.

[0159] The electronic device (100) can execute a section jump function based on programmed logic. For example, when an independent section defined as an advertisement section or a non-real-time section is included in the content, the electronic device (100) can recognize the independent section and perform a function to automatically move from the previous section to the next section.

[0160] In one embodiment, the electronic device (100) may provide a jump button on the interface so that the user can directly activate the segment skip function. Through this, the viewer can manually skip independent segments by their own choice. The automatic segment skip function can be applied to various types of content, such as streaming, recorded broadcasts, and live streams.

[0161] In one embodiment, the independent section (620) is included in a section where real-time characteristics do not exist, so the electronic device (100) may have little impact on the user experience even if it skips the independent section (620) and plays. The independent section (620) may be a section having designated content characteristics that have little impact on the user experience even if it is skipped and played. In one embodiment, by skipping the independent section and playing, the delay time of the content being played can be recovered without degrading the user experience.

[0162] In one embodiment, the independent section (620) may be any content inserted between the first section (510) having real-time characteristics and the second section (530) having real-time characteristics. For example, the independent section (620) may be an advertisement video during a real-time sports match. For example, the independent section (620) may be a singer introduction video during a live concert. For example, the independent section (620) may be a player highlight video during an e-sports match. For example, the independent section (620) may be a new product advertisement during a real-time game stream.

[0163] Meanwhile, the electronic device (100) can play the independent section (620) at a normal speed or a specified playback speed when the delay time is recovered (e.g., when it is identified that the delay time is less than or equal to the threshold time).

[0164] In one embodiment, the independent section (620) is identified among the sections where real-time characteristics do not exist, so the playback control operation for the sections where real-time characteristics do not exist, as previously described with reference to FIG. 5, can also be applied to the independent section (620), and redundant descriptions are omitted here.

[0165] In one embodiment, the electronic device (100) can identify silent sections of content and determine independent sections. The electronic device (100) can analyze the audio signal during content playback to determine whether audio silence occurs in a specific section. Silent sections can be detected by the absence of sound or by a consistently low volume. Audio silent sections can be used as signals to indicate transitions between sections of content.

[0166] In one embodiment, the electronic device (100) can identify a silent section of content to identify at least one of the start or end point of an independent section. For example, if the electronic device (100) identifies a silent section during the playback of content, it may determine that an independent section exists before or after the silent section. For example, the electronic device (100) may identify that specific content (e.g., an advertisement or an interview) has ended before the silent section and determine the corresponding section as an independent section. For example, if new content begins after the silent section, the electronic device may determine that the subsequent section is an independent section.

[0167] For example, the electronic device (100) may determine that an independent section exists before the silent section, or that an independent section exists after the silent section. For example, the electronic device (100) may determine that a transition to an independent section occurs in a section where real-time characteristics exist before and after the silent section. For example, the electronic device (100) may determine that a transition to an independent section occurs in a section other than the independent section among sections where real-time characteristics do not exist before and after the silent section.

[0168] In one embodiment, a silent period may be inserted before an advertisement or important content begins during a live broadcast, and the electronic device can detect the transition of the period through this. For example, a silent period may be detected during the playback of real-time sports game content. In this case, the silent period may indicate an important moment of the game or a point of transition to an advertisement. At this time, the electronic device recognizes the transition of the playback period and can identify the independent period.

[0169] For example, the electronic device (100) can recognize a section where the purpose, nature, or format of the content is switched through a silent section. In one embodiment, the electronic device (100) can determine that the content is switched to an independent section at the point (or section) where the silence of the audio is detected.

[0170] In one embodiment, the electronic device (100) can control the playback of content based on the viewing environment of the electronic device (100) playing the content, based on the delay time of the content being played on the electronic device exceeding a threshold delay time.

[0171] For example, the electronic device (100) can determine the concentration rate of the viewer based on the viewing environment and control the playback of the content based on the concentration rate of the viewer. For example, the content can be played at a third speed based on the viewer's concentration rate exceeding a threshold concentration rate. For example, if the viewer's concentration rate is below the threshold concentration rate, the content can be played at a fourth speed higher than the third speed. An embodiment of controlling the playback of the content based on the viewing environment of the electronic device (100) playing the content will be described in detail with reference to FIG. 10, and redundant descriptions are omitted here.

[0172] Returning to Fig. 4, in operation 450, the electronic device (100) can play the content at a normal speed if the delay time of the content being played on the electronic device is less than or equal to the threshold time.

[0173] FIG. 7 is a reference diagram for explaining a case in which real-time characteristics of content according to one embodiment of the present disclosure are included in a playlist of content.

[0174] In one embodiment, when the electronic device (100) receives content from an external electronic device, it can acquire real-time characteristics of the content included in the content playlist and / or specified content characteristics together.

[0175] The real-time characteristics and / or specified content characteristics of the content included in the content playlist may be acquired when the content is filmed. The real-time characteristics and / or specified content characteristics of the content included in the content playlist may be entered by the user when the content is filmed or streamed. The real-time characteristics and / or specified content characteristics of the content included in the content playlist may be automatically entered according to scene transitions of the content.

[0176] Referring to FIG. 7, we will describe a case where real-time characteristics are included in an m3u8 file, which is a playlist used for streaming LL-HLS, a type of low-latency streaming protocol. For the sake of brevity, matters that can be understood by a person skilled in the art to which this disclosure belongs will be described briefly below.

[0177] Element 710 can represent basic information about the content. For example, #EXT-X-PLAYLIST-TYPE:LIVE can indicate that the playlist is a live stream. Since Element 710 is a standard m3u8 component, a description of it will be omitted here for the sake of brevity.

[0178] Element 720 may represent a segment of a section that has real-time characteristics. For example, #EXT-X-PART:DURATION=0.5 may indicate that the length of the part segment is 0.5 seconds. For example, URI=https: / example.com / live_part1.ts may represent the URL of a part segment of a section that has real-time characteristics. The electronic device (100) can stream the part segment of a section that has real-time characteristics via the URL.

[0179] For example, in "#EXTINF:2.0, https: / example.com / live_segment1.ts", #EXTINF:2.0 may indicate that the playback time of the corresponding segment is 2 seconds. The entire segment is provided with a length of 2 seconds, and the electronic device (100) can obtain the segment of the section with real-time characteristics through the URL address https: / example.com / live_segment1.ts.

[0180] The electronic device (100) can play a section of the content that has real-time characteristics through element 720 of the playlist 700.

[0181] Element 730 may indicate a segment of a section where real-time characteristics are absent. For example, #EXT-X-DISCONTINUITY may indicate the start of a discontinuous section. Specifically, in Element 730, #EXT-X-DISCONTINUITY may indicate the end of a section where real-time characteristics of the content exist and the start of a section where real-time characteristics are absent. In Element 720 as well, similar to Element 710, the electronic device (100) may stream a partial segment of 0.5 seconds in length via a URL.

[0182] For example, the electronic device (100) can stream content by obtaining the first part segment of the section where real-time characteristics do not exist through the URL address https: / example.com / replay_part1.ts and the second part segment of the section where real-time characteristics do not exist through the URL address https: / example.com / replay_part2.ts.

[0183] For example, in "#EXTINF:1.0, https: / example.com / replay_segment.ts", #EXTINF:2.0 may indicate that the playback time of the corresponding segment is 1 second. The entire segment is provided with a length of 2 seconds, and the electronic device (100) can stream the content by obtaining the segment of the section with real-time characteristics through the URL address https: / example.com / replay_segment.ts.

[0184] The electronic device (100) can play a section of the content where real-time characteristics are not present through element 730 of the playlist 700.

[0185] Element 740 may represent a segment of an independent section. #EXT-X-DISCONTINUITY may indicate that a discontinuous section begins. Specifically, in Element 750, #EXT-X-DISCONTINUITY may indicate that a section other than the independent section ends and the independent section begins, among sections where the real-time characteristics of the content do not exist. In Element 740 as well, similar to Element 710, the electronic device (100) may stream a partial segment of 0.5 seconds in length. #EXT-SCENE-TYPE: Specified may indicate that the playback section is a section with specified content characteristics. For example, #EXT-SCENE-TYPE: Specified may indicate that the playback section is an independent section. For example, the independent section represented by the playlist in Element 740 may indicate an advertisement section.

[0186] The electronic device (100) can play independent sections of content through element 740 of playlist 700.

[0187] Element 750, #EXT-X-DISCONTINUITY, can indicate the start of a discontinuous segment. Specifically, in Element 750, #EXT-X-DISCONTINUITY can indicate that an independent segment of content ends and a segment with real-time characteristics begins again. Since the description of Element 750 overlaps with the description of Element 720, the description will be omitted here for the sake of brevity.

[0188] The m3u8 code of FIG. 7 is an example embodiment, and the real-time characteristics of the content and / or specified content characteristics may be included in the m3u8 code in a manner that a person skilled in the art can adopt. Additionally, the real-time characteristics of the content and / or specified content characteristics may be included in a playlist other than the m3u8 code in a manner that a person skilled in the art can adopt.

[0189] FIG. 8 is a reference diagram for explaining a case in which real-time characteristics of content according to one embodiment of the present disclosure are included in the metadata of the content.

[0190] In one embodiment, when the electronic device (100) receives content from an external electronic device, it may acquire real-time characteristics of the content and / or specified characteristics of the content included in the metadata of the content. The metadata of the content may include characteristics of the content for each playback segment.

[0191] The real-time characteristics and / or specified content characteristics included in the content's metadata may have been acquired at the time the content was captured. The real-time characteristics and / or specified content characteristics included in the content's metadata may have been entered by the user at the time the content was captured or streamed. The real-time characteristics and / or specified content characteristics included in the content's metadata may have been automatically entered according to scene transitions of the content.

[0192] Referring to FIG. 8 below, an example is described in which real-time characteristics and specified content characteristics are included in the JSON-formatted metadata of video content. For the sake of brevity, matters that can be understood by those skilled in the art to which this disclosure belongs will be described briefly below.

[0193] Element 810 can represent metadata for segments containing basic information and real-time characteristics of the content. For example, liveStreamMetadata can indicate that the above object is an object containing metadata for real-time video. "segments": [ can indicate the start of an array containing segment information.

[0194] In one embodiment, "startTime": "0", "endTime": "300" may indicate that the start time of the playback interval is 0 seconds and the end time is 300 seconds. "type": "live" may indicate that the content of the playback interval is live. "realTimeCharacteristic": "yes" may indicate that the playback interval has real-time characteristics.

[0195] Element 820 can represent metadata for intervals where real-time characteristics are absent.

[0196] In one embodiment, "startTime": "300", "endTime": "320" may indicate that the start time of the playback section is 300 seconds and the end time is 320 seconds. "type": "replay" may indicate that the content of the playback section is a replay. "realTimeCharacteristic": "none" may indicate that the real-time characteristic of the playback section is absent.

[0197] Element 830 can represent metadata for independent intervals.

[0198] In one embodiment, "startTime": "320", "endTime": "340" may indicate that the start time of the playback segment is 320 seconds and the end time is 340 seconds. "type": "advertisement" may indicate that the content of the playback segment is a replay. "realTimeCharacteristic": "none" may indicate that the real-time characteristic of the playback segment is absent. "specified_characteristic" : "yes" may indicate that the specified content characteristic of the playback segment exists.

[0199] Element 840 can represent metadata for a section where real-time characteristics exist. Since the description of Element 840 overlaps with the description of Element 810, the description will be omitted here for brevity.

[0200] The JSON code of FIG. 8 is an example embodiment, and real-time characteristics of the content and / or specified content characteristics may be included in the JSON code in a manner that a person skilled in the art can adopt. Additionally, real-time characteristics of the content and / or specified content characteristics may be included in metadata other than the JSON code in a manner that a person skilled in the art can adopt.

[0201] FIG. 9 is a drawing for illustrating the operation of a sensor of an electronic device according to one embodiment of the present disclosure.

[0202] In one embodiment of the present disclosure, the electronic device (100) may include a sensor. The sensor may acquire sensor data of the electronic device (100). The sensor may transmit the acquired sensor data to the electronic device (100). The electronic device (100) may acquire a viewing environment based on the sensor data acquired by the sensor. For example, the electronic device (100) may detect at least one of the number of viewers, the gaze of viewers, the movement of viewers, or ambient brightness based on the sensor data acquired by the sensor. The sensor may include at least one of a camera (910), a microphone (920), a motion sensor (930), or an illuminance sensor (940).

[0203] The camera (910) can capture the physical environment space surrounding the electronic device (100). In one embodiment of the present disclosure, the camera (910) may include an RGB camera capable of acquiring an image containing RGB information. However, the present disclosure is not limited thereto, and the camera (910) may include a stereo camera comprising two RGB cameras, an RGB-Depth camera acquiring an image containing RGB information and depth information, or a black and white camera acquiring a black and white image, and is not limited to any one of these.

[0204] A camera (910) may be positioned at the top center of the electronic device (100) to acquire an image of the space where the electronic device (100) is located. The camera (910) may transmit the captured image to the electronic device (100). Based on the image acquired by the camera (910), the electronic device (100) may detect the number of viewers in the space where the electronic device (100) is located, the movements of the viewers, and / or the gaze of the viewers. In one embodiment, the electronic device (100) may acquire the viewing environment of the electronic device (100) based on the detected number of viewers, the movements of the viewers, and / or the gaze of the viewers. In one embodiment, the electronic device (100) may determine the concentration rate of viewers watching content based on the viewing environment. An embodiment for determining the concentration rate of viewers watching content will be described in detail with reference to FIG. 10, and redundant descriptions will be omitted here.

[0205] In one embodiment, the electronic device (100) can perform a visual understanding technique that recognizes objects like human vision based on images acquired by the camera (910). Visual understanding is a technique that recognizes and processes objects like human vision and may include object recognition, object tracking, image search, person recognition, scene understanding, spatial understanding, image enhancement, etc. For example, the electronic device (100) can detect the number of viewers in the images acquired by the camera (910) through object recognition and / or person recognition. The electronic device (100) can detect the movements of viewers in the images acquired by the camera (910) through object tracking. Since the functions of object recognition, person recognition, and object tracking can be intuitively inferred by a person skilled in the art from their names, a detailed description will be omitted.

[0206] The electronic device (100) can detect the viewer's gaze by measuring the order and position of the viewer's eyes through eye tracking. For example, if the viewer's gaze included in the video acquired through the camera (910) is directed toward the electronic device (100), the electronic device (100) can recognize that the viewer is watching the content. For example, if the viewer's gaze included in the video acquired through the camera (910) is directed toward a space other than the electronic device (100), the electronic device (100) can recognize that the viewer is not concentrating on the content.

[0207] The microphone (920) can receive the uttered voice of a viewer. The microphone (920) can convert the received voice into an electrical signal and transmit it to the electronic device (100). The microphone (920) can detect the voice of a viewer in the space where the electronic device (100) is located. The microphone (920) can be placed at the center bottom or right bottom of the electronic device (100) to detect the voice of a viewer in the space where the electronic device (100) is located.

[0208] The electronic device (100) can determine the number of viewers and / or the actions of viewers detected based on the voice of the viewers detected by the microphone (920).

[0209] For example, if a voice is detected through the microphone (920), the electronic device (100) can recognize that a viewer is present in the space where the electronic device (100) is located. For example, if a voice is detected through the microphone (920), the electronic device (100) can identify that the viewer in the space where the electronic device (100) is located is not in a sleeping state. For example, if the electronic device (100) analyzes the voice of the viewer detected by the microphone (920) and detects the voices of two different people, the electronic device (100) can identify that there are two or more viewers in the space where the electronic device (100) is located.

[0210] The motion sensor (930) can detect the motion (or movement) of an object located in the space where the electronic device (100) is located. For example, the electronic device (100) can detect the motion of a viewer watching the electronic device (100). The motion sensor (930) may include passive infrared (PIR), sensor ultrasonic sensors, microwave sensors, dual tech / hybrid sensors, etc., but the present disclosure is not limited thereto. The motion sensor (930) may be positioned at the right center or right bottom of the electronic device (100) to detect the motion of a viewer in the space where the electronic device (100) is located.

[0211] The motion sensor (930) can generate a motion value and transmit it to the electronic device (100). The electronic device (100) can obtain a viewing environment based on the motion of the viewer detected by the motion sensor (930). For example, if motion is detected through the motion sensor (930), the electronic device (100) can recognize that a viewer who is not in a sleeping state is present in the space where the electronic device (100) is located.

[0212] The illuminance sensor (940) can detect the illuminance (or brightness) of the space where the electronic device (100) is located. The electronic device (100) can identify or obtain an illuminance value using the sensor detection value of the illuminance sensor (940). The illuminance value may vary depending on the on / off status of the indoor lighting device of the target space, the set illuminance, the daylight, etc. The illuminance sensor (940) may include, for example, a photoresistor, a photodiode, or a phototransistor.

[0213] An illuminance sensor (940) may be positioned at the right center or right bottom of the electronic device (100) to detect the illuminance of the space where the electronic device (100) is located. The illuminance sensor (940) may generate an illuminance value and transmit it to the electronic device (100). The electronic device (100) may obtain the brightness around the electronic device (100) based on the illuminance value obtained by the illuminance sensor (940). However, the present disclosure is not limited thereto, and the illuminance sensor (940) may include various configurations for measuring the illuminance of the space containing the electronic device (100).

[0214] The electronic device (100) can obtain a viewing environment based on the movement of a viewer detected by the light sensor (940). For example, if a light value lower than the reference light is detected by the light sensor (940), the electronic device (100) can estimate that there is no viewer in the space where the electronic device (100) is located or that the viewer is in a sleeping state. For example, if a light value higher than the reference light is detected by the light sensor (940), the electronic device (100) can estimate that there is a viewer in the space where the electronic device (100) is located and that the viewer is watching content output through the electronic device (100).

[0215] FIG. 10a is a flowchart illustrating a method for controlling the playback of content based on a viewing environment according to one embodiment of the present disclosure.

[0216] In operation 1010, the electronic device (100) can acquire a viewing environment based on sensor data acquired by a sensor. The sensor data may include at least one of image, sound, motion data, or illuminance value around the electronic device (100) acquired by a camera. The viewing environment may include at least one of the number of viewers, the movements of viewers, the gaze of viewers, or ambient brightness.

[0217] For example, the electronic device (100) can acquire at least one of the number of viewers watching the content, the actions of the viewers, or the gaze of the viewers based on an image of the electronic device (100) acquired by a camera.

[0218] For example, sensor data may include sound around the electronic device (100) acquired by a microphone. The electronic device (100) may acquire the number of viewers around the electronic device (100) based on the sound around the electronic device (100) acquired by the microphone.

[0219] For example, sensor data may include motion data around the electronic device (100) acquired by a motion sensor. Based on the motion data around the electronic device (100) acquired by the motion sensor, the electronic device (100) may acquire the movement of a viewer around the electronic device (100).

[0220] For example, sensor data may include an illuminance value around the electronic device (100) obtained by a motion sensor. Based on the illuminance value around the electronic device (100) obtained by an illuminance sensor, the electronic device (100) can determine whether the brightness around the electronic device (100) exceeds a threshold brightness.

[0221] In one embodiment, the electronic device (100) can obtain a viewing environment by combining sensor data.

[0222] In operation 1020, the electronic device (100) can determine the concentration rate of a viewer watching content based on the viewing environment. For example, the electronic device (100) can determine the concentration rate of a viewer watching content based on at least one of the number of viewers, the movement of viewers, the gaze of viewers, or ambient brightness. For example, the electronic device (100) can determine the concentration rate of a viewer watching content by synthesizing the viewing environment.

[0223] In one embodiment, the electronic device (100) can analyze the viewer's behavior to determine whether the viewer is looking at the screen, whether the viewer is sleeping, or whether the viewer is performing other actions (e.g., using a mobile phone, talking, etc.). The electronic device (100) can determine the viewer's concentration rate based on the viewer's behavior and the number of viewers.

[0224] The electronic device (100) can measure whether the viewer is looking at the electronic device (100) or how long the viewer is looking at the screen based on the viewer's gaze. The electronic device (100) can determine the viewer's concentration rate based on the viewer's gaze and the number of viewers.

[0225] The electronic device (100) can determine the concentration rate of the viewer based on the sound that the viewer may be in a sleeping state when the ambient light is low.

[0226] In addition to the above examples, the electronic device (100) can obtain the viewer's concentration rate in various ways based on the viewing environment. The concentration rate may be in various forms. For example, the concentration rate may be continuous or discontinuous numerical data, or binary data indicating whether there is concentration or not.

[0227] In operation 1030, the electronic device (100) can control the playback of content based on the viewer's concentration rate. In one embodiment, the electronic device (100) can adaptively recover the delay time by controlling the playback of content based on the viewer's concentration rate based on the delay time of the content being played on the electronic device exceeding a threshold delay time.

[0228] FIG. 10b is a flowchart for explaining detailed operations included in operation 1030 according to one embodiment of the present disclosure.

[0229] In operation 1032, the electronic device (100) can determine whether the viewer's concentration rate exceeds a threshold concentration rate. The electronic device (100) can identify whether the viewer is concentrating on the content. The electronic device (100) can determine the degree of the viewer's concentration on the content.

[0230] For example, the electronic device (100) may determine that the concentration rate of the viewer is below the threshold concentration rate in the case corresponding to at least one of the following: when there is no viewer in front of the electronic device (100); when there is a viewer but no action by the viewer; when there is a viewer but the viewer's gaze is not detected; or when the brightness around the electronic device (100) is below the threshold brightness.

[0231] For example, if there is a viewer in front of the electronic device (100) and there is movement of the viewer, if the viewer's gaze is detected, or if the brightness around the electronic device (100) exceeds a threshold brightness, the electronic device (100) may determine that the viewer's concentration rate exceeds a threshold concentration rate.

[0232] In operation 1034, the electronic device (100) can play the content at a third speed based on the viewer's concentration rate exceeding a threshold concentration rate. Since operation 1034 is the case where the viewer's concentration rate exceeds a threshold concentration rate, if the electronic device (100) plays the content at a high speed, the viewer may perceive the speed playback and degrade the viewer's viewing experience.

[0233] In one embodiment, the electronic device (100) may select a latency recovery strategy that prioritizes playback quality to enhance the user experience. The electronic device (100) may perform a passive catch-up compared to operation 1036. For example, the electronic device (100) may play content at 1.05 times speed.

[0234] In one embodiment, the electronic device (100) can play content at a playback speed specified in the streaming data. For example, the electronic device (100) can play content at 1x speed.

[0235] In operation 1036, the electronic device (100) can play the content at a fourth speed higher than the third speed when the viewer's concentration rate is below the threshold concentration rate. Since the viewer's concentration rate is below the threshold concentration rate, even if the electronic device (100) plays the content at a high speed, the probability that the viewer will perceive the playback at a high speed is relatively low.

[0236] In one embodiment, the electronic device (100) may select a delay recovery strategy that prioritizes delay recovery. The electronic device (100) may perform an active catch-up compared to operation 1034.

[0237] In one embodiment, the electronic device (100) can play content at a faster speed than the playback speed specified in the streaming data. For example, the electronic device (100) can play content at 1.5 times the speed. For example, the electronic device (100) can play content at a faster speed than operation 1034. For example, the electronic device (100) can play content at 1.1 times the speed in operation 1034 and at 1.4 times the speed in operation 1036.

[0238] FIG. 11 is a reference diagram for explaining an example of determining the concentration rate based on the viewing environment according to one embodiment of the present disclosure.

[0239] In one embodiment, the first viewing environment (1110) is a viewing environment in which there are two viewers, there is no movement of the viewers, the gaze of the viewers toward the electronic device (100) is not detected, and the ambient brightness is below a threshold brightness.

[0240] In one embodiment, the electronic device (100) can determine that the number of viewers is two by recognizing a person in an image acquired by a camera. The electronic device (100) can determine that the viewer is in a sleeping state based on the fact that no movement of the viewer is detected by the image acquired by the camera and / or motion data from a motion sensor. The electronic device (100) can determine that the viewer's gaze is not detected by the image acquired by the camera and / or sensor data from another sensor (e.g., an eye tracker). The electronic device (100) can determine that the ambient brightness exceeds a threshold brightness by detecting the ambient brightness using the ambient illuminance value acquired by an illuminance sensor.

[0241] In one embodiment, the electronic device (100) may determine that the concentration rate of the first viewing environment (1110) is less than or equal to a critical concentration rate based on at least one of the number of acquired viewers, the movement of the viewers, the gaze of the viewers, or the ambient brightness.

[0242] In one embodiment, the second viewing environment (1120) is a viewing environment in which no viewer is present. Specifically, the second viewing environment (1120) is a viewing environment in which no viewer is present because the viewer has moved to a space other than the space where the electronic device (100) is located.

[0243] In one embodiment, the electronic device (100) can recognize a person in an image acquired by a camera and determine that the number of viewers is zero. Based on the image acquired by the camera and / or motion data from a motion sensor, the electronic device (100) can determine that the viewer is absent (or has moved) if the viewer's movement is detected in a space other than the space where the electronic device (100) is located. Based on the image acquired by the camera and / or sensor data from another sensor (e.g., an eye tracker), the electronic device (100) can determine that the viewer's gaze toward the electronic device (100) is not detected. The electronic device (100) can detect ambient brightness using an ambient illuminance value acquired by an illuminance sensor and determine that the ambient brightness exceeds a threshold brightness.

[0244] In one embodiment, the electronic device (100) may determine that the concentration rate of the second viewing environment (1120) is less than or equal to a critical concentration rate based on at least one of the number of acquired viewers, the movement of the viewers, the gaze of the viewers, or the ambient brightness.

[0245] In one embodiment, the third viewing environment (1130) is a viewing environment in which there are three viewers, there is movement of the viewers, the gaze of the viewers toward the electronic device (100) is detected, and the ambient brightness exceeds a threshold brightness.

[0246] In one embodiment, the electronic device (100) can recognize a person in an image acquired by a camera and determine that the number of viewers is three. The electronic device (100) can detect the movement of a viewer based on the image acquired by the camera and / or motion data from a motion sensor and determine that the viewer's movement is present. The electronic device (100) can detect the viewer's gaze based on the image acquired by the camera and / or sensor data from another sensor (e.g., an eye tracker) and determine that the viewer's gaze is directed toward the electronic device (100). The electronic device (100) can detect ambient brightness based on the ambient illuminance value acquired by an illuminance sensor and determine that the ambient brightness exceeds a threshold brightness.

[0247] In one embodiment, the electronic device (100) may determine that the concentration rate of the third viewing environment (1130) exceeds a critical concentration rate based on at least one of the number of acquired viewers, the movement of the viewers, the gaze of the viewers, or the ambient brightness.

[0248] FIG. 12 is a block diagram illustrating the configuration of a server according to one embodiment of the present disclosure.

[0249] In one embodiment, the server (2000) may include memory (2010), a processor (2020), and a communication interface (2030).

[0250] Memory (2010) may include various types of memory. Memory (2010) may include main memory that stores data currently being processed in the server (2000). For example, the main memory may include non-volatile memory including at least one of ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), and PROM (Programmable Read-Only Memory), and volatile memory such as RAM (Random Access Memory) or SRAM (Static Random Access Memory). Memory (2010) may include secondary memory that permanently stores large amounts of data (e.g., programs, system files, etc.). For example, the secondary memory may include a hard disk drive (HDD), a solid-state drive (SSD), an optical drive (e.g., a CD), a flash drive, etc., but is not limited thereto.

[0251] Memory (2010) may store one or more instructions and one or more programs that enable the server (2000) to operate to stream content. For example, memory (2010) may store instructions and programs for implementing the functions of a content acquisition module (2012), a content encoding module (2014), a streaming packaging module (2016), and a streaming service module (2018). Meanwhile, the modules stored in memory (2010) are for convenience of explanation and are not necessarily limited thereto. Other modules may be added to implement the aforementioned embodiments, and some modules may be omitted. Additionally, one module may be divided into multiple modules distinguished by detailed functions, and some of the aforementioned modules may be combined to be implemented as a single module.

[0252] The processor (2020) can control the overall operations of the server (2000). The processor (2020) may include a processing circuit. For example, the processor (2020) can control the overall operations for the server (2000) to acquire the original source of content and provide content including segment-specific content characteristics to an electronic device by executing one or more instructions of a program stored in memory (2010). The processor (2020) may be one or more.

[0253] The processor (2020) may be composed of at least one of, for example, a Central Processing Unit (CPU), a Microprocessor, a Graphic Processing Unit (GPU), Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), an Application Processor (AP), a Neural Processing Unit (NPU), or an AI-dedicated processor designed with a hardware structure specialized for processing AI models, but is not limited thereto.

[0254] The processor (2020) can execute a content acquisition module (2012) to acquire the original source of the content. For example, the content acquisition module (2012) can acquire the original source of the content that the server (2000) will stream to the electronic device (100). In one embodiment, the original source of the content and the content may be the same or different from each other. For convenience, in the following description, both the 'original source of the content' and the 'content' will be referred to as 'content'.

[0255] The content acquisition module (2012) may receive content captured by the camera from the camera, or may acquire pre-stored content (e.g., advertisements) from an external electronic device. For example, the content acquisition module (2012) may retrieve content pre-stored in the server (2000). The content management module (1210) may store the content.

[0256] The processor (2020) can execute a content encoding module (2014) to encode the original source of content into a form that can be transmitted to an electronic device (100). For example, the content encoding module (2014) can encode the original video source using video encoding standards such as H.264, H.265, VP9, ​​AV1. For example, the content encoding module (2014) can encode the original audio source using audio encoding standards such as AAC, MP3, Opus. The content encoding module (2014) may encode the content at a single bitrate, but may also enable adaptive streaming according to network conditions through an adaptive bitrate (ABR) encoding method.

[0257] The processor (2020) can identify the characteristics of the content by executing the content section processing module (2015). For example, the processor (2020) can identify the characteristics of the content by each playback section of the content acquired from the content acquisition module (2012) by executing the content section processing module (2015). The processor (2020) can identify the characteristics of the content by each playback section of the content by executing the content section processing module (2015) and identify sections where the characteristics of the content are different.

[0258] In one embodiment, the content section processing module (2015) may classify the content into one of a section where real-time characteristics exist or a section where real-time characteristics do not exist for each playback section. For example, if the content is a real-time sports match, the section where real-time characteristics exist is a section where the sports match is played in real-time, and the section where real-time characteristics do not exist may be a section where a scene of a player scoring a goal is replayed.

[0259] In one embodiment, the content section processing module (2015) can identify an independent section having a specified content characteristic among sections where real-time characteristics do not exist. For example, an independent section having a specified content characteristic among the content may be a section having a content characteristic different from the section excluding the independent section among sections where real-time characteristics exist and sections where real-time characteristics do not exist.

[0260] In one embodiment, the path for obtaining the content of an independent section may differ from the path for obtaining the content of another section. For example, the content of the independent section may be a section containing content that the server has obtained in advance. For example, the content of the independent section may not be content generated in real time.

[0261] For example, if the content is a live sports match, the independent segments may be advertising segments, player introduction segments, or team introduction segments. The source from which the content for the advertising segments, player introduction segments, or team introduction segments was obtained may differ from the source from which the content for the segments where the live sports match is in progress was obtained. It may be content pre-stored on a server rather than content generated in real time.

[0262] The content section processing module (2015) can analyze the characteristics of the content in advance before transmitting the content to the electronic device (100). For example, the content section processing module (2015) can classify the content into sections where real-time characteristics exist and sections where real-time characteristics do not exist. For example, the content section processing module (2015) can identify independent sections among the sections where real-time characteristics do not exist.

[0263] In one embodiment, the characteristics of the content for each playback segment obtained by the content segment processing module (2015) may be those obtained together when the content acquisition module (2012) acquires the content. For example, when the server (2000) receives content for a segment that has real-time characteristics (e.g., a real-time sports match) in real-time from a camera, and then receives content for a segment that does not have real-time characteristics (e.g., a replay of a sports match) from another electronic device, and the path of the content acquired by the server (2000) changes, the server (2000) may acquire the real-time characteristics of the content for each segment together. For example, when the scene of the content acquired by the server (2000) changes, the server (2000) may acquire the real-time characteristics of the content for each segment together.

[0264] In one embodiment, the characteristics of the content per playback section obtained by the content section processing module (2015) may be obtained after the content acquisition module (2012) has acquired the content.

[0265] The content section processing module (2015) can transmit the characteristics of the content obtained for each playback section to the streaming packaging module (2016).

[0266] The processor (2020) can execute a streaming packaging module (2016) to package content into segments suitable for a streaming protocol and create a playlist. In one embodiment, the streaming protocol may be a low-latency streaming protocol (e.g., LL-HLS (Low Latency HTTP Live Streaming), LL-DASH (Low Latency adaptive streaming over HTTP)), but the present disclosure is not limited to the examples described above.

[0267] The streaming packaging module (2016) can divide the content into segments of fixed time units (e.g., 2 seconds, 6 seconds) and store (or package) them as separate files. By dividing the content into segments of fixed time units and storing them, the streaming packaging module (2016) can transmit the content in a way that is suitable for a network environment while maintaining the continuity of the real-time content.

[0268] The streaming packaging module (2016) can store the packaged segments in a playlist file. For example, the playlist may be configured in the form of an m3u8 or MPD file, but the present disclosure is not limited to the examples described above. By storing the packaged segments in a playlist file, the streaming packaging module (2016) enables the electronic device (100) to request and play each segment of the server (2000) in the correct order.

[0269] In one embodiment, the playlist includes information such as the position, length, and bitrate of each segment, and can be updated or cached in real time.

[0270] The streaming packaging module (2016) may include the characteristics of the content for each playback segment obtained from the content segment processing module (2015) in the metadata and / or playlist generated during the streaming packaging process.

[0271] In one embodiment, the streaming packaging module (2016) may store (e.g., record) in metadata the length of each playback segment, the start time of each playback segment, the end time of each playback segment, information of each playback segment, real-time characteristics of each playback segment, or whether each playback segment includes specified characteristics. The characteristics of the content included in the metadata may be used to control the playback of the content by distinguishing each segment of the content in the electronic device (100) or to improve the user experience.

[0272] The streaming packaging module (2016) can store the characteristics of the content by playback segment obtained from the content segment processing module (2015) in a playlist of content packaged in segment units (e.g., m3u8 or MPD file). For example, the streaming packaging module (2016) may include in the playlist the version of the streaming protocol, the segment loading method of the electronic device, the buffer time, the maximum duration of the segment, the target time of the segment, the sequence number of each segment in the playlist, whether the playlist is real-time streaming, the length and URL of the part segment, the playback time of the part segment, the point at which discontinuous segments begin, or whether each segment of each segment is real-time content. In one embodiment, the characteristics of the content by playback segment included in the playlist may be used to control the playback of the content by distinguishing each segment of the content in the electronic device (100) or to improve the user experience.

[0273] The processor (2020) can execute a streaming service module (2018) to transmit packaged content to an electronic device (100) (or client device) over an Internet Protocol (IP) network. In one embodiment, the streaming service module (2018) may support transmission methods such as multicast or unicast. Multicast can be used when transmitting the same content to multiple users simultaneously. Unicast can be used when transmitting data to individual users separately.

[0274] The streaming service module (2018) can support efficient content delivery through integration with a cache server. Content can be cached at various locations on the network and can be quickly delivered from a cache server close to the user, thereby reducing delivery delay.

[0275] In one embodiment, there may be one or more processors (2020). If there is one or more processors (2020), the operations of the present disclosure may be performed by one or more processors individually or collectively by executing instructions and / or programs stored in memory (2010). If the method according to one embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one processor (2020) or by a plurality of processors (2020).

[0276] For example, when the first, second, and third operations are performed by a method according to one embodiment, the first, second, and third operations may all be performed by a first processor, or some of the first to third operations may be performed by a first processor (e.g., a general-purpose processor) and the remaining operations may be performed by a second processor (e.g., an AI-dedicated processor). Here, operations for training / inference of an AI model may be performed by an AI-dedicated processor, which is an example of a second processor. However, the embodiments of the present disclosure are not limited thereto.

[0277] One or more processors according to the present disclosure may be implemented as a single-core processor or as a multi-core processor. When a method according to one embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by a single core or by a plurality of cores included in one or more processors.

[0278] The communication interface (2030) can perform data communication with other electronic devices under the control of the processor (2020). The communication interface (2030) may include a communication circuit.

[0279] The communication interface (2030) can perform data communication between a server (2000) and another electronic device (e.g., electronic device (100), content server (3000)) by using at least one of a data communication method including, for example, a wired LAN (e.g., Ethernet), a wireless LAN (e.g., Wi-Fi), a cellular network (e.g., 4G, 5G, etc.), Bluetooth, BLE (Bluetooth Low Energy), ZigBee, infrared communication (IrDA, infrared Data Association), NFC (Near Field Communication), RF communication, and various other types of known wireless / wired communication technologies. The communication interface (2030) may include a communication circuit designed to use the aforementioned communication methods.

[0280] The server (2000) can transmit and receive data to another electronic device (e.g., electronic device (100) or another server) to control the playback of content using a communication interface (2030).

[0281] FIG. 13 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0282] An electronic device (100) according to one embodiment of the present disclosure may correspond to an electronic device (1300). In one embodiment, the electronic device (1300) may include a memory (1310), a processor (1320), a display (1330), a communication interface (1340), a sensor (900), an input / output interface (1350), an audio output interface (1360), a video processing interface (1370), an audio processing interface (1380), and a power module (1390). The electronic device (1300) may be composed of various combinations of the components shown in FIG. 13, and not all of the components shown in FIG. 13 are essential components.

[0283] The electronic device (1300) of FIG. 13 corresponds to the electronic device (100) described in FIG. 2, the memory (1310) corresponds to the memory (210) described in FIG. 2, and the processor (1320) corresponds to the processor (220) described in FIG. 2.

[0284] The memory (1310) can store a program related to the operation of the electronic device (1300) and various data generated during the operation of the electronic device (1300). The memory (1310) can store at least one instruction. Additionally, the memory (1310) may store at least one instruction executed by the processor (1320). Additionally, the memory (1310) may store at least one program executed by the processor (1320). Additionally, the memory (1310) may store an application for providing a specific service.

[0285] The memory (1310) may include various types of memory. The memory (1310) may include a main memory that stores data currently being processed in the electronic device (1300). For example, the main memory may include non-volatile memory including at least one of ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), and PROM (Programmable Read-Only Memory), and volatile memory such as RAM (Random Access Memory) or SRAM (Static Random Access Memory).

[0286] The memory (1310) may include a secondary memory that permanently stores a large amount of data (e.g., programs, system files, etc.). For example, the secondary memory may include a hard disk drive (HDD), a solid-state drive (SSD), an optical drive (e.g., a CD), a flash drive, etc., but is not limited thereto.

[0287] According to one embodiment, the memory (1310) can store various modules described with reference to FIG. 3.

[0288] The processor (1320) can control the overall operations of the electronic device (1300). For example, the processor (1320) can perform the functions of the electronic device (1300) described in this disclosure by executing one or more instructions stored in memory (1310) individually or collectively. The processor (1320) may include a processing circuit. There may be one or more processors (1320).

[0289] In an embodiment of the present disclosure, the processor (1320) may store one or more instructions in an internally provided memory and control the operation of the electronic device (1300) to be performed by executing one or more instructions stored in the internally provided memory. That is, the processor (1320) may perform a predetermined operation by executing at least one instruction or program stored in an internal memory or memory (1310) provided within the processor (1320).

[0290] According to one embodiment, the processor (1320) can perform the operation of the electronic device (1300) described in the present disclosure by executing one or more instructions stored in memory (1310).

[0291] The processor (1320) may be composed of at least one of, for example, a Central Processing Unit (CPU), a Microprocessor, a Graphic Processing Unit (GPU), ASICs (Application Specific Integrated Circuits), DSPs (Digital Signal Processors), DSPDs (Digital Signal Processing Devices), PLDs (Programmable Logic Devices), FPGAs (Field Programmable Gate Arrays), an Application Processor (AP), a Neural Processing Unit (NPU), or an AI-dedicated processor designed with a hardware structure specialized for processing AI models, but is not limited thereto.

[0292] The display (1330) can output a video signal to the screen of the electronic device (1300) under the control of the processor (1320). For example, the electronic device (1300) can output content through the display (1330). The display (1330) can generate a driving signal by converting a video signal, data signal, OSD signal, control signal, etc. processed by the processor (1320), and can display an image according to the driving signal. The display (1330) may include any one of a liquid crystal display, a plasma display, an organic light-emitting diode display, or an inorganic light-emitting diode display. However, the present disclosure is not limited thereto, and the display (1330) may include other types of displays capable of displaying content.

[0293] The communication interface (1340) can perform data communication with other electronic devices (e.g., a server (2000)) under the control of the processor (1320). Here, 'communication' may mean the operation of transmitting and / or receiving data, signals, requests, and / or commands, etc. The communication interface (1340) may include a communication circuit.

[0294] The communication interface (1340) can perform wired or wireless communication with at least one external device. The external device may be a server (2000), etc. For example, the communication interface (1340) may include at least one of a communication module, a communication circuit, a communication device, an input / output port, and an input / output plug for performing wired or wireless communication with at least one external device.

[0295] The communication interface (1340) may include one or more modules that enable wired wireless communication between the electronic device (1300) and a wireless communication system or between the electronic device (1300) and a network where another electronic device is located. For example, the communication interface (1340) may include a mobile communication module (1342), a wireless internet module (1342), a Wi-Fi communication module (1346), and a Bluetooth communication module (1348).

[0296] The mobile communication module (1342) transmits and receives wireless signals with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signals may include various forms of data such as voice call signals, video call call signals, or text / multimedia message transmission and reception.

[0297] The wireless internet module (1342) refers to a module for wireless internet access, which may be built into or externally mounted on a device. Wireless internet technologies such as WLAN (Wireless LAN) (WiFi), Wibro (Wireless broadband), WiMAX (World Interoperability for Microwave Access), and HSDPA (High Speed ​​Downlink Packet Access) may be used. Through the wireless internet module (1342), the electronic device (1300) can establish a Wi-Fi P2P (Peer to Peer) connection with another electronic device.

[0298] The communication interface (1340) may include a short-range communication module for short-range communication. Short-range communication technologies such as Bluetooth, BLE (Bluetooth Low Energy), RFID (Radio Frequency Identification), infrared communication (IrDA, infrared Data Association), UWB (Ultra-Wideband), and ZigBee may be used. The communication interface (1340) may include a Wi-Fi communication module (1346) and a Bluetooth communication module (1348) as short-range communication modules.

[0299] The sensor (900) can acquire sensor data. There may be one or more sensors (900). The sensor (900) can detect the presence or absence of a viewer, the number of viewers, the viewer's gaze, the viewer's movements, the viewer's voice, or the illuminance. The processor (1320) can acquire information by processing the sensor data. The sensor (900) may include a camera (910), a microphone (920), a motion sensor (930), and an illuminance sensor (940). Since the description of the sensor (900) has already been explained with reference to FIG. 9, redundant descriptions will be omitted here for brevity.

[0300] The input / output interface (1350) processes input / output from outside the electronic device (1300). The input / output interface (1350) receives video (e.g., video, etc.), audio (e.g., voice, music, etc.), and additional information (e.g., EPG, etc.). The input / output interface (1350) may include any one of an HDMI (High-Definition Multimedia Interface) port (1352), a component jack (1354), a PC port (1356), a USB (Universal Serial Bus) port (1358), an MHL (Mobile High-Definition Link), a DP (Display Port), a Thunderbolt, a VGA (Video Graphics Array) port, an RGB port, a D-SUB (D-subminiature), a DVI (Digital Visual Interface), and an audio jack. In one embodiment, the input / output interface (1350) may be implemented to include a plurality of modules (e.g., USB port, HDMI port, etc.) for implementing the aforementioned input / output methods. The electronic device (1300) may be connected to external devices such as a display, camera, microphone, speaker, touchpad, set-top box, etc. through the input / output interface (1350).

[0301] The audio output interface (1360) can output audio (e.g., voice, sound) input from the communication interface (1340) or the input / output interface (1350). Additionally, the audio output interface (1360) can output audio stored in memory (210) under the control of the processor (220). The audio output interface (1360) may include at least one of a speaker, a headphone output terminal, or an S / PDIF (Sony / Philips Digital Interface) output terminal, or a combination thereof.

[0302] The video processing interface (1370) performs processing on video data played by the electronic device (1300). The video processing interface (1370) can perform various image / video processing on the video data, such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, rendering, etc.

[0303] The audio processing interface (1380) performs processing on audio data played by the electronic device (1300). Various processing such as decoding, amplification, and noise filtering can be performed on the audio data at the audio processing interface (1380).

[0304] The power module (1390) supplies power input from an external power source to the components inside the electronic device (1300) that operate under the control of the processor (1320). Additionally, the power module (1390) can supply power output from one or more batteries located inside the electronic device (1300) to the internal components under the control of the processor (1320).

[0305] In one embodiment, the operations of the aforementioned server (2000) may be replaced by operations executed in the electronic device (1300). For example, the electronic device (1300) may store programs and instructions corresponding to a content acquisition module, a content encoding module, a streaming packaging module, and a streaming service module to perform functions identical or similar to those of the server (2000).

[0306] An electronic device according to one embodiment of the present disclosure may include at least one processor comprising a memory for storing at least one instruction and a circuit device. By executing the at least one instruction individually or collectively by the at least one processor, the electronic device may obtain real-time characteristics of the content being played. By executing the at least one instruction individually or collectively by the at least one processor, the electronic device may obtain a viewing environment of the electronic device playing the content. By executing the at least one instruction individually or collectively by the at least one processor, the electronic device may control the playback of the content based on at least one of the real-time characteristics or the viewing environment, based on whether the delay time of the content being played on the electronic device exceeds a threshold delay time.

[0307] In one embodiment, the real-time characteristic may be acquired for each playback section of the content. By executing the at least one instruction individually or collectively by the at least one processor, the electronic device may play the content of the playback section where the real-time characteristic exists at a first speed. By executing the at least one instruction individually or collectively by the at least one processor, the electronic device may play the content of the playback section where the real-time characteristic does not exist at a second speed higher than the first speed.

[0308] In one embodiment, the real-time characteristic may be included in at least one of the metadata of the content or the playlist of the content.

[0309] In one embodiment, the electronic device can acquire the real-time characteristics by recognizing the scene of the content as the at least one instruction is executed individually or collectively by the at least one processor.

[0310] In one embodiment, by executing the at least one instruction individually or collectively by the at least one processor, the electronic device can identify an independent section having a specified content characteristic among the sections where the real-time characteristic is absent. By executing the at least one instruction individually or collectively by the at least one processor, the electronic device can skip the independent section and play the content being played on the electronic device based on the delay time of the content being played on the electronic device exceeding a threshold delay time.

[0311] In one embodiment, by executing the at least one instruction individually or collectively by the at least one processor, the electronic device can play the content of the section having the real-time characteristic at a specified playback speed based on the identification of the independent section. By executing the at least one instruction individually or collectively by the at least one processor, the electronic device can play the content by jumping to the end point of the independent section, based on the fact that the delay time of the content being played on the electronic device exceeds a threshold delay time, as the start point of the independent section is identified during the playback of the content.

[0312] In one embodiment, by executing the at least one instruction individually or collectively by the at least one processor, the electronic device can identify silent intervals of the content and determine the independent intervals.

[0313] In one embodiment, the viewing environment may include at least one of the number of viewers, the movements of the viewers, the gaze of the viewers, or the ambient brightness.

[0314] In one embodiment, the electronic device may further include a sensor. In one embodiment, by executing the at least one instruction individually or collectively by the at least one processor, the electronic device may acquire the viewing environment based on sensor data acquired by the sensor. In one embodiment, by executing the at least one instruction individually or collectively by the at least one processor, the electronic device may determine the concentration rate of a viewer watching the content based on the viewing environment.

[0315] By executing the above at least one instruction individually or collectively by the above at least one processor, the electronic device can control the playback of the content based on the viewer's concentration rate based on the delay time of the content being played on the electronic device exceeding a threshold delay time.

[0316] By executing the above at least one instruction individually or collectively by the above at least one processor, the electronic device can play the content at a third speed based on the viewer's concentration rate exceeding a threshold concentration rate. By executing the above at least one instruction individually or collectively by the above at least one processor, the electronic device can play the content at a fourth speed higher than the third speed based on the viewer's concentration rate being below a threshold concentration rate.

[0317] In one embodiment, by executing the at least one instruction individually or collectively by the at least one processor, the electronic device can play the content at the specified playback speed based on the delay time of the content being less than or equal to the threshold time.

[0318] A method of operation of an electronic device according to one embodiment of the present disclosure may include an operation of obtaining a viewing environment of the electronic device that plays content. A method of operation of an electronic device according to one embodiment of the present disclosure may include an operation of controlling the playback of the content based on at least one of the real-time characteristic or the viewing environment, based on the delay time of the content being played on the electronic device exceeding a threshold delay time.

[0319] In one embodiment, the real-time characteristic may be obtained for each playback section of the content. This method may include an operation of playing the content in the section where the real-time characteristic exists at a first speed. This method may include an operation of playing the content in the section where the real-time characteristic does not exist at a second speed higher than the first speed.

[0320] In one embodiment, this method may include an operation of obtaining the real-time characteristic from the metadata of the content.

[0321] In one embodiment, this method may include an operation of recognizing a scene of the content and acquiring the real-time characteristics.

[0322] In one embodiment, the method may include an operation of identifying an independent section having a specified content characteristic among sections where the real-time characteristic is absent. The method may include an operation of skipping the independent section and playing the content based on the delay time of the content being played on the electronic device exceeding a threshold delay time.

[0323] In one embodiment, the method may include an operation of playing the content of the section where the real-time characteristics of the content exist at a specified playback speed, based on the identification of the independent section. In one embodiment, the method may include an operation of playing the content by jumping to the end point of the independent section, based on the identification of the start point of the independent section during the playback of the content, when the delay time of the content being played on the electronic device exceeds a threshold delay time.

[0324] In one embodiment, the method may include the operation of identifying silent intervals of the content to determine the independent intervals.

[0325] In one embodiment, the viewing environment may include at least one of the number of viewers, the movements of the viewers, the gaze of the viewers, or the ambient brightness.

[0326] In one embodiment, the method may include an operation of acquiring the viewing environment based on sensor data acquired by a sensor. The method may include an operation of determining the concentration rate of a viewer watching the content based on the viewing environment. The method may include an operation of controlling the playback of the content based on the viewer's concentration rate based on the delay time of the content being played on the electronic device exceeding a threshold delay time. The method may include an operation of playing the content at a third speed based on the viewer's concentration rate exceeding a threshold concentration rate. The method may include an operation of playing the content at a fourth speed higher than the third speed based on the viewer's concentration rate being below the threshold concentration rate.

[0327] In one embodiment, the method may include an operation of playing the content at the normal speed based on the delay time of the content being less than or equal to the threshold time.

[0328] In a computer-readable recording medium having at least one instruction recorded thereon according to one embodiment of the present disclosure, the at least one instruction is executed individually or collectively by the at least one processor to obtain real-time characteristics of the content being played and to obtain a viewing environment of the electronic device playing the content, and based on the delay time of the content being played on the electronic device exceeding a threshold delay time, the playback of the content can be controlled based on at least one of the real-time characteristics or the viewing environment.

[0329] Some embodiments may also be implemented in the form of a recording medium containing computer-executable instructions, such as program modules executed by a computer. A computer-readable medium may be any available medium accessible by a computer and includes both volatile and non-volatile media, and both removable and non-removable media. Additionally, a computer-readable medium may include a computer storage medium. A computer storage medium includes both volatile and non-volatile, removable and non-removable media implemented by any method or technique for storing information, such as computer-readable instructions, data structures, program modules, or other data.

[0330] The disclosed embodiments may be implemented as a software program comprising instructions stored on a computer-readable storage media.

[0331] A computer is a device capable of calling instructions stored from a storage medium and performing operations according to the disclosed embodiments according to the called instructions, and may include an electronic device according to the disclosed embodiments.

[0332] Computer-readable storage media may be provided in the form of non-transitory storage media. Here, 'non-transitory' means merely that the storage medium does not contain a signal and is tangible, without distinguishing whether data is stored semi-permanently or temporarily on the storage medium.

[0333] In addition, the control method according to the disclosed embodiments may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product.

[0334] A computer program product may include a software program and a computer-readable storage medium on which the software program is stored. For example, a computer program product may include a product in the form of a software program (e.g., a downloadable app) that is electronically distributed through a device manufacturer or an electronic market (e.g., Google Play Store, App Store). For electronic distribution, at least a portion of the software program may be stored on a storage medium or temporarily created. In this case, the storage medium may be a server of the manufacturer, a server of the electronic market, or a storage medium of a relay server that temporarily stores the software program.

[0335] A computer program product may include a storage medium of a server or a storage medium of a device in a system composed of a server and a device. Alternatively, if a third device (e.g., a smartphone) is communicationally connected to the server or device, the computer program product may include a storage medium of the third device. Alternatively, the computer program product may include the S / W program itself that is transmitted from the server to the device or the third device, or transmitted from the third device to the device.

[0336] In this case, one of the server, the device, and the third device may execute the computer program product to perform the method according to the disclosed embodiments. Alternatively, two or more of the server, the device, and the third device may execute the computer program product to perform the method according to the disclosed embodiments in a distributed manner.

[0337] For example, a server (e.g., a cloud server or an artificial intelligence server, etc.) can execute a computer program product stored on the server to control a device connected to the server in communication to perform a method according to the disclosed embodiments.

[0338] As another example, the third device may execute a computer program product to control a device connected to the third device in communication to perform a method according to the disclosed embodiment. When the third device executes the computer program product, the third device may download the computer program product from a server and execute the downloaded computer program product. Alternatively, the third device may execute a computer program product provided in a preloaded state to perform a method according to the disclosed embodiments.

[0339] Additionally, in this specification, "interface" may be a hardware component, such as a processor or circuit, and / or a software component executed by a hardware component, such as a processor.

[0340] The foregoing description of the present disclosure is for illustrative purposes only, and those skilled in the art will understand that other specific forms can be easily modified without altering the technical spirit or essential features of the present disclosure. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, each component described as a single unit may be implemented in a distributed manner, and components described as distributed may likewise be implemented in a combined form.

[0341] The scope of the present disclosure is defined by the claims set forth below rather than by the detailed description above, and all modifications or variations derived from the meaning and scope of the claims and equivalent concepts thereof should be interpreted as being included within the scope of the present disclosure.

Claims

In an electronic device (100), A memory (210) that stores at least one instruction and It includes at least one processor (220) including a circuit device, and By executing the above at least one instruction individually or collectively by the above at least one processor (220), the electronic device, Acquire real-time characteristics of the content currently being played, and Obtaining a viewing environment of the electronic device that plays the above content, and An electronic device (100) that controls the playback of the content based on at least one of the real-time characteristics or the viewing environment, based on the delay time of the content being played on the electronic device exceeding a threshold delay time. In paragraph 1, The above real-time characteristics are obtained for each playback section of the above content, and By executing the above at least one instruction individually or collectively by the above at least one processor (220), the electronic device, Play the content of the playback section having the above real-time characteristics at the first speed, and An electronic device (100) that plays content of a playback section in which the above real-time characteristics are absent at a second speed higher than the first speed. In paragraph 1 or 2, The above real-time characteristics are included in at least one of the metadata of the content or the playlist of the content, an electronic device (100). In any one of paragraphs 1 through 3, By executing the above at least one instruction individually or collectively by the above at least one processor (220), the electronic device, An electronic device (100) that recognizes a scene of the above content and obtains the above real-time characteristics. In any one of paragraphs 1 through 4, By executing the above at least one instruction individually or collectively by the above at least one processor (220), the electronic device, Identify independent sections with designated content characteristics among sections where the above real-time characteristics are absent, and An electronic device (100) that skips and plays the independent section based on the delay time of the content being played on the electronic device exceeding a threshold delay time. In paragraph 5, By executing the above at least one instruction individually or collectively by the above at least one processor (220), the electronic device, Based on the identification of the above independent segment, the content of the segment where the real-time characteristic exists is played at a normal speed or a designated playback speed, and An electronic device (100) that plays the content by jumping to the end point of the independent section based on the delay time of the content being played on the electronic device exceeding a threshold delay time, and based on the start point of the independent section being identified during the playback of the content. In paragraph 5 or 6, By executing the above at least one instruction individually or collectively by the above at least one processor (220), the electronic device, An electronic device (100) that identifies silent sections of the above content and determines the above independent sections. In any one of paragraphs 1 through 7, The above viewing environment is, An electronic device (100) comprising at least one of the number of viewers, the movement of viewers, the gaze of viewers, or ambient brightness. In any one of paragraphs 1 through 8, It further includes a sensor (910), By executing the above at least one instruction individually or collectively by the above at least one processor (220), the electronic device, Based on sensor data acquired by the above sensor, the above viewing environment is acquired, and Based on the above viewing environment, the concentration rate of the viewer watching the above content is determined, and An electronic device (100) that controls the playback of the content based on the concentration rate of the viewer when the delay time of the content being played on the electronic device exceeds a threshold delay time. In any one of paragraphs 1 through 9, By executing the above at least one instruction individually or collectively by the above at least one processor (220), the electronic device, Based on the concentration rate of the aforementioned viewers exceeding the critical concentration rate, the content is played at a third speed, and An electronic device (100) that plays content at a fourth speed higher than a third speed, based on the concentration rate of the above-mentioned viewers being below a critical concentration rate. In any one of paragraphs 1 through 10, By executing the above at least one instruction individually or collectively by the above at least one processor (220), the electronic device, An electronic device (100) that plays the content at the normal speed based on the delay time of the content being less than or equal to the threshold time. In the method of operating an electronic device, An operation to acquire real-time characteristics of content currently being played; The operation of obtaining a viewing environment of the electronic device that plays the above content; and A method comprising controlling the playback of the content based on at least one of the real-time characteristics or the viewing environment when the delay time of the content being played on the electronic device exceeds a threshold delay time. In Paragraph 12, The above real-time characteristics are obtained for each playback section of the above content, and The operation of controlling the playback of the above content is, The operation of playing content of a section having the above real-time characteristics at a first speed; and A method comprising the operation of playing content in a section where the above real-time characteristics are absent at a second speed higher than the first speed. In Article 12 or Article 13, The operation of acquiring real-time characteristics of the content currently being played is, A method comprising the operation of obtaining the real-time characteristic from the metadata of the above content. A computer-readable recording medium having at least one instruction recorded thereon, wherein the at least one instruction is executed by a processor of an electronic device so that the electronic device is configured to perform the method of any one of claims 12 to 14 on a computer.

Images