Electronic device and operation method thereof

Abstract

Provided are an electronic device for appropriately controlling audio in response to a user input and an operation method thereof. The electronic device comprises: a memory storing one or more instructions; and at least one processor for executing the one or more instructions stored in the memory. When a first input corresponding to audio control of a first scene among one or more scenes included in an input image is received, the processor controls the audio of the first scene in response to the first input. The processor controls to maintain the audio of a second scene distinguishable from the first scene among the one or more scenes. The audio control of the first scene is characterized in that audio components included in the audio of the first scene are controlled independently of each other.

Description

Electronic device and method of operation thereof

[0001] The present disclosure relates to an electronic device and a method of operating the same, and more particularly, to an electronic device and a method of operating the same for appropriately controlling scene-based audio in response to user input.

[0002] Recent technological advancements are significantly impacting users' consumption of video content, and users are increasingly viewing video content like movies and dramas using a variety of devices. Consequently, viewers are increasingly prioritizing immersion and vividness when watching video content.

[0003] Meanwhile, active research is underway to control the scene-based audio contained in video content to provide users with a more immersive and vibrant listening experience. Scene-based audio control technology designs and applies audio tailored to specific scenes within a video.

[0004] Scene-based audio control technology analyzes scenes within a video in real time and controls audio at each point during playback. However, to further enhance user satisfaction, scene-based audio control requires interaction with the user to appropriately reflect their responses.

[0005] In view of the above, the present disclosure discloses a novel technique for appropriately controlling scene-based sound in response to user input.

[0006] An electronic device according to one embodiment of the present disclosure includes a memory storing one or more instructions and at least one processor executing one or more instructions stored in the memory. When a first input corresponding to sound control of a first scene among one or more scenes included in an input image is received, the processor controls the sound of the first scene in response to the first input. The processor controls the sound of a second scene, which is distinct from the first scene among the one or more scenes, to be maintained. The sound control of the first scene is characterized in that sound components included in the sound of the first scene are controlled independently of each other.

[0007] An operating method of an electronic device according to one embodiment of the present disclosure includes a step of controlling sound of a first scene in response to a first input received from one or more scenes included in an input image. The operating method includes a step of maintaining sound of a second scene, which is distinct from the first scene, from among the one or more scenes. The sound control of the first scene is characterized in that sound components included in the sound of the first scene are controlled independently of each other.

[0008] One embodiment of the present disclosure provides a computer-readable recording medium having recorded thereon a program for executing at least one of the embodiments of the disclosed method on a computer as a technical means for achieving the above-described technical task.

[0009] Other technical features will be readily apparent to those skilled in the art from the following drawings, descriptions and claims.

[0010] Figure 1 is a reference diagram for explaining the concept of an electronic device according to one embodiment.

[0011] FIG. 2 is a diagram illustrating a method for an electronic device to appropriately control sound in response to user input according to one embodiment.

[0012] FIG. 3A is a drawing for explaining an operation of an electronic device according to one embodiment of the present invention to output a UI for independently controlling sound components.

[0013] FIGS. 3b to 3h are drawings for explaining examples of UIs for independently controlling sound components according to one embodiment.

[0014] FIG. 4 is a diagram illustrating an operation of an electronic device according to one embodiment of the present invention to output a UI for selecting either sound control of each scene or overall sound control associated with the electronic device.

[0015] FIG. 5 is a drawing for explaining an operation of an electronic device according to one embodiment of the present invention to output a UI for simultaneously controlling the sound of each scene and the overall sound associated with the electronic device.

[0016] FIG. 6 is a diagram for explaining an operation of an electronic device according to one embodiment of the present invention to manage sound control setting history in response to content.

[0017] FIG. 7 is a diagram for explaining an operation of an electronic device according to one embodiment of the present invention to manage sound control setting history in response to a genre of content.

[0018] FIG. 8 is a diagram for explaining an operation of an electronic device according to one embodiment of the present invention to manage sound control setting history in correspondence with a user account.

[0019] Figure 9 is a block diagram of an electronic device according to one embodiment.

[0020] FIG. 10 is a block diagram of an electronic device according to one embodiment.

[0021] The terms used in this disclosure are described as currently used general terms in consideration of the functions mentioned in this disclosure; however, these may mean various other terms depending on the intentions of engineers working in the field, precedents, the emergence of new technologies, etc. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in such cases, the meanings thereof will be described in detail in the description of the relevant embodiments. Therefore, the terms used in this disclosure should not be interpreted solely on the basis of the names of the terms, but should be interpreted based on the meanings of the terms and the overall contents of this disclosure.

[0022] Additionally, the terminology used in this disclosure is for the purpose of describing specific embodiments only and is not intended to limit the present disclosure.

[0023] Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art described herein.

[0024] When a part of this specification is said to "include" a component, unless otherwise specifically stated, this does not exclude other components but rather implies the inclusion of other components. Furthermore, terms such as "part," "module," etc., used herein refer to a unit that processes at least one function or operation, which may be implemented in hardware, software, or a combination of hardware and software.

[0025] In addition, each component described below may additionally perform some or all of the functions performed by other components in addition to its own main function, and some of the main functions performed by each component may be performed exclusively by other components.

[0026] The expression “configured to” as used herein can be used interchangeably with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of.”

[0027] The term "configured (or set up) to" may not necessarily mean "specifically designed to" hardware. Instead, in some contexts, the phrase "a system configured to" may mean that the system, in conjunction with other devices or components, is "capable of" doing something.

[0028] When a component is referred to herein as being “connected” or “connected” to another component, it should be understood that the component may be directly connected or directly connected to the other component, but may also be connected or connected via another component in between, unless otherwise specifically stated. When a part is referred to herein as being “connected” to another part, this includes not only cases where the parts are “directly connected,” but also cases where the parts are “electrically connected” with another element in between.

[0029] As used herein, and particularly in the claims, the terms "above" and "above" and similar referents may refer to both the singular and the plural. Furthermore, unless the order of steps in a method according to the present disclosure is explicitly specified, the steps described may be performed in any appropriate order. The present disclosure is not limited by the order in which the steps are described.

[0030] The appearances of phrases such as “in some embodiments” or “in an embodiment” in various places throughout this specification are not necessarily all referring to the same embodiment.

[0031] Some embodiments of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented by various hardware and / or software configurations that perform specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more microprocessors or by circuit configurations for a given function. Furthermore, for example, the functional blocks of the present disclosure may be implemented using various programming or scripting languages. The functional blocks may be implemented as algorithms that execute on one or more processors. Furthermore, the present disclosure may employ conventional techniques for electronic configuration, signal processing, and / or data processing.

[0032] In order to clearly explain the present disclosure in the drawings, parts that are not related to the description have been omitted, and similar parts have been designated with similar drawing reference numerals throughout the specification. In addition, the drawing reference numerals used in each drawing are only for the purpose of explaining each drawing, and different drawing reference numerals used in different drawings do not indicate different elements. In addition, the connecting lines or connecting members between components illustrated in the drawings are only examples of functional connections and / or physical or circuit connections. In an actual device, connections between components may be indicated by various functional connections, physical connections, or circuit connections that may be replaced or added.

[0033] In describing embodiments, if it is determined that a specific description of a related known technology may unnecessarily obscure the gist of the present disclosure, the detailed description thereof will be omitted. In addition, in the specification, the expression “at least one of a, b, or c” may refer to “a,” “b,” “c,” “a and b,” “a and c,” “b and c,” “all of a, b, and c,” or variations thereof. The numbers (e.g., first, second, third, etc.) used in the description of the specification are merely identifiers to distinguish one component from another.

[0034] Below, embodiments of the present disclosure are described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein.

[0035] In this disclosure, a 'user' means a person who uses an electronic device, and may include a consumer, an evaluator, a viewer, an administrator, or an installer.

[0036] In the present disclosure, 'image' may mean a still image, a picture, a frame, a moving image composed of a plurality of consecutive still images, or a video.

[0037] In this disclosure, a "scene" may refer to a series of consecutive image frames that constitute a video. A video may be composed of various scenes, and each scene may be connected to the next to form the overall flow of the video. Each scene comprising the video may be divided into an event occurring at a specific location and time, a specific theme, or a specific narrative unit.

[0038] In this disclosure, "audio" may refer to a sound wave phenomenon that propagates through the air or other medium and is perceived by the human ear. "Acoustic" may be referred to as "sound."

[0039] In this disclosure, "scene-based audio" may refer to sound output together with the scenes that compose a video when playing a video. In this disclosure, sound output together with a specific scene when playing that scene may be expressed as "sound of that scene."

[0040] In this disclosure, the term "audio element" may refer to each distinguishable sound contained in the overall sound. For example, the distinguishable sounds contained in the overall sound of a sports game scene, i.e., the sound elements, may include the commentary sound of a broadcaster, the cheers of the audience, the sounds of specific characters, game sound effects, background music, etc.

[0041] In this disclosure, "audio properties" may refer to unique characteristics of acoustic components. Depending on the acoustic properties, acoustic components included in the overall sound can be distinguished. For example, acoustic properties may include frequency, amplitude, time, timbre, etc.

[0042] FIG. 1 is a reference diagram for explaining the concept of an electronic device (100) according to one embodiment.

[0043] Referring to FIG. 1, in one embodiment, the electronic device (100) may include a device having a display. For example, the electronic device (100) may include, but is not limited to, a TV, a smart monitor, a tablet PC, a laptop, a digital signage, a large display, a 360-degree projector, a smartphone, etc., which include a display.

[0044] In one embodiment, the electronic device (100) may not have a display, but may include various types of devices that can be connected to a display. For example, the electronic device (100) may include, but is not limited to, a set-top box (STB), a desktop PC, etc. that can be connected to a display.

[0045] In one embodiment, the electronic device (100) does not have a built-in display for displaying content, but may include a small display for OSD output for notifications.

[0046] In one embodiment, the electronic device (100) may include an output port for outputting a video signal, an output port for outputting an audio signal, or an output port for simultaneously outputting video / audio signals (e.g., HDMI, DP, Thunderbolt, etc.), and a communication interface for transmitting video and audio signals to a device including a display (e.g., TV, monitor, etc.) using wireless communication.

[0047] An electronic device (100) according to one embodiment can provide a user-friendly scene-based sound control function that independently controls each sound component included in the sound of each scene constituting an input image according to a user input in a scene-based sound control mode.

[0048] An electronic device (100) according to one embodiment can provide a user-friendly scene-based sound control function that controls, in a scene-based sound control mode, a sound control effect according to a user input corresponding to a specific scene so as not to affect other scenes that are distinct from the specific scene.

[0049] In one embodiment, the "scene-based audio mode" may refer to a mode configured to analyze scenes constituting an input video in real time and automatically emphasize important audio components in each scene. An electronic device (100) according to one embodiment may operate in the scene-based audio control mode using an artificial intelligence (AI) model based on deep learning.

[0050] In one embodiment, the electronic device (100) may receive user input indicating that the scene-based audio control mode is to be used. The electronic device (100) may output a user interface (UI) indicating that the scene-based audio control mode is activated.

[0051] In one embodiment, a user may transmit a first input to the electronic device (100) using various input devices (e.g., remote control, microphone, touch screen, etc.) through a remote control function, voice recognition function, touch interaction function, etc. The first input may be for independently controlling sound components included in the sound of the first scene.

[0052] In one embodiment, the electronic device (100) can identify one or more scenes included in an input image. In one embodiment, the electronic device (100) can receive a first input corresponding to sound control of a first scene. In one embodiment, the electronic device (100) can control the sound of the first scene based on the first input, and control the sound of other scenes among one or more scenes that are distinct from the first scene to be maintained.

[0053] In one embodiment, if the first input is for independently controlling sound components included in the sound of the first scene, the electronic device (100) can control only specific sound components included in the sound of the first scene based on the first input, and control the remaining sound components included in the sound of the first scene and the sounds of other scenes among one or more scenes that are distinct from the first scene to maintain their existing states.

[0054] To this end, in one embodiment, the electronic device (100) can identify each of the sound components included in the sound of the first scene based on the sound characteristics of each of the sound components, for example, changes in frequency distribution and amplitude. Each of the sound components included in the sound of the first scene can have a unique pattern of frequency distribution and changes in amplitude. The electronic device (100) can analyze such frequency and amplitude patterns to identify each of the sound components included in the sound of the first scene. Based on the identification result, the electronic device (100) can control only a specific sound component included in the sound of the first scene corresponding to the first input, and control the remaining sound components included in the sound of the first scene to maintain their existing states.

[0055] In addition, in one embodiment, the electronic device (100) can identify one or more scenes included in an input image using frame-to-frame motion and object recognition technology based on deep learning. The electronic device (100) can recognize that there is a scene transition based on the scene identification result. When the electronic device (100) recognizes that there is a scene transition from a first scene to a second scene, the electronic device (100) can remove the sound control effect corresponding to the first input and control the sound of the second scene to maintain the setting state of the initial scene-based sound control mode.

[0056] For example, in the example of FIG. 1, the input video (40) may start playing at the beginning of the T1 section. The input video (40) is a movie including an intro scene (corresponding to the T1 section of FIG. 1), a first scene (corresponding to the T2 section of FIG. 1), a second scene (corresponding to the T3 section), a third scene, and an n-th scene, and it may be assumed that the electronic device (100) is operating according to a scene-based audio control mode activated by the user (10).

[0057] For example, the electronic device (100) may output a user interface (UI) (30) indicating that the scene-based audio control mode is activated.

[0058] For example, while the electronic device (100) operates in a scene-based audio control mode, it may be assumed that the user (10) wants to emphasize the caster relay sound among the sound components included in the sound of the first scene at some point in the T2 section while the first scene is being played. In this case, the user (10) may press the volume increase (+) button of the remote control (20) to increase the volume of the caster relay sound, which may be referred to as the first input.

[0059] Previously, when a user used a scene-based audio control mode, if the volume of an automatically emphasized audio component in a specific scene was too loud and was reduced, the reduced volume was also applied when watching the remaining scenes, and the user had to increase the volume again in the remaining scenes, which was inconvenient. For example, in the example of FIG. 1, if an input was made to increase the volume of the caster's commentary sound in the first scene, this volume-up input would also be applied to other audio components in the first scene, such as the crowd's cheers, specific character's voice, game sound effects, and background music, and the volume of all of them would increase. In addition, according to the input to increase the volume of the caster's commentary sound in the first scene, the corresponding input may be maintained in the second scene, and the volume of the audio components in the second scene may also be increased. However, the user may not want the volume of other audio components in the first scene to increase, or the volume of the audio components in the second scene to increase. Therefore, the user may experience the inconvenience of having to input a volume-down input again when the second scene is played.

[0060] Accordingly, in the embodiments disclosed in the present disclosure, in order to improve such user inconvenience, an electronic device (100) according to an embodiment of the present disclosure can control, based on a first input corresponding to the first scene, to increase only the size of the caster relay sound among the sound components included in the sound of the first scene. The electronic device (100) can control so that the remaining sound components of the first scene that are distinguished from the caster relay sound and the sounds of the second scene, the third scene, and the n-th scene that are distinguished from the first scene are not affected, that is, the setting state of the initial scene-based sound control mode is maintained as is.

[0061] According to one embodiment of the present disclosure, an electronic device (100) can improve the listening experience of users watching a video by providing a function for appropriately controlling scene-based sound according to a user's input.

[0062] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0063] Specific operations of the electronic device (100) to provide user-friendly scene-based sound control functions will be described in more detail through the drawings and descriptions thereof described below.

[0064] FIG. 2 is a drawing for explaining a method (200) for an electronic device (100) to appropriately control sound in response to user input according to one embodiment.

[0065] Referring to FIG. 2, in step 210, an electronic device (100) according to one embodiment may, when receiving a first input corresponding to sound control of a first scene among one or more scenes included in an input image, control the sound of the first scene in response to the first input.

[0066] An electronic device (100) according to one embodiment can identify one or more scenes included in an input image.

[0067] An electronic device (100) according to one embodiment may receive a first input corresponding to sound control of a first scene among one or more scenes.

[0068] In one embodiment, the first input may include a user input indicating to increase or decrease the volume of a specific sound component among the sound components included in the sound of the first scene. Volume refers to the loudness or intensity of a sound. For example, the user may use various input devices (e.g., a remote control, a microphone, a touch screen, a camera, etc.) to indicate to increase or decrease the volume or intensity of a specific sound component.

[0069] In one embodiment, the first input may include a user input that instructs to emphasize or soften a specific sound effect for a specific sound component among the sound components included in the sound of the first scene. For example, the sound effect may include, but is not limited to, echo, reverb, chorus, flanging, 3D audio, etc. For example, the user may use various input devices (e.g., remote control, microphone, touch screen, camera, etc.) to instruct to apply a specific sound effect more strongly or more weakly to a specific sound component.

[0070] An electronic device (100) according to one embodiment can control sound of a first scene based on a first input.

[0071] In step S220, the electronic device (100) according to one embodiment may maintain the sound of a second scene that is distinct from the first scene among one or more scenes. For example, the electronic device (100) may maintain existing settings for the sound of other scenes that are distinct from the first scene.

[0072] In step S230, the sound control of the first scene may be characterized in that sound components included in the sound of the first scene are controlled independently of each other.

[0073] In one embodiment, the electronic device (100) can identify each sound component included in the sound of the first scene based on the sound characteristics of each sound component, such as changes in frequency distribution and amplitude. Each sound component included in the sound of the first scene can have a unique pattern of frequency distribution and changes in amplitude. The electronic device (100) can identify each sound component included in the sound of the first scene by analyzing such frequency and amplitude patterns.

[0074] In one embodiment, the electronic device (100) may control a specific sound component among the sound components included in the sound of the identified first scene based on a first input. The electronic device (100) may maintain existing settings for other sound components distinct from the specific sound component, and may also maintain existing settings for sounds of other scenes distinct from the first scene.

[0075] In one embodiment, the electronic device (100) may process the first input as an input for overall sound control associated with the electronic device (100) when the sound value for the sound of the first scene exceeds a preset first threshold value or becomes less than a preset second threshold value.

[0076] For example, when the sound value for the sound of the first scene becomes 0, the electronic device (100) can then process the first input as an input for overall sound control associated with the electronic device (100).

[0077] In one embodiment, an acoustic value may refer to a value representing a volume or a value representing the intensity of a sound effect. The acoustic value for the sound of the first scene may refer to an acoustic value corresponding to the first scene that takes into account the acoustic values ​​of the acoustic components included in the sound of the first scene. For example, the acoustic value for the sound of the first scene may refer to an arithmetic mean value or a weighted mean value of the acoustic values ​​of the acoustic components included in the sound of the first scene.

[0078] In one embodiment, the overall sound control associated with the electronic device (100) may mean sound control associated with the electronic device (100) itself, regardless of the input image and scene, as sound control applied when the scene-based sound control mode is inactive.

[0079] In one embodiment, the first threshold value or the second threshold value may be set by the user, or may be preset by the manufacturer of the electronic device (100). In one embodiment, the first threshold value or the second threshold value may be set differently in real time depending on the scene, or may be set differently in real time depending on the acoustic characteristics of the acoustic component.

[0080] In one embodiment, steps 210 to 230 may be performed on a device-based basis in the electronic device (100). Alternatively, steps 210 to 230 may be specifically performed in a cloud-based server, and the electronic device (100) may perform a scene-based sound control function simply by transmitting / receiving data with the cloud server.

[0081] In addition, steps 210 to 230 may be performed in a system including both the electronic device (100) and the cloud server. For example, operations requiring high computational performance, such as large-scale data processing, complex calculations, and advanced graphic processing, may be performed in the cloud server, and operations requiring low associative performance may be performed in the electronic device (100). For example, the cloud server may identify one or more scenes included in an input image and transmit the identification result to the electronic device (100), the electronic device (100) may receive a first input corresponding to a first scene and transmit related data to the cloud server, and the cloud server may perform the scene-based sound control described in step 230 based on the data received from the electronic device (100).

[0082] According to one embodiment of the present disclosure, an electronic device (100) can improve the listening experience of users watching a video by independently controlling sound components for each scene of the video according to a user's input.

[0083] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0084] FIG. 3A is a drawing for explaining an operation of an electronic device (100) according to one embodiment of the present invention to output a UI for independently controlling sound components.

[0085] Referring to FIG. 3A, an electronic device (100) according to one embodiment may output a user interface (UI) (301) for independently controlling sound components included in the sound of a first scene upon receiving a first input. The electronic device (100) according to one embodiment may receive a second input based on the UI (301). The electronic device (100) may control one or more selected sound components based on the second input.

[0086] In one embodiment, the electronic device (100) can control a display to display a user interface (UI) (301) for independently controlling sound components included in the sound of the first scene. In one embodiment, the electronic device (100) can generate / control / configure a video signal to output a user interface (UI) (301) for independently controlling sound components included in the sound of the first scene, and can transmit the generated / controlled / configured video signal to a device including a display (e.g., TV, monitor, etc.).

[0087] In one embodiment, the second input may include a user input that selects one or more sound components and instructs to increase or decrease the volume of the selected one or more sound components. In one embodiment, the second input may include a user input that selects one or more sound components and instructs to emphasize or soften a particular sound effect for the selected one or more sound components. For example, the second input may include user input received based on UI 301 and UI 302 of FIG. 3, UI 401 of FIG. 4, and UI 500 of FIG. 5.

[0088] For example, a user may use various input devices (e.g., a remote control, a microphone, a touch screen, a camera, etc.) to select one or more sound components and instruct the user to increase or decrease the volume or intensity of the selected one or more sound components. For example, a user may use various input devices (e.g., a remote control, a microphone, a touch screen, a camera, etc.) to select one or more sound components and instruct the user to apply a specific sound effect more strongly or more weakly to the selected one or more sound components.

[0089] In one embodiment, when there is a scene transition from a first scene to a second scene, the electronic device (100) may remove a user interface (UI) (301) for independently controlling sound components included in the sound of the first scene and output a user interface (UI) (302) for independently controlling sound components included in the sound of the second scene.

[0090] In this case, since the sound control of the first scene does not affect the sound of the second scene, the UI 302 displayed immediately after the scene change can indicate the initial sound setting status of the second scene, regardless of the UI 301 displayed immediately before the scene change. The electronic device (100) can repeat the above operation whenever the scene changes thereafter.

[0091] FIGS. 3b to 3h are drawings for explaining examples of UIs for independently controlling sound components according to one embodiment.

[0092] Referring to FIGS. 3b to 3h, in one embodiment, a user interface (UI) for independently controlling sound components included in the sound of each scene can be implemented in various forms, for example, a user interface (UI) for independently controlling sound components included in the sound of each scene can be implemented in a circular shape (311 to 313 of FIG. 3b), a donut shape (321 to 323 of FIG. 3c), a polygonal shape (331 to 333 of FIG. 3d), a linear shape (341 to 343 of FIG. 3e, 351 to 353 of FIG. 3f), a grid shape (361 to 363 of FIG. 3g), a card shape (371 to 373 of FIG. 3h), a hologram shape, etc., but is not limited thereto.

[0093] For example, it can be assumed that the setting state of the scene-based sound control mode is divided into three stages, and that the sound effect becomes stronger or the volume increases as it goes from stage 1 to stage 3. It can be assumed that the initial scene-based sound control mode setting state (i.e., the state in which there is no second input from the user after the scene-based sound control mode is activated) is set to stage 2 for the sound of all scenes of the input video. However, the above assumption is only an example, and the setting state of the scene-based sound control mode can be implemented in more detailed stages depending on the system architecture.

[0094] For example, referring to FIG. 3B, the electronic device (100) may output UI 311 upon receiving a first input. UI 311 may indicate the setting status of an initial scene-based sound control mode of sound components included in the sound of the first scene (audience cheers, specific person sounds, background music, caster commentary sounds, game sound effects, etc.).

[0095] The electronic device (100) may, based on UI 311, select an audience shout from among the sound components included in the sound of the first scene, and receive a second input instructing to reduce the volume of the selected audience shout. In addition, the electronic device (100), based on UI 311, may select a caster relay sound from among the sound components included in the sound of the first scene, and receive a second input instructing to increase the volume of the selected caster relay sound.

[0096] The electronic device (100) can control the selected audience cheers and caster relay sounds based on the received second input, and output the UI 312 based on the controlled result.

[0097] For example, when there is a scene transition from a first scene to a second scene, the electronic device (100) may remove the UI 312 and output the UI 313. The UI 313 may indicate the setting status of the initial scene-based sound control mode of the sound components (male voice, female voice, background music, restaurant sound effects, etc.) included in the sound of the second scene. The electronic device (100) may repeat the above operation whenever the scene transitions thereafter.

[0098] In FIGS. 3c to 3h, the electronic device (100) can operate similarly to what was described with reference to FIG. 3b. Any content overlapping with what was described with reference to FIG. 3b will be referred to FIG. 3b, and its description will be omitted here.

[0099] In one embodiment, a user interface (UI) for independently controlling sound components included in the sound of each scene may be implemented as a hologram. The electronic device (100) may include various systems (e.g., projection, 3D sensor, tracking sensor, real-time rendering system, etc.) for outputting a holographic UI. The electronic device (100) may use a hologram to output information and manipulation tools for independently controlling sound components included in the sound of each scene of an input image.

[0100] According to one embodiment of the present disclosure, the electronic device (100) can enable users to use a scene-based sound control mode more efficiently by outputting various types of UI for independently controlling sound components for each scene of an input image.

[0101] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0102] FIG. 4 is a drawing for explaining an operation of outputting a UI (400) for allowing an electronic device (100) according to one embodiment to select either sound control of each scene or overall sound control associated with the electronic device.

[0103] Referring to FIG. 4, an electronic device (100) according to one embodiment may output a UI (400) for selecting either sound control of a first scene or overall sound control associated with the electronic device (100) upon receiving a first input. The electronic device (100) may receive a third input based on the UI (400). The third input may refer to a user input for selecting either sound control of the first scene or overall sound control associated with the electronic device (100). Based on the third input, the electronic device (100) may output a UI (401) for controlling sound of the first scene or a UI (402) for overall sound control associated with the electronic device (100).

[0104] In one embodiment, overall sound control associated with the electronic device (100) may mean sound control associated with the electronic device (100) itself, regardless of the input image and scene, as sound control that is applied in the same manner as when the scene-based sound control mode is disabled.

[0105] In one embodiment, the electronic device (100) can control the display to display a UI (400) for independently controlling sound components included in the sound of the first scene, a UI (401) for controlling the sound of the first scene, or a UI (402) for controlling the overall sound associated with the electronic device (100). In one embodiment, the electronic device (100) can generate / control / configure a video signal so that the UI (400) for independently controlling sound components included in the sound of the first scene, the UI (401) for controlling the sound of the first scene, or the UI (402) for controlling the overall sound associated with the electronic device (100) is output, and can transmit the generated / controlled / configured video signal to a device including a display (e.g., TV, monitor, etc.).

[0106] For example, in the example of FIG. 4, a user may select 'scene-based sound control' based on UI 400. The electronic device (100) may receive a third input for selecting 'scene-based sound control' and output UI 401 based on the third input. For example, UI 401 may correspond to UI 301 of FIGS. 3A to 3H, and specifically, may correspond to UI 311 of FIG. 3B, UI 321 of FIG. 3C, UI 331 of FIG. 3D, UI 341 of FIG. 3E, UI 351 of FIG. 3F, UI 361 of FIG. 3G, and UI 371 of FIG. 3H.

[0107] For example, in the example of FIG. 4, a user may select 'full sound control' based on UI 400. The electronic device (100) may receive a third input for selecting 'full sound control' and output UI 402 based on the third input. For example, UI 402 may be implemented in a circular, donut-shaped, polygonal, linear, numeric, card-shaped, or holographic form, but is not limited thereto.

[0108] According to one embodiment, the electronic device (100) may receive a user input for controlling the sound of the first scene or a user input for controlling the entire sound associated with the electronic device (100) based on a UI (401) for controlling the sound of the first scene or a UI (402) for controlling the entire sound associated with the electronic device (100). The electronic device (100) may control the sound of the first scene or the entire sound associated with the electronic device (100) based on the received user input.

[0109] According to one embodiment of the present disclosure, the electronic device (100) may enable users to use a scene-based sound control mode more efficiently by outputting a UI for selecting either sound control of each scene or overall sound control associated with the electronic device.

[0110] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0111] FIG. 5 is a drawing for explaining an operation of an electronic device (100) according to one embodiment of the present invention to output a UI (500) for simultaneously controlling the sound of each scene and the overall sound associated with the electronic device.

[0112] Referring to FIG. 5, an electronic device (100) according to one embodiment can output a UI (500) for simultaneously controlling the sound of a first scene and the entire sound associated with the electronic device (100) upon receiving a first input.

[0113] In one embodiment, the electronic device (100) can control the display to display a UI (500) for simultaneously controlling the sound of the first scene and the entire sound associated with the electronic device (100). In one embodiment, the electronic device (100) can generate / control / configure a video signal to output the UI (500) for simultaneously controlling the sound of the first scene and the entire sound associated with the electronic device (100), and can transmit the generated / controlled / configured video signal to a device including a display (e.g., TV, monitor, etc.).

[0114] For example, in FIG. 5, each of the UI for controlling the sound of the first scene included in UI 500 and the UI for controlling the overall sound associated with the electronic device (100) may be implemented in a circular, donut-shaped, polygonal, linear, numerical, card-shaped, or holographic form, but is not limited thereto.

[0115] The electronic device (100) can receive a user input for controlling the sound of the first scene or a user input for controlling the entire sound associated with the electronic device (100) based on a UI (500) for simultaneously controlling the sound of the first scene and the entire sound associated with the electronic device (100). The electronic device (100) can control the sound of the first scene or the entire sound associated with the electronic device (100) based on the received user input.

[0116] According to one embodiment of the present disclosure, the electronic device (100) can enable users to use a scene-based sound control mode more efficiently by outputting a UI for simultaneously controlling the sound of each scene and the overall sound associated with the electronic device.

[0117] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0118] FIG. 6 is a drawing for explaining an operation of an electronic device (100) according to one embodiment of the present invention to manage sound control setting history in response to content.

[0119] Referring to FIG. 6, an electronic device (100) according to one embodiment may store a sound control setting history corresponding to a first input or a second input in correspondence with content related to an input image. When playing an input image, the electronic device (100) may automatically perform sound control of the input image based on the sound control setting history stored corresponding to the content related to the input image.

[0120] In one embodiment, the content related to a video may refer to the unique content / content of a specific video based on various information that can identify the video, and may refer to the video itself. For example, various information that can identify the video may include, but is not limited to, the title, purpose, and description of the video, the content genre to which the video belongs, information about the target audience of the video, the total length and format of the video, the source of the video, information about the production company and cast, the thumbnail, hashtags and keywords of the video, the posting date and update information of the video, etc.

[0121] For example, in the example of FIG. 6, it can be assumed that the user plays an input image on the electronic device (100) and activates the scene-based sound control mode.

[0122] The electronic device (100) may, based on the UI 311, select an audience cheer from among the audio components included in the audio of the first scene constituting the input image, and receive a second input instructing to reduce the volume of the selected audience cheer. The electronic device (100) may control the selected audience cheer based on the received second input. The electronic device (100) may specify content A regarding the input image, and store an audio control setting history according to the second input in correspondence with the content A. When the electronic device (100) subsequently plays the input image, even without a separate user input, the electronic device (100) may automatically control the scene-based audio of the input image based on the audio control setting history corresponding to the previously stored content A regarding the input image.

[0123] For example, the electronic device (100) can store scene-based sound control setting history corresponding to content B when specifying content regarding an input image as content B according to various information that can specify an image, and similarly, when specifying content regarding an input image as content C, it can store scene-based sound control setting history corresponding to content C.

[0124] According to one embodiment of the present disclosure, the electronic device (100) can store scene-based sound control setting history for each content and automatically link past scene-based sound control setting states based on the content, thereby enabling users to use the scene-based sound control mode more efficiently.

[0125] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0126] FIG. 7 is a drawing for explaining an operation of an electronic device (100) according to one embodiment of the present invention to manage sound control setting history in response to a genre of content.

[0127] Referring to FIG. 7, an electronic device (100) according to one embodiment may store a sound control setting history according to a first input or a second input in correspondence with the genre of content regarding an input video. When the sound control setting history corresponding to the genre of content accumulates to a certain standard, the electronic device (100) may automatically perform sound control of the video based on the sound control setting history stored in correspondence with the genre of the content when playing a video included in the genre of the content.

[0128] In one embodiment, the schedule criterion may be a fixed value preset in the electronic device (100). In one embodiment, the schedule criterion may be changed by the user.

[0129] In one embodiment, the electronic device (100) can analyze the genre of content related to an input image. The electronic device (100) can analyze the genre of content related to the input image by utilizing an artificial neural network model learned / trained to predict the genre of content related to the input image or previously collected metadata related to the input image. Based on the analysis results, the electronic device (100) can identify the genre of content related to the input image.

[0130] In one embodiment, "content genre" may refer to a type of content classified based on the subject matter or unique characteristics of the content. For example, content genres include, but are not limited to, comedy, crime thriller, sports, horror, romance, fantasy, action, family, documentary, science fiction, drama, and animation. "Content genre" may also be referred to as a type or category of content.

[0131] For example, in the example of FIG. 7, it can be assumed that the user plays an input image on the electronic device (100) and activates the scene-based sound control mode.

[0132] The electronic device (100) may, based on the UI 311, select a crowd cheer from among the sound components included in the sound of the first scene constituting the input image, and receive a second input instructing to reduce the volume of the selected crowd cheer. The electronic device (100) may control the selected crowd cheer based on the received second input. The electronic device (100) may analyze the genre of the content related to the input image and identify the content genre related to the input image as a sports genre. The electronic device (100) may store a sound control setting history according to the second input in correspondence with the sports genre, which is the content genre related to the input image. When the sound control setting history corresponding to the sports genre has accumulated to a certain standard, the electronic device (100) may automatically control the scene-based sound of the image based on the sound control setting history corresponding to the sports genre when playing a video corresponding to the sports genre thereafter, even without a separate user input.

[0133] According to one embodiment of the present disclosure, the electronic device (100) can store scene-based sound control setting history by content genre and automatically link past scene-based sound control setting states based on the content genre, thereby enabling users to use the scene-based sound control mode more efficiently.

[0134] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0135] FIG. 8 is a diagram for explaining an operation of an electronic device (100) according to one embodiment of the present invention to manage sound control setting history in correspondence with a user account.

[0136] Referring to FIG. 8, an electronic device (100) according to one embodiment may store a sound control setting history corresponding to a first input or a second input in correspondence with a user account of a user. When playing an input image based on a user account, the electronic device (100) may automatically perform sound control of the input image based on the sound control setting history stored corresponding to the user account.

[0137] In one embodiment, a user account may mean a unique identifier and associated permissions and information used to identify and authenticate a user so that the user can access applications within an electronic device (100).

[0138] In one embodiment, the sound control setting history according to the first or second input may refer to information related to all records / records of controlling / adjusting / changing / setting scene-based sound when the electronic device (100) receives the first or second input. The electronic device (100) may store the sound control setting history in association with a user account on the electronic device (100) or an external server.

[0139] For example, in the example of FIG. 8, it can be assumed that a user accesses an application within an electronic device (100) based on user account A, plays a video, and activates a scene-based sound control mode.

[0140] The electronic device (100) may, based on the UI 311, select an audience cheer from among the sound components included in the sound of the first scene, and receive a second input instructing to reduce the volume of the selected audience cheer. The electronic device (100) may control the selected audience cheer based on the received second input. The electronic device (100) may store a sound control setting history according to the second input in correspondence with a user account A. When the electronic device (100) subsequently plays an input image based on the user account A, the electronic device (100) may automatically control the scene-based sound of the input image based on the sound control setting history previously stored based on the user account A, even without a separate user input.

[0141] If the electronic device (100) plays an input image based on a user account B that is distinct from a user account A, the scene-based sound of the input image may not be automatically controlled based on the pre-stored sound control setting history based on the user account A, and may be set to the initial setting state of the scene-based sound control mode unless there is a pre-stored sound control setting history based on the user account B.

[0142] In one embodiment, the electronic device (100) can interact with other electronic devices that are distinct from the electronic device (100) based on a scene-based audio control setting history that has been previously stored in correspondence with a user account. For example, the electronic device (100) can interact with other electronic devices by sharing the scene-based audio control setting history that has been previously stored with the other electronic devices using an Application Programming Interface (API). Accordingly, even when a user plays a video played using an application in the electronic device (100) using an application in another electronic device, the user can experience the audio of the video being automatically controlled based on the scene-based audio control setting history that has been linked based on the user account.

[0143] According to one embodiment of the present disclosure, the electronic device (100) can store scene-based sound control setting history for each user account and automatically link past scene-based sound control setting states based on the user account, thereby enabling users to use the scene-based sound control mode more efficiently.

[0144] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0145] FIG. 9 is a block diagram of an electronic device (100) according to one embodiment.

[0146] Referring to FIG. 9, an electronic device (100) according to one embodiment may include a display or various types of devices that can be connected to a display. For example, the electronic device 100 may include a TV, a smart monitor, a tablet PC, a laptop, a digital signage, a large display, a 360-degree projector, etc. that include a display. Alternatively, the electronic device (100) may include a set-top box, a desktop PC, etc. that can be connected to a display, but is not limited thereto.

[0147] An electronic device (100) according to one embodiment may include a memory (120) and at least one processor (130). However, the electronic device (100) may be implemented with more components than the illustrated components and is not limited to the examples described above. The components will be described in turn below.

[0148] The memory (120) can store a program for processing and controlling at least one processor (130), and can store data input to or output from the electronic device (100).

[0149] The memory (120) may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.

[0150] A memory (120) according to one embodiment may include one or more instructions that perform a function for appropriately controlling scene-based sound in response to user input disclosed in the present disclosure.

[0151] At least one processor (130) controls the overall operation of the electronic device (100). For example, at least one processor (130) may control a display or generate and transmit a video signal to a device including a display (e.g., a TV, a monitor, etc.) by executing one or more instructions stored in the memory (120). At least one processor (130) may perform the functions of the electronic device (100) described in FIGS. 1 to 8 by executing one or more instructions stored in the memory (120).

[0152] At least one processor (130) may be composed of one or more processors. In this case, one or more processors may be a general-purpose processor such as a CPU, AP, or DSP (Digital Signal Processor), a graphics-only processor such as a GPU or VPU (Vision Processing Unit), or an artificial intelligence-only processor such as an NPU. For example, if one or more processors are artificial intelligence-only processors, the artificial intelligence-only processor may be designed with a hardware structure specialized for processing a specific artificial intelligence model.

[0153] At least one processor (130) may include various processing circuits and / or multiple processors. For example, the term “processor” as used herein, including in the claims, may include various processing circuits, including at least one processor. One or more processors in the at least one processor may be configured to perform various functions described herein, individually and / or collectively, in a distributed fashion. As used herein, “processor,” “at least one processor,” and “one or more processors” may be configured to perform multiple functions. However, these terms encompass, without limitation, situations where one processor performs some of the functions and other processor(s) perform other parts of the functions, and situations where a single processor may perform all of the functions. Furthermore, the at least one processor may include a combination of processors that perform various of the disclosed functions in a distributed manner. The at least one processor may execute program instructions to achieve or perform various functions.

[0154] According to one embodiment, at least one processor (130) may, by executing one or more instructions stored in the memory (120), control the sound of the first scene in response to a first input received corresponding to sound control of one or more scenes included in an input image. At least one processor (130) may, by executing one or more instructions stored in the memory (120), control the sound of second scenes, which are distinct from the first scene among the one or more scenes, to be maintained. The sound control of the first scene is characterized in that sound components included in the sound of the first scene are controlled independently of each other.

[0155] According to one embodiment, the first input may be a user input corresponding to at least one of volume control or sound effect control of a specific sound component included in the sound of the first scene. At least one processor (130) may, in response to the first input, control a specific sound component identified based on changes in frequency distribution and amplitude among the sound components included in the sound of the first scene by executing one or more instructions stored in the memory (120).

[0156] According to one embodiment, at least one processor (130) may be controlled to output a user interface (UI) for controlling sound components included in the sound of a first scene when a first input is received by executing one or more instructions stored in the memory (120). At least one processor (130) may be controlled to perform at least one of volume control or sound effect control of a sound component selected by a second input when a second input is received through the output UI by executing one or more instructions stored in the memory (120).

[0157] According to one embodiment, at least one processor (130) may be controlled to output a UI corresponding to a selection of either sound control of a first scene or overall sound control associated with the electronic device when a first input is received by executing one or more instructions stored in the memory (120). At least one processor (130) may be controlled to output at least one of a UI for controlling sound of the first scene or a UI for overall sound control associated with the electronic device in response to a third input received through the output UI by executing one or more instructions stored in the memory (120).

[0158] According to one embodiment, at least one processor (130) may be controlled to output a UI for simultaneous control of the entire sound associated with the sound and electronic devices of the first scene when a first input is received by executing one or more instructions stored in the memory (120).

[0159] According to one embodiment, at least one processor (130) may perform overall acoustic control associated with the electronic device based on a received first input or a second input, by executing one or more instructions stored in the memory (120), if an acoustic value for an acoustic of the first scene exceeds a first threshold value or is below a second threshold value.

[0160] According to one embodiment, at least one processor (130) may store, in correspondence with content related to an input image, a sound control setting history controlled based on a first input or a second input by executing one or more instructions stored in the memory (120). At least one processor (130) may automatically perform sound control of an input image based on the sound control setting history stored in correspondence with the content by executing one or more instructions stored in the memory (120).

[0161] According to one embodiment, at least one processor (130) may store, by executing one or more instructions stored in the memory (120), a sound control setting history controlled based on a first input or a second input, corresponding to a genre of content regarding an input image. At least one processor (130) may automatically perform sound control of an input image based on the sound control setting history stored in response to the genre of the content when an input image corresponding to the genre of the content is output after the stored sound control setting history corresponding to the genre of the content is stored in a preset value or more by executing one or more instructions stored in the memory (120).

[0162] According to one embodiment, at least one processor (130) may store a sound control setting history corresponding to a user account of a user by executing one or more instructions stored in the memory (120) based on a first input or a second input. At least one processor (130) may automatically perform sound control of an input image based on the sound control setting history stored corresponding to the user account when an input image based on the user account is output by executing one or more instructions stored in the memory (120).

[0163] According to one embodiment of the present disclosure, an electronic device (100) can improve the listening experience of users watching a video by providing a function for appropriately controlling scene-based sound according to a user's input.

[0164] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0165] FIG. 10 is a block diagram of an electronic device (100) according to one embodiment.

[0166] As illustrated in FIG. 10, the electronic device (100) may further include a video processing unit (180), an audio processing unit (115), an audio output unit (125), a tuner unit (140), a communication unit (150), a detection unit (160), and an input / output unit (170) in addition to a display (110), a memory (120), a processor (130), and a user input unit (190).

[0167] Regarding the memory (120) and processor (130), the same contents as described in FIG. 9 are omitted in FIG. 10.

[0168] The display (110) can display data processed in the electronic device (100). The display (110) can display a video included in a broadcast signal received through the tuner unit (140) under the control of the processor (130) on the screen. In addition, the display (110) can display content (e.g., a moving picture) according to a video / audio signal input through the communication unit (150) or the input / output unit (170). The display (110) can output an image stored in the memory (120) under the control of the processor (130).

[0169] Meanwhile, when the display (110) and the touchpad form a layer structure to form a touch screen, the display (110) can be used as an input device in addition to an output device. The display (110) can include at least one of a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a 3D display, and an electrophoretic display.

[0170] The tuner unit (140) can select and tune only the frequency of the channel to be received by the electronic device (100) among many radio wave components through amplification, mixing, resonance, etc. of a broadcast signal received wired or wirelessly. The broadcast signal includes audio, video, and additional information (e.g., EPG (Electronic Program Guide)).

[0171] The communication unit (150) can connect the electronic device (100) to an external device (e.g., a server, an audio device, a mobile device, a display device, etc.) under the control of the processor (130). The processor (130) can transmit / receive various data, including video / audio signals, to the external device connected via the communication unit (150), download an application from the external device, or perform web browsing.

[0172] The communication unit (150) may include one or more modules that enable wireless communication between the electronic device (100) and a wireless communication system or between the electronic device (100) and a network in which another electronic device is located.

[0173] According to one embodiment, the electronic device (100) may receive a first input, a second input, or a third input through the communication unit (150). For example, a user may use a microphone included in the user's input device (e.g., a remote control, a smartphone, a tablet, a smart wearable device, etc.) or a voice recognition function implemented by an application installed on the user's input device to instruct a voice command corresponding to the first input, the second input, or the third input for scene-based sound control. The user's input device may convert the received voice command into an electrical signal and transmit it to the electronic device (100). The communication unit (150) of the electronic device (100) may receive the electrical signal as the first input, the second input, or the third input.

[0174] For example, the communication unit (150) may include a broadcast reception module (151), a mobile communication module (152), a wireless Internet module (153), and a short-range communication module (154). The communication unit (150) may be referred to as a transmission / reception unit.

[0175] The broadcast receiving module (151) receives broadcast signals and / or broadcast-related information from an external broadcast management server via a broadcast channel. The broadcast signals may include TV broadcast signals, radio broadcast signals, and data broadcast signals, as well as broadcast signals in the form of a TV broadcast signal or radio broadcast signal combined with a data broadcast signal.

[0176] A mobile communication module (152) transmits and receives wireless signals with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signals may include various types of data, such as voice call signals, video call signals, or text / multimedia message transmission and reception.

[0177] The wireless Internet module (153) refers to a module for wireless Internet access, and can be built into or external to the device. Wireless Internet technologies that can be used include WLAN (Wireless LAN) (WiFi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), and HSDPA (High Speed ​​Downlink Packet Access). Through the wireless Internet module (153), the device can establish a Wi-Fi connection with other devices. For example, the processor (130) can communicate with one or more APs using the wireless Internet module (153).

[0178] A short-range communication module (154) refers to a module for short-range communication. Short-range communication technologies that can be used include Bluetooth, RFID (Radio Frequency Identification), infrared communication (IrDA, infrared Data Association), UWB (Ultra Wideband), and ZigBee.

[0179] The detection unit (160) detects the user's voice, the user's image, or the user's interaction, and may include a microphone (161), a camera unit (162), and a light receiving unit (163).

[0180] A microphone (161) receives a user's spoken voice. The microphone (161) can convert the received voice into an electrical signal and output it to the processor (130). According to one embodiment, the electronic device (100) can receive a first input, a second input, or a third input using the microphone (161).

[0181] The camera unit (162) can receive images (e.g., consecutive frames) corresponding to a user's motion including a gesture within the camera recognition range. According to one embodiment, the electronic device (100) can receive a first input, a second input, or a third input using the camera unit (162).

[0182] The optical receiver (163) receives an optical signal (including a control signal) from a remote control device. The optical receiver (163) can receive an optical signal corresponding to a user input (e.g., a touch, a press, a touch gesture, a voice, or a motion) from the control device. A control signal can be extracted from the received optical signal under the control of the processor (130). According to one embodiment, the electronic device (100) can receive a first input, a second input, or a third input using the optical receiver (163).

[0183] The input / output unit (170) receives video (e.g., moving pictures, etc.), audio (e.g., voice, music, etc.), and additional information (e.g., EPG, etc.), etc. from the outside of the electronic device (100) under the control of the processor (130). The input / output unit (170) transmits video (e.g., moving pictures, etc.), audio (e.g., voice, music, etc.), and additional information (e.g., EPG, etc.), etc. to an external display device or speaker of the electronic device (100) under the control of the processor (130). The input / output unit (170) may include one or a combination of an HDMI port (High-Definition Multimedia Interface port, 171), a component jack (component jack, 172), a PC port (PC port, 173), a USB port (USB port, 174), DP (DisplayPort), RGB (Red, Green, Blue), DVI (Digital Visual Interface), and Thunderbolt.

[0184] The video processing unit (180) processes image data to be displayed by the display (110) and can perform various image processing operations such as decoding, rendering, scaling, noise filtering, frame rate conversion, and resolution conversion for the image data.

[0185] The audio processing unit (115) performs processing on audio data. The audio processing unit (115) can perform various processing such as decoding, amplification, and noise filtering on audio data.

[0186] The audio output unit (125) can output audio included in a broadcast signal received through the tuner unit (140) under the control of the processor (130), audio input through the communication unit (150) or the input / output unit (170), and audio stored in the memory (120). The audio output unit (125) can include at least one of a speaker (126), a headphone output terminal (127), or a S / PDIF (Sony / Philips Digital Interface:) output terminal (128).

[0187] The user input unit (190) refers to a means for a user to input data for controlling the electronic device (100). The user input unit (190) may include a touch input unit that receives a touch input. For example, the user input unit (190) may include, but is not limited to, a key pad, a dome switch, a touch pad (contact electrostatic capacitance type, pressure resistive film type, infrared detection type, surface ultrasonic conduction type, integral tension measurement type, piezo effect type, etc.), a jog wheel, a jog switch, etc.

[0188] A memory (120) according to one embodiment can store a program for processing and controlling a processor (130) and can store data input to or output from an electronic device (100).

[0189] The processor (130) controls the overall operation of the electronic device (100) and the signal flow between internal components of the electronic device (100), and performs a function of processing data. When there is a user input or a preset stored condition is satisfied, the processor (130) can execute an OS (Operating System) and various applications stored in the memory (120). In addition, according to one embodiment, the processor (130) can execute one or more instructions stored in the memory (120) that implement a function for appropriately controlling scene-based sound in response to a user input.

[0190] Meanwhile, the block diagrams of the electronic device (100) illustrated in FIGS. 9 and 10 are block diagrams for one embodiment. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the electronic device (100) actually implemented. For example, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are for describing embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.

[0191] A specific example for explaining an embodiment according to the present disclosure is only one combination of each criterion, method, detailed method, and operation, and by combining at least two or more of the various techniques described, the electronic device (100) can provide a function for appropriately controlling scene-based sound according to a user's input, thereby improving the listening experience of users watching a video. In addition, at this time, it can be performed according to a method determined through one or a combination of at least two or more of the above-described techniques. For example, it may be possible to perform a part of the operation of one embodiment in combination with a part of the operation of another embodiment.

[0192] A device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage medium and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.

[0193] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

Claims

1. In electronic devices, Memory that stores one or more instructions; and At least one processor configured to execute one or more instructions stored in the memory, The at least one processor executes the one or more instructions, When a first input corresponding to sound control of a first scene among one or more scenes included in an input video is received, Controlling the sound of the first scene in response to the first input, Controlling to maintain the sound of a second scene that is distinct from the first scene among the one or more scenes, An electronic device characterized in that the sound control of the first scene is such that sound components included in the sound of the first scene are controlled independently of each other.

2. In the electronic device of paragraph 1, The first input is a user input corresponding to at least one of volume control or sound effect control of a specific sound component included in the sound of the first scene, The at least one processor executes the one or more instructions, An electronic device that controls, in response to the first input, the specific sound component identified based on changes in frequency distribution and amplitude among the sound components included in the sound of the first scene.

3. In the electronic device of claim 1 or 2, the at least one processor executes the one or more instructions, When the first input is received, a user interface (UI) corresponding to the control of the sound component included in the sound of the first scene is controlled to be output, When the second input is received through the UI output above, An electronic device characterized in that it performs at least one of volume control or sound effect control of a sound component selected by the second input.

4. In any one of the electronic devices of paragraphs 1 to 3, the at least one processor executes the one or more instructions, When the first input is received, a UI corresponding to a selection of one of the sound control of the first scene or the overall sound control associated with the electronic device is controlled to be output, When a third input corresponding to the above selection is received through the above output UI, An electronic device that controls, in response to the third input, to output at least one of a UI corresponding to sound control of the first scene or a UI corresponding to overall sound control associated with the electronic device.

5. In any one of the electronic devices of claims 1 to 4, the at least one processor executes the one or more instructions, An electronic device that, when the first input is received, controls to output a UI corresponding to simultaneous control of the sound of the first scene and the entire sound associated with the electronic device.

6. In any one of the electronic devices of paragraphs 1 to 5, the at least one processor executes the one or more instructions, An electronic device that performs overall sound control associated with the electronic device based on the received first input or the second input when the sound value for the sound of the first scene exceeds a first threshold value or is less than a second threshold value.

7. In any one of the electronic devices of claims 1 to 6, the at least one processor executes the one or more instructions, The sound control setting history controlled based on the first input or the second input is stored in correspondence with the content related to the input image, An electronic device that automatically performs sound control of the input image based on the sound control setting history stored in response to the above content.

8. In any one of the electronic devices of paragraphs 1 to 7, the at least one processor executes the one or more instructions, The sound control setting history controlled based on the first input or the second input is stored in correspondence with the genre of the content regarding the input video, An electronic device that automatically performs sound control of an input image based on the sound control setting history stored in response to the genre of the content, when an input image corresponding to the genre of the content is output after the sound control setting history stored in response to the genre of the content is stored in a preset amount or more.

9. In any one of the electronic devices of claims 1 to 8, the at least one processor executes the one or more instructions, The sound control setting history controlled based on the first input or the second input is stored corresponding to the user account of the user, An electronic device that automatically performs sound control of the input image based on the sound control setting history stored corresponding to the user account when an input image based on the user account is output.

10. In the method of operating an electronic device, When a first input corresponding to sound control of a first scene among one or more scenes included in an input video is received, A step of controlling the sound of the first scene in response to the first input; and A step of controlling the sound of a second scene, which is distinct from the first scene among the one or more scenes, to be maintained, A method for controlling the sound of the first scene, characterized in that the sound components included in the sound of the first scene are controlled independently of each other.

11. In paragraph 10, The first input is a user input corresponding to at least one of volume control or sound effect of a specific sound component included in the sound of the first scene, A method further comprising, in response to the first input, a step of controlling the specific sound component identified based on changes in frequency distribution and amplitude among the sound components included in the sound of the first scene.

12. In paragraph 10 or 11, When the first input is received, a step of controlling to output a user interface (UI) corresponding to the control of the sound component included in the sound of the first scene; and When the second input is received through the UI output above, A method further comprising the step of performing at least one of volume control or sound effect control of the sound component selected by the second input.

13. In any one of paragraphs 10 to 12, When the first input is received, a step of controlling to output a UI corresponding to a selection of one of sound control of the first scene or overall sound control associated with the electronic device; and When a third input corresponding to the above selection is received through the above output UI, A method further comprising a step of controlling, in response to the third input, to output at least one of a UI corresponding to sound control of the first scene or a UI corresponding to overall sound control associated with the electronic device.

14. In any one of paragraphs 10 to 13, A method further comprising the step of controlling, when the first input is received, to output a UI corresponding to simultaneous control of the sound of the first scene and the entire sound associated with the electronic device.

15. A computer-readable recording medium having recorded thereon at least one program for implementing the method described in any one of claims 10 to 14.

Images