Electronic device and operation method thereof
The electronic device addresses the challenge of adapting picture and sound quality to game content characteristics by identifying genres and adjusting settings in real-time, resulting in an enhanced gaming experience.
Patent Information
- Application Number
- PCT/KR2024/096723
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-12-12
- Filing Date
- 2024-12-11
- Publication Date
- 2025-06-19
AI Technical Summary
Conventional electronic devices struggle to dynamically adjust picture and sound quality to match the varying characteristics of game content, leading to suboptimal gaming experiences.
An electronic device capable of identifying representative and partial genres of game content through analysis of video frames and audio frequencies, allowing for real-time adjustment of video and audio quality settings to enhance the gaming experience.
The device provides an optimized output environment for each scene of game content by dynamically controlling image and sound quality, thereby enhancing player immersion and overall gaming experience.
Smart Images

Figure KR2024096723_19062025_PF_FP_ABST
Abstract
Description
Electronic device and method of operation thereof
[0001] The disclosed embodiment relates to an electronic device capable of playing content, and more specifically, to an electronic device capable of playing content while providing audiovisual effects appropriate to the characteristics of the content, and a method of operating the same.
[0002] Advances in display technology have led to the development of display devices capable of implementing a variety of functions. A prime example of a display device is the television. Conventional TVs simply received broadcast signals and played corresponding broadcast content (e.g., news, dramas, music programs, etc.).
[0003] Recent advancements in display technology have enabled TVs to store and install a variety of applications or programs to perform a variety of functions. These applications can provide a variety of functions and services beyond just broadcast content playback. For example, game applications can be stored and installed on a TV, allowing game content to be played.
[0004] As communication technologies or communication connection capabilities of display devices develop, display devices can now provide various functions or services through wired or wireless communication with external devices. For example, a display device can be connected to an external device, such as a game console, or a game server providing game content via wired or wireless communication, and can receive game content from the external device or game server via the aforementioned wired or wireless communication.
[0005] Meanwhile, in order to maximize the player's gaming experience and enhance the player's gaming immersion while playing the game content, the display device may provide picture quality and / or sound quality suitable for the game content.
[0006] According to one embodiment of the present disclosure, in providing game content through an electronic device, an electronic device capable of providing image quality and / or sound quality that can highlight the characteristics of each scene of the game content, a method of operating the electronic device, and a non-transitory computer-readable recording medium are provided.
[0007] The technical problems to be achieved in the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.
[0008] According to one embodiment, an electronic device includes a memory that stores at least one instruction; and at least one processor that executes at least one instruction. According to one embodiment, when the at least one instruction is executed by the at least one processor, the electronic device may be configured to identify a representative genre of the content based on information about the content. According to one embodiment, when the at least one instruction is executed by the at least one processor, the electronic device may be configured to perform at least one of video quality control or audio quality control on the content by setting at least one of video quality or audio quality for reproduction of the content to a predetermined value based on the identified representative genre. According to one embodiment, when the at least one instruction is executed by the at least one processor, the electronic device may be configured to identify a partial genre of the content based on analysis of a scene including at least one of one or more video frames or audio frequencies corresponding to at least a portion of the content being reproduced. According to one embodiment, the electronic device may be configured to perform at least one of the video quality control or the audio quality control on the content by weighting a predetermined value based on the identified partial genre by executing the at least one instruction by the at least one processor.
[0009] According to one embodiment, a method of operating an electronic device may include an operation of identifying a representative genre of content based on information about the content. According to one embodiment, the method of operating an electronic device may include an operation of performing at least one of video quality control or audio quality control on the content by setting at least one of video quality or audio quality for playing the content to a predetermined value based on the identified representative genre. According to one embodiment, the method of operating an electronic device may include an operation of identifying a partial genre of the content based on an analysis of a scene including at least one of one or more video frames or audio frequencies corresponding to at least a portion of the content being played. According to one embodiment, the method of operating an electronic device may include an operation of performing at least one of video quality control or audio quality control on the content by assigning a weight to the predetermined value based on the identified partial genre.
[0010] In one embodiment, a non-transitory computer-readable recording medium storing one or more instructions for executing a method of operating an electronic device by a computer may include: an operation of identifying a representative genre of the content based on information about the content; an operation of performing at least one of video quality control or audio quality control on the content by setting at least one of video quality or audio quality for reproduction of the content to a predetermined value based on the identified representative genre; an operation of identifying a partial genre of the content based on analysis of a scene including at least one of one or more video frames or audio frequencies corresponding to at least a portion of the content being reproduced; and an operation of performing at least one of video quality control or audio quality control on the content by assigning a weight to the predetermined value based on the identified partial genre.
[0011] According to an electronic device, an operating method of the electronic device, and a non-transitory computer-readable recording medium according to one embodiment, when providing game content using the electronic device, an output environment optimized for each scene of the game content can be provided by controlling the picture quality and / or sound quality differently for each scene of the game content.
[0012] The effects that can be obtained from the embodiments disclosed in this disclosure are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains from the description below.
[0013] The above-described and other aspects, features and advantages of the embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings.
[0014] FIG. 1 illustrates an example of a system for playing content according to one embodiment.
[0015] FIG. 2 illustrates an example of a schematic block diagram of devices included in a system according to one embodiment.
[0016] FIG. 3 is an example of a block diagram of an electronic device according to one embodiment.
[0017] FIG. 4 shows a functional block diagram of a picture / sound quality processing unit according to one embodiment.
[0018] FIG. 5 illustrates an example of a genre-specific picture and sound quality control parameter value information storage module according to one embodiment.
[0019] FIG. 6 illustrates an example of a flowchart of a method of operating an electronic device according to one embodiment.
[0020] FIG. 7 illustrates an example of a method of operating an electronic device according to one embodiment.
[0021] FIG. 8 is a reference diagram for explaining a method of recognizing content by analyzing a content video screen in an electronic device according to one embodiment.
[0022] FIG. 9 is a reference diagram for explaining an example of applying weights to image quality control parameters and sound quality control parameters according to one embodiment.
[0023] FIG. 10 is a reference diagram for explaining an example of analyzing and processing picture quality and sound quality for each genre of game content according to one embodiment.
[0024] Figure 11 shows a weight table in one embodiment when the representative genres are RPG, RTS, FPS, and SPORTS, respectively.
[0025] FIG. 12 is a reference diagram for explaining an example of controlling image quality based on a representative genre and a partial genre during play of game content according to one embodiment.
[0026] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings so that those skilled in the art can easily practice the present invention. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, parts irrelevant to the description are omitted to clearly explain the present invention, and similar parts are designated with similar reference numerals throughout the specification. In addition, throughout the drawings, the same reference numerals are assigned to the same components.
[0027] Throughout the specification, when a part is said to be "connected" to another part, this includes not only the cases where the parts are "directly connected" but also the cases where the parts are "electrically connected" with other elements intervening. Furthermore, when a part is said to "include" a component, this does not exclude other components, but rather includes other components, unless otherwise stated.
[0028] The appearances of phrases such as “in some embodiments” or “in one embodiment” in various places throughout this specification are not necessarily all referring to the same embodiment.
[0029] Some embodiments may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented by various hardware and / or software configurations that perform specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more processors or microprocessors, or by circuit configurations for performing the intended functions. Furthermore, for example, the functional blocks of the present disclosure may be implemented in various programming or scripting languages. The functional blocks may be implemented by algorithms that execute on one or more processors. Furthermore, the present disclosure may employ conventional techniques for electronic configuration, signal processing, and / or data processing. Terms such as modules and configurations may be used broadly and are not limited to mechanical and physical configurations.
[0030] Additionally, the connecting lines or connecting members between components depicted in the drawings are merely exemplary representations of functional connections and / or physical or circuit connections. In an actual device, connections between components may be represented by various functional connections, physical connections, or circuit connections that may be replaced or added.
[0031] Additionally, the description 'at least one of A, B, and C' means that it can be any one of 'A', 'B', 'C', 'A and B', 'A and C', 'B and C', and 'A, B, and C'.
[0032] In the disclosed embodiment, an electronic device may refer to any electronic device capable of receiving content from a source device and displaying a corresponding screen. Here, the content may be a game, lecture, movie, home training service content, etc.
[0033] Specifically, an electronic device according to an embodiment of the present disclosure may be any electronic device capable of selectively displaying at least one content, and may exist in various forms, such as a TV, a smart TV, a digital broadcasting terminal, a tablet PC, a smart phone, a mobile phone, a computer, a laptop, etc. In addition, the display device may be not only fixed, but also movable or portable.
[0034] FIG. 1 illustrates an example of a system for playing content according to one embodiment.
[0035] Referring to FIG. 1, the system 10 may include an electronic device 100 for displaying content, a content providing device 200 or server device 300 for providing content, and an input device 50.
[0036] The electronic device 100 can communicate with the content providing device 200 or the server device 300 and receive and display content provided from the content providing device 200 or the server device 300.
[0037] The electronic device 100 can transmit a request for executing a content application to the server device 300, and according to the request for executing the content application, can receive an execution result screen from the server device 300 and display the received execution result screen on the display. The user of the electronic device 100 can operate the input device 50 to control the execution result screen displayed on the display of the electronic device 100. According to the user's operation, the input device 50 can transmit a control signal to the electronic device 100, and the electronic device 100 can transmit the control signal received from the input device 50 to the server device 300. The server device 300 can execute the content application based on the control signal received from the electronic device 100 and transmit the execution result screen to the electronic device 100.
[0038] The electronic device 100 can receive an execution result screen according to the execution of a content application in the content providing device 200 from the content providing device 200 and display the received execution result screen on the display. A user of the electronic device 100 can operate an input device 50 to control the execution result screen displayed on the display of the electronic device 100. According to the user's operation, the input device 50 can transmit a control signal to the electronic device 100, and the electronic device 100 can transmit the control signal received from the input device 400 to the content providing device 200. The content providing device 200 can execute the content application based on the control signal received from the electronic device 100 and transmit the execution result screen to the electronic device 100.
[0039] The content providing device 200 can communicate with the electronic device 100 using wired or wireless communication technology. The content providing device 200 can execute a content application and transmit a result screen according to the execution of the content application to the electronic device 100 via a communication network. For example, the content providing device 200 can execute a game application and transmit a result screen or result image rendered according to the execution of the game application to the electronic device 100.
[0040] The server device 300 may execute a content application upon a request from the electronic device 100, and transmit a result screen according to the execution of the content application to the electronic device 100 via a communication network. For example, if the server device 300 receives a request to execute a game application from the electronic device 100, the server device 300 may execute the game application and transmit a result screen or result image rendered according to the execution of the game application to the electronic device 100 via the communication network 20.
[0041] When the electronic device 100 receives and displays game content resulting from the execution of a game content application from the content providing device 200 or the server device 300, the electronic device 100 may set the picture quality or sound quality for outputting the game content differently depending on the characteristics of the game content. In the case of game content, unlike general video content, each game content may be produced to have various characteristics, such as providing an overall dark image, an overall bright image, a fast image, or providing various effects. Therefore, it is desirable for the electronic device 100 to provide an audio / video output environment so that the characteristics or effects of such game content can be better expressed. For example, the electronic device 100 may set the picture quality or sound quality for outputting the game content depending on the genre of the game content.
[0042] In the past, if a user of an electronic device 100 had to manually set the genre of game content, it could cause inconvenience to the user. In the case of a method of manual setting, the user had to set the genre by manipulating the user interface (UI) provided on the electronic device during game play, which could hinder the immersion of the game or make it difficult to optimize the settings for the content scene at the time of setting. Even if the electronic device 100 could automatically set the genre of game content, automatic setting could be difficult if the electronic device 100 could not obtain metadata about the genre of the game content. The embodiments disclosed in the present disclosure provide an electronic device and an operating method thereof that can recognize a representative genre of content based on analysis of a content screen being played when the electronic device 100 could not obtain metadata about the genre of the game content.
[0043] Game content can encompass the characteristics of various genres, not just those of a single genre, even within a single game content. For example, adventure game content may incorporate characteristics of both action and fighting genres within each scene. Therefore, it is important to provide various picture and sound qualities according to the scene characteristics so that the picture and sound quality can be optimized for each scene of the content. Even within a single game content, the characteristics of the game content can change. If the picture and sound quality are initially set using only the game content's genre information, the initially set picture and sound quality may not be suitable for the section where the game content's characteristics have changed. The embodiments disclosed in the present disclosure provide an electronic device and an operating method thereof that can adaptively change the picture and sound quality according to the scene characteristics of the game content to provide game content.
[0044] According to one embodiment, the electronic device 100 may identify a representative genre of the content based on information about the content, and set the picture quality or sound quality for outputting the content based on one or more predetermined values corresponding to the identified representative genre. The output effect according to the picture quality or sound quality set based on the representative genre may be referred to as a primary audio-visual effect. In addition, the electronic device 100 may identify a partial genre of the content based on characteristics of the content obtained through scene analysis of the content being played, and may change the picture quality or sound quality for outputting the content by assigning a weight to one or more predetermined values for setting the picture quality or sound quality corresponding to the representative genre based on the identified partial genre. The output effect according to the changed picture quality or sound quality based on the partial genre may be referred to as a secondary audio-visual effect.
[0045] According to one embodiment, the electronic device 100 may be configured to provide a primary audio visual effect to the content by identifying a representative genre of the content based on identification information of the content, and setting at least one of video quality or audio quality for playback of the content to a predetermined value based on the identified representative genre.
[0046] According to one embodiment, the electronic device 100 may be configured to identify a partial genre of the content based on analysis of a scene including one or more video frames and / or audio frequencies corresponding to at least a portion of the content being played, and to provide a secondary audio-visual effect to the content by weighting a predetermined value based on the identified partial genre.
[0047] According to one embodiment, the electronic device 100 may be configured to recognize that playback of content has begun, obtain a title of the content by analyzing an image of the content being played, and identify a representative genre of the content based on the title of the content.
[0048] According to one embodiment, the electronic device 100 may be configured to recognize that playback of game content has begun based on whether at least one signal of VRR, ALLM, or ContentsType is received from an external device connected to provide the content.
[0049] According to one embodiment, the electronic device 100 may be configured to obtain at least one of a setting value of one or more parameters for setting video quality or a setting value of one or more parameters for setting audio quality corresponding to a representative genre, and to set at least one of the video quality or the audio quality using at least one of the setting values of one or more parameters for setting video quality or the setting values of one or more parameters for setting audio quality.
[0050] According to one embodiment, the electronic device 100 may be configured to obtain a genre selected from among a plurality of predetermined genres as a representative genre of the content based on identification information of the content, and to obtain a genre selected from among the plurality of predetermined genres as a partial genre of the content based on analysis of the scene.
[0051] According to one embodiment, the electronic device 100 may be configured to weight a primary audiovisual effect by adjusting a setting value of one or more parameters for setting video quality corresponding to a representative genre using an offset value corresponding to an identified partial genre.
[0052] According to one embodiment, the electronic device 100 is configured to obtain a table storing the offset values added corresponding to each of a plurality of predetermined genres to the setting values of one or more parameters for setting video quality corresponding to the representative genre, and the offset values can vary within a predetermined range of values.
[0053] FIG. 2 illustrates an example of a schematic block diagram of devices included in a system according to one embodiment.
[0054] Referring to FIG. 2, the system 10 may include an electronic device 100 for displaying content, a content providing device 200 for providing content to the electronic device 100, a server device 300, and an input device 50 for controlling the electronic device 100.
[0055] The electronic device 100 can output or display content received from the content providing device 200 or the server device 300. The electronic device 100 may include various types of electronic devices capable of receiving and outputting content, such as a network TV, a smart TV, an Internet TV, a web TV, an IPTV, a PC, etc. The electronic device 100 may be referred to as a display device in terms of receiving and displaying content, and may also be referred to as a content receiving device, a sink device, a computing device, etc.
[0056] The electronic device 100 can be connected to the content providing device 200 using wired or wireless communication technology.
[0057] The electronic device 100 and the content provider 200 can transmit and receive content by being connected via a wired connection means for forming a wired network. For example, the wired connection means may include a cable, and the electronic device 100 and the content provider 200 may each include one or more ports for cable connection. The one or more ports may include a digital input interface, such as an HDMI port, a DisplayPort, or a Type-C port.
[0058] The electronic device 100 and the content providing device 200 can transmit and receive content by being connected via a wireless connection means for forming a wireless network. For example, the wireless connection means may include a wireless HDMI communication module, and each of the electronic device 100 and the content providing device 200 may include a wireless HDMI communication module. As another example, the wireless connection means may include at least one communication module that performs communication according to a communication standard such as Bluetooth, Wi-Fi, BLE (Bluetooth Low Energy), NFC / RFID, Wi-Fi Direct, UWB, ZIGBEE, Internet, 3G, 4G, 5G, and / or 6G.
[0059] The electronic device 100 is a device that can display images or data according to a user's request, and may include a communication interface 110, a display 120, a memory 130, and a processor 140.
[0060] The communication interface 110 may perform communication with at least one external device. Here, 'communication' may mean an operation of transmitting and / or receiving data, signals, requests, and / or commands.
[0061] The communication interface 110 can perform wired or wireless communication with at least one external device. The external device may be a content providing device 200 capable of providing content, a server device 300, or an input device 50.
[0062] For example, the communication interface 110 may include at least one of a communication module, a communication circuit, a communication device, an input / output port, and an input / output plug for performing wired or wireless communication with at least one external device.
[0063] For example, the communication interface 110 may include at least one wireless communication module, wireless communication circuit, or wireless communication device that performs wireless communication with at least one external device.
[0064] For example, the communication interface 110 may include a short-range communication module, such as an IR (infrared) communication module, capable of receiving control commands from a remote controller located in close proximity, such as the input device 50. In this case, the communication interface 110 may receive a control signal from the remote controller.
[0065] As another example, the communication interface 110 may include at least one communication module that performs communication according to a wireless communication standard such as Bluetooth, Wi-Fi, BLE (Bluetooth Low Energy), NFC / RFID, Wi-Fi Direct, UWB, or ZIGBEE. Alternatively, the communication interface 110 may further include a communication module that performs communication with a server to support long-distance communication according to a long-distance communication standard. For example, the communication interface 110 may include a communication module that performs communication through a network for Internet communication. In addition, the communication interface 110 may include a communication module that performs communication through a communication network according to a communication standard such as 3G, 4G, 5G, and / or 6G.
[0066] As another example, the communication interface 110 may include at least one port for connecting to an external device via a wired cable in order to communicate with the external device via a wired connection. For example, the communication interface 110 may include at least one of an HDMI port (High-Definition Multimedia Interface port), a component jack, a PC port, and a USB port. Accordingly, the communication interface 110 may communicate with a wired external device via at least one port. Here, the port may refer to a physical device configuration into which a cable, communication line, or plug can be connected or inserted.
[0067] As described above, the communication interface 110 may include at least one support element for supporting communication between the electronic device 100 and an external device. Here, the support element may include the communication module, the communication circuit, the communication device, the port (for input / output of data), the cable port (for input / output of data), the plug (for input / output of data), etc., as described above. For example, the at least one support element included in the communication interface 110 may include an Ethernet communication module, a Wi-Fi communication module, a Bluetooth communication module, an IR communication module, a USB port, a tuner (or a broadcast receiver), an HDMI port, a DP (display port), a DVI (digital visual interface) port, etc.
[0068] Referring to FIG. 2, electronic device 100 may be an electronic device that does not include an internal display. For example, electronic device 100 may be a set-top box (STB). As another example, electronic device 100 may be a content playback device.
[0069] Alternatively, the electronic device 100 may include a display 120 internally, but may control content received by the electronic device 100 or stored in the electronic device 100 to be displayed through an external display connected via the communication interface 110 instead of the internal display. For example, the processor 140 may control the communication interface 110 so that content stored internally or received via the communication interface 110 is transmitted to the external display. For example, the communication interface 110 may transmit content to the external display under the control of the processor 140. Then, the external display may output the received content through an internally included display panel. Accordingly, a user may visually recognize the content output through the external display.
[0070] The display 120 can output an image onto the screen under the control of the processor 140. For example, the processor 140 can control the display 120 so that an intended image is output onto the display 120.
[0071] The display 120 outputs an image onto a screen. For example, the display 120 may output an image corresponding to the video data through an internally included display panel so that a user can visually recognize the video data. Specifically, the video data forming the content may include a plurality of frame images, and the display 120 may play the video content by sequentially displaying the plurality of frame images under the control of the processor 140. For example, the display 120 may output a content image corresponding to the video content onto a screen under the control of the processor 140.
[0072] Although the display 120 is shown as being arranged within the electronic device 100, the display 120 may also be arranged externally to the electronic device 100 and connected to the electronic device 100 via wired or wireless communication.
[0073] Memory 130 may store at least one instruction, data, information, and / or application. For example, memory 130 may store at least one instruction to be executed by processor 140. For example, memory 130 may store at least one program to be executed by processor 140. For example, memory 130 may store an application for providing a certain service.
[0074] The memory 130 may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.
[0075] The processor 140 may control the execution of at least one instruction to perform an intended operation. Here, the at least one instruction may be stored in an internal memory included in the processor 140 or in a memory 130 included in the electronic device 100 separately from the processor 140.
[0076] The processor 140 can control at least one component included in the electronic device 100 to perform an intended operation by executing at least one instruction. Accordingly, even if an example is given of the processor 140 performing predetermined operations, this may mean that the processor 140 controls at least one component included in the electronic device 100 to perform the predetermined operations.
[0077] In addition, although the processor 140 is described and illustrated as an example of being formed as a single processor, it may also be formed in a form including multiple processors.
[0078] For example, the processor 140 may include a RAM that stores signals or data input from the outside of the electronic device 100, a storage area corresponding to various tasks performed in the electronic device 100, a control program for controlling the electronic device 100, an application for providing a predetermined function or service, and / or a ROM that stores a plurality of instructions, and at least one processor. The processor 140 may include a graphics processor (Graphics Processing Unit) for graphics processing corresponding to video. The processor may be implemented as a SoC (System On Chip) that integrates a core and a GPU. In addition, the processor 140 may include multiple cores more than a single core. For example, the processor 140 may include a dual core, a triple core, a quad core, a hexa core, an octa core, a deca core, a dodeca core, a hexa decimal core, etc.
[0079] In an embodiment of the present disclosure, the processor 140 may store one or more instructions in an internally provided memory, and may control the operations of the electronic device 100 to be performed by executing one or more instructions stored in the internally provided memory. That is, the processor 140 may perform a predetermined operation by executing at least one instruction or program stored in an internal memory or memory 130 provided within the processor 140.
[0080] According to one embodiment, the processor 140 may identify a representative genre of the content based on information about the content by executing one or more instructions stored in the memory 130.
[0081] According to one embodiment, the processor 140 may perform primary video quality control and / or audio quality control on the content by executing one or more instructions stored in the memory 130 to set at least one of the video quality or audio quality for playback of the content to a predetermined value based on the identified representative genre.
[0082] According to one embodiment, the processor 140 may identify a partial genre of the content based on an analysis of a scene including one or more video frames and / or audio frequencies corresponding to at least a portion of the content being played, by executing one or more instructions stored in the memory 130.
[0083] According to one embodiment, the processor 140 may be configured to perform secondary video quality control and / or audio quality control on the content by weighting the predetermined value based on the identified partial genre by executing one or more instructions stored in the memory 130.
[0084] According to one embodiment, the processor 140 may be configured to recognize that playback of the content has begun by executing one or more instructions stored in the memory 130, obtain title information of the content by analyzing an image of the content being played, and identify a representative genre of the content based on the title information of the content.
[0085] According to one embodiment, the processor 140 may be configured to recognize that playback of game content has begun based on whether at least one signal of VRR, ALLM, or ContentsType is received from an external device connected to provide the content by executing one or more instructions stored in the memory 130.
[0086] According to one embodiment, the processor 140 may be configured to identify a selected genre from among a plurality of predetermined genres as a representative genre of the content based on information about the content by executing one or more instructions stored in the memory 130.
[0087] According to one embodiment, the processor 140 may be configured to identify a selected genre from among the plurality of predetermined genres as a sub-genre of the content based on an analysis of the scene by executing one or more instructions stored in the memory 130.
[0088] According to one embodiment, the processor 140 may be configured to obtain at least one of a setting value of one or more parameters for controlling the video quality or a setting value of one or more parameters for controlling the audio quality corresponding to the representative genre by executing one or more instructions stored in the memory 130, and to control at least one of the video quality or the audio quality by setting one or more parameters for controlling the video quality using the setting value of one or more parameters for controlling the video quality or by setting one or more parameters for controlling the audio quality using the setting value of one or more parameters for controlling the audio quality.
[0089] According to one embodiment, the processor 140 may be configured to perform secondary video quality control and / or audio quality control on the content by adjusting a setting value of one or more parameters for setting the video quality and / or a setting value of one or more parameters for setting the audio quality corresponding to the representative genre using a weight corresponding to the identified partial genre by executing one or more instructions stored in the memory 130.
[0090] According to one embodiment, the processor 140 may be configured to determine whether the identified partial genre is the same as the representative genre by executing one or more instructions stored in the memory 130, and, if the identified partial genre is the same as the representative genre, perform video quality control and / or audio quality control using at least one of setting values of one or more parameters for controlling the video quality corresponding to the representative genre or setting values of one or more parameters for controlling the audio quality, and, if the identified partial genre is different from the representative genre, adjust the setting values of one or more parameters for setting the video quality corresponding to the representative genre and / or the setting values of one or more parameters for setting the audio quality using a weight corresponding to the identified partial genre.
[0091] According to one embodiment, the processor 140 may be configured to obtain a table storing the weights added to the setting values of one or more parameters for setting the video quality corresponding to the representative genre, corresponding to each of a plurality of predetermined genres, by executing one or more instructions stored in the memory 130.
[0092] The electronic device 100 may be any type of device that performs a function, including a processor and memory. The electronic device 100 may be a fixed or portable device. For example, the electronic device 100 may be a device that has a display and can display image content, video content, game content, graphic content, etc. The electronic device 100 may output or display images or content received from a content providing device 200 or a server device 300. The electronic device 100 may include various types of electronic devices that can receive and output content, such as televisions such as network TVs, smart TVs, Internet TVs, web TVs, and IPTVs; computers such as desktops, laptops, and tablets; smartphones, cellular phones, game players, music players, video players, medical equipment, and home appliances. The electronic device 100 may be referred to as a display device in that it receives and displays content, and may also be referred to as a content receiving device, a sink device, a display device, a computing device, etc.
[0093] The block diagram of the electronic device 100 illustrated in FIG. 2 is a block diagram for one embodiment. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the electronic device 100 actually implemented. For example, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are for the purpose of explaining embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.
[0094] Now, let's describe the content provider device 200.
[0095] The content providing device 200 can connect to the electronic device 100 using wired or wireless communication technology and provide content to the electronic device 100. The content providing device 200 can execute a content application at the request of the electronic device 100 and transmit an execution result screen or an execution result image to the electronic device 100. In addition, the content providing device 200 can receive an input signal for controlling the content application from the electronic device 100. The content providing device 100 can execute the content application based on the input signal and transmit an execution result screen or an execution result image to the electronic device 100.
[0096] The content providing device 200 may include a communication interface 210, a memory 220, and a processor 230.
[0097] The communication interface 210 may include one or more modules that enable wired or wireless communication between the content providing device 200 and the electronic device 100.
[0098] According to one embodiment, the communication interface 210 may transmit content to the electronic device 100 by performing communication with the electronic device 100 using wired or wireless communication technology. The wireless communication technology may include short-range communication technology. The short-range communication technology may include, for example, Bluetooth communication, Wi-Fi communication, infrared communication, etc.
[0099] Memory 220 can store a program for processing and controlling the processor 230, and can store data input to or output from the content providing device 200. In addition, memory 220 can store data necessary for the operation of the content providing device 200.
[0100] The memory 220 may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.
[0101] Processor 230 controls the overall operation of content providing device 200. For example, processor 230 may perform functions of content providing device 200 described in the present disclosure by executing one or more instructions stored in memory 220.
[0102] In an embodiment of the present disclosure, the processor 230 may store one or more instructions in an internally provided memory, and may control the operations of the content providing device 200 to be performed by executing one or more instructions stored in the internally provided memory. That is, the processor 230 may perform a predetermined operation by executing at least one instruction or program stored in an internal memory provided within the processor 230 or in the memory 220.
[0103] According to one embodiment, the processor 230 may execute one or more instructions stored in the memory 220 to execute a content application and transmit an execution result screen to the electronic device 100.
[0104] The content providing device 200 may be any type of device that performs a function, including a processor and memory. For example, the content providing device 200 may include various types of electronic devices capable of providing content by executing a content application, such as computers such as desktops, laptops, and tablets, various smart devices such as smartphones, cellular phones, game players, music players, video players, medical equipment, and home appliances. In terms of providing content, the content providing device 200 may also be referred to as a source device, or may also be referred to as an electronic device, a computing device, etc.
[0105] The block diagram of the content providing device 200 illustrated in FIG. 2 is a block diagram for one embodiment. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the content providing device 200 actually implemented. For example, two or more components may be combined into a single component, or one component may be subdivided into two or more components, as needed. Furthermore, the functions performed by each block are intended to illustrate embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.
[0106] Now let's describe server device 300.
[0107] The server device 300 can connect to the electronic device 100 using wired or wireless communication technology and provide content to the electronic device 100. The server device 300 can execute a content application at the request of the electronic device 100 and transmit an execution result screen or an execution result image to the electronic device 100. In addition, the server device 300 can receive an input signal for controlling the content application from the electronic device 100. The content providing device 100 can execute the content application based on the input signal and transmit an execution result screen or an execution result image to the electronic device 100.
[0108] The server device 300 may include various types of electronic devices capable of providing content to the electronic device 100. The server device 300 may be referred to as a source device in terms of providing content, and may also be referred to as a host device, a content providing device, an electronic device, a storage device, a computing device, a server computer, etc.
[0109] The server device 300 may include a communication interface 310, memory 320, and a processor 330. However, the server device 300 may be implemented with more components than those illustrated, and is not limited to the examples described above. For example, the server device 300 may include a separate image processing unit for image processing of application images executed on the server device 300.
[0110] The communication interface 310 may include one or more modules that enable wireless communication between the server device 300 and the electronic device 100. In one embodiment, the communication interface 310 may communicate with the electronic device 100 according to an Internet protocol. In one embodiment, the communication interface 310 may communicate with the input device 400 according to an Internet protocol.
[0111] The memory 320 can store a program for processing and controlling the processor 330, and can store data input to or output from the server device 300.
[0112] The memory 320 may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.
[0113] The processor 330 controls the overall operation of the server device 300. For example, the processor 330 may perform the functions of the server device 300 described in the present disclosure by executing one or more instructions stored in the memory 320.
[0114] In an embodiment of the present disclosure, the processor 330 can store one or more instructions in an internally provided memory, and control the execution of the one or more instructions stored in the internally provided memory so that the aforementioned operations are performed. That is, the processor 330 can perform a predetermined operation by executing at least one instruction or program stored in an internal memory provided within the processor 330 or in the memory 320.
[0115] According to one embodiment, the processor 330 may receive a request to execute a content application from the electronic device 100 by executing one or more instructions stored in the memory 320, and transmit an execution result screen of the requested content application to the electronic device 100.
[0116] The block diagram of the server device 300 illustrated in FIG. 2 is a block diagram for one embodiment. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the server device 300 actually implemented. For example, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are for the purpose of explaining embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.
[0117] Now let's describe input device 50.
[0118] The input device 50 may include a communication interface 51, a user input portion 52, memory 53, and a processor 54. However, the input device 50 may be implemented by more components than the illustrated components and is not limited to the examples described above.
[0119] The communication interface 51 may include one or more modules that enable wired or wireless communication between the input device 50 and the electronic device 100. According to one embodiment, the communication interface 51 may communicate with the electronic device 100 using a short-range communication technology. The short-range communication technology may include, for example, Bluetooth communication, Wi-Fi communication, infrared communication, etc. According to one embodiment, the communication interface 51 may communicate with the server device 300 using an Internet protocol.
[0120] The user input unit 52 may be any form of interface means capable of receiving user input. For example, the user input unit 52 may include an operation button arranged on a part of the input device 50 capable of receiving user input, a touch-sensitive display configured to detect touch input, a microphone capable of receiving user voice input, etc.
[0121] According to one embodiment, the user input unit 52 may receive user input for controlling a game content execution result screen displayed on the display of the electronic device 100 based on the control of the processor 54.
[0122] Memory 53 can store a program for processing and controlling the processor 54, and can store data input to or output from the input device 50.
[0123] The memory 53 may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.
[0124] Processor 54 controls the overall operation of input device 40. For example, processor 54 may perform the functions of input device 50 described in the present disclosure by executing one or more instructions stored in memory 53.
[0125] In an embodiment of the present disclosure, the processor 54 can store one or more instructions in an internally provided memory, and control the execution of one or more instructions stored in the internally provided memory so that the aforementioned operations are performed. That is, the processor 54 can perform a predetermined operation by executing at least one instruction or program stored in an internal memory provided within the processor 54 or in the memory 54.
[0126] According to one embodiment, the processor 54 may perform a communication connection with the electronic device 100 using a short-range wireless communication technology by executing one or more instructions stored in the memory 53. The short-range wireless communication technology may include Bluetooth communication technology, Wi-Fi Direct technology, infrared communication technology, and the like.
[0127] According to one embodiment, the processor 54 may control the communication interface 51 to transmit a control signal corresponding to a user input received through the user input unit 52 to the electronic device 100 by executing one or more instructions stored in the memory 53.
[0128] The input device 50 may be any type of device that performs a function, including a processor and memory. The input device 50 may include various electronic devices, such as a remote controller, a game controller, or a smartphone.
[0129] Meanwhile, the block diagram of the input device 50 illustrated in FIG. 2 is a block diagram for one embodiment. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the input device 50 actually implemented. For example, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are for the purpose of explaining embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.
[0130] FIG. 3 is an example of a block diagram of an electronic device according to one embodiment.
[0131] Referring to FIG. 3, the electronic device 100 may include, in addition to a communication interface 110, a display 120, a memory 130, and a processor 140, an image processing unit 150, an audio processing unit 160, an audio output unit 170, a receiving unit 180, and a detection unit 190.
[0132] The communication interface 110 may include one or more modules that enable wireless communication between the electronic device 100 and a wireless communication system or between the electronic device 100 and a network in which another electronic device is located. For example, the communication interface 110 may include a mobile communication module 111, a wireless Internet module 112, and a short-range communication module 113.
[0133] The mobile communication module 111 transmits and receives wireless signals with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signals may include various types of data, such as voice call signals, video call signals, or text / multimedia message transmission and reception.
[0134] The wireless Internet module 112 refers to a module for wireless Internet access, which may be built into or external to the device. Wireless Internet technologies that may be used include WLAN (Wireless LAN) (WiFi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), and HSDPA (High Speed Downlink Packet Access). Through the wireless Internet module 112, the electronic device 100 can establish a Wi-Fi P2P (Peer to Peer) connection with other devices.
[0135] Short-range communication module 113 refers to a module for short-range communication. Short-range communication technologies that can be used include Bluetooth, BLE (Bluetooth Low Energy), RFID (Radio Frequency Identification), IrDA (Infrared Data Association), UWB (Ultra Wideband), and ZigBee.
[0136] The display 120 can display a video signal received from the server device 300 on the screen.
[0137] Memory 130 can store programs related to the operation of the electronic device 100 and various data generated during the operation of the electronic device 100.
[0138] Memory 130 can store at least one instruction. Furthermore, memory 130 can store at least one program executed by processor 150. Furthermore, memory 130 can store an application for providing a specific service.
[0139] Specifically, the memory 130 may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.
[0140] The processor 140 controls the overall operation of the electronic device 100. For example, the processor 140 may perform the functions of the electronic device 100 described in the present disclosure by executing one or more instructions stored in the memory 130.
[0141] In an embodiment of the present disclosure, the processor 140 can store one or more instructions in an internally provided memory, and control the execution of operations of the display device by executing one or more instructions stored in the internally provided memory. That is, the processor 140 can perform a predetermined operation by executing at least one instruction or program stored in the internal memory or memory 130 provided within the processor 140.
[0142] The processor 140 controls the overall operation of the electronic device 100 and the signal flow between internal components (not shown) of the electronic device 100, and performs the function of processing data. When there is a user input or a preset and stored condition is satisfied, the processor 140 can execute the OS (Operating System) stored in the memory 130 and various applications.
[0143] Processor 140 may include a graphic processor (Graphic Processing Unit) for graphics processing corresponding to video. The graphic processor generates a screen including various objects such as icons, images, and text using a calculation unit and a rendering unit. The calculation unit uses user interactions detected by the detection unit to calculate attribute values such as coordinate values, shape, size, and color for each object to be displayed according to the screen layout. The rendering unit generates a screen including various layouts of objects based on the attribute values calculated by the calculation unit.
[0144] Processor 140 may include various processing circuits and / or multiple processors. For example, the term “processor” as used herein, including in the claims, may include various processing circuits, including at least one processor. At least one processor, one or more processors may be configured to perform various functions described herein, individually and / or collectively, in a distributed fashion. As used herein, a processor, at least one processor, or more than one processor may be configured to perform multiple functions. However, these terms encompass, for example, but not limited to, situations where one processor performs some of the functions and other processor(s) perform other parts of the functions, and situations where a single processor may perform all of the functions. Furthermore, at least one processor may include a combination of processors that perform various of the functions described in a distributed manner. At least one processor may execute program instructions to achieve or perform various functions.
[0145] The image processing unit 150 can process an image signal received from the receiving unit 110 or the communication interface 120 and output it to the display 130 under the control of the processor 140.
[0146] The audio processing unit 160 can convert an audio signal received from the receiving unit 110 or the communication interface 120 into an analog audio signal and output it to the audio output unit 180 under the control of the processor 140.
[0147] The audio output unit 170 can output audio (e.g., voice, sound) input through the communication interface 110 or the receiver 180. In addition, the audio output unit 170 can output audio stored in the memory 130 under the control of the processor 140. The audio output unit 170 can include at least one of a speaker, a headphone output terminal, or an S / PDIF (Sony / Philips Digital Interface:) output terminal, or a combination thereof.
[0148] The receiving unit 180 can receive video (e.g., moving images, etc.), audio (e.g., voice, music, etc.), and additional information (e.g., EPG, etc.) from the outside of the electronic device 100 under the control of the processor 140. The receiving unit 180 may include one of an HDMI port (High-Definition Multimedia Interface port, 181), a component jack (component jack, 182), a PC port (PC port, 183), and a USB port (USB port, 184), or a combination of one or more thereof. In addition to the HDMI port, the receiving unit 180 may further include a DisplayPort (DP), Thunderbolt, or MHL (Mobile High-Definition Link).
[0149] The detection unit 190 detects the user's voice, the user's image, or the user's interaction, and may include a microphone 191, a camera 192, and an optical receiving unit 193.
[0150] Microphone 191 receives the user's spoken voice. Microphone 191 can convert the received voice into an electrical signal and output it to processor 140. The user's voice may include, for example, a voice corresponding to a menu or function of electronic device 100.
[0151] Camera 192 can receive images (e.g., consecutive frames) corresponding to a user's motion, including a gesture, within the camera's recognition range. Processor 140 can use the recognition results of the received motion to select a menu displayed on the electronic device 100 or perform a control corresponding to the motion recognition results.
[0152] The optical receiver 193 receives an optical signal (including a control signal) from an external control device. The optical receiver 193 can receive an optical signal corresponding to a user input (e.g., touch, pressing, touch gesture, voice, or motion) from the control device. A control signal can be extracted from the received optical signal under the control of the processor 140.
[0153] FIG. 4 illustrates a functional block diagram of a picture / sound quality processing module that processes picture and / or sound quality according to the characteristics of a scene of content according to one embodiment. The picture / sound quality processing module illustrated in FIG. 4 is a block diagram from a functional perspective that can perform operations based on one or more of the components of the electronic device 100 illustrated in FIG. 3.
[0154] Referring to FIG. 4, the image quality / sound quality processing module 400 may include a representative genre processing module 410 that enables image quality / sound quality settings based on a representative genre identified in the content being played, a partial genre processing module 420 that enables image quality / sound quality settings based on a partial genre identified in the content being played, and a image quality / sound quality processing module 430 that processes image quality and / or sound quality based on an output of the representative genre processing module 410 or an output of the partial genre processing module 420.
[0155] The representative genre processing module 410 may include a representative genre identification module 411, a picture / audio quality control parameter value acquisition module 412, and a genre-specific picture / audio quality control parameter value information storage module 500.
[0156] The representative genre identification module 411 may include suitable logic, circuitry, interfaces and / or codes operable to identify a representative genre of the content being played and provide information about the identified representative genre to the picture / audio quality control parameter value acquisition module 412.
[0157] According to one embodiment, the representative genre identification module 411 can obtain information about the representative genre of the content from the metadata of the content by obtaining the metadata of the content being played. For example, a content creator or content provider can provide the representative genre of the content by including it in the metadata of the content. Accordingly, the representative genre identification module 411 can identify the representative genre of the content based on the metadata of the content. For example, when the electronic device 100 receives content from the server device 300, the electronic device 100 can receive metadata about the content from the server device 300.
[0158] According to one embodiment, the representative genre identification module 411 may obtain information about the representative genre of the content by obtaining identification information, such as the title of the content, from a frame of the content being played. For example, when the electronic device 100 receives content from the content providing device 200, the electronic device 100 may not be able to receive metadata of the content from the content providing device 200. In this case, the representative genre identification module 411 may obtain content identification information, such as the title of the content, by analyzing the content of the screen output based on the content received from the content providing device 200. In addition, the representative genre identification module 411 may obtain the representative genre of the content corresponding to the content identification information.
[0159] The image quality control parameter value acquisition module 412 may include appropriate logic, circuits, interfaces and / or codes that can be operated to acquire image quality control parameter values corresponding to the representative genre received from the representative genre identification module 411 by referring to the genre-specific image quality control parameter value information storage module 500 as illustrated in FIG. 5.
[0160] FIG. 5 illustrates an example of a genre-specific picture and sound quality control parameter value information storage module according to one embodiment.
[0161] The genre-specific picture and sound quality control parameter value information storage module 500 can store parameter value information for setting picture and sound quality for each genre of multiple content genres.
[0162] Referring to FIG. 5, the genre-specific picture / audio quality control parameter value information storage module 500 can store a table corresponding to a representative genre of the content. For example, if the total number of multiple genres of the content is 4, including a first genre, a second genre, a third genre, and a fourth genre, the first table 510 corresponding to a case where the representative genre is the first genre, a second table 520 corresponding to a case where the representative genre is the second genre, a third table 530 corresponding to a case where the representative genre is the third genre, and a fourth table 540 corresponding to a case where the representative genre is the fourth genre can be included.
[0163] Each table may include image quality control parameters and sound quality control parameters corresponding to each genre. Image quality control parameters may be referred to as image quality adjustment parameters to obtain the desired image quality by adjusting the details, clarity, color, contrast, etc. of the image. For example, image quality control parameters may include one or more of brightness, which adjusts the overall brightness of the image; contrast, which adjusts the difference between dark and light areas by adjusting the contrast of the image; sharpness, which adjusts the sharpness of the image, where high sharpness makes the image look sharper and low sharpness makes the image look softer; color, which adjusts the main color tone of the image; and saturation, which adjusts the saturation of the image to change the vividness of the color. Sound quality control parameters may be referred to as sound quality adjustment parameters to obtain the desired sound by adjusting the sound quality of the audio.Sound quality control parameters may include, for example, one or more of an Equalizer that adjusts sound quality by emphasizing or suppressing specific frequency bands of a music or audio signal; a Balance that adjusts the volume balance between the left and right channels in a stereo audio system; a Tone Control that adjusts the pitch of bass and treble; a Reverb and Echo that are used to add attenuated reflections to an audio signal to create a spatial effect; a Gain that is used to adjust the input level of a music or audio signal to prevent excessive distortion or to output the signal higher or lower; and an Ambience Effect that adds Compression, Reverb, Chorus, Phaser, and other effects that are used to control the dynamic range of an audio signal to create a spatial effect or texture to an audio signal.
[0164] Referring to FIG. 5, the image quality control parameter may include one or more parameters, for example, a first parameter, a second parameter, and a third parameter. The sound quality control parameter may include one or more parameters, for example, a fourth parameter, and a fifth parameter.
[0165] For example, the first table 510 indicates that, in response to the first genre, which is a representative genre, the first parameter for setting the picture quality is set to the first value, the second parameter is set to the second value, the third parameter is set to the third value, the fourth parameter for setting the sound quality is set to the fourth value, and the fifth parameter is set to the fifth value. In addition, in a situation where the representative genre is the first genre, the electronic device 100 can refer to the first table 510. In this case, when the second genre is identified as a partial genre, for example, the first table 510 indicates that the first parameter can be weighted as w1, the second parameter can be weighted as w4, and the third parameter can be weighted as w7 for changing or updating the picture quality setting, and the fourth parameter can be weighted as w10, and the fifth parameter can be weighted as w13 for changing or updating the sound quality setting. The weight corresponding to each partial genre may represent an offset value that can be varied based on the representative genre. That is, when the representative genre is the first genre, the first parameter among the image quality control parameters is initially set to the first value, and when the second genre is identified as the partial genre, the first parameter among the image quality control parameters may be set to the first value + w1. The weight may represent a value added to each parameter value, and may be determined within a predetermined range for each parameter. For example, the weights w1, w2, and w3 of the first parameter may have values between -5 and +5, and, for example, the weights w4, w5, and w6 of the second parameter may have values between -3 and +4.
[0166] Returning to FIG. 4 again, the image quality / audio quality control parameter value acquisition module 412 can obtain image quality / audio quality control parameter values corresponding to a representative genre by referring to the genre-specific image quality / audio quality control parameter value information storage module 500, and provide the obtained image quality / audio quality control parameter values to the image quality / audio quality processing module 430.
[0167] The image quality / audio quality processing module 430 may include an image quality processing module 431 and an audio quality processing module 432.
[0168] The image quality processing module 431 may include suitable logic, circuitry, interfaces and / or code operable to process image quality by setting image quality control parameters based on received image quality control parameter values.
[0169] The image quality control parameters may include, for example, one or more of a brightness parameter that controls the overall brightness of an image, a contrast parameter that controls the difference between dark and bright areas by adjusting the contrast of the image, a sharpness parameter that controls the sharpness of the image, a color parameter that is used to control the main color tone of the image, and a saturation parameter that enables changing the vividness of color by adjusting the saturation of the image. The image quality processing module 431 may control the image quality by setting one or more of the above image quality control parameters based on the received image quality control parameter values.
[0170] The sound quality processing module 432 may include suitable logic, circuitry, interfaces and / or code operable to process sound quality by setting sound quality control parameters based on received sound quality control parameter values.
[0171] Sound quality control parameters may include, for example, one or more of the following: an Equalizer parameter that adjusts sound quality by emphasizing or suppressing specific frequency bands of a music or audio signal; a Balance parameter that adjusts the volume balance between the left and right channels in a stereo audio system; a Tone Control parameter that adjusts the tonality of bass and treble; Reverb and Echo parameters that are used to add attenuated reflections to an audio signal to create a spatial effect; a Gain parameter that is used to adjust the input level of a music or audio signal to prevent excessive distortion or to output the signal higher or lower; and Ambience Effects parameters that add Compression, Reverb, Chorus, Phaser and other effects that are used to control the dynamic range of an audio signal to create a spatial effect or texture to an audio signal.
[0172] The sound quality processing module 432 can control the sound quality by setting one or more sound quality control parameters as described above based on the received sound quality control parameter values.
[0173] The partial genre processing module 420 may include a scene analysis module 421, a weight acquisition module 422, and a genre-specific picture / audio quality control parameter value information storage module 500.
[0174] The scene analysis module 421 may include suitable logic, circuitry, interfaces and / or code operable to analyze a scene corresponding to at least a portion of content played on the electronic device 100 to identify a partial genre of the content and provide information about the identified partial genre to the weight acquisition module 422. The scene corresponding to at least a portion of the content may include video data and audio data.
[0175] The scene analysis module 421 can analyze one or more video frames corresponding to at least a portion of the content being played on the electronic device 100.
[0176] The scene analysis module 421 can analyze audio frequencies corresponding to at least a portion of the content played on the electronic device 100.
[0177] The weight acquisition module 422 may include appropriate logic, circuits, interfaces and / or codes that can be operated to acquire weights for setting image quality corresponding to the partial genre received from the scene analysis module 422 by referring to the genre-specific image quality control parameter value information storage module 500.
[0178] For example, referring to FIG. 5, in a situation where the representative genre is the first genre and the partial genre is identified as the third genre, the weight acquisition module 422 can acquire weight values w2, w5, w8, w11, and w14 corresponding to the third genre from the first table 510 where the representative genre is the first genre.
[0179] And the weight acquisition module 422 can provide the weight corresponding to the acquired partial genre to the image / sound quality processing module 430.
[0180] The image quality / audio quality processing module 430 may include an image quality processing module 431 and an audio quality processing module 432.
[0181] The image quality processing module 431 may include suitable logic, circuitry, interfaces and / or code operable to process image quality by setting image quality control parameters based on received image quality control parameter values.
[0182] The sound quality processing module 432 may include suitable logic, circuitry, interfaces and / or code operable to process sound quality by setting sound quality control parameters based on received sound quality control parameter values.
[0183] FIG. 6 illustrates an example of a flowchart of a method of operating an electronic device according to one embodiment.
[0184] Referring to FIG. 6, in operation 610, the electronic device 100 can identify a representative genre of the content based on information about the content.
[0185] According to one embodiment, an electronic device 100 may identify a representative genre of content based on content metadata, which is information about the content being played. The content metadata may include various information related to the content. For example, if the content is game content, the content metadata may include information such as a content title, a content ID, or a genre. For example, if the electronic device 100 receives and displays game content from a server device 300, the electronic device 100 may receive metadata about the game content from the server device 300. The electronic device 100 may obtain genre information about the game content from the metadata about the game content. The electronic device 100 may also obtain genre information about the game content based on the game content title included in the metadata. The electronic device 100 may identify the genre information about the game content obtained in this way as a representative genre of the content.
[0186] According to one embodiment, the electronic device 100 may obtain content identification information or a title of the content by analyzing a content screen displayed on a display as information about the content being played, and may identify a representative genre of the content based on such content identification information or the title of the content. For example, when the electronic device 100 receives content from a content providing device 200, it may be difficult to obtain content metadata. In this case, the electronic device 100 may obtain content identification information or a title of the content by analyzing the content screen received from the content providing device 200, and may identify a representative genre of the content based on such content identification information or the title of the content. A method for identifying a representative genre of the content by analyzing the content screen will be described in detail with reference to FIG. 7.
[0187] In operation 620, the electronic device 100 can provide a primary audiovisual effect to the content by processing at least one of video quality or audio quality for playback of the content based on the representative genre identified in operation 610.
[0188] According to one embodiment, the electronic device 100 may provide primary audiovisual effects to content by processing video quality for content playback based on the identified representative genre. For example, the quality processing may be performed to enhance or improve the quality of video data, and may include at least one of color enhancement, brightness enhancement, contrast processing, and RGB correction. However, the quality processing method performed by the electronic device 100 is not limited to the described examples.
[0189] According to one embodiment, the electronic device 100 may obtain one or more picture quality control parameters corresponding to a representative genre, and process video quality for playback of the content based on the one or more picture quality control parameters, thereby providing a primary audio visual effect to the content. For example, the electronic device 100 may obtain one or more picture quality control parameters corresponding to the representative genre using the genre-specific picture quality sound quality control parameter value information storage module 500 illustrated in FIG. 5. For example, when the representative genre is identified as a first genre, the electronic device 100 may obtain first, second, and third values of the picture quality control parameters corresponding to the first genre from the first table 510 corresponding to the first genre in the information storage module 500.
[0190] According to one embodiment, the electronic device 100 can provide primary audiovisual effects to content by processing audio quality for content playback based on the identified representative genre. The audio quality processing is intended to enhance or improve the audio quality of audio data. For example, in the sports genre, effects can be applied to highlight sounds such as crowd noise or player movements, such as the sound of a player kicking a ball in the case of soccer, thereby enhancing audio quality appropriate for a sports environment.
[0191] According to one embodiment, the electronic device 100 may obtain one or more sound quality control parameters corresponding to a representative genre, and process audio quality for playback of the content based on the one or more sound quality control parameters, thereby providing a primary audio visual effect to the content. For example, the electronic device 100 may obtain one or more sound quality control parameters corresponding to the representative genre using the genre-specific image quality sound quality control parameter value information storage module 500 illustrated in FIG. 5. For example, when the representative genre is identified as a first genre, the electronic device 100 may obtain the fourth and fifth values of the sound quality control parameters corresponding to the first genre from the first table 510 corresponding to the first genre in the genre-specific image quality sound quality control parameter value information storage module 500.
[0192] According to one embodiment, the electronic device 100 can provide primary audiovisual effects to content by processing video quality and audio quality for playback of the content based on the identified representative genre.
[0193] According to one embodiment, the electronic device 100 may obtain one or more picture quality control parameters and one or more sound quality control parameters corresponding to a representative genre, and process video quality and audio quality for playback of the content based on the picture quality control parameters and the one or more sound quality control parameters, thereby providing a primary audio visual effect to the content. For example, the electronic device 100 may obtain one or more picture quality control parameters and one or more sound quality control parameters corresponding to the representative genre using the genre-specific picture quality and sound quality control parameter value information storage module 500 illustrated in FIG. 5. For example, when the representative genre is identified as a first genre, the electronic device 100 may obtain first, second, and third values of picture quality control parameters and fourth and fifth values of sound quality control parameters corresponding to the first genre from the genre-specific picture quality and sound quality control parameter value information storage module 500, corresponding to the first genre.
[0194] In operation 630, the electronic device 100 may identify a partial genre of the content based on analysis of a scene including one or more video frames and / or audio frequencies corresponding to at least a portion of the content being played.
[0195] In operation 620, the electronic device 100 provides a primary audiovisual effect corresponding to the representative genre of the content, thereby performing video quality processing and audio quality processing for the content in a manner appropriate to the main characteristics of the content. However, even a single content may include various characteristics. For example, in the case of game content whose representative genre is identified as RPG, at least a portion of the game content may include scenes with characteristics such as FPS or sports. Accordingly, the electronic device 100 initially performs quality processing based on the representative genre of RPG, and then detects scenes that are distinct from the representative genre, that is, scenes that can be classified as partial genres, and performs quality processing appropriate to the characteristics of the partial genre for the scenes that can be classified as partial genres, thereby actively providing quality and audio effects more appropriate to the characteristics of the content. To this end, the electronic device 100 may identify the partial genre of the content by analyzing a scene that includes one or more video frames and / or audio frequencies corresponding to at least a portion of the content being played.
[0196] According to one embodiment, the electronic device 100 can identify a partial genre of content by analyzing at least one of brightness, saturation, contrast ratio, sharpness, or number of objects of a screen of a scene including one or more video frames of the content being played. The electronic device 100 can analyze video frames from a current streaming time to a specific time in the past. For example, if the electronic device 100 analyzes a scene including one or more video frames and identifies that the scene corresponds to one of a plurality of predetermined genres, the electronic device 100 can determine the identified genre as a partial genre.
[0197] In one embodiment, the range or type of genre types used to determine a partial genre may be the same as or different from the range or type of genre types used to determine a representative genre. For example, if the representative genre is determined from among five predetermined genre types, the type of the partial genre may include the same five genre types. Alternatively, if the representative genre is determined from among five predetermined genre types, the type of the partial genre may include ten genre types, which is more than the range or type of the representative genre.
[0198] In one embodiment, when a game content provider provides information about a representative genre of the game content and one or more genres to which the game content belongs, the electronic device 100 may set one or more genres provided by the game content provider as a range of partial genres and identify partial genres within this range. For example, when a game content provider provides genre information for a certain game content as belonging to four genres, such as RPG, RTS, FPS, and sports, and setting the representative genre as RPG, the electronic device 100 may identify the representative genre of the game content as RPG and determine the partial genre of the game content from among RPG, RTS, FPS, and sports.
[0199] According to one embodiment, the electronic device 100 can identify characteristics of an audio scene by analyzing audio frequencies of content being played. The characteristics of the audio scene may include, for example, effects, sports (crowd), music, speech, racing, etc. The electronic device 100 can analyze frequencies of audio frames from the current streaming time to a specific time in the past. The electronic device 100 can identify a partial genre based on the results of analyzing the audio frequencies of the content being played in this way.
[0200] According to one embodiment, the electronic device 100 may identify a partial genre of content based on analysis of a scene including one or more video frames and audio frequencies corresponding to at least a portion of the content being played. For example, if the partial genre identified as a result of analyzing the video frames is identical to the partial genre identified as a result of analyzing the audio frequencies, the identically identified partial genre may be determined as the partial genre of the scene.
[0201] In one embodiment, if the sub-genre identified as a result of analyzing a video frame differs from the sub-genre identified as a result of analyzing audio frequencies, the sub-genre may be determined based on information about the representative genre. For example, if the sub-genre identified as RPG based on the video frame analysis and the sub-genre identified as Fighting based on the audio frequency analysis, then either RPG or Fighting may be determined as the sub-genre based on the representative genre.
[0202] In one embodiment, if the sub-genre identified as a result of analyzing a video frame is different from the sub-genre identified as a result of analyzing an audio frequency, the sub-genre may be determined based on more meaningful result information. For example, if the probability that the sub-genre is identified as RPG according to the video frame analysis is 80% and the probability that the sub-genre is identified as Fighting according to the audio frequency analysis is 30%, the electronic device 100 may determine RPG as the sub-genre with the higher probability value.
[0203] In one embodiment, if the sub-genre identified as a result of analyzing a video frame is different from the sub-genre identified as a result of analyzing an audio frequency, instead of determining a single sub-genre, two sub-genres may be used separately. The weight of the image quality control parameter corresponding to the sub-genre identified as a result of analyzing a video frame and the weight of the sound quality control parameter corresponding to the sub-genre identified as a result of analyzing an audio frequency may be separately obtained. For example, if the sub-genre according to the video frame analysis is RPG and the sub-genre according to the audio frequency analysis is Fighting, the weight of the image quality control parameter may be obtained corresponding to the RPG sub-genre, and the weight of the sound quality control parameter may be obtained corresponding to the Fighting sub-genre.
[0204] At operation 640, the electronic device 100 can provide secondary audiovisual effects to the content by weighting the primary audiovisual effects based on the identified partial genre.
[0205] According to one embodiment, the electronic device 100 may provide a secondary audiovisual effect to content by weighting one or more picture quality control parameter values and / or one or more sound quality control parameter values set for picture quality processing based on a primary audiovisual effect, i.e., a representative genre.
[0206] According to one embodiment, the electronic device 100 may provide secondary audiovisual effects to content by weighting one or more quality control parameter values set for quality processing based on the primary audiovisual effect, i.e., the representative genre.
[0207] According to one embodiment, the electronic device 100 may obtain weights of one or more picture quality control parameters corresponding to a partial genre, and process video quality for playback of the content based on the weights of the one or more picture quality control parameters, thereby providing secondary audio visual effects to the content. For example, the electronic device 100 may obtain one or more weights corresponding to the partial genre using the genre-specific picture quality and sound quality control parameter value information storage module 500 illustrated in FIG. 5. For example, when the partial genre is identified as a second genre, the electronic device 100 may obtain weights w1, w4, and w7 corresponding to the picture quality control parameters corresponding to the second genre from the first table 510 in the genre-specific picture quality and sound quality control parameter value information storage module 500.
[0208] According to one embodiment, the electronic device 100 may obtain weights of one or more sound quality control parameters corresponding to a partial genre, and process audio quality for playback of the content based on the weights of the one or more sound quality control parameters, thereby providing secondary audio visual effects to the content. For example, the electronic device 100 may obtain one or more weights corresponding to the partial genre using the genre-specific picture quality control parameter value information storage module 500 as illustrated in FIG. 5. For example, when the partial genre is identified as a second genre, the electronic device 100 may obtain weights w10 and w13 corresponding to the sound quality control parameters corresponding to the second genre from the first table 510 in the information 500.
[0209] According to one embodiment, the electronic device 100 may obtain weights of one or more picture quality control parameters and sound quality control parameters corresponding to a partial genre, and process video quality and audio quality for playback of the content based on the weights of the one or more picture quality control parameters and sound quality control parameters, thereby providing secondary audio visual effects to the content. For example, the electronic device 100 may obtain one or more weights corresponding to the partial genre using the genre-specific picture quality and sound quality control parameter value information storage module 500 as illustrated in FIG. 5. For example, when the partial genre is identified as a second genre, the electronic device 100 may obtain weights w1, w4, and w7 corresponding to the picture quality control parameters corresponding to the second genre and weights w10 and w13 corresponding to the sound quality control parameters from the first table 510 in the information 500.
[0210] FIG. 7 illustrates an example of a method of operating an electronic device according to one embodiment.
[0211] Referring to FIG. 7, in operation 701, the electronic device 100 may communicate with the content providing device 200. According to one embodiment, the electronic device 100 may communicate with the content providing device 200 through an HDMI port.
[0212] In operation 702, the electronic device 100 may receive an information signal from the content providing device 200. For example, the electronic device 100 may receive information signals such as VRR, ALLM, and content type from a game console or PC connected to an HDMI port.
[0213] VRR (Variable Refresh Rate) can refer to information indicating a technology that synchronizes the frame rate (fps) of a game with the refresh rate (Hz) of a monitor, synonymous with variable refresh rate, variable screen refresh rate, or variable refresh rate. For example, if the content provider 200 is a PC, VRR output settings are possible for each graphics card vendor, and the electronic device 100 can receive a VRR signal from the content provider 200 according to these output settings.
[0214] ALLM stands for Auto Low Latency Mode and can refer to a technology that reduces the delay time that occurs between controller input and in-game output. Supporting ALLM reduces input delay and creates a smooth screen, enabling smooth game play without screen tearing. When connected based on HDMI 2.1, the electronic device 100 can receive ALLM information signals from the content provider 200.
[0215] If the content providing device 200 is a game console, the content providing device 200 can continuously send at least one of the information signals such as ALLM, VRR, Contents type (Video / Game), etc. to the electronic device 100 depending on whether game content is played.
[0216] In operation 703, the electronic device 100 can recognize that the game content play has started based on an information signal. The electronic device 100 can recognize that the game content play has started based on at least one of the information signals received from the content providing device 200, for example, signals such as ALLM, VRR, or Content type. That is, when the electronic device 100 receives at least one of the signals such as ALLM, VRR, or Content type (Video / Game) from the content providing device 200, the electronic device 100 can recognize that the game content play has started. Similarly, when the electronic device 100 ends providing at least one of the signals such as ALLM, VRR, or Content type (Video / Game) received from the content providing device 200, the electronic device 100 can recognize that the game content play has ended. When recognizing that the game content play has started in this way, the electronic device 100 can prepare to identify a representative genre by analyzing a content frame image received from the content providing device 200.
[0217] In operation 704, when the content providing device 200 starts transmitting the content frame, the electronic device 100 can receive the content frame image.
[0218] In operation 705, the electronic device 100 can detect a representative genre based on a content frame image received from the content providing device 200.
[0219] According to one embodiment, the electronic device 100 may recognize attribute information of running game content based on a content capture screen input to a pre-trained neural network model using deep learning, and recognize a representative genre based on this. The neural network model may include a model trained to detect text regions from video screens by receiving multiple video screens as training data. An algorithm or a set of algorithms for implementing AI technology is called a neural network. Here, the neural network may receive input data, analyze the input data, and output desired result data. In this way, in order for the neural network to accurately output result data corresponding to the input data, the neural network needs to be trained. Here, 'training' may mean inputting various data into the neural network, and training the neural network so that the neural network can discover or acquire on its own a method for analyzing the input data, a method for classifying the input data, and / or a method for extracting features necessary for generating result data from the input data. Here, 'training' may be expressed as 'learning' or 'training.' In addition, a set of algorithms that output output data corresponding to input data through the aforementioned neural network, software that executes the set of algorithms, and / or hardware that executes the set of algorithms may be referred to as an 'AI model' (or 'artificial intelligence model'). AI models can exist in a wide variety of forms. Specifically, there may exist various AI models that receive an image as input, analyze the input image, and perform an action of classifying the gestures of objects included in the image into at least one category. The AI model may include at least one neural network.
[0220] For example, methods for performing object recognition, object tracking, and / or object discrimination, etc., using artificial intelligence (AI) technology that performs operations through neural networks, are being developed and utilized. For convenience of explanation, operations for performing object recognition, object tracking, and object discrimination, etc., to recognize specific image objects by analyzing images are collectively referred to as "object recognition." For example, the neural network may be a deep neural network (DNN) that includes multiple layers and performs multi-stage operations. In addition, deep neural network (DNN) operations may include convolutional neural network (CNN) operations, etc. Specifically, a data recognition model for object recognition can be implemented through the exemplified neural network, and the implemented recognition model can be trained using training data. Then, input data, for example, a received image, can be analyzed using the trained data recognition model, and an object can be recognized in the input image and the recognized object can be output as output data. Additionally, convolutional neural networks (CNNs) are a general term for neural networks that perform algorithms to analyze images and find patterns, and can come in many different types and forms.
[0221] According to one embodiment, the electronic device 100 may input a video screen into a neural network model for analysis, thereby extracting a text region from the video screen and obtaining content attribute information based on the text region. The content attribute information may include information regarding the representative genre of the content.
[0222] According to one embodiment, the electronic device 100 can obtain attribute information of content by transmitting text extracted from a text area to a text server and receiving attribute information of content related to the text from the server.
[0223] FIG. 8 is a reference diagram for explaining a method of recognizing content by analyzing a content video screen in an electronic device according to one embodiment.
[0224] Referring to FIG. 8, in operation 810, the electronic device 100 may analyze a content video screen using a neural network model. The neural network model is a neural network used to detect one or more objects from an input image, and may include, for example, two-stage methods such as Faster R-CNN, R_FCN [Region-based Fully Convolutional Networks], and FPN-FRCN, or single-stage methods such as YOLO, SSD [Single Shot Multibox Detector], and RetinaNet. According to one embodiment, the neural network model may include an object detection model 800 that detects an object including text from an input screen by learning a plurality of input images including text.
[0225] The object detection model 800 can detect one or more objects from an input image using one or more neural networks, and output object information including an object class and an object location corresponding to one or more detected objects.
[0226] Object detection involves determining where objects are located in a given image (object localization) and determining which category each object belongs to (object classification). Therefore, object detection models typically involve three steps: selecting candidate object regions (informative region selection), extracting features from each candidate region (feature extraction), and applying a classifier to the extracted features to classify the object candidate regions (classification). Depending on the detection method, post-processing, such as bounding box regression, can improve localization performance.
[0227] Referring to Fig. 8, the network structure of R-CNN, an object detection method that combines region proposal and CNN, is shown according to an example of object detection model 800.
[0228] Referring to FIG. 8, the object detection model 800 may include a region proposal module 801, a CNN 802, a classifier module 803, and a bounding box regression module 804.
[0229] The region proposal module (801) extracts candidate regions from the input image. The number of candidate regions can be fixed, for example, 2,000. R-CNN utilizes selective search, a region proposal algorithm.
[0230] CNN (Convolutional Neural Network) 802 extracts a fixed-length feature vector from the region generated by the region proposal module 801. Since CNN (e.g., AlexNet, VggNet, etc.) receives input of a fixed size, it is necessary to warp the various rectangular regions provided by the region proposal algorithm for the image to fit a fixed size, regardless of the size or aspect ratio. CNN receives the warped region and extracts the result of the layer before the classifier module.
[0231] The classifier module (Linear SVM module) 803 takes a fixed-length feature vector as input and performs classification. For example, the classifier module 803 could classify whether an object is text or a logo.
[0232] The bounding-box regression module 804 takes a fixed-length feature vector as input and computes four numbers (x, y, w, h) that represent a box. The location of an object can be specified by the four numbers (x, y, w, h) that represent the box.
[0233] In other words, R-CNN performs object localization through region proposal extraction and object detection by recognizing object classes through classification of extracted features. Furthermore, it can reduce localization errors by performing bounding box regression.
[0234] Training of this object detection model 800 involves modifying the pre-trained CNN to suit the object detection task by changing the classification layer (e.g., output layer) of the pre-trained CNN to "the number of object classes + background" for object detection, and initializing the weights for only that part.
[0235] For example, one or more objects can be detected from an input image using an object detection model such as this. Object information 805 includes information about one or more objects, and each object information can be represented as (object class, location). Here, the object class can represent text.
[0236] In operation 820, the electronic device 100 can determine whether a text area has been extracted from the content video screen.
[0237] If, as a result of the judgment of operation 830, a text area is not detected from the content video screen, the process can proceed to operation 810 to analyze the next screen.
[0238] As a result of the judgment of operation 820, if a text area is detected from the content video screen, the process can proceed to operation 830.
[0239] In operation 830, the electronic device 100 can obtain a representative genre of the content based on the detected text area.
[0240] According to one embodiment, when an electronic device 100 detects a text area from a video screen, it can extract text from the text area and obtain attribute information of the content based on the extracted text. The electronic device 100 can extract text from the text area using a technology such as OCR (Optical Character Recognition). The electronic device 100 can transmit the text extracted from the text area to a server that manages information about content, and receive attribute information of the content corresponding to the text from the server. For example, the server can receive text from the electronic device 100, search for content corresponding to the text, and find information about the content, and then extract information about the content, such as attribute information such as the category, genre, and viewing age of the content, and transmit the attribute information of the extracted content to the electronic device 100. The electronic device 100 can identify a genre included in the attribute information of the content obtained in this way as a representative genre of the content.
[0241] Returning to FIG. 7 again, at operation 706, the electronic device 100 can process the audio quality based on the identified representative genre.
[0242] According to one embodiment, the electronic device 100 may store one or more image quality control parameter values and / or one or more sound quality control parameter values corresponding to each genre among a plurality of predetermined genres. In addition, the electronic device 100 may obtain one or more image quality control parameter values and / or one or more sound quality control parameter values corresponding to a representative genre among the plurality of genres stored in this manner. In addition, the electronic device 100 may process image quality and / or sound quality by setting one or more image quality control parameters and / or one or more sound quality control parameters based on the one or more image quality control parameter values and / or one or more sound quality control parameter values obtained in this manner.
[0243] According to one embodiment, the electronic device 100 may perform image quality and / or sound quality processing corresponding to a representative genre using the image quality and sound quality control parameter value DB 500 as illustrated in FIG. 5. For example, if the content is game content, the plurality of predetermined genres may include an RPG (Role Playing Game), which is a role-playing game in which the user plays the role of a character in the game, a FPS (First-person shooter) game, which is a shooting game in which the player fights using weapons or tools on a screen similar to the player's point of view, a RTS (Real-time strategy) game, which is a strategy game that proceeds in real time, in which resources are collected, buildings are constructed or troops are produced with the resources, civilization is developed, or the game ends when a war is won, and sports, etc. For example, in the genre-specific image quality and sound quality control parameter value information storage module 500 illustrated in FIG. 5, the first genre, the second genre, the third genre, and the fourth genre may be any one of RPG, FPS, RTS, and sports.
[0244] For example, if the identified representative genre is the first genre, the electronic device 100 can obtain the first table 510 in which the representative genre is the first genre from the genre-specific image quality control parameter value information storage module 500. Then, the electronic device 100 can perform image quality processing by setting the first parameter, the second parameter, and the third parameter in the first table 510 according to the first value, which is the setting value of the first parameter, which is the image quality control parameter corresponding to the first genre, the second value, which is the setting value of the second parameter, and the third value, which is the setting value of the third parameter. In addition, the electronic device 100 can perform sound quality processing by setting the fourth parameter and the fifth parameter in the first table 510 according to the fourth value, which is the setting value of the fourth parameter, which is the sound quality control parameter corresponding to the first genre, and the fifth value, which is the setting value of the fifth parameter.
[0245] For example, first-person shooter games such as FPS require a higher level of realism than other games because the viewpoint of the character in the game and the player must be the same, so a third quality value consisting of quality values that can express relatively more realism can be set.
[0246] In operation 707, the electronic device 100 may perform scene analysis based on content frames received from the content providing device 200.
[0247] According to one embodiment, the electronic device 100 may perform screen analysis based on video frames of content received from the content providing device 200. For example, the electronic device 100 may analyze the brightness, saturation, contrast ratio, sharpness, number of objects, etc. of the screen using a frame analysis engine or a scene analysis engine. In addition, the electronic device 100 may identify one of a plurality of predetermined genres based on the analysis results. The genre identified by the electronic device 100 based on the scene analysis may be referred to as a partial genre so as to be distinguished from the representative genre.
[0248] According to one embodiment, the electronic device 100 may perform an audio frequency analysis based on an audio frame of content received from a content providing device 200. For example, the electronic device 100 may analyze the frequency of an audio frame from a current streaming time point to a specific time in the past using an audio frequency analysis engine or the like, and identify which category an audio scene belongs to. For example, the categories of the audio scene may include effects, sports, music, speech, racing, etc. The electronic device 100 determines how much to improve sound elements such as speech intelligibility, presence, tonal balance, sound stage, and surround according to the categories of the audio scenes identified in this way.
[0249] In operation 708, the electronic device 100 can determine whether the identified partial genre is the same as the representative genre identified in operation 705. If the identified partial genre is the same as the representative genre identified in operation 705, there is no need to change the picture or sound quality parameters set based on the current representative genre, and thus, the electronic device 100 can proceed to operation 707 to analyze the next scene.
[0250] If the partial genre identified in operation 708 is not the same as the representative genre identified in operation 705, the picture or sound quality parameters set based on the current representative genre need to be changed to suit the identified partial genre, so operation 709 can be performed.
[0251] At operation 709, the electronic device 100 may obtain weights for picture quality control parameters and / or sound quality control parameters corresponding to the identified partial genre.
[0252] According to one embodiment, the electronic device 100 may obtain weights for image quality control parameters and / or sound quality control parameters corresponding to the identified partial genre by referring to the genre-specific image quality and sound quality control parameter value information storage module 500. For example, referring to FIG. 5, if the representative genre of the content currently being played is a first genre and the identified partial genre is a third genre, the electronic device 100 may obtain weight values w2, w5, and w8 for the image quality control parameter, the first parameter, the second parameter, and the third parameter corresponding to the third genre from the first table 510 in which the representative genre is the first genre, and may obtain weight values w11, w14 for the sound quality control parameter, the fourth parameter, and the fifth parameter corresponding to the third genre.
[0253] In operation 710, the electronic device 100 can perform image quality processing based on the acquired weights.
[0254] According to one embodiment, the electronic device 100 may perform image quality processing by setting image quality control parameters using weight values for the image quality control parameters. For example, if the electronic device 100 obtains w2, w5, and w8 as weight values for the image quality control parameters, the first parameter, the second parameter, and the third parameter as in the example above, the electronic device 100 may set the parameters by applying w2, w5, and w8 to the first parameter, the second parameter, and the third parameter, respectively. Applying w2 to the first parameter may mean processing so that the weight value w2 is reflected in the currently set value for the first parameter. For example, applying w2 to the first parameter may mean adding the weight value w2 to the first value, which is the currently set value for the first parameter.
[0255] According to one embodiment, the electronic device 100 may perform sound quality processing by setting sound quality control parameters using weight values for the sound quality control parameters. For example, if the electronic device 100 obtains w11 and w14 as weight values for the sound quality control parameter, the fourth parameter, and the fifth parameter as in the example above, the electronic device 100 may set the parameters by applying w11 and w14 to the fourth parameter and the fifth parameter, respectively. Applying w11 to the fourth parameter may mean processing so that the weight value w11 is reflected in the currently set value for the fourth parameter. For example, applying w11 to the fourth parameter may mean adding the weight value w11 to the fourth value, which is the currently set value for the fourth parameter. A method of applying weights to a sound quality control parameter or a sound quality control parameter will be described with reference to FIG. 9.
[0256] FIG. 9 is a reference diagram illustrating an example of applying weights to image quality control parameters and sound quality control parameters according to one embodiment. The example illustrated in FIG. 9 shows an example of weights for image quality control parameters and sound quality control parameters when the representative genre is the first genre.
[0257] Referring to FIG. 9, when the representative genre is the first genre, the image quality control parameters may include the first parameter, the second parameter, and the third parameter, and when the representative genre is the first genre, the sound quality control parameters may include the fourth parameter and the fifth parameter.
[0258] For each parameter, a specific value can be mapped to be set when the content genre is the representative genre. For example, if the representative genre is identified as Genre 1, the first parameter can be set to the first value, the second parameter to the second value, the third parameter to the third value, the fourth parameter to the fourth value, and the fifth parameter to the fifth value.
[0259] When the representative genre of the content is identified as the first genre and the subsequent identified partial genre is identified as the second genre, third genre, or fourth genre, the electronic device 100 can adjust or change the picture quality or sound quality by applying a mapped weight value to each parameter.
[0260] For example, the first parameter may be set to the first value corresponding to the first genre as the representative genre, and the weight for the partial genre may be determined in the range from a1 to a2. The second parameter may be set to the second value corresponding to the first genre as the representative genre, and the weight for the partial genre may be determined in the range from b1 to 22 b2. The third parameter may be set to the third value corresponding to the first genre as the representative genre, and the weight for the partial genre may be determined in the range from c1 to c2. The fourth parameter may be set to the fourth value corresponding to the first genre as the representative genre, and the weight for the partial genre may be determined in the range from d1 to d2. The fifth parameter may be set to the fifth value corresponding to the first genre as the representative genre, and the weight for the partial genre may be determined in the range from e1 to e2.
[0261] In the case of the first parameter, the weight corresponding to each partial genre can represent a relative value based on the first value. The weight corresponding to the second genre, which is a partial genre, is w1, the weight corresponding to the third genre is w2, and the weight corresponding to the fourth genre is w3. w1, w2, and w3 can be determined in the range from a1 to a2, respectively. For example, when a1 is -3 and a2 is +3, w1, w2, and w3 can be determined in the range from -3 to +3, respectively. For example, when the first value is 15, and w1, w2, and w3 are +2, -1, and -2, respectively, if the representative genre of the initial content is identified as the first genre, the electronic device 100 can set the first parameter to the first value, 15. And then, if the partial genre is identified as the third genre as a result of scene analysis of the content, the electronic device 100 can obtain a weight w2 corresponding to the third genre, which is -1, and set the first parameter to a value obtained by adding the weight w2 to the first value, which is the current setting value of the first parameter, as (15+(-1))=14.
[0262] FIG. 10 is a reference diagram for explaining an example of analyzing and processing picture quality and sound quality for each genre of game content according to one embodiment.
[0263] In the example shown in Fig. 5, an example of controlling both picture quality and sound quality for all genres is described, but depending on the genre of the game content, only picture quality, only sound quality, or both picture quality and sound quality can be controlled.
[0264] Referring to FIG. 10, the predetermined plurality of genres may include RPG, RTS, FPS, Sports, Rhythm, Fighting, and Racing.
[0265] If the identified partial genre is RPG as a result of performing frame image analysis and audio frequency analysis after the start of play of game content, the electronic device 100 can control both the picture quality and the sound quality according to the analysis results. At this time, the weight for controlling the picture quality is saturation -3, brightness +3, and the weight for controlling the sound quality can represent a 3D effect. That is, the electronic device 100 can control the picture quality by adding -3 to the current setting value of the saturation parameter and adding +3 to the current setting value of the brightness parameter in response to the identified partial genre of RPG, and can control the sound quality by adding a 3D effect. The current setting value of the saturation parameter can represent the setting value of the saturation parameter set in response to the representative genre of the content, and the current setting value of the brightness parameter can represent the setting value of the brightness parameter set in response to the representative genre of the content.
[0266] If the identified partial genre is RTS as a result of analyzing the frame image after the start of play of the game content, the electronic device 100 can control the image quality according to the analysis result. At this time, the weights for controlling the image quality can represent saturation +2, sharpness +3, and brightness +2. That is, the electronic device 100 can perform image quality control by adding +2 to the current setting value of the saturation parameter, adding +3 to the current setting value of the sharpness parameter, and adding +2 to the current setting value of the brightness parameter in response to the identified partial genre being RTS.
[0267] If the identified partial genre is FPS as a result of performing frame image analysis and audio frequency analysis after the start of play of the game content, the electronic device 100 can control both the image quality and the sound quality according to the analysis results. At this time, the weight for controlling the image quality can be +4 for brightness, and the weight for controlling the sound quality can represent a 3D effect. In other words, the electronic device 100 can control the image quality by adding +4 to the current setting value of the brightness parameter in response to the identified partial genre, FPS, and can control the sound quality by adding a 3D effect.
[0268] If the identified partial genre is sports as a result of performing frame image analysis and audio frequency analysis after the start of play of game content, the electronic device 100 can control both the picture quality and the sound quality according to the analysis results. At this time, the weight for controlling the picture quality may represent saturation -4, sharpness +3, and the weight for controlling the sound quality may represent emphasis on the caster's voice and shouting. That is, the electronic device 100 may control the picture quality by adding -4 to the current setting value of the saturation parameter and adding +3 to the current setting value of the sharpness parameter in response to the identified partial genre of sports, and may control the sound quality by adding emphasis on the caster's voice and shouting.
[0269] If, after starting the game content, the audio frequency analysis is performed and the identified partial genre is rhythm, the electronic device 100 can control the sound quality based on the analysis results. In this case, the weight for controlling the sound quality may represent background music emphasis. In other words, the electronic device 100 can perform sound quality control by adding background music emphasis in response to the identified partial genre of rhythm.
[0270] If, after starting play of game content, an audio frequency analysis is performed and the identified partial genre is Fighting, the electronic device 100 can control the sound quality based on the analysis results. In this case, the weight for controlling the sound quality may indicate emphasis on fighting sounds. In other words, the electronic device 100 can perform sound quality control by adding emphasis on fighting sounds in response to the identified partial genre, Fighting.
[0271] If, after starting play of the game content, an audio frequency analysis is performed and the identified sub-genre is Racing, the electronic device 100 can control the sound quality based on the analysis results. In this case, the weights for controlling the sound quality may represent wheel friction sounds and engine sound emphasis. In other words, the electronic device 100 can perform sound quality control by adding wheel friction sounds and engine sound emphasis in response to the identified sub-genre, Racing.
[0272] While the example illustrated in Figure 10 illustrates that the weights of sub-genres are determined regardless of the representative genre, this is not a limitation. Weights can be set to vary depending on the representative genre. For example, the values added to the saturation and brightness parameters among the image quality control parameters of a sub-genre RPG may vary depending on the representative genre.
[0273] Now, referring to Figures 11 and 12, an example of a method for processing image quality for each genre in game content will be described. To simplify the explanation, only an example of image quality processing is shown.
[0274] Figure 11 shows a weight table in one embodiment when the representative genres are RPG, RTS, FPS, and SPORTS, respectively.
[0275] Referring to FIG. 11, when the representative genre is RPG, in the weight table 1110 corresponding to each partial genre, if the partial genre is RPG, the weight is represented as 0 because it is the same genre as the representative genre. When the partial genre is RTS, the brightness parameter, contrast parameter, sharpness parameter, and color parameter represent -1, 0, 1, and 1, respectively. When the partial genre is FPS, the brightness parameter, contrast parameter, sharpness parameter, and color parameter represent -1, -1, 0, and 0, respectively. When the partial genre is SPORTS, the brightness parameter, contrast parameter, sharpness parameter, and color parameter represent 1, 0, 0, and 2, respectively.
[0276] In the weight table 1120 corresponding to each sub-genre when the representative genre is RTS, if the sub-genre is RTS, the weight is represented as 0 because it is the same genre as the representative genre. When the sub-genre is RPG, the brightness parameter, contrast parameter, sharpness parameter, and color parameter represent 1, 1, 1, and 1, respectively. When the sub-genre is FPS, the brightness parameter, contrast parameter, sharpness parameter, and color parameter represent -1, -1, 0, and 0, respectively. When the sub-genre is SPORTS, the brightness parameter, contrast parameter, sharpness parameter, and color parameter represent 1, 0, 0, and 2, respectively.
[0277] In the weight table 1130 corresponding to each sub-genre when the representative genre is FPS, if the sub-genre is FPS, the weight is represented as 0 because it is the same genre as the representative genre. When the sub-genre is RPG, the brightness parameter, contrast parameter, sharpness parameter, and color parameter represent 2, -1, 0, and 1, respectively. When the sub-genre is RTS, the brightness parameter, contrast parameter, sharpness parameter, and color parameter represent -1, 0, 1, and 1, respectively. When the sub-genre is SPORTS, the brightness parameter, contrast parameter, sharpness parameter, and color parameter represent 1, 0, 1, and 0, respectively.
[0278] If the representative genre is SPORTS, in the weight table 1140 corresponding to each sub-genre, if the sub-genre is SPORTS, the weight is represented as 0 because it is the same genre as the representative genre. If the sub-genre is RPG, the brightness parameter, contrast parameter, sharpness parameter, and color parameter represent 1, -1, -1, and -1, respectively. If the sub-genre is RTS, the brightness parameter, contrast parameter, sharpness parameter, and color parameter represent -1, 0, 1, and 1, respectively. If the sub-genre is SPORTS, the brightness parameter, contrast parameter, sharpness parameter, and color parameter represent 0, 0, 0, and 0, respectively.
[0279] FIG. 12 is a reference diagram for explaining an example of controlling image quality based on a representative genre and a partial genre during play of game content according to one embodiment.
[0280] Referring to FIG. 12, when the electronic device 100 receives content from the content providing device 200, it can recognize that play of the game content has begun based on an information signal provided from the content providing device 200 at time t1.
[0281] When the electronic device 100 recognizes that the game content has begun playing, it can identify the representative genre of the game content at time t2 to perform appropriate image quality control for each genre of the game content. For example, the electronic device 100 can identify that the representative genre of the game content is RPG. Accordingly, the electronic device 100 can perform image quality control by setting image quality control parameters to values for image quality control parameters when the representative genre is RPG. By performing image quality control based on the representative genre in this way, primary audiovisual effects based on RPG characteristics can be provided to the game content.
[0282] The electronic device 100 can continuously analyze content frames received from the content providing device 200 after identifying the representative genre. The electronic device 100 can identify the partial genre of the content by analyzing the image frame and audio frequency of the content. For example, at time t3, the electronic device 100 can identify that the partial genre of the content is FPS. Accordingly, the electronic device 100 can obtain a weight corresponding to the partial genre FPS from the image quality control weight table in which the representative genre is RPG. For example, in FIG. 11, when the representative genre is RPG, the weight corresponding to the partial genre FPS can be obtained as -1, -1, 0, and 0 as the brightness parameter, the contrast parameter, the sharpness parameter, and the color parameter in the weight table 1110 corresponding to each partial genre. Electronic device 100 can provide secondary audiovisual effects to game content by performing image quality control by adding weights -1, -1, 0, and 0 corresponding to the partial genre FPG to the brightness parameter setting value, contrast parameter setting value, sharpness parameter setting value, and color parameter setting value set corresponding to the representative genre RPG, respectively. By doing so, when a scene in which FPS characteristics are prominent appears while content whose representative genre is RPG is being played, a secondary audiovisual effect can be provided by giving a weight according to the FPS characteristics in order to add an effect according to the FPS characteristics based on the RPG genre.
[0283] The electronic device 100 can continuously identify the sub-genre of the content by analyzing the image frames and audio frequencies of the content. For example, at time t4, the electronic device 100 can identify that the sub-genre of the content is RPG. Accordingly, since the main genre, RPG, and the sub-genre, RPG, are the same, the electronic device 100 can remove the weight corresponding to the FPS performed at time t3 and return to the brightness parameter, contrast parameter, sharpness parameter, and color parameter settings corresponding to the original RPG.
[0284] The electronic device 100 can continuously identify the partial genre of the content by analyzing the image frame and audio frequency of the content. For example, at time t5, the electronic device 100 can identify that the partial genre of the content is SPORTS. Accordingly, the electronic device 100 can obtain a weight corresponding to the partial genre SPORTS from the image quality control weight table whose representative genre is RPG. For example, in FIG. 11, if the representative genre is RPG, the weights corresponding to the partial genre SPORTS can be obtained as 1, 0, 0, and 2 as brightness parameter, contrast parameter, sharpness parameter, and color parameter in the weight table 1110 corresponding to each partial genre. The electronic device 100 can provide secondary audio visual effects to the game content by performing image quality control by adding weights 1, 0, 0, and 2 corresponding to the partial genre SPORTS to the brightness parameter setting value, contrast parameter setting value, sharpness parameter setting value, and color parameter setting value set corresponding to the representative genre RPG, respectively. By doing this, when a scene with prominent SPORTS characteristics appears while playing content whose representative genre is RPG, a secondary audio-visual effect can be provided by giving weight according to SPORTS characteristics in order to add effects according to SPORTS characteristics based on the RPG genre.
[0285] The electronic device 100 may recognize the end of the game content at time t6 when the game content play has ended and no longer receives information signals from the content providing device 200. Upon recognizing the end of the game content in this manner, the electronic device 100 may no longer perform the picture and / or sound quality control performed based on the representative genre and partial genre of the game content.
[0286] The method of operating an electronic device according to the disclosed embodiment may be implemented in the form of program commands that can be executed by various computer means and recorded on a computer-readable medium. Furthermore, the disclosed embodiment may be a computer-readable recording medium having recorded thereon one or more programs containing commands for executing the method of operating a display device.
[0287] The above computer-readable medium may include program commands, data files, data structures, etc., either singly or in combination. The program commands recorded on the medium may be those specially designed and configured for the present invention, or may be those known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program commands, such as ROMs, RAMs, and flash memories. Examples of program commands include not only machine language codes generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc.
[0288] Here, the device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage medium and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.
[0289] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smartphones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product (e.g., downloadable app) may be at least temporarily stored or temporarily created in a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
Claims
1. In electronic devices, memory for storing at least one instruction; and comprising at least one processor executing at least one instruction; The electronic device, wherein the at least one instruction is executed by the at least one processor, Identify the representative genre of said content based on information about the content, At least one of video quality control and audio quality control is performed on the content by setting at least one of video quality and audio quality for playback of the content to a predetermined value based on the identified representative genre, Identifying a partial genre of said content based on analysis of a scene containing at least one video frame or audio frequency corresponding to at least a portion of said content being played, An electronic device configured to perform at least one of the video quality control or the audio quality control on the content by assigning a weight to the predetermined value based on the identified partial genre.
2. In paragraph 1, The electronic device, wherein the at least one instruction is executed by the at least one processor, Recognize that playback of the above content has begun, By analyzing the image of the content being played, the title information of the content is obtained, An electronic device configured to identify a representative genre of the content based on title information of the content.
3. In paragraph 1 or 2, The above content includes game content, The electronic device, wherein the at least one instruction is executed by the at least one processor, An electronic device configured to recognize that playback of said game content has begun based on the presence of at least one signal among VRR, ALLM, or ContentsType received from an external device connected to provide said content.
4. In any one of paragraphs 1 to 3, The electronic device, wherein the at least one instruction is executed by the at least one processor, An electronic device configured to identify a genre selected from a plurality of predetermined genres as a representative genre of the content based on information about the content.
5. In any one of paragraphs 1 to 4, The electronic device, wherein the at least one instruction is executed by the at least one processor, An electronic device configured to identify a selected genre from among the plurality of predetermined genres as a sub-genre of the content based on an analysis of the scene.
6. In any one of paragraphs 1 to 5, The electronic device, wherein the at least one instruction is executed by the at least one processor, Obtaining at least one of the setting values of one or more parameters for controlling the video quality corresponding to the representative genre or the setting values of one or more parameters for controlling the audio quality, An electronic device configured to control at least one of the video quality or the audio quality by setting one or more parameters for controlling the video quality using the setting values of one or more parameters for controlling the video quality, or by setting one or more parameters for controlling the audio quality using the setting values of one or more parameters for controlling the audio quality.
7. In any one of paragraphs 1 to 6, The electronic device, wherein the at least one instruction is executed by the at least one processor, An electronic device configured to perform at least one of the video quality control and the audio quality control on the content by adjusting the setting values of one or more parameters for setting the video quality and / or the setting values of one or more parameters for setting the audio quality, corresponding to the representative genre, using a weight corresponding to the identified partial genre.
8. In any one of paragraphs 1 to 7, The electronic device, wherein the at least one instruction is executed by the at least one processor, Identify whether the above identified partial genre is identical to the above representative genre, As the identified partial genre is the same as the representative genre, at least one of the video quality control or the audio quality control is performed using at least one of the setting values of one or more parameters for controlling the video quality or the setting values of one or more parameters for controlling the audio quality, which correspond to the representative genre. An electronic device configured to adjust at least one of the setting values of one or more parameters for setting the video quality corresponding to the representative genre or the setting values of one or more parameters for setting the audio quality using a weight corresponding to the identified partial genre, depending on whether the identified partial genre is different from the representative genre.
9. In any one of paragraphs 1 to 8, The electronic device, wherein the at least one instruction is executed by the at least one processor, It is configured to obtain a table storing the weights added to the setting values of one or more parameters for setting the video quality corresponding to the representative genre, corresponding to each of a plurality of predetermined genres, An electronic device wherein the above weights are variable within a range of predetermined values.
10. A method of operating an electronic device, An action to identify the representative genre of said content based on information about said content; An operation of performing video quality control and / or audio quality control on the content by setting at least one of the video quality or audio quality for playback of the content to a predetermined value based on the identified representative genre. An operation of identifying a partial genre of said content based on an analysis of a scene including at least one of one or more video frames or audio frequencies corresponding to at least a portion of the content being played, and A method comprising an operation of performing at least one of the video quality control or the audio quality control on the content by weighting the predetermined value based on the identified partial genre.
11. In paragraph 10, An action that recognizes that playback of the above content has begun; An operation of obtaining title information of the content by analyzing an image of the content being played, and A method comprising an action of identifying a representative genre of the content based on title information of the content.
12. In clause 10 or 11, The above content includes game content, The above method, A method further comprising an action of recognizing that playback of the game content has started based on whether at least one signal of VRR, ALLM, or ContentsType is received from an external device connected to provide the content.
13. In any one of paragraphs 10 to 12, A method further comprising an action of identifying a genre selected from a plurality of predetermined genres based on information about the content as a representative genre of the content.
14. In any one of paragraphs 10 to 13, A method further comprising an action of identifying a selected genre from among the plurality of predetermined genres as a partial genre of the content based on an analysis of the scene.
15. A non-transitory computer-readable recording medium storing one or more instructions that, when executed by a processor of an electronic device, cause the electronic device to perform operations, the operations comprising: An action to identify the representative genre of said content based on information about said content; An operation of performing video quality control and / or audio quality control on the content by setting at least one of the video quality or audio quality for playback of the content to a predetermined value based on the identified representative genre. An operation of identifying a partial genre of said content based on an analysis of a scene including at least one of one or more video frames or audio frequencies corresponding to at least a portion of the content being played, and A computer-readable recording medium comprising an operation of performing at least one of the video quality control or the audio quality control on the content by assigning a weight to the predetermined value based on the identified partial genre.
Citation Information
Patent Citations
Display device, display control method, and program
JP2023173914A
Method and apparatus for controlling a colour of (an)image display device
KR1020070055925A
Method and system for adjusting content rendering device automatically with broadcast content material
KR1020090022373A
The pipe connection device by manual type without using fluid type press
KR1020230052138A
Electronic blackboard with universal design that is convenient for users and considers the socially disadvantaged
KR102449894B1