Multimedia device and control method therefor

Abstract

Presented is a multimedia device, including: a display configured to output an image through one or more windows; and a controller configured to control the display, wherein the controller detects whether an activation trigger condition of a picture in picture (PIP) mode is satisfied, and activates the PIP mode when the activation trigger condition is satisfied, wherein the activation trigger condition may be related to a progress state of a game through the multimedia device.

Description

Multimedia device and control method therefor

[0001] The present invention relates to a multimedia device and a control method therefor, and more particularly, to a multimedia device for activating a PIP (picture in picture) mode and outputting an image during a game, and a control method therefor.

[0002] Recently, new form factors have been discussed in multimedia devices such as mobile phones and TVs. Form factors refer to the structured form of a product.

[0003] The growing importance of form factor innovation in the display industry stems from the increasing mobility of consumers, the rapid advancement of device convergence and smartness, and the growing need for form factors that can be used freely and conveniently regardless of the usage environment, moving away from typical form factors tailored to specific usage environments.

[0004] For example, vertical TVs are expanding, breaking the stereotype of viewing TV horizontally. These TVs, designed to accommodate the MZ generation's familiarity with mobile content, feature screen orientation adjustments. This allows users to conveniently view images from social media or shopping sites, and even read comments while watching videos. Vertical TVs are particularly advantageous when paired with smartphones via Near Field Communication (NFC)-based mirroring. When watching regular TV or movies, the TV can be rotated horizontally.

[0005] As another example, rollable TVs and foldable smartphones are similar in that they both use "flexible displays." A flexible display, as the name suggests, refers to electronic components that are flexible. For these displays to be flexible, they must first be thin. The substrate that receives information and converts it into light must be thin and flexible to ensure long-lasting performance without damage.

[0006] Flexibility means being able to withstand impact without significant impact. While a flexible display is being bent or folded, the joints are constantly under pressure. To prevent internal damage from this pressure, the display must be durable yet still be able to deform smoothly when subjected to pressure.

[0007] Flexible displays, for example, are implemented based on OLEDs. OLEDs are displays that utilize organic light-emitting materials. Organic materials are relatively more flexible than inorganic materials like metals. Furthermore, OLEDs have a thin substrate, giving them a competitive edge over other displays. Previously used LCD substrates required separate liquid crystals and glass, limiting their ability to be reduced in thickness.

[0008] As a new form factor for TVs, demand is growing for TVs that can be easily transported both indoors and outdoors. In particular, the recent coronavirus pandemic has led to increased time spent at home, driving demand for second TVs. Furthermore, the growing number of people going outdoors for activities like camping has driven demand for TVs in new form factors that are easy to carry and transport.

[0009] Figure 2 shows an example of a TV in a new form factor.

[0010] The emergence of TVs in various form factors is all about enhancing the user experience, which aims to provide satisfaction through seamless content consumption within the home (specific space) and sharing content with others.

[0011] Meanwhile, regarding user experience, cloud gaming and console games are now also being offered through TVs. Depending on the gaming environment, periods of inactivity (hereinafter referred to as "idle periods") occur when the user is not actively engaged in the game (i.e., periods of time when no user interaction is required), and ways to utilize these periods are being explored.

[0012] In particular, as short-form videos are the recent trend in video content, it is expected that attempts to provide such videos to users with shorter idle periods during game play, as mentioned above, will be necessary to enhance the user experience.

[0013] The present invention aims to provide a multimedia device for activating a PIP (picture in picture) mode during a game and outputting an image, and a control method therefor.

[0014] A multimedia device is proposed, comprising: a display for outputting images through one or more windows; and a controller for controlling the display, wherein the controller detects whether an activation trigger condition of a picture in picture (PIP) mode is satisfied, and activates the PIP mode when the activation trigger condition is satisfied, wherein the activation trigger condition may be related to a progress state of a game through the multimedia device.

[0015] A method for controlling a multimedia device is proposed, the method being performed by a multimedia device including a display for outputting an image through one or more windows; and a controller for controlling the display, the method comprising: a step of detecting whether a trigger condition for activating a picture in picture (PIP) mode is satisfied; and a step of activating the PIP mode when the trigger condition is satisfied, wherein the trigger condition may be related to a progress state of a game through the multimedia device.

[0016] The above problem solving methods are only some of the embodiments of the present invention, and various embodiments reflecting the technical features of the present invention can be derived and understood by a person having ordinary knowledge in the relevant technical field based on the detailed description of the present invention described below.

[0017] The present invention has the following effects.

[0018] The present invention can activate a PIP mode that outputs images through a sub-window of a display during game play on a multimedia device.

[0019] Additionally, the present invention enables output of video through a sub-window during game play by activating PIP mode.

[0020] Additionally, the present invention may provide for PIP mode deactivation.

[0021] The effects that can be obtained from the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by a person having ordinary skill in the art to which the present invention belongs from the description below.

[0022] The accompanying drawings, which are included as part of the detailed description to aid in understanding the present invention, provide embodiments of the present invention and, together with the detailed description, explain the technical idea of ​​the present invention.

[0023] Figure 1 is a block diagram for explaining each component of the display device.

[0024] FIG. 2 is a drawing showing a display device according to one embodiment of the present invention.

[0025] Figure 3 shows a flowchart of a control method of a multimedia device for activating PIP mode according to the present invention.

[0026] Figure 4 shows a flowchart of a control method of a multimedia device for activating PIP mode according to the present invention.

[0027] FIG. 5 is a diagram for explaining the PIP mode and multi-view mode according to the present invention.

[0028] Figure 6 shows a block diagram of a device according to the present invention.

[0029] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Regardless of the drawing numbers, identical or similar components will be given the same reference numbers and redundant descriptions thereof will be omitted. The suffixes "module" and "part" used for components in the following description are assigned or used interchangeably only for the convenience of writing the specification, and do not in themselves have distinct meanings or roles. In addition, when describing the embodiments disclosed in this specification, if it is determined that a specific description of a related known technology may obscure the gist of the embodiments disclosed in this specification, a detailed description thereof will be omitted. In addition, the attached drawings are only intended to facilitate easy understanding of the embodiments disclosed in this specification, and the technical ideas disclosed in this specification are not limited by the attached drawings, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and technical scope of the present invention.

[0030] Terms that include ordinal numbers, such as first, second, etc., may be used to describe various components, but the components are not limited by these terms. These terms are used solely to distinguish one component from another.

[0031] When a component is referred to as being "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components intervening. Conversely, when a component is referred to as being "directly connected" or "connected" to another component, it should be understood that there are no other components intervening.

[0032] Singular expressions include plural expressions unless the context clearly indicates otherwise.

[0033] In this application, terms such as “include” or “have” are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in the specification, but should be understood not to exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0034]

[0035] In the following description, the display device (100) is referred to as such, but the display device may be referred to by various names, such as a TV or a multimedia device, and the scope of the invention is not limited to the name.

[0036]

[0037] FIG. 1 is a block diagram for explaining each component of a display device (100) according to one embodiment of the present invention.

[0038] The display device (100) may include a broadcast receiving unit (110), an external device interface unit (171), a network interface unit (172), a storage unit (140), a user input interface unit (173), an input unit (130), a control unit (180), a display module (150), an audio output unit (160), and / or a power supply unit (190).

[0039] The broadcast receiving unit (110) may include a tuner unit (111) and a demodulator unit (112).

[0040] Meanwhile, unlike the drawing, the display device (100) may include only the external device interface unit (171) and the network interface unit (172) among the broadcast receiving unit (110), the external device interface unit (171), and the network interface unit (172). That is, the display device (100) may not include the broadcast receiving unit (110).

[0041] The tuner unit (111) can select a broadcast signal corresponding to a channel selected by the user or all previously stored channels among broadcast signals received through an antenna (not shown) or a cable (not shown). The tuner unit (111) can convert the selected broadcast signal into an intermediate frequency signal or a baseband video or audio signal.

[0042] For example, the tuner unit (111) can convert the selected broadcast signal into a digital IF signal (DIF) if it is a digital broadcast signal, and can convert it into an analog baseband video or audio signal (CVBS / SIF) if it is an analog broadcast signal. That is, the tuner unit (111) can process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal (CVBS / SIF) output from the tuner unit (111) can be directly input to the control unit (180).

[0043] Meanwhile, the tuner unit (111) can sequentially select broadcast signals of all stored broadcast channels through the channel memory function among the received broadcast signals and convert them into intermediate frequency signals or baseband video or audio signals.

[0044] Meanwhile, the tuner unit (111) may be equipped with multiple tuners to receive broadcast signals of multiple channels. Alternatively, a single tuner that simultaneously receives broadcast signals of multiple channels is also possible.

[0045] The demodulation unit (112) can perform a demodulation operation by receiving a digital IF signal (DIF) converted by the tuner unit (111). The demodulation unit (112) can output a stream signal (TS) after performing demodulation and channel decoding. At this time, the stream signal can be a signal in which a video signal, an audio signal, or a data signal is multiplexed.

[0046] The stream signal output from the demodulation unit (112) can be input to the control unit (180). The control unit (180) can perform demultiplexing, image / audio signal processing, etc., and then output an image through the display module (150) and output an audio through the audio output unit (160).

[0047] The sensing unit (120) refers to a device that detects changes within the display device (100) or detects external changes. For example, it may include at least one of a proximity sensor, an illumination sensor, a touch sensor, an infrared sensor (IR sensor), an ultrasonic sensor, an optical sensor (e.g., a camera), a voice sensor (e.g., a microphone), a battery gauge, and an environmental sensor (e.g., a hygrometer, a thermometer, etc.).

[0048] The control unit (180) can check the status of the display device (100) based on the information collected from the sensing unit (120), and if a problem occurs, can notify the user of it or control it to maintain the best condition by adjusting it on its own.

[0049] In addition, the content, picture quality, size, etc. of the image provided to the display module (150) can be controlled differently depending on the viewer detected by the sensing unit or the surrounding lighting, etc., to provide an optimal viewing environment. As smart display devices advance, the functions installed in the display devices increase, and the sensing unit (20) also increases along with them.

[0050] The input unit (130) may be provided on one side of the main body of the display device (100). For example, the input unit (130) may include a touch pad, a physical button, etc. The input unit (130) may receive various user commands related to the operation of the display device (100) and transmit a control signal corresponding to the input command to the control unit (180).

[0051] Recently, as the size of the bezel of the display device (100) has become smaller, the number of display devices (100) with a minimal input unit (130) in the form of a physical button exposed to the outside has increased. Instead, a minimum number of physical buttons are positioned on the back or side, and user input can be received through a remote control device (200) via a touchpad or a user input interface unit (173) described later.

[0052] The storage unit (140) may store programs for each signal processing and control within the control unit (180), or may store signal-processed video, audio, or data signals. For example, the storage unit (140) may store application programs designed for the purpose of performing various tasks that can be processed by the control unit (180), and may selectively provide some of the stored application programs upon request from the control unit (180).

[0053] Programs stored in the storage unit (140) are not particularly limited as long as they can be executed by the control unit (180). The storage unit (140) may also perform a function for temporarily storing video, audio, or data signals received from an external device through the external device interface unit (171). The storage unit (140) may store information regarding a specific broadcast channel through a channel memory function such as a channel map.

[0054] Although the storage unit (140) of FIG. 1 is provided separately from the control unit (180), the scope of the present invention is not limited thereto, and the storage unit (140) may be included within the control unit (180).

[0055] The storage unit (140) may include at least one of volatile memory (e.g., DRAM, SRAM, SDRAM, etc.) or non-volatile memory (e.g., flash memory, hard disk drive (HDD), solid-state drive (SSD), etc.).

[0056] The display module (150) can generate a driving signal by converting a video signal, data signal, OSD signal, control signal, etc. processed by the control unit (180) or a video signal, data signal, control signal, etc. received from the interface unit (171). The display module (150) can include a display panel (181) having a plurality of pixels.

[0057] The plurality of pixels provided on the display panel may have RGB sub-pixels. Alternatively, the plurality of pixels provided on the display panel may have RGBW sub-pixels. The display module (150) can convert image signals, data signals, OSD signals, control signals, etc. processed by the control unit (180) to generate driving signals for the plurality of pixels.

[0058] The display module (150) can be a PDP (Plasma Display Panel), an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diode), a flexible display module, etc., and may also be a 3D display module. The 3D display module (150) can be divided into a glasses-free type and a glasses type.

[0059] The display device (100) includes a display module that occupies most of the front surface area and a case that covers the rear side of the display module and packages the display module.

[0060] Recently, display devices (100) can utilize display modules (150) that can be bent, such as LEDs (Light Emitting Diodes) or OLEDs (Organic Light Emitting Diodes), to implement a curved screen rather than a flat screen.

[0061] Previously, LCDs were primarily used because they were unable to emit light on their own, so they relied on backlight units for light. Backlight units are devices that evenly distribute light from a light source to the liquid crystal display (LCD) located at the front. As backlight units have become thinner, thinner LCDs have become possible. However, it has been difficult to implement backlight units using flexible materials, and when the backlight unit is bent, it becomes difficult to supply light evenly to the LCD, causing screen brightness to fluctuate.

[0062] On the other hand, in the case of LEDs or OLEDs, since each element forming a pixel emits light on its own, it is possible to implement a curved display without using a backlight unit. In addition, since each element emits light on its own, even if the positional relationship with neighboring elements changes, its own brightness is not affected, so a curved display module (150) can be implemented using LEDs or OLEDs.

[0063] OLED (Organic Light-Emitting Diodes) panels made their debut in the mid-2010s and are rapidly replacing LCDs in the small- and medium-sized display market. OLEDs utilize the self-luminous phenomenon, where fluorescent organic compounds emit light when current flows through them. Their image quality response speed is faster than that of LCDs, resulting in virtually no afterimages when displaying video.

[0064] OLED uses three types of fluorescent organic compounds with self-luminous functions: red, green, and blue. It is a luminescent display product that utilizes the phenomenon in which electrons injected from the cathode and anode and positively charged particles combine within the organic material to emit light on their own, so there is no need for a backlight (backlight device) that reduces color.

[0065] LED (Light Emitting Diode) panels are a technology that uses one LED element as one pixel, and can reduce the size of the LED element compared to the past, enabling the implementation of a flexible display module (150). Devices previously referred to as LED TVs used LEDs as a light source for a backlight unit that supplied light to an LCD, and the LEDs themselves did not form a screen.

[0066] The display module includes a display panel, a coupling magnet positioned on a rear surface of the display panel, a first power supply unit, and a first signal module. The display panel may include a plurality of pixels (R, G, B). The plurality of pixels (R, G, B) may be formed in each area where a plurality of data lines and a plurality of gate lines intersect. The plurality of pixels (R, G, B) may be arranged or arranged in a matrix form.

[0067] For example, the plurality of pixels (R, G, B) may include a red (Red, hereinafter referred to as 'R') sub-pixel, a green (Green, 'G') sub-pixel, and a blue (Blue, 'B') sub-pixel. The plurality of pixels (R, G, B) may further include a white (White, hereinafter referred to as 'W') sub-pixel.

[0068] The side of the display module (150) that displays an image can be referred to as the front or front. When the display module (150) displays an image, the side from which the image cannot be observed can be referred to as the rear or back.

[0069] Meanwhile, the display module (150) is configured as a touch screen and can be used as an input device in addition to an output device.

[0070] The audio output unit (160) receives a signal processed by the control unit (180) and outputs it as voice.

[0071] The interface unit (170) serves as a passageway for various types of external devices connected to the display device (100). The interface unit may include not only a wired method for transmitting and receiving data through a cable, but also a wireless method using an antenna.

[0072] The interface unit (170) may include at least one of a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, an audio I / O (Input / Output) port, a video I / O (Input / Output) port, and an earphone port.

[0073] As an example of a wireless method, the broadcast receiving unit (110) described above may be included, and may include not only broadcast signals but also mobile communication signals, short-range communication signals, wireless Internet signals, etc.

[0074] The external device interface unit (171) can transmit or receive data with a connected external device. To this end, the external device interface unit (171) may include an A / V input / output unit (not shown).

[0075] The external device interface unit (171) can be connected to external devices such as a DVD (Digital Versatile Disk), Blu-ray, game device, camera, camcorder, computer (laptop), set-top box, etc., via wired / wireless connection, and can also perform input / output operations with the external devices.

[0076] In addition, the external device interface unit (171) can establish a communication network with various remote control devices (200), and receive a control signal related to the operation of the display device (100) from the remote control device (200), or transmit data related to the operation of the display device (100) to the remote control device (200).

[0077] The external device interface unit (171) may include a wireless communication unit (not shown) for short-range wireless communication with other electronic devices. Through this wireless communication unit (not shown), the external device interface unit (171) can exchange data with an adjacent mobile terminal. In particular, in mirroring mode, the external device interface unit (171) can receive device information, running application information, application images, etc. from the mobile terminal.

[0078] The network interface unit (172) may provide an interface for connecting the display device (100) to a wired / wireless network, including the Internet. For example, the network interface unit (172) may receive content or data provided by the Internet, a content provider, or a network operator via a network. Meanwhile, the network interface unit (172) may include a communication module (not shown) for connection to a wired / wireless network.

[0079] The external device interface unit (171) and / or the network interface unit (172) may include a communication module for short-range communication such as Wi-Fi (Wireless Fidelity), Bluetooth, Bluetooth Low Energy (BLE), Zigbee, and NFC (Near Field Communication), a communication module for cellular communication such as LTE (long-term evolution), LTE-A (LTE Advance), CDMA (code division multiple access), WCDMA (wideband CDMA), UMTS (universal mobile telecommunications system), and WiBro (Wireless Broadband).

[0080] The user input interface unit (173) can transmit a signal input by the user to the control unit (180), or transmit a signal from the control unit (180) to the user. For example, it can transmit / receive a user input signal such as power on / off, channel selection, screen setting, etc. from a remote control device (200), or transmit a user input signal input from a local key (not shown) such as a power key, a channel key, a volume key, a setting value, etc. to the control unit (180), or transmit a user input signal input from a sensor unit (not shown) that senses a user's gesture to the control unit (180), or transmit a signal from the control unit (180) to the sensor unit.

[0081] The control unit (180) may include at least one processor, and may control the overall operation of the display device (100) using the processor included therein. Here, the processor may be a general processor such as a central processing unit (CPU). Of course, the processor may be a dedicated device such as an ASIC or another hardware-based processor.

[0082] The control unit (180) can demultiplex a stream input through a tuner unit (111), a demodulator unit (112), an external device interface unit (171), or a network interface unit (172), or process demultiplexed signals to generate and output a signal for video or audio output.

[0083] The image signal processed by the control unit (180) can be input to the display module (150) and displayed as an image corresponding to the image signal. In addition, the image signal processed by the control unit (180) can also be input to an external output device through the external device interface unit (171).

[0084] The voice signal processed in the control unit (180) can be output as sound to the audio output unit (160). In addition, the voice signal processed in the control unit (180) can be input to an external output device through the external device interface unit (171). In addition, the control unit (180) can include a demultiplexing unit, an image processing unit, etc.

[0085] In addition, the control unit (180) can control the overall operation within the display device (100). For example, the control unit (180) can control the tuner unit (111) to select (tuning) a broadcast corresponding to a channel selected by the user or a previously stored channel.

[0086] In addition, the control unit (180) can control the display device (100) by a user command or an internal program input through the user input interface unit (173). Meanwhile, the control unit (180) can control the display module (150) to display an image. At this time, the image displayed on the display module (150) may be a still image or a moving image, and may be a 2D image or a 3D image.

[0087] Meanwhile, the control unit (180) can cause a predetermined 2D object to be displayed within an image displayed on the display module (150). For example, the object can be at least one of a connected web screen (newspaper, magazine, etc.), an EPG (Electronic Program Guide), various menus, widgets, icons, still images, videos, and text.

[0088] Meanwhile, the control unit (180) may modulate and / or demodulate a signal using the Amplitude Shift Keying (ASK) method. Here, the Amplitude Shift Keying (ASK) method may mean a method of modulating a signal by varying the amplitude of a carrier wave according to a data value, or of restoring an analog signal to a digital data value according to the amplitude of the carrier wave.

[0089] For example, the control unit (180) can modulate a video signal using the amplitude shift keying (ASK) method and transmit it through a wireless communication module.

[0090] For example, the control unit (180) can demodulate and process an image signal received through a wireless communication module using the amplitude shift keying (ASK) method.

[0091] Through this, the display device (100) can easily transmit and receive signals with other adjacently placed video display devices without using a unique identifier such as a MAC address (Media Access Control Address) or a complex communication protocol such as TCP / IP.

[0092] Meanwhile, the display device (100) may further include a camera (not shown). The camera can capture images of the user. The camera can be implemented with a single camera, but is not limited thereto, and may also be implemented with multiple cameras. Meanwhile, the camera can be embedded in the display device (100) above the display module (150) or can be separately positioned. Image information captured by the camera can be input to the control unit (180).

[0093] The control unit (180) can recognize the user's location based on the image captured by the camera. For example, the control unit (180) can determine the distance (z-axis coordinate) between the user and the display device (100). In addition, the control unit (180) can determine the x-axis coordinate and y-axis coordinate within the display module (150) corresponding to the user's location.

[0094] The control unit (180) can detect the user's gesture based on the image captured from the camera unit, or the signal detected from the sensor unit, or a combination thereof.

[0095] The power supply unit (190) can supply power to the entire display device (100). In particular, it can supply power to a control unit (180) that can be implemented in the form of a system on chip (SOC), a display module (150) for displaying images, and an audio output unit (160) for audio output.

[0096] Specifically, the power supply unit (190) may be equipped with a converter (not shown) that converts AC power into DC power and a Dc / Dc converter (not shown) that converts the level of DC power.

[0097] Meanwhile, the power supply unit (190) receives power from an external source and distributes power to each component. The power supply unit (190) may utilize a method of supplying AC power by directly connecting to an external power source, or may include a power supply unit (190) that can be recharged and used, including a battery.

[0098] The former requires a wired cable connection, making movement difficult or limited. The latter offers freedom of movement, but increases weight and volume by the battery. Charging requires a direct connection to a power cable or a charging cradle (not shown) for a set period of time.

[0099] The charging cradle can be connected to the display device through an externally exposed terminal, or the built-in battery can be charged when brought into proximity using a wireless method.

[0100] The remote control device (200) can transmit user input to the user input interface unit (173). To this end, the remote control device (200) can use Bluetooth, RF (Radio Frequency) communication, infrared (Infrared Radiation) communication, UWB (Ultra-wideband), ZigBee, etc. In addition, the remote control device (200) can receive images, voices, or data signals output from the user input interface unit (173) and display or output the same as voice on the remote control device (200).

[0101] Meanwhile, the above-described display device (100) may be a digital broadcast receiver capable of receiving fixed or mobile digital broadcasts.

[0102] Meanwhile, the block diagram of the display device (100) illustrated in FIG. 1 is only a block diagram for one embodiment of the present invention, and each component of the block diagram may be integrated, added, or omitted depending on the specifications of the display device (100) actually implemented.

[0103] That is, two or more components may be combined into a single component, or a single component may be subdivided into two or more components, as needed. Furthermore, the functions performed by each block are intended to illustrate embodiments of the present invention, and their specific operations or devices do not limit the scope of the present invention.

[0104]

[0105] Figure 2 is a drawing illustrating a display device according to one embodiment of the present invention. Any description that overlaps with the above description will be omitted.

[0106] Referring to FIG. 2, the display device (100) is configured such that a display module (150) is housed inside a housing (210). At this time, the housing (210) includes an upper case (210a) and a lower case (210b), and the upper case (210a) and the lower case (210b) can be made in a structure that opens and closes.

[0107] In one embodiment, an audio output unit (160) may be included in the upper case (210a) of the display device (100), and a control unit (180), such as a main board, a power board, a power supply unit (190), a battery, an interface unit (170), a sensing unit (120), and an input unit (130, including a local key), may be housed in the lower case (210b). Here, the interface unit (170) may include a Wi-Fi module, a Bluetooth module, an NFC module, and the like for communication with an external device, and the sensing unit (120) may include a light sensor and an IR sensor.

[0108] In one embodiment, the display module (150) may include a DC-DC board, a sensor, and an LVDS (low voltage differential signaling) conversion board.

[0109] Additionally, in one embodiment, the display device (100) may further include four detachable legs (220a, 220b, 220c, 220d). Here, the four legs (220a, 220b, 220c, 220d) may be attached to the lower case (210b) to allow the display device (100) to be spaced from the floor.

[0110]

[0111] The display device illustrated in FIG. 2 is exemplary, and the display device to which the present invention can be applied includes not only a display device having a new form factor, but also a display device of an existing form factor including a general flat-screen TV.

[0112]

[0113] Hereinafter, the proposed technology will be described with reference to FIGS. 3 to 6.

[0114]

[0115] FIG. 3 is a flowchart illustrating a control method of a multimedia device for activating PIP mode according to the present invention. The control method related to FIG. 3 may be performed by the multimedia device (100) or the control unit (180) of the multimedia device (100) (hereinafter referred to as the “controller”), and may also be performed by other components of the multimedia device (100). For simplicity of explanation, the control method will be described as being performed by the multimedia device (100).

[0116] The multimedia device (100) can detect a state corresponding to an activation trigger condition of the PIP (picture in picture) mode (S310).

[0117] The multimedia device (100) can determine whether the activation trigger condition of the PIP mode is met (S320).

[0118] The activation trigger condition of the PIP mode may be set to be related to the progress of the game through the multimedia device (100). For example, the activation trigger condition of the PIP mode may include a state in which the progress of the game is stopped or a state in which the user must wait for a certain period of time depending on the progress of the game.

[0119] Additionally, the trigger condition for activating the PIP mode may include detecting a predetermined user operation or input through the user input interface. Activation of the PIP mode due to an operation or input detected through the user input interface continues until the PIP mode is deactivated due to an operation or input through the user input interface. In other words, the game progress is resumed only when the trigger condition for deactivating the PIP mode is satisfied.

[0120] The time interval from when the game progress stops or the user starts waiting until the game progresses again can be referred to as an “idle interval.” In other words, the activation trigger condition for PIP mode is whether the game progress corresponds to an “idle interval.”

[0121] In this way, there are various trigger conditions for the start of the “idle section”, and these are stored in the storage unit (140) (hereinafter referred to as “memory”) of the multimedia device (100), and when the trigger condition is satisfied, the multimedia device (100) can activate the PIP mode.

[0122] Table 1 below shows PIP mode activation trigger conditions stored in the memory of the multimedia device (100). The PIP mode activation trigger conditions may be set by combining two or more conditions, as shown in Table 1, 4 to 7. In addition to the PIP mode activation trigger conditions listed in Table 1, other trigger conditions may be used.

[0123]

[0124] No. PIP mode activation trigger condition details 1A When the game respawn waiting time is reached 2B When the gyro sensor value (or value change) of the game controller falls within a preset range 3C When a pre-specified input or operation is performed through the user input interface 4A+B 5A+C Even if a pre-specified input or operation is performed through the user input interface, PIP mode is activated only when condition A is satisfied 6B+C Even if a pre-specified input or operation is performed through the user input interface, PIP mode is activated only when condition B is satisfied 7A+B+C Even if a pre-specified input or operation is performed through the user input interface, both conditions A and B are satisfied to activate PIP mode

[0125] Regarding A, respawn refers to the phenomenon in which a character or monster in a game is relocated to a designated location after dying or disappearing. In other words, a "idle period" occurs due to a respawn, and when a respawn occurs, PIP mode may be activated.

[0126] In relation to B, it is possible to detect the up-and-down movement of the game controller using the measurement values ​​of the gyro sensor included in the game controller, and through this, it is possible to detect whether the user has put the game controller down on a table, floor, etc., or picked it up again.

[0127] Accordingly, when the gyro sensor value has a value (or a range of values, a change in values) corresponding to being lowered, the multimedia device (100) can activate the PIP mode. As a result, a sub-window and an image can be output on the display (150). When the gyro sensor value has a value (or a range of values, a change in values) corresponding to being raised, the multimedia device (100) can deactivate the PIP mode. As a result, the sub-window and an image can disappear on the display (150).

[0128] As another embodiment, the activation trigger condition of the PIP mode may be set to include a case where at least one of A, B, or C is satisfied, unlike Table 1.

[0129] When the activation trigger condition of the PIP mode is met, the multimedia device (100) can activate the PIP mode (S330).

[0130] Meanwhile, the activated PIP mode can be deactivated again when the PIP mode deactivation trigger condition is satisfied. Here, the PIP mode deactivation trigger condition can be set differently depending on the PIP mode activation trigger. That is, if the PIP mode activation trigger condition is A, the PIP mode deactivation trigger condition is set to A' (condition “D” in Table 2 below).

[0131] There are various trigger conditions for deactivating the PIP mode, and these are stored in the storage unit (140) (hereinafter referred to as “memory”) of the multimedia device (100), and when the trigger condition is satisfied, the multimedia device (100) can deactivate the PIP mode.

[0132] Table 2 below shows the PIP mode deactivation trigger conditions stored in the memory of the multimedia device (100). The PIP mode deactivation trigger conditions may be set by combining two or more conditions, as shown in Table 2, 4 to 7. In addition to the PIP mode activation trigger conditions listed in Table 1, other trigger conditions may be used.

[0133] The deactivation trigger conditions D, E, and F of the PIP mode in Table 2 are set to correspond to the activation trigger conditions A, B, and C of the PIP mode in Table 1, respectively.

[0134]

[0135] No. PIP mode disable trigger condition details 1D When the game respawn waiting time has elapsed 2E When the gyro sensor value (or value change) of the game controller falls within a preset range 3F When a pre-specified input or operation is performed through the user input interface 4D+E 5D+F Even if a pre-specified input or operation is performed through the user input interface (condition F is satisfied), condition D must be satisfied for PIP mode to be activated 6E+F Even if a pre-specified input or operation is performed through the user input interface (condition F is satisfied), condition E must be satisfied for PIP mode to be activated 7D+E+F Even if a pre-specified input or operation is performed through the user input interface (condition F is satisfied), both conditions A and B must be satisfied for PIP mode to be activated

[0136] As another embodiment, the deactivation trigger condition of the PIP mode may be set to include a case where at least one of D, E, or F is satisfied, unlike Table 2.

[0137]

[0138] The multimedia device (100) can control the output of an image to a sub-window on the display (150) of the multimedia device (100) when the PIP mode is activated. Fig. 4 illustrates a flowchart of a control method of the multimedia device for activating the PIP mode according to the present invention. The present invention will be described with reference to Fig. 4.

[0139] More specifically, the multimedia device (100) can check whether there is a registered video for PIP mode (S410).

[0140] If there is a pre-registered image, the multimedia device (100) can be controlled to output the registered image to a sub window (S420).

[0141] If there is no pre-registered video, the multimedia device (100) can select a recommended video (S415).

[0142] For example, the multimedia device (100) may select at least one recommended video and present it to the user, allowing the user to select one of the recommended videos. As another example, the multimedia device (100) may select a recommended video, and the selection of the recommended video may be based on the user's past viewing history (or the video output history of the multimedia device (100)) or information related to the game in question. For example, the most frequently viewed or most recently played video may be selected as the recommended video.

[0143] As another example, the multimedia device (100) may select a recommended video, and the selection of the recommended video may be based on information about the progress of the game. For example, in the case of cloud gaming, metadata related to the progress of the game may be shared between the game server and the client (i.e., the multimedia device (100)). That is, the metadata may indicate the “idle period” described above, and accordingly, the video to be output to a sub-window, etc. may be selected. In addition, a video of a length corresponding to the length of the “idle period” may be selected.

[0144] Additionally, the multimedia device (100) may obtain age information based on user information when selecting recommended videos, and filter videos based on the obtained age information. For example, the user information may correspond to account information connected to the multimedia device (100) or a game server. The multimedia device (100) does not include videos that do not match the obtained age information in the recommended videos.

[0145] Meanwhile, in an environment where metadata related to the game progress status is shared between the game server and the multimedia device (100), the multimedia device (100) can detect whether the PIP mode activation trigger condition is satisfied based on the metadata. For example, if the metadata can indicate condition A of Table 1, the multimedia device (100) can detect whether condition A is satisfied from the received metadata. In addition, if the metadata is used as the PIP mode activation trigger condition, the trigger condition for deactivating the PIP mode can also be based on the metadata. If the metadata can indicate condition D of Table 2 (a condition corresponding to condition A of Table 1), the multimedia device (100) can detect whether condition D is satisfied from the received metadata.

[0146]

[0147] Additionally, the video output to the sub-window may be related to the game. For example, the video output to the sub-window may include a video explaining a strategy for playing the game, a video explaining a character in the game, etc.

[0148]

[0149] Additionally, the multimedia device (100) can monitor whether the PIP mode has been activated for a preset period of time. If the PIP mode has been activated for a preset period of time, the multimedia device (100) can control the display (150) to output the video to the main window instead of the sub-window. In this case, the multimedia device (100) can terminate the game in progress.

[0150] Alternatively, if the time for which the PIP mode is activated exceeds a preset time, the multimedia device (100) may be controlled to output the image to one of the multi-view mode windows of the display (150) instead of the sub-window.

[0151] Alternatively, if the PIP mode is activated for a preset period of time, the multimedia device (100) may output the video output in the sub-window through another app for that video. In this case, the multimedia device (100) may terminate the game in progress.

[0152] Alternatively, if the PIP mode is activated for a preset period of time, the multimedia device (100) may output a user interface on the display (150) that asks the user whether to continue outputting the video through the sub-window. If the user's continuation or interruption of the video output is detected through the user input interface, the multimedia device (100) continues or interrupts the video output to the sub-window. If the video output to the sub-window is interrupted, the multimedia device (100) does not display the sub-window itself on the display (150).

[0153]

[0154] FIG. 5 is a diagram for explaining the PIP mode and multi-view mode according to the present invention.

[0155] (a) indicates PIP mode, and a main window (V1) and a sub-window (V2) are output or displayed on a display screen (1500). The location of the sub-window (V2) is only an example, and the sub-window (V2) is displayed as a pop-up above the main window (V1) on the display screen (1500).

[0156] (b) represents a multi-view mode, in which a main window (V1) and a sub-window (V2) are output or displayed on a display screen (1500). Although the display screen (1500) is shown divided into two, it can be divided into more numbers.

[0157]

[0158] Figure 6 illustrates a block diagram of a device according to the present invention. The multimedia device (100) may include a game engine (181), a multi-view controller (182), and a display controller (183).

[0159] The game engine (181) can check whether the game console device is being operated and connected.

[0160] The game engine (181) can determine whether to activate the PIP mode by checking the game progress status (e.g., status such as respawn) according to the operating status of the game console device. If the PIP mode needs to be activated, the gain engine (181) can request the multi-view controller (182) to output the PIP screen. Accordingly, the multi-view controller (182) can request N (e.g., 2) screens from the display controller (183). The display controller (183) can output a registered video or a recommended video on at least one of the N screens.

[0161] In this case, the user can select a display output mode, which may include the aforementioned sub-window pop-up mode, multi-view mode, etc.

[0162]

[0163] In addition, as another aspect of the present invention, the operation of the proposal or invention described above may be implemented, performed or executed by a “computer” (a comprehensive concept including a system on chip (SoC) or a (micro) processor, etc.), or may be provided as a code or a computer-readable storage medium storing or including the code or a computer program product, and the scope of the present invention may be extended to the code or the computer-readable storage medium storing or including the code or the computer program product.

[0164]

[0165] The detailed description of the preferred embodiments of the present invention disclosed above has been provided to enable those skilled in the art to implement and practice the present invention. While the above description has been made with reference to preferred embodiments of the present invention, those skilled in the art will appreciate that various modifications and variations of the present invention, as defined by the following claims, are possible. Accordingly, the present invention is not intended to be limited to the embodiments disclosed herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. As a multimedia device, A display for outputting images through one or more windows; and a controller for controlling the display, The above controller: Detects whether the activation trigger condition of PIP (picture in picture) mode is met, Activate the PIP mode when the above activation trigger condition is met, The above activation trigger condition is related to the progress of the game through the multimedia device.

2. In paragraph 1, The above controller: Detecting whether the deactivation trigger condition of the above PIP mode is met, and deactivating the PIP mode when the deactivation trigger condition is met, A multimedia device wherein the above deactivation trigger condition is set differently depending on the above activation trigger condition.

3. In paragraph 1, The above controller: A multimedia device that controls the output of an image to a sub-window on the display when the PIP mode is activated.

4. A multimedia device according to claim 3, wherein the output image is an image associated with the game.

5. In paragraph 3, The above controller: A multimedia device that controls the output of the image to the main window or multi-view mode window of the display instead of the sub-window when the time for which the PIP mode is activated exceeds a preset time.

6. In paragraph 3, The above controller: A multimedia device that outputs a user interface that queries whether to continue outputting the image through the sub-window when the time for which the PIP mode is activated exceeds a preset time.

7. In paragraph 3, A multimedia device in which the above controller obtains past viewing history and selects an image to be output to the sub-window based on the obtained past viewing history.

8. In paragraph 3, A multimedia device in which the controller obtains information about the progress status of the game and selects an image to be output to the sub-window based on the obtained information.

9. A method for controlling a multimedia device, the method being performed by a multimedia device including a display that outputs an image through one or more windows; and a controller that controls the display, A step of detecting whether a trigger condition for activating PIP (picture in picture) mode is met; and comprising a step of activating the PIP mode when the above trigger condition is met; The above trigger condition is related to the progress of the game through the multimedia device.

10. In paragraph 9, A step of detecting whether the deactivation trigger condition of the above PIP mode is satisfied; and comprising a step of disabling the PIP mode when the above deactivation trigger condition is satisfied; A method in which the above deactivation trigger condition is set differently depending on the above activation trigger condition.

11. In paragraph 9, A method comprising a step of controlling an image to be output to a sub-window on the display when the PIP mode is activated.

12. In paragraph 11, A method in which the image output above is an image related to the game.

13. In paragraph 11, A method comprising a step of controlling the display to output the image to the main window or multi-view mode window of the display instead of the sub-window when the time for which the PIP mode is activated exceeds a preset time.

14. In paragraph 11, A method comprising the steps of obtaining past viewing history and selecting an image to be output to the sub-window based on the obtained past viewing history.

15. In paragraph 9, A method comprising the steps of obtaining information on the progress status of the game and selecting an image to be output to the sub-window based on the obtained information.

Images