Display device and operating method thereof

Abstract

A display device according to an embodiment disclosed herein may comprise: a display; a wireless communication interface for performing wireless communication with a fitness device; and a controller for receiving operable information of the fitness device from the fitness device through the wireless communication interface and, when one or more exercise factors for an exercise course are changed, transmitting an operation command generated on the basis of the operable information to the fitness device through the wireless communication interface.

Description

Display device and method of operation thereof

[0001] The present disclosure relates to a display device, and more specifically, to a display device linked with a fitness device.

[0002] Digital TV services using wired or wireless communication networks are becoming commonplace. Digital TV services can provide a variety of services that were not available through existing analog broadcasting services.

[0003] For example, digital TV services such as IPTV (Internet Protocol Television) and smart TV provide interactivity that allows users to actively select the types of programs and viewing time. Based on this interactivity, IPTV and smart TV services can also provide various additional services, such as internet search, home shopping, and online games.

[0004] Recent TVs provide exercise information through wearable devices linked to fitness equipment, such as treadmills or cycling machines, via applications related to the user's health.

[0005] Previously, users had to directly operate the fitness device while exercising.

[0006] However, manually operating fitness equipment while exercising interferes with the workout and causes inconvenience from the user's perspective. Furthermore, there is a risk that the user may get injured while operating the equipment during a workout.

[0007] The purpose of the present disclosure may be to provide a service that automatically operates a fitness device without the user having to operate the fitness device while the user is watching a display device and using the fitness device.

[0008] The purpose of the present disclosure may be to provide a service that allows users to perform exercises realistically without separate operation of fitness equipment while watching an exercise course video.

[0009] The purpose of the present disclosure may be to provide a service that reduces the risk of injury and enables exercise at one's own pace when one is fatigued or in poor physical condition during exercise.

[0010] A display device according to an embodiment of the present disclosure may include: a display; a wireless communication interface that performs wireless communication with a fitness device; and a controller that receives operable information of the fitness device from the fitness device through the wireless communication interface, and transmits an operable command generated based on the operable information to the fitness device through the wireless communication interface when one or more exercise factors for an exercise course are changed.

[0011] A method of operation of a display device according to an embodiment of the present disclosure may include: receiving operable information of the fitness device from a fitness device; determining whether one or more exercise factors for an exercise course are changed; and, if one or more exercise factors for the exercise course are changed, transmitting an operation command generated based on the operable information to the fitness device.

[0012] According to an embodiment of the present disclosure, a user can be provided with an experience in which a fitness device is automatically operated according to an exercise course without any input for operation on the fitness device during exercise. Accordingly, the user does not need to directly operate the fitness device during exercise, so the exercise is not interfered with.

[0013] According to an embodiment of the present disclosure, an exercise course can be generated in accordance with the context of an exercise course video. Accordingly, a user can perform exercise more realistically while viewing the exercise course video.

[0014] According to an embodiment of the present disclosure, if direct operation by a user occurs while the fitness device is operating on an exercise course selected via a display device, the user may temporarily deviate from the exercise course. Accordingly, when the user is fatigued or in poor physical condition, the user can reduce the risk of injury and enable exercise at their own pace.

[0015] According to an embodiment of the present disclosure, as exercise course video and real-time exercise information are provided together, the sense of immersion in exercise can be increased and the user's motivation to achieve goals can be enhanced.

[0016] According to an embodiment of the present disclosure, as the exercise factor of the fitness device and the factor of an object included in a video being played on a display device are synchronized, the user's immersion in exercise can be increased.

[0017] FIG. 1 is a block diagram illustrating the configuration of a display device according to one embodiment of the present invention.

[0018] FIG. 2 is a block diagram of a remote control device according to one embodiment of the present invention.

[0019] FIG. 3 shows an example of the actual configuration of a remote control device according to one embodiment of the present invention.

[0020] Figure 4 shows an example of utilizing a remote control device according to an embodiment of the present invention.

[0021] FIG. 5 is a drawing illustrating the configuration of a system according to one embodiment of the present disclosure.

[0022] FIG. 6 is a sequence diagram for explaining the operation method of a system according to an embodiment of the present disclosure.

[0023] FIG. 7 is a flowchart illustrating a process for determining whether a fitness device’s search condition is satisfied based on CPU usage and user viewing situation information according to an embodiment of the present disclosure.

[0024] FIGS. 8a to 8c are drawings illustrating an example of displaying a connection pop-up window for wireless connection with a fitness device according to one embodiment of the present disclosure.

[0025] FIG. 9 is a sequence diagram illustrating a BLE connection procedure between a display device and a fitness device according to one embodiment of the present disclosure.

[0026] FIG. 10 is a flowchart illustrating a process for determining a user's exercise state based on whether exercise data and video manipulation are detected, according to one embodiment of the present disclosure.

[0027] FIG. 11 is a drawing illustrating the results of an exercise according to one embodiment of the present disclosure.

[0028] Figure 12 is a diagram illustrating a disconnection notification window displayed on a display device as the fitness device and BLE connection are disconnected.

[0029] FIG. 13 is a sequence diagram for explaining a method of operation of a system according to one embodiment of the present disclosure.

[0030] FIG. 14 is a drawing illustrating an example of playing an exercise course video according to the selection of an exercise course according to one embodiment of the present disclosure.

[0031] FIGS. 15a to 15c are drawings illustrating a plurality of exercise courses according to an embodiment of the present disclosure.

[0032] FIGS. 16a and FIGS. 16b are drawings illustrating an example of generating an exercise course based on context information of a content image according to an embodiment of the present disclosure.

[0033] FIG. 17 is a sequence diagram for explaining a method of operation of a system according to another embodiment of the present disclosure.

[0034] Figure 18 is a diagram illustrating an example of providing exercise information and exercise course videos together during exercise through a fitness device.

[0035] FIG. 19 is a drawing illustrating an example of controlling a video being played based on exercise data received from a fitness device according to one embodiment of the present disclosure.

[0036] Hereinafter, embodiments related to the present invention will be described in more detail with reference to the drawings. The suffixes "module" and "part" for components used in the following description are assigned or used interchangeably solely for the ease of drafting the specification, and do not inherently have distinct meanings or roles.

[0037] A display device according to an embodiment of the present invention is, for example, an intelligent display device that adds computer support functions to a broadcast reception function. While faithful to the broadcast reception function, it also adds internet functions, and can be equipped with a more user-friendly interface such as a handwriting input device, a touch screen, or a spatial remote control. Furthermore, by supporting wired or wireless internet functions, it can be connected to the internet and a computer, and can perform functions such as email, web browsing, banking, or games. A standardized general-purpose OS may be used for these various functions.

[0038] Accordingly, the display device described in the present invention allows various applications to be freely added or removed, for example, on a general-purpose OS kernel, thereby enabling various user-friendly functions to be performed. More specifically, the display device may be, for example, a network TV, HBB TV, smart TV, LED TV, OLED TV, etc., and may also be applicable to smartphones depending on the circumstances.

[0039] FIG. 1 is a block diagram illustrating the configuration of a display device according to one embodiment of the present invention.

[0040] Referring to FIG. 1, the display device (100) may include a broadcast receiver (130), an external device interface (135), a memory (140), a user input interface (150), a controller (170), a wireless communication interface (173), a display (180), a speaker (185), and a power supply circuit (190).

[0041] The broadcast receiver (130) may include a tuner (131), a demodulator (132), and a network interface (133).

[0042] The tuner (131) can tune to a specific broadcast channel according to a channel tuning command. The tuner (131) can receive a broadcast signal for the tuned specific broadcast channel.

[0043] The demodulator (132) can separate the received broadcast signal into a video signal, an audio signal, and a data signal related to the broadcast program, and can restore the separated video signal, audio signal, and data signal into a form that can be output.

[0044] The external device interface (135) can receive an application or a list of applications within an adjacent external device and transmit it to the controller (170) or memory (140).

[0045] The external device interface (135) can provide a connection path between the display device (100) and an external device. The external device interface (135) can receive one or more of video and audio output from an external device connected to the display device (100) wirelessly or via a wired connection, and transmit them to the controller (170). The external device interface (135) may include a plurality of external input terminals. The plurality of external input terminals may include an RGB terminal, one or more HDMI (High Definition Multimedia Interface) terminals, and a component terminal.

[0046] The video signal of an external device input through the external device interface (135) can be output through the display (180). The audio signal of an external device input through the external device interface (135) can be output through the speaker (185).

[0047] The external device that can be connected to the external device interface (135) may be any one of a set-top box, Blu-ray player, DVD player, game console, soundbar, smartphone, PC, USB memory, or home theater, but this is merely an example.

[0048] The network interface (133) may provide an interface for connecting the display device (100) to a wired / wireless network including the Internet network. The network interface (133) may transmit or receive data to or from other users or other electronic devices through the connected network or another network linked to the connected network.

[0049] In addition, some of the content data stored in the display device (100) can be transmitted to another user or other electronic device selected among other users or other electronic devices that are previously registered in the display device (100).

[0050] The network interface (133) can access a specific web page through a connected network or another network linked to the connected network. That is, it can access a specific web page through a network and transmit or receive data with the corresponding server.

[0051] Additionally, the network interface (133) can receive content or data provided by a content provider or network operator. That is, the network interface (133) can receive content such as movies, advertisements, games, VOD, broadcast signals, and related information provided by a content provider or network provider through a network.

[0052] Additionally, the network interface (133) can receive firmware update information and update files provided by the network operator, and can transmit data to the internet or a content provider or network operator.

[0053] The network interface (133) can select and receive a desired application among the applications that are open to the public through the network.

[0054] The memory (140) can store programs for each signal processing and control within the controller (170), and can store signal-processed video, audio, or data signals.

[0055] Additionally, the memory (140) may perform the function of temporarily storing video, audio, or data signals input from an external device interface (135) or a network interface (133), and may also store information regarding a predetermined image through a channel memory function.

[0056] The memory (140) can store an application or a list of applications input from an external device interface (135) or a network interface (133).

[0057] The display device (100) can play content files (video files, still image files, music files, document files, application files, etc.) stored in memory (140) and provide them to the user.

[0058] The user input interface (150) can transmit a signal input by the user to the controller (170) or transmit a signal from the controller (170) to the user. For example, the user input interface (150) can receive and process control signals such as power on / off, channel selection, and screen setting from the remote control device (200) according to various communication methods such as Bluetooth, Ultra Wideband (WB), ZigBee, Radio Frequency (RF) communication, or Infrared (IR) communication, or process to transmit control signals from the controller (170) to the remote control device (200).

[0059] Additionally, the user input interface (150) can transmit control signals input from local keys (not shown), such as power key, channel key, volume key, and setting value, to the controller (170).

[0060] The image signal processed by the controller (170) can be input to the display (180) and displayed as an image corresponding to the image signal. Additionally, the image signal processed by the controller (170) can be input to an external output device through the external device interface (135).

[0061] The voice signal processed by the controller (170) can be output as audio to the speaker (185). Additionally, the voice signal processed by the controller (170) can be input to an external output device through the external device interface (135).

[0062] In addition, the controller (170) can control the overall operation within the display device (100).

[0063] Additionally, the controller (170) can control the display device (100) by means of user commands or internal programs entered through the user input interface (150), and can connect to a network to allow the user to download an application or a list of applications desired by the user into the display device (100).

[0064] The controller (170) enables the processed video or audio signal, such as channel information selected by the user, to be output through the display (180) or speaker (185).

[0065] Additionally, the controller (170) enables a video signal or audio signal from an external device, such as a camera or camcorder, input through the external device interface (135) according to an external device video playback command received through the user input interface (150), to be output through the display (180) or speaker (185).

[0066] Meanwhile, the controller (170) can control the display (180) to display video, for example, broadcast video input through the tuner (131), external input video input through the external device interface (135), video input through the network interface, or video stored in the memory (140) can be controlled to be displayed on the display (180). In this case, the video displayed on the display (180) may be a still image or a video, and may be a 2D image or a 3D image.

[0067] Additionally, the controller (170) can control the playback of content stored in the display device (100), received broadcast content, or external input content input from the outside, and the content may be in various forms such as broadcast video, external input video, audio file, still image, connected web screen, and document file.

[0068] The wireless communication interface (173) can communicate with an external device via wired or wireless communication. The wireless communication interface (173) can perform short-range communication with an external device. To this end, the wireless communication interface (173) can support short-range communication by using at least one of Bluetooth™, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, and Wireless Universal Serial Bus (Wireless USB) technologies. Such wireless communication interface (173) can support wireless communication between the display device (100) and a wireless communication system, between the display device (100) and another display device (100), or between the display device (100) and a network where the display device (100, or an external server) is located, through wireless area networks. Short-range wireless communication networks can be Wireless Personal Area Networks.

[0069] Here, another display device (100) may be a mobile terminal such as a wearable device (e.g., a smartwatch, smart glass, HMD (head mounted display)), a smartphone, etc., capable of exchanging data with (or interacting with) the display device (100) according to the present invention. The wireless communication interface (173) may detect (or recognize) a wearable device capable of communicating around the display device (100).

[0070] Furthermore, if the detected wearable device is a device authenticated to communicate with the display device (100) according to the present invention, the controller (170) can transmit at least a portion of the data processed in the display device (100) to the wearable device through the wireless communication interface (173). Accordingly, the user of the wearable device can use the data processed in the display device (100) through the wearable device.

[0071] The display (180) can generate a driving signal by converting the video signal, data signal, OSD signal processed by the controller (170) or the video signal, data signal, etc. received from the external device interface (135) into R, G, and B signals, respectively.

[0072] Meanwhile, since the display device (100) illustrated in FIG. 1 is merely an embodiment of the present invention, some of the illustrated components may be integrated, added, or omitted depending on the specifications of the actual implemented display device (100).

[0073] That is, as needed, two or more components may be combined into a single component, or a single component may be subdivided into two or more components. In addition, the functions performed in each block are intended to explain embodiments of the present invention, and the specific operations or devices thereof do not limit the scope of the present invention.

[0074] According to another embodiment of the present invention, the display device (100) may receive and play video through a network interface (133) or an external device interface (135) without having a tuner (131) and a demodulator (132), unlike as shown in FIG. 1.

[0075] For example, the display device (100) may be implemented by separating it into a video processing device, such as a set-top box, for receiving broadcast signals or content according to various network services, and a content playback device for playing content input from the video processing device.

[0076] In this case, the operation method of a display device according to an embodiment of the present invention described below may be performed not only by the display device (100) described with reference to FIG. 1, but also by any one of an image processing device such as the separated set-top box, or a content playback device having a display (180) and a speaker (185).

[0077] Next, with reference to FIGS. 2 and 3, a remote control device according to an embodiment of the present invention will be described.

[0078] FIG. 2 is a block diagram of a remote control device according to one embodiment of the present invention, and FIG. 3 shows an example of the actual configuration of a remote control device (200) according to one embodiment of the present invention.

[0079] First, referring to FIG. 2, the remote control device (200) may include a fingerprint reader (210), a wireless communication circuit (220), a user input interface (230), a sensor (240), an output interface (250), a power supply circuit (260), a memory (270), a controller (280), and a microphone (290).

[0080] Referring to FIG. 2, the wireless communication circuit (220) transmits and receives signals with any one of the display devices according to the embodiments of the present invention described above.

[0081] The remote control device (200) is equipped with an RF circuit (221) capable of transmitting and receiving signals to and from the display device (100) according to RF communication standards, and may be equipped with an IR circuit (223) capable of transmitting and receiving signals to and from the display device (100) according to IR communication standards. Additionally, the remote control device (200) may be equipped with a Bluetooth circuit (225) capable of transmitting and receiving signals to and from the display device (100) according to Bluetooth communication standards. Furthermore, the remote control device (200) may be equipped with an NFC circuit (227) capable of transmitting and receiving signals to and from the display device (100) according to NFC (Near Field Communication) communication standards, and may be equipped with a WLAN circuit (229) capable of transmitting and receiving signals to and from the display device (100) according to WLAN (Wireless LAN) communication standards.

[0082] Additionally, the remote control device (200) transmits a signal containing information regarding the movement of the remote control device (200), etc., to the display device (100) through a wireless communication circuit (220).

[0083] Meanwhile, the remote control device (200) can receive a signal transmitted by the display device (100) through the RF circuit (221), and, if necessary, can transmit commands regarding power on / off, channel change, volume change, etc. to the display device (100) through the IR circuit (223).

[0084] The user input interface (230) may be composed of a keypad, buttons, a touchpad, or a touch screen. The user can input commands related to the display device (100) to the remote control device (200) by operating the user input interface (230). If the user input interface (230) is equipped with a hard key button, the user can input commands related to the display device (100) to the remote control device (200) through a push operation of the hard key button. This will be explained with reference to FIG. 3.

[0085] Referring to FIG. 3, the remote control device (200) may include a plurality of buttons. The plurality of buttons may include a fingerprint recognition button (212), a power button (231), a home button (232), a live button (233), an external input button (234), a volume control button (235), a voice recognition button (236), a channel change button (237), a confirmation button (238), and a back button (239).

[0086] The fingerprint recognition button (212) may be a button for recognizing a user's fingerprint. In one embodiment, the fingerprint recognition button (212) may be capable of a push operation and may receive a push operation and a fingerprint recognition operation.

[0087] The power button (231) may be a button for turning the power of the display device (100) on / off.

[0088] The home button (232) may be a button for moving to the home screen of the display device (100).

[0089] The live button (233) may be a button for displaying a live broadcast program.

[0090] The external input button (234) may be a button for receiving an external input connected to the display device (100).

[0091] The volume control button (235) may be a button for adjusting the volume output by the display device (100).

[0092] The voice recognition button (236) may be a button for receiving the user's voice and recognizing the received voice.

[0093] The channel change button (237) may be a button for receiving a broadcast signal of a specific broadcast channel.

[0094] The confirmation button (238) may be a button for selecting a specific function, and the back button (239) may be a button for returning to the previous screen.

[0095] Figure 2 is explained again.

[0096] If the user input interface (230) is equipped with a touchscreen, the user can input commands related to the display device (100) to the remote control device (200) by touching the soft keys on the touchscreen. Additionally, the user input interface (230) may be equipped with various types of input means that the user can operate, such as scroll keys or jog keys, and this embodiment does not limit the scope of the present invention.

[0097] The sensor (240) may be equipped with a gyroscope sensor (241) or an accelerometer sensor (243), and the gyroscope sensor (241) may sense information regarding the movement of the remote control device (200).

[0098] For example, the gyroscope sensor (241) can sense information regarding the operation of the remote control device (200) based on the x, y, and z axes, and the accelerometer sensor (243) can sense information regarding the movement speed of the remote control device (200). Meanwhile, the remote control device (200) may further be equipped with a distance measuring sensor to sense the distance to the display (180) of the display device (100).

[0099] The output interface (250) can output a video or audio signal corresponding to the operation of the user input interface (230) or a signal transmitted from the display device (100).

[0100] The user can recognize whether the output interface (250) is operated by the user input interface (230) or whether the display device (100) is controlled.

[0101] For example, the output interface (250) may be equipped with an LED (251) that lights up when the user input interface (230) is operated or when a signal is transmitted or received with the display device (100) through the wireless communication circuit (220), a vibrator (253) that generates vibration, a speaker (255) that outputs sound, or a display (257) that outputs video.

[0102] Additionally, the power supply circuit (260) supplies power to the remote control device (200), and can reduce power waste by stopping the power supply when the remote control device (200) does not move for a predetermined period of time.

[0103] The power supply circuit (260) can resume power supply when a predetermined key provided in the remote control device (200) is operated.

[0104] The memory (270) can store various types of programs, application data, etc. required for the control or operation of the remote control device (200).

[0105] When the remote control device (200) transmits and receives signals wirelessly through the RF circuit (221) and the display device (100), the remote control device (200) and the display device (100) transmit and receive signals through a predetermined frequency band.

[0106] The controller (280) of the remote control device (200) can store and refer to information regarding frequency bands, etc., that can wirelessly transmit and receive signals with the display device (100) paired with the remote control device (200) in the memory (270).

[0107] The controller (280) controls all matters related to the control of the remote control device (200). The controller (280) can transmit a signal corresponding to a predetermined key operation of the user input interface (230) or a signal corresponding to the movement of the remote control device (200) sensed by the sensor (240) to the display device (100) through the wireless communication circuit (220).

[0108] In addition, the microphone (290) of the remote control device (200) can acquire voice.

[0109] The microphone (290) may be provided in multiple numbers.

[0110] Next, Figure 4 is explained.

[0111] Figure 4 shows an example of utilizing a remote control device according to an embodiment of the present invention.

[0112] FIG. 4(a) illustrates a pointer (205) corresponding to a remote control device (200) being displayed on a display (180).

[0113] The user can move or rotate the remote control device (200) up and down, left and right. The pointer (205) displayed on the display (180) of the display device (100) corresponds to the movement of the remote control device (200). Since the pointer (205) of the remote control device (200) moves and is displayed according to the movement in 3D space as shown in the drawing, it can be named a spatial remote control.

[0114] FIG. 4(b) illustrates that when the user moves the remote control device (200) to the left, the pointer (205) displayed on the display (180) of the display device (100) also moves to the left in response.

[0115] Information regarding the movement of the remote control device (200) detected through the sensor of the remote control device (200) is transmitted to the display device (100). The display device (100) can calculate the coordinates of the pointer (205) from the information regarding the movement of the remote control device (200). The display device (100) can display the pointer (205) to correspond to the calculated coordinates.

[0116] FIG. 4(c) illustrates a case where, while pressing a specific button within the remote control device (200), the user moves the remote control device (200) away from the display (180). By doing so, the selected area within the display (180) corresponding to the pointer (205) can be zoomed in and enlarged.

[0117] Conversely, when the user moves the remote control device (200) closer to the display (180), the selected area within the display (180) corresponding to the pointer (205) can be zoomed out and reduced in size.

[0118] Meanwhile, when the remote control device (200) moves away from the display (180), the selected area may be zoomed out, and when the remote control device (200) moves closer to the display (180), the selected area may be zoomed in.

[0119] Additionally, when a specific button within the remote control device (200) is pressed, recognition of up-down and left-right movement may be excluded. That is, when the remote control device (200) moves away from or closer to the display (180), up-down, left-right movement is not recognized, and only forward-backward movement is recognized. When the specific button within the remote control device (200) is not pressed, only the pointer (205) moves according to the up-down, left-right movement of the remote control device (200).

[0120] Meanwhile, the movement speed or direction of movement of the pointer (205) can correspond to the movement speed or direction of movement of the remote control device (200).

[0121] Meanwhile, the pointer in this specification refers to an object displayed on the display (180) in response to the operation of the remote control device (200). Accordingly, the pointer (205) can be an object of various shapes other than the arrow shape shown in the drawing. For example, it may be a concept including a point, a cursor, a prompt, a thick outline, etc. Furthermore, the pointer (205) can be displayed corresponding to either a point on the horizontal axis or a vertical axis on the display (180), and it is also possible to display it corresponding to multiple points, such as a line or a surface.

[0122] FIG. 5 is a drawing illustrating the configuration of a system according to one embodiment of the present disclosure.

[0123] Referring to FIG. 5, a system (50) according to one embodiment of the present disclosure may include a display device (100) and a fitness device (500).

[0124] The display device (100) can provide fitness services using a Fitness Machine Service (FTMS) standard protocol used to receive exercise information from the fitness device (500) or to control the fitness device (500).

[0125] The fitness device (500) may be an exercise device such as a treadmill or a cycling machine that can communicate with an external device.

[0126] The display device (100) and the fitness device (500) can perform wireless communication through a short-range wireless communication standard. The short-range wireless communication standard may be a Bluetooth Low Energy (BLE) communication standard.

[0127] Each of the display device (100) and the fitness device (500) may be equipped with a BLE communication circuit.

[0128] FIG. 6 is a sequence diagram for explaining the operation method of a system according to an embodiment of the present disclosure.

[0129] Referring to FIG. 6, the controller (170) of the display device (100) can obtain at least one of the usage rate of the Central Processing Unit (CPU) or information on the user's viewing situation (S601).

[0130] In one embodiment, the central processing unit may be an element included in the controller (170). The controller (170) may include a plurality of hardware chips, and the CPU may be one of the chips.

[0131] In another embodiment, the central processing unit may be the same component as the controller (170).

[0132] The CPU usage rate may be a value that measures how much the CPU is being used in the display device (100). The CPU usage rate may represent the ratio between the CPU's available capacity and the capacity currently being used. The CPU usage rate may represent the ratio between the CPU's processing capacity and the capacity currently being used.

[0133] The user's viewing situation information may include at least one of the following: information indicating a situation in which the user is viewing a screen other than the home screen of the display device (100), or information indicating a situation in which the user's remote control device (200) is not operated.

[0134] The user's viewing situation information may include at least one of the viewing time during which the user watched a screen other than the home screen or the time during which the remote control device (200) was not operated.

[0135] In one embodiment, the home screen may be an initial screen displayed when the power of the display device (100) is turned on.

[0136] The controller (170) can count the viewing time during which the display (180) is watching a screen other than the home screen. The screen other than the home screen may be either the execution screen of a specific application or a live broadcast screen.

[0137] The controller (170) can count the non-operation time of the remote control device (200). The controller (170) can count the non-operation time elapsed from the time the control signal was last received from the remote control device (200) until a new control signal is received.

[0138] The controller (170) of the display device (100) can determine whether the search conditions of the fitness device (500) are satisfied based on the acquired CPU usage rate and the acquired user viewing situation information (S603).

[0139] In one embodiment, the search condition of the fitness device (500) may be a condition for initiating the search of the fitness device (500).

[0140] The controller (170) can determine whether the search conditions of the fitness device (500) are satisfied based on the CPU usage rate, the viewing time of screens other than the home screen, and the time not operated by the remote control device (200).

[0141] This will be explained with reference to Fig. 7.

[0142] FIG. 7 is a flowchart illustrating a process for determining whether a fitness device’s search condition is satisfied based on CPU usage and user viewing situation information according to an embodiment of the present disclosure.

[0143] Referring to FIG. 7, the controller (170) of the display device (100) can determine whether the CPU usage rate is smaller than a preset rate (S701).

[0144] The pre-set ratio may be 50%, but this is merely an example.

[0145] The controller (170) of the display device (100) can determine whether a screen other than the home screen is being viewed when the CPU usage rate is less than a preset rate (S703).

[0146] The controller (170) can determine whether the user is viewing a screen other than the home screen by comparing the initial screen, which is the home screen, with the screen displayed by the current display (180).

[0147] When the CPU usage rate is less than a preset rate, the controller (170) can measure the viewing time of screens other than the home screen and determine whether the viewing time is greater than the first reference time.

[0148] The first standard time may be 1 minute, but this is merely an example.

[0149] The controller (170) of the display device (100) can determine whether the CPU usage rate is lower than a preset rate, whether a screen other than the home screen is being viewed, and whether the remote control device (200) is not being operated (S705).

[0150] If the controller (170) does not receive a control signal from the remote control device (200), it can determine that the remote control device (200) is not operated.

[0151] The controller (170) can determine that the search conditions of the fitness device (500) are satisfied if the CPU usage rate is lower than the preset rate and the user is watching a screen other than the home screen, and if the remote control device (200) is not operated.

[0152] The controller (170) can measure the time during which the remote control device (200) is not operated and determine whether the measured time during which the operation is not operated is greater than a second reference time. The second reference time may be 30 seconds, but this is merely an example and may be equal to the first reference time.

[0153] As another example, the controller (170) can determine that the search conditions of the fitness device (500) are satisfied if the CPU usage rate is less than a preset rate, the viewing time of screens other than the home screen is greater than a first reference time, and the non-operation time of the remote control device (200) is greater than a second reference time.

[0154] As another example, the controller (170) can determine that the search conditions of the fitness device (500) are satisfied if the CPU usage rate is less than a preset rate and the viewing time of a screen other than the home screen is greater than a first reference time.

[0155] As another example, the controller (170) can determine that the search condition of the fitness device (500) is satisfied if the CPU usage rate is less than a preset rate and the non-operation time of the remote control device (200) is greater than a second reference time.

[0156] Again, Figure 6 is explained.

[0157] The controller (170) of the display device (100) can start a device scan (or device search) based on the determination that the search conditions of the fitness device (500) are satisfied (S605).

[0158] The controller (170) can start scanning for devices using a Bluetooth Low Energy (BLE) communication circuit. The wireless communication interface (173) may be equipped with a BLE communication circuit.

[0159] The controller (170) can adjust the scan interval and scan window of the BLE communication circuit for device scanning.

[0160] The scan interval is the device's scan cycle, which may be the period during which the BLE communication circuit searches for advertising signals broadcast from the surroundings.

[0161] The scan window may be the time during which the BLE communication circuit performs an actual scan. The scan window may be the time during which the BLE communication circuit activates the radio frequency to receive an advertisement signal.

[0162] The controller (170) can adjust the scan interval and scan window of the BLE communication circuit so as not to affect other wireless communication functions of the display device (100).

[0163] For example, the scan interval can be set to 1860.625 msec and the scan window to 202.500 msec. As another example, the scan interval can be set to 3120.000 msec and the scan window to 160.000 msec.

[0164] The controller (170) of the display device (100) can receive a communication signal from the fitness device (500) through a wireless communication interface (173) (S607).

[0165] In one embodiment, the communication signal may be an advertisement signal for the fitness device (500) to announce its presence to the outside. The advertisement signal may include information about an external device transmitting the advertisement signal. The information about the external device may include one or more of a service UUID, the name of the device, or the type of the device.

[0166] If the external device is a fitness device (500), the advertising signal may include at least one of a Service Universally Unique Identifier (Service UUID) that identifies the fitness device (500) or the service provided by the fitness device (500), the name of the fitness device (500), or the type of the fitness device (500).

[0167] The type of fitness device (500) can identify what kind of device the fitness device (500) is. The type of fitness device (500) may represent any one of a treadmill, a cross trainer, a step climber, a stair climber, a lower, or an indoor bike.

[0168] The BLE circuit equipped in the fitness device (500) can periodically broadcast an advertisement signal.

[0169] The controller (170) can receive an advertisement signal broadcast from the fitness device (500) in the section corresponding to the scan window.

[0170] The controller (170) of the display device (100) can display a connection pop-up window on the display (180) based on a communication signal received from the fitness device (500) (S609).

[0171] In one embodiment, the controller (170) can determine whether the discovered device is a fitness device (500) based on information included in the communication signal. The controller (170) can recognize that the device that transmitted the advertisement signal is a fitness device (500) if at least one of the service UUID, the name of the device, or the type of the device included in the advertisement signal indicates a fitness device (500).

[0172] Based on the recognition of the fitness device (500), the controller (170) can display a connection pop-up window for BLE connection with the fitness device (500) on the display (180).

[0173] In another embodiment, the controller (170) may display a connection pop-up window on the display (180) when the external device is recognized as a fitness device (500) based on an advertisement signal received from an external device and an operation trigger is received from the fitness device (500). The operation trigger may be a signal indicating that the user is operating the fitness device (500). For example, if the fitness device (500) is an indoor bike, the indoor bike may generate an operation trigger when the user pedals.

[0174] From an actual user's perspective, a connection pop-up window may be displayed the moment the user pedals the indoor bike.

[0175] The operation trigger may be included in the advertisement signal or transmitted to the display device (100) separately from the advertisement signal.

[0176] In another embodiment, the controller (170) can display a connection pop-up window on the display (180) when the power of the fitness device (500) is turned on and the controller (170) recognizes the external device as the fitness device (500) based on an advertisement signal received from the external device.

[0177] FIGS. 8a to 8c are drawings illustrating an example of displaying a connection pop-up window for wireless connection with a fitness device according to one embodiment of the present disclosure.

[0178] In FIGS. 8a to 8c, the display device (100) may be playing a content video (800) on the display (180). The content video (800) may be a live broadcast video, a video provided through a video streaming application, or an execution screen of a specific application.

[0179] First, Figure 8a will be explained.

[0180] FIG. 8a is an example in which a display device (100) displays a pop-up window for BLE connection with a fitness device (500).

[0181] When the display device (100) receives an advertisement signal from the first fitness device (500-1) and recognizes that it is a fitness device, it may display a first pop-up window (810) for BLE connection with the first fitness device (500-1) on the display (180). The first pop-up window (810) may be displayed superimposed on the content image (800).

[0182] The first pop-up window (810) may include text inquiring about a connection, indicating that the first fitness device (500-1) has been discovered. The first pop-up window (810) may include an agreement button (811) and a floating agreement button (812).

[0183] The display device (100) can perform a BLE connection procedure with the first fitness device (500-1) upon receiving a command to select the consent button (811).

[0184] The display device (100) receives an advertisement signal from the first fitness device (500-1) and recognizes that it is a fitness device, and when it receives an operation trigger indicating that the first fitness device (500-1) is being operated, it can display the first pop-up window (810) on the display (180).

[0185] When the power of the first fitness device (500-1) is turned on and the display device (100) receives an advertisement signal from the first fitness device (500-1) and recognizes that it is a fitness device, it can display a first pop-up window (810) for BLE connection with the first fitness device (500-1) on the display (180).

[0186] Thus, according to an embodiment of the present disclosure, when a user uses a fitness device (500) while watching a content video (800) of a display device (100), a natural connection process between the fitness device (500) and the display device (100) can be provided without a complex process.

[0187] Next, Fig. 8b is explained.

[0188] FIG. 8b is an example of a case where a display device (100) searches for a plurality of fitness devices (500-1, 500-2).

[0189] When the display device (100) receives an advertisement signal from the first fitness device (500-1) and recognizes that it is a fitness device, and receives an advertisement signal from the second fitness device (500-2) and recognizes that it is a fitness device, it can display a second pop-up window (820) on the display (180). The second pop-up window (820) can be displayed superimposed on the content image (800).

[0190] The second pop-up window (820) may include text asking which device to connect to, and that the first and second fitness devices (500-1, 500-2) have been discovered.

[0191] The second pop-up window (820) may further include a first device name (821) indicating the name of the first fitness device (500-1) and a second device name (822) indicating the name of the second fitness device (500-2).

[0192] The display device (100) can perform a BLE connection procedure to a fitness device corresponding to the selected device name upon receiving a command to select either the first device name (821) or the second device name (822).

[0193] In another embodiment, even if the display device (100) receives an advertisement signal from the first fitness device (500-1) and recognizes that it is a fitness device, and receives an advertisement signal from the second fitness device (500-2) and recognizes that it is a fitness device, it may display a pop-up window on the display (180) that includes only the name of the device that transmitted the operation trigger among the two fitness devices.

[0194] In this way, according to an embodiment of the present disclosure, while watching the content video (800) of the display device (100), the user can experience a natural connection process between the fitness device (500) and the display device (100) without a complex process, even when multiple fitness devices are connected.

[0195] Next, Fig. 8c is explained.

[0196] FIG. 8c is an example of a case where a display device (100) searches for multiple fitness devices (500-1, 500-2) that have previously been connected.

[0197] When the display device (100) receives an advertisement signal from the first fitness device (500-1) and recognizes that it is a fitness device, and receives an advertisement signal from the second fitness device (500-2) and recognizes that it is a fitness device, it can display a third pop-up window (830) on the display (180). The third pop-up window (830) can be displayed superimposed on the content image (800).

[0198] The third pop-up window (830) may include text asking which device to connect to, as multiple fitness devices have been discovered.

[0199] The third pop-up window (830) may further include a third device name (831) indicating the name of the first fitness device (500-1) and a fourth device name (832) indicating the name of the second fitness device (500-2).

[0200] The third device name (831) may be a combination of the user account and the name of the first fitness device (500-1).

[0201] The display device (100) can store a third device name (831) in memory (140) by combining the name (Bike) of a first fitness device (500-1) that has previously been connected and a user account (Tom) logged into the display device (100). When the first fitness device (500-1) is re-recognized, the display device (100) can display a third pop-up window (830) containing the third device name (831) stored in memory (140) on the display (180).

[0202] The display device (100) can store a fourth device name (832) in memory (140) by combining the name (Treadmill) of the second fitness device (500-2) that was previously connected and the name (LK61TV) of the display device (100). When the second fitness device (500-2) is re-recognized, the display device (100) can display a third pop-up window (830) containing the fourth device name (832) stored in memory (140) on the display (180).

[0203] That is, when a fitness device (500) that has a connection history is re-recognized by the display device (100), it can display a pop-up window using the device name stored in the memory (140). As a result, when similar fitness devices are connected to the display device (100), it can be clearly distinguished which device is the one used by the user through the device name.

[0204] Meanwhile, the name of the fitness device (500) connected to the display device (100) via BLE can be edited according to user input. The display device (100) can display a device name editing menu and can store the device name entered through the device name editing menu in memory (140). When the fitness device (500) is re-recognized, the display device (100) can display a pop-up window containing the stored device name on the display (180).

[0205] The display device (100) can perform a BLE connection procedure to a fitness device corresponding to the selected device name upon receiving a command to select either a third device name (831) or a fourth device name (832).

[0206] Again, Figure 6 is explained.

[0207] The controller (170) of the display device (100) can receive a connection confirmation command (S611), and can perform a connection procedure with the fitness device (500) according to the received connection confirmation command (S613).

[0208] The controller (170) can obtain a command to select the consent button (811) of FIG. 8a as a connection confirmation command.

[0209] The controller (170) can obtain a command to select either the first device name (821) or the second device name (822) of FIG. 8b as a connection confirmation command.

[0210] The controller (170) can obtain a command to select either the third device name (831) or the fourth device name (832) of FIG. 8c as a connection confirmation command.

[0211] The controller (170) can receive a connection confirmation command from the remote control device (200) through the user input interface (150).

[0212] The controller (170) can perform a BLE connection procedure with the fitness device (500) upon receiving a connection confirmation command. The BLE connection procedure is described with reference to FIG. 9.

[0213] FIG. 9 is a sequence diagram illustrating a BLE connection procedure between a display device and a fitness device according to one embodiment of the present disclosure.

[0214] FIG. 9 may be an example illustrating at least part of the process of step S613 of FIG. 6.

[0215] Referring to FIG. 9, the controller (170) of the display device (100) can perform a GATT (Generic Attribute Profile) connection with the fitness device (500) through a BLE circuit (S901).

[0216] GATT can define a method for exchanging profiles and data through a BLE connection.

[0217] A GATT connect request may be a request for setting up to exchange data between a display device (100) and a fitness device (500) via the GATT protocol.

[0218] Step S901 may include steps S605 and S607 of FIG. 6.

[0219] The controller (170) of the display device (100) can transmit a Service discovery request through a BLE circuit (S903).

[0220] A service discovery request may be a request to search for what services the fitness device (500) provides. A service discovery request may be a request for a list of services provided by the fitness device (500).

[0221] For example, if the fitness device (500) is an indoor bike, the list of services may include a service for managing speed and a service for managing calorie consumption.

[0222] The controller (170) of the display device (100) can receive a list of services from the fitness device (500) in response to a service discovery request via a BLE circuit (S904).

[0223] The controller (170) of the display device (100) can send a Get Service request through the BLE circuit (S905) and receive a Service response from the fitness device (500) (S907).

[0224] A Get Service request may be a request to select a specific service from a list of services. The controller (170) may receive the selected specific service in response to the Get Service request.

[0225] The controller (170) of the display device (100) can transmit a characteristic data request to the fitness device (500) via a BLE circuit (S909).

[0226] A characteristic data request may be a request to read characteristic data provided through a selected service. For example, the characteristic data may be specific data provided through the selected service, such as the real-time speed or calories burned of an indoor bike.

[0227] The controller (170) of the display device (100) can receive a characteristic data response through a BLE circuit in response to a characteristic data request (S911).

[0228] The characteristic data response may be a response indicating that the requested characteristic data will be provided.

[0229] The controller (170) of the display device (100) can transmit a Set notification through a BLE circuit (S913).

[0230] Set notification may be a notification that automatically receives changed characteristic data whenever characteristic data, such as the speed or calorie consumption of the indoor bike, changes. The display device (100) can receive and update characteristic data in real time through Set notification without having to request characteristic data every time.

[0231] Again, Figure 6 is explained.

[0232] The controller (170) of the display device (100) can receive exercise data from the fitness device (500) through a wireless communication interface (173) (S615).

[0233] Exercise data may be characteristic data of the service described in FIG. 9. If the fitness device (500) is an indoor bike, the exercise data may include one or more of instantaneous speed, average speed, instantaneous cadence, average cadence, low-energy level, calories burned, exercise time, and time remaining.

[0234] The controller (170) of the display device (100) can determine whether the user's exercise state is a continuous exercise state based on the received exercise data (S617).

[0235] The user's exercise state may include an exercise continuation state and an exercise termination state.

[0236] The exercise continuation state may be a state in which the user is continuing to exercise. The exercise continuation state may include a state in which the user is not currently exercising but is predicted to continue exercising after a predetermined period of time.

[0237] The exercise end state may be a state where the user has ended the exercise. The exercise end state may include a state where the user is not currently exercising and is predicted not to continue exercising in the future.

[0238] In one embodiment, the controller (170) can determine the user's exercise state as an exercise continuing state if the value of the received exercise data is greater than 0, and can determine the user's exercise state as an exercise ending state if the value of the received exercise data is 0. For example, the controller (170) can determine the user's exercise state as an exercise continuing state if the RPM (Revolution Per Minute) received from the indoor bike is greater than 0, and can determine the user's exercise state as an exercise ending state if the RPM is 0.

[0239] In another embodiment, the controller (170) can determine the user's exercise state as an exercise continuation state if the value of the received exercise data changes within a certain period of time, and can determine the user's exercise state as an exercise termination state if the value of the received exercise data does not change for a certain period of time. For example, the controller (170) can determine the user's exercise state as an exercise continuation state if the SPM (Stroke Per Minute) received from Rower increases within a certain period of time, and can determine the user's exercise state as an exercise termination state if the SPM does not increase for a certain period of time.

[0240] In another embodiment, the controller (170) can determine the user's exercise state based on exercise data and whether the user's video manipulation is detected.

[0241] FIG. 10 is a flowchart illustrating a process for determining a user's exercise state based on whether exercise data and video manipulation are detected, according to one embodiment of the present disclosure.

[0242] Referring to FIG. 10, the controller (170) can determine whether image manipulation of the display (180) is detected when the value of exercise data from the fitness device (500) is 0 or has not changed for a certain period of time (S1001) (S1003).

[0243] The controller (170) can determine that video manipulation has been detected when the video being played on the display (180) changes from the first content video to the second content video.

[0244] The controller (170) can determine that video manipulation has been detected when the video being played on the display (180) changes from the first content video to the second content video according to a command received from the remote control device (200).

[0245] The controller (170) can determine the user's exercise state as an exercise continuing state when video manipulation is detected (S1005), and can determine the user's exercise state as an exercise ending state when video manipulation is not detected (S1007).

[0246] Again, Figure 6 is explained.

[0247] The controller (170) of the display device (100) can output the exercise result when the user's exercise state is determined to be an exercise end state (S619).

[0248] The exercise results may include the results of the exercise performed by the user from the time the fitness device (500) is connected until the user's exercise state is determined to be an exercise end state.

[0249] The exercise results may include past exercise history previously obtained through the fitness device (500).

[0250] FIG. 11 is a drawing illustrating the results of an exercise according to one embodiment of the present disclosure.

[0251] Referring to FIG. 11, if the controller (170) determines that the user's exercise state is an exercise end state, it can display the exercise result (1100) on the display (180).

[0252] In one embodiment, if the controller (170) determines that the user's exercise state is an exercise end state, it can change the content video (800) that the user is watching into an exercise result (1100).

[0253] In another embodiment, if the controller (170) determines that the user's exercise state is an exercise end state, it may display the exercise result (1100) superimposed on the content video (800) that the user is watching.

[0254] The exercise results (1100) may include an information item (1110), an exercise date history item (1120), a category usage rate item (1130), and an exercise time summary item (1140).

[0255] My information item (1110) may include user exercise information generated based on exercise data received from the fitness device (500). My information item (1110) may include total exercise time, number of completed exercises (or number of categories), calories burned, and the category that spent the most time.

[0256] The exercise date history item (1120) may be an item that identifies the days on which the exercise was completed and the days on which it was not completed among multiple dates.

[0257] The category usage ratio item (1130) may be an item representing the usage ratio of each of the multiple fitness devices.

[0258] The exercise time summary item (1140) may be an item containing the user's daily exercise time over a period of time.

[0259] After finishing using the fitness device (500), the user can immediately check information about the exercise performed through the exercise results (1100).

[0260] Again, Figure 6 is explained.

[0261] The controller (170) of the display device (100) can perform a disconnection procedure with the fitness device (500) (S621).

[0262] The controller (170) can disconnect the BLE connection with the fitness device (500) when the user's exercise state is determined to be an exercise end state.

[0263] Step S621 may be performed before Step S619 or simultaneously with Step S619.

[0264] In another embodiment, the controller (170) may disconnect the BLE connection with the fitness device (500) based on receiving a specific trigger from the fitness device (500). The specific trigger may be any one of a trigger that selects an emergency button provided on the fitness device (500), a trigger that detects an emergency situation to stop the operation of the fitness device (500), or a trigger that turns off the power of the fitness device (500).

[0265] Figure 12 is a diagram illustrating a disconnection notification window displayed on a display device as the fitness device and BLE connection are disconnected.

[0266] Referring to FIG. 12, the display device (100) can display a disconnection notification window (1200) on the display (180) when the BLE connection with the first fitness device (500-1) is disconnected.

[0267] The user can experience the BLE connection between the fitness device (500) and the display device (100) being automatically disconnected without any separate process.

[0268] FIG. 13 is a sequence diagram for explaining a method of operation of a system according to one embodiment of the present disclosure.

[0269] In the following, the second fitness device (500-2) may be a treadmill (500-2).

[0270] Referring to FIG. 13, the controller (170) of the display device (100) can receive operable information from the fitness device (500) through a wireless communication interface (173) (S1301).

[0271] Operable information may include information regarding operable functions among the multiple functions possessed by the fitness device (500). Operable information may include information regarding functions operable according to control commands from an external device other than the fitness device (500). The external device may be a display device (100).

[0272] For example, if the fitness device (500) is a treadmill, the operable information may include a treadmill speed control function and an incline control function. Each of the operable functions included in the operable information may correspond to each of a plurality of exercise factors. The plurality of exercise factors may include speed and incline.

[0273] In one embodiment, the operable information may be information included in the communication signal of step S607.

[0274] In another embodiment, operable information may be information received after a wireless connection procedure between a display device (100) and a fitness device (500) is performed according to step S615.

[0275] Manipulable information can be received together with or separately from exercise data.

[0276] The operable information may vary depending on the type of fitness device (500).

[0277] The controller (170) of the display device (100) can play an exercise course video corresponding to the exercise course on the display (180) (S1303).

[0278] In one embodiment, the exercise course may be a course set as default.

[0279] In another embodiment, the exercise course may be a personalized course generated based on the user's exercise history. The controller (170) may generate an exercise history corresponding to the user account based on exercise data received from the fitness device (500) over a certain period. The exercise history may be information representing the accumulation or average of past exercise data corresponding to the user account.

[0280] In another embodiment, the exercise course may be a customized exercise course generated according to the user's setting input.

[0281] In another embodiment, the exercise course may be a course generated based on context information of a content video played on a display device (100).

[0282] An exercise course may include multiple sub-courses. Each of the multiple sub-courses constituting a single exercise course may be a course with one or more different exercise factors. For example, each of the multiple sub-courses constituting an exercise course may be distinguished by distance.

[0283] The exercise factor may be a factor related to the progress of the exercise, such as speed or incline. The exercise factor may be a factor corresponding to the operable function of the fitness device (500).

[0284] The controller (170) can display an exercise course video corresponding to the exercise course selected according to user input among a plurality of exercise courses on the display (180).

[0285] The display device (100) may also display real-time exercise information based on exercise data received in real-time from the fitness device (500) along with an exercise course video on the display (180).

[0286] FIG. 14 is a drawing illustrating an example of playing an exercise course video according to the selection of an exercise course according to one embodiment of the present disclosure.

[0287] In FIG. 14, it is assumed that the fitness device (500) is a treadmill (500-2) and the display device (100) is connected to the treadmill (500-2) via BLE.

[0288] The display device (100) can display an exercise course selection menu (1410) on the display (180). The display device (100) can display the exercise course selection menu (1410) on the display (180) according to a command received from the remote control device (200).

[0289] The display device (100) can display an exercise course selection menu (1410) superimposed with a content video (800).

[0290] The exercise course menu (1410) may include a plurality of exercise courses (1411, 1412, 1413, 1414). The first exercise course (1411) may be a course set by default. The second exercise course (1412) may be a customized course created according to the user's settings. The third exercise course (1413) may be a personalized course created based on the user's exercise history. The fourth exercise course (1414) may be an exercise course created based on an exercise course video.

[0291] The first exercise course (1411) can be any one of a beginner course, an intermediate course, or an advanced course.

[0292] The second exercise course (1412) may be a course set according to user input. The display device (100) can set exercise factors for each of the multiple sub-courses constituting the exercise course according to user input received through an exercise course editing menu (not shown).

[0293] The third exercise course (1413) may be a course generated based on the user's accumulated exercise data. The display device (100) can set the values ​​of the exercise factors for each of the multiple sub-courses that constitute the exercise course based on the accumulated exercise data.

[0294] The fourth exercise course (1414) may be an exercise course generated based on context information of the exercise course video. This will be described later.

[0295] In one embodiment, the controller (170) can receive a command to select one of a plurality of exercise courses (1411, 1412, 1413, 1414), and can play an exercise course video (1420) corresponding to the selected exercise course on the display (180) according to the received command.

[0296] In another embodiment, when the user starts exercising, the controller (170) can automatically play an exercise course video (1420) corresponding to either the second exercise course (1412) or the third exercise course (1413) on the display (180).

[0297] The controller (170) can play an exercise course video that is the source of the fourth exercise course (1414) based on the selection of the fourth exercise course (1414).

[0298] FIGS. 15a to 15c are drawings illustrating a plurality of exercise courses according to an embodiment of the present disclosure.

[0299] FIG. 15a shows a first exercise course (1510) set as default. The first exercise course (1510) may include a plurality of sub-courses (1511, 1512, 1513).

[0300] The exercise factors of each of the multiple sub-courses (1511, 1512, 1513) may have different values. The exercise factors may include the speed of the treadmill (500-2), the incline, and the distance of the sub-course.

[0301] For example, the slope of the first sub-course (1511) may be 15, the speed may be 5, and the distance may be 5; the slope of the second sub-course (1512) may be 5, the speed may be 4, and the distance may be 5; and the slope of the third sub-course (1513) may be -15, the speed may be 3, and the distance may be 5.

[0302] FIG. 15b illustrates a second exercise course (1520) generated for user customization. The second exercise course (1520) may include a plurality of sub-courses (1521, 1522, 1523).

[0303] The values ​​of the exercise factors for each of the multiple sub-courses (1521, 1522, 1523) may differ from each other. The display device (100) can receive setting inputs for the exercise factors of each sub-course through the exercise course editing menu, and can create a second exercise course (1520) through the received setting inputs. Information about the created second exercise course (1520) may be stored in memory (140).

[0304] FIG. 15c illustrates a third exercise course (1530) generated based on the user's exercise history. The third exercise course (1530) may include a plurality of sub-courses (1531, 1532, 1533).

[0305] The values ​​of the exercise factors of each of the multiple sub-courses (1531, 1532, 1533) may differ from each other. The display device (100) can extract an exercise pattern from the user's exercise history and can generate multiple sub-courses (1531, 1532, 1533) according to the extracted exercise pattern. The display device (100) can calculate the average value of each exercise factor of each sub-course from the user's exercise history. The display device (100) can set the average values ​​as the values ​​of the exercise factors of the sub-courses.

[0306] Information about the generated third exercise course (1530) may be stored in memory (140).

[0307] Again, Figure 13 is explained.

[0308] The controller (170) of the display device (100) can determine whether the exercise factor of the exercise course is changed (S1305).

[0309] The memory (140) may store information about an exercise course and one or more exercise factors corresponding to the exercise course. The memory (140) may store information about a plurality of sub-courses constituting the exercise course and one or more exercise factors corresponding to each of the plurality of sub-courses.

[0310] Information regarding one or more exercise factors may include the time when the exercise factor changes and the value of the exercise factor to be changed.

[0311] The controller (170) can determine whether the value of one or more exercise factors for the exercise course is changed. The controller (170) can determine whether the value of either the speed or the incline of the treadmill (500-2) is changed.

[0312] The controller (170) of the display device (100) can generate an operation command for the fitness device (500) when it is determined that the exercise factor has changed (S1307).

[0313] When the controller (170) determines that the exercise factor has changed, it can generate an operation command based on the received operationable information.

[0314] The operation command may include an exercise factor and a value of the exercise factor, and may be a command to operate the fitness device (500) with the value of the exercise factor.

[0315] Referring to FIG. 15a, the controller (170) may generate an operation command at the time (t1) when changing from the first sub-course (1511) to the second sub-course (1512) or before the time (t1). In step S1301, the operable information of the treadmill (500-2) may include a speed control function and an incline control function.

[0316] The controller (170) can generate an operation command to change the incline of the treadmill (500-2) to 5 and the speed to 4. The operation command may include one or more exercise factors and the value of each exercise factor. The command of the operation command is as shown in FIG. 14 <writecharacteristicvalue>It can be. CharacteristicValue can be the value of the exercise factor.

[0317] The controller (170) of the display device (100) can transmit the generated operation command to the fitness device (500) through the wireless communication interface (173) (S1309).

[0318] The controller (170) can transmit an operation command containing the value of the changed exercise factor to the fitness device (500) via the BLE circuit.

[0319] The fitness device (500) can perform operations of the fitness device (500) according to operation commands received from the display device (100) (S1311).

[0320] For example, the treadmill (500-2) can automatically adjust the incline or speed according to the value of the exercise factor included in the operation command.

[0321] In this way, according to an embodiment of the present disclosure, the user can be provided with an experience in which the fitness device (500) is automatically operated according to the exercise course without any operation input to the fitness device (500) during exercise.

[0322] Accordingly, the user does not need to directly operate the fitness device (500) during exercise, so the exercise is not interfered with.

[0323] FIGS. 16a and FIGS. 16b are drawings illustrating an example of generating an exercise course based on context information of a content image according to an embodiment of the present disclosure.

[0324] Referring to FIG. 16a, the controller (170) of the display device (100) can obtain context information of the content image (S1601).

[0325] In one embodiment, the content video may be an exercise course video representing an exercise course. The context information of the exercise course video may include the overall context represented by the exercise course. The context information of the exercise course video may include at least one of the background provided by the exercise course video, screen movement, the speed of movement of surrounding objects, or changes in terrain.

[0326] Referring to FIG. 16b, the display device (100) can play an exercise course video (1610) on the display (180). The display device (100) can extract context information from the exercise course video (1610).

[0327] The controller (170) of the display device (100) can generate an exercise course based on acquired context information (S1603).

[0328] The exercise course video may consist of multiple sub-course videos. One sub-course video may be a video corresponding to a section where the values ​​of the exercise factors remain constant relative to each other.

[0329] The controller (170) can obtain the speed for each sub-course video based on the movement of the screen or the speed of movement of surrounding objects through the motion course video.

[0330] The controller (170) can obtain the slope of the sub-course video by analyzing the terrain change of the exercise course video.

[0331] The controller (170) can generate information about the sub-courses based on the values ​​of the exercise factors of each sub-course video. The controller (170) can generate an exercise course by combining information about each of the multiple sub-courses.

[0332] Referring to FIG. 16b, the controller (170) can generate an exercise course (1620) including a plurality of sub-courses (1621, 1622, 1623) based on context information of the exercise course video (1610).

[0333] The generated exercise course can be displayed in the exercise course menu (1410) of Fig. 14.

[0334] The controller (170) of the display device (100) can store information about the generated exercise course in memory (140) (S1605).

[0335] Information about the exercise course may include the values ​​of exercise factors for each sub-course constituting the exercise course.

[0336] When the controller (170) is played on an exercise course video (1610) corresponding to the generated exercise course (1620), it can generate operation commands corresponding to each sub-course constituting the exercise course (1620) and transmit the generated operation commands to the fitness device (500). The fitness device (500) can automatically adjust the value of the exercise factor according to the received operation commands.

[0337] As such, according to an embodiment of the present disclosure, an exercise course can be generated in accordance with the context of an exercise course video. Accordingly, a user can perform exercises realistically while viewing the exercise course video without any separate operation of the fitness device.

[0338] FIG. 17 is a sequence diagram for explaining a method of operation of a system according to another embodiment of the present disclosure.

[0339] In particular, FIG. 17 may be an example performed after step S1311 of FIG. 13.

[0340] Referring to FIG. 17, the fitness device (500) can determine whether an operation input has occurred (S1701).

[0341] The fitness device (500) may be in a state of operation according to an operation command received from the display device (100).

[0342] The fitness device (500) can determine that user operation input has occurred when any one of the multiple physical buttons provided on the fitness device (500) is selected.

[0343] The fitness device (500) can perform an operation based on the determination that an operation input has occurred (S1703) and can transmit the operation input event to the display device (100) (S1705).

[0344] That is, the fitness device (500) can stop performing the operation according to the operation command received from the display device (100) and perform the operation according to the operation input.

[0345] The operation input event may be an event indicating that one of the multiple physical buttons provided in the fitness device (500) has been selected. The operation input event may be an event indicating that the user directly operates the fitness device (500).

[0346] In another embodiment, the operation input event may be an event to exit the exercise course selected in the display device (100) or the sub-course at the time of receiving the operation input event. The display device (100) may stop generating operation commands according to the selected exercise course upon receiving the operation input event.

[0347] The controller (170) of the display device (100) can determine whether the corresponding sub-course at the time of receiving the operation input event has ended based on the operation input event (S1707).

[0348] The controller (170) of the display device (100) can generate an operation command for the subsequent sub-course when it is determined that the corresponding sub-course has ended (S1709).

[0349] The controller (170) can generate an operation command for setting to a subsequent sub-course after the sub-course corresponding to the time when the operation input is received has ended. That is, the user's operation input can be recognized as a temporary input for controlling the operation of the corresponding sub-course.

[0350] The controller (170) of the display device (100) can transmit the generated operation command to the fitness device (500) through the wireless communication interface (173) (S1711), and the fitness device (500) can adjust the value of the exercise factor according to the received operation command (S1713).

[0351] The controller (170) can transmit an operation command to the fitness device (500) via a BLE circuit, which includes values ​​of exercise factors for a sub-course after the point in time when the operation input event is received, for automatic control of the fitness device (500).

[0352] As such, according to an embodiment of the present disclosure, when a user directly operates the fitness device (500) while it is operating on an exercise course selected through a display device (100), the user may temporarily deviate from the exercise course. Accordingly, when the user is fatigued or in poor physical condition, the user can reduce the risk of injury and enable exercise at their own pace.

[0353] Figure 18 is a diagram illustrating an example of providing exercise information and exercise course videos together during exercise through a fitness device.

[0354] Referring to FIG. 18, the user is performing exercise on a treadmill (500-2). The display device (100) can play an exercise course video (1810) corresponding to the selected exercise course based on user input on the display (180).

[0355] The display device (100) can display real-time exercise information (1820) based on exercise data received in real-time from the treadmill (500-2) along with an exercise course video (1810) on the display (180).

[0356] Real-time exercise information (1820) may include at least one of an incline curve corresponding to the exercise course, calories consumed, exercise time, and distance traveled.

[0357] As exercise course videos (1810) and real-time exercise information (1820) are provided together, the sense of immersion in the exercise can be increased and the user's motivation to achieve goals can be enhanced.

[0358] FIG. 19 is a drawing illustrating an example of controlling a video being played based on exercise data received from a fitness device according to one embodiment of the present disclosure.

[0359] Referring to FIG. 19, the display device (100) is playing a game video (1910), and the user is performing exercise on a treadmill (500-2).

[0360] When the display device (100) performs a BLE connection procedure with the treadmill (500-2), it can synchronize the exercise data collected by the fitness device (500) with the game key value.

[0361] Motion data can be either speed or gradient, and the game key value can be either the speed or booster level of an object included in the game video.

[0362] For example, the display device (100) can synchronize the speed of the treadmill (500-2) with the speed of the object included in the game video.

[0363] The treadmill (500-2) can transmit exercise data collected in real time to the display device (100). When the speed is increased, the treadmill (500-2) can transmit a control command to the display device (100) to match the game key value to the increased speed. The display device (100) can increase the speed of the airplane moving within the game video (1910) according to the control command. The command of the control command can be expressed as < monitorCharacteristicValue >.

[0364] As another example, the display device (100) can increase the booster level of the airplane moving within the game video (1910) when the incline of the treadmill (500-2) increases.

[0365] In this way, according to an embodiment of the present disclosure, as the exercise factor of the fitness device and the factor of the object included in the video being played on the display device (100) are synchronized, the user can increase their immersion in exercise.

[0366] A display device (100) according to an embodiment of the present disclosure may include a display (180), a wireless communication interface (173) that performs wireless communication with a fitness device (500); and a controller (170) that receives operable information of the fitness device from the fitness device through the wireless communication interface, and transmits an operable command generated based on the operable information to the fitness device through the wireless communication interface when one or more exercise factors for an exercise course are changed.

[0367] The above operation command may include one or more exercise factors and values ​​of one or more exercise factors, and may be a command for operating the fitness device with the values ​​of one or more exercise factors.

[0368] The device further includes a memory (140) for storing values ​​of one or more exercise factors for each of the plurality of sub-courses included in the above exercise course, and the controller (170) can transmit the operation command to the fitness device at the time when the values ​​of the one or more exercise factors change.

[0369] The above exercise course may be a course set according to user input.

[0370] The above exercise course may be a course generated based on an exercise history created based on exercise data received from the fitness device.

[0371] The above controller (170) plays an exercise course video on the display, and the exercise course may be a course generated based on context information of the exercise course video.

[0372] The above exercise course includes a plurality of sub-courses, and when the controller (170) receives an operation input event from the fitness device, it determines whether the sub-course corresponding to the time of receiving the operation input event has ended, and if it is determined that the sub-course has ended, it can transmit an operation command corresponding to the sub-course following the ended sub-course to the fitness device.

[0373] The controller (170) can display real-time exercise information based on an exercise course video corresponding to the exercise course and exercise data received from the fitness device on the display.

[0374] The above motion factor may be either speed or incline.

[0375] The above operable information may vary depending on the type of fitness device.

[0376] According to one embodiment of the present disclosure, the above-described method can be implemented as code that a controller (170) can read on a medium on which a program is recorded. Examples of media that a controller (170) can read include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

[0377] The display device described above is not limited to the configuration and method of the embodiments described above; rather, all or part of each embodiment may be selectively combined to allow for various modifications to be made.< / writecharacteristicvalue>

Claims

1. In a display device, display; A wireless communication interface that performs wireless communication with a fitness device; and A controller comprising: receiving operable information of the fitness device from the fitness device via the wireless communication interface; and, when one or more exercise factors for an exercise course are changed, transmitting an operation command generated based on the operable information to the fitness device via the wireless communication interface. Display device.

2. In Paragraph 1, The above operation command is Includes the above one or more exercise factors and the values ​​of the above one or more exercise factors, A command for operating the fitness device with the values ​​of one or more of the above exercise factors Display device.

3. In Paragraph 2, It further includes a memory for storing the values ​​of one or more exercise factors for each of the plurality of sub-courses included in the above exercise course, and The above controller Transmitting the operation command to the fitness device at the time when the values ​​of the one or more of the above exercise factors change. Display device.

4. In Paragraph 1, The above exercise course is Course set according to user input Display device.

5. In Paragraph 1, The above exercise course is A course generated based on exercise history generated based on exercise data received from the above fitness device Display device.

6. In Paragraph 1, The above controller Play the exercise course video on the above display, and The above exercise course is A course generated based on context information of the above exercise course video Display device.

7. In Paragraph 1, The above exercise course is It includes multiple sub-courses, The above controller When an operation input event is received from the fitness device, it is determined whether a sub-course corresponding to the time at which the operation input event is received has ended, and if it is determined that the sub-course has ended, an operation command corresponding to a sub-course following the ended sub-course is transmitted to the fitness device. Display device.

8. In Paragraph 1, The above controller Displaying on the display real-time exercise information based on an exercise course video corresponding to the above exercise course and exercise data received from the fitness device Display device.

9. In Paragraph 1, The above exercise factor is Either speed or gradient Display device.

10. In Paragraph 1, The above operable information Varies depending on the type of the above fitness device Display device.

11. In a method of operating a display device, A step of receiving operability information of the fitness device from the fitness device; A step of determining whether one or more exercise factors for an exercise course change; and When one or more exercise factors for the above exercise course are changed, the method includes the step of transmitting an operation command generated based on the above operable information to the fitness device. Method of operation of a display device.

12. In Paragraph 11, The above operation command is Includes the above one or more exercise factors and the values ​​of the above one or more exercise factors, A command for operating the fitness device with the values ​​of one or more of the above exercise factors Method of operation of a display device.

13. In Paragraph 12, It further includes a memory for storing the values ​​of one or more exercise factors for each of the plurality of sub-courses included in the above exercise course, and The step of transmitting the above operation command A step comprising transmitting the operation command to the fitness device at the time when the values ​​of the one or more exercise factors are changed. Method of operation of a display device.

14. In Paragraph 11, The above exercise course is Course set according to user input Method of operation of a display device.

15. In Paragraph 11, The above exercise course is A course generated based on exercise history generated based on exercise data received from the above fitness device Method of operation of a display device.

16. In Paragraph 11, The above exercise course is A course generated based on context information of the exercise course video Method of operation of a display device.

17. In Paragraph 11, The above exercise course is It includes multiple sub-courses, The step of transmitting the above operation command When an operation input event is received from the fitness device, a step of determining whether a sub-course corresponding to the time of receiving the operation input event has ended; and If it is determined that the above sub-course has ended, the method includes the step of transmitting an operation command corresponding to a sub-course following the ended sub-course to the fitness device. Method of operation of a display device.

18. In Paragraph 11, The method further includes the step of displaying real-time exercise information based on an exercise course video corresponding to the above exercise course and exercise data received from the fitness device. Method of operation of a display device.

19. In Paragraph 11, The above exercise factor is Either speed or gradient Method of operation of a display device.

20. In Paragraph 11, The above operable information Varies depending on the type of the above fitness device Method of operation of a display device.

Images