Electronic device and UI providing method thereof
By identifying the type of scroll wheel input and providing corresponding UI feedback, the shortcomings of existing scroll wheel devices in fine movement and fast continuous operation are solved, and the diversity and precision of the user's manipulation experience is improved.
Patent Information
- Application Number
- CN202380027674.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-06-16
- Filing Date
- 2023-03-09
- Publication Date
- 2024-11-01
AI Technical Summary
The existing roller devices lack effective feedback on fine movement and fast continuous operation when manipulating the UI screen, resulting in a monotonous user manipulation experience and inability to meet diverse functional needs.
By identifying the type of roller input, providing different types of UI feedback, including motion feedback, transparency changes and sizing, based on rotation distance and speed, to achieve fine distinction and support for continuous operation of roller input.
It improves the diversity and precision of the user's manipulation experience, provides a navigation method that is more suitable for fine manipulation or fast continuous operation, and enhances the user's interaction with the UI.
Smart Images

Figure CN118891606A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to an electronic device and a UI providing method thereof, and more particularly, to an electronic device and a UI providing method thereof for controlling a UI screen based on a scroll wheel input. Background Art
[0002] Due to the development of electronic technology, various types of input devices are being developed. Specifically, in order to meet the needs of users who want newer and more diverse functions, input devices (such as scroll wheel devices and touch devices) through which users can easily control objects are gradually developing.
[0003] When using an existing wheel device to manipulate a UI screen, there is a problem that there is only manipulation feedback for a single key, which only provides a monotonous experience. In addition, there is no separate definition for fine movement before an event occurs, or for interaction when the rotation exceeds a set speed. For example, there is a problem that the steps of the wheel input are not subdivided, which fails to provide the user with a manipulation experience suitable for each user intention for fine manipulation or rapid continuous operation. Summary of the invention
[0004] According to one or more embodiments, an electronic device includes: a display; and one or more processors, configured to: control the display to display a user interface (UI) screen including multiple graphical user interface (GUI) items and a focus GUI located on a first GUI item among the multiple GUI items; identify an input type of a roller input from multiple input types of roller inputs based on at least one of a rotation distance or a rotation speed of a roller on a user input device; based on the roller input being identified as the first input type, control the display to provide first UI feedback to the first GUI item, a second GUI item corresponding to the rotation direction of the roller input, or at least one of the focus GUI; based on the roller input being identified as the second input type, control the display to move the focus GUI to the second GUI item and display the focus GUI; and based on the roller input being identified as a third input type, control the display to provide second UI feedback to the focus GUI while continuously moving the focus GUI to sequentially pass through multiple GUI items corresponding to the rotation direction of the roller input.
[0005] The first input type is identified based on the following event: returning to the manipulation starting point after generating a number of scale inputs corresponding to the movement of the roller less than a threshold value; the second input type is identified based on the following event: generating a number of scale inputs corresponding to the movement of the roller greater than or equal to a threshold value at a speed less than a threshold speed; the third input type is identified based on the following event: generating a number of scale inputs corresponding to the movement of the roller greater than or equal to a threshold value at a speed greater than or equal to a threshold speed, and the scale input is an input corresponding to a basic manipulation unit of the roller on at least one of the roller button or the touch panel that receives the roller input.
[0006] The first UI feedback includes at least one of: feedback providing movement to the first GUI item, feedback changing the transparency of a focus GUI located on the first GUI item, feedback displaying the focus GUI with a preset transparency on the second GUI item, or feedback changing the size of the second GUI item, and the second UI feedback includes: feedback continuously moving to sequentially pass through multiple GUI items corresponding to the rotation direction of the scroll wheel input by changing the transparency of the focus GUI.
[0007] The one or more processors are configured to enter the continuous key mode based on the wheel input being recognized as a third input type, and release the continuous key mode based on the wheel input not being recognized as the third input type within a threshold time in the continuous key mode.
[0008] The second input type is identified based on the following event: a scale input corresponding to the movement of the roller wheel greater than or equal to a threshold number is generated at a speed less than a threshold speed, and the one or more processors are configured to: based on recognizing the roller input while playing back content through the display, identify the threshold number corresponding to the second input type as having a value such that the threshold number corresponding to the second input type is inversely proportional to the length of the content.
[0009] One or more processors are configured to: identify a threshold number corresponding to a second input type as a first number based on the length of a first content, and adjust the playback interval of the first content according to a preset time interval based on a roller input of the second input type that generates the first number of scale inputs at a speed less than a threshold speed; identify a threshold number corresponding to the second input type as a second number greater than the first number based on the length of the second content, and adjust the playback interval of the second content according to a preset time interval based on a roller input of the second input type that generates the second number of scale inputs at a speed less than a threshold speed; and identify a threshold number corresponding to the second input type as a third number greater than the second number based on the length of a third content, and adjust the playback interval of the content according to a preset time interval based on a roller input of the second input type that generates the third number of scale inputs at a speed less than a threshold speed, wherein the length of the second content is greater than the length of the first content and less than the length of the third content.
[0010] The second input type is identified based on the following event: a scale input greater than or equal to a threshold number is generated at a speed less than a threshold speed, and the one or more processors are configured to: based on recognizing a roller input while providing a continuous adjustment UI with an adjustable range through a display, identify the threshold number corresponding to the second input type as having a value such that the threshold number corresponding to the second input type is inversely proportional to the length of the adjustable range.
[0011] One or more processors are configured to control the display to provide first UI feedback based on the scroll wheel input being identified as a first input type before the focus GUI moves horizontally from a first GUI item to a second GUI item, before the focus GUI moves vertically from a first GUI item to a second GUI item, or before the focus GUI moves vertically from a first GUI item to a second GUI item and a line break occurs.
[0012] One or more processors are configured to: based on determining that a GUI item having the same depth as the depth of the first GUI item is not arranged at a position corresponding to the rotation direction of the scroll wheel input, control the display to display a GUI item having a depth different from the depth of the first GUI item, or control the display to move the focus GUI to a GUI item of a different depth arranged at a position corresponding to the rotation direction, and display the focus GUI.
[0013] One or more processors are configured to: based on the scroll wheel input being identified as a second input type, control the display to increase the size of the second GUI item while moving the focus GUI to the second GUI item and displaying the focus GUI; and based on the scroll wheel input being identified as a third input type, control the display to continuously move the focus GUI to multiple GUI items corresponding to the rotation direction of the scroll wheel input so as to maintain the size of the GUI item where the focus GUI is located.
[0014] According to one or more embodiments, a method for providing a UI for an electronic device includes: displaying a user interface (UI) screen including multiple graphical user interface (GUI) items and a focus GUI located on a first GUI item among the multiple GUI items; identifying an input type of a roller input from multiple input types of the roller input based on at least one of a rotation distance or a rotation speed of a roller on a user input device; and controlling the UI screen based on the identified input type of the roller input, and wherein controlling the UI screen includes: providing first UI feedback to at least one of the first GUI item, a second GUI item corresponding to a rotation direction of the roller input, or a focus GUI based on the roller input being identified as a first input type; moving the focus GUI to the second GUI item and displaying the focus GUI based on the roller input being identified as a second input type; and providing second UI feedback to the focus GUI while continuously moving the focus GUI to sequentially pass through multiple GUI items corresponding to the rotation direction of the roller input based on the roller input being identified as a third input type.
[0015] The first input type is identified based on the following event: returning to the manipulation starting point after generating a number of scale inputs corresponding to the movement of the roller less than a threshold value; the second input type is identified based on the following event: generating a number of scale inputs corresponding to the movement of the roller greater than or equal to a threshold value at a speed less than a threshold speed; the third input type is identified based on the following event: generating a number of scale inputs corresponding to the movement of the roller greater than or equal to a threshold value at a speed greater than or equal to a threshold speed, and the scale input is an input corresponding to a basic manipulation unit of the roller on at least one of the roller button or the touch panel that receives the roller input.
[0016] According to one or more embodiments, a non-transitory computer-readable medium having instructions stored therein, when a processor executes the instructions, causes the processor to execute a method for providing a UI for an electronic device, the method comprising: displaying a user interface (UI) screen including multiple graphical user interface (GUI) items and a focus GUI located on a first GUI item among the multiple GUI items; identifying an input type of a roller input from multiple input types of roller inputs based on at least one of a rotation distance or a rotation speed of a roller on a user input device; and controlling the UI screen based on the identified input type of the roller input, and wherein controlling the UI screen comprises: providing first UI feedback to at least one of the first GUI item, a second GUI item corresponding to a rotation direction of the roller input, or a focus GUI based on the roller input being identified as a first input type; moving the focus GUI to a second GUI item and displaying the focus GUI based on the roller input being identified as a second input type; and providing second UI feedback to the focus GUI while continuously moving the focus GUI to sequentially pass through multiple GUI items corresponding to a rotation direction of the roller input based on the roller input being identified as a third input type. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] Figure 1 is a diagram of an implementation of an electronic device according to one or more embodiments of the present disclosure.
[0018] Figure 2a is a block diagram illustrating a configuration of an electronic device according to one or more embodiments.
[0019] Figure 2b is a diagram showing a detailed configuration of an implementation of an electronic device according to one or more embodiments of the present disclosure.
[0020] Figure 3 and Figure 4 is a diagram for explaining a control operation according to a type of scroll wheel input according to one or more embodiments.
[0021] Figure 5 is a diagram for explaining a control operation according to a first input type according to one or more embodiments.
[0022] Figures 6a to 6d is a diagram for explaining various examples according to a first input type according to one or more embodiments.
[0023] Figure 7 is a diagram for explaining various examples according to a second input type according to one or more embodiments.
[0024] Figure 8 and Fig. 9is a diagram for explaining a method of setting a threshold number of second input types according to content length according to one or more embodiments.
[0025] Figures 10a to 10c is a diagram for explaining a method for adjusting a content playback interval according to one or more embodiments.
[0026] Fig.11 is a diagram for explaining a method for adjusting a content playback interval according to one or more embodiments.
[0027] Fig.12 is a diagram for explaining a method of adjusting a continuous adjustment UI according to one or more embodiments.
[0028] Figures 13a to 13c is a diagram for explaining a method of adjusting a continuous adjustment UI according to one or more embodiments.
[0029] Fig.14 and Fig.15 is a diagram for explaining various examples according to the third input type. DETAILED DESCRIPTION
[0030] The present disclosure will now be described in detail with reference to the accompanying drawings.
[0031] The terms used herein will be briefly described, and the present disclosure will be described in detail.
[0032] Although the general terms used in this disclosure are selected to describe the embodiments in consideration of their functions, these general terms may vary according to the intentions of those skilled in the art, legal or technical interpretations, the emergence of new technologies, etc. Some terms are arbitrarily selected by the applicant of the embodiments. In this case, their meanings will be described in detail in the description of this disclosure. Accordingly, the terms used in this disclosure should be defined based on the meaning of the terms rather than the names of the simple terms, and should be based on the overall content of this disclosure.
[0033] Terms such as first and second may be used to describe various components, but these components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.
[0034] Unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" include plural forms. In the present application, the terms "including" or "configuration" etc. specify the presence of features, quantities, steps, operations, elements, components or combinations thereof, but do not exclude the presence or addition of one or more features, quantities, steps, operations, components, parts or combinations thereof.
[0035] The expression “at least one of A or B” should be understood to mean “A” or “B” or “A and B”.
[0036] In the present disclosure, the term "module" or "component" can perform at least one function or operation, and can be implemented as hardware, software, or a combination of hardware and software. In addition, in addition to the "module" or "component" that must be implemented as specific hardware, multiple "modules" or multiple "components" can be implemented as at least one processor integrated into at least one module.
[0037] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure can be implemented in a variety of different forms and is not limited to the embodiments described herein. In addition, in order to clearly describe the present disclosure in the accompanying drawings, components that are not related to the description are omitted, and similar reference numerals are attached to similar components throughout the specification.
[0038] Figure 1 is a diagram of an implementation of an electronic device according to one or more embodiments of the present disclosure.
[0039] Reference Figure 1 , the electronic device 100 may include a wheel input device 10 (or a wheel device), or may be implemented as a display device that can be remotely controlled by the wheel input devices 20 and 30. According to one or more examples, the electronic device 100 may be applied to, but not limited to, any device having a display function, such as a TV, a tablet PC, a mobile phone, a desktop PC, a laptop PC, a PDA, a portable multimedia player (PMP), a large format display (LFD), a digital signage, a digital information display (DID), a video wall, a projector, a refrigerator, an air conditioner, an air purifier, or a medical device. Here, each of the wheel input devices 10, 20, and 30 may be implemented as a circular rotatable physical wheel device as shown in the figure, but is not limited thereto, and may be implemented as a software wheel displayed on a touch screen. For example, the wheel on the input device 10, 20, or 30 may be a rotatable physical wheel, or may be a graphic wheel displayed on the screen that can be manipulated by the user.
[0040] According to one or more examples, the electronic device 100 may provide a UI screen including a plurality of GUI items, and control a navigation operation between the plurality of GUI items based on a wheel input received through the wheel input devices 10, 20, and 30. According to one or more examples, the electronic device 100 may provide a content playback screen, and adjust the content playback based on a wheel input received through the wheel input devices 10, 20, and 30. According to one or more examples, the electronic device 100 may provide a continuous adjustment UI, and adjust various values based on a wheel input received through the wheel input devices 10, 20, and 30. In addition, the electronic device 100 may perform various control functions according to the type / function of the screen provided based on the wheel input received through the wheel input devices 10, 20, and 30.
[0041] According to one or more embodiments, the wheel input may be of various types, and different functions may be performed according to the type of the wheel input by the electronic device 100. Hereinafter, various functions performed by the electronic device 100 according to the type of the wheel input are described in detail.
[0042] Figure 2a is a block diagram illustrating a configuration of an electronic device according to one or more embodiments.
[0043] according to Figure 2a , the electronic device 100 includes a display 110 and a processor 120 .
[0044] The display 110 may be implemented as a display including a self-luminous device, or a display including a non-luminous device and a backlight. For example, the display 110 may be implemented as various types of displays, such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a light emitting diode (LED), a plasma display panel (PDP), a quantum dot light emitting diode (QLED), or any other display known to those skilled in the art. The display 110 may also include a drive circuit, a backlight unit, etc., which may be implemented in the form of an a-siTFT, a low temperature polycrystalline silicon (LTPS) TFT, or an organic TFT (OTFT). The display 110 may be implemented as a touch screen combined with a touch sensor, a flexible display, a rollable display, a 3D display, a display in which multiple display modules are physically connected, or any other display configuration known to those skilled in the art.
[0045] One or more processors 120 (hereinafter referred to as processors) are electrically connected to the display 110 to control the overall operation of the electronic device 100. One or more processors 120 may be configured as one or more processors. One or more processors may be implemented as at least one software, at least one hardware, or a combination of at least one software and at least one hardware. According to one or more examples, the software or hardware logic corresponding to the one or more processors may be implemented in one chip. According to one or more examples, the software or hardware logic corresponding to some of the multiple processors may be implemented in one chip, and the software or hardware logic corresponding to the remaining processors may be implemented in another chip.
[0046] According to various embodiments of the present disclosure, the processor 120 may perform operations of the electronic device 100 by executing at least one instruction stored in a memory.
[0047] According to one or more embodiments, the processor 120 may be implemented as a digital signal processor (DSP), a microprocessor, a graphics processing unit (GPU), an artificial intelligence (AI) processor, a neural processing unit (NPU), or a time controller (TCON) for processing a digital image signal. However, the processor 120 is not limited thereto, and may include one or more of a central processing unit (CPU), a microcontroller unit (MCU), a microprocessing unit (MPU), a controller, an application processor (AP), a communication processor (CP), or an ARM processor, or may be defined as a corresponding term. In addition, the processor 120 may be implemented as a system on chip (SoC) or a large-scale integration (LSI) with an embedded processing algorithm, or may be implemented as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).
[0048] According to one or more embodiments, the processor 120 can control the display 110 to display various types of screens that can be controlled by the scroll input devices 10, 20 and 30, such as a UI screen including multiple graphical user interface (GUI) items, a content playback screen, a continuous adjustment UI screen, etc.
[0049] According to one or more examples, the processor 120 may control the display 110 to display a user interface (UI) screen including a plurality of GUI items and a focus GUI on a first GUI item among the plurality of GUI items. Here, the plurality of GUI items may be arranged in a specific direction (such as a horizontal direction, a vertical direction, or a diagonal direction) and may have a specific shape (e.g., a rectangle, a rounded rectangle, a circle, a diamond, etc.). The focus GUI may be in a form highlighted on an edge of a GUI item, but is not necessarily limited thereto, and may be highlighted on the entire GUI item or on a portion of the edge.
[0050] Furthermore, the processor 120 may identify the type of the scroll wheel input based on at least one of the rotation distance or the rotation speed of the scroll wheel input, and perform different control functions according to the identified type of the scroll wheel input.
[0051] The rotation distance may correspond to the rotation angle of the circular scroll wheel and may be acquired by a sensor (e.g., an encoder) provided in each of the scroll wheel input devices 10, 20, and 30. However, the rotation distance is not necessarily limited to this configuration, and in the case of a software scroll wheel, may be calculated by a program or formula. The rotation speed may be calculated by dividing the rotation distance (or rotation angle) by a reference time. The reference time may be determined as various values based on the type, size, and model of each of the scroll wheel input devices 10, 20, and 30.
[0052] According to one or more examples, when the wheel input device is implemented as an external device (e.g., a remote control device) of the electronic apparatus 100, the type of the wheel input may be identified based on a remote control signal received from the wheel input device when the user manipulates the wheel input device. For example, the remote control signal may be a short-range communication signal such as a Bluetooth signal or an infrared signal. According to one or more examples, when the wheel input device is implemented as an internal device of the electronic apparatus 100, the type of the wheel input may be an electrical signal generated by the wheel input device and received by the processor 120 when the user manipulates the wheel input device.
[0053] According to one or more embodiments, the type of the wheel input may have a plurality of predefined types, and may include a first type, a second type, and a third type described below. However, in some cases, each type may be classified into a plurality of detailed types. For example, the third type may be divided into a first subtype and a second subtype based on at least one of a rotation distance or a rotation speed of the wheel input, and at least one of a function or UI feedback may be provided differently.
[0054] Figure 2b is a diagram showing a detailed configuration of an implementation example of an electronic device according to one or more embodiments of the present disclosure.
[0055] Reference Figure 2b , the electronic device 100 ′ includes a display 110, a processor 120, a memory 130, a communication interface 140, a user interface 150, an output unit 160, and a camera 170. Figure 2b Among the components shown, the Figure 2a The components shown repeat the detailed description of the components.
[0056] The memory 130 may be electrically connected to the processor 120, and may store data required by various embodiments of the present disclosure. The memory 130 may be implemented in the form of a memory embedded in the electronic device 100', or may be implemented in the form of a removable memory in the electronic device 100' according to the data storage purpose. For example, data for driving the electronic device 100' may be stored in a memory embedded in the electronic device 100', and data for the extended functions of the electronic device 100' may be stored in the removable memory of the electronic device 100'. In one or more examples, the memory embedded in the electronic device 100' may be implemented as at least one of a volatile memory (e.g., a dynamic RAM (DRAM), a static RAM (SRAM), a synchronous dynamic RAM (SDRAM), etc.), a non-volatile memory (e.g., a one-time programmable ROM (OTPROM), a programmable ROM (PROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a mask ROM, a flash ROM, a flash memory (e.g., a NAND flash memory or a NOR flash memory, etc.), a hard disk drive, or a solid-state drive (SSD)). In addition, the removable memory of the electronic device 100' can be implemented in the form of a memory card (e.g., Compact Flash (CF), Secure Digital (SD), Micro Secure Digital (micro-SD), Micro Secure Digital (mini-SD), xD (extreme Digital), MMC (Multimedia Card)), etc.), an external memory connectable to a USB port (e.g., USB memory), etc.
[0057] According to one or more examples, the memory 130 may store at least one instruction or a computer program including instructions for controlling the electronic device 100 ′.
[0058] According to one or more examples, the memory 130 can store images (i.e., input images), various data, information, etc. received from an external device (e.g., a source device), an external storage medium (e.g., a USB), an external server (e.g., a network hard disk), etc.
[0059] According to one or more examples, the memory 130 may store various information that may be used for various embodiments of the present disclosure, such as predefined information related to the first UI feedback, information related to the second UI feedback, user information, operation history information, and the like.
[0060] According to one or more embodiments, the memory 130 may be implemented as a single memory storing data generated in various operations according to the present disclosure. However, according to one or more embodiments, the memory 130 may be implemented to include multiple memories storing different types of data or data generated in different steps, respectively.
[0061] In the above-mentioned embodiments, it has been described that various data are stored in the external memory 130 of the processor 120. However, as understood by those skilled in the art, according to one or more examples of at least one of the electronic device 100' or the processor 120, at least a portion of the above-mentioned data may be stored in the internal memory of the processor 120.
[0062] The communication interface 140 may be a component that communicates with an external device. For example, the communication interface 140 may receive an image signal from an external device (e.g., a source device), an external storage medium (e.g., a USB memory), an external server (e.g., a network hard disk), etc. in a streaming or downloading manner through a communication method such as AP-based Wi-Fi (Wi-Fi, wireless LAN network), Bluetooth, Zigbee, wired / wireless local area network (LAN), wide area network (WAN), Ethernet, IEEE 1394, High Definition Multimedia Interface (HDMI), Universal Serial Bus (USB), Mobile High Definition Link (MHL), Audio Engineering Society / European Broadcasting Union (AES / EBU), optical fiber, coaxial, etc. The image signal may be a digital image signal of any one of standard definition (SD), high definition (HD), full HD, and ultra HD images, but is not limited thereto, and may include any other suitable resolution known to those skilled in the art. According to one or more embodiments, the communication interface 140 may receive a remote control wheel input signal sent from an external wheel input device.
[0063] The user interface 150 may be implemented as a device such as a button, a touch pad, a mouse, and a keyboard, or may be implemented as a touch screen, a remote control transceiver, etc. that can perform the above-mentioned display function and manipulation input function together. The remote control transceiver may receive a remote control signal from an external remote control device, or send a remote control signal through at least one of infrared communication, Bluetooth communication, or Wi-Fi communication. According to one or more embodiments, the remote control transceiver may receive a scroll wheel input signal sent from an external remote controller.
[0064] The output unit 160 may output a sound signal. For example, the output unit 160 may convert a digital sound signal processed by the processor 120 into an analog sound signal, amplify the analog sound signal, and output the amplified sound signal. For example, the output unit 160 may include at least one speaker unit configured to output at least one channel, a D / A converter, an audio amplifier, etc. According to one or more examples, the output unit 160 may be implemented to output various multi-channel sound signals. In this case, the processor 120 may control the output unit 160 to enhance and output the input sound signal so as to correspond to the enhanced processing of the input image. For example, the processor 120 may convert an input 2-channel sound signal into a virtual multi-channel (e.g., 5.1-channel) sound signal, identify the position where the electronic device 100' is placed, and process the position into a stereo signal optimized for space, or provide a sound signal optimized according to the type of the input image (e.g., content type). According to one or more examples, according to various embodiments, the processor 120 may control the output unit 160 to output audio feedback corresponding to the UI feedback.
[0065] The camera 170 may be turned on according to a preset event to perform shooting. The camera 170 may convert a captured image into an electrical signal and generate image data based on the converted signal. For example, an object may be converted into an electrical image signal by a charge coupled device (CCD), and the converted image signal may be amplified and converted into a digital signal, and then signal processing may be performed. However, according to one or more examples of the electronic device 100', the camera 170 may not be included.
[0066] According to an implementation example, the electronic device 100' may additionally include a tuner and a demodulator. The tuner may tune a channel selected by a user or all previously stored channels, and receive a RF broadcast signal among RF broadcast signals received through an antenna. The demodulator may receive and demodulate a digital IF signal (DIF) converted by the tuner, and perform channel decoding, etc.
[0067] Figure 3 1 is a diagram for explaining a control operation according to a type of a wheel input according to one or more embodiments. The types of wheel inputs may be distinguished from each other based on a rotation distance and / or a rotation speed of the wheel input. Based on the identified type of wheel input, a predetermined action may be performed by a processor or a display device.
[0068] according to Figure 3 , the processor 120 may identify the type of the scroll wheel input based on at least one of the rotation distance or the rotation speed of the scroll wheel input (S310).
[0069] When the wheel input is identified as the first type in step S310 (S320: YES), the processor 120 may control the display 110 to provide a first UI feedback to at least one of the first GUI item, a second GUI item corresponding to the rotation direction of the wheel input, or a focus GUI (S330).
[0070] The first input type may be identified based on an event of returning to the manipulation starting point after generating a number of scale inputs less than a threshold. The scale input may be an input corresponding to a basic manipulation unit on at least one of a wheel button or a touch panel that receives a wheel input. For example, when each of the wheel input devices 10, 20, and 30 is implemented in hardware, the scale input may be the smallest unit recognized by the hardware. The scale input may correspond to, for example Figure 4 An instrument or object shown physically moving a distance. Figure 4 One interval shown may correspond to a basic manipulation unit. In one or more examples, when each of the scroll wheel input devices 10, 20, and 30 is implemented in software, the scale input may be a minimum movement unit (eg, P0 to P0') defined by the software.
[0071] The scale input corresponding to the movement of the roller greater than or equal to the threshold number is identified as the second input type and may correspond to a key input in the software (e.g., a direction key input on a remote control). Accordingly, the first input type that identifies the scale input less than the threshold number may be referred to as an input that does not complete a key input in the software, and may only provide preset UI feedback (i.e., first UI feedback) without performing a specific function. Since the first input type is a case where the scale input less than the threshold number is identified, when the threshold number is 3, the first scale input and the second scale input may be identified as the first input type. According to one or more examples, the first input type may be named as a scale input meaning a scale level input.
[0072] A first UI feedback may be provided in response to identifying the first input type. The first UI feedback may include at least one of the following: feedback providing movement to the first GUI item, feedback changing the transparency of a focus GUI located on the first GUI item, feedback displaying a focus GUI with a preset transparency on the second GUI item, and / or feedback changing the size of the second GUI item.
[0073] According to one or more embodiments, before executing the GUI action, when the scroll wheel input is recognized as the first input type, the processor 120 may control the display 110 to provide a first UI feedback. For example, the GUI action may correspond to the focus GUI moving horizontally from the first GUI item to the second GUI item, the focus GUI moving vertically from the first GUI item to the second GUI item, and / or a line break occurring while the focus GUI moves from the first GUI item to the second GUI item.
[0074] In step S310, when the wheel input is recognized as the second type (S340: YES), the processor 120 may control the display 110 to move the focus GUI to the second GUI item corresponding to the rotation direction of the wheel input and display the focus GUI (S350).
[0075] The second input type can be identified based on determining an event that generates a scale input equal to or greater than a threshold number at a speed less than a threshold speed. In one or more examples, the threshold number can be the same as the threshold number used as a criterion for identifying the first input type. For example, the scale input corresponding to the threshold number can be identified as the second input type and can correspond to a key input in the software (e.g., a directional key input on a remote control). For example, detecting that the number of scale inputs corresponds to the threshold number can indicate that the second input type is input once. In addition, detecting that the number of scale inputs corresponds to an integer multiple of the threshold number (e.g., *n) can indicate that the second input type is input n times. For example, when the second input type is identified once, the focus GUI can move to the second GUI item, and when the second input type is identified again (e.g., the second input type is identified twice in a row), the focus GUI can move again to a third GUI item adjacent to the second GUI item. For example, as Figure 4 As shown, when the threshold number is set to 3, three scale inputs may represent a second input type input once. For example, rotating the wheel from P1 to P2 (421), from P2 to P3 (422), from P3 to P4 (423), or from P4 to P5 may correspond to the second input type. According to one or more examples, the second input type may be referred to as a rotation input.
[0076] According to one or more embodiments, the rotation speed of the scroll wheel input may be calculated as a value obtained by dividing the rotation distance of the scroll wheel by the rotation time. The rotation time may correspond to the time to move the scroll wheel from point A to point B. For example, the rotation distance of the scroll wheel may be identified as the difference between the angle corresponding to the current position of the scroll wheel and the angle corresponding to the initial rotation start position. In one or more examples, the rotation distance of the scroll wheel may be identified as the difference between the angle corresponding to the current occurrence position of the second input type of the scroll wheel and the angle corresponding to the first occurrence position of the second input type.
[0077] In step S310, when the scroll wheel input is identified as the third type (S360: Yes), while continuously moving the focus GUI to a plurality of GUI items corresponding to the rotation direction of the scroll wheel input, the processor 120 may control the display 110 to provide a second GUI feedback to the focus GUI (S370). The third input type may be identified based on an event generating a scale input equal to or greater than a threshold number. In one or more examples, the threshold number may be the same as the threshold number used as a criterion for identifying the first input type and the second input type, and the threshold speed may be the same as the threshold speed used as a criterion for identifying the second input type. For example, when a plurality of second input types (or a plurality of first input types) are continuously generated at a threshold speed or higher, the processor 120 may identify that a third input type is generated.
[0078] The second UI feedback may include feedback of changing the transparency of the focus GUI and continuously moving the focus GUI to a plurality of GUI items corresponding to the rotation direction of the scroll wheel input.
[0079] According to one or more embodiments, when the wheel input is recognized as the second input type, while moving and displaying the focus GUI to the second GUI item, the processor 120 may control the display 110 to increase the size of the second GUI item where the focus GUI is located. In one or more examples, when the wheel input is recognized as the third input type, the processor 120 may control the display 110 to continuously move the focus GUI to a plurality of GUI items corresponding to the rotation direction of the wheel input so that the size of the GUI item where the focus GUI is located is maintained.
[0080] According to one or more examples, when the wheel input is recognized as the third input type, the processor 120 may enter the continuous key mode. In addition, when the wheel input is not recognized as the third input type within a threshold time in the continuous key mode, the processor 120 may release the continuous key mode. The continuous key mode may represent a mode in which the size of the GUI item where the focus GUI is located is maintained while the focus GUI is continuously moved to a plurality of GUI items corresponding to the rotation direction of the wheel input as the wheel input is recognized as the third type. The threshold time may be a preset time when the electronic device 100 or 100' is manufactured, but is not necessarily limited thereto, and may be set / changed according to a user command. According to one or more examples, in the continuous key mode, the focus GUI may be continuously moved while maintaining the size of the GUI item and changing the transparency of the focus GUI.
[0081] Figure 5 is a diagram for explaining a control operation according to a first input type according to one or more embodiments.
[0082] according to Figure 5 When the wheel input is identified as the first type (S510), the processor 120 identifies whether the predefined first UI feedback corresponding to the first type provides feedback for the motion (S520). The predefined first UI feedback may be preset at the time of manufacturing the electronic device 100, or may be set / changed by the user.
[0083] According to one or more examples, the first UI feedback may be set to different forms (e.g., motion (or dynamic) feedback, static feedback, etc.) according to various attributes (such as the type of UI screen (e.g., the size of the UI screen), the size of the GUI item, the type of the GUI item, the depth of the GUI item, the interval between the GUI items, etc.). However, the predefined first UI feedback is not limited thereto, and may be set differently based on various types of information (such as the type of application providing the UI screen, setting information (e.g., screen brightness), viewing environment (e.g., current time and ambient light), user information, etc.). For example, when the brightness of the screen is too bright, the user may not be able to recognize the transparency change of the focus GUI well, and therefore, the predefined first UI feedback may be set to provide motion feedback.
[0084] The motion feedback may be feedback that provides a motion corresponding to the rotation direction of the wheel input to the GUI item where the focus GUI is located. For example, the motion feedback may be feedback that tilts the corresponding GUI item in a moving direction corresponding to the rotation direction of the wheel input and then returns.
[0085] When the predefined first UI feedback is motion providing feedback (S520: Yes), the processor 120 may provide motion feedback corresponding to the rotation direction of the scroll wheel input to the first GUI item (S530). In this case, the motion feedback may be feedback that tilts the first GUI item in the direction of scroll wheel rotation by a preset angle so as not to overlap with a second GUI item adjacent to the first GUI item. However, when the distance between the GUI items is not wide enough to provide motion feedback at a preset angle, the first GUI item may be tilted so as to partially overlap with a second GUI item adjacent to the first GUI item. In this case, the overlapping portion may be displayed with a preset transparency. Alternatively, the angle corresponding to the motion feedback may be automatically adjusted according to the distance between the GUI items.
[0086] When the predefined first UI feedback is not motion providing feedback (S520: No), the processor 120 may provide static feedback to the second GUI item corresponding to the rotation direction of the scroll wheel input and the focus GUI (S540). Static feedback is named for the convenience of distinguishing from motion feedback, and may represent providing various visual feedback to the first GUI item, the second GUI item, and the focus GUI. According to one or more examples, the static feedback may include: feedback of maintaining the size of the second GUI item corresponding to the rotation direction of the scroll wheel input and providing a portion of the entire transparency of the focus GUI to the second GUI item, feedback of changing the size of the second GUI corresponding to the rotation direction of the scroll wheel input and providing a portion of the entire transparency of the focus GUI to the second GUI item, feedback of changing the size of the second GUI corresponding to the rotation direction of the scroll wheel input, and the like.
[0087] Despite Figure 5 It has been described that the processor 120 identifies whether the predefined first UI feedback is motion feedback, and provides static feedback when the predefined first UI feedback is not motion feedback, but this operation is for convenience of description, and the processor 120 can identify the predefined first UI feedback based on various information (such as application type, setting information (e.g., screen brightness), viewing environment (e.g., current time and ambient lighting), user information, etc.).
[0088] Figures 6a to 6d is a diagram for explaining various examples according to the first input type.
[0089] For convenience, Figures 6a to 6dIt is shown that multiple GUI items are arranged in a horizontal direction, and the focus GUI is located on the first GUI item among the multiple GUI items. However, as understood by a person of ordinary skill in the art, the arrangement direction of the multiple GUI items may vary (such as vertical and diagonal directions), and the focus GUI may also be located on a GUI item other than the first GUI item. In addition, the focus GUI is highlighted on the edge of the GUI item, and the GUI item where the focus GUI is located is shown to have a relatively larger size compared to the other GUI items. The focus GUI is not necessarily limited to this configuration, and may be modified as understood by a person of ordinary skill in the art. For example, the focus GUI may be highlighted on the entire GUI item, or only on a portion of the edge area of the GUI item.
[0090] Reference Figure 6a According to one or more examples, when a first input type in the right direction is recognized in a state where the focus GUI 620 is located on the first GUI item 611, the processor 120 may provide a motion feedback that the first GUI item 611 is tilted toward the second GUI item 612 located in the right direction and then returns to the original state. In this case, the motion feedback may be feedback that the first GUI item 611 is tilted by a preset angle in the direction of rotation of the scroll wheel so as not to overlap with the second GUI item 612 adjacent to the first GUI item 611. However, when the distance between the GUI items is not wide enough to provide motion feedback of a preset angle, the first GUI item 611 may be tilted so as to partially overlap with the second GUI item 612 adjacent to the first GUI item. In this case, the overlapping portion may be displayed with a preset transparency so as not to block the view of the overlapping GUI items. In one or more examples, the angle corresponding to the motion feedback may be automatically adjusted according to the distance between the GUI items so that the GUI items do not overlap.
[0091] For example, when the processor 120 recognizes a scale input in which the scroll wheel rotates from point P1 to point P2 of the scroll wheel input device and then returns to point P1, the processor 120 may provide corresponding motion feedback. When the scroll wheel rotates from point P1 to point P2, the scale input may be recognized as the second input type, but since the scroll wheel returns to point P1 before reaching point P2 (e.g., the scroll wheel only reaches P1'), the corresponding input is recognized as a scale input.
[0092] Reference Figure 6bAccording to one or more examples, when a first input type in the right direction is recognized while the focus GUI 620 is located on the first GUI item 611, the processor 120 may provide feedback of displaying the focus GUI 620 by maintaining the transparency of the focus GUI 620 on the first GUI item 611 at 50% (621) only and moving 50% (622) of the transparency of the focus GUI 620 to the second GUI item 612.
[0093] However, according to one or more examples, the transparency may also be adjusted based on the relative position of the rotation point of the scroll wheel between point P1 and point P2. For example, when the first input type is input to a point relatively closer to point P2 than point P1, the processor 120 may assign a relatively higher value to the second GUI item 612 as the transparency of the focus GUI 620 compared to the first GUI item 611. For example, the processor 120 may display the focus GUI 620 by keeping the transparency of the focus GUI 620 on the first GUI item 611 at 30% and moving the remaining 70% of the transparency of the focus GUI 620 to the second GUI item 612. High transparency may indicate that the focus GUI 620 may be displayed brighter. For example, high transparency may indicate a higher highlight attribute.
[0094] Reference Figure 6c According to one or more examples, when a first input type in the right direction is recognized in a state where the focus GUI 620 is located in the first GUI item 611, the processor 120 may Figure 6b As shown, the transparency of the focus GUI 620 is changed to adjust the size of the second GUI item 612. For example, Figure 6c As shown, the processor 120 may adjust the size of the second GUI item 612 to be the same as the size of the first GUI item 611 , but is not necessarily limited thereto.
[0095] However, according to one or more examples, the size may also be adjusted based on the relative position of the rotation point of the scroll wheel between point P1 and point P2. For example, when the first input type is input to a point relatively closer to point P2 than point P1, the processor 120 may adjust the size of the second GUI item 612 to be the same as the size of the first GUI item 611, and when the first input type is input to a point relatively closer to point P1 than point P2, the processor 120 may adjust the size of the second GUI item 612 to be smaller than the size of the first GUI item 611. In this case, the sizes of the first GUI item 611 and the second GUI item 612 may be adjusted so that the first GUI item 611 and the second GUI item 612 do not overlap each other.
[0096] Reference Figure 6dAccording to one or more examples, when the first input type in the right direction is recognized in a state where the focus GUI 620 is located on the first GUI item 611, the processor 120 may Figure 6c The second GUI item 612 is resized in a similar manner, but the transparency of the focus GUI 620 remains unchanged.
[0097] The above-mentioned first UI feedback can be set when manufacturing the electronic device 100, or can be set / changed according to a user command. In addition, the first GUI feedback can be set in various forms based on various information (such as the type of UI screen, the type of application, the current time, the user, etc.), or can be set / changed by combining some information. For example, when the first GUI feedback preset for the type of UI screen is motion feedback, and the first GUI feedback preset for the first user is static feedback, it is also possible to provide the first GUI feedback according to the user's input. Figure 6a Movement feedback and Figure 6b Static feedback of both.
[0098] In addition, according to one or more embodiments, each time the first input type is recognized, the processor 120 may provide the first UI feedback in a different form. For example, the processor 120 may provide a first UI feedback according to the first input of the first type. Figure 6a motion feedback, and providing a second input of the first type according to Figure 6b Static feedback.
[0099] Figure 7 is a diagram for explaining various examples according to the second input type.
[0100] According to one or more embodiments, when the second input type in the right direction is recognized once in a state where the focus GUI 620 is located on the first GUI item 611, the processor 120 may expand the size of the second GUI item 612, restore the size of the first GUI item 611 to its original state, move the focus GUI 620 to the second GUI item 612 located in the right direction, and display the focus GUI 620. For example, Figure 7 As shown, when three scales are defined as the second input type, each of P1 to P2, P2 to P3, P3 to P4, and P4 to P5 may correspond to the second input type. Accordingly, when the scroll wheel rotates 710 from point P1 to point P2, the processor 120 may move the focus GUI 620 from the first GUI item 611 to the second GUI item 612 and display the focus GUI 620, and when rotating 720 again from point P2 to point P3, the processor 120 may move the focus GUI 620 from the second GUI item 612 to the third GUI item 613 and display the focus GUI 620. In this case, as Figure 7As shown, the size of the GUI item where the focus GUI 620 is located can be adjusted to be larger than other GUI items and displayed.
[0101] 2 , according to one or more embodiments, when a second input type is recognized while playing back content through the display 110 , the processor 120 may recognize a threshold number corresponding to the second input type as a different value so as to be inversely proportional to the length of the content.
[0102] For example, when the content length is less than the first threshold length, the processor 120 may identify the threshold number as the first number, when the content length is greater than or equal to the first threshold length and less than the second length, the processor 120 may identify the threshold number as the second number, and when the content length is greater than or equal to the second length, the processor 120 may identify the threshold number as the third number. However, although the content length in this case is divided into 3 intervals, in other examples, the content length may be divided into 2 intervals, or may be divided into 4 or more intervals.
[0103] According to one or more examples, even if the threshold number corresponding to the second type is identified as a different value so as to be inversely proportional to the length of the content, the processor 120 may change the threshold number for each interval of the content. For example, the processor 120 may adaptively adjust the threshold number in the corresponding interval based on the user's operation history and the importance of the content inserted in the initial or end part of the content (e.g., repeating the notification of the previous section, the next section, etc.).
[0104] Figure 8 and Fig. 9 2 is a diagram for explaining a method of setting a threshold number of the second input type according to a content length.
[0105] Reference Figure 8 , when the processor 120 recognizes that the overall length of the content played back through the display 110 is less than the first threshold length (S805: Yes), the processor 120 may recognize the threshold number of scales for the second input type as the first number (S810). Next, when the first number of scale inputs is generated (S815), the processor 120 may adjust the playback interval of the content according to the preset time interval (S820). For example, the first number of scale inputs (one second input type) may be a key input in the software (e.g., a specific button (e.g., a play button) of the remote control is input once), so that the processor 120 may perform the same function as the function of moving the preset interval.
[0106] When the overall length of the content played back through the display 110 is not less than the first threshold length (S805: No), the processor 120 may identify whether the overall length of the content is equal to or greater than the first threshold length and less than the second threshold length (S825). When the overall length of the content is identified as being greater than or equal to the first threshold length and less than or equal to the second threshold length (S825: Yes), the processor 120 may identify the second type of scale threshold quantity as a second quantity (S830). Subsequently, when the second quantity of scale input is generated (S835), the processor 120 may adjust the playback interval of the content according to a preset time interval (S840).
[0107] When the overall length of the content is equal to or greater than the second threshold length (S825: No), the processor 120 identifies whether the overall length of the content is greater than or equal to the second threshold length (S845). When it is identified that the overall length of the content is greater than or equal to the second threshold length (S845: Yes), the processor 120 may identify the scale threshold number of the second input type as a third number (S850). Subsequently, when the third number of scale inputs is generated (S855), the processor 120 may adjust the playback interval of the content according to a preset time interval (S860). For example, the processor 120 may move the same playback time (e.g., 1 second) based on different numbers of scale inputs according to the overall length of the content.
[0108] As described above, when the overall length of the first content is less than the first threshold length, the processor 120 may determine the threshold number of the second input type as the first number. When the overall length of the second content is greater than or equal to the first threshold length and less than the second threshold length, the processor 120 may determine the threshold number of the second input type as the second number. When the overall length of the third content is greater than or equal to the second threshold length, the processor 120 may determine the threshold number of the second input type as the third number. The second number may be greater than the third number and less than the first number. Therefore, the size of the threshold number is inversely proportional to the content length.
[0109] According to one or more examples, such as Fig. 9 As shown, when the overall length of the first content is less than the first threshold length, the processor 120 may set the threshold number to a first number 910, for example, 1 (eg, 1 scale). Fig. 9 As shown, when the overall length of the second content is greater than or equal to the first threshold length and less than the second threshold length, the processor 120 may set the threshold number to a second number 920, for example, 3 (eg, 3 scales). Fig. 9As shown, for the third content whose overall length is equal to or greater than the second threshold length, the processor 130 may set the threshold number to a third number 930, for example, 10 (e.g., 10 scales). In this case, in the case of the first content, the playback interval moves by 1 second for every 1 scale input, in the case of the second content, the playback interval moves by 1 second for every 3 scale inputs, and in the case of the third content, the playback interval moves by 1 second for every 10 scale inputs.
[0110] However, in Fig. 9 In the embodiment, it has been described that the processor 120 sequentially determines whether the overall length of the content is less than the first threshold length, whether the content is greater than or equal to the first threshold length and less than the second threshold length, and whether the content is greater than or equal to the second threshold length. However, this operation is for convenience of description, and the overall length of the content can be immediately identified based on metadata, etc.
[0111] Figures 10a to 10c is a diagram for describing a method for adjusting a content playback interval according to one or more embodiments.
[0112] Reference Fig.10a According to one or more examples, videos with a playback time of mainly 15 seconds to 1 minute (e.g., up to 10 minutes) (such as scale films, short films, reels, fast-paced rap, etc.) can be classified as short videos, and thus the threshold number N can be set to 10. In this case, 10 scales can be set as one rotation input 930, and each time a rotation input 930 occurs (e.g., the rotating wheel moves 10 scales), the playback interval can move 1 second. This configuration prevents the playback time from being accidentally changed a lot at one time due to the short length of the video.
[0113] Reference Fig.10b According to one or more examples, content with a length of more than 10 minutes (e.g., content with a length between 20 and 40 minutes) (such as YouTube content and web dramas) may be classified as medium videos, and therefore, the threshold number N may be set to 3. In this case, 3 scales may be set as one rotation input 920, and each time a rotation input 920 occurs (e.g., the rotation wheel moves 3 scales), the playback interval may move 1 second. In this case, an experience similar to general image manipulation may be provided (e.g., the image is updated every 3 scales when the rotation wheel is moved).
[0114] Reference Fig.10cAccording to one or more examples, general traditional media such as movies and dramas (e.g., content with a length of more than 1 hour) may be classified as long videos, and therefore, the threshold number N may be set to 1. In this case, 1 scale is set as one rotation input 910, and each time a rotation input 910 occurs (e.g., the rotation wheel moves 1 scale), the playback interval may move 1 second. In this case, depending on the length of the video, quick manipulation (e.g., scrolling the content quickly) and fine adjustment (e.g., scrolling a small amount of content per scale) may be performed for each interval.
[0115] As described above, an operation experience suitable for the user's intention can be provided by adjusting one or more thresholds according to the length of the content. For example, the longer the content is, the more sensitive the feedback based on the movement of the scroll wheel becomes (for example, when defined as 1 rotation input = N scales, the N value decreases), and the shorter the length of the content is, the less sensitive the feedback based on the movement of the scroll wheel becomes (for example, when defined as 1 rotation input = N scales, the N value increases).
[0116] According to one or more embodiments, even if the threshold number is set according to the length of the content, the threshold number in some intervals may be temporarily adjusted according to a user command or the interval type of the content. Fig.10b In the embodiment of the embodiment, the threshold number of the content is set to 3, and in the initial interval and the end interval of the content, the threshold number can also be automatically changed to a value less than 3. According to one or more examples, the processor 120 can determine whether to adjust the threshold number based on the user's manipulation history information. For example, when the tendency of quickly adjusting the scroll wheel input in the initial interval and the end interval of the content is high, the processor 120 can adaptively change the threshold number in the corresponding interval to a value less than 3, so that it can be adjusted faster in the corresponding interval than in other intervals.
[0117] Fig.11 is a diagram for explaining a method for adjusting a content playback interval according to one or more embodiments.
[0118] exist Fig.11 In the present invention, for the convenience of description, the case where the scroll wheel input device is implemented as an external device of the electronic device 100 will be described. However, as understood by those skilled in the art, Fig.11 The illustrated process may be performed with respect to a scroll wheel input device that is a component of the electronic apparatus 100 .
[0119] Reference Fig.11, when the processor 120 recognizes that the overall length of the content played back through the display 110 is less than the first threshold length (S11005: Yes), the processor 120 may recognize the scale threshold number of the second input type as the first number (S1110). Subsequently, the processor 120 may send information related to the first number to the wheel input device (S1115). Thereafter, when a signal corresponding to the scale input of the first number is received from the wheel input device (S1120: Yes), the processor 120 may adjust the playback interval of the content according to the preset time interval (S1125).
[0120] When the overall length of the content played back through the display 110 is not less than the first threshold length (S1105: No), the processor 120 identifies whether the overall length of the content is equal to or greater than the first threshold length and less than the second threshold length (S1130). When the overall length of the content is identified as being greater than or equal to the first threshold length and less than or equal to the second threshold length (S1130: Yes), the processor 120 may identify the second type of scale threshold quantity as the second quantity (S1135). Subsequently, the processor 120 may send information related to the second quantity to the scroll wheel input device (S1140). Thereafter, when a signal corresponding to the scale input of the second quantity is received from the scroll wheel input device (S1145: Yes), the processor 120 may set the playback interval of the content according to a preset time interval (S1150).
[0121] When the overall length of the content is equal to or greater than the second threshold length (S1130: No), the processor 120 identifies whether the overall length of the content is greater than or equal to the second threshold length (S1150). When it is identified that the overall length of the content is greater than or equal to the second threshold length (S1150: Yes), the processor 120 may identify the scale threshold number of the second input type as a third number (S1155). Subsequently, the processor 120 may send information related to the third number to the scroll wheel input device (S1160). Thereafter, when a signal corresponding to the scale input of the second number is received from the scroll wheel input device (S1145: Yes), the processor 120 may set the playback interval of the content according to a preset time interval (S1150). For example, as described above, the processor 120 may send information related to the identified threshold number to the scroll wheel input device, and whenever a signal corresponding to the threshold number is received from the scroll wheel input device, the playback interval of the content may be set according to a preset time interval.
[0122] In addition, the length of the content, the first quantity, the second quantity, and the third quantity are described with Figure 8 The same / similar to those described in , and therefore, their detailed description will be omitted.
[0123] Returning to FIG. 2 , according to one or more embodiments, when a scroll wheel input is recognized while providing a continuous adjustment UI with an adjustable range through the display 110, the processor 120 may recognize the threshold quantity corresponding to the second input type as one of different values so as to be inversely proportional to the length of the adjustable range. The continuous adjustment UI may refer to a UI having a preset adjustment range and configured to be continuously adjusted, such as a UI for adjusting volume, screen brightness, contrast, backlight brightness, bulb brightness, air conditioning temperature, etc.
[0124] Fig.12 is a diagram for explaining a method of adjusting a continuous adjustment UI according to one or more embodiments.
[0125] Reference Fig.12 , when the adjustable range of the continuous adjustment UI provided by the display 110 is the first range (S1205: Yes), the processor 120 may identify the scale threshold number of the second input type as the fourth number (S1210). Subsequently, when the fourth number of scale inputs is generated (S1215), the processor 120 may adjust the continuous adjustment UI according to a preset interval (S1220).
[0126] When the adjustable range of the continuous adjustment UI is not the first range (S1205: No), the processor 120 identifies whether the adjustable range of the continuous adjustment UI is the second range (S1225). When the adjustable range of the continuous adjustment UI is identified as the second range (S1225: Yes), the processor 120 may identify the scale threshold quantity of the second input type as the fifth quantity (S1230). Subsequently, when the fifth quantity scale input is generated (S1235), the processor 120 may adjust the continuous adjustment UI according to the preset interval (S1240).
[0127] When the adjustable range of the continuous adjustment UI is not the second range (S1225: No), the processor 120 identifies whether the adjustable range of the continuous adjustment UI is the third range (S1245). When the adjustable range of the continuous adjustment UI is identified as the third range (S1245: Yes), the processor 120 may identify the second type of scale threshold quantity as the sixth quantity (S1250). Subsequently, when the sixth quantity of scale input is generated (S1255), the processor 120 may adjust the continuous adjustment UI by a preset interval (S1260). For example, the processor 120 may move a preset interval (e.g., 1 interval) based on different numbers of scale inputs according to the adjustable range of the continuous adjustment UI.
[0128] Figures 13a to 13c is a diagram for explaining a method of adjusting a continuous adjustment UI according to one or more embodiments.
[0129] Reference Figures 13a to 13c, the processor 120 can finely adjust the UI by automatically setting the threshold number according to the length of the adjustment interval in the continuous adjustment UI. For example, because the backlight brightness is generally set in the range of 0 to 20, the temperature of the air conditioner is generally set in the range of 0 to 30, and the volume, contrast, picture brightness, etc. are generally set in the range of 0 to 100, etc., the backlight brightness can correspond to a "low" level adjustment sensitivity, the temperature of the air conditioner can correspond to a "medium" level adjustment sensitivity, and the volume, contrast, picture brightness, etc. can correspond to a "high" level adjustment sensitivity. For example, when a first setting has a "low" level adjustment sensitivity compared to a second setting having a "high" level adjustment sensitivity, the adjustment amount for the first setting can be smaller than the adjustment amount for the second setting based on the same number of scales.
[0130] Fig.13a A case where the backlight brightness control UI 1310 is adjusted is shown.
[0131] Assuming that the backlight brightness can be set to 0 to 20, the processor 120 can adjust the backlight value by 1 for one rotation input of 5 scales by setting, for example, the threshold value number N=5. For example, since the range of adjustable values is not large, the value can be prevented from being significantly changed by setting the manipulation sensitivity of the scroll wheel to have a "low" level of sensitivity regardless of the user's intention. When the screen brightness adjustment UI 1320 and the contrast adjustment UI 1330 are selected, the threshold value number can be set to a value smaller than the backlight brightness adjustment based on the adjustable range of the corresponding UI.
[0132] Fig.13b A case where the air-conditioning temperature adjustment UI 1340 is adjusted is shown.
[0133] Assuming that the temperature value can be set to 0 to 30, the processor 120 can adjust the temperature value by 1 for one rotation input of 3 scales by setting, for example, the threshold number N=3.
[0134] Fig.13c A case where the volume control UI 1350 is adjusted is shown.
[0135] Assuming that the volume value can be set to 0 to 100, the processor 120 can adjust the volume value by 1 for each rotation input of 1 scale by setting, for example, the threshold number N = 1. For example, since the adjustable range is large, the sensitivity can be set to a high level sensitivity so that it can be manipulated quickly.
[0136] According to one or more embodiments, the processor 120 may send information about the set threshold number N value to the wheel input device 20 including the wheel 21, and adjust the corresponding value by 1 each time a signal corresponding to one rotation input is received from the wheel input device 20.
[0137] Fig.14 and Fig.15 is a diagram for explaining various examples according to the third input type.
[0138] According to one or more embodiments, when a plurality of second input types (or a plurality of first input types) are continuously generated at a threshold speed or higher, the processor 120 may recognize that a third input type has occurred. The second UI feedback may include feedback of changing the transparency of the focus GUI and continuously moving the focus GUI to a plurality of GUI items corresponding to the rotation direction of the scroll wheel input.
[0139] like Fig.14 As shown, when a third input type is recognized in a state where the focus GUI 1420 is located on the first GUI item 1411 among multiple GUI items arranged in a horizontal direction, the processor 120 can adjust the transparency of the focus GUI 1420 while continuously moving the focus GUI 1420 to a GUI item located in the rotation direction of the scroll wheel (e.g., the right direction).
[0140] For example, when the focus GUI 1420 is located on the sixth GUI item 1416, the focus GUIs 1421 and 1422 having a transparency lower than that of the GUI 1420 may be located on the fifth GUI item 1415 adjacent to the left side of the sixth GUI item 1416 and on the seventh GUI item 1417 adjacent to the right side of the sixth GUI item 1416. For example, when the transparency of the focus GUI 1420 is 100%, the transparency of the focus GUIs 1421 and 1422 located on the fifth GUI item 1415 and the seventh GUI item 1417 may be 50%.
[0141] In one or more examples, the transparency of the focus GUI 1420 may be assigned to each of the sixth GUI item 1416, the fifth GUI item 1415, and the seventh GUI item 1417. For example, the focus GUI 1420 with 50% transparency may be located on the sixth GUI item 1416, and the focus GUIs 1421 and 1422 with 25% transparency may be located on the fifth GUI item 1415 and the seventh GUI item 1417, respectively.
[0142] In one or more examples, the transparency of the focus GUI 1420 may be assigned only to the seventh GUI item 1417 corresponding to the rotation direction of the scroll wheel. For example, the focus GUI 1420 with 70% transparency may be located on the sixth GUI item 1416, and the focus GUI 1422 with 30% transparency may be located on the seventh GUI item 1417.
[0143] However, the embodiment is not limited thereto, and the focus GUI 1420 may be positioned in a form in which transparency is extended to adjacent GUI items in a Gaussian form based on a center GUI item, or in a form in which transparency is extended only to GUI items corresponding to a rotation direction of the scroll wheel.
[0144] According to one or more embodiments, when it is identified that a GUI item having the same depth as the first GUI item 1411 is not arranged at a position corresponding to the rotation direction of the third type of scroll wheel input, the processor 120 can control the display 110 to display a GUI item having a depth different from the depth of the first GUI item 1411, or can control the display 110 to move the focus GUI to a GUI item having a different depth arranged at a position corresponding to the rotation direction, and display the focus GUI.
[0145] For example, Fig.14 As shown, when a scroll wheel input in the left direction is recognized in a state where the focus GUI 1420 is located on the first GUI item 1411, the processor 120 may recognize that a GUI item having the same depth as that of the first GUI item 1411 is not arranged in the left direction. In this case, the processor 120 may display the focus GUI 1420 by moving the focus GUI 1420 to one of the GUI items 1431, 1432, 1433, 1434, and 1435 vertically arranged on the left side (e.g., the GUI item 1431 positioned closest to the first GUI item 1411 in the vertical arrangement), or by moving the focus GUI 1420 to the first GUI item 1435 or the last GUI item 1431 in the vertical arrangement.
[0146] As one or more examples, when it is recognized that a GUI item having the same depth as that of the first GUI item 1411 is arranged in the left direction but is not displayed, the processor 120 may move the displayed GUI item to the right and display the GUI item that is not displayed on the left side of the first GUI item 1411. For example, when the first GUI item 1411 is the first GUI item in the horizontal arrangement, the processor 120 may display the last GUI item in the horizontal arrangement and the GUI items reversely arranged on the left side of the first GUI item 1411, and move the focus GUI 1420 to the corresponding GUI item in the left direction and display the focus GUI 1420.
[0147] As one or more examples, when it is identified that a GUI item having the same depth as that of the first GUI item 1411 is not arranged in the left direction, the processor 120 may display a GUI item corresponding to the detailed depth of the first GUI item 1411, and move the focus GUI 1420 and display the focus GUI 1420 on the corresponding GUI item.
[0148] Fig.15 A method of identifying a third input type according to one or more examples is shown. Fig.15 , the processor 120 can calculate the rotation speed by dividing the number of scales (or original scales) recognized during the preset time by the time taken, and can identify the third input type based on the rotation speed. For example, the processor 120 can calculate the rotation speed by dividing the number of scales recognized within 60ms by the time interval (e.g., 60ms).
[0149] For example, when the rotation speed is greater than or equal to the threshold speed, the processor 120 may identify the third input type and enter the continuous key mode. For example, when the threshold speed is 30 degrees / ms, the processor 120 may enter the continuous key mode when it is identified that the speed is equal to or greater than 30 degrees / ms, and maintain the continuous key mode when the speed remains equal to or greater than 30 degrees / ms. In one or more examples, when the roller input is not recognized within a preset time after entering the continuous key mode, or when the roller input with a speed equal to or greater than a specific speed is not recognized, the processor 120 may release the continuous key mode. For example, the threshold speed for releasing the continuous key mode may be different from the threshold speed for entering and maintaining the continuous key mode.
[0150] In one or more examples, the threshold speed for entering the continuous key mode may be different from the threshold speed for maintaining the continuous key mode. For example, the processor 120 may enter the continuous key mode when the speed is equal to or greater than 60 degrees / ms, and maintain the continuous key mode when the speed remains equal to or greater than 30 degrees / ms.
[0151] According to the various embodiments described above, a navigation experience that satisfies the user's intention can be provided by classifying the type of scroll wheel input into three types. In addition, for fine manipulation or fast continuous operation, a manipulation experience that satisfies each user's intention can be provided.
[0152] The methods according to various embodiments of the present disclosure described above can be implemented in the form of an application that can be installed in an existing electronic device. According to various embodiments of the present disclosure, at least some of the methods described above can be performed using an artificial intelligence model based on deep learning (e.g., a learning network model).
[0153] In addition, the above-mentioned methods according to various embodiments of the present disclosure may be implemented only by upgrading the software or hardware of the existing electronic device.
[0154] In addition, the various embodiments of the present disclosure described above may be executed by an embedded server included in the electronic device or an external server of the electronic device.
[0155] According to one or more embodiments of the present disclosure, the various embodiments described above may be implemented as software including instructions stored in a machine (e.g., computer) readable storage medium. A machine is a device that can call stored commands from a storage medium and operate according to the called commands, and may include an electronic device (e.g., electronic device A) according to a disclosed embodiment. When a command is executed by a processor, the processor may directly execute a function corresponding to the command, or execute it by using other components under the control of the processor. A command may include code generated or executed by a compiler or interpreter. A machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory" means that the storage medium does not include a signal and is tangible, but does not distinguish whether the data is stored semi-permanently or temporarily on the storage medium.
[0156] According to one or more embodiments of the present disclosure, the methods according to the various embodiments described above may be provided in a computer program product. The computer program product may be traded between a seller and a buyer as a commodity. The computer program product may include a product in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or may be downloaded through an application store (e.g., Google Play Store). TM or AppStore TM ) Online distribution. In the case of electronic distribution, at least a portion of the computer program product may be temporarily stored or created on a storage medium (such as a manufacturer's server, an application store's server, or a memory of a relay server).
[0157] Each component (e.g., module or program) according to the various embodiments described above may be composed of a single entity or multiple entities, and some of the above subcomponents may be omitted, or other subcomponents may be included in various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into one entity to perform the functions performed by each corresponding component before integration in the same or similar manner. According to various embodiments, the operations performed by modules, programs or other components may be performed sequentially, in parallel, repeatedly or heuristically, or at least some operations may be performed in a different order, another operation may be omitted or added.
[0158] Although the embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the above-mentioned specific embodiments, and various modifications may be made by technicians in the relevant fields without departing from the subject matter of the present disclosure as claimed in the claims, and such modifications should not be understood solely from the technical ideas or prospects of the present disclosure.
Claims
1. An electronic device, include: monitor; as well as One or more processors configured to: controlling the display to display a user interface (UI) screen, wherein the UI screen includes a plurality of graphical user interface (GUI) items and a focus GUI located on a first GUI item among the plurality of GUI items, identifying an input type of the wheel input from a plurality of input types of the wheel input based on at least one of a rotation distance or a rotation speed of the wheel input, Based on the scroll wheel input being recognized as a first input type, controlling the display to provide a first UI feedback to at least one of the first GUI item, a second GUI item corresponding to the rotation direction of the scroll wheel input, or the focus GUI, Based on the scroll wheel input being recognized as a second input type, controlling the display to move the focus GUI to the second GUI item and displaying the focus GUI, and Based on the scroll wheel input being recognized as a third input type, the display is controlled to provide second UI feedback to the focus GUI while continuously moving the focus GUI to sequentially pass through a plurality of GUI items corresponding to a rotation direction of the scroll wheel input.
2. The electronic device according to claim 1, in, The first input type is identified based on the following events: returning to a manipulation starting point after generating less than a threshold number of scale inputs corresponding to the movement of the scroll wheel, The second input type is identified based on the following event: a number of scale inputs corresponding to the movement of the scroll wheel greater than or equal to the threshold number is generated at a speed less than a threshold speed, The third input type is identified based on the following events: a number of scale inputs corresponding to the movement of the scroll wheel greater than or equal to the threshold number is generated at a speed greater than or equal to the threshold speed, and The scale input is an input corresponding to a basic manipulation unit of the scroll wheel on at least one of a scroll wheel button or a touch panel that receives the scroll wheel input.
3. The electronic device according to claim 1, in, The first UI feedback includes at least one of the following items: feedback providing movement to the first GUI item, feedback changing the transparency of the focus GUI located on the first GUI item, feedback displaying a focus GUI with a preset transparency on the second GUI item, or feedback changing the size of the second GUI item, and The second UI feedback includes feedback of continuously moving to sequentially pass through a plurality of GUI items corresponding to a rotation direction of the scroll wheel input by changing transparency of the focus GUI.
4. The electronic device according to claim 1, in, The one or more processors are configured to: entering a continuous key mode based on the scroll wheel input being recognized as the third input type, and The continuous key mode is released based on not recognizing the scroll wheel input of the third input type within a threshold time in the continuous key mode.
5. The electronic device according to claim 1, in, The second input type is identified based on the following event: a greater than or equal to a threshold number of scale inputs corresponding to the movement of the scroll wheel are generated at a speed less than a threshold speed, and The one or more processors are configured to, based on recognizing the scroll wheel input while playing back content through the display, identify a threshold number corresponding to the second input type as having a value such that the threshold number corresponding to the second input type is inversely proportional to a length of the content.
6. The electronic device according to claim 5, in, The one or more processors are configured to: identifying a threshold number corresponding to the second input type as a first number based on the length of the first content, and adjusting the playback interval of the first content according to a preset time interval based on a wheel input of the second input type that generates the first number of scale inputs at a speed less than the threshold speed, identifying a threshold number corresponding to the second input type as a second number greater than the first number based on a length of the second content, and adjusting a playback interval of the second content according to the preset time interval based on a wheel input of the second input type that generates the second number of scale inputs at a speed less than the threshold speed, and identifying a threshold number corresponding to the second input type as a third number greater than the second number based on a length of the third content, and adjusting the playback interval of the content according to the preset time interval based on a wheel input of the second input type that generates the third number of scale inputs at a speed less than the threshold speed, The length of the second content is greater than the length of the first content, and less than the length of the third content.
7. The electronic device according to claim 1, in, The second input type is identified based on the following event: a threshold number of tick inputs is generated at a speed less than a threshold speed, and The one or more processors are configured to: based on recognizing the scroll wheel input while providing a continuous adjustment UI with an adjustable range through the display, identify a threshold number corresponding to the second input type as having a value such that the threshold number corresponding to the second input type is inversely proportional to the length of the adjustable range.
8. The electronic device according to claim 1, in, The one or more processors are configured to control the display to provide the first UI feedback based on the scroll wheel input being identified as the first input type before the focus GUI moves horizontally from the first GUI item to the second GUI item, before the focus GUI moves vertically from the first GUI item to the second GUI item, or before the focus GUI moves vertically from the first GUI item to the second GUI item and a line break occurs.
9. The electronic device according to claim 1, in, The one or more processors are configured to: based on determining that a GUI item having the same depth as the depth of the first GUI item is not arranged at a position corresponding to the rotation direction of the scroll wheel input, control the display to display a GUI item having a depth different from the depth of the first GUI item, or control the display to move the focus GUI to a GUI item of a different depth arranged at a position corresponding to the rotation direction, and display the focus GUI.
10. The electronic device according to claim 1, in, The one or more processors are configured to: Based on the scroll wheel input being recognized as the second input type, while moving the focus GUI to the second GUI item and displaying the focus GUI, controlling the display to increase the size of the second GUI item, and Based on the wheel input being recognized as the third input type, the display is controlled to continuously move the focus GUI to a plurality of GUI items corresponding to the rotation direction of the wheel input so that the size of the GUI item where the focus GUI is located is maintained.
11. A method for providing a UI of an electronic device, the method include: Displaying a user interface UI screen, wherein the UI screen includes a plurality of graphical user interface GUI items and a focus GUI located on a first GUI item among the plurality of GUI items; identifying an input type of the scroll wheel input from a plurality of input types of the scroll wheel input based on at least one of a rotation distance or a rotation speed of the scroll wheel input; as well as controlling the UI screen based on the recognized input type of the scroll wheel input, and Wherein, controlling the UI screen includes: providing first UI feedback to at least one of the first GUI item, a second GUI item corresponding to the rotation direction of the wheel input, or the focus GUI based on the wheel input being recognized as a first input type, Based on the scroll wheel input being recognized as a second input type, moving the focus GUI to the second GUI item and displaying the focus GUI, and Based on the scroll wheel input being recognized as a third input type, second UI feedback is provided to the focus GUI while continuously moving the focus GUI to sequentially pass through a plurality of GUI items corresponding to a rotation direction of the scroll wheel input.
12. The method according to claim 11, in, The first input type is identified based on the following events: returning to a manipulation starting point after generating less than a threshold number of scale inputs corresponding to the movement of the scroll wheel, The second input type is identified based on the following event: a number of scale inputs corresponding to the movement of the scroll wheel greater than or equal to the threshold number is generated at a speed less than a threshold speed, The third input type is identified based on the following events: a number of scale inputs corresponding to the movement of the scroll wheel greater than or equal to the threshold number is generated at a speed greater than or equal to the threshold speed, and The scale input is an input corresponding to a basic manipulation unit of the scroll wheel on at least one of a scroll wheel button or a touch panel that receives the scroll wheel input.
13. The method according to claim 11, in, The first UI feedback includes at least one of the following items: feedback providing movement to the first GUI item, feedback changing the transparency of the focus GUI located on the first GUI item, feedback displaying a focus GUI with a preset transparency on the second GUI item, or feedback changing the size of the second GUI item, and The second UI feedback includes feedback of continuously moving to sequentially pass through a plurality of GUI items corresponding to a rotation direction of the scroll wheel input by changing transparency of the focus GUI.
14. The method according to claim 11, in, Controlling the UI screen includes entering a continuous key mode based on the wheel input being recognized as the third input type, and releasing the continuous key mode based on the wheel input of the third input type not being recognized within a threshold time in the continuous key mode.
15. The method according to claim 11, in, The second input type is identified based on the following event: a greater than or equal to a threshold number of scale inputs corresponding to the movement of the scroll wheel is generated at a speed less than a threshold speed, The method further comprises: Based on recognizing the scroll wheel input while playing back content through a display, a threshold number corresponding to the second input type is identified to have a value such that the threshold number corresponding to the second input type is inversely proportional to a length of the content.
