Graphical User Interface Controller

Abstract

To allow a user to easily grasp an operation amount of drag operation in a GUI.SOLUTION: A device 11 for controlling operation of a graphical user interface having a touch panel 20 includes a first processing unit 12 and a second processing unit 15. The first processing unit 12 moves sliders 47-49 that can move in a one-dimensional direction displayed on the touch panel 20 according to touch operation of the sliders 47-49 performed by being in contact with the touch panel 20. The second processing unit 15 displays a marker 50 at a position on the touch panel 20 apart in the direction orthogonal to a movement direction of the sliders 47-49 from the sliders 47-49 while the sliders 47-49 are touch-operated.SELECTED DRAWING: Figure 3B

Description

[Technical Field]

[0001] The present invention relates to a graphical user interface (hereinafter abbreviated as "GUI") control device. [Background technology]

[0002] The GUI, which has a touch panel on the screen of the display unit, detects touch operations on the screen by the user through the touch panel. When the GUI detects a touch operation on the screen, the electronic device equipped with the GUI executes processing according to the content of the touch operation.

[0003] Patent Document 1 proposes a technique for simultaneously inputting setting values ​​for two elements related to heating food in a single operation in a microwave oven GUI. This proposal involves displaying a Cartesian coordinate system with coordinate axes corresponding to the two elements on the display unit of the GUI, and allowing the user to drag a point on the display unit touched with their finger up, down, left, right, or diagonally on the Cartesian coordinate system to a point with coordinate values ​​corresponding to the setting values ​​for both elements. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Special Publication No. 2015-59920 Summary of the Invention [Problem to be solved by the invention]

[0005] In the technology of Patent Document 1, during a drag operation on the display unit, the position touched by a finger or the like is hidden behind the finger or the like, making it difficult for the user to grasp the amount of drag operation. Patent Document 1 does not mention a method for making it easier to grasp the amount of drag operation.

[0006] An object of the present invention is to make it easier for the user to grasp the amount of dragging operation in a GUI. [Means for solving the problem]

[0007] In order to achieve the above object, a graphical user interface control device according to one aspect of the present invention comprises: 1. An apparatus for controlling the operation of a graphical user interface having a touch panel, comprising: a first processing unit that moves a slider that is displayed on the touch panel and that can move in one dimension in response to a touch operation of the slider that is performed by contacting the touch panel; a second processing unit that displays a marker at a position on the touch panel that is spaced apart from the slider in a direction perpendicular to a moving direction of the slider while the slider is being touch-operated; Equipped with. [Effects of the Invention]

[0008] According to the present invention, it is possible to make it easier for the user to grasp the amount of dragging operation in the GUI. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing the configuration of a user terminal device equipped with a GUI control device according to a first embodiment of the present invention. [Figure 2] FIG. 2 is a diagram showing a smartphone in which the display unit of FIG. 1 is arranged on the front side of the housing. [Figure 3A] FIG. 3A is a diagram showing a state in which a user touches the treble slider with a finger on the equalizer setting screen of FIG. [Figure 3B] FIG. 3B is a diagram showing a state in which a bar corresponding to the treble slider is displayed on the equalizer setting screen by touching the slider in FIG. 3A. [Figure 3C] FIG. 3C is a diagram showing a state in which the treble slider and bar have been moved on the equalizer setting screen by dragging the slider in FIG. 3B. [Figure 3D]FIG. 3D is a diagram showing a state in which the movement of the treble slider on the equalizer setting screen by the dragging operation of the slider in FIG. 3C has been confirmed. [Figure 3E] FIG. 3E is a diagram showing the acceptance state of movement due to fine adjustment of the treble slider during the suspension period before the movement of the slider in FIG. 3C is confirmed. [Figure 4A] FIG. 4A is a diagram showing a state in which a bar corresponding to the bass slider is displayed on the equalizer setting screen by touching the slider in FIG. 3A. [Figure 4B] FIG. 4B is a diagram showing a state in which a bar corresponding to the midrange slider is displayed on the equalizer setting screen by touching the slider in FIG. 3A. [Figure 4C] FIG. 4C is a diagram showing a state in which a moving area corresponding to the treble slider on the equalizer setting screen is displayed in color by touching the slider in FIG. 3A. [Figure 5] FIG. 5 is a diagram showing a state in which the link button on the equalizer setting screen of FIG. 2 is turned on, and the movement of one dragged slider causes the other two sliders to move in conjunction with each other. [Figure 6] FIG. 6 is a diagram showing a case where the movement direction of the slider on the equalizer setting screen of FIG. 2 is changed by 90°. [Figure 7] FIG. 7 is a diagram showing a state in which a position mark corresponding to the treble slider is displayed on the equalizer setting screen by touching the slider in FIG. 3A. [Figure 8] FIG. 8 is a diagram showing a state in which a volume setting screen is displayed on the display unit of FIG. 1 by a GUI control device according to the second embodiment of the present invention. [Figure 9A] FIG. 9A is a diagram showing a state in which a bar corresponding to the left channel slider is displayed on the volume setting screen by touching the slider in FIG. [Figure 9B] FIG. 9B is a diagram showing a state in which a bar corresponding to the slider for the right channel is displayed on the volume setting screen by touching the slider in FIG. [Figure 10]FIG. 10 is a diagram showing a state in which the link button on the volume setting screen in FIG. 8 is turned on, and the left channel slider moves in conjunction with the movement of the right channel slider that has been dragged. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present invention will be described with reference to the drawings. The same or equivalent parts or components are designated by the same reference numerals throughout the drawings.

[0011] The following embodiments are examples of devices that embody the technical concept of the present invention. The technical concept of the present invention does not limit the materials, shapes, structures, arrangements, functions, etc. of each component to those described below.

[0012] [First embodiment] FIG. 1 is a diagram showing the configuration of a user terminal device equipped with a GUI control device according to a first embodiment of the present invention. The user terminal device 1 in FIG. 1 can be configured as a mobile terminal such as a smartphone or a tablet terminal device. The user terminal device 1 may not be a mobile terminal, but may also be a stationary terminal device. The user terminal device 1 has a general-purpose microcontroller 10 and a touch panel 20.

[0013] The microcontroller 10 includes a CPU (Central Processing Unit) and a memory. The memory includes a ROM (Read Only Memory) and a RAM (Random Access Memory). The microcontroller 10 can virtually configure multiple information processing circuits by having the CPU execute programs stored in the memory. The microcontroller 10 configures the GUI control device 11 of this embodiment using the multiple information processing circuits.

[0014] The GUI control device 11 controls the operation of a GUI having a touch panel 20. The touch panel 20 is used as a user interface (hereinafter abbreviated as "UI") to receive information input from a user or to output information to a user. The touch panel 20 can be configured by combining a display unit 21 such as a liquid crystal panel with a position input device. The touch panel 20 of this embodiment uses a touchpad 23 as the position input device. The touchpad 23 may also be called a touch screen, touch display, or contact screen.

[0015] 1 is, for example, a smartphone 30 shown in FIG. 2, the display unit 21 of the touch panel 20 is disposed on the front side of the housing 31 of the smartphone 30. FIG. 2 shows a state in which an equalizer setting screen 40 is displayed on the display unit 21. The equalizer setting screen 40 is displayed on the display unit 21 when, for example, a mobile application (not shown) for playing music installed on the smartphone 30 is executed.

[0016] A mobile application is application software designed and produced to run on smartphones, tablet computers, and other mobile devices. The equalizer setting screen 40 can be displayed on the display unit 21 even when a native app installed on the smartphone 30 is not running, for example, as a console screen for a mobile-oriented website built on a cloud server on the Internet.

[0017] The equalizer setting screen 40 in Fig. 2 has three adjustment units 41 to 43. Each adjustment unit 41 to 43 displays a slider 47 to 49 that can move in a one-dimensional direction within a linear movement area 44 to 46. In the example of Fig. 2, the up and down direction corresponds to the one-dimensional direction. The movement areas 44 to 46 and the sliders 47 to 49 are illustrations of slide volumes. A slide volume is a type of potentiometer that adjusts a resistance value by linearly sliding the slider.

[0018] Three frequency bands, bass, midrange, and treble, are assigned to each of the adjustment units 41 to 43. Frequencies of the same bandwidth may be assigned evenly to each frequency band, or frequencies of different bandwidths may be assigned to each frequency band. By dragging the sliders 47 to 49 of each adjustment unit 41 to 43 with an object such as a finger touching the display unit 21, the frequency characteristics of the audio signal of the music being played can be adjusted for each frequency band. The adjustment resolution of the frequency characteristics may be the same for each frequency band, or may be different. In this embodiment, it is assumed that the adjustment resolution of the frequency characteristics is the same for each frequency band. When the adjustment resolution of the frequency characteristics differs depending on the frequency band, the scales on the movement areas 44 to 46 or the lengths of the movement areas 44 to 46 differ depending on the frequency band.

[0019] When different scales are applied depending on the frequency band, scales for the corresponding frequency bands may be applied near each of the movement areas 44 to 46. Alternatively, only one scale may be displayed on the equalizer setting screen 40, and the content of the displayed scale may be switched as needed to content corresponding to the frequency band whose frequency characteristics are being adjusted by dragging the sliders 47 to 49.

[0020] The sliders 47 to 49 can also be dragged by touching the display unit 21 with an object other than a finger, such as a touch pen.

[0021] 1 detects a touch operation on the display unit 21 in Fig. 2 by a finger or the like that is in contact with the display unit 21. The touch pad 23 can detect a touch operation on the display unit 21 by, for example, a capacitance method.

[0022] The microcontroller 10 includes a plurality of information processing circuits that constitute the GUI control device 11, and constitutes a first processing unit 12, a touch detection unit 13, a second processing unit 15, a discrimination unit 17, and a determination unit 19 shown in FIG.

[0023] In this embodiment, an example is shown in which the above-described information processing circuits (12, 13, 15, 17, 19) are realized by the microcontroller 10 and software. Of course, it is also possible to prepare dedicated hardware to configure the information processing circuits (12, 13, 15, 17, 19). Furthermore, multiple information processing circuits (12, 13, 15, 17, 19) may be configured by individual hardware.

[0024] The display unit 21 displays an equalizer setting screen 40 including sliders 47 to 49 that move within movement areas 44 to 46 in FIG.

[0025] The touch detection unit 13 can detect touch operations of the sliders 47 to 49 by a finger or the like that is in contact with the display unit 21, based on the output of the touchpad 23 in Fig. 1. The touch operations can include drag operations, tap operations, and flick operations. A drag operation refers to an operation of tracing the screen while touching it. A tap operation refers to an operation of touching the screen and then immediately releasing it, and a flick operation refers to an operation of flicking the screen while touching it.

[0026] When the touch detection unit 13 detects a touch operation on the sliders 47 to 49 in FIG. 2, the first processing unit 12 in FIG. 1 can move the sliders 47 to 49 displayed on the display unit 21 within the movement areas 44 to 46 in accordance with the detected touch operation.

[0027] 1 causes markers to be displayed on the touch panel 20 at positions spaced apart from the sliders 47 to 49 in a direction perpendicular to the direction of movement of the sliders 47 to 49 while the touch detection unit 13 is detecting touch operations on the sliders 47 to 49 in FIG. The markers to be displayed on the touch panel 20 will be described in detail later.

[0028] The determination unit 17 determines the operation content of the sliders 47 to 49 in Fig. 2 due to the touch operation detected by the touch detection unit 13 in Fig. 1. The operation content of the sliders 47 to 49 in Fig. 2 determined by the determination unit 17 in Fig. 1 may include a tap operation and a drag operation of the sliders 47 to 49.

[0029] The determination unit 19 in Fig. 1 determines whether or not the movement of the sliders 47 to 49 within the movement areas 44 to 46 by the drag operation has been confirmed, based on the operation content of the sliders 47 to 49 in Fig. 2 determined by the discrimination unit 17. The method of determining whether or not the movement of the sliders 47 to 49 has been confirmed will be described later.

[0030] For example, when a user drags slider 49 of adjustment unit 43 on equalizer setting screen 40 with a finger, slider 49 is hidden behind finger 60 as shown in FIG. 3A, making it difficult for the user to grasp the position of slider 49 moved by the drag operation.

[0031] In this embodiment, when the user touches the slider 49 with a finger 60 on the equalizer setting screen 40 during a drag operation of the slider 49, the touch detection unit 13 in FIG.

[0032] When the touch detection unit 13 detects a touch operation on the slider 49, the second processing unit 15 displays a bar 50 as a marker on the equalizer setting screen 40, as shown in Fig. 3B. The display of the bar 50 in Fig. 3B by the second processing unit 15 in Fig. 1 may be such that the bar 50 is displayed in a flashing state or such that the bar 50 is displayed in a constantly lit state.

[0033] 2, whose touch operation is detected by the touch detection unit 13 in FIG. 1. The bar 50 in FIG. 3B extends from the slider 49 in a direction perpendicular to the movement direction of the slider 49. The bar 50 has a length greater than the width W of the finger 60. Both ends of the bar 50 in the extension direction are located at the left and right ends of the equalizer setting screen 40 on the touch panel 20, spaced apart from the slider 49 in the direction perpendicular to the movement direction of the slider 49.

[0034] When the touch detection unit 13 in Fig. 1 detects a drag operation of the slider 49 in Fig. 2, the first processing unit 12 moves the position of the slider 49 displayed on the equalizer setting screen 40 in Fig. 2 from the position shown in Fig. 3B to the position shown in Fig. 3C within the movement area 46. In accordance with the movement of the slider 49, the bar 50 in Fig. 3B displayed by the second processing unit 15 in Fig. 1 also moves to the position shown in Fig. 3C.

[0035] 1 no longer detects the drag operation of the slider 49, the determination unit 19 determines that the movement of the slider 49 due to the drag operation has been confirmed at the position shown in FIG. 3C. When the determination unit 19 of FIG. 1 determines that the movement of the slider 49 has been confirmed, the first processing unit 12 fixes the position of the slider 49 displayed on the equalizer setting screen 40 at the position shown in FIG. 3C. When the determination unit 19 of FIG. 1 determines that the movement of the slider 49 has been confirmed, the second processing unit 15 of FIG. 1 ends the display of the bar 50 of FIG. 3C.

[0036] Based on the judgment result of the judgment unit 19, the second processing unit 15 of Figure 1 may, when the movement of the slider 49 that ends the display of the bar 50 of Figure 3C is confirmed, display the bar 50 in a manner different from that before the movement of the slider 49 was confirmed, and then end the display of the bar 50.

[0037] When the bar 50 is displayed in a flashing state while the slider 49 is moving, the display of the bar 50 when the movement of the slider 49 is confirmed may be, for example, a state in which the bar 50 is displayed in a constantly lit state. The display of the bar 50 in the constantly lit state may be brighter than the lit period when the bar 50 is displayed in a flashing state, as shown in FIG. 3D .

[0038] When the bar 50 is displayed in a constantly lit state during the movement of the slider 49 before the movement of the slider 49 is confirmed, the bar 50 can be displayed in a constantly lit state with a brightness greater than that before the movement of the slider 49 is confirmed, for example.

[0039] The determination unit 19 in FIG. 1 may determine that the movement of the slider 49 in FIG. 2 has been confirmed at a point other than the point at which the touch detection unit 13 in FIG. 1 no longer detects the drag operation of the slider 49 in FIG.

[0040] For example, if the touch detection unit 13 no longer detects a drag operation of the slider 49 in FIG. 2 and then does not detect a touch operation of the slider 49 until a hold period has elapsed, the determination unit 19 in FIG. 1 may determine that the movement of the slider 49 has been confirmed.

[0041] During the above-described hold period, the slider 49 may be configured to accept fine adjustment of the slider 49. For example, as shown in FIG. 3E, the slider 49 may be moved by tapping on an area above or below the bar 50 on the equalizer setting screen 40.

[0042] When the touch detection unit 13 in Fig. 1 detects a tap operation on an area above or below the bar 50 on the equalizer setting screen 40 in Fig. 3E during the hold period, the second processing unit 15 in Fig. 1 moves the bar 50 in Fig. 3E by a minute pitch. When the area above the bar 50 is tapped, the bar 50 moves upward by a minute pitch, and when the area below the bar 50 is tapped, the bar 50 moves downward by a minute pitch.

[0043] During the above-mentioned hold period, the second processing unit 15 of FIG. 1 may display fine adjustment marks 51 above and below the bar 50 of FIG. 3E to notify the user that movement of the slider 49 due to fine adjustment is being accepted.

[0044] The determination unit 19 in Fig. 1 may determine that the movement of the slider 49 in Fig. 2 has been confirmed when, for example, the touch detection unit 13 detects a double-tap operation on the equalizer setting screen 40 in Fig. 3E after the touch detection unit 13 no longer detects the drag operation of the slider 49 in Fig. 2. The double-tap operation means an operation of tapping the screen twice in succession within a short period of time.

[0045] The above describes the case where the user drags the slider 49 of the adjustment unit 43 corresponding to the treble with the finger 60. When the user drags the sliders 47 and 48 of the adjustment units 41 and 42 corresponding to the bass and midrange, if the touch detection unit 13 in Fig. 1 detects a touch operation by the finger 60, the second processing unit 15 displays the bar 50 as a marker on the equalizer setting screen 40.

[0046] The bar 50 corresponding to each slider 47 to 49 may be displayed on the display unit 21 in a different manner for each slider 47 to 49 for which a touch operation has been detected by the touch detection unit 13 in Fig. 1. By changing the manner of the bar 50 for each slider 47 to 49, the user can recognize which frequency band slider 47 to 49 is being touched, based on the manner of the bar 50 displayed on the display unit 21.

[0047] The appearance of the bar 50 can be varied by, for example, changing the color of the bar 50. When the touch detection unit 13 in Fig. 1 changes the color of the bar 50 for each of the sliders 47 to 49 for which a touch operation is detected, the bar 50 is displayed on the display unit 21 in a different color for each of the bass, midrange, and treble frequency bands. Instead of changing the color of the bar 50 for each of the sliders 47 to 49, the appearance of the bar 50 may be varied by factors other than color, such as by changing the brightness or blinking rate of the bar 50 for each of the sliders 47 to 49.

[0048] 1 may cause the display unit 21 to display the movement areas 44 to 46 corresponding to the sliders 47 to 49 in different modes depending on whether or not the touch detection unit 13 has detected a touch operation of the corresponding slider 47 to 49. By varying the display mode of the movement areas 44 to 46 depending on the detection state of the touch detection unit 13, the user can recognize which frequency band slider 47 to 49 is being touched based on the display mode of the movement areas 44 to 46.

[0049] The display manner of the moving areas 44-46 can be varied, for example, by changing the color, brightness, etc. of the moving areas 44-46. Figures 4A-4C show an example in which the manner of the bar 50 and the moving areas 44-46 is varied by color. In Figures 4A-4C, the difference in color of the bar 50 is represented by the type of line, and the difference in color of the moving areas 44-46 is represented by the presence or absence of hatching and the type of hatching.

[0050] As shown in Fig. 5, the equalizer setting screen 40 may have a link button 52 below the adjustment units 41 to 43. When the link button 52 in Fig. 5 is turned on by a touch operation, the first processing unit 12 in Fig. 1 can move the sliders 47 to 49 displayed on the equalizer setting screen 40 in conjunction with each other.

[0051] When the sliders 47 to 49 are moved in conjunction with each other, the first processing unit 12 of FIG. 1 moves the other two sliders that are not dragged in conjunction with the movement of one of the sliders 47 to 49 displayed on the equalizer setting screen 40 of FIG. 5 that is dragged.

[0052] 1 may move two linked sliders by the same amount as the single slider that is dragged. First processing unit 12 may also move the two linked sliders to well-balanced positions that correspond to the position of the single slider after it has been moved, regardless of the amount of movement of the single slider that is dragged.

[0053] When two other sliders are moved in conjunction with the movement of one dragged slider, the second processing unit 15 in FIG. 1 may display bars 50 corresponding to the other two sliders on the equalizer setting screen 40.

[0054] The bars 50 corresponding to the other two sliders may be displayed in a line type different from that of the bar 50 corresponding to the one slider that has been dragged, as shown in Fig. 5. The second processing unit 15 in Fig. 1 may display the bars 50 corresponding to the other two sliders in a color different from that of the bar 50 corresponding to the one slider that has been dragged, or may display the bars 50 corresponding to the other two sliders by flashing them.

[0055] 1 may display the bar 50 corresponding to one slider that has been dragged in a manner different from the bars 50 corresponding to the other two sliders that are moved in conjunction with the dragged slider. Displaying the bars 50 in different manners can be achieved by using different colors, different line types, etc. for the bars 50.

[0056] As shown in FIG. 6, the first processing unit 12 in FIG. 1 may change the movement direction of the sliders 47 to 49 on the equalizer setting screen 40 by 90°.

[0057] According to the GUI control device 11 of this embodiment, even if the sliders 47 to 49 are hidden behind the finger 60 performing the drag operation, the position of the slider 49 in the movement direction can be grasped by the display of the bar 50, which has a length greater than the width W of the finger 60 and extends in a direction perpendicular to the movement direction of the slider 49.

[0058] 1 may display position marks as markers on the equalizer setting screen 40 instead of the bars 50 corresponding to the sliders 47 to 49. Fig. 7 shows a case where the second processing unit 15 displays, as a marker on the equalizer setting screen 40, a position mark 70 corresponding to the slider 49 in Fig. 2 on which the touch detection unit 13 in Fig. 1 has detected a touch operation by a finger 60.

[0059] The position mark 70 is placed at a location outside the adjustment units 41 to 43, spaced apart from the slider 49 in a direction perpendicular to the movement direction of the slider 49. The distance between the slider 49 and the position mark 70 in the separation direction is longer than the width W of the finger 60 that touches and operates the slider 49. The second processing unit 15 in FIG. 1 moves the position mark 70 in FIG. 7 displayed on the equalizer setting screen 40 in accordance with the movement of the slider 49 due to the drag operation.

[0060] When the second processing unit 15 displays the position mark 70 on the equalizer setting screen 40, even if the slider 49 is hidden behind the finger 60 performing the drag operation, the position of the slider 49 in the movement direction can be grasped by the display of the position mark 70 positioned outside the width W of the finger 60.

[0061] [Second embodiment] Like the first embodiment, the user terminal device 1 of the second embodiment has a general-purpose microcontroller 10 and a touch panel 20 shown in Fig. 1. The microcontroller 10 configures a GUI control device 11 of this embodiment using multiple information processing circuits that are virtually constructed by a CPU executing a program stored in memory. The microcontroller 10 configures a first processing unit 12, a touch detection unit 13, a second processing unit 15, a discrimination unit 17, and a determination unit 19 using the multiple information processing circuits that configure the GUI control device 11.

[0062] A volume setting screen 80 shown in Fig. 8 is displayed on the display unit 21 of the touch panel 20 of the second embodiment. The volume setting screen 80 has two adjustment units 81, 82 corresponding to the earphone volumes of the left and right channels. Each adjustment unit 81, 82 displays linear movement areas 83, 84 that illustrate slide volumes, sliders 85, 86 that can move in one-dimensional directions within the movement areas 83, 84, and a link button 87. In the example of Fig. 8, the up and down directions correspond to one-dimensional directions.

[0063] The volume of the music being played can be adjusted for each channel by dragging the sliders 85, 86 of the adjustment units 81, 82 with an object such as a finger that is in contact with the display unit 21. The sliders 85, 86 can also be dragged by contacting an object other than a finger, such as a touch pen, with the display unit 21.

[0064] The touch detection unit 13 of the second embodiment can detect touch operations on the sliders 85 and 86 by a finger or the like that is in contact with the display unit 21, based on the output of the touch pad 23 of FIG.

[0065] When the touch operation unit 13 detects a touch operation on the sliders 85, 86 in Figure 8, the first processing unit 12 of the second embodiment can move the sliders 85, 86 displayed on the display unit 21 within the movement areas 83, 84 in accordance with the detected touch operation.

[0066] The second processing unit 15 of the second embodiment displays a marker on the volume setting screen 80 while the touch detection unit 13 detects a touch operation on the sliders 85, 86 in Fig. 8. The marker is placed at a position on the touch panel 20 that is spaced apart from the sliders 85, 86 in a direction perpendicular to the movement direction of the sliders 85, 86.

[0067] In this embodiment, for example, when the user touches the sliders 85 and 86 with a finger on the volume setting screen 80 to drag the sliders 85 and 86, the touch detection unit 13 detects the touch operation of the sliders 85 and 86 with the finger.

[0068] When the touch detection unit 13 detects a touch operation on the sliders 85 and 86, the second processing unit 15 displays a bar 90 as a marker on the volume setting screen 80, as shown in Fig. 9A and Fig. 9B. Fig. 9A shows a state in which a touch operation on the slider 85 for the left channel causes the bar 90 corresponding to the slider 85 to be displayed on the volume setting screen 80. Fig. 9B shows a state in which a touch operation on the slider 86 for the right channel causes the bar 90 corresponding to the slider 86 to be displayed on the volume setting screen 80.

[0069] The display of the bar 90 in FIGS. 9A and 9B by the second processing unit 15 of the second embodiment can be performed in a manner similar to the display of the bar 50 on the equalizer setting screen 40 of the first embodiment.

[0070] The determination unit 17 of the second embodiment determines the operation content of the sliders 85, 86 in Fig. 8 due to the touch operation detected by the touch detection unit 13. The operation content of the sliders 85, 86 in Fig. 8 determined by the determination unit 17 of the second embodiment may include a tap operation and a drag operation of the sliders 85, 86.

[0071] The determination unit 19 of the second embodiment determines whether or not the movement of the sliders 85, 86 within the movement areas 83, 84 by the drag operation has been confirmed, based on the operation content of the sliders 85, 86 in Fig. 8 determined by the discrimination unit 17. Whether or not the movement of the sliders 85, 86 has been confirmed can be determined in the same manner as the determination unit 19 of the first embodiment determines whether or not the movement of the sliders 47 to 49 has been confirmed.

[0072] 8 is turned on by a touch operation, the first processing unit 12 of the second embodiment may move two sliders 85, 86 displayed on the volume setting screen 80 in an interlocking manner. When the two sliders 85, 86 are moved in an interlocking manner, the first processing unit 12 of the second embodiment moves the other slider that is not dragged in an interlocking manner with the movement of one of the two sliders 85, 86 that is dragged.

[0073] The first processing unit 12 of the second embodiment may move one of the sliders 85, 86 that has not been dragged by the same amount as the dragged slider. The first processing unit 12 may move the one of the sliders 85, 86 that has not been dragged to a well-balanced position that corresponds to the position of the dragged slider after it has been moved.

[0074] When the two sliders 85, 86 are moved in a linked manner, the second processing unit 15 of the second embodiment may display a bar 90 corresponding to the slider that is not being dragged on the volume setting screen 80. The display of the bar 90 corresponding to the slider that is not being dragged can be performed in the same manner as when the sliders 47 to 49 of the first embodiment are moved in a linked manner. Fig. 10 shows a case where, by a touch operation on the slider 86 of the right channel, in addition to the bar 90 corresponding to the slider 86, a bar 90 corresponding to the slider 85 of the left channel is displayed on the volume setting screen 80.

[0075] The second processing unit 15 of the second embodiment may display the movement areas 83, 84 corresponding to each slider 85, 86 on the display unit 21 in different colors depending on whether the touch detection unit 13 has detected a touch operation on the corresponding slider 85, 86.

[0076] Even in the GUI control device 11 of the second embodiment, when the sliders 85, 86 are hidden behind the finger 60 performing the drag operation, the position of the slider 49 in the movement direction can be grasped by displaying a bar 90 that is longer than the width W of the finger 60 and extends in a direction perpendicular to the movement direction of the slider 49.

[0077] In the GUI control device 11 of the second embodiment, the second processing unit 15 may also display a mark similar to the position mark 70 of the first embodiment in Fig. 7 as a marker on the volume setting screen 80 of Fig. 8, instead of the bar 90. In the GUI control device 11 of the second embodiment, the first processing unit 12 may also change the movement direction of the sliders 85 and 86 on the volume setting screen 80 by 90°.

[0078] In the above-described embodiments, the case where there are two or more sliders 47 to 49, 85, and 86 has been described. The present invention is also applicable to the case where there is a single slider. The present invention is not limited to the GUIs of the application software for the equalizer and earphone volume for the left and right channels described in the above-described embodiments, but can also be applied to the GUI of application software for a mixer that adjusts and mixes audio from multiple sound sources, for example. [Explanation of symbols]

[0079] 10 Microcontrollers 11 Graphical User Interface (GUI) Control Device 12 First Processing Section 15 Second Processing Section 17 Discrimination part 19 Judgment section 20 Touch Panel 44~46,83,84 Moving area 47~49,85,86 slider 50,90 bar (marker) 60 fingers 70 Position Marker

Claims

1. 1. An apparatus for controlling the operation of a graphical user interface having a touch panel, comprising: a first processing unit that moves one of a plurality of sliders that are displayed on the touch panel and are movable in one dimension in response to a touch operation of the slider that is performed by contacting the touch panel; a second processing unit that displays, on the touch panel while the slider is being touch-operated, a linear marker that extends from the slider in a direction perpendicular to a moving direction of the slider; The processing in the first processing unit or the second processing unit includes: At least one end side in a direction perpendicular to the moving direction of the slider, a scale corresponding to a range of movement of the slider that is moved by the touch operation is displayed in response to the slider being operated; When the operated slider is switched, the scale corresponding to the slider is switched and displayed. Graphical user interface control device.

2. the first processing unit causes the plurality of sliders to be displayed on the touch panel; The second processing unit is The marker corresponding to the slider that has been touched is Each slider is displayed on the touch panel in a different manner.

10. The graphical user interface control device of claim 1.

3. The first processing unit determines a state of a moving area of ​​the slider that is touched; The state of the movement area of ​​the slider is made different from that of the slider that is not touched, The movement area corresponding to the slider is displayed on the touch panel.

3. The graphical user interface control device of claim 2.

4. a determination unit that determines the operation content of the slider that has been touched; a determination unit that determines whether or not the movement of the slider by the touch operation has been confirmed based on the operation content determined by the determination unit, The second processing unit displays the marker on the touch panel in a different manner before and after the movement of the slider is confirmed based on the determination result of the determination unit. A graphical user interface control device according to any one of claims 1 to 3.

Images