GUI setting device, GUI setting method, and GUI setting program
The GUI setting device and method adapt GUI components to user preferences by evaluating operational feel and switching interfaces when errors exceed a threshold, enhancing user experience through personalized customization.
Patent Information
- Application Number
- JP2022563622
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-11-18
- Filing Date
- 2021-10-08
- Publication Date
- 2025-08-20
- Estimated Expiration
- 2041-10-08
AI Technical Summary
Existing electronic devices struggle with user-specific customization of graphical user interfaces (GUIs) as they fail to adapt to individual user preferences in terms of display form, operation method, operation sensitivity, and screen transitions, leading to varying levels of ease of use.
A GUI setting device and method that utilizes an evaluation value acquisition process to assess user operational feel, allowing for customization of GUI components such as display form, operation method, and transition sensitivity, and switches to alternative GUIs when user errors exceed a threshold, ensuring a better fit for individual user preferences.
Enables easy customization of GUIs to match user operational feel, reducing errors and improving user experience by dynamically adapting the interface based on user interaction data.
Smart Images

Figure 0007726910000001 
Figure 0007726910000002 
Figure 0007726910000003
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a GUI setting device, a GUI setting method, and a GUI setting program. [Background technology]
[0002] There are known electronic devices that accept operational inputs from users based on a GUI (Graphical User Interface) displayed on a display. In a GUI, for example, the display form of graphic elements, the operation method of the graphic elements, the operation sensitivity of the graphic elements, the order of screen transitions, and the time for screen transitions vary from user to user in terms of ease of use. Patent Document 1 describes an electronic device that receives information about the display form of the GUI from a mobile terminal carried by each user, and displays a dedicated GUI for each user. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-134694 Summary of the Invention
[0004] The technology disclosed herein provides a GUI setting device, a GUI setting method, and a GUI setting program that enable easy customization of a GUI for each user. [Means for solving the problem]
[0005] The GUI setting device of the present disclosure includes at least one processor and a memory built into or connected to the processor, and the processor executes an evaluation value acquisition process to acquire an evaluation value for evaluating a user's operational feel for a GUI for operating an electronic device, and a GUI setting process to set the GUI based on the evaluation value.
[0006] The GUI setting process has at least one of a first GUI setting mode and a second GUI setting mode. The first GUI setting mode is a mode in which the presented GUI is changed to another GUI when the evaluation value falls below a set threshold. The second GUI setting mode may be a mode in which multiple types of GUIs for the same operation item are presented, and when evaluation values of the multiple types of GUIs presented are obtained in the evaluation value acquisition process, the GUI with the relatively high evaluation value is set.
[0007] The evaluation value may also include an evaluation value in which the number of user operation errors with respect to the presented GUI is used as an evaluation item.
[0008] In addition, in the GUI setting process, the processor may execute a first GUI setting mode in which, when the evaluation value falls below a set threshold, the presented GUI is changed to another GUI, and when the number of incorrect operations exceeds a set number and the evaluation value falls below the set threshold, the presented GUI is changed to a GUI that matches the content of the user's incorrect operation.
[0009] In addition, in the GUI setting process, the processor may be able to change at least one component of the GUI, including the display form of the graphic elements, the operation method of the graphic elements, the operation sensitivity of the graphic elements, the order of screen transitions, and the time of screen transitions.
[0010] The processor may also execute a series of processes including a GUI presentation process for presenting a GUI, an evaluation value acquisition process, and a GUI setting process at set timing.
[0011] Furthermore, the series of processes may be repeatedly executed at set times.
[0012] Furthermore, in the GUI setting process, the processor may be capable of executing a GUI generation process for generating a new GUI that is different from a preset GUI, and setting the generated GUI.
[0013] The computer may further include a GUI data acquisition unit that acquires GUI data necessary to generate a new GUI, and the processor may execute the GUI generation process based on the acquired GUI data.
[0014] In addition, in the GUI generation process, the processor may quantify the deviation amount indicating the degree to which the changed state of each of the components of the GUI that can be changed deviates from the set standard state, and generate a new GUI so that the total deviation amount falls within a predetermined numerical range.
[0015] Furthermore, when arranging GUIs of a plurality of operation items on one screen in the GUI generation process, the processor may arrange the GUI of the most frequently used operation item in a position closest to the center of the screen.
[0016] The GUI may be a GUI used in an imaging device, and the operation items may be operation items for setting operations related to imaging.
[0017] The evaluation value may be an evaluation value that uses at least one of the setting operation time, the non-operation time, and the number of incorrect operations as evaluation items, where the setting operation time is the total elapsed time from the start to the end of the setting operation or from the start of the setting operation to the operation of the shutter button, the non-operation time is the non-contact time during the setting operation time when the user is not touching the GUI, and the number of incorrect operations may be the number of incorrect operations performed within the setting operation time.
[0018] The operation items may also include at least one of aperture, shutter speed, and imaging sensitivity.
[0019] The device may also include a communication unit that communicates with the electronic device, and the processor may acquire an evaluation value from the electronic device via the communication unit in the evaluation value acquisition process, and set the GUI of the electronic device based on the evaluation value in the GUI setting process.
[0020] In addition, the processor may acquire multiple evaluation values for the GUI of the same operation item from each of multiple electronic devices in the evaluation value acquisition process, and set the GUI of the electronic device selected as the setting target based on the multiple evaluation values in the GUI setting process.
[0021] The processor may also determine a default GUI for the electronic device based on the plurality of evaluation values.
[0022] The GUI setting method of the present disclosure executes an evaluation value acquisition process that acquires an evaluation value for evaluating the user's operating feel for a GUI for operating an electronic device, and a GUI setting process that sets the GUI based on the evaluation value.
[0023] The GUI setting program of the present disclosure causes a computer to execute an evaluation value acquisition process that acquires an evaluation value for evaluating a user's operating feel for a GUI for operating an electronic device, and a GUI setting process that sets the GUI based on the evaluation value. [Brief explanation of the drawings]
[0024] [Figure 1] 1 is a perspective view of a digital camera according to a first embodiment, seen from the front side. [Figure 2] FIG. 2 is a perspective view of the digital camera as seen from the rear side. [Figure 3] FIG. 1 is a block diagram showing a hardware configuration of a digital camera. [Figure 4] FIG. 1 is a functional block diagram of a digital camera. [Figure 5] 1 is a timing chart showing the flow from setting to capturing an image in a digital camera. [Figure 6] FIG. 10 is a diagram showing a setting screen for a rotational swipe operation type. [Figure 7] 10A and 10B are diagrams illustrating operations on a setting screen for a rotational swipe operation type. [Figure 8] FIG. 10 is a diagram showing a setting screen for a tap operation type. [Figure 9]FIG. 10 is a diagram illustrating an operation on a setting screen for a tap operation type. [Figure 10] FIG. 10 is a diagram showing a setting screen for an up / down swipe operation type. [Figure 11] 10A and 10B are diagrams for explaining operations on a setting screen for an up / down swipe operation type. [Figure 12] 10A and 10B are diagrams for explaining the processing content of an evaluation value acquisition processing unit. [Figure 13] FIG. 10 is a diagram for explaining the processing content of a GUI setting processing unit. [Figure 14] 10 is a flowchart illustrating a process for GUI setting in the first embodiment. [Figure 15] 10 is a flowchart illustrating details of a GUI setting process according to the first embodiment. [Figure 16] 10 is a flowchart illustrating a process for GUI setting in a modified example of the first embodiment. [Figure 17] 10 is a flowchart illustrating a process for GUI setting in a modified example of the first embodiment. [Figure 18] 1 is a timing chart showing the flow from setting to capturing an image in a digital camera. [Figure 19] 10 is a flowchart illustrating details of a GUI setting process according to the second embodiment. [Figure 20] 10 is a flowchart illustrating details of a GUI generation process according to the second embodiment. [Figure 21] 10 is a table showing the cumulative number of settings for each operation item. [Figure 22] FIG. 10 is a diagram showing a modified example of the setting screen for the rotational swipe operation type. [Figure 23] 13 is a flowchart illustrating details of a GUI generation process according to the third embodiment. [Figure 24] 10 is a table showing the amount of deviation for each item of the changed portion of the GUI, for each priority and degree of change. [Figure 25] FIG. 10 is a diagram showing a modified example of the setting screen for the rotational swipe operation type. [Figure 26] FIG. 13 is a diagram for explaining the processing content of a GUI setting processing unit in the fourth embodiment. [Figure 27] 13 is a flowchart illustrating a process for GUI setting in the fourth embodiment. [Figure 28] FIG. 10 is a configuration diagram of a GUI setting system including a digital camera according to a fifth embodiment. [Figure 29] FIG. 1 is a block diagram showing a hardware configuration of a digital camera. [Figure 30] FIG. 20 is a block diagram showing a hardware configuration of a server according to a sixth embodiment. [Figure 31] 10 is a flowchart illustrating processing during GUI setting in the GUI setting system. [Figure 32] 10 is a table showing evaluation values of setting screens for each operation type for each digital camera. DETAILED DESCRIPTION OF THE INVENTION
[0025] [First embodiment] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. FIGS. 1 and 2 are external views of a digital camera 10, which is a GUI setting device according to a first embodiment of the present disclosure. FIG. 1 shows a perspective view of the digital camera 10 as seen from the front side, and FIG. 2 shows a perspective view of the digital camera 10 as seen from the rear side. The digital camera 10 shown in FIGS. 1 and 2 accepts operational inputs from a user based on a GUI (Graphical User Interface) displayed on a touch panel 26 on the rear surface 11b. Furthermore, the digital camera 10 allows the GUI displayed on the touch panel 26 to be customized for each user. The digital camera 10 is an example of an imaging device in accordance with the technology of the present disclosure.
[0026] 1 and 2, an imaging lens 12 is provided in the center of a front surface 11a of a housing 11 of a digital camera 10. Buttons such as a shutter button 13 are provided on a top surface 11c of the housing 11. Buttons such as a setting button 14 and a touch panel 26 are provided on a back surface 11b of the housing 11.
[0027] The touch panel 26 displays a live view during image capture, a post-view after image capture, and the like. The live view is, for example, a display of a moving image captured in real time by the image capture unit 24 (described later), and is used to frame the subject before image capture by pressing the shutter button 13. The post-view is, for example, a display of an image captured at the timing when the shutter button 13 (described later) is pressed, and is displayed for a certain period of time after image capture to allow the user to check the image. Furthermore, when the setting button 14 is pressed, a setting screen G (see FIGS. 6, 8, and 10) is displayed.
[0028] 3, the digital camera 10 has a CPU (Central Processing Unit) 21, a memory 22, a storage 23, an imaging unit 24, an operation input unit 25, and a touch panel 26. Each component is connected via a bus 28 so as to be able to communicate with each other.
[0029] The CPU 21 executes a control program and the like to comprehensively control each unit of the digital camera 10. The memory 22 is a working memory and is configured, for example, by a RAM (Random Access Memory). The CPU 21 reads the control program from the storage 23 into the memory 22 and executes the control program using the memory 22 as a working area. The CPU 21 controls each of the above components and performs various processes in accordance with the control program.
[0030] The CPU 21 is an example of a processor in the technology of the present disclosure. The memory 22 is an example of a memory in the technology of the present disclosure. The digital camera 10 including the CPU 21 and the memory 22 also functions as a GUI setting device in the technology of the present disclosure.
[0031] The storage 23 stores various programs such as control programs including an operating system, application programs, and various data including image data. The storage 23 is configured, for example, with a non-volatile memory such as a flash memory. In this embodiment, the storage 23 stores a GUI setting program PG as one of the various programs. The storage 23 also stores GUI data GD required to display the GUI. The GUI data GD includes data required to generate the GUI, such as GUI images, text information, and setting information including display color and size.
[0032] The imaging unit 24 includes an imaging lens 12 and an imaging element (not shown), etc. The imaging unit 24 captures an image of a subject to obtain image data of the subject.
[0033] The operation input unit 25 includes buttons such as a shutter button 13 and a setting button 14 .
[0034] The touch panel 26 functions as a display unit that displays various images, and as an operation input unit that inputs touch operations.
[0035] As shown in FIG. 4, the CPU 21 executes the GUI setting program PG stored in the storage 23 to function as a GUI presentation processing unit 21a, an evaluation value acquisition processing unit 21b, and a GUI setting processing unit 21c.
[0036] An example of the flow from setting up to capturing an image in digital camera 10 is shown in the timing chart in FIG. 5. When digital camera 10 is powered on and in an image capture mode in which image capture is possible using shutter button 13, live view is continuously displayed. When, for example, setting button 14 is pressed while live view is displayed on touch panel 26, CPU 21 displays setting screen G (see FIGS. 6, 8, and 10) on touch panel 26. When setting screen G is displayed on touch panel 26 and various setting operations are accepted from touch panel 26, and an instruction to end settings is input, for example, by pressing setting button 14 again, CPU 21 ends display of setting screen G and resumes displaying the live view on touch panel 26. When shutter button 13 is pressed while live view is displayed on touch panel 26, CPU 21 captures an image and displays a post-view on touch panel 26 after the image is captured.
[0037] In this embodiment, the time from the start to the end of the setting operation, that is, the time from when the setting button 14 is pressed until the display of the setting screen G is finished, is defined as the setting operation time ts1. The setting operation time ts1 includes not only the contact time when the user's finger FG is in contact with the setting screen G as a GUI, but also the non-contact time when the user's finger FG (see FIG. 7, etc., described later) is not in contact with the setting screen G. The non-contact time is the time when no operation in the narrow sense of the word, that is, contacting the finger FG with the setting screen G displayed on the touch panel 26, is performed, and in this sense, the non-contact time within the setting operation time is called the non-operation time tn, as shown in FIG.
[0038] The GUI presentation processing unit 21a executes GUI presentation processing that presents a GUI for operating the digital camera 10. The operation screen displayed on the touch panel 26 is a GUI used for the digital camera 10, which is an example of an imaging device, and the operation screen includes a setting screen G (see FIGS. 6, 8, and 10). As described above, the setting screen G is displayed on the touch panel 26 by pressing the setting button 14. The GUI presentation processing unit 21a is capable of presenting a plurality of types of setting screens G as the GUI.
[0039] In this example, the GUI presentation processing unit 21a can selectively present three types of setting screens G3: setting screen G1 shown in Fig. 6, setting screen G2 shown in Fig. 8, and setting screen G3 shown in Fig. 10. Here, when it is necessary to distinguish between setting screens G1, G2, and G3 shown in Fig. 6, Fig. 8, and Fig. 10, respectively, the setting screens G are distinguished by adding subcodes "1," "2," and "3" to the symbol G, and when no distinction is necessary, they are simply referred to as setting screen G without adding subcodes.
[0040] As examples of the three types of setting screens G1, G2, and G3, the setting screen G1 shown in FIG. 6 is a rotational swipe operation type, the setting screen G2 shown in FIG. 8 is a tap operation type, and the setting screen G3 shown in FIG. 10 is an up-and-down swipe operation type. Each of the setting screens G1, G2, and G3 has a graphic element with a different operation method. The graphic element is a component of the GUI, and examples thereof include operation buttons such as various setting buttons described below. Furthermore, the setting screen G is a GUI for performing setting operations related to imaging, and the operation items for setting operations related to imaging on the setting screen G are, for example, three operation items: shutter speed, aperture, and imaging sensitivity.
[0041] In the digital camera 10, one of three types of setting screens, namely, setting screen G1, setting screen G2, and setting screen G3, is set as the setting screen G to be displayed on the touch panel 26 when the setting button 14 is pressed. The GUI presentation processing unit 21a displays the set setting screen G on the touch panel 26, thereby presenting the setting screen G as a GUI to the user.
[0042] As shown in FIG. 6, the setting screen G1 has five buttons: a shutter speed setting button 30, an aperture setting button 31, an image capture sensitivity setting button 32, a confirm button 33, and a back button 34. As described above, the setting screen G1 is of the rotational swipe operation type, and the shutter speed setting button 30, the aperture setting button 31, and the image capture sensitivity setting button 32 are operated by a rotational swipe gesture. As shown in FIG. 7, the rotational swipe operation is a touch operation in which a finger FG is placed in contact with the shutter speed setting button 30 or the like and then rotated in a substantially circular shape. The setting screen G1 also has two information display icons: an image capture mode display icon 35 and a remaining battery level display icon 36.
[0043] The shutter speed setting button 30 has a setting value display area 30a and an operation area 30b. The setting value display area 30a is a circular area large enough to display the shutter speed setting value inside, and the annular operation area 30b is arranged around it.
[0044] As shown in FIG. 7, a detection area R1 is set on the touch panel 26 in accordance with the operation area 30b. The detection area R1 is an area that includes the operation area 30b and is set in a ring shape in accordance with the ring-shaped operation area 30b. The operation area 30b is part of the shutter speed setting button 30 and is a portion that is displayed on the setting screen G1 so as to be visible to the user. The detection area R1 is an area that detects operations on the shutter speed setting button 30. Unlike the operation area 30b, the detection area R1 is not a visible area in this example, but is an area in which a touch operation by the user can be detected. By setting such a detection area R1, operations on the shutter speed setting button 30 can be performed not only in the displayed operation area 30b but also by touch operations on an area that is slightly larger than the operation area 30b.
[0045] When a rotational swipe operation is performed clockwise in the operation area 30b of the shutter speed setting button 30, the shutter speed setting value increases according to the amount of the rotational swipe. Also, when a rotational swipe operation is performed counterclockwise, the shutter speed setting value decreases according to the amount of the rotational swipe. As an example, when a rotational swipe operation is performed with a rotational swipe amount of 30 degrees, the shutter speed setting value increases or decreases by one step according to the direction of rotation. And when the rotational angle is 60 degrees, the shutter speed setting value increases or decreases by two steps.
[0046] Like the shutter speed setting button 30, the aperture setting button 31 also has a setting value display area 31a and an operation area 31b, and the setting value is changed in the same way as the shutter speed setting button 30. A detection area R1 that is slightly larger than the operation area 31b is also set for the aperture setting button 31.
[0047] Like the shutter speed setting button 30, the image capture sensitivity setting button 32 also has a setting value display area 32a and an operation area 32b, and the setting value is changed in the same way as the shutter speed setting button 30. A detection area R1 that is slightly larger than the operation area 32b is also set for the image capture sensitivity setting button 32.
[0048] When the setting value of an operation item such as the shutter speed is changed by operating the shutter speed setting button 30 or the like, and then the decision button 33 is tapped, the setting value of each operation item changed on the rotational swipe operation type setting screen G1 is saved, and the display of the setting screen is terminated.
[0049] When the back button 34 is tapped, the display of the setting screen G1 is terminated without saving the setting values of the operation items changed on the setting screen G1 of the rotational swipe operation type.
[0050] As shown in Fig. 8, the setting screen G2 has five buttons: a shutter speed setting button 40, an aperture setting button 41, an image capture sensitivity setting button 42, a confirm button 43, and a back button 44. As described above, the setting screen G2 is of the tap operation type, and the shutter speed setting button 40, the aperture setting button 41, and the image capture sensitivity setting button 42 are operated by a tap gesture. A tap operation is a touch operation in which the shutter speed setting button 40 or the like is lightly tapped with a finger FG, as shown in Fig. 9. The tap operation type setting screen G2 also has two information display icons: an image capture mode display icon 45 and a remaining battery level display icon 46.
[0051] The shutter speed setting button 40 includes a setting value display area 40a, an up button 40b, and a down button 40c. The setting value display area 40a is a circular area large enough to display the shutter speed setting value, with the up button 40b located at the top and the down button 40c located at the bottom of the area.
[0052] As shown in FIG. 9, a detection area R2 is set on the touch panel 26 to correspond to the up button 40b, and a detection area R3 is set to correspond to the down button 40c. The detection area R2 is an area including the up button 40b and is an area for detecting an operation to increase the shutter speed setting value. The detection area R3 is an area including the down button 40c and is an area for detecting an operation to decrease the shutter speed setting value. The detection areas R2 and R3 on the setting screen G2 shown in FIG. 9 are the same as the detection area R1 on the setting screen G1 shown in FIG. 7. That is, unlike the up button 40b and the down button 40c, which are visibly displayed on the setting screen G2, the detection areas R2 and R3 on the setting screen G2 are not visible in this example, but are areas where a touch operation by a user can be detected. By setting such detection areas R2 and R3, the shutter speed setting button 40 can be operated not only by touching the displayed up button 40b or down button 40c, but also by touching an area slightly larger than the up button 40b or down button 40c.
[0053] When the upper button 40b in the shutter speed setting button 40 is tapped, the shutter speed setting value increases according to the number of taps, and when the lower button 40c is tapped, the shutter speed setting value decreases according to the number of taps.
[0054] Like the shutter speed setting button 40, the aperture setting button 41 also has a setting value display area 41a, an up button 41b, and a down button 41c, and the setting value is changed in the same way as the shutter speed setting button 40. Detection areas R2 and R3, which are slightly larger than the up button 41b and the down button 41c, are set for the aperture setting button 41 as well.
[0055] Like the shutter speed setting button 40, the image capture sensitivity setting button 42 also has a setting value display area 42a, an up button 42b, and a down button 42c, and the setting value is changed in the same way as the shutter speed setting button 40. Detection areas R2 and R3 that are slightly larger than the up button 42b and the down button 42c are set for the image capture sensitivity setting button 42 as well.
[0056] When the set value of an operation item such as the shutter speed is changed by operating the shutter speed setting button 40 or the like and then the decision button 43 is tapped, the set value of each operation item changed on the tap operation type setting screen G2 is saved and the display of the setting screen G2 is terminated.
[0057] When the back button 44 is tapped, the display of the setting screen G2 is terminated without saving the setting values of the operation items changed on the tap operation type setting screen G2.
[0058] As shown in FIG. 10, the setting screen G3 has five buttons: a shutter speed setting button 50, an aperture setting button 51, an image capture sensitivity setting button 52, a confirm button 53, and a back button 54. As described above, the setting screen G3 is of the up / down swipe operation type, and the shutter speed setting button 50, the aperture setting button 51, and the image capture sensitivity setting button 52 are operated by an up / down swipe gesture. The up / down swipe operation is a touch operation in which, as shown in FIG. 11, a finger FG is placed in contact with the shutter speed setting button 50 or the like and then slid upward or downward. The up / down swipe operation type setting screen G3 also has two information display icons: an image capture mode display icon 55 and a remaining battery level display icon 56.
[0059] The shutter speed setting button 50 includes a display frame 50a and a setting value designation section 50b. The setting value designation section 50b can be scrolled up and down relative to the display frame 50a. Scrolling the setting value designation section 50b up and down changes the shutter speed setting value displayed in the display frame 50a. Scrolling the setting value designation section 50b up and down decreases the setting value, and scrolling it down increases the setting. Center lines 57 are provided on the left and right sides of the display frame 50a, located in the vertical center of the display frame 50a. In this example, three setting values are displayed in the display frame 50a, and the three setting values change in stages by scrolling the setting value designation section 50b up and down. Of the three setting values, the setting value corresponding to the position of the center line 57 is the specified setting value. In other words, when the user specifies a setting value, they scroll the setting value designation section 50b up and down to align the desired setting value with the position of the center line 57.
[0060] As shown in FIG. 11, a detection area R4 is set on the touch panel 26 to fit the display frame 50a. The detection area R4 is an area that includes the display frame 50a and is set rectangular to fit the rectangular display frame 50a. The detection area R4 is an area that detects an operation on the shutter speed setting button 50. The detection area R4 on the setting screen G3 shown in FIG. 11 is the same as the detection area R1 on the setting screen G1 shown in FIG. 7. That is, unlike the display frame 50a and the setting value designation section 50b, which are visibly displayed on the setting screen G3, the detection area R4 on the setting screen G3 is not a visible area in this example, but is an area that can detect a touch operation by a user. By setting such a detection area R4, the shutter speed setting button 50 can be operated not only by touching the displayed display frame 50a and setting value designation section 50b, but also by touching an area that is slightly larger than the display frame 50a and setting value designation section 50b.
[0061] When a downward swipe operation is performed within the display frame 50a of the shutter speed setting button 50, the setting value designation section 50b scrolls downward, and the shutter speed setting value displayed within the display frame 50a increases depending on the amount of the swipe. When an upward swipe operation is performed, the setting value designation section 50b scrolls upward, and the shutter speed setting value displayed within the display frame 50a decreases depending on the amount of the swipe. Through such a swipe operation, the desired setting value is aligned with the center line 57.
[0062] Like the shutter speed setting button 50, the aperture setting button 51 also has a display frame 51a and a setting value designation section 51b, and the setting value is changed in the same way as the shutter speed setting button 50. A detection area R4 that is slightly larger than the display frame 51a and the setting value designation section 51b is also set for the aperture setting button 51.
[0063] Like the shutter speed setting button 50, the image capture sensitivity setting button 52 also has a display frame 52a and a setting value designation section 52b, and the setting value is changed in the same way as the shutter speed setting button 50. A detection area R4 that is slightly larger than the display frame 52a and the setting value designation section 52b is also set for the image capture sensitivity setting button 52.
[0064] When the setting value of an operation item such as the shutter speed is changed by operating the shutter speed setting button 50 or the like and then the decision button 53 is tapped, the setting value of each operation item changed on the up / down swipe operation type setting screen G3 is saved and the display of the setting screen G3 is terminated.
[0065] When the back button 54 is tapped, the display of the setting screen G3 is terminated without saving the setting values of the operation items changed on the setting screen G3 of the up / down swipe operation type.
[0066] The evaluation value acquisition processing unit 21b executes an evaluation value acquisition process to acquire an evaluation value for evaluating the user's operational feel for the presented GUI, for example, from among the setting screens G1 to G3. The evaluation value is, for example, an evaluation value in which the number of erroneous operations by the user for the presented GUI is used as an evaluation item. Here, the number of erroneous operations refers to the number of erroneous operations performed within the setting operation time ts1 shown in Fig. 5. In this case, the evaluation value is set lower as the number of erroneous operations increases, and higher as the number of erroneous operations decreases.
[0067] An erroneous operation refers to a case where, when any of the setting screens G1 to G3 is presented as a GUI, the user performs a touch operation using an incorrect operation method in contrast to the correct operation method of the presented GUI. For example, when the setting screen G1 of the rotational swipe operation type shown in FIG. 6 is displayed on the touch panel 26, the correct operation method for the shutter speed setting button 30, the aperture setting button 31, and the image capture sensitivity setting button 32 is the rotational swipe operation as shown in FIG. 7. In contrast, an erroneous operation refers to, for example, a case where, when the setting screen G1 of the rotational swipe operation type is displayed, the upper and lower parts of the shutter speed setting button 30, the aperture setting button 31, and the image capture sensitivity setting button 32 are tapped as shown in FIG. 9 or swipe up and down as shown in FIG. 11.
[0068] As shown in FIG. 12, when the setting screen G1 of the rotational swipe operation type is displayed, if a touch operation other than the rotational swipe operation shown in FIG. 7 is performed, such as a tap operation shown in FIG. 9 or an up / down swipe operation shown in FIG. 11, the evaluation value acquisition processing unit 21b determines that an erroneous operation has been performed. The evaluation value acquisition processing unit 21b also records the number of such erroneous operations. For example, if the setting value does not change as expected even after performing a touch operation, it is considered that the user will repeat the touch operation. If an erroneous operation is repeated as a touch operation, the evaluation value acquisition processing unit 21b records the number of repeated erroneous operations. The evaluation value acquisition processing unit 21b acquires the evaluation value by deriving the evaluation value based on the number of such erroneous operations.
[0069] Furthermore, the evaluation value acquisition processing unit 21b records not only the number of erroneous operations but also the details of the erroneous operations, such as whether the erroneous operation was a tap operation or an up / down swipe operation. As an example, the number of erroneous operations is recorded for each type of erroneous operation, such as the number of tap operations or the number of up / down swipe operations.
[0070] In FIG. 4, the GUI setting processing unit 21c executes GUI setting processing for setting the GUI based on the evaluation value acquired by the evaluation value acquisition processing unit 21b.
[0071] In this embodiment, the GUI setting process is performed in a first GUI setting mode, in which one GUI such as the setting screen G1 is first presented, and when the evaluation value for the presented GUI falls below a set threshold, the presented GUI is changed to another GUI.
[0072] As an example, when the number of incorrect operations in the presented GUI exceeds a set number and the evaluation value falls below a set threshold, the GUI setting processing unit 21c changes the presented GUI to a GUI that is suitable for the content of the user's incorrect operation.
[0073] As shown in FIG. 13, for example, when the setting screen G1 of the rotational swipe operation type is displayed, consider a case where the GUI setting processing unit 21c acquires an evaluation value lower than a threshold value from the evaluation value acquisition processing unit 21b. In this example, the greater the number of erroneous operations, the lower the evaluation value. In this example, the greater the number of erroneous operations on the presented setting screen G1 of the rotational swipe operation, the lower the evaluation value. Therefore, the GUI setting processing unit 21c changes the presented GUI, the setting screen G1, to another GUI. The GUI to change to is determined based on the type of erroneous operation. For example, if the number of erroneous tap operations is relatively high compared to other erroneous operations, the GUI setting processing unit 21c determines that the GUI that matches the type of erroneous operation by the user is the setting screen G2 of the tap operation type. Therefore, the GUI setting processing unit 21c changes the setting screen G2 of the tap operation type instead of the setting screen G1 of the rotational swipe operation type. The GUI presentation processing unit 21a presents the changed GUI, the setting screen G2, the next time the setting screen G is displayed.
[0074] In this example, a series of processes including the GUI presentation process by the GUI presentation processing unit 21a, the evaluation value acquisition process by the evaluation value acquisition processing unit 21b, and the GUI setting process by the GUI setting processing unit 21c is performed only once after the digital camera 10 is turned on and before the power is turned off. In other words, if the presented GUI is changed once after the digital camera 10 is turned on, the GUI will not be changed again until the power is turned off.
[0075] [Processing flow] Next, the processing flow for GUI setting in digital camera 10 will be described using the flowcharts shown in Fig. 14 and Fig. 15. When digital camera 10 is powered on and in imaging mode, it displays a live view on touch panel 26. The flowchart shown in Fig. 14 shows processing that assumes a state in which live view display is being performed after digital camera 10 is powered on.
[0076] As shown in FIG. 14, when the setting button 14 is pressed while a live view is displayed on the touch panel 26 (determined Yes in step S10), the CPU 21 first determines whether this is the first setting operation after the digital camera 10 is powered on (step S11).
[0077] If it is determined in step S11 that this is the first setting operation after the digital camera 10 is powered on (determined Yes in step S11), the GUI presentation processing unit 21a displays the setting screen G on the touch panel 26 (step S12). As a result, the setting screen G is presented to the user as a GUI.
[0078] The setting screen G displayed on the touch panel 26 during the initial setting operation after the power is turned on is the setting screen G that was set at the time the power was most recently turned off, out of the setting screen G1 for the rotational swipe operation type, the setting screen G2 for the tap operation type, and the setting screen G3 for the up / down swipe operation type. Note that in the initial state of the digital camera 10 when it is shipped from the factory, for example, the setting screen G1 for the rotational swipe operation type is set as the initial setting.
[0079] Next, the evaluation value acquisition processing unit 21b starts the evaluation value acquisition process for the setting screen G presented as a GUI on the touch panel 26 (step S13). In the evaluation value acquisition process, the number of erroneous operations and the details of the erroneous operations are recorded.
[0080] Next, when an instruction to end the setting is input from the touch panel 26, the evaluation value acquisition processing unit 21b ends the display of the setting screen G (step S14) and ends the evaluation value acquisition process (step S15).
[0081] Next, the GUI setting processing unit 21c executes the GUI setting process (step S16).
[0082] 15, the GUI setting process first determines whether the evaluation value of the setting screen G as the presented GUI is equal to or less than a threshold value (step S160). If the evaluation value is equal to or less than the threshold value (determined Yes in step S160), the GUI setting processing unit 21c sets the setting screen G (an example of a GUI) that matches the content of the user's operation error based on the recorded content of the operation error (step S161).
[0083] For example, when the setting screen G1 of the rotational swipe operation type is presented as the GUI, if the evaluation value is below the threshold and the number of tap operation errors is relatively high for the type of operation error at that time, the setting screen G2 of the tap operation type is changed instead of the setting screen G1 of the rotational swipe operation type.
[0084] Next, the GUI setting processing unit 21c changes the next setting screen G to the setting screen G (an example of a GUI) set in step S161 (step S162), and proceeds to step S19 in FIG.
[0085] Also, if the evaluation value exceeds the threshold value in step S160 (determined No in step S160), the GUI setting processing unit 21c does not change the setting screen G (an example of a GUI), and proceeds to step S19 in FIG. 14 with the original setting screen G remaining.
[0086] Returning to the flowchart of FIG. 14, the CPU 21 repeats the processes from steps S10 to S16 until the digital camera 10 is powered off (determined Yes in step S19).
[0087] Furthermore, if it is determined in step S11 that this is not the first setting operation after the digital camera 10 is powered on (determination No in step S11), the GUI presentation processing unit 21a displays the setting screen G on the touch panel 26 (step S17). The setting screen G displayed at this time presents the setting screen G set in the GUI setting process in step S16. In step S17, the setting screen G is presented as in step S12, but because this is not the first setting operation, the evaluation value acquisition processing unit 21b does not execute the evaluation value acquisition process. Furthermore, because the evaluation value acquisition process is not executed, the GUI setting processing by the GUI setting processing unit 21c is not executed either.
[0088] When an instruction to end the settings is input from the touch panel 26, the CPU 21 ends the display of the setting screen G (step S18) and proceeds to step S19.
[0089] [Action and effect] The CPU 21 of the digital camera 10 in this embodiment executes an evaluation value acquisition process to acquire an evaluation value for evaluating the user's operational feel for the GUI (for example, the setting screen G), and a GUI setting process to set the GUI based on the evaluation value.
[0090] In this way, by setting the GUI based on the evaluation value indicating the user's operational feel, it is possible to customize the GUI to suit the user's operational feel without the user having to customize the GUI themselves. Customization is easy for each user because the user only needs to perform the setting operations they normally perform. Therefore, the technology disclosed herein makes it possible to easily customize the GUI for each user.
[0091] Furthermore, the GUI setting process has a first GUI setting mode in which the presented GUI is changed to another GUI when the evaluation value falls below a set threshold. By setting the GUI in the first GUI setting mode, if the presented GUI does not suit the user's operational feel, it can be changed to another GUI. This makes it possible to eliminate GUIs that do not suit the user's operational feel.
[0092] The evaluation value also includes an evaluation value based on the number of user operation errors with respect to the presented GUI. The number of operation errors is considered to be an index that directly indicates the user's operational feel. By using the number of operation errors as the evaluation value, it is possible to appropriately estimate whether the presented GUI is suitable for the user's operational feel.
[0093] Furthermore, by executing the first GUI setting mode in the GUI setting process, when the number of erroneous operations exceeds a set number and the evaluation value falls below a set threshold, the CPU 21 changes the presented GUI to a GUI that matches the content of the erroneous operation made by the user. By adopting such an embodiment, it is possible to display a GUI that is less likely to cause erroneous operations and is easy for the user to use.
[0094] In the above example, the CPU 21 changes the GUI from the setting screen G1 to the setting screen G2 in the GUI setting process, thereby changing the display form and operation method of the graphic elements as the components of the GUI. The display form and operation method of the graphic elements generally have a relatively strong influence on the user's operational feel. By changing such components, it becomes easier to accurately evaluate whether the presented GUI and the GUI to be changed are compatible with the user's operational feel. If the compatibility of the operational feel can be accurately evaluated, it becomes easier to match the GUI with a more compatible operational feel.
[0095] In addition to the display format and operation method of the graphic elements shown in the above examples, GUI components include the operation sensitivity of the graphic elements, the screen transition order, and the screen transition time. Changing these components can also change the GUI. The operation sensitivity of the graphic elements is, for example, the operation sensitivity for determining whether a touch operation has been performed on the shutter speed setting button 30. The operation sensitivity is, for example, the contact time of the finger FG. Alternatively, the operation sensitivity can be changed by changing the area for detecting touch operations, such as by changing the size of the detection region R1. Furthermore, the screen transition order refers to the order of transitions between sub-screens when the setting screen G is composed of multiple hierarchical sub-screens, and the screen transition time refers to the time it takes to switch from one sub-screen to another. The operation feel can also vary significantly depending on the sub-screen transition order. Furthermore, if the sub-screen switching time is too short, operational errors may increase.
[0096] In this way, components other than the display form of the graphic elements and the operation method of the graphic elements can also be used as indicators for evaluating whether or not the GUI is suited to the user's operational feel. Therefore, in the technology disclosed herein, the method of changing the GUI is not limited to the above examples, and it is sufficient to change at least one of the components of the display form of the graphic elements, the operation method of the graphic elements, the operation sensitivity of the graphic elements, the order of screen transitions, and the time for screen transitions.
[0097] Furthermore, the CPU 21 executes a series of processes, including a GUI presentation process, an evaluation value acquisition process, and a GUI setting process, at set timings while the digital camera 10, an example of an electronic device, is powered on. By performing the series of processes at set timings while the power is on, various effects can be obtained depending on the timing settings. For example, in the above example, the set timing is the first setting operation after the power is turned on. In this manner, the evaluation value is updated only once after the power is turned on. Therefore, the GUI is changed at most once. Therefore, power consumption of the digital camera 10 can be reduced compared to a manner in which evaluation value acquisition and GUI changes are repeated many times while the power is on.
[0098] Also, unlike the above example, the CPU 21 may repeatedly execute a series of processes including a GUI presentation process, an evaluation value acquisition process, and a GUI setting process at a set timing, as shown in the flowchart of Fig. 16. The flowchart of Fig. 16 is the same as the flowchart of Fig. 14 except that steps S11, S17, and S18 are removed from the flowchart of Fig. 14. In the flowchart of Fig. 16, the GUI presentation process, the evaluation value acquisition process, and the GUI setting process are executed each time the setting screen G is displayed while the power is on. In the example of Fig. 16, the set timing is the timing when a setting operation is performed, and the series of processes are repeatedly executed at this timing.
[0099] In this way, the series of processes may be repeatedly executed at set timing. By repeatedly executing the series of processes, the GUI can be made closer to the GUI preferred by the user. In this example, there are three setting screens G1 to G3 as GUIs, and one setting screen G is selected from these according to the evaluation value. By repeating the series of processes as shown in FIG. 16, the setting screen G that best suits the user's operational feel is likely to be selected from the three setting screens G.
[0100] Furthermore, as shown in FIG. 17, even if the evaluation value acquisition process is executed, if the shutter button 13 is not operated, the GUI setting process does not need to be executed. The flowchart shown in FIG. 17 is the same as the flowchart of FIG. 16 except that step S151 is added between steps S15 and S16. In the flowchart shown in FIG. 17, after the evaluation value acquisition process is completed in step S15, it is determined in step S151 whether the shutter button 13 has been operated. If the shutter button 13 has not been operated (determined NO in step S151), the GUI setting process is not executed. However, if the shutter button 13 has been operated (determined YES in step S151), the GUI setting process is executed. In other words, the timing at which a series of processes including the GUI presentation process, the evaluation value acquisition process, and the GUI setting process are executed is the timing at which the setting operation is performed and the shutter button 13 is operated. In this way, the GUI setting process is not executed simply by performing the setting operation, and therefore power consumption can be reduced by reducing the frequency of the GUI setting process.
[0101] 17 and the example shown in Fig. 14 may be combined. That is, the GUI setting process is executed the first time both the setting operation and the shutter button 13 operation are performed after the digital camera 10 is powered on. Thereafter, the GUI setting process is not executed until the power is turned off. This also makes it possible to reduce power consumption.
[0102] The GUI is a GUI used in the digital camera 10, which is an imaging device, and the operation items are operation items related to setting operations related to imaging. By adopting such an embodiment, it becomes possible to customize the GUI, which is frequently used for setting operations related to imaging, in the digital camera 10. Note that the imaging device may be any device other than a digital camera as long as it has an imaging function, such as a smartphone.
[0103] The evaluation value is an evaluation value in which the number of erroneous operations is an evaluation item. Here, the number of erroneous operations is the number of erroneous operations performed within the setting operation time. In this example, the setting operation time is the total elapsed time from the start to the end of the setting operation (setting operation time ts1 in FIG. 5). By using the number of erroneous operations as an evaluation item as the evaluation value, it is easy to accurately evaluate whether or not the GUI is suited to the user's operating feel, as described above. Furthermore, by setting a higher evaluation value the fewer the number of erroneous operations, it is easy to customize a GUI to one that has fewer erroneous operations. Furthermore, the setting operation time in which the number of erroneous operations is counted is set to setting operation time ts1, which is the total elapsed time required to perform the setting operation, as shown in FIG. 5. This makes it possible to count the number of erroneous operations throughout the entire time period related to the setting operation, making it easy to appropriately evaluate the user's operating feel.
[0104] The evaluation value may be an evaluation value in which the setting operation time is an evaluation item. In this case, for example, the longer the setting operation time, the lower the evaluation value is set, and the shorter the setting operation time, the higher the evaluation value is set. By adopting such an embodiment, it is easy to customize a GUI that allows setting operations to be performed in a short time. Time is considered to be an important factor that causes users to feel that operability is poor. Therefore, by using the setting operation time as an evaluation item, it is easy to more appropriately evaluate the user's operational feel.
[0105] The evaluation value may also be an evaluation value that uses the no-operation time tn shown in FIG. 5 as an evaluation item. The no-operation time tn can be considered as the time during which the user's finger FG is on the GUI while the user is unsure how to operate the GUI. In this case, the evaluation value is set lower the longer the no-operation time tn, and higher the shorter the no-operation time tn. By adopting such an embodiment, it is easy to customize the GUI so that it is less likely to cause confusion.
[0106] As described above, various evaluation items can be considered as evaluation items for the evaluation value, such as the setting operation time, the non-operation time, the number of incorrect operations, etc. As described above, all of these evaluation items are recognized as being useful for appropriately evaluating the user's operational feel, and therefore it is sufficient for the evaluation item for the evaluation value to include at least one of these evaluation items.
[0107] Furthermore, in addition to the example shown in FIG. 5 (setting operation time ts1), the setting operation time may be the total elapsed time from the start of the setting operation to the shutter button operation (setting operation time ts2 in FIG. 18 ) as shown in FIG. 18 . By setting the setting operation time to the setting operation time ts2 shown in FIG. 18 , it is possible to count not only the operation up to closing the setting screen G, but also the number of erroneous operations from then returning to live view until the operation of the shutter button 13 is completed. As in this example, when the setting operation is a setting operation related to imaging, the setting operation is performed for imaging, and it can also be considered important that the series of operations from the setting operation to imaging be easy to perform. Therefore, by setting the setting operation time to the setting operation time ts2 shown in FIG. 18 , the series of operations from the setting operation to imaging can be reflected in the evaluation value. As a result, a GUI with good operability for the series of operations from the setting operation to imaging can be set.
[0108] The operational items include aperture, shutter speed, and imaging sensitivity. By adopting this configuration, operational items that are frequently set in the digital camera 10 can be easily customized for each user.
[0109] [Second embodiment] Next, a second embodiment of the present disclosure will be described. Compared to the first embodiment, a digital camera 10 according to the second embodiment has a change in the content of the GUI setting process of step S16 shown in FIG. 14 and the like. Specifically, the GUI setting process of step S16 of FIG. 14 and the like is changed to step SA16 shown in FIG. 19. The other processes are the same as those in the first embodiment. Furthermore, the hardware configuration of the digital camera 10 is the same as that of the first embodiment, and therefore a description of the content that overlaps with the first embodiment will be omitted.
[0110] [Processing flow] In the second embodiment, the overall processing will be explained using the flowchart of FIG. 14 shown in the first embodiment as an example, and the contents of the GUI setting processing in step S16A, which is a difference from the first embodiment, will be explained using the flowchart shown in FIG. 19.
[0111] As shown in FIG. 14, when the setting button 14 is pressed while a live view is displayed on the touch panel 26 (determined Yes in step S10), the CPU 21 first determines whether this is the first setting operation after the digital camera 10 is powered on (step S11).
[0112] If it is determined in step S11 that this is the first setting operation after the digital camera 10 is powered on (determined Yes in step S11), the GUI presentation processing unit 21a executes GUI presentation processing to display a setting screen on the touch panel 26 (step S12).
[0113] As an example of the setting screen, a case will be described in which the rotational swipe operation type setting screen G1 shown in FIG. 6 is set. As an example, the digital camera 10 has three operation items on the setting screen: shutter speed, aperture, and image capture sensitivity. On the rotational swipe operation type setting screen G1, a shutter speed setting button 30, an aperture setting button 31, and an image capture sensitivity setting button 32 for inputting setting values for each operation item are arranged in a horizontal row in this order from the left. In addition to these buttons, a decision button 33 and a back button 34 are also provided.
[0114] Next, the evaluation value acquisition processing unit 21b starts the evaluation value acquisition process for the GUI presented on the touch panel 26 as the setting screen (step S13). Here, as an example, the evaluation value is set to the number of times the user makes an erroneous operation on the presented GUI.
[0115] Next, when an instruction to end the setting is input from the touch panel 26, the evaluation value acquisition processing unit 21b ends the display of the setting screen (step S14) and ends the evaluation value acquisition process (step S15).
[0116] Next, the GUI setting processing unit 21c executes the GUI setting process shown in FIG. 19 (step SA16).
[0117] 19, the GUI setting processing unit 21c first determines whether the evaluation value for the presented GUI is equal to or less than a threshold value (step SA160). If the evaluation value is equal to or less than the threshold value (determined Yes in step SA160), the GUI setting processing unit 21c executes GUI generation processing (step SA161).
[0118] The GUI generation process of step SA161 is a process of generating a new GUI that is different from a preset GUI. In detail, in step SA161, as shown in Fig. 20, the GUI setting processing unit 21c determines the most frequently used operation item based on the user's operation history (step SA1610).
[0119] Specifically, as shown in the table of FIG. 21, the GUI setting processing unit 21c records the cumulative number of times settings have been made for the three items of shutter speed, aperture, and imaging sensitivity since the product was shipped, based on the user's operation history.
[0120] Then, in step SA1610, the GUI setting processing unit 21c determines the operation item with the largest cumulative number of settings as the most frequently used operation item from the table of Fig. 21. Here, as an example, a case will be described where the shutter speed has the largest cumulative number of settings.
[0121] Next, the GUI setting processing unit 21c places the GUI of the most frequently used operation item in the position closest to the center of the screen, and generates a new GUI (step SA1611).
[0122] As an example of generating a new GUI, on the currently set setting screen G1 for the rotational swipe operation type, the shutter speed setting button 30, which is the GUI of the most frequently used operation item, is placed closest to the center of the screen. In addition, the aperture setting button 31 and the image capture sensitivity setting button 32 are placed on either side of the shutter speed setting button 30.
[0123] In this way, as shown in Figure 22, a rotational swipe operation type setting screen G1A is generated in which the aperture setting button 31, shutter speed setting button 30, and image capture sensitivity setting button 32 are arranged in a horizontal row in this order from left to right.
[0124] Returning to the flowchart of FIG. 19, the GUI setting processing unit 21c then changes the GUI for the next display of the setting screen to the GUI generated in step SA161 (step SA162), and proceeds to step S19 in FIG.
[0125] If the evaluation value exceeds the threshold value in step SA160 (determined No in step SA160), the GUI setting processing unit 21c does not generate a GUI, but proceeds to step S19 in FIG. 14 with the original settings unchanged.
[0126] 14, the CPU 21 repeats the processes from steps S10 to S16 until the digital camera 10 is powered off (determined Yes in step S19). In this way, the processes other than the GUI setting process in step S16 are the same as those in the first embodiment.
[0127] [Action and effect] In this embodiment, the CPU 21 executes a GUI generation process in the GUI setting process to generate a new GUI different from a preset GUI, and sets the generated GUI. This configuration allows various GUI screens to be presented by combining individual GUI components, without having to previously store data for multiple changeable setting screens G, such as the multiple setting screens G1 to G3 shown in the first embodiment. This allows for customization of each individual GUI component, making it easier to create a GUI that is closer to the user's preferences. Furthermore, by storing data for the GUI components, various GUIs can be generated by various combinations of the components. This eliminates the need to store all data for the entire GUI, as is the case when storing data for all of the multiple setting screens G, and allows various GUIs to be presented while reducing data storage capacity.
[0128] Furthermore, when arranging the GUIs of multiple operation items on one screen in the GUI generation process, the GUI setting processor 21c arranges the GUI of the most frequently used operation item closest to the center of the screen. By adopting such an embodiment, it is possible to set a GUI that is easy for the user to use.
[0129] [Third embodiment] Next, a third embodiment of the present disclosure will be described. In the digital camera 10 according to the third embodiment, the GUI generation process is changed compared to the second embodiment. Specifically, in the third embodiment, step SA161 shown in FIG. 20 is replaced by step SB161 shown in FIG. 23. The other processes are similar. The hardware configuration of the digital camera 10 is the same as in the second embodiment, and therefore a description of the content that overlaps with the first embodiment will be omitted.
[0130] [Processing flow] The process flow for GUI setting in the digital camera 10 will be described using a flowchart.
[0131] As shown in FIG. 14, when the setting button 14 is pressed while a live view is displayed on the touch panel 26 (determined Yes in step S10), the CPU 21 first determines whether this is the first setting operation after the digital camera 10 is powered on (step S11).
[0132] If it is determined in step S11 that this is the first setting operation after the digital camera 10 is powered on (determined Yes in step S11), the GUI presentation processing unit 21a executes GUI presentation processing to display a setting screen on the touch panel 26 (step S12).
[0133] Here, as an example of the setting screen G, a case will be described in which the setting screen G1 of the rotational swipe operation type shown in FIG. 6 is set. As an example, the digital camera 10 has three operation items on the setting screen G: shutter speed, aperture, and image capture sensitivity. On the rotational swipe operation type setting screen G1, a shutter speed setting button 30, an aperture setting button 31, and an image capture sensitivity setting button 32 for inputting the setting values of each operation item are arranged in this order horizontally from the left. In addition to these buttons, a decision button 33 and a back button 34 are also provided.
[0134] Next, the evaluation value acquisition processing unit 21b starts an evaluation value acquisition process for the GUI presented on the touch panel 26 as the setting screen G (step S13). Here, as an example, the evaluation value is set to the number of times the user makes an erroneous operation on the presented GUI.
[0135] Next, when an instruction to end the setting is input from the touch panel 26, the evaluation value acquisition processing unit 21b ends the display of the setting screen (step S14) and ends the evaluation value acquisition process (step S15).
[0136] Next, the GUI setting processing unit 21c executes the GUI setting process (step S16).
[0137] 19, the GUI setting process first determines whether the evaluation value for the presented GUI is equal to or less than a threshold value (step SA160). If the evaluation value is equal to or less than the threshold value (determined Yes in step SA160), in the third embodiment, the GUI setting processing unit 21c executes GUI generation processing in step SB161 shown in FIG. 23 instead of step SA161 shown in FIG.
[0138] As shown in FIG. 23, in step SB161, the GUI setting processing unit 21c determines the parts of the GUI to be changed and the degree of change based on the user's operation history (step SB1610).
[0139] As for the changeable parts of the GUI, as shown in the table of FIG. 24, for example, the size, display saturation, swipe operation reaction amount, tap operation discrimination time, and detection range displacement amount of each button can be changed for each button.
[0140] Furthermore, a priority is set for each item of the change portion. The smaller the number, the higher the priority. The priority indicates which of the change portions is to be changed first. In the example of FIG. 24, the button size has the highest priority, and the detection area displacement amount has the lowest priority. When changing the setting screen G in the GUI generation process, the GUI setting processing unit 21c changes the change portion in order from the highest priority. Furthermore, for each item of the change portion, a deviation amount indicating the degree of deviation from the standard state is quantified according to the degree of change. The degree of change is an index indicating the degree to which the change portion is changed. For example, the degree of change of the button size is the degree to which the button size is changed, and the larger the degree of change in the positive direction, the larger the button size is changed.
[0141] The button size can be increased by 1.1 to 1.3 times from the standard size, and decreased by 0.9 to 0.7 times. The deviation amount is set to "0" for the standard size, "1" for 1.1 and 0.9, "2" for 1.2 and 0.8, and "3" for 1.3 and 0.7. The priority of the button size is set to "1."
[0142] During the setting operation time ts1 (see FIG. 5) from when the setting button 14 is pressed until the input of an instruction to end the setting on the touch panel 26 is completed, if the no-operation time tn is long, it is considered that the GUI is difficult for the user to distinguish. Therefore, based on the user's operation history, if the no-operation time tn is long, the GUI setting processing unit 21c changes the button size to be larger in accordance with the length of the no-operation time tn. Furthermore, if the frequency of use of a corresponding button is high during the setting operation time ts1, the GUI setting processing unit 21c changes the button size to be larger in accordance with the frequency of use. Furthermore, if the frequency of use of a corresponding button is low during the setting operation time ts1, the GUI setting processing unit 21c changes the button size to be smaller in accordance with the frequency of use.
[0143] Display saturation is the saturation of the display color of changeable parts of the GUI, such as buttons. Display saturation can be changed to high or very high to increase the saturation, or to low or very low to decrease the saturation, based on the standard saturation. The deviation amount is set to "0" for the standard state, "1" for high and low, and "2" for very high and very low. The priority of button display saturation is set to "2".
[0144] During the setting operation time ts1 from when the setting button 14 is pressed until the input of an instruction to end the setting on the touch panel 26 is completed, if the no-operation time tn is long, it is considered that the GUI will be difficult for the user to distinguish. Therefore, based on the user's operation history, if the no-operation time tn is long, the GUI setting processing unit 21c changes the display saturation of the button to be higher in accordance with the length of the no-operation time tn. Furthermore, if the frequency of use of the corresponding button is high during the setting operation time ts1, the GUI setting processing unit 21c changes the display saturation of the button to be higher in accordance with the frequency of use. Furthermore, if the frequency of use of the corresponding button is low during the setting operation time ts1, the GUI setting processing unit 21c changes the display saturation of the button to be lower in accordance with the frequency of use.
[0145] For buttons that perform swipe operations, the swipe operation reaction amount can be changed. The swipe operation reaction amount is a parameter indicating the amount by which the GUI setting processing unit 21c changes the setting value in response to the amount of swipe operation on the touch panel 26 by the user's finger FG. The swipe operation reaction amount can be changed from 1.1 to 1.3 times in the direction of increasing the reaction amount, and from 0.9 to 0.7 times in the direction of decreasing the reaction amount, based on the size in the standard state. The deviation amount is set to "0" for the standard state, "1" for 1.1 times and 0.9 times, "2" for 1.2 times and 0.8 times, and "3" for 1.3 times and 0.7 times. The priority of the swipe operation reaction amount is set to "3."
[0146] When a user repeatedly performs long swipes on the setting screen, the sensitivity of the swipe operation is considered to be too low. Conversely, when a user repeatedly performs small swipes on the setting screen, the sensitivity of the swipe operation is considered to be too high. Therefore, when a user repeatedly performs long swipes, the GUI setting processing unit 21c increases the swipe operation response amount depending on the length of the swipe operation. Furthermore, when a user repeatedly performs small swipe operations, the GUI setting processing unit 21c decreases the swipe operation response amount depending on the length of the swipe operation.
[0147] The tap operation identification time can be changed for buttons that are tapped. The tap operation identification time is a parameter indicating the length of time that the finger FG is in contact with the touch panel 26, which is required for the GUI setting processing unit 21c to identify a tap operation when the user taps with the finger FG. The tap operation identification time can be changed from 1.1 to 1.3 times the size in the standard state to increase the identification time, and from 0.9 to 0.7 times to decrease the identification time. The deviation amount is set to "0" for the standard state, "1" for 1.1 and 0.9 times, "2" for 1.2 and 0.8 times, and "3" for 1.3 and 0.7 times. The priority of the tap operation identification time is set to "3."
[0148] If the user tends to tap buttons for a long time, the GUI setting processing unit 21c changes the tap operation identification time to be longer in accordance with the length of the tap operation, whereas if the user tends to tap buttons for a short time, the GUI setting processing unit 21c changes the tap operation identification time to be shorter in accordance with the length of the tap operation.
[0149] The detection range displacement is the displacement of the detection area for button operation on the touch panel 26 relative to the display position of the button. Normally, the center position of the button and the center position of the detection area are the same. However, if the user's button operation position always deviates from the center position of the button in the same direction, the center position of the detection area is displaced from the center position of the button in the direction of the operation deviation. This improves detection accuracy even when there is variation in the operation position for each user operation input. The detection range displacement can be displaced in 20-pixel increments up to 60 pixels in the direction of the operation deviation, based on the position in the standard state. The deviation amount is set to "0" for the standard state, "1" for 20 pixels, "2" for 40 pixels, and "3" for 60 pixels. The priority of the detection range displacement amount is set to "4."
[0150] The GUI setting processing unit 21c changes the direction and amount of displacement according to the average error between the center position of the button and the position where the user operates the button.
[0151] The GUI setting processing unit 21c determines the above factors in combination and determines the portions of the GUI to be changed and the degree of change for each button on the rotational swipe operation type setting screen G1 based on the operation history of the user.
[0152] Next, the GUI setting processor 21c determines whether the sum of the deviations in the determined changed parts and degrees of change is equal to or less than a threshold (step SB1611). If the sum of the deviations is equal to or less than the threshold (determined Yes in step SB1611), the GUI setting processor 21c generates a new GUI based on the determined changed parts and degrees of change (step SB1612).
[0153] If the total deviation exceeds the threshold (No in step SB1611), the GUI setting processor 21c reduces the degree of change by one level in order of the lowest priority of the changed part (step SB1613) and performs the determination in step SB1611 again. These processes are repeated until the total deviation becomes equal to or less than the threshold.
[0154] Here, the processing of steps SB1611, SB1612, and SB1613 will be described in detail using a specific example.
[0155] It is assumed that the threshold value in step SB1611 is set to "15." It is also assumed that in step SB1610, the GUI setting processing unit 21c has determined that the button size is 1.2 times (priority order 1, deviation amount 2) and the button display saturation is high (priority order 2, deviation amount 1) for each of the shutter speed setting button 30, aperture setting button 31, image capture sensitivity setting button 32, enter button 33, and back button 34. It is also assumed that the GUI setting processing unit 21c has determined that the tap operation discrimination time is 1.1 times (priority order 3, deviation amount 1) for each of the enter button 33 and back button 34.
[0156] In this case, the total deviation amount is "17," so the processes of steps SB1611 and SB1613 are repeated until it becomes equal to or less than the threshold value (here, 15). Specifically, first, the degree of change of the tap operation discrimination time with the lowest priority of the changed part is lowered by one level (step SB1613), and the determination of step SB1611 is performed again.
[0157] Here, the two buttons for which the tap operation identification time has been changed are the decision button 33 and the back button 34, but it is possible to set as appropriate which button's degree of change is to be lowered first. For example, a priority may be set for each button, and the degree of change may be lowered starting with the button with the lowest priority, or starting with the button located farthest from the center of the screen.
[0158] As a result of repeating the processing of steps SB1611 and SB1613, the GUI setting processing unit 21c increases the button size by 1.2 times (priority 1, deviation amount 2) and increases the button display saturation by 1.2 times (priority 2, deviation amount 1) for each of the shutter speed setting button 30, aperture setting button 31, image capture sensitivity setting button 32, decision button 33, and back button 34, and the total deviation amount becomes "15," and the process proceeds from step SB1611 to step SB1612.
[0159] Based on the changes and the degree of change finally determined as described above, the GUI setting processing unit 21c generates a rotational swipe operation type setting screen G1B as a new GUI, as shown in FIG. 25 (step SB1612).
[0160] Returning to the flowchart of FIG. 19, the GUI setting processing unit 21c then changes the GUI for the next display of the setting screen to the GUI generated in step SB161 (step SA162), and proceeds to step S19 in FIG.
[0161] If the evaluation value exceeds the threshold value in step SA160 (determined No in step SA160), the GUI setting processing unit 21c does not generate a GUI, but proceeds to step S19 in FIG. 14 with the original settings unchanged.
[0162] 14, the CPU 21 repeats the processes from steps S10 to S16 until the digital camera 10 is powered off (determined Yes in step S19). In this way, the processes other than the GUI setting process in step S16 are the same as those in the first embodiment.
[0163] [Action and effect] In this embodiment, in the GUI generation process, CPU 21 quantifies the deviation amount, which indicates the degree to which the changed state of each of the changeable GUI components deviates from the set standard state, and generates a new GUI so that the total deviation amount falls within a predetermined numerical range. By adopting this mode, it is possible to prevent the GUI from deviating too much from the standard state and becoming difficult to use.
[0164] [Fourth embodiment] Next, a fourth embodiment of the present disclosure will be described. The digital camera 10 according to the fourth embodiment differs from the first embodiment in that the GUI setting process is changed from a first GUI setting mode to a second GUI setting mode. As described above, the first GUI setting mode is a mode in which one GUI is presented, and if the evaluation value for the presented GUI falls below a set threshold, the presented GUI is changed to another GUI. In contrast, the second GUI setting mode is a mode in which multiple types of GUIs for the same operation item are presented, and, if evaluation values for each of the multiple types of GUIs presented are acquired in the evaluation value acquisition process, the GUI with the relatively highest evaluation value is set. The hardware configuration of the digital camera 10 is the same as that of the first embodiment, and therefore a description of the content that overlaps with the first embodiment will be omitted.
[0165] In the fourth embodiment, the GUI presentation processing unit 21a selectively presents three types of setting screens G, for example, a setting screen G1 of a rotational swipe operation type, a setting screen G2 of a tap operation type, and a setting screen G3 of an up / down swipe operation type. The GUI presentation processing unit 21a switches between the three types of setting screens G1 to G3 when a set switching condition is met. The switching condition may be, for example, time or the number of times the digital camera 10 has been started. For example, after presenting one setting screen G1, the GUI presentation processing unit 21a determines that the switching condition is met when a set time has elapsed and switches to another setting screen G2. Alternatively, after presenting one setting screen G1, the GUI presentation processing unit 21a determines that the switching condition is met when the number of times the setting screen has been started reaches a set number and switches to another setting screen G2.
[0166] The evaluation value acquisition processing unit 21b acquires the evaluation value of each of the setting screens G1 to G3 when they are presented. The acquired evaluation values are recorded in the memory 22.
[0167] After the presentation of the plurality of types of setting screens G1 to G3 and the acquisition of the evaluation values are completed in this manner, the GUI setting processing unit 21c performs GUI setting processing in the second GUI setting mode, as shown in FIG.
[0168] 26, in the GUI setting process, the GUI setting processing unit 21c first reads out the evaluation values of the setting screens G1 to G3 acquired by the evaluation value acquisition processing unit 21b from the memory 22. Then, the GUI setting processing unit 21c selects the setting screen G with a relatively high evaluation value, and sets the selected setting screen G as the GUI to be used for the setting operation.
[0169] In the example of Figure 26, of the setting screen G1 for the rotational swipe operation type, the setting screen G2 for the tap operation type, and the setting screen G3 for the up / down swipe operation type, the setting screen G2 for the tap operation type has the highest evaluation value, so the setting screen G2 for the tap operation type is set.
[0170] [Processing flow] The process flow for GUI setting in the digital camera 10 will be described using a flowchart.
[0171] As shown in FIG. 27, when a user inputs an instruction to start the customization mode (step S20), the GUI presentation processing unit 21a first sets a rotational swipe operation type setting screen G1 as GUI type 1, and when the setting button 14 is pressed, displays the rotational swipe operation type setting screen G1 on the touch panel 26 (step S21).
[0172] Next, the evaluation value acquisition processing unit 21b executes an evaluation value acquisition process for the GUI presented on the touch panel 26 as the setting screen G (step S22). Steps S21 and S22 are performed only once while the digital camera 10 is powered on.
[0173] Thereafter, when the GUI presentation processing unit 21a detects that the switching condition is satisfied (step S23), it sets the tap operation type setting screen G2 as the next GUI type 2, and when the setting button 14 is pressed, it displays the tap operation type setting screen G2 as the setting screen on the touch panel 26 (step S24). In this example, if the power of the digital camera 10 is restarted once after one setting screen G has been presented, it is determined that the switching condition is satisfied, and the setting screen is switched to another setting screen G.
[0174] Next, the evaluation value acquisition processing unit 21b executes evaluation value acquisition processing for the GUI presented on the touch panel 26 as the setting screen (step S25). Steps S24 and S25 are performed only once while the digital camera 10 is powered on.
[0175] Thereafter, when the GUI presentation processing unit 21a detects that the switching condition is satisfied (step S26), it sets the setting screen G3 of the up / down swipe operation type as GUI type 3, and when the setting button 14 is pressed, displays the setting screen G3 of the up / down swipe operation type as the setting screen on the touch panel 26 (step S27).
[0176] Next, the evaluation value acquisition processing unit 21b executes evaluation value acquisition processing for the GUI presented on the touch panel 26 as the setting screen (step S28). Steps S27 and S28 are performed only once while the digital camera 10 is powered on.
[0177] Thereafter, when the GUI setting processing unit 21c detects that the switching condition is satisfied (step S29), it sets the GUI type with the relatively high evaluation value based on the evaluation values of each of the multiple GUI types presented (step S30), and terminates the processing.
[0178] [Action and effect] In this embodiment, in the GUI setting process, CPU 21 presents multiple types of GUIs for the same operation item, and in the evaluation value acquisition process, CPU 21 acquires the evaluation values of each of the presented multiple types of GUIs. Then, CPU 21 sets the GUI in a second GUI setting mode that sets the GUI with a relatively high evaluation value. By adopting this mode, it is possible to set a GUI that provides high user satisfaction.
[0179] [Fifth embodiment] Next, a fifth embodiment of the present disclosure will be described. As shown in Fig. 28, a digital camera 10 according to the fifth embodiment differs from the second embodiment in that the digital camera 10 executes GUI generation processing based on GUI data acquired from an external server 60 via a network 61. Regarding the hardware configuration of the digital camera 10, a description of the same content as in the first and second embodiments will be omitted.
[0180] 29, digital camera 10 has a CPU 21, memory 22, storage 23, imaging unit 24, operation input unit 25, touch panel 26, and communication unit 27. Each component is connected to each other via bus 28 so as to be able to communicate with each other.
[0181] The communication unit 27 is an interface for the smartphone to communicate with external devices such as the server 60, and uses standards such as Wi-Fi (registered trademark) and Bluetooth (registered trademark), for example. The communication unit 27 is an example of a GUI data acquisition unit in the technology of the present disclosure.
[0182] The CPU 21 acquires GUI data from the external server 60 via the communication unit 27 and stores the acquired GUI data in the storage 23 .
[0183] In the GUI generation process, the CPU 21 may generate a new GUI based on GUI data acquired from the external server 60.
[0184] By adopting such an embodiment, the GUI data required to generate a GUI can be added later, thereby increasing the variety of GUIs presented to the user.
[0185] Acquisition of GUI data from outside is not limited to acquisition from a server 60 separate from the digital camera 10 as described above, but the GUI data may also be acquired by reading GUI data recorded on a medium such as a memory card in the digital camera 10.
[0186] The GUI data may be in a form including only data of the components of the setting screen G, or may be in a form including a GUI generation program in addition to the data of the components. In the case where the GUI generation program is included, even if the GUI generation program is not pre-installed in the digital camera 10, the GUI can be generated by downloading the GUI data from the server 60.
[0187] [Sixth embodiment] Next, a sixth embodiment of the present disclosure will be described. As shown in FIG. 28, the GUI setting system 1 includes a server 60 and a digital camera 10.
[0188] In the GUI setting system 1, the server 60 acquires user operation information from the digital camera 10, and performs evaluation value acquisition processing and GUI setting processing based on the acquired operation information to change the GUI of the digital camera 10. The server 60 is an example of a GUI setting device in the technology of the present disclosure. The digital camera 10 is an example of an electronic device in the technology of the present disclosure.
[0189] The hardware configuration of the digital camera 10 is the same as that of the fifth embodiment, and therefore a description of the same content as that of the fifth embodiment will be omitted.
[0190] In the digital camera 10, as an example, the GUI can present setting screens G of three different operation types: a setting screen G1 for a rotational swipe operation type, a setting screen G2 for a tap operation type, and a setting screen G3 for an up / down swipe operation type. GUI data GD required to display these GUIs is stored in the storage 23.
[0191] 30, the server 60 includes a CPU 71, a memory 72, a storage 73, and a communication unit 74. Each component is connected via a bus 75 so as to be able to communicate with each other.
[0192] The CPU 71 executes a control program and the like to comprehensively control each unit of the server 60. The memory 72 is a working memory and is configured, for example, by a RAM. The CPU 71 reads the control program from the storage 73 into the memory 72 and executes the control program using the memory 72 as a working area. The CPU 71 controls each of the above components and performs various processes in accordance with the control program.
[0193] The CPU 71 is an example of a processor in the technology of the present disclosure. The memory 72 is an example of a memory in the technology of the present disclosure. The server 60 including the CPU 71 and the memory 72 also functions as a GUI setting device in the technology of the present disclosure.
[0194] In the evaluation value acquisition process, the CPU 71 acquires an evaluation value from the digital camera 10 via the communication unit 74. The evaluation value acquired from the digital camera 10 may be the evaluation value itself, or may not include the evaluation value itself but may be user operation information required to derive the evaluation value.
[0195] In this embodiment, the CPU 71 acquires user operation information from the digital camera 10, and derives and acquires an evaluation value in the CPU 71. The method of evaluation value acquisition processing in the CPU 71 is similar to that of the CPU 21 of the digital camera 10 in the first embodiment (see FIG. 12).
[0196] The method of GUI setting processing in the CPU 71 is the same as that in the CPU 21 of the digital camera 10 in the first embodiment (see FIG. 13).
[0197] The storage 73 stores control programs including an operating system, various programs such as application programs, and various data including GUI data. The storage 73 is configured with a drive such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). In this embodiment, the storage 73 stores a GUI setting program PG as one of the various programs.
[0198] The communication unit 74 is an interface for the server 60 to communicate with external devices such as the digital camera 10, and uses standards such as Ethernet (registered trademark), FDDI (Fiber Distributed Data Interface), and Wi-Fi (registered trademark).
[0199] [Processing flow] The processing flow for GUI setting in the GUI setting system 1 will be described using a flowchart.
[0200] As shown in FIG. 31, when the setting button 14 is pressed while a live view is being displayed on the touch panel 26, the CPU 21 of the digital camera 10 displays a setting screen on the touch panel 26 (step SC10).
[0201] The setting screen presents the currently set GUI type setting screen G among the rotational swipe operation type setting screen G1, the tap operation type setting screen G2, and the up / down swipe operation type setting screen G3. Note that the initial setting of the digital camera 10 is set to the rotational swipe operation type setting screen G1.
[0202] When an instruction to end the settings is input from the touch panel 26, the CPU 21 ends the display of the setting screen and transmits to the server 60 the type information of the setting screen G of the operation type displayed on the setting screen and the information on the user's operations performed while the setting screen was displayed (step SC11).
[0203] The CPU 71 of the server 60 executes an evaluation value acquisition process (step SS10) after acquiring the type information of the setting screen G for the operation type and the operation information of the user performed while the setting screen was displayed from the digital camera 10. Next, the CPU 71 executes a GUI setting process and transmits the type information of the setting screen G for the operation type of the set GUI to the digital camera 10 (step SS11).
[0204] For example, suppose that the setting screen G1 for the rotational swipe operation type is displayed as the GUI on the digital camera 10. At this time, if the evaluation value is equal to or less than the threshold value and the type of operation error at that time includes many tapping erroneous operations, the CPU 71 changes the setting screen G2 for the tapping operation type to the setting screen G1 for the rotational swipe operation type, and transmits the information about this to the digital camera 10.
[0205] When the CPU 21 of the digital camera 10 acquires the type information of the operation type setting screen G from the server 60, it changes the GUI to the one indicated by the type information (step SC12) and ends the process. The changed GUI will be reflected the next time the setting screen G is displayed.
[0206] [Action and effect] In this embodiment, the server 60, which is an example of a GUI setting device, is provided with a communication unit 74 that communicates with the digital camera 10, and the CPU 71 acquires an evaluation value from the digital camera 10 via the communication unit 74 in an evaluation value acquisition process, and sets the GUI of the digital camera 10 based on the evaluation value in a GUI setting process.
[0207] By adopting such an embodiment, it becomes possible to configure the GUIs of a plurality of digital cameras 10 using a single server 60.
[0208] [Seventh embodiment] Next, a seventh embodiment of the present disclosure will be described. The GUI setting system 1 of this embodiment acquires multiple evaluation values for the GUI of the same operation item from each of multiple digital cameras 10, and sets the GUI of the digital camera 10 selected as the setting target based on the multiple evaluation values in a GUI setting process in the server 60. The hardware configuration of the GUI setting system 1 is the same as that of the sixth embodiment, so a description of the content that overlaps with the sixth embodiment will be omitted.
[0209] The CPU 71 of the server 60 performs GUI setting processing as described in the sixth embodiment for the plurality of digital cameras 10. Furthermore, as shown in the table of Fig. 32, the CPU 71 assigns a camera ID to each of the plurality of digital cameras 10, and records and manages the evaluation value for each type of operation type setting screen G.
[0210] In the GUI setting process, the CPU 71 can set the GUI of the digital camera 10 selected as the setting target based on the evaluation values acquired from the plurality of digital cameras 10.
[0211] For example, it is possible to set the setting screen type of the operation type with the highest average evaluation value among a plurality of digital cameras 10 as the GUI of the digital camera 10 selected as the setting target.
[0212] In the example table of Figure 32, the average evaluation value of the tap operation type setting screen is the highest among multiple digital cameras 10, so it is possible to set the tap operation type setting screen as the GUI of the digital camera 10 selected as the setting target.
[0213] By adopting such an embodiment, the GUI for the same operation item is set based on a plurality of evaluation values for each user, so that the operation sensations of a plurality of users can be reflected in the GUI setting.
[0214] Furthermore, when a new digital camera 10 is connected to the server 60, the CPU 71 may determine that the GUI that has been set based on the evaluation values acquired from the plurality of digital cameras 10 as described above is the default GUI for the new digital camera 10. By adopting such an embodiment, it is possible to display a GUI that reflects the operational feel of many users in the initial state of the digital camera 10.
[0215] [Variations] The present disclosure has been described above based on the preferred embodiments, but the embodiments to which the present disclosure can be applied are not limited to the above-described embodiments.
[0216] For example, in the above embodiment, the evaluation value acquisition process and the GUI setting process are performed based on a program that performs processing according to a fixed routine, but the evaluation value acquisition process and the GUI setting process method are not limited to the above. For example, the GUI setting process may be performed using a machine learning model. Furthermore, the evaluation value acquisition process and the GUI setting process may both be performed using a machine learning model.
[0217] For example, a machine learning model may be used that inputs multiple evaluation values related to evaluation items such as setting operation time, non-operation time, and number of operation errors, and outputs a GUI such as a setting screen G that matches the user's operational feel according to the combination of the evaluation values. Evaluation values are acquired for one GUI used by the user, and a different GUI is newly set according to the acquired evaluation values. Then, for the newly set GUI, acquisition of evaluation values and setting of the different GUI are repeated. The machine learning model may be trained using evaluation values acquired when the user actually uses the GUI as training data. When a server is used as the GUI setting device, evaluation values from multiple users can be collected, increasing the amount of training data. As a result, the more training data there is, the more the machine learning model progresses. For example, a machine learning model described in Japanese Patent No. 4929449 may be used as the machine learning model.
[0218] The GUI display screen is not limited to the setting screen described above, and may be any screen. For example, the operation items may include items other than aperture, shutter speed, and image sensitivity. The live view and setting screen may be displayed side by side on a single screen, or may be displayed overlapping each other.
[0219] Furthermore, the electronic device in the technology of the present disclosure is not limited to a digital camera, but may be other electronic devices such as a smartphone.
[0220] In addition, the processes executed by CPU 21 and CPU 71 after loading software (programs) in the above embodiments may be executed by various processors other than CPUs. Examples of such processors include programmable logic devices (PLDs) whose circuit configuration can be changed after fabrication, such as field programmable gate arrays (FPGAs), and dedicated electrical circuits, such as application specific integrated circuits (ASICs), which are processors with circuit configurations specifically designed to execute specific processes. Each process may be executed by one of these processors, or by a combination of two or more processors of the same or different types (e.g., multiple FPGAs, or a combination of a CPU and an FPGA). The hardware structure of these processors is, more specifically, an electrical circuit that combines circuit elements such as semiconductor devices.
[0221] In addition, in each of the above embodiments, the GUI setting program is described as being pre-stored (installed) in storage 23 or storage 73, but this is not limiting. The program may be provided in a form recorded on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), or a USB (Universal Serial Bus) memory. The program may also be downloaded from an external device via a network.
[0222] ROM is a broad concept that includes flash memory, which is a rewritable ROM, EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory), and the like.
[0223] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.
[0224] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference. [Explanation of symbols]
[0225] 1 GUI configuration system 10. Digital Camera 11. Housing 11a Front 11b Back 11c Top side 12 Imaging lens 13 Shutter button 14 Settings button 21 CPU 21a GUI presentation processing unit 21b Evaluation value acquisition processing unit 21c Setting processing section 22 Memory 23 Storage 24 Imaging unit 25 Operation input section 26 Touch Panel 27 Communications Department 28 Bus 30 Shutter speed setting button 30a Setting value display area 30b Operation area 31 Aperture setting button 31a Setting value display area 31b Operation area 32 Image sensitivity setting button 32a Setting value display area 32b Operation area 33 Confirm button 34 Back button 35. Shooting mode display icon 36 Battery level icon 40 Shutter speed setting button 40a Setting value display area 40b Up button 40c Down button 41 Aperture setting button 41a Setting value display area 41b Up button 41c Down button 42 Image sensitivity setting button 42a Setting value display area 42b Up button 42c Down button 43 Confirm button 44 Back button 45 Shooting mode display icon 46 Battery level icon 50 Shutter speed setting button 50a display frame 50b Setting value specification section 51 Aperture setting button 51a Display frame 51b Setting value specification section 52 Image sensitivity setting button 52a Display frame 52b Setting value specification section 53 Confirm button 54 Back button 55 Shooting mode display icon 56 Battery level icon 57 Center Line 60 servers 61 Network 71 CPU 72 memory 73 Storage 74 Communications Department 75 Bus G1, G1A, G1B Rotation Swipe Operation Type Setting Screen G2 Tap operation type setting screen G3 Up / down swipe operation type setting screen GD GUI Data FG finger PG GUI setting program R1~R4 detection area
Claims
1. At least one processor and a memory embedded in or connected to the processor; The processor: a GUI presentation process for presenting a GUI for operating the electronic device; an evaluation value acquisition process for acquiring an evaluation value for evaluating the user's operational feel for the presented GUI; a GUI setting process for changing the presented GUI to another GUI based on the evaluation value; and executing a transmission process of transmitting the information of the different GUI to the electronic device as information of the GUI to be presented next time. A GUI setting device, the GUI setting process has at least one mode of a first GUI setting mode and a second GUI setting mode; the first GUI setting mode is a mode in which, when the evaluation value becomes equal to or less than a set threshold, the presented GUI is changed to another GUI; The second GUI setting mode is a mode in which a plurality of types of GUIs for the same operation item are presented, and when the evaluation values of the presented plurality of types of GUIs are acquired in the evaluation value acquisition process, a GUI with a relatively high evaluation value is set. GUI setting device.
2. The evaluation value includes an evaluation value in which the number of user operation errors with respect to the presented GUI is used as an evaluation item. The GUI setting device according to claim 1.
3. A system comprising at least one processor and a memory built into or connected to said processor; The processor: a GUI presentation process for presenting a GUI for operating the electronic device; an evaluation value acquisition process for acquiring an evaluation value for evaluating the user's operational feel for the presented GUI; a GUI setting process for changing the presented GUI to another GUI based on the evaluation value; and executing a transmission process of transmitting the information of the different GUI to the electronic device as information of the GUI to be presented next time. A GUI setting device, the evaluation value includes an evaluation value in which the number of user operation errors with respect to the presented GUI is used as an evaluation item; The processor: In the GUI setting process, when the evaluation value becomes equal to or less than a set threshold value, a first GUI setting mode is executed in which the presented GUI is changed to another GUI; When the number of times of the erroneous operation exceeds a set number and the evaluation value becomes equal to or less than the set threshold value, the presented GUI is replaced with a GUI that matches the content of the erroneous operation by the user. GUI setting device.
4. The processor: In the GUI setting process, it is possible to change at least one of the following components of the GUI: the display form of a graphic element, the operation method of the graphic element, the operation sensitivity of the graphic element, the order of screen transitions, and the time of screen transitions. The GUI setting device according to any one of claims 1 to 3.
5. The processor: A series of processes including a GUI presentation process for presenting the GUI, the evaluation value acquisition process, and the GUI setting process are executed at set timings. The GUI setting device according to any one of claims 1 to 4.
6. The series of processes is repeatedly executed at set timings. The GUI setting device according to claim 5 .
7. The processor: In the GUI setting process, a GUI generation process is executed to generate a new GUI different from a preset GUI, and the generated GUI can be set. The GUI setting device according to any one of claims 1 to 6.
8. a GUI data acquisition unit that acquires GUI data necessary to generate the new GUI; The processor: Execute the GUI generation process based on the GUI data. The GUI setting device according to claim 7.
9. The processor: In the GUI generation process, for each of the GUI components that can be changed, a deviation amount indicating the degree to which the changed state deviates from a set standard state is calculated. and generating the new GUI so that the total deviation falls within a predetermined range.
9. The GUI setting device according to claim 7 or 8.
10. A system comprising at least one processor and a memory built into or connected to said processor, The processor: a GUI presentation process for presenting a GUI for operating the electronic device; an evaluation value acquisition process for acquiring an evaluation value for evaluating the user's operational feel for the presented GUI; a GUI setting process for changing the presented GUI to another GUI based on the evaluation value; and executing a transmission process of transmitting the information of the different GUI to the electronic device as information of the GUI to be presented next time. A GUI setting device, The processor: In the GUI setting process, a GUI generation process is executed to generate a new GUI different from a preset GUI, and the generated GUI can be set; In the GUI generation process, when GUIs for a plurality of operation items are arranged on one screen, the GUI for the most frequently used operation item is arranged closest to the center of the screen. GUI setting device.
11. A system comprising at least one processor and a memory built into or connected to said processor, The processor: a GUI presentation process for presenting a GUI for operating the electronic device; an evaluation value acquisition process for acquiring an evaluation value for evaluating the user's operational feel for the presented GUI; a GUI setting process for changing the presented GUI to another GUI based on the evaluation value; and executing a transmission process of transmitting the information of the different GUI to the electronic device as information of the GUI to be presented next time. A GUI setting device, the GUI is a GUI used in an imaging device, The operation items are operation items for setting operations related to imaging. GUI setting device.
12. the evaluation value is an evaluation value using at least one of a setting operation time, a non-operation time, and a number of operation errors as an evaluation item; the setting operation time is the total elapsed time from the start to the end of the setting operation or from the start of the setting operation to the shutter button operation, the no-operation time is a non-contact time during which the user does not touch the GUI, within the setting operation time; The number of erroneous operations is the number of erroneous operations performed within the set operation time. The GUI setting device according to claim 11.
13. The operation items include at least one of aperture, shutter speed, and imaging sensitivity.
13. The GUI setting device according to claim 11 or 12.
14. a communication unit that communicates with the electronic device, The processor: In the evaluation value acquisition process, the evaluation value is acquired from the electronic device via the communication unit; In the GUI setting process, a GUI of the electronic device is set based on the evaluation value. The GUI setting device according to any one of claims 1 to 13.
15. The processor: In the evaluation value acquisition process, a plurality of evaluation values for the GUI of the same operation item are acquired from each of the plurality of electronic devices; In the GUI setting process, the GUI of the electronic device selected as the setting target is set based on the plurality of evaluation values. The GUI setting device according to claim 14.
16. The processor: The GUI for initial setting of the electronic device is determined based on the plurality of evaluation values. The GUI setting device according to claim 15.
17. The GUI information is information about the display format of graphic elements of an electronic device owned by a user or information about a method of operating the graphic elements. The GUI setting device according to any one of claims 1 to 16.
18. The GUI information is information about at least one display mode of the GUI, including an operation sensitivity of a graphic element, an order of screen transitions, and a time period for screen transitions. The GUI setting device according to any one of claims 1 to 17.
19. The processor determines whether the setting operation is the first one after the power supply of the electronic device is turned on, and if it is determined that the setting operation is not the first one after the power supply of the electronic device is turned on, the GUI presentation process presents a GUI for operating the electronic device based on information of the different GUI changed by the GUI setting process. The GUI setting device according to any one of claims 1 to 18.
20. The GUI presentation process displays a setting screen on the electronic device based on the changed information of the different GUI. The GUI setting device according to claim 19.
21. a GUI presentation process for presenting a GUI for operating the electronic device; an evaluation value acquisition process for acquiring an evaluation value for evaluating the user's operational feel for the presented GUI; a GUI setting process for changing the presented GUI to another GUI based on the evaluation value; a transmission process of transmitting the information of the different GUI to the electronic device as information of the GUI to be presented next time; A GUI setting method, comprising: the GUI setting process has at least one mode of a first GUI setting mode and a second GUI setting mode; the first GUI setting mode is a mode in which, when the evaluation value becomes equal to or less than a set threshold, the presented GUI is changed to another GUI; The second GUI setting mode is a mode in which a plurality of types of GUIs for the same operation item are presented, and when the evaluation values of the presented plurality of types of GUIs are acquired in the evaluation value acquisition process, a GUI with a relatively high evaluation value is set. GUI setting method.
22. a GUI presentation process for presenting a GUI for operating the electronic device; an evaluation value acquisition process for acquiring an evaluation value for evaluating the user's operational feel for the presented GUI; a GUI setting process for changing the presented GUI to another GUI based on the evaluation value; and a transmission process of transmitting the information of the different GUI to the electronic device as information of the GUI to be presented next time. A GUI setting program, the GUI setting process has at least one mode of a first GUI setting mode and a second GUI setting mode; the first GUI setting mode is a mode in which, when the evaluation value becomes equal to or less than a set threshold, the presented GUI is changed to another GUI; The second GUI setting mode is a mode in which a plurality of types of GUIs for the same operation item are presented, and when the evaluation values of the presented plurality of types of GUIs are acquired in the evaluation value acquisition process, a GUI with a relatively high evaluation value is set. GUI configuration program.
Citation Information
Patent Citations
Display control method for input device and input device
JP2004341813A
Portable terminal device, touch operation control method, and program
JP2013182463A
Transaction processing device and transaction processing method
JP2014137723A
Information processing apparatus, portable terminal and control method of information screen
JP2016134694A
Program for predicting object to be touched, on the basis of operation history, electronic device, system, and control method
JP2017033451A