Electronic devices and their programs

Abstract

To enable a user to habitually engage in moderate exercise while being authenticated.SOLUTION: A program disclosed herein causes a computer of an electronic device requiring user authentication to function as detection means, counting means, and authentication means. The detection means detects postures of an exercising user. The counting means counts the number iteration of a predetermined motion from the postures of the user. The authentication means authenticates the user once the number of iteration of the predetermined motion reaches the predetermined number of times of two or more.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] An embodiment of the present invention relates to a program for performing user authentication and an electronic device for performing user authentication in accordance with the program. [Background technology]

[0002] Some electronic devices require user authentication to use their functions. There are three commonly known methods for user authentication. The first method involves entering information known only to the user, such as a password or a PIN (Personal Identification Number) code. The second method involves using a tool such as an ID card or a token that generates a one-time password. The third method involves using biometric information such as the user's fingerprint, iris, face, or veins. However, none of these methods impose a physical burden on the user.

[0003] On the other hand, in recent years, the proportion of desk work in the workplace has been increasing. As a result, an increasing number of people are complaining of health problems such as back pain, neck pain, and eye strain caused by working in the same position for long periods of time. These health problems are caused by: habit From this perspective, if users are authenticated through exercise, it is expected that health hazards such as back pain, neck pain, and eye strain will be reduced because users will become accustomed to exercising when they are authenticated. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2022-163168 Summary of the Invention [Problem to be solved by the invention]

[0005] The problem to be solved by the embodiments of the present invention is to provide an electronic device and a program therefor that enable a user to habitually perform moderate exercise during user authentication. [Means for solving the problem]

[0006] In one embodiment, the program causes a computer of an electronic device requiring user authentication to function as a detection means, a counting means, and an authentication means. The detection means detects the posture of a user performing an exercise. The counting means counts the number of times a predetermined movement is repeated based on the user's posture. The authentication means authenticates the user when the number of times the predetermined movement is repeated reaches a predetermined number of times that is two or more. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a schematic diagram showing the appearance of a smartphone according to the first embodiment. [Figure 2] FIG. 2 is a block diagram showing the main hardware configuration of a smartphone. [Figure 3] FIG. 3 is a configuration diagram of an event-specific determination model according to the first embodiment. [Figure 4] FIG. 4 is a configuration diagram of a setting table according to the first embodiment. [Figure 5] FIG. 5 is a flowchart showing the procedure of information processing when the processor of the smartphone operates in the setting mode of the user authentication APL. [Figure 6] FIG. 6 is a flowchart showing the procedure of information processing when the processor of the smartphone operates in the authentication mode of the user authentication APL. [Figure 7] FIG. 7 is a schematic diagram showing an example of a display of the setting screen. [Figure 8] FIG. 8 is a schematic diagram showing an example of a display of the confirmation screen. [Figure 9] FIG. 9 is a schematic diagram showing the appearance of a multifunction peripheral according to the second embodiment. [Figure 10]FIG. 10 is a block diagram showing the main hardware configuration of the multifunction peripheral. [Figure 11] FIG. 11 is a diagram showing the configuration of a user-specific setting table according to the second embodiment. [Figure 12] FIG. 12 is a flowchart showing the main steps of information processing when the processor of the multifunction peripheral operates in the setting mode of the user authentication APL. [Figure 13] FIG. 13 is a flowchart showing the main steps of information processing when the processor of the multifunction peripheral operates in the authentication mode of the user authentication APL. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, an embodiment of an electronic device and a program therefor that enable a user to habitually perform moderate exercise during user authentication will be described with reference to the drawings.

[0009] [First embodiment] The first embodiment uses a smartphone as an example of an electronic device that requires user authentication to use a function. A variety of application software can be installed on a smartphone. Therefore, in this embodiment, a folder is provided on the smartphone that is not unlocked unless the user is authenticated. When the user is authenticated by exercising in front of the smartphone, the folder is unlocked and the application software becomes available. Thus, user authentication allows the user to habitually engage in moderate exercise.

[0010] FIG. 1 is a schematic diagram showing the appearance of a smartphone 10, and FIG. 2 is a block diagram showing the main hardware configuration of the smartphone 10. As shown in FIG. 1, the smartphone 10 has a touch panel 102 on the front of a main body 101. The touch panel 102 is a user interface that combines a display device and an input device. A user of the smartphone 10 operates the touch panel 102 to input various pieces of information and obtain various pieces of information from the screen of the touch panel 102.

[0011] The smartphone 10 also has a camera 103, a microphone 104, a speaker 105, and the like mounted on the main body 101. The camera 103 is an image capturing device, and for example, a CCD camera is used. The camera 103 captures still images or videos using the front or rear side of the main body 101 as its capturing area. The microphone 104 is a sound or audio input device, and a general-purpose sound-collecting microphone is used. The speaker 105 is a sound or audio output device, and a general-purpose loudspeaker is used.

[0012] As shown in FIG. 2 , the smartphone 10 includes a processor 11, an internal storage 12, an external storage 13, a mobile communication unit 14, and a short-range communication unit 15. The smartphone 10 connects the processor 11 to the internal storage 12, the external storage 13, the mobile communication unit 14, and the short-range communication unit 15 via a system transmission path 16. The system transmission path 16 includes an address bus, a data bus, a control signal line, and the like. The smartphone 10 configures a computer by connecting the processor 11 to the internal storage 12, the external storage 13, the mobile communication unit 14, and the short-range communication unit 15 via the system transmission path 16. The smartphone 10 connects a touch panel 102, a camera 103, a microphone 104, and a speaker 105 to the computer via the system transmission path 16. It goes without saying that the devices mounted on the smartphone 10 are not limited to the touch panel 102, the camera 103, the microphone 104, and the speaker 105.

[0013] The processor 11 corresponds to the central part of the computer. The processor 11 controls each part to realize various functions of the smartphone 10 in accordance with an operating system or application software. The processor 11 is, for example, a CPU (Central Processing Unit).

[0014] The internal storage 12 corresponds to the main memory of the computer. The internal storage 12 includes a nonvolatile memory area and a volatile memory area. The internal storage 12 stores an operating system or application software in the nonvolatile memory area. The internal storage 12 may store data required for the processor 11 to execute processes for controlling each part in either the nonvolatile or volatile memory area. The internal storage 12 uses the volatile memory area as a work area where data is rewritten by the processor 11 as appropriate. The nonvolatile memory area is, for example, ROM (Read Only Memory). The volatile memory area is, for example, RAM (Random Access Memory).

[0015] The external storage 13 corresponds to the auxiliary storage portion of the computer. For example, the external storage 13 can be a memory card such as an SD card, or a USB memory. The external storage 13 stores data used by the processor 11 when performing various processes, data created by the processes in the processor 11, etc. The external storage 13 may also store the application software described above.

[0016] The mobile communication unit 14 is an interface for performing data communication with an external device via a mobile communication network, and connects to the mobile communication network using a wireless communication standard such as Wi-Fi (registered trademark).

[0017] The short-range communication unit 15 is an interface for performing data communication with a wireless communication medium by short-range wireless communication. The short-range communication unit 15 performs data communication with the wireless communication medium using a wireless communication standard such as NFC (Near Field Communication) or Bluetooth (registered trademark).

[0018] In this embodiment, the user authentication APL 131 is installed in the smartphone 10 configured as described above. The user authentication APL 131 is application software for user authentication. The user authentication APL 131 may be installed in the internal storage 12 or the external storage 13. FIG. 2 shows the case where the user authentication APL 131 is installed in the external storage 13. The method for installing the user authentication APL 131 in the smartphone 10 is not particularly limited. The user authentication APL 131 can be installed in the internal storage 12 or the external storage 13 of the smartphone 10 by recording the user authentication APL 131 on a removable recording medium or by delivering the user authentication APL 131 via communication via a mobile communication network. The recording medium may be in any form, such as a CD-ROM or a memory card, as long as it can store a program and is readable by the device.

[0019] The user authentication APL 131 is application software that detects the posture of a user who is exercising from an image captured by the camera 103, counts the number of times a predetermined movement is repeated from the user's posture, and authenticates the user of the smartphone 10 if the count reaches a predetermined number of times that is equal to or greater than two. When the user is authenticated by the user authentication APL 131, a folder is unlocked in the smartphone 10, and the application software stored in the folder becomes available for use.

[0020] To realize such a function, when a user authentication APL 131 is installed on the smartphone 10, memory areas for an event-specific judgment model 132, a setting table 133, and a lock folder 134 are formed in the internal storage 12 or the external storage 13.

[0021] As shown in FIG. 3 , the event-specific determination model 132 is an area that describes the event name and determination model for each event code C that identifies the event of exercise used for user authentication. In this embodiment, the event types are "push-ups," "squats," and "sit-ups." The determination model is a machine learning algorithm that inputs a video of the user captured by the camera 103, detects parts of the user's body, such as the head, shoulders, elbows, wrists, waist, knees, and ankles, from the video, and recognizes the user's exercise from the movement of each part. This technology is well known through posture estimation techniques such as OpenPose, so a detailed description thereof will be omitted here.

[0022] As shown in FIG. 4, the setting table 133 is an area for setting an exercise code C and the number of times N of exercises in association with a table number X. The area for the exercise code C of table number 1 is set to either the exercise code "01" for the exercise "push-ups," the exercise code "02" for the exercise "squats," or the exercise code "03" for the exercise "sit-ups." The area for the exercise code C of table number 2 and onward can be set to the exercise codes "01," "02," "03," or "Null," indicating that no exercise code is set. On the other hand, an integer equal to or greater than "2" is set for the number of times N of exercises for table number X to which the above-mentioned exercise codes "01," "02," or "03" are set. For table number X to which "Null" is set as the exercise code C, the number of times N of exercises is set to "0."

[0023] The lock folder 134 is a folder that is unlocked when the user is authenticated by the user authentication APL 131. By installing the user authentication APL 131 on the smartphone 10, an icon p of the user authentication APL 131 and an icon q of the lock folder 134 are displayed on the screen of the touch panel 102, as shown in FIG. 1 . For example, the user can store the icon of any application software other than the user authentication APL 131 in the lock folder 134 by dragging and dropping the icon of the application software into the lock folder 134.

[0024] Furthermore, the user can touch the icon p to activate the user authentication APL 131. When the user authentication APL 131 is activated, the processor 11 realizes the functions of a setting means 111, a detecting means 112, a counting means 113, and an authenticating means 114, as shown in FIG.

[0025] The setting means 111 is a function that sets an arbitrary exercise code C and number of exercises N in the setting table 133 in the order of table number No. X. The detection means 112 is a function that uses the exercise-specific determination model 132 to detect the posture of the user exercising in front of the smartphone 10. The counting means 113 is a function that counts the number of times a predetermined movement is repeated from the user's posture. The authentication means 114 is a function that authenticates the user on the condition that the number of times the predetermined movement is performed reaches a predetermined number of times that is two or more.

[0026] The setting means 111 is a function that is realized when the processor 11 operates in the setting mode of the user authentication APL 131. The detection means 112, the counting means 113, and the authentication means 114 are functions that are realized when the processor 11 operates in the authentication mode of the user authentication APL 131. Next, the main operations of the processor 11 will be described with reference to Figures 5 to 8.

[0027] FIG. 5 is a flowchart showing the procedure of information processing when the processor 11 operates in the setting mode of the user authentication APL 131. FIG. 6 is a flowchart showing the procedure of information processing when the processor 11 operates in the authentication mode of the user authentication APL 131. FIG. 7 is a schematic diagram showing a setting screen SCa displayed on the touch panel 102. FIG. 8 is a schematic diagram showing a confirmation screen SCb displayed on the touch panel 102. Note that the information processing procedure shown in each flowchart is an example. The procedure can be changed as appropriate as long as the same effect can be achieved. Furthermore, the setting screen SCa and the confirmation screen SCb are also examples. The screen layout, displayed text, etc. can be changed as appropriate as long as the same information can be provided to the user.

[0028] When the user of the smartphone 10 touches the icon p displayed on the touch panel 102 to activate the user authentication APL 131, a menu screen of the user authentication APL 131 is displayed on the touch panel 102. When the user selects a setting mode from the menu screen, the processor 11 starts information processing according to the procedure shown in the flowchart of FIG.

[0029] Processor 11 initializes setting table 133 in ACT1. This initialization clears the event code C and the number of exercises N that have been written in association with each table number X in setting table 133. As a result, the event code C becomes "Null" and the number of exercises N becomes "0."

[0030] After initializing the setting table 133, the processor 11 proceeds to ACT2. In ACT2, the processor 11 sets the screen of the touch panel 102 to the setting screen SCa. As shown in Fig. 7, the setting screen SCa has a pull-down box INa for selecting the type of exercise and an input box INb for inputting the number of times N of exercise. The setting screen SCa also has the following software keys: an execute button BTa, a cancel button BTb, and a setting end button BTc.

[0031] After checking the setting screen SCa, the user selects one of the exercises displayed in the pull-down box INa: "push-ups," "squats," or "sit-ups." Then, by touching the input box INb, a numeric keypad is displayed, allowing the user to enter a number of repetitions of "2" or greater.

[0032] For example, if the user is to be authenticated by performing five "push-ups," the user selects the event "push-ups" in the pull-down box INa and inputs the number of push-ups "5" in the input box INb. After that, the user presses the execute button BTa, and then presses the end setting button BTc.

[0033] For example, if the user is to be authenticated by performing five "push-ups" and five "squats," the user first selects the exercise type "push-ups" in the pull-down box INa and inputs the number of times "5" in the input box INb. Next, the user selects the exercise type "squats" in the pull-down box INa and inputs the number of times "5" in the input box INb. After that, the user presses the execute button BTa, and then presses the end setting button BTc. This is also the case when there are three exercise types. If the user wants to redo the selection of the exercise type or input of the number of times, the user can press the cancel button BTb before pressing the end setting button BTc.

[0034] Returning to the explanation of Figure 5. After displaying the setting screen SCa, the processor 11 resets the number counter X to "0" in ACT 3. Then, the processor 11 waits for an exercise type to be selected in ACT 4. In this standby state, the processor 11 checks whether the setting end button BTc has been pressed in ACT 5. If the setting end button BTc has been pressed, the processor 11 proceeds from ACT 5 to ACT 16. The processing from ACT 16 onwards will be described later.

[0035] If any one of the exercise events is selected in the pull-down box INa without pressing the setting end button BTc, the processor 11 proceeds from ACT4 to ACT6. The processor 11 acquires the exercise event code C of the exercise event selected in the pull-down box INa in ACT6. For example, if the exercise event "push-ups" is selected, the processor 11 acquires "01" as the exercise event code C. For example, if the exercise event "squats" is selected, the processor 11 acquires "02" as the exercise event code C. For example, if the exercise event "sit-ups" is selected, the processor 11 acquires "03" as the exercise event code C.

[0036] Having selected event code C, processor 11 proceeds to ACT7. Processor 11 waits for the number of times to be entered into input box INb as ACT7. The number of times is an integer equal to or greater than 2. When the number of times is entered into input box INb, processor 11 proceeds from ACT7 to ACT8. Processor 11 acquires the number of times entered into input box INb as ACT8 as the number of exercises N.

[0037] After acquiring the number of exercises N, processor 11 proceeds from ACT8 to ACT9. Processor 11 checks whether the execute button BTa has been pressed in ACT9. If the execute button BTa has not been pressed, processor 11 proceeds to ACT10. Processor 11 checks whether the cancel button BTb has been pressed in ACT10. If the cancel button BTb has not been pressed, processor 11 returns to ACT9. In this way, processor 11 waits for the execute button BTa or the cancel button BTb to be pressed in ACT9 and ACT10.

[0038] If the cancel button BTb is pressed during the standby state of ACT9 and ACT10, the processor 11 proceeds from ACT10 to ACT11. The processor 11 clears the acquired event code C and number of exercises N in ACT11. The processor 11 also resets the number counter X to "0" in ACT12. The processor 11 then returns to ACT4. The processor 11 then executes the processing from ACT4 onwards in the same manner as described above.

[0039] If the execute button BTa is pressed during the standby state of ACT 9 and ACT 10, the processor 11 proceeds from ACT 9 to ACT 13. In ACT 13, the processor 11 counts up the number counter X by "1". Then, the processor 11 associates the acquired event code C and the number of exercises N with the table number No. X in the setting table 133, and sets them.

[0040] Thereafter, in ACT 15, processor 11 checks whether number counter X has reached the maximum value Xmax of table number No. X. For example, as shown in FIG. 4, if the maximum value Xmax of table number No. X is "3," processor 11 checks whether number counter X has reached "3." If number counter X has not reached the maximum value Xmax of table number No. X, processor 11 returns to ACT 4. Then, processor 11 executes the processing from ACT 4 onward in the same manner as described above.

[0041] On the other hand, when the number counter X reaches the maximum value Xmax of the table number No. X, the processor 11 proceeds from ACT 15 to ACT 16. In this way, when the setting end button BTc is pressed while waiting for the selection of an event, or when the number counter X reaches the maximum value Xmax of the table number No. X, the processor 11 proceeds to ACT 16. That is, when the event code C and the number of exercises N are set in the table number No. 1 or the table numbers No. 1 and No. 2, and the setting end button BTc is pressed, or when the event code C and the number of exercises N are set in the table numbers No. 1, No. 2, and No. 3, respectively, the processor 11 proceeds to ACT 16.

[0042] The processor 11 displays the confirmation screen SCb on the touch panel 102 as ACT 16. As shown in Fig. 8, the confirmation screen SCb displays a correspondence table Li between the event name and the number of exercises N of the event code C set in the setting table 133. The confirmation screen SCb also has software keys for a registration button BTd and a cancel button BTe.

[0043] 8 shows the confirmation screen SCb when the user has set the first exercise to be "push-ups," the second to be "squats," and the third to be "sit-ups" so that the user will be authenticated by performing 10 of each of these exercises. If there are no problems with these settings, the user presses the register button BTd. If the user wants to change the settings, the user presses the cancel button BTe.

[0044] Returning to the explanation of Figure 5. After displaying the confirmation screen SCb, the processor 11 waits in ACT 17 for the registration button BTd to be pressed or the cancel button BTe to be pressed. If the registration button BTd is pressed in this standby state, the processor 11 proceeds from ACT 17 to ACT 18. In ACT 18, the processor 11 saves the setting table 133 in the external storage 13. With this, the processor 11 ends the information processing when the setting mode is selected.

[0045] On the other hand, if the cancel button BTe is pressed, the processor 11 skips the processing of ACT 18. That is, the processor 11 does not save the setting table 133. With this, the processor 11 ends the information processing when the setting mode is selected. Here, the processor 11 realizes the function of the setting means 111 by the processing of ACT1 to ACT18.

[0046] When a user of the smartphone 10 in which the setting table 133 is saved selects an authentication mode from the menu screen of the user authentication APL 131, the processor 11 starts information processing of the procedure shown in the flowchart of Fig. 6. The processor 11 resets the number counter X to "0" in ACT21. Next, the processor 11 activates the camera 103 in ACT22. The activated camera 103 captures an image of the front or back side of the smartphone 10.

[0047] After activating the camera 103, the processor 11 proceeds to ACT 23. In ACT 23, the processor 11 counts up the number counter X by "1". Then, in ACT 24, the processor 11 obtains the event code C and the number of exercises N of the table number No. X from the setting table 133.

[0048] In ACT25, the processor 11 checks whether the event code C is "Null." When the number counter X is "1," that is, when the event code C of table number No. 1 is not "Null," the processor 11 proceeds from ACT25 to ACT26. In ACT26, the processor 11 activates the determination model associated with the event code C. For example, if the event code C is "01," the processor 11 activates the determination model MODa for the event "push-ups." If the event code C is "02," the processor 11 activates the determination model MODb for the event "squats." If the event code C is "03," the processor 11 activates the determination model MODc for the event "sit-ups."

[0049] After activating any of the judgment models, the processor 11 proceeds to ACT 27. In ACT 27, the processor 11 resets the number counter n to "0." Next, in ACT 28, the processor 11 captures an image captured by the camera 103. The processor 11 then inputs the captured image into the judgment model to obtain a judgment result.

[0050] For example, the determination model MODa determines whether or not a user has performed push-ups based on the movements of the user's parts, such as the head, shoulders, elbows, wrists, hips, knees, and ankles, that are captured in the captured image. If the push-up movement is recognized, the determination model MODa returns a recognition success to the processor 11. If the push-up movement cannot be recognized, the determination model MODa returns a recognition failure to the processor 11.

[0051] For example, the determination model MODb determines whether or not the user has performed a squat based on the movements of the user's parts, such as the head, shoulders, elbows, wrists, hips, knees, and ankles, that are captured in the captured image. If the squat movement is recognized, the determination model MODb returns a recognition success to the processor 11. If the squat movement cannot be recognized, the determination model MODb returns a recognition failure to the processor 11.

[0052] For example, the determination model MODc determines whether or not the user has performed sit-ups based on the movements of the user's parts, such as the head, shoulders, elbows, wrists, waist, knees, and ankles, that are captured in the captured image. If the movement of the sit-ups is recognized, the determination model MODc returns a recognition success to the processor 11. If the movement of the sit-ups cannot be recognized, the determination model MODc returns a recognition failure to the processor 11.

[0053] After inputting the image captured by camera 103 into the determination model, processor 11 proceeds to ACT 29. In ACT 29, processor 11 checks whether or not there is a response from the determination model indicating successful recognition. If there is no response indicating successful recognition, processor 11 checks whether or not there is a response indicating unsuccessful recognition from the determination model in ACT 30. If there is also no response indicating unsuccessful recognition, processor 11 returns to ACT 28. In this way, processor 11 captures images captured by camera 103 and inputs the captured images into the determination model until there is a response indicating successful recognition or unsuccessful recognition from the determination model. Processor 11 then waits for the determination result of the determination model.

[0054] If there is a response from the judgment model that the recognition was successful, the processor 11 proceeds from ACT 29 to ACT 31. In ACT 31, the processor 11 counts up the number of times counter n by "1". Then, in ACT 32, the processor 11 checks whether the number of times counter n has reached the number of exercises N of table number No. X.

[0055] If the number of times counter n has not reached the number of times of exercise N, the processor 11 returns from ACT 32 to ACT 28. The processor 11 executes the processes from ACT 28 onwards in the same manner as described above.

[0056] Therefore, for example, if the event code C for table number No. 1 is set to "01" and the number of exercises N is set to "10", the processor 11 will repeat the processing of ACT28 to ACT32 until the judgment model MODa recognizes the push-up movement 10 times in a row in the image captured by camera 103.

[0057] When the number counter n reaches the number of exercises N, processor 11 proceeds from ACT 32 to ACT 33. In ACT 33, processor 11 checks whether number counter X has reached the maximum value Xmax of table number No. X. If number counter X has not reached the maximum value Xmax of table number No. X, processor 11 returns from ACT 33 to ACT 23. In ACT 23, processor 11 counts up number counter X by another "1." Therefore, number counter X becomes an integer equal to or greater than "2." When number counter X is equal to or greater than "2," that is, when event code C of table number No. 2 or table number No. 3 is "Null," processor 11 proceeds from ACT 25 to ACT 34. The processing of ACT 34 will be described later.

[0058] On the other hand, if the event code C of table number No. X is not "Null," processor 11 executes the processing from ACT26 onwards in the same manner as described above. Therefore, for example, if "02" is set as the event code C for table number No. 2 and "10" is set as the number of exercises N, the determination model MODb for the event "squat" becomes valid. Then, processor 11 repeats the processing of ACT28 through ACT32 until this determination model MODb recognizes the squat movement 10 times in a row in the images captured by camera 103.

[0059] When the squat movement is recognized 10 times in a row, processor 11 proceeds from ACT 32 to ACT 33. In ACT 33, processor 11 checks whether number counter X has reached the maximum value Xmax of table number No. X. If number counter X has not reached the maximum value Xmax of table number No. X, processor 11 returns from ACT 33 to ACT 23. Processor 11 executes the processes from ACT 23 onwards in the same manner as described above.

[0060] For example, if "03" is set as the event code C for table number No. 3 and "10" is set as the number of exercises N, the determination model MODc for the event "abdominal muscles" becomes valid. Then, the processor 11 repeats the processes of ACT28 to ACT32 until this determination model MODc recognizes the movement of abdominal muscles 10 times consecutively in the images captured by the camera 103.

[0061] When abdominal muscle movements are recognized 10 times in a row, the processor 11 proceeds from ACT 32 to ACT 33. In ACT 33, the processor 11 checks whether the number counter X has reached the maximum value Xmax of the table number No. X. Thus, when the number counter X has reached the maximum value Xmax of the table number No. X, the processor 11 proceeds from ACT 33 to ACT 34.

[0062] In this way, when processor 11 detects that the event code C of table number No. X is "Null" or when number counter X reaches the maximum value Xmax of table number No. X, processor 11 proceeds to ACT 34. In ACT 34, processor 11 recognizes that the user has been authenticated.

[0063] That is, for example, if an event code C and an exercise count N are set only for table number No. 1, processor 11 will recognize that the user has been authenticated if the user repeats the exercise of the event identified by the event code C N times within the shooting area of ​​camera 103. For example, if an event code C and an exercise count N for the first event are set for table number No. 1 and an event code C and an exercise count N for the second event are set for table number No. 2, processor 11 will recognize that the user has been authenticated if the user first repeats the exercise of the event identified by the first event code C N times within the shooting area of ​​camera 103, and then repeats the exercise of the event identified by the second event code C N times. The same is true if event codes C and an exercise count N for three events are set for table numbers No. 1 to No. 3.

[0064] Thus, once the user is authenticated, the processor 11 unlocks the lock folder 134. As a result, the user can use the application software stored in the lock folder 134.

[0065] If the determination model returns a response indicating a recognition failure, the processor 11 proceeds from ACT 30 to ACT 35. The processor 11 recognizes in ACT 35 that the user has been denied. If the user has been denied, the lock on the lock folder 134 is not released. Therefore, the user cannot use the application software stored in the lock folder 134.

[0066] With this, processor 11 ends the information processing when the authentication mode is selected. Here, the processor 11 realizes the function of detection means 112 by processing ACT26 to ACT30. The processor 11 realizes the function of counting means 113 by processing ACT31. The processor 11 realizes the function of authentication means 114 by processing ACT25 and ACT32 to ACT34.

[0067] As is clear from the above explanation, the user of the smartphone 10 must repeat the set exercise a predetermined number of times before using application software in the locked folder 134 that requires user authentication. Therefore, the user will be able to habitually perform moderate exercise during user authentication, which is expected to reduce health hazards such as lower back pain, neck pain, and eye strain.

[0068] Furthermore, the user can freely set the number of exercises and the number of repetitions of each exercise, so that the user can habitually perform exercises that provide the optimal physical load for the user.

[0069] [Second embodiment] The second embodiment illustrates a multifunction peripheral (MFP) as an example of an electronic device that requires user authentication to use its functions. Generally, multifunction peripherals are installed in a workspace and shared by multiple users. For this reason, some models allow each user to own an ID card and use functions such as printer, fax, and copy by having the multifunction peripheral read the ID card. In the second embodiment, if a user who has had their ID card read by the multifunction peripheral is authenticated by exercising in front of the multifunction peripheral, the functions of the multifunction peripheral can be used. In this way, the user is encouraged to habitually engage in moderate exercise during user authentication.

[0070] Fig. 9 is a schematic diagram showing the appearance of the multifunction device 20, and Fig. 10 is a block diagram showing the main hardware configuration of the multifunction device 20. As shown in Fig. 9, the multifunction device 20 has a scanner 201, a printer 202, and an operation panel 203.

[0071] The scanner 201 is installed on top of the main body of the multifunction device 20. The scanner 201 is a device that optically reads an image of an original. The scanner 201 has a platen glass on which the original to be scanned is placed. The scanner 201 scans the original placed on the platen glass. The scanner 201 has a carriage, a photoelectric conversion unit, etc. The carriage, photoelectric conversion unit, etc. are installed below the platen glass. The scanner 201 reads the image of the entire original by acquiring image data in the main scanning direction with the photoelectric conversion unit while moving the carriage in the sub-scanning direction.

[0072] An automatic document feeder (ADF) 204 is provided above the scanner 201. The ADF 204 is installed so as to be freely opened and closed. The ADF 204 also functions as a document table cover for the scanner 201. When closed, the ADF 204 covers the entire document reading area on the document table glass. The ADF 204 also has a paper feed tray, a transport system, and the like. When closed, the ADF 204 takes out documents set in the paper feed tray one by one and transports the documents so that the reading surface of the taken-out document passes a predetermined reading position. When the ADF 204 transports a document, the scanner 201 reads the document surface as the document transported to the ADF 204 passes the predetermined reading position, thereby reading the image of the entire document.

[0073] The printer 202 has a paper feed cassette, a transport system, and an image forming mechanism. The paper feed cassette stores paper as an image forming medium on which an image is printed. For example, the paper feed cassette can be detachably attached to the bottom of the multifunction device main body. Paper stored in the paper feed cassette is taken out one sheet at a time by a paper feed roller. The transport system transports the paper taken out of the paper feed cassette by the paper feed roller to an image forming position or an image transfer position.

[0074] The image forming mechanism of the printer 202 is a mechanism that forms an image. The image forming mechanism can be of various image forming types. For example, the image forming mechanism may be of an electrophotographic type, an inkjet type, or a thermal transfer type. The image forming mechanism may also be one that forms a color image or one that forms a monochrome image. The image forming mechanism forms an image on paper supplied by a conveying system. The image forming mechanism may also be one that transfers an image formed on an intermediate transfer body to paper supplied by the conveying system at an image transfer position.

[0075] The operation panel 203 is a user interface. The operation panel 203 has a touch panel 205 and operation buttons 206. The touch panel 205 displays operation guides, preset content, and the like. The touch panel 205 also displays icons and the like as operation buttons. The touch panel 205 detects a location on the display screen touched by the user. The operation buttons 206 include a numeric keypad and operation buttons for instructing specific operations. The user inputs operation instructions using the operation buttons 206 or touch panel 205 of the operation panel 203.

[0076] The multifunction device 20 has a reader 207 attached to the operation panel 203. The reader 207 is a device that reads data from a contactless IC card. The contactless IC card is an ID card owned by each user who works in the workspace where the multifunction device 20 is installed. A unique user ID set for each user is recorded on the ID card to identify the user who owns the ID card.

[0077] The multifunction device 20 is equipped with a camera 208. The camera 208 is an image capturing device, and is, for example, a CCD camera. The camera 208 captures still images or videos from the front side of the multifunction device body, i.e., the side where the operation panel 203 is provided, as its capture area.

[0078] As shown in FIG. 10 , the multifunction peripheral 20 includes a processor 21, a main memory 22, an auxiliary storage device 23, and a communication interface 24. The multifunction peripheral 20 connects the processor 21 to the main memory 22, the auxiliary storage device 23, and the communication interface 24 via a system transmission path 25. The system transmission path 25 includes an address bus, a data bus, control signal lines, etc. The multifunction peripheral 20 configures a computer by connecting the processor 21 to the main memory 22, the auxiliary storage device 23, and the communication interface 24 via the system transmission path 25. The multifunction peripheral 20 connects a scanner 201, a printer 202, an operation panel 203, a reader 207, and a camera 208 to the computer via the system transmission path 25. It goes without saying that the devices mounted on the multifunction peripheral 20 are not limited to the scanner 201, the printer 202, the operation panel 203, the reader 207, and the camera 208.

[0079] The processor 21 corresponds to the central part of the computer. The processor 21 controls each part to realize various functions of the multifunction peripheral 20 in accordance with an operating system or application software. The processor 21 is, for example, a CPU.

[0080] The main memory 22 corresponds to the main storage portion of the computer. The main memory 22 includes a nonvolatile memory area and a volatile memory area. The main memory 22 stores an operating system or application software in the nonvolatile memory area. The main memory 22 may store data required for the processor 21 to execute processes for controlling each part in either the nonvolatile or volatile memory area. The main memory 22 uses the volatile memory area as a work area where data is rewritten by the processor 21 as appropriate. The nonvolatile memory area is, for example, ROM. The volatile memory area is, for example, RAM.

[0081] The auxiliary storage device 23 corresponds to the auxiliary storage portion of the computer. For example, an EEPROM (Electric Erasable Programmable Read-Only Memory), an HDD (Hard Disk Drive), or an SSD (Solid State Drive) can be the auxiliary storage device 23. The auxiliary storage device 23 stores data used by the processor 21 when performing various processes, data created by the processes in the processor 21, etc. The auxiliary storage device 23 may also store the above-mentioned application software.

[0082] The communication interface 24 communicates data with other computers connected via a network. The other computers may be, for example, one or more personal computers installed in a workspace. The communication interface 24 receives print data from the other computers via the network, for example. The communication interface 24 transmits data read by the scanner 201 to the other computers via the network.

[0083] In this embodiment, a user authentication APL 231 is installed in the multifunction peripheral 20 configured as described above. The user authentication APL 231 is application software for user authentication. The user authentication APL 231 may be installed in the main memory 22 or the auxiliary storage device 23. FIG. 10 shows the case where the user authentication APL 231 is installed in the auxiliary storage device 23. The method for installing the user authentication APL 231 in the multifunction peripheral 20 is not particularly limited. The user authentication APL 231 can be installed in the main memory 22 or the auxiliary storage device 23 of the multifunction peripheral 20 by recording the user authentication APL 231 on a removable recording medium or by distributing the user authentication APL 231 via communication via a network. The form of the recording medium is not important as long as it can store a program and is readable by the device, such as a CD-ROM or memory card.

[0084] The user authentication APL 231 is application software that detects the posture of a user who is exercising from an image captured by the camera 208, counts the number of times a predetermined movement is repeated from the user's posture, and authenticates the user of the multifunction device 20 when the count reaches a predetermined number of times that is equal to or greater than two. Once the user is authenticated by the user authentication APL 231, the user can use functions such as printing, faxing, and copying in the multifunction device 20.

[0085] In order to realize such a function, when a user authentication APL 231 is installed in the multifunction device 20, storage areas for an event-specific determination model 232 and a user-specific setting table 233 are formed in the main memory 22 or the auxiliary storage device 23.

[0086] The event-specific determination model 232 is similar to the event-specific determination model 132 described in the first embodiment, and therefore will not be described here.

[0087] 11, the per-user setting table 233 is an area for setting an event code C and the number of times N of exercises in the order of a series of table numbers No. X in association with the user ID of each user. The table number No. X, event code C, and number of times N are the same as those in the setting table 133 in the first embodiment. In other words, the per-user setting table 233 is a setting table 133 provided for each user of the multifunction device 20.

[0088] By installing the user authentication APL 231 in the multifunction device 20, an icon for the user authentication APL 231 is displayed on the screen of the touch panel 205. When the user of the multifunction device 20 touches this icon, the user authentication APL 231 is activated. By activating the user authentication APL 231, the processor 21 realizes the functions of an acquisition unit 211, a setting unit 212, a detection unit 213, a counting unit 214, and an authentication unit 215, as shown in FIG.

[0089] The acquisition means 211 is a function for acquiring identification information for identifying a user. In this embodiment, the identification information is a user ID. The acquisition means 211 acquires the user ID recorded on the ID card via the reader 207. The setting means 212 is a function for setting an exercise event code C and a number of times N for each user ID in the user-specific setting table 233 in the order of table number No. X. The detection means 213 is a function for detecting the posture of a user exercising in front of the multifunction device 20 using the exercise event-specific determination model 232. The counting means 214 is a function for counting the number of times a predetermined movement is repeated based on the user's posture. The authentication means 215 is a function for authenticating a user when the number of times reaches a predetermined number of times, which is equal to or greater than two.

[0090] The setting means 212 is a function that is realized when the processor 21 operates in the setting mode of the user authentication APL 231. The detection means 213, counting means 214, and authentication means 215 are functions that are realized when the processor 21 operates in the authentication mode of the user authentication APL 131. Note that the acquisition means 211 is a function that is realized in both the setting mode and the authentication mode. Next, the main operations of the processor 21 will be described with reference to Figures 12 and 13.

[0091] Fig. 12 is a flowchart showing the main steps of information processing when the processor 21 operates in the setting mode of the user authentication APL 231. In Fig. 12, the same processing steps as in Fig. 5, which shows the corresponding processing in the first embodiment, are assigned the same reference numerals. Fig. 13 is a flowchart showing the main steps of information processing when the processor 21 operates in the authentication mode of the user authentication APL 231. In Fig. 13, the same processing steps as in Fig. 6, which shows the corresponding processing in the first embodiment, are assigned the same reference numerals. Note that the information processing steps shown in each flowchart are merely examples. The steps can be changed as appropriate as long as the same effects can be achieved.

[0092] When a user of the multifunction peripheral 20 touches the icon of the user authentication APL 231 displayed on the touch panel 205 to activate the user authentication APL 231, a menu screen of the user authentication APL 231 is displayed on the touch panel 205. When the user selects a setting mode from the menu screen, the processor 21 starts information processing according to the procedure shown in the flowchart of FIG.

[0093] Processor 21 waits for the user ID to be read in ACT41. A user who has selected the setting mode holds the ID card over reader 207. By doing so, reader 207 reads the user ID recorded on the ID card, and processor 21 proceeds from ACT41 to ACT42. Processor 21 stores the user ID in ACT42.

[0094] Next, processor 21 initializes user-specific setting table 233 as ACT43. This initialization clears the event code C and the number of exercises N that have been written in user-specific setting table 233 in association with the stored user ID. As a result, the event code C for each table number No. X associated with the stored user ID becomes "Null." The number of exercises N becomes "0."

[0095] After initializing the per-user setting table 233, the processor 21 proceeds to ACT44. In ACT44, the processor 21 sets the screen of the touch panel 205 as a setting screen. The setting screen is the same as the setting screen SCa of the first embodiment. That is, the setting screen has a pull-down box INa for selecting an event and an input box INb for the number of exercises N. The setting screen also has the software keys of an execute button BTa, a cancel button BTb, and a setting end button BTc.

[0096] After checking the setting screen, the user selects one of the exercises displayed in the pull-down box INa, "push-ups," "squats," and "sit-ups," just as in the first embodiment. Then, by touching the input box INb, a numeric keypad is displayed, allowing the user to enter a number of repetitions of "2" or greater.

[0097] After displaying the setting screen, processor 11 resets number counter X to "0" in ACT 45. This process is the same as the process in ACT 3 described in the first embodiment. Processor 21 then executes the processes in ACTs 4 to 18 described in the first embodiment in the same manner as described above.

[0098] Thus, in the user setting table 233, the event code C and the number of exercises N set by the user identified by the user ID are associated with the user ID of the ID card read by the reader 207 and are written in the order of table number No. X. Here, the processor 21 realizes the function of the acquisition means 211 by processing ACT41 and ACT42. The processor 21 also realizes the function of the setting means 212 by processing ACT43, ACT44, and ACT4 to ACT18.

[0099] When a user who has set an event code C and the number of exercises N in association with their own user ID in the user setting table 233 selects authentication mode from the menu screen of the user authentication APL 231, the processor 21 starts information processing of the procedure shown in the flowchart of FIG. 13. The processor 21 waits for the user ID to be read as ACT51. The user who selected authentication mode holds their ID card over the reader 207. By doing so, the reader 207 reads the user ID recorded on the ID card, and the processor 21 proceeds from ACT51 to ACT52. The processor 21 stores the user ID as ACT52.

[0100] Next, in ACT 53, processor 21 obtains data described in association with the stored user ID from per-user setting table 233. That is, processor 21 obtains event code C and number of exercises N described in the order of table number No. X. Thereafter, processor 21 resets number counter X to "0" in ACT 54. This process is the same as the process of ACT 21 described in the first embodiment. Then, processor 21 subsequently executes the processes of ACTs 21 to 35 described in the first embodiment in the same manner as described above.

[0101] Thus, when the user repeats the exercise identified by the exercise code C a number of times N within the photographing area of ​​the camera 208 provided in the multifunction device 20, the processor 21 recognizes that the user has been authenticated. As a result, the user can use the functions of the multifunction device 20, such as the printer, fax, and copy functions.

[0102] Here, the processor 21 realizes the function of the acquisition means 211 by the processing of ACT51 and ACT52. The processor 21 also realizes the function of the detection means 112 by the processing of ACT26 to ACT30, realizes the function of the counting means 113 by the processing of ACT31, and realizes the function of the authentication means 114 by the processing of ACT25 and ACT32 to ACT34, as in the first embodiment.

[0103] As described above in detail, according to the second embodiment, every user of the multifunction device 20 must repeat the set exercise a predetermined number of times when using functions such as printer, fax, copy, etc. Therefore, each user will be able to habitually perform moderate exercise during user authentication, and it is expected that health hazards such as back pain, neck pain, and eye strain will be reduced for each user working in the workspace.

[0104] Furthermore, each user can freely set the number of exercises and the number of times they will perform each exercise, so that they can habitually perform exercises that provide the optimal physical load for the user.

[0105] [Other embodiments] In the above embodiment, multiple exercise types can be set. In another embodiment, the number of types may be limited to one. In that case, only the number of exercises N is set on the setting screen SCa. Incidentally, the exercise types are not limited to the three types of "push-ups," "squats," and "sit-ups." For example, "jumps," "side jumps," "leg raises," "arm circles," etc. can also be set as exercise types because they provide an appropriate physical load.

[0106] In the above embodiment, the posture of a user performing exercise is detected based on an image captured by camera 103 or camera 208. However, the means for detecting the posture of a user performing exercise is not limited to this. For example, to detect the exercise type "jump," a sheet-like pressure sensor is provided near an electronic device that requires user authentication. The user then repeatedly jumps on the pressure sensor. The output signal of the pressure sensor fluctuates depending on the user's posture at that time, and the electronic device may receive this output signal to detect the posture of the user performing exercise.

[0107] In the above embodiment, the smartphone 10 and the multifunction peripheral 20 are exemplified as electronic devices that require user authentication to use a function. Needless to say, the electronic devices are not limited to the smartphone 10 and the multifunction peripheral 20. For example, the first embodiment can be applied as is to electronic devices used by individuals, such as tablet terminals and personal computers. On the other hand, the second embodiment can be applied as is to electronic devices shared by multiple users, such as copiers, scanners, and shared personal computers.

[0108] In the above embodiment, for example, if N number of times of exercise is set for each of three types of exercise, the user is not authenticated unless the N number of times of exercise for each of the three types of exercise is recognized in the set order. In this regard, the user may be authenticated, for example, when it is recognized that any one type of exercise has been performed N number of times. By doing so, the user can appropriately change the type of exercise at the time of user authentication without changing the settings in the setting table 133 or the user-specific setting table 233. As a result, the user does not get bored, and is more likely to make moderate exercise a habit.

[0109] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope of the invention and the scope of the inventions and their equivalents as defined in the claims. The inventions described in the original claims of this application are set forth below. [1] A program for causing a computer of an electronic device that requires user authentication to function as a detection means for detecting the posture of a user who is exercising, a counting means for counting the number of times a predetermined movement is repeated from the posture of the user, and an authentication means for authenticating the user when the number of times reaches a predetermined number of times that is two or more. [2] The program according to appendix [1] for causing the computer to further function as a setting means for setting the predetermined number of times. [3] The program described in appendix [1], wherein the counting means counts the number of times that each of a plurality of predetermined types of movements is repeated from the user's posture for each type of movement, and the authentication means authenticates the user on the condition that the number of times each of the plurality of types of movement has reached a predetermined number of times of two or more. [4] The program according to appendix [3], for causing the computer to further function as a setting means for setting the plurality of types of movements and the predetermined number of times for each of the movements. [5] A program described in any one of appendices [1] to [4], further causing the computer to function as an acquisition means for acquiring identification information that identifies a user, wherein the counting means counts the number of times a movement determined by the user identified by the identification information acquired by the acquisition means is repeated from the user's posture, and the authentication means authenticates the user on the condition that the number of times reaches a number set for the user identified by the identification information acquired by the acquisition means. [6] An electronic device requiring user authentication, comprising: a detection means for detecting the posture of a user exercising; a counting means for counting the number of times a predetermined movement is repeated from the posture of the user; and an authentication means for authenticating the user when the number of times reaches a predetermined number of times, which is equal to or greater than two. [Explanation of symbols]

[0110] 10...smartphone, 11...processor, 12...internal storage, 13...external storage, 14...mobile communication unit, 15...short-range communication unit, 16...system transmission path, 20...multifunction printer, 21...processor, 22...main memory, 23...auxiliary storage device, 24...communication interface, 25...system transmission path, 101...main body, 102...touch panel, 103...camera, 104...microphone, 105...speaker, 111, 212...setting procedure Stages, 112, 213...detection means, 113, 214...counting means, 114, 215...authentication means, 131, 231...user authentication APL, 132, 232...category-specific judgment model, 133...setting table, 134...lock folder, 201...scanner, 202...printer, 203...operation panel, 204...ADF, 205...touch panel, 206...operation button, 207...reader, 208...camera, 211...acquisition means, 233...user-specific setting table.

Claims

1. The computer of the electronic device that requires user authentication, a detection means for detecting the posture of a user performing exercise; a counting means for counting the number of times that a plurality of predetermined types of movements are repeatedly performed for each type of movement from the user's posture; and an authentication means for authenticating the user on condition that the number of times of each of the plurality of types of movements reaches a predetermined number of times of two or more; A program to function as a

2. The computer a setting means for setting the plurality of types of movements and the predetermined number of times for each of the movements; The program according to claim 1, further functioning as

3. The computer an acquisition means for acquiring identification information for identifying a user; It further functions as the counting means counts, from the posture of the user, the number of times that each of a plurality of types of movements determined by the user identified by the identification information acquired by the acquisition means is repeatedly performed for each type of movement; The program according to claim 1 or 2, wherein the authentication means authenticates the user on the condition that the number of times of the multiple types of movements reaches a predetermined number for the user identified by the identification information acquired by the acquisition means.

4. An electronic device that requires user authentication, A detection means for detecting the posture of a user who is exercising; a counting means for counting the number of times that each of a plurality of predetermined types of movements is repeatedly performed from the user's posture for each type of movement; an authentication means for authenticating the user on condition that the number of times of each of the plurality of types of movements reaches a predetermined number of times of two or more; An electronic device comprising:

Images