Portable terminal

Abstract

A portable terminal 10A comprises a first acquisition unit 160a, a determination unit 160b, and a notification unit 160c. The first acquisition unit 160a acquires tilt data indicating the pitch angle θ and roll angle θr that represent the tilt of the portable terminal 10A. The determination unit 160b determines, on the basis of the tilt data acquired by the first acquisition unit 160a, whether a hunched posture of a user using the mobile terminal 10A has continued for a prescribed period. When it has been determined by the determination unit 160b that a hunched posture has continued for the prescribed period, the notification unit 160c prompts the user to change posture by controlling the area and the position occupied by a display image on the display surface of a display device 120 in accordance with the tilt of the portable terminal 10A.

Description

Mobile devices

[0001] The present invention relates to a mobile terminal.

[0002] Patent Document 1 discloses an invention in which a mobile device such as a smartphone issues a warning to the user when it is determined that the user is using the mobile device in an incorrect posture from the perspective of the user's health, such as with their head down.

[0003] JP 2013-69286 A

[0004] Regardless of whether the posture is correct or not, it is undesirable for a user to continue using a mobile device in the same posture for a long period of time, from the perspective of muscle tension and poor blood flow. For example, using a mobile device in a hunched position for a long period of time can cause stiff neck (so-called smartphone neck), leading to neck or shoulder problems. In the present disclosure, maintaining the same posture for a long period of time includes not only cases where the posture remains unchanged for a long period of time, but also cases where the posture changes to the extent that muscle tension or poor blood flow is not alleviated. The technology disclosed in Patent Document 1 issues a warning to the user every time it is determined that the user is using the mobile device in an incorrect posture, which causes the problem of frequent and annoying warnings to the user.

[0005] A portable terminal according to a preferred aspect of the present disclosure is a portable terminal including a first acquisition unit, a determination unit, and a notification unit. The first acquisition unit acquires tilt data indicating the tilt of the portable terminal. The determination unit determines whether a user using the portable terminal has maintained the same posture for a predetermined period of time based on the tilt data acquired by the first acquisition unit. The notification unit prompts the user to change their posture when the determination unit determines that the same posture has continued for the predetermined period of time.

[0006] According to the present disclosure, when a user of a mobile terminal equipped with a display device that displays images continues to use the mobile terminal in the same posture for a long period of time, the user can be prompted to change their posture.

[0007] FIG. 1 is a diagram illustrating a configuration example of a mobile terminal 10A according to a first embodiment of the present disclosure. FIG. 2 is a diagram for explaining a pitch angle θp and a roll angle θr that represent the tilt of the mobile terminal 10A. FIG. 3 is a diagram illustrating an example of a user U holding the mobile terminal 10A in his / her hand and using it, and an operation example of a notification unit 160c. FIG. 4 is a flowchart illustrating the flow of a notification control process executed by a processing device 160 of the mobile terminal 10A according to a program PR1. FIG. 5 is a diagram for explaining an operation example of the mobile terminal 10A. FIG. 6 is a diagram illustrating a configuration example of a mobile terminal 10B according to a second embodiment of the present disclosure. FIG. 7 is a flowchart illustrating the flow of a notification control process executed by a processing device 160 of the mobile terminal 10B according to a program PR2. FIG. 8 is a diagram for explaining an operation example of the mobile terminal 10B. FIG. 9 is a diagram for explaining a modified example (1). FIG. 10 is a diagram for explaining a modified example (2). FIG. 11 is a diagram for explaining a modified example (3).

[0008] (A. First Embodiment) FIG. 1 is a diagram illustrating an example configuration of a mobile terminal 10A according to an embodiment of the present disclosure. The mobile terminal 10A is, for example, a smartphone. As illustrated in FIG. 1, the mobile terminal 10A is used while being held in the hand of a user U. The mobile terminal 10A has a program execution function, and this program execution function executes entertainment application programs and business application programs used by the user U when performing work, in accordance with instructions from the user U. Examples of entertainment application programs include video game programs and video viewing programs. Examples of business application programs include word processing programs.

[0009] 1, the mobile terminal 10A includes an input device 110, a display device 120, a communication device 130, a first measuring device 140, a storage device 150, a processing device 160, and a bus 190. The input device 110, the display device 120, the communication device 130, the first measuring device 140, and the storage device 150 are each connected to the processing device 160 by the bus 190 for communicating information. The bus 190 may be configured using a single bus, or may be configured using different buses for each device.

[0010] The input device 110 includes a touch panel. In addition to the touch panel, the input device 110 may include a plurality of operation keys. The input device 110 accepts operations by the user U on the mobile terminal 10A. The display device 120 is, for example, a liquid crystal display. Although detailed illustration is omitted in FIG. 1 , the display device 120 has a rectangular display surface. A touch panel of the input device 110 is layered on the display surface of the display device 120. The display device 120 displays various information on the display surface under the control of the processing device 160.

[0011] The communication device 130 is hardware (transmitting / receiving device) for communicating with other devices via a communication line, either wired or wirelessly. The communication line and other devices are not shown in FIG. 1 . The communication device 130 is also referred to as, for example, a network device, a network controller, a network card, or a communication module. An example of another device that communicates with the communication device 130 via a communication line is a server device that distributes application programs. The communication device 130 transmits data provided by the processing device 160 to the communication line. Furthermore, the communication device 130 supplies data received via the communication line to the processing device 160.

[0012] The first measuring device 140 is, for example, a gyro sensor. However, the first measuring device 140 may also be, for example, a three-axis acceleration sensor. The first measuring device 140 measures the tilt of the mobile terminal 10A. FIG. 2 is a diagram illustrating the pitch angle θp and roll angle θr, which represent the tilt of the mobile terminal 10A. The pitch angle θp is the rotation angle of the mobile terminal 10A around the axis AXp. Here, the axis AXp is an axis that is perpendicular to the axis AXy that is normal to the display surface of the display device 120 and extends in the short-side direction of the display surface of the display device 120. The roll angle θr is the rotation angle of the mobile terminal 10A around the axis AXr. Here, the axis AXr is an axis that extends in a direction perpendicular to both the axis AXy and the axis AXp. In other words, the axis AXr is an axis that is perpendicular to the axis AXy and extends in the long-side direction of the display surface of the display device 120. In this embodiment, the reference state is a state in which the axis AXy is aligned with the vertical axis. In this reference state, the pitch angle θp is 0°, and the roll angle θr is also 0°. In this embodiment, the rotation direction indicated by the dotted arrow in FIG. 2 is the positive rotation direction. For example, as shown in FIG. 1 , when the mobile terminal 10A is held upright so that the axis AXr is approximately aligned with the vertical axis, the pitch angle θp is approximately 90°. In this embodiment, the first measuring device 140 is not constantly supplied with operating power from a battery (not shown in FIG. 1 ). The supply of operating power to the first measuring device 140, i.e., the start of operation of the first measuring device 140, is controlled by the processing device 160. Under the control of the processing device 160, the first measuring device 140 outputs tilt data representing each of the pitch angle θp and the roll angle θr to the processing device 160.

[0013] The storage device 150 is a recording medium readable by the processing device 160. The storage device 150 includes, for example, a nonvolatile memory and a volatile memory. The nonvolatile memory is, for example, a read-only memory (ROM), an erasable programmable read-only memory (EPROM), or an electrically erasable programmable read-only memory (EEPROM). The volatile memory is, for example, a random access memory (RAM). Although not shown in detail in FIG. 1 , the nonvolatile memory of the storage device 150 stores the entertainment application program and the business application program described above. The nonvolatile memory of the storage device 150 also stores a program PR1 associated with the entertainment application program, which causes the processing device 160 to execute a notification control process, which is a process for sending notifications from the mobile terminal 10A to the user using a notification method specific to the present disclosure. The volatile memory of the storage device 150 is used as a work area when executing various application programs and the program PR1.

[0014] The processing device 160 includes one or more central processing units (CPUs). The one or more CPUs are examples of one or more processors. Each of the processors and CPUs is an example of a computer. When the processing device 160 is instructed to execute an entertainment application program or a business application program by operating the input device 110, it reads the instructed application program from non-volatile memory to volatile memory. The processing device 160 then executes the application program read into volatile memory. The processing device 160, operating in accordance with the application program, displays an image including an app image on the display surface of the display device 120 to allow the user U to use the application realized by the application program. The app image is an example of a display image in the present disclosure. The user U uses the application by viewing the app image and performing various inputs.

[0015] Furthermore, when the application program instructed to be executed by an operation on the input device 110 is an entertainment application program, the processing device 160 reads the program PR1 associated with the entertainment application program from the non-volatile memory to the volatile memory, and executes the program PR1 in parallel with the execution of the entertainment application program. The processing device 160 operating in accordance with the program PR1 functions as the first acquisition unit 160a, the determination unit 160b, and the notification unit 160c shown in FIG. 1. In other words, the first acquisition unit 160a, the determination unit 160b, and the notification unit 160c in FIG. 1 are software modules realized by operating the processing device 160 in accordance with software. The respective functions of the first acquisition unit 160a, the determination unit 160b, and the notification unit 160c are as follows.

[0016] The first acquisition unit 160a acquires tilt data representing the tilt of the mobile terminal 10A from the first measuring device 140. Although details will be described later, in this embodiment, the first acquisition unit 160a starts supplying operating power to the first measuring device 140 when a predetermined time T has elapsed since the start of execution of the entertainment application program (in other words, the start of execution of the program PR1), and thereafter acquires tilt data output from the first measuring device 140.

[0017] The determination unit 160b determines whether or not an incorrect posture of the user U using the mobile terminal 10A has continued for a predetermined time T, based on the tilt data acquired by the first acquisition unit 160a. Fig. 3 is a diagram showing an example of the posture of the user U using the mobile terminal 10A. In this embodiment, an incorrect posture is a hunched posture such as posture F2 or F3 in Fig. 3, and a correct posture is an upright posture such as posture F1 in Fig. 3.

[0018] There is a certain relationship between the posture of the user U holding the mobile terminal 10A in their hand and the tilt of the mobile terminal 10A. For example, when the user U uses the mobile terminal 10A in an upright posture, as in posture F1 in FIG. 3, the user often uses the mobile terminal 10A upright, and the pitch angle θp is approximately 60° to 90°. On the other hand, when the user U uses the mobile terminal 10A in a bowed posture, as in posture F2 or F3 in FIG. 3, the pitch angle θp is approximately 0° to 60°. In this embodiment, the determination unit 160b determines that the user U's posture is correct if 60°≦pitch angle θp≦90°. On the other hand, when 0°≦pitch angle θp<60° and the roll angle θr is a value in the range of −15° to 15°, the determination unit 160b determines that the user U's posture is incorrect. Then, when a state in which 0°≦pitch angle θp<60° and the roll angle θr is a value in the range of −15° to 15° continues for a predetermined time T, the determination unit 160b determines that the user U has maintained an incorrect posture for the predetermined time T. Furthermore, when it is determined that the user U has maintained an incorrect posture for the predetermined time T, the determination unit 160b determines that the user U has returned to a correct posture when a state in which 60°≦pitch angle θp≦90° continues for the predetermined time T.

[0019] The notification unit 160c notifies the user U that the posture will be changed when the determination unit 160b determines that an incorrect posture (as described above, in this embodiment, a bowed posture) has continued for a predetermined time T. In this embodiment, the notification unit 160c notifies the user U that the posture will be changed by controlling the area and position of the app image G1 on the display surface of the display device 120 in accordance with the pitch angle θp, as shown in FIG.

[0020] More specifically, the notification unit 160c controls the ratio R of the area occupied by the app image G1 to the entire display surface of the display device 120 in accordance with the pitch angle θp according to the following equation 1. The notification unit 160c also places the app image G1 along the upper edge of the display surface of the display device 120 and blacks out the lower margin of the display surface. Note that R = 1 means that the app image G1 occupies the entire display surface of the display device 120 (i.e., 100%), R = 0.55 means that the app image G1 occupies 55% of the display surface, and R = 0.1 means that the app image G1 occupies 10% of the display surface. In this embodiment, the ratio R calculated according to equation 1 never falls below 0.1, and the app image G1 is not completely erased even when the pitch angle θp is 0°. Since the app image G1 is not completely erased even when the pitch angle θp is 0°, the entertainment application corresponding to the app image G1 is not completely unavailable even when the user U is in the posture F3 shown in FIG. 3 .

[0021] As is clear from Equation 1 and FIG. 3 , the worse the degree to which user U is tilting their head down (i.e., the closer the pitch angle θp is to 0°), the more app image G1 is displayed on the display surface of display device 120 in a state where it is narrowed from the bottom. When app image G1 is narrowed from the bottom, user U unconsciously moves their arms to upright mobile terminal 10A (i.e., so that pitch angle θp approaches 90°), and in conjunction with this arm movement, they often straighten their back. As a result, user U's posture returns to the correct posture, such as posture F1 in FIG. 3 . In this embodiment, when determination unit 160b determines that mobile terminal 10A has been used in an incorrect posture for a predetermined time T, notification unit 160c narrows app image G1 from the bottom of the display surface of display device 120 in accordance with pitch angle θp in order to prompt user U to unconsciously change their posture.

[0022] Furthermore, the processing device 160 operating in accordance with the program PR1 executes a notification control process for providing a notification using a notification method specific to the present disclosure. Figure 4 is a flowchart showing the flow of the notification control process. As shown in Figure 4, the notification control process includes a first determination process SA110, a normal display process SA120, a second determination process SA130, a third determination process SA140, and a notification process SA150. The processing contents of each of the first determination process SA110, the normal display process SA120, the second determination process SA130, the third determination process SA140, and the notification process SA150 are as follows.

[0023] In the first determination process SA110, the processing device 160 determines whether a predetermined time T has elapsed since the start of execution of the entertainment application program. The determination result of the first determination process SA110 is "No" until the predetermined time T has elapsed since the start of execution of the entertainment application program. In contrast, the determination result of the first determination process SA110 is "Yes" after the predetermined time T has elapsed since the start of execution of the entertainment application program. As shown in FIG. 4 , if the determination result of the first determination process SA110 is "No," the processing device 160 executes the normal display process SA120. In contrast, if the determination result of the first determination process SA110 is "Yes," the processing device 160 executes the third determination process SA140.

[0024] In normal display processing SA120, which is executed when the determination result of the first determination processing SA110 is "No," the processing device 160 arranges the app image G1, which is displayed in accordance with the entertainment application program, across the entire display surface of the display device 120. Hereinafter, the operating mode in which the app image G1 is arranged across the entire display surface of the display device 120 is referred to as the normal mode. In second determination processing SA130, which follows the normal display processing SA120, the processing device 160 determines whether an instruction to end execution of the entertainment application program has been issued by an operation on the input device 110. If an instruction to end execution of the entertainment application program has been issued, the determination result of the second determination processing SA130 is "Yes." If the determination result of the second determination processing SA130 is "Yes," the processing device 160 ends execution of the entertainment application program, terminates execution of program PR1, and terminates the notification control processing. If an instruction to end execution of the entertainment application program has not been issued, the determination result of the second determination processing SA130 is "No." If the determination result of the second determination process SA130 is "No", the processor 160 executes the first determination process SA110 described above again.

[0025] In third determination process SA140, which is executed when the determination result of first determination process SA110 is "Yes," processing device 160 functions as first acquisition unit 160a and determination unit 160b. More specifically, in third determination process SA140, processing device 160 activates first measuring device 140 and acquires tilt data from first measuring device 140. Then, processing device 160 determines, based on the acquired tilt data, whether user U using mobile terminal 10A has maintained an incorrect posture for a predetermined time T. More specifically, processing device 160 determines that user U has maintained an incorrect posture for a predetermined time T when a state in which 0°≦pitch angle θp<60° and a roll angle θr is in the range of -15° to 15° has continued for the predetermined time T. In other words, if the state in which 0°≦pitch angle θp<60° and the roll angle θr is a value in the range of −15° to 15° continues for a predetermined time T, the determination result of the third determination process SA140 will be “Yes.” If the state in which 0°≦pitch angle θp<60° and the roll angle θr is a value in the range of −15° to 15° continues for less than the predetermined time T, or if 60°≦pitch angle θp≦90°, the determination result of the third determination process SA140 will generally be “No.” However, if the determination result of the previous third determination process SA140 was “Yes,” the determination result of the third determination process SA140 will be “No” if the state in which 60°≦pitch angle θp≦90° continues for the predetermined time T.

[0026] If the determination result of the third determination process SA140 is "No," the processing device 160 executes the normal display process SA120 described above. On the other hand, if the determination result of the third determination process SA140 is "Yes," the processing device 160 executes a notification process SA150 and then executes a second determination process SA130. In the notification process SA150, the processing device 160 functions as a notification unit 160c. In the notification process SA150, the processing device 160 notifies the user that the attitude will be changed by controlling the area and position of the app image G1 on the display surface of the display device 120 in accordance with the pitch angle θp. Hereinafter, the operation mode in which the area and position of the app image G1 on the display surface of the display device 120 in accordance with the pitch angle θp is referred to as a notification mode.

[0027] FIG. 5 illustrates an example of the operation of the mobile terminal 10A. As shown in FIG. 5, assume that the user U starts using an entertainment application program at time ta1 and continues using the mobile terminal 10A in a correct posture F1 until time tb3. From time ta1 until time ta2, when a predetermined time T has elapsed, the determination result of the first determination process SA110 is “No,” and the normal display process SA120 is executed. From time ta2 onward, the determination result of the first determination process SA110 is “Yes.” Even after time ta2, the user U’s posture deteriorates from the correct posture F1 to a head-down posture F2 at time ta3 until the predetermined time T has elapsed (i.e., until time ta4), even if the head-down posture F2 continues, the determination result of the third determination process SA140 is “No,” and the normal display process SA120 is executed. Therefore, in the example illustrated in FIG. 5, the mobile terminal 10A operates in normal mode from time ta1 to time ta4.

[0028] If the user U's posture, which deteriorated at time ta3, continues from time ta3 to time ta4, which is a predetermined time T, the determination result of the third determination process SA140 becomes "Yes," and notification process SA150 is executed. Thereafter, even if the user U changes his / her posture to the correct posture F1 at time ta5, the determination result of the third determination process SA140 remains "Yes" until the correct posture F1 is maintained for the predetermined time T, and notification process SA150 is executed. If the user U maintains the correct posture F1 from time ta5 to time ta6, which is a predetermined time T, the determination result of the third determination process SA140 becomes "No" from time ta6 onwards, and normal display process SA120 is executed. Therefore, in the example shown in FIG. 5 , the mobile terminal 10A operates in notification mode from time ta4 to time ta6, and operates in normal mode from time ta6 onwards.

[0029] As described above, according to this embodiment, if user U continues to use an entertainment application program in an incorrect posture for a predetermined period of time T, a notification is sent to user U urging him or her to change posture. Therefore, compared to a mode in which a notification is sent to urge user U to change posture every time user U's posture becomes incorrect, such notifications are not sent frequently, reducing annoyance.

[0030] Furthermore, in this embodiment, the processing device 160 activates the first measuring device 140 when a predetermined time T has elapsed since the execution of the entertainment application program was started, which reduces battery consumption in the mobile terminal 10A compared to a mode in which the first measuring device 140 is kept constantly activated. Note that in this embodiment, the posture of the user U while using the entertainment application program is monitored because entertainment application programs are expected to be used for longer periods of time in an incorrect posture compared to business application programs.

[0031] Furthermore, according to this embodiment, if the user U continues to use an entertainment application program in an incorrect posture for a predetermined time T, the notification unit 160c narrows the app image G1 from the bottom of the display surface of the display device 120 in accordance with the pitch angle θp, thereby urging the user U to unconsciously change their posture to the correct posture F1. Note that in this embodiment, the posture of the user U who is using a business application program is not monitored, so the mobile terminal 10A does not operate in notification mode while the business application program is being executed, and therefore, there is no disruption to the user U's use of the business application program.

[0032] (B: Second Embodiment) FIG. 6 is a diagram showing an example configuration of a mobile terminal 10B according to a second embodiment of the present disclosure. In FIG. 6, the same components as those in FIG. 1 are assigned the same reference numerals. As is clear from comparing FIG. 6 with FIG. 1, the configuration of the mobile terminal 10B differs from the configuration of the mobile terminal 10A in the following two points. The first difference is that the mobile terminal 10B has a second measuring device 170. The second difference is that a program PR2, instead of a program PR1, is stored in a storage device 150 provided in the mobile terminal 10B.

[0033] The second measuring device 170 is, for example, a three-axis acceleration sensor. The second measuring device 170 measures the acceleration of the mobile terminal 10B in the vertical axis direction and in two axes perpendicular to the vertical axis and perpendicular to each other. The second measuring device 170 may also measure the acceleration of the mobile terminal 10B in each axis direction in a three-axis Cartesian coordinate system fixed to the second measuring device 170. Similar to the first measuring device 140, the second measuring device 170 is not constantly supplied with operating power from a battery (not shown in FIG. 6 ). The supply of operating power to the second measuring device 170, i.e., the start of operation of the second measuring device 170, is controlled by the processing device 160. Under the control of the processing device 160, the second measuring device 170 outputs acceleration data representing the measured acceleration in each axis direction.

[0034] Similar to program PR1 in the first embodiment, program PR2 is stored in storage device 150 in association with an entertainment application program. Similar to the first embodiment, processing device 160 of mobile terminal 10B starts executing program PR2 when the entertainment application program starts to execute. Processing device 160 operating in accordance with program PR2 functions as first acquisition unit 160a, second acquisition unit 160d, determination unit 160e, and notification unit 160c shown in FIG. 6 . The second acquisition unit 160d and determination unit 160e, which are different from the first embodiment, are software modules, similar to first acquisition unit 160a and notification unit 160c. The functions of second acquisition unit 160d and determination unit 160e are as follows:

[0035] The second acquisition unit 160d acquires acceleration data representing the acceleration of the mobile terminal 10B in the vertical axis direction and in each of two axes that are orthogonal to the vertical axis and are orthogonal to each other, from the second measurement device 170. When a predetermined time T has elapsed since the start of execution of the entertainment application program, the second acquisition unit 160d activates the second measurement device 170 and starts acquiring the acceleration data.

[0036] Based on the tilt data acquired by the first acquisition unit 160a and the acceleration data acquired by the second acquisition unit 160d, the determination unit 160e determines whether the same posture has continued for a predetermined time T for the user U using an entertainment application program with the mobile terminal 10B, regardless of whether the posture is correct. In this embodiment, the determination unit 160e determines that the same posture has continued for a predetermined time T when the fluctuations in each of the pitch angle θp and roll angle θr represented by the tilt data are within a predetermined range (e.g., a range of −5° to 5°) and the fluctuations in acceleration of the acceleration data in the vertical axis direction and in each of two axial directions orthogonal to the vertical axis and orthogonal to each other are within a predetermined range (e.g., a range of −0.1×g to 0.1×g, where g is the acceleration of gravity) continue for the predetermined time T. In this embodiment, when the determination unit 160e determines that the same posture has continued for the predetermined time T, the notification unit 160c issues a notification. In this embodiment, the reason for determining whether the same posture has continued for the predetermined time T regardless of whether it is the correct posture is because maintaining the same posture regardless of whether it is the correct posture is undesirable from the perspective of muscle tension and poor blood flow. In this embodiment, a gyro sensor may be used as the first measuring device 140. In this case, the determination unit 160e may determine whether the same posture has continued for the predetermined time T based on the output from the gyro sensor. In this case, the mobile terminal 10B may be configured without the second measuring device 170. In this embodiment, a triaxial acceleration sensor may be used as the first measuring device 140. In this case, the determination unit 160e may determine whether the same posture has continued for the predetermined time T based on the output from the triaxial acceleration sensor. In this case, the mobile terminal 10B may be configured without the second measuring device 170. In addition, in this embodiment, the judgment unit 160e may determine whether or not an incorrect posture has continued for a predetermined period of time T for a user U who is using an entertainment application program with the mobile terminal 10B, based on the tilt data acquired by the first acquisition unit 160a and the acceleration data acquired by the second acquisition unit 160d.

[0037] 7 is a flowchart showing the flow of the notification control process according to the second embodiment, which is executed by the processing device 160 of the mobile terminal 10B in accordance with the program PR2. In FIG. 7, the same processes as those in FIG. 4 are assigned the same reference numerals. The difference between the notification control process according to the second embodiment and the notification control process according to the first embodiment is that a third determination process SB140 is provided instead of the third determination process SA140.

[0038] In the third determination process SB140, the processing device 160 functions as a first acquisition unit 160a, a second acquisition unit 160d, and a determination unit 160e. In the third determination process SB140, the processing device 160 activates the first measuring device 140 to acquire tilt data from the first measuring device 140, and activates the second measuring device 170 to acquire acceleration data from the second measuring device 170. Then, based on the acquired tilt data and acceleration data, the processing device 160 determines whether the same posture has continued for a predetermined time T for the user U who is using an entertainment application program with the mobile terminal 10B.

[0039] Specifically, the determination result of the third determination process SB140 is "Yes" if the fluctuations of the pitch angle θp and roll angle θr represented by the tilt data are within a predetermined range, and the fluctuations of the acceleration represented by the acceleration data in the vertical axis direction and in each of two axial directions perpendicular to the vertical axis and perpendicular to each other remain within a predetermined range for a predetermined time T. If at least one of the pitch angle θp and the roll angle θr has fluctuated beyond the predetermined range, or if at least one of the accelerations in each axial direction has fluctuated beyond the predetermined range, the determination result of the third determination process SB140 is "No." If the determination result of the third determination process SB140 is "No," the processing device 160 executes the normal display process SA120. If the determination result of the third determination process SB140 is "Yes," the processing device 160 executes the notification process SA150 and then the second determination process SA130.

[0040] FIG. 8 is a diagram illustrating an example of the operation of the mobile terminal 10B. In the example shown in FIG. 8, assume that user U starts using an entertainment application program at time tb1 and changes his / her posture as needed until time tb3. From time tb1 until time tb2, when a predetermined time T has elapsed, the determination result of the first determination process SA110 is "No," and the normal display process SA120 is executed. From time tb2 onward, the determination result of the first determination process SA110 is "Yes." However, since user U changes his / her posture as needed from time tb2 to time tb3, the determination result of the third determination process SB140 is "No," and the normal display process SA120 is executed. Here, assume that user U remains in a head-down position F2 from time tb3 to time tb4. In this case, the determination result of the third determination process SB140 is "No" until time tb4, and the normal display process SA120 is executed. Therefore, in the example shown in FIG. 8, the mobile terminal 10B operates in the normal mode from time tb1 to time tb4.

[0041] At time tb4, the determination result of the third determination process SB140 is "Yes", and the notification process SA150 is executed. Thereafter, the determination result of the third determination process SB140 remains "Yes", and the notification process SA150 is executed, until the user U changes his / her posture at time ta5. When the user U changes his / her posture at time ta5, the determination result of the third determination process SB140 remains "No", and the normal display process SA120 is executed. Therefore, in the example shown in FIG. 8 , the mobile terminal 10B operates in the notification mode from time tb4 to time tb5.

[0042] As described above, according to this embodiment, when the user U continues to use an entertainment application program in the same posture for a predetermined time T, the user U can be prompted to change his / her posture.

[0043] Also in this embodiment, the processing device 160 activates the first measuring device 140 and the second measuring device 170 when a predetermined time T has elapsed since the start of execution of the entertainment application program. This reduces battery consumption in the mobile terminal 10B compared to a configuration in which the first measuring device 140 and the second measuring device 170 are constantly activated. Also in this embodiment, the posture of the user U while using the entertainment application program is monitored because entertainment application programs are expected to be used for longer periods of time than business application programs. Also in this embodiment, the posture of the user U while using the business application program is not monitored. Therefore, the mobile terminal 10B does not operate in notification mode while the business application program is running, and the use of the business application program is not hindered.

[0044] (C: Modifications) The present disclosure is not limited to the first and second embodiments exemplified above. Specific modifications are as follows. Two or more modifications arbitrarily selected from the following examples may be combined. (C-1: Modification 1) In the first embodiment described above, the mobile terminal 10A is held by the user U so that the axis AXr is the vertical axis. However, depending on the type of application program executed on the mobile terminal 10A, it may be preferable to hold the mobile terminal 10A so that the axis AXp is the vertical axis, as shown in FIG. 9. When the mobile terminal 10A is held so that the axis AXp is the vertical axis, as shown in FIG. 9, the determination unit 160b may determine whether the user U's posture is good or bad based on the roll angle θr. Specifically, the determination unit 160b may determine that the posture of the user U is correct if the roll angle θr is 60° or less, and may determine that the posture of the user U is incorrect if the roll angle θr is 0° or less than 60° and the pitch angle θp is an angle in the range of -15° to 15°.

[0045] (C-2: Modification 2) In the first and second embodiments, the notification unit 160c urges the user U to change his / her posture by narrowing the area allocated to the app image on the display surface of the display device 120 from the bottom. However, the notification unit 160c may urge the user U to change his / her posture by narrowing the area allocated to the app image on the display surface of the display device 120 from the top, right, or left, or may urge the user U to change his / her posture by narrowing the area from multiple directions among the top, bottom, left, and right. Essentially, the notification unit 160c may be able to urge the user U to change his / her posture by controlling at least one of the area and position allocated to the app image on the display surface of the display device 120. Furthermore, the notification unit 160c may urge the user to change his / her posture by controlling the area allocated to the app image without changing the position allocated to the app image on the display surface of the display device 120. Here, "controlling the area allocated to the app image without changing the position allocated to the app image" means, for example, "reducing the app image around the center position of the app image on the display surface without changing the center position of the app image on the display surface." Furthermore, the notification unit 160c may prompt the user U to change his / her posture by controlling the position allocated to the app image without changing the area allocated to the app image on the display surface of the display device 120. Here, "controlling the area allocated to the app image without changing the area allocated to the app image" means, for example, "sliding the placement position of the app image without changing the area of ​​the app image on the display surface." Furthermore, the notification unit 160c may prompt the user U to change his / her posture by controlling at least one of the lightness (brightness) and the saturation (color vividness) when displaying the app image on the display surface of the display device 120 in accordance with the pitch angle θp.

[0046] Specifically, as shown in FIG. 10 , a possible embodiment is one in which the brightness of the app image G1 when the pitch angle θp is 90° is a reference value V0, the brightness when the pitch angle θp is 45° is a first value V1 lower than the reference value, and the brightness when the pitch angle θp is 0° is a second value V2 lower than the first value V1. Vertical hatching in FIG. 10 indicates that the brightness of the app image G1 when the pitch angle θp is 45° is lower than the brightness of the app image G1 when the pitch angle θp is 90°. Similarly, horizontal hatching in FIG. 10 indicates that the brightness of the app image G1 when the pitch angle θp is 0° is lower than the brightness of the app image G1 when the pitch angle θp is 45°. Furthermore, the notification prompting the user to change their posture is not limited to notification by controlling the display mode of the app image on the display surface of the display device 120, but may also be notification by displaying a message such as "Stand up straight" or outputting a voice representing the message.

[0047] (C-3: Modification 3) In the second embodiment, when a fixed attitude is detected, the notification mode is entered, and the display area of ​​the app image is controlled according to the pitch angle θp. However, if the display area of ​​the app image becomes significantly smaller without any warning, it may interfere with the use of the application program. As described above, the user U of the mobile terminal 10B can cancel the notification mode and return to the normal mode by temporarily changing their own posture. However, from the perspective of maintaining the user U's health, it is important to make it a habit to change their posture appropriately and use the application program in the correct posture while using the application program. Therefore, assuming that transitions from the normal mode to the notification mode and back again may occur multiple times between the time the application program is launched and the time the application program is terminated, the notification unit 160c may control the display area of ​​the app image by weighting the number of transitions from the normal mode to the notification mode according to the number of transitions from the normal mode to the notification mode.

[0048] For example, in FIG. 11, until the nth (n is a positive integer less than or equal to 5) transition to the notification mode, the notification unit 160c calculates the ratio R of the display area of ​​the app image to the entire display surface of the display device 120 according to the following equation 2. In the example shown in FIG. 11 , when the display device 120 transitions to the notification mode for the first time, the minimum value of the ratio R of the display area of ​​the app image to the entire display surface of the display device 120 is 0.5 (i.e., 50%). Even if the pitch angle θp is 0 degrees, the display area of ​​the app image to the entire display surface of the display device 120 will not be less than 50%. Similarly, in the example shown in FIG. 11 , when the display device 120 transitions to the notification mode for the second time, the minimum value of the ratio R is 0.4 (i.e., 40%). Even if the pitch angle θp is 0 degrees, the display area of ​​the app image to the entire display surface of the display device 120 will not be less than 40%. Then, when the display device 120 transitions to the notification mode for the fifth time, the minimum value of the ratio R is 0.1 (i.e., 10%). Even if the pitch angle θp is 0 degrees, the display area of ​​the app image to the entire display surface of the display device 120 will not be less than 10%. The minimum values ​​of the ratio R in FIG. 11 , 0.5, 0.4, and 0.1, are examples of predetermined thresholds in the present disclosure. When transitioning to the notification mode for the sixth time or later, the notification unit 160c calculates the ratio R according to the above-mentioned equation (1).

[0049] In this modified example, by controlling the display area of ​​the app image by weighting it according to the number of times the notification mode is entered, the ratio R does not fall below 0.5 when the notification mode is entered for the first time, and the app image remains easy to see. However, if the fixed posture continues to occur thereafter, the ratio R gradually decreases, making it possible for the user U to be aware of posture changes while using the application program.

[0050] (C-4: Variation 4) In the above embodiment, program PR1 is stored in storage device 150 of mobile terminal 10A, but program PR1 may also be manufactured or sold as a standalone program. When selling program PR1, program PR1 may be provided to purchasers by being written to a computer-readable recording medium such as a flash ROM and distributed, or by being downloaded via a telecommunications line. Similarly, program PR2 may also be manufactured or sold as a standalone program.

[0051] (C-5: Modification 5) In the above embodiment, the first acquisition unit 160a, the determination unit 160b, and the notification unit 160c were software modules. However, any one, any two, or all of the first acquisition unit 160a, the determination unit 160b, and the notification unit 160c may be hardware modules. Specific examples of hardware modules include a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). Even if any one, any two, or all of the first acquisition unit 160a, the determination unit 160b, and the notification unit 160c are hardware modules, the same effects as those of the first embodiment can be achieved. Similarly, any one or all of the second acquisition unit 160d and the determination unit 160e may be hardware modules. Even if either one or both of the second acquisition unit 160d and the determination unit 160e are hardware modules, the same effects as those of the second embodiment can be achieved.

[0052] (D: Other) (1) In the above-described embodiments, ROM, RAM, etc. are given as examples of storage device 150, but storage device 150 may also be a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disk), a smart card, a flash memory device (e.g., a card, a stick, a key drive), a CD-ROM (Compact Disc-ROM), a register, a removable disk, a hard disk, a floppy (registered trademark) disk, a magnetic strip, a database, a server, or other suitable storage medium.

[0053] (2) In each of the above-described embodiments, the described information, signals, etc. may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0054] (3) In each of the above-described embodiments, input and output information may be stored in a specific location (for example, a memory) or may be managed using a management table. Input and output information may be overwritten, updated, or added to. Output information may be deleted. Input information may be transmitted to another device.

[0055] (4) In each of the above-described embodiments, the determination may be made based on a value represented by one bit (0 or 1), a Boolean value (true or false), or a comparison of numerical values ​​(e.g., comparison with a predetermined value).

[0056] (5) The order of the process procedures, sequences, flowcharts, etc. illustrated in each of the above-described embodiments may be rearranged unless it is consistent. For example, the methods described in this disclosure present elements of various steps using an example order and are not limited to the particular order presented.

[0057] (6) Each function illustrated in Figure 1 or 6 is realized by any combination of hardware and / or software. Furthermore, the method for realizing each functional block is not particularly limited. That is, each functional block may be realized using a single device that is physically or logically coupled, or may be realized using two or more physically or logically separated devices that are directly or indirectly connected (e.g., wired, wireless, etc.) and these multiple devices. A functional block may be realized by combining software with the single device or the multiple devices.

[0058] (7) The programs exemplified in the above-described embodiments should be broadly construed to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., regardless of whether software is called software, firmware, middleware, microcode, hardware description language, or by other names.

[0059] Software, instructions, information, etc. may also be transmitted or received over a transmission medium. For example, if software is transmitted from a website, server, or other remote source using wired technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave), then these wired and / or wireless technologies are included within the definition of transmission media.

[0060] (8) In each of the above embodiments, the terms "system" and "network" are used interchangeably.

[0061] (9) The information, parameters, etc. described in this disclosure may be expressed using absolute values, relative values ​​from a predetermined value, or corresponding other information.

[0062] (10) In each of the above-described embodiments, the mobile terminal includes a mobile station (MS). A mobile station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or some other appropriate term. In this disclosure, terms such as "mobile station," "user terminal," "user equipment (UE)," and "terminal" may be used interchangeably.

[0063] (11) In each of the above-described embodiments, the terms "connected," "coupled," or any variation thereof refers to any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, "connected" may be read as "access." As used in this disclosure, two elements may be considered to be "connected" or "coupled" to each other using at least one of one or more electric wires, cables, and printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and optical (both visible and invisible) range, as some non-limiting and non-exhaustive examples.

[0064] (12) In each of the above-described embodiments, unless otherwise specified, the phrase "based on" does not mean "based only on." In other words, the phrase "based on" means both "based only on" and "based at least on."

[0065] (13) As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (e.g., searching a table, database, or other data structure), and ascertaining something that is considered to be a "determining." Also, "determining" and "determining" may include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in memory), and the like. Furthermore, "judgment" and "decision" can include regarding resolving, selecting, choosing, establishing, comparing, etc. as having been "judgment" or "decision." In other words, "judgment" and "decision" can include regarding some action as having been "judgment" or "decision." Furthermore, "judgment (decision)" can be interpreted as "assuming," "expecting," "considering," etc.

[0066] (14) In the above-described embodiments, when the terms "include," "including," and variations thereof are used, these terms are intended to be inclusive, similar to the term "comprising." Furthermore, the term "or" used in this disclosure is not intended to mean an exclusive or.

[0067] (15) In this disclosure, where articles are added by translation, such as a, an, and the in English, this disclosure may include the nouns following these articles being plural.

[0068] (16) In this disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "combined" may also be interpreted in the same way as "different."

[0069] (17) The aspects / embodiments described in this disclosure may be used alone, in combination, or switched depending on the implementation. Notification of predetermined information (e.g., notification that "X is true") is not limited to being explicit, but may be implicit (e.g., not notifying the predetermined information).

[0070] (E: Aspects Understood from the Above-described Embodiments or Modifications) Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the present disclosure. The following aspects can be understood from at least one of the above-described embodiments or modifications.

[0071] A mobile terminal according to a first aspect of the present disclosure is a mobile terminal including a first acquisition unit, a determination unit, and a notification unit. The first acquisition unit acquires tilt data indicating the tilt of the mobile terminal. The determination unit determines whether a user using the mobile terminal has maintained the same posture for a predetermined period of time based on the tilt data acquired by the first acquisition unit. The notification unit prompts the user to change their posture when the determination unit determines that the same posture has continued for the predetermined period of time. According to this aspect, when a user using the mobile terminal has maintained the same posture for the predetermined period of time, the user can be prompted to change their posture.

[0072] A portable terminal according to a second aspect (an example of the first aspect) of the present disclosure may further include a second acquisition unit that acquires acceleration data indicating an acceleration of the portable terminal. The determination unit in the portable terminal according to this second aspect may determine whether a user using the portable terminal has maintained the same posture for a predetermined period of time based on the tilt data acquired by the first acquisition unit and the acceleration data acquired by the second acquisition unit. According to this aspect, it is possible to determine whether a user using the portable terminal has maintained the same posture for a predetermined period of time based on the tilt and acceleration of the portable terminal.

[0073] The notification unit in the mobile terminal according to a third aspect (an example of the first aspect) of the present disclosure may prompt the user to change their posture by controlling at least one of the area and the position of a display image on the display surface of the display device, the display image being displayed in accordance with an application program. According to this aspect, the user can be visually prompted to change their posture by controlling at least one of the area and the position of the display image on the display surface of the display device.

[0074] In the mobile device according to a fourth aspect (an example of the third aspect) of the present disclosure, the notification unit may allocate the display image to an upper side of the display surface. According to this aspect, it is possible to prompt the user to unconsciously make posture changes that improve posture.

[0075] In a mobile terminal according to a fifth aspect (an example of the third aspect) of the present disclosure, the notification unit may control the area occupied by the display image within a range in which the proportion of the area occupied by the display image on the display surface is equal to or greater than a predetermined threshold. According to this aspect, it is possible to prevent the display image from being completely hidden.

[0076] 10A, 10B...mobile terminal, 110...input device, 120...display device, 130...communication device, 140...first measuring device, 170...second measuring device, 150...storage device, 160...processing device, 160a...first acquisition unit, 160b, 160e...determination unit, 160c...notification unit, 160d...second acquisition unit, 190...bus, PR1, PR2...program.

Claims

1. A mobile terminal having: a first acquisition unit that acquires tilt data indicating the tilt of the mobile terminal; a determination unit that determines whether a user using the mobile terminal has maintained the same posture for a predetermined period of time based on the tilt data acquired by the first acquisition unit; and a notification unit that prompts the user to change their posture when the determination unit determines that the same posture has continued for the predetermined period of time.

2. A mobile terminal as described in claim 1, further comprising a second acquisition unit that acquires acceleration data indicating an acceleration of the mobile terminal, and the determination unit determines whether a user using the mobile terminal continues to maintain the same posture for a predetermined period of time based on the tilt data acquired by the first acquisition unit and the acceleration data acquired by the second acquisition unit.

3. The mobile terminal according to claim 1, wherein the notification unit prompts the user to change the posture by controlling at least one of the area and position allocated to a display image displayed in accordance with an application program on the display surface of the display device.

4. The mobile terminal according to claim 3, wherein the notification unit assigns the display image to an upper side of the display surface.

5. The mobile terminal according to claim 3, wherein the notification unit controls the area occupied by the display image in accordance with the inclination of the mobile terminal within a range in which the proportion of the area of ​​the display surface occupied by the display image is equal to or greater than a predetermined threshold value.