Portable information terminal and control method thereof

Abstract

The objective of the present invention is to provide a mobile information terminal wherein the battery remaining of a secondary battery can be effectively used.　For this objective, this mobile information terminal, which has a secondary battery, a control device and a storage device, is configured such that the control device performs a power use amount prediction and a power charging opportunity prediction from a schedule stored in the storage device and further performs, on the basis of the power use amount prediction and the power charging opportunity prediction, the setting of power saving modes for which the power saving levels of reducing the consumed power are different.

Description

[Technical field]

[0001] The present invention relates to a technique for effectively utilizing the remaining battery capacity of a secondary battery in a portable information terminal. [Background technology]

[0002] Background of this technical field is Patent Document 1. Patent Document 1 discloses an information processing device that is driven by power supplied from a secondary battery, and includes an action plan determination unit that determines whether or not a user's action plan is a non-chargeable action that makes it impossible or difficult for the user to start charging the secondary battery, and a notification unit that notifies the user of a decrease in the remaining battery level of the secondary battery before the start time of the action plan that is determined by the action plan determination unit to be the non-chargeable action. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-50655 A Summary of the Invention [Problem to be solved by the invention]

[0004] Patent Document 1 describes a warning for the secondary battery running out of power, based on an action plan. However, it does not take into consideration the viewpoint of effectively utilizing the remaining battery power by predicting the future usage status of the mobile information terminal, and is insufficient in terms of providing a mobile information terminal that is highly convenient for the user.

[0005] In view of the above-mentioned problems, an object of the present invention is to provide a portable information terminal that can effectively utilize the remaining battery capacity of a secondary battery, and a control method thereof. [Means for solving the problem]

[0006] One example of the present invention is a portable information terminal equipped with a secondary battery, a control device, and a storage device, in which the control device predicts power usage and charging opportunity predictions from a schedule stored in the storage device, and sets power saving modes with different power saving levels that reduce power consumption based on the power usage predictions and charging opportunity predictions. Effect of the Invention

[0007] According to the present invention, it is possible to provide a portable information terminal that can effectively utilize the remaining battery capacity of a secondary battery and is highly convenient for the user, and a control method thereof. [Brief description of the drawings]

[0008] [Figure 1] FIG. 2 is a system configuration diagram of power management for a group of portable information terminals according to the first embodiment. [Diagram 2] FIG. 4 is a process flow diagram of power management in the first embodiment. [Figure 3A] 2 is an example of a usage schedule of the portable information terminal 1A in the first embodiment. [Figure 3B] 4 is an example of a usage schedule of the portable information terminal 1B in the first embodiment. [Figure 3C] 4 is an example of a usage schedule of the portable information terminal 1C in the first embodiment. [Figure 4] 4 is an example of a schedule for predicting a charging opportunity in the first embodiment. [Diagram 5] FIG. 4 is a diagram illustrating a power saving mode of the portable information terminal according to the first embodiment. [Figure 6] 13 is an example of prediction of remaining battery capacity at a charging opportunity in the first embodiment. [Figure 7A] 13 is an example of a power saving mode setting when the predicted remaining battery charge of each portable information terminal is small in the first embodiment. [Figure 7B] 13 is an example of power saving mode setting when the remaining battery charge of each portable information terminal is large in the first embodiment. [Figure 8] 2 illustrates an example of the external configuration of an HMD as an example of a portable information terminal in the first embodiment. [Figure 9] 2 is a functional block configuration example of a portable information terminal (HMD) in the first embodiment. [Figure 10A] FIG. 11 is a diagram showing how the set lower limit value of the remaining battery charge is changed according to the predicted arrival time in the second embodiment. [Figure 10B] FIG. 11 is a diagram showing how the set lower limit value of the remaining battery charge is changed according to a predicted charging time in the second embodiment. [Figure 11] 13 is an example of a power usage record of a user in the third embodiment. [Figure 12] 13 is an example of a user's behavior history in the fourth embodiment. [Figure 13] FIG. 13 is a process flow diagram of power management in the fifth embodiment. [Figure 14A] FIG. 13 is a diagram showing how a threshold value for switching the power-saving mode is changed according to a predicted arrival time in the fifth embodiment. [Figure 14B] FIG. 13 is a diagram showing how a threshold value for switching between power-saving modes is changed according to a predicted charging time in the fifth embodiment. [Figure 15] FIG. 23 is a process flow diagram of power management in the sixth embodiment. [Figure 16] 23 is a display example of charging spots on a portable information terminal that is an HMD in the sixth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. EXAMPLES

[0010] FIG. 1 is a system configuration diagram of power management of a group of mobile information terminals in this embodiment. In FIG. 1, the system configuration of power management of a group of mobile information terminals has at least one of the following mobile information terminals: mobile information terminal 1A which is an HMD (Head Mounted Display), mobile information terminal 1B which is a smartphone, and mobile information terminal 1C which is a smart watch. The following processing operations of the mobile information terminals may be performed by these mobile information terminals alone or in cooperation with each other. In the following description, mobile information terminals 1A to 1C are collectively referred to as mobile information terminal 1. Also, a mobile information terminal may be simply referred to as a mobile terminal or a terminal.

[0011] The system configuration may also include a portable battery 2 that supplies power to the portable information terminal. The portable battery 2 communicates with the portable information terminal 1, provides information necessary for managing the power management system, and supplies the stored power to the portable information terminal.

[0012] The server 3 performs processing on behalf of each mobile information terminal 1, mediates the transmission and reception of information between each mobile information terminal 1, and provides necessary information via a communication network 9. The server 3 may be, for example, a local server, a cloud server, an edge server, a net service, or the like, and its form is not important. In addition, some of the functions of the mobile information terminal 1 may be processed by the server 3.

[0013] FIG. 2 is a processing flow diagram of power management in this embodiment. In FIG. 2, for example, the portable information terminal 1A is an HMD, and the portable information terminal 1B is a smartphone. In addition, it is assumed that communication between the portable information terminals 1 is established before this processing flow, and the remaining battery capacity of each is known. In addition, the portable battery 2 can also be regarded as a special information portable terminal whose main function is to lend power to other information portable terminals, so it is basically controlled according to this flow. However, in the case of the portable battery 2, the only power it uses is the power related to the control of the battery, and basically power saving is not performed. However, power saving may be performed if it is possible to save power within a range that does not affect battery control, such as when there is a display that displays the status.

[0014] 2, first, in steps S21A and S21B, power usage is predicted from a user schedule. That is, power usage is predicted from viewing reservations and scheduled use of application software (hereinafter, abbreviated as apps) from normal usage patterns. Note that when the information processing capabilities differ depending on the mobile information terminal, or when schedules are managed centrally, one mobile information terminal may assist another mobile information terminal in the overall information processing.

[0015] For example, Fig. 3A, Fig. 3B, and Fig. 3C are examples of usage schedules of each mobile information terminal 1. Fig. 3A, Fig. 3B, and Fig. 3C show the applications used, power consumption, and time information as usage schedules of high-load applications of mobile information terminals 1A, 1B, and 1C, respectively. High-load applications are applications that play or display a large amount of audio, image, or video, applications that require a large amount of calculation, etc. SNS applications, telephone, etc. that are used from time to time are classified as low-load applications, and it is assumed that average usage is always occurring. The baseline power consumption excluding the usage of these high-load applications may be set from the actual value of each terminal.

[0016] Next, returning to Fig. 2, in steps S22A and S22B, charging opportunity prediction is performed from the user schedule. Fig. 4 is an example of a schedule for predicting charging opportunities. In Fig. 4, the user's schedule shows opportunities for charging, i.e., the places for charging and the time to go there. Opportunities for charging are predicted from such a user schedule. Note that this charging opportunity prediction is common regardless of the mobile information terminal, and is therefore shared between mobile information terminals.

[0017] Next, in steps S23A and S23B, the power interchange between the mobile information terminals is adjusted. That is, assuming the highest power saving mode, it is determined whether the power of the other mobile information terminal can be exchanged with the mobile information terminal whose remaining battery level is below the set lower limit at the next charging opportunity, and the user is notified. At this time, the efficiency of charging between the mobile information terminals is also taken into consideration. Furthermore, if the power interchange cannot save the situation, the user is notified to select to stop using the application and further to stop using the mobile information terminal. Since the power interchange causes a loss, the power interchange may be performed automatically, but it is preferable to perform it according to the user's instruction. However, in the case of the power interchange from the mobile battery 2, since that is the main function of the mobile battery 2, it is preferable to perform it automatically. If the power interchange is not performed, power management is performed for each individual terminal.

[0018] FIG. 5 is a diagram for explaining the power saving mode of a mobile information terminal. FIG. 5 shows the relationship between the consumption items that consume power and the power saving modes 0, 1, and 2. That is, the power saving modes 0, 1, and 2 have different power saving levels for reducing power consumption, and the power saving mode 0 is a state in which power saving is not performed, and the larger the number, the higher the power saving level and the larger the reduction in power consumption. In other words, a high power saving mode strengthens power saving, and a low power saving mode relaxes power saving. Specifically, in FIG. 5, the display brightness, low load applications, and high load applications of the consumption items are set to normal mode in power saving mode 0, weak dimming, normal mode, and low power mode in power saving mode 1, and strong dimming, normal mode, and prohibited in power saving mode 2. That is, low load applications such as email are set to normal mode as much as possible, and non-essential high load applications that consume a lot of power are set to low power mode in power saving mode 1 and prohibited in power saving mode 2.

[0019] Next, returning to FIG. 2, in steps S24A and S24B, the remaining battery capacity at the next charging opportunity is predicted from the power usage prediction and the charging opportunity prediction.

[0020] Fig. 6 is an example of a predicted remaining battery charge at a certain charging opportunity. Fig. 6 shows the predicted remaining battery charge of each mobile information terminal, the amount of power that can be transferred, and the transfer destination at the charging opportunity (location) at coffee shop △△ in the charging opportunity schedule table in Fig. 4. In Fig. 6, the remaining battery charge of mobile information terminal 1A becomes negative by the time it arrives at coffee shop △△, while the remaining battery charges of mobile information terminals 1B and 1C are positive, indicating that they can transfer power to mobile information terminal 1A.

[0021] Then, the power saving mode to be used until the next charging opportunity is determined based on this remaining battery charge prediction. For example, if the remaining battery charge prediction falls below a set lower limit, the power saving mode is increased.

[0022] 7A and 7B are examples of power saving mode settings for each mobile information terminal at a certain point in time. In FIG. 7A, the remaining battery charge is predicted to be low, and strict power saving modes are set overall. In FIG. 7A, the power saving mode for mobile information terminal 1A (HMD) is set low and lenient, taking into consideration the priority order. FIG. 7B is an example of power saving mode settings when the remaining battery charge is predicted to be high and there is some margin for error. In FIG. 7B, all mobile information terminals are used in normal mode (=power saving mode 0).

[0023] If it is predicted that all mobile information terminals can be operated until the next charging opportunity by power interchange, the power saving mode of some or all mobile information terminals is set to a low level, taking into consideration the priority order, to the extent that operation can be maintained. Also, since the above-mentioned battery remaining amount prediction changes over time depending on the difference with the predicted value of power usage, the set power saving mode is also changed as needed.

[0024] Returning to FIG. 2, next, in steps S25A and S25B, the process returns to steps S21A and S21B to repeat the power management process until an end instruction is received, at which point the power management process ends.

[0025] Although Fig. 2 shows an example of a case where there are two mobile information terminals, the same control is applied to a group of three or more terminals. A mobile information terminal that receives an end instruction ends the power management process, but the power management process continues among other mobile information terminals that have not received an end instruction. Even if there is only one terminal, it is possible to carry out the power management process, except for power interchange.

[0026] In the above description of the control, the power-saving mode is set based on a predetermined time, which is a schedule, but if it is expected that the time will deviate from the actual situation, the power-saving mode setting is dynamically corrected to match each predicted time. This dynamic correction can be similarly applied to other embodiments.

[0027] Fig. 8 shows an example of the external configuration of an HMD as an example of a portable information terminal in this embodiment. In Fig. 8, a portable information terminal 1A, which is an HMD, is provided with a display including a display surface 11 in a glasses-like housing 10. This display is, for example, a transmissive display, and a real image of the outside world is transmitted to the display surface 11, and an image is superimposed and displayed on the real image. A control device, a camera 12, a distance measuring sensor 13, other sensors 14, etc. are mounted on the housing 10.

[0028] The cameras 12 are, for example, two cameras arranged on the left and right sides of the housing 10, and capture an image by capturing an area including the front of the HMD. The distance measurement sensor 13 is a sensor that measures the distance between the HMD and an object in the outside world. The distance measurement sensor 13 may use a TOF (Time Of Flight) type sensor, a stereo camera, or other types. The sensor 14 includes a group of sensors for detecting the position and orientation of the HMD. On the left and right sides of the housing 10, there are provided an audio input device 18 including a microphone, an audio output device 19 including a speaker and an earphone terminal, and the like.

[0029] The mobile information terminal 1A, which is an HMD, may be provided with an operation device 20 such as a remote controller. In this case, the HMD performs, for example, short-distance wireless communication with the operation device 20. A user can input instructions related to the functions of the HMD and move a cursor on the display surface 11 by operating the operation device 20 with his or her hand. The HMD may communicate with an external smartphone, PC, or the like to cooperate with the HMD. For example, the HMD may receive AR (Augmented Reality) image data from an application on the smartphone.

[0030] The mobile information terminal 1A, which is an HMD, may display a virtual image such as an AR image on the display surface 11. For example, the mobile information terminal 1A, which is an HMD, generates a virtual image for guiding the user and displays it on the display surface 11.

[0031] Furthermore, the mobile information terminal 1A includes a charging cable 21 and a charger 22. The charger 22 includes a wireless charging antenna. The mobile information terminal 1A may be the power supplying side or the power receiving side. The charger may be built into the housing 10, in which case the charging cable 21 is omitted. The charging cable 21 may be detachable from the housing 10. Furthermore, power may be supplied to and received from another terminal by wire, rather than wirelessly. In that case, the charger 22 shall be read as a connector.

[0032] Fig. 9 is a functional block diagram of a mobile information terminal 1A, which is the HMD in Fig. 8. Basically, the other mobile information terminals 1 have the same configuration. The mobile information terminal 1 includes a processor 101, a memory 102, a camera 12, a distance measuring sensor 13, a sensor 14, a display 103, a communication interface 104, an audio input device 18 including a microphone, an audio output device 19 including a speaker, etc., a wireless transmission interface 105, a wireless reception interface 106, an operation input unit 107, a battery 108, and a charging control unit 109. These elements are connected to each other via a bus or the like.

[0033] The processor 101 is composed of a CPU, a ROM, a RAM, etc., and constitutes a control device for the HMD. The processor 101 executes processes according to a control program 31 and an application program 32 in the memory 102, thereby realizing functions of an OS, middleware, application, etc., and other functions. The memory 102 is a storage device, composed of a non-volatile storage device, etc., and stores various data and information handled by the processor 101, etc. The memory 102 also stores images and detection information acquired by the camera 12, etc., as temporary information.

[0034] The camera 12 converts light incident from a lens into an electrical signal using an imaging element to obtain an image. When the distance measurement sensor 13 uses, for example, a TOF (Time Of Flight) sensor, the distance measurement sensor 13 calculates the distance to an object from the time it takes for light emitted to the outside world to hit the object and return. The sensor 14 includes, for example, an acceleration sensor 141, a gyro sensor (angular velocity sensor) 142, a geomagnetic sensor 143, and a GPS receiver 144. The sensor 14 detects the position, orientation, movement, and other conditions of the HMD using detection information from these sensors. The HMD is not limited to this, and may include an illuminance sensor, a proximity sensor, an air pressure sensor, and the like. Furthermore, the distance measurement sensor 13 and the sensor 14 are not separate, and the distance measurement sensor 13 may be one of the sensors 14.

[0035] The display 103 includes a display drive circuit and a display surface 11, and displays a virtual image or the like on the display surface 11 based on image data of the display information 34. Note that the display 103 is not limited to a transmissive display, and may be a non-transmissive display or the like.

[0036] The communication interface 104 includes a communication processing circuit, an antenna, and the like corresponding to various predetermined communication interfaces. Examples of the communication interface include a mobile network, Wi-Fi (registered trademark), Bluetooth (registered trademark), UWB (Ultra Wide Band), infrared, and the like. The communication interface 104 performs wireless communication processing between other mobile information terminals 1 and access points. The communication interface 104 also performs short-range communication processing with the controller 20.

[0037] The wireless transmission interface 105 transmits a wireless signal of a radio wave source accompanied by an identification signal used for position estimation. Here, the wireless signal accompanied by identification information is, for example, a signal of UWB, Bluetooth, or the like. The wireless reception interface 106 receives the wireless signal of the radio wave source accompanied by the identification signal, and measures the reception strength, the timing of the signal, and the like. Note that the positional relationship between the mobile information terminals may be used as an aid in determining whether or not wireless power supply is possible. Also, information communication may be performed using the wireless transmission interface 105 and the wireless reception interface 106. Also, in the case of a mobile information terminal 1 that only transmits or only receives wireless signals, it is sufficient to have the necessary devices.

[0038] The audio input device 18 converts input audio from a microphone into audio data. The audio output device 19 outputs audio from a speaker or the like based on the audio data. The audio input device may have a voice recognition function. The audio output device may have a voice synthesis function. The operation input unit 107 is a part that accepts operation inputs to the HMD, such as turning the power on / off and adjusting the volume, and is composed of hardware buttons, touch sensors, etc. The battery 108 is a secondary battery that supplies power to each part of the mobile information terminal 1.

[0039] The control device by the processor 101 has, as an example of a configuration of functional blocks realized by processing, a communication control unit 101A, a display control unit 101B, a data processing unit 101C, and a data acquisition unit 101D.

[0040] The memory 102 stores a control program 31, an application program 32, setting information 33, display information 34, power management information 35, etc. The control program 31 is a program for implementing power management of the mobile information terminal 1. The application program 32 is various programs used by the user. The setting information 33 includes system setting information and user setting information related to each function. The display information 34 includes image data and position coordinate information for displaying a virtual image on the display surface 11. The power management information 35 is information related to the remaining battery capacity, predicted power usage, charging opportunities, and power saving mode of the own terminal and other terminals for performing power management.

[0041] The communication control unit 101A controls communication processing using the communication interface 104, such as when communicating with other mobile information terminals 1. The display control unit 101B controls the display of a virtual image or the like on the display surface 11 of the display 103 using the display information 34.

[0042] The data processing unit 101C reads and writes the power management information 35, predicts the remaining battery power of the own terminal and other terminals, predicts charging opportunities, sets the power saving mode, etc. This processing may be performed by each terminal or by the representative terminal. The data acquisition unit 101D acquires the remaining battery power data of the own terminal, acquires information of other terminals, etc.

[0043] The configuration of the portable battery 2 is obtained by retaining the configuration necessary for controlling the battery 108 from the configuration of FIG. 9 and restricting the functions as appropriate.

[0044] As described above, according to this embodiment, the mobile information terminal controls the power saving mode of the mobile information terminal based on predictions of future usage and charging opportunities of the mobile information terminal, thereby making it possible to effectively utilize the remaining battery power of the secondary battery, and providing a mobile information terminal and a control method thereof that are highly convenient for the user. EXAMPLES

[0045] In this embodiment, a description will be given of a variable lower limit value for the remaining battery charge, which is a criterion for determining whether to switch between power-saving modes or whether to provide power interchange.

[0046] 10A and 10B are diagrams for explaining the set lower limit value of the remaining battery capacity in this embodiment. In FIG. 10A, the set lower limit value of the remaining battery capacity is changed according to the predicted arrival time until the charging opportunity (location). That is, the longer the arrival time until the charging opportunity, the larger the prediction error of the remaining battery capacity becomes, and the higher the risk of the battery running out. Specifically, in FIG. 10A, when the predicted arrival time is 2 hours or more, 1 hour to less than 2 hours, and less than 1 hour, the set lower limit value is set to 30%, 20%, and 10% of the full charge amount, respectively.

[0047] Furthermore, the above-mentioned set lower limit value may be changed depending on the predicted time available for charging during the charging opportunity, i.e., the predicted time available for charging. Figure 10B shows a correction coefficient to be multiplied with the set lower limit value shown in Figure 10A. This shows a case in which the shorter the time available for charging, the larger the set lower limit value. In other words, if the time available for charging is short, sufficient charging cannot be performed, and the risk of running out of battery after charging increases.

[0048] The setting method is not limited to the illustrated one, and various modes are possible. Also, the setting method may be different for each mobile information terminal. Furthermore, when the charging opportunity is at home, the risk is lower than in other charging opportunities, so the lower limit value may be exceptionally set low.

[0049] As described above, according to this embodiment, in addition to the effects of the first embodiment, it is possible to provide a portable information terminal that can further reduce the possibility of the battery running out and does not leave too much margin for the remaining battery capacity, and a control method thereof. EXAMPLES

[0050] In the first embodiment, the power consumption is predicted based on the user schedule. In contrast, in the present embodiment, the power consumption may be predicted in consideration of the user's power consumption record.

[0051] FIG. 11 is an example of a user's power usage record in this embodiment. In FIG. 11, average power usage records by behavior, day of the week, and time period are shown. Power usage may be predicted taking these user usage records into consideration. The user's behavior is estimated by inspecting camera information and HMD movements. Unusual power usage is taken into consideration in predicting power usage by reading records of scheduled consumption of terminal power, such as viewing reservations, from a schedule book.

[0052] As described above, according to this embodiment, in addition to the effects of the first embodiment, it is possible to perform more accurate prediction of power consumption. EXAMPLES

[0053] In the first embodiment, charging opportunity prediction is performed based on the user schedule. In contrast, in the present embodiment, a point will be described where charging opportunity prediction may be performed based on the user's behavior history.

[0054] Fig. 12 is an example of a user's behavior history in this embodiment. In Fig. 12, the location, day of the week, time, and charging time are described. Charging opportunity prediction may be performed taking into account these user's behavior history.

[0055] If charging at a certain location is a patterned behavior, the system will set a charging opportunity based on that record. If the behavior is not habitual, the system will read the planned behavior from the schedule book, find a place where charging is possible, and set a charging opportunity.

[0056] As described above, according to this embodiment, in addition to the effects of the first embodiment, it is possible to perform more accurate charging opportunity prediction. EXAMPLES

[0057] In this embodiment, power management is performed only based on charging opportunity prediction without using power usage prediction.

[0058] Fig. 13 is a process flow diagram of power management in this embodiment. In Fig. 13, the same components as in Fig. 2 are given the same reference numerals, and their explanation will be omitted. Fig. 13 differs from Fig. 2 in that steps S21A and S21B of predicting power usage from a user schedule are eliminated.

[0059] 13, in steps S24A and S24B of the power saving mode control, the power saving mode is switched based on the time until the charging opportunity is reached, by changing the value of the remaining battery capacity for switching the power saving mode. Note that, in order to avoid a strict power saving mode as much as possible, power may be borrowed from a terminal with surplus power.

[0060] 14A and 14B are diagrams for explaining the thresholds for switching the power-saving mode in this embodiment. In FIG. 14A, the thresholds for switching the power-saving mode are changed according to the predicted time to the charging opportunity. The first threshold is the threshold for switching from power-saving mode 0 to power-saving mode 1. The second threshold is the threshold for switching from power-saving mode 1 to power-saving mode 2. That is, the longer the time to the charging opportunity, the larger the prediction error of the remaining battery level becomes, and the higher the risk of the battery running out. Specifically, in FIG. 14A, when the predicted time to the arrival is 2 hours or more, 1 hour to less than 2 hours, and less than 1 hour, the first threshold is set to 30%, 20%, and 15% of the full charge amount, and the second threshold is set to 15%, 10%, and 10% of the full charge amount, respectively.

[0061] Furthermore, the first and second thresholds may be changed depending on the predicted time available for charging during the charging opportunity, i.e., the predicted time available for charging. FIG. 14B shows correction coefficients multiplied by the first and second thresholds shown in FIG. 14A. This shows a case in which the shorter the time available for charging, the larger the first and second thresholds are. In other words, if the time available for charging is short, sufficient charging cannot be performed, and the risk of running out of battery after charging increases. Note that the setting method is not limited to this.

[0062] As described above, according to this embodiment, the mobile information terminal controls the power saving mode of the mobile information terminal based on the charging opportunity prediction of the mobile information terminal, thereby making it possible to effectively utilize the remaining battery power of the secondary battery, and providing a mobile information terminal and a control method thereof that are highly convenient for the user. EXAMPLES

[0063] In this embodiment, a process will be described in which charging is required even if the power-saving mode is switched by the power-saving mode control described in the first to fifth embodiments.

[0064] FIG. 15 is a processing flow diagram of power management in this embodiment. In FIG. 15, step S61 is a process of switching the power saving mode by the power saving mode control described in the embodiment 1-5. Then, in step S62, for example, the power saving mode is maximum, and it is determined whether charging is necessary based on the power usage situation. For example, a threshold value of the remaining battery capacity is set, and if the remaining battery capacity falls below the threshold, it is determined that charging is necessary. Then, if charging is necessary, in step S63, a charging spot is searched for and recommended to the user. The search is performed by searching for information on the Internet or by searching for surrounding charging spots using a camera or beacon. In step S64, the process returns to step S61 and the power management process is repeated until an end instruction is received, and when an end instruction is received, the power management process is terminated.

[0065] Fig. 16 is a display example of charging spots on a mobile information terminal 1A which is an HMD in this embodiment. In Fig. 16, the outer frame represents the field of view of the user when the HMD is optical see-through, and represents the field of view of the display when the HMD is video see-through.

[0066] 16, a charging spot 61 is an AR object, and is displayed superimposed on an image of the outside world. Also, the current remaining battery level and a predicted remaining battery level may be displayed for each of the mobile information terminals 1A, 1B, and 1C.

[0067] As described above, according to the present embodiment, when charging is necessary, a charging spot can be searched for and recommended to the user, so that a portable information terminal and a control method thereof that are highly convenient for the user can be provided.

[0068] The embodiments have been described above, but the present invention contributes to achieving the Sustainable Development Goals (SDGs), particularly to item 7, energy.

[0069] In addition, the above-mentioned embodiment has been described in detail to explain the present invention in an easy-to-understand manner, and is not necessarily limited to those having all the configurations described. For example, the programs described in each processing example may be independent programs, or a plurality of programs may constitute one application program. In addition, the order of each process may be changed and executed. In addition, the functions of the above-mentioned embodiment are described as being realized by software by a CPU executing an operation program that realizes each function, but some or all of them may be realized by hardware, for example, by designing an integrated circuit. In addition, some or all of each function may be realized by a server. Information such as programs, tables, and files that realize each function may be stored in a memory, a recording device such as a hard disk or SSD (Solid State Drive), or a recording medium such as an IC card, SD card, or DVD, or may be stored in a device on a communication network. In addition, it is possible to replace a part of the configuration of a certain embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of a certain embodiment. In addition, it is possible to add, delete, or replace a part of the configuration of each embodiment with another configuration. [Explanation of symbols]

[0070] 1, 1A to 1C: portable information terminal, 2: portable battery, 3: server, 9: communication network, 10: housing, 11: display surface, 35: power management information, 101: processor, 101C: data processing unit, 101D: data acquisition unit, 102: memory, 103: display, 107: operation input unit, 108: battery, 109: charging control unit, 61: charging spot

Claims

1. A portable information terminal including a secondary battery, a control device, and a storage device, The control device performs power usage prediction and charging opportunity prediction based on the schedule stored in the storage device, and sets power saving modes with different power saving levels for reducing power consumption based on the power usage prediction and the charging opportunity prediction; A portable information terminal characterized in that the remaining battery capacity of the secondary battery at the next charging opportunity is predicted from the power usage prediction and charging opportunity prediction, and if the battery remaining capacity prediction falls below a set lower limit value, the power saving mode is changed so that the power saving level is increased.

2. 2. The portable information terminal according to claim 1, 2. A portable information terminal comprising: a power saving mode setting unit configured to dynamically correct a power saving mode setting for a time on the schedule when the time on the schedule is expected to deviate from an actual usage state, the power saving mode setting being dynamically corrected based on the expected time.

3. 2. The portable information terminal according to claim 1, The power usage forecast is based on the schedule of viewing reservations and high load applications. The charging opportunity prediction is characterized in that a charging opportunity is predicted based on an opportunity to charge and a time when charging is possible.

4. 2. The portable information terminal according to claim 1, The portable information terminal is characterized in that the control device determines whether power can be supplied from another portable information terminal or a portable battery when the remaining battery charge of the secondary battery falls below a set lower limit at the next charging opportunity.

5. A portable information terminal as claimed in claim 1, A portable information terminal characterized in that the set lower limit value is changed according to a predicted arrival time until a charging opportunity, and the set lower limit value is increased as the predicted arrival time until the charging opportunity is longer.

6. A portable information terminal according to claim 5, The portable information terminal is characterized in that the set lower limit value is changed according to a predicted chargeable time at the charging opportunity, and the shorter the predicted chargeable time, the larger the set lower limit value.

7. 2. The portable information terminal according to claim 1, The portable information terminal according to claim 1, wherein the power consumption prediction is performed taking into consideration a user's actual power consumption.

8. 2. The portable information terminal according to claim 1, The portable information terminal is characterized in that the charging opportunity prediction is performed taking into consideration a user's electrical behavior history.

9. A portable information terminal including a secondary battery, a control device, and a storage device, The control device predicts charging opportunities from the schedule stored in the storage device, and sets power saving modes with different power saving levels to reduce power consumption based on the time until the charging opportunity arrives.

10. A portable information terminal as claimed in claim 9, A portable information terminal, comprising: a power saving mode switching threshold value that is set to a larger value as the time until the charging opportunity increases.

11. A portable information terminal as claimed in claim 10, The portable information terminal is characterized in that the threshold value is changed according to a predicted time available for charging at the charging opportunity, and the shorter the predicted time available for charging is, the larger the threshold value is.

12. 2. The portable information terminal according to claim 1, The portable information terminal is characterized in that, when the set power saving mode has a maximum power saving level and charging of the secondary battery is required, the control device searches for a charging spot and notifies a user of the same.

13. A portable information terminal as claimed in claim 12, Equipped with a display, A portable information terminal characterized in that the charging spots are displayed on the display while being superimposed on an external image.

14. A method for controlling a portable information terminal that is powered by a secondary battery, comprising the steps of: Based on the usage schedule, power usage and charging opportunities are predicted. setting a power saving mode having a different power saving level for reducing power consumption of the secondary battery based on the power usage prediction and the charging opportunity prediction; A control method for a portable information terminal, characterized in that a remaining battery capacity of the secondary battery at the next charging opportunity is predicted from the power usage prediction and the charging opportunity prediction, and if the remaining battery capacity prediction falls below a set lower limit value, the power saving mode is changed so that the power saving level is increased.

Images