Calibration execution device and calibration execution method

Abstract

To enable a user to correctly execute calibration of a sensor attached to an electronic device such as a smartphone.SOLUTION: Guide information explaining execution procedures or the like of calibration of various sensors attached to an electronic device such as a smartphone is output. The guide information is instruction information for user processing on a box which is a calibration tool having functions or information usable at the time of execution of calibration, and the box is, for example, an electronic device storage box being packaging of the electronic device such as a smartphone. A user can correctly execute calibration of various sensors such as an acceleration sensor and a gyro by performing processing using the electronic device storage box in accordance with the guide information.SELECTED DRAWING: Figure 11

Description

Technical Field

[0001] The present disclosure relates to a calibration execution device and a calibration execution method. More specifically, for example, it relates to a calibration execution device and a calibration execution method that enable a user to correctly and surely execute calibration, which is an adjustment process for sensors such as an acceleration sensor and a gyro, and devices such as a display, mounted on an electronic device such as a smartphone.

Background Art

[0002] For example, electronic devices such as smartphones are equipped with various sensors such as acceleration sensors, gyros, and proximity sensors, and devices such as displays. The performance of these devices such as sensors may deteriorate when the electronic device is subjected to a strong impact or due to long-term use of the electronic device. Specifically, for example, problems such as errors occurring in the output values of acceleration sensors and gyros may occur.

[0003] In some states in Europe and the United States, the movement to recognize the user's right to repair electronic devices such as smartphones and oblige electronic device manufacturers to provide the parts and tools necessary for the user to repair is spreading worldwide. For example, in the case of a smartphone, it is assumed that the user will replace the battery or the display panel of the smartphone.

[0004] When replacing the battery or the display panel of a smartphone, operations such as removing and reinstalling the cover of the smartphone are performed. When such operations are performed, the positions and stresses of the internal parts of the smartphone change, and as a result, there is a possibility that the accuracy of the sensors decreases due to minute misalignments and distortions of sensors such as acceleration sensors and gyros.

[0005] When the accuracy of the sensor decreases, it is necessary to perform calibration of the sensor, that is, an adjustment process. By calibrating the sensor, it becomes possible to readjust the output value of the sensor to a highly accurate output value.

[0006] When the user replaces the battery or the display panel, it is necessary for the user to calibrate the sensor by themselves. However, it is difficult for a general user without specialized knowledge to correctly execute the calibration process.

[0007] For example, Patent Document 1 (Japanese Patent Application Laid-Open No. 2020-181543) discloses an apparatus in which an electronic device automatically performs calibration without the user being aware of it.

[0008] This patent document discloses a calibration configuration for a touch sensor that detects whether or not a user's finger is touching. Specifically, for example, when it is detected that the user's finger is touching one touch sensor A among a plurality of touch sensors, it is determined that the finger is not touching another touch sensor B, and a calibration process for adjusting the output value of the touch sensor B to an output value indicating that the finger is not touching is disclosed.

[0009] However, the configuration described in this Patent Document 1 is a configuration that does not require the user to perform any special processing or operations when performing calibration. Therefore, for example, it cannot be applied when a process such as rotating the electronic device in a specific sequence during calibration is required.

[0010] For example, in the calibration process of sensors such as an acceleration sensor and a gyro, it is necessary to cause the acceleration sensor and the gyro to perform a certain regular movement. That is, it is necessary to have the user perform a process of regularly moving the electronic device, and the configuration described in Patent Document 1 cannot be applied.

Prior Art Documents

Patent Documents

[0011] [Patent Document 1] Japanese Patent Application Laid-Open No. 2020-181543 [Summary of the Invention] [Problems to be Solved by the Invention]

[0012] The present disclosure has been made, for example, in view of the above problems, and enables calibration of various devices such as sensors and displays mounted on electronic devices such as smartphones to be correctly and reliably executed according to the operations of general users without specialized knowledge. An object is to provide a calibration execution device and a calibration execution method.

[0013] Further, in one embodiment of the present disclosure, there is provided a calibration execution device and a calibration execution method that enable calibration of various devices such as sensors and displays mounted on an electronic device such as a smartphone to be correctly executed by a user using the packaging material of the electronic device. [Means for Solving the Problems]

[0014] A first aspect of the present disclosure is having a data processing unit that outputs guide information for calibration of a device mounted on an electronic device, the data processing unit outputs guide information explaining the processing to be executed by the user when calibrating the device, the guide information is in a calibration execution device including user processing for a box that is a calibration tool having a function or information used when executing calibration.

[0015] Furthermore, a second aspect of the present disclosure is a calibration execution method executed in a calibration execution device, the calibration execution device It has a data processing unit that outputs guide information for calibrating a device mounted on an electronic device. The data processing unit outputs guide information that explains the processing to be executed by the user when calibrating the device, The guide information is in a calibration execution method that includes user processing for a box that is a calibration tool having functions or information used when executing calibration.

[0016] Still other objects, features, and advantages of the present disclosure will become apparent from more detailed descriptions based on embodiments of the present disclosure and the accompanying drawings described below. Note that in this specification, a system is a logical collective configuration of a plurality of devices, and the devices of each configuration are not limited to those within the same housing.

[0017] According to the configuration of an embodiment of the present disclosure, a user can correctly execute calibration of a sensor mounted on an electronic device such as a smartphone. Specifically, for example, guide information explaining the execution procedure and the like of calibration of various sensors mounted on an electronic device such as a smartphone is output. The guide information is instruction information for user processing for a box that is a calibration tool having functions or information that can be used when executing calibration. The box is, for example, an electronic device storage box that is a packaging material for an electronic device such as a smartphone. The user can correctly execute calibration of various sensors such as an acceleration sensor and a gyro by performing processing using the electronic device storage box according to the guide information. With this configuration, a user can correctly execute calibration of a sensor mounted on an electronic device such as a smartphone. Note that the effects described in this specification are merely examples and are not limiting, and there may be additional effects.

Brief Description of the Drawings

[0018]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Figure 27

Figure 28

Figure 29

Figure 30

Figure 31

Figure 32

Figure 33

Figure 34

Figure 35

Figure 36

Embodiments for Carrying Out the Invention

[0019] Hereinafter, details of the calibration execution device and the calibration execution method of the present disclosure will be described with reference to the drawings. The description will be made according to the following items. 1. Regarding devices such as sensors mounted on a smartphone 2. Details of the calibration process for the acceleration sensor and gyro 3. Details of the calibration process for the proximity sensor 4. Details of the calibration process for the illuminance sensor and RGB sensor 5. Details of the calibration process for the display unit (display) 6. About the processing sequence executed by the calibration execution device 7. About other embodiments 8. Example of the hardware configuration of the calibration execution device 9. Summary of the configuration of the present disclosure

[0020] [1. About devices such as sensors mounted on a smartphone] First, devices such as sensors mounted on a smartphone will be described.

[0021] FIG. 1 shows an example of the (a) front configuration and (b) back configuration of the smartphone 10. As shown in the figure, various sensors and devices such as a display are mounted on the smartphone 10.

[0022] In the (a) front configuration of the smartphone 10 in FIG. 1, a front camera 11, a proximity sensor 12, an illuminance sensor 13, an RGB sensor 14, a display unit (display) 15, a fingerprint sensor 16, and a touch sensor 17 are shown. Also, in the (b) back configuration, a main camera (rear camera) 18, an illuminance sensor 19, an RGB sensor 20, and a distance sensor (TOF sensor) 21 are shown.

[0023] The proximity sensor 12 is a sensor that detects whether the distance between the smartphone 10 and another object is greater than or equal to a specified distance (threshold distance) or less than the specified distance (threshold distance). The proximity sensor 12 is composed of, for example, a far-infrared light-emitting element and a light-receiving element, and detects the reflected light of the output light of the light-emitting element with the light-receiving element to detect whether the distance between the smartphone 10 and another object is equal to or greater than a specified distance (threshold distance) or less than the specified distance (threshold distance).

[0024] The proximity sensor 12 is used, for example, when making a call using the smartphone 10 to detect that the smartphone 10 has approached a person's face and turn off the display unit 15, or to detect that the call has ended and the smartphone 10 has been moved away from the face and turn on the display unit 15, etc.

[0025] The illuminance sensor 13 and the RGB sensor 14 are sensors that detect the color and illuminance of ambient light during image capture using a camera such as the front camera 11. Based on the detection information of these illuminance sensor 13 and RGB sensor 14, camera shooting control, such as white balance control and shutter speed control, etc. is executed. It is also used for control processing such as output luminance control of the display unit 15.

[0026] The fingerprint sensor 16 is a sensor that verifies the fingerprint of the user and is a sensor used for user authentication. The touch sensor 17 is provided on the entire surface of the display unit 15 and is used to detect the touch position of the user's finger and execute processing according to the detected position.

[0027] The illuminance sensor 19 and the RGB sensor 20 on the back of the smartphone 10 detect the color and illuminance of the ambient light during image capture using the main camera (rear camera) 18. It is also used for control processing such as output luminance control of the display unit 15. The distance sensor (TOF sensor) 21 is a sensor that measures the distance to the subject, and based on the sensor detection information, focus control of the camera is performed.

[0028] In addition to these sensors, the smartphone 10 also stores sensors inside the smartphone. Figure 2 is a diagram showing an example of the sensors mounted inside the smartphone 10. As shown in FIG. 2, inside the smartphone 10, an IMU (Inertial Measurement Unit) 24 is mounted on a substrate, and an acceleration sensor 25 and a gyro 26 are installed inside the IMU (Inertial Measurement Unit) 24.

[0029] The acceleration sensor 25 is a sensor that measures the linear acceleration of the smartphone 10 and can detect linear movement, vibration, tilt, etc. of the smartphone 10. The gyro 26 is a sensor that detects the rotational speed of the smartphone 10 and can detect the rotation direction and rotation angle of the smartphone 10.

[0030] Referring to FIG. 3, an example of the detection information of the acceleration sensor 25 and the gyro 26 will be described. FIG. 3(1) is a diagram for explaining an example of the detection information of the acceleration sensor 25. The acceleration sensor 25 can detect the orientation and tilt of the smartphone 10. As shown in FIG. 3(1), for example, it is possible to detect the postures of the smartphone 10 such as (a) to (d).

[0031] (a) shows a state where the front surface of the smartphone 10, that is, the display unit side, is set upward. (b) shows a horizontal posture state with the right side of the smartphone 10 facing up. (c) shows a vertical posture state with the upper side of the smartphone 10 facing up. (d) shows a state where the back side of the smartphone 10 is facing up.

[0032] The acceleration sensor 25 detects various posture states of the smartphone as shown in, for example, (a) to (d) of FIG. 3(1). Note that the postures shown in (a) to (d) of FIG. 3(1) are just examples, and it is possible to detect various other postures of the smartphone 10.

[0033] The posture detection information of the smartphone by the acceleration sensor 25 is used, for example, for rotation processing of the display data of the display unit 15. Specifically, if the smartphone 10 is in the vertical orientation, a vertical image can be displayed, and if the smartphone 10 is in the horizontal orientation, a horizontal image can be displayed.

[0034] Figure 3(2) is a diagram for explaining an example of detection information of the gyro 26. The gyro 26 detects the rotation direction and rotation angle of the smartphone 10. As shown in Figure 3(2), the gyro 26 detects the rotation direction and rotation angle around each axis of the three axes (x, y, z) with the center of the smartphone 10 as the origin.

[0035] The example shown in the figure is an example in which the x-axis is set to the right direction, the y-axis is set to the upward direction, and the z-axis is set to the depth direction of the vertically oriented smartphone 10, and the gyro 26 detects the rotation direction and rotation angle of the smartphone 10 around these three axes.

[0036] The detection information of the gyro 26 is used, for example, for camera shake correction, rotation processing of display data of the display unit 15, and movement control of characters and background images in a game application displayed on the display unit 15.

[0037] In this way, various sensors are installed in the smartphone 10. However, these sensors may have reduced accuracy when the smartphone 10 receives a strong impact or due to long-term use of the smartphone 10. For example, if an error occurs in the measurement data of the acceleration sensor or gyro, a situation may occur where correct control cannot be executed.

[0038] Also, as described above, it is expected that the number of cases where the user himself / herself performs repair work such as battery replacement will increase in the future. When replacing the battery or display panel of the smartphone 10, it is necessary to remove and reinstall the cover of the smartphone 10, etc. At this time, minute position changes and stress changes occur inside the smartphone housing. As a result, the accuracy of the acceleration sensor and gyro inside the smartphone is likely to decrease.

[0039] The present disclosure enables a general user without specialized knowledge to correctly and reliably perform calibration of various devices such as sensors and displays mounted on an electronic device such as a smartphone. Hereinafter, details of the calibration execution device and calibration execution method of the present disclosure will be described.

[0040] [Details of Calibration Processing for Acceleration Sensor and Gyroscope] Next, details of the calibration processing for the acceleration sensor and the gyroscope will be described.

[0041] The following-described embodiment is an embodiment in which calibration of the acceleration sensor 25 and the gyroscope 26 mounted on the smartphone 10 is performed using a smartphone storage box, which is a packaging material for storing the smartphone 10.

[0042] Fig. 4 shows an example of a smartphone storage box 30, which is a packaging material for storing the smartphone 10. The smartphone storage box 30 is a box that can store the smartphone 10 and can be received when the user purchases the smartphone 10 or later when it is required, such as during smartphone repair. The user can use this smartphone storage box 30 to perform calibration of the acceleration sensor 25 and the gyroscope 26 mounted on the smartphone 10. The smartphone storage box 30 used in the processing of the present disclosure is a calibration tool having functions or information that can be used when performing calibration.

[0043] As shown in Fig. 4, the smartphone storage box 30 has a rectangular parallelepiped shape. Numbers are recorded (printed) on each of the six surfaces constituting the smartphone storage box 30. A specific example will be described with reference to Fig. 5. As shown in Fig. 5, numbers are recorded (printed) on each of the six surfaces constituting the smartphone storage box 30. Fig. 5 shows each view of the (a) front side and (b) back side of the smartphone storage box 30.

[0044] As shown in Fig. 5, [1] is recorded on the upper surface of the smartphone storage box 30, [2] on the right side surface, [5] on the left side surface, [4] on the upper side surface, [6] on the lower side surface, and [3] on the bottom surface. As shown in FIG. 5, these numbers 1 to 6 are calibration execution procedure identification numbers 31.

[0045] The user stores the smartphone 10 in the smartphone storage box 30 and rotates the smartphone storage box 30 according to the voice guidance output from the smartphone 10. The calibration execution procedure identification number 31 indicates this rotation procedure.

[0046] With reference to FIG. 6, the outline of the execution procedure for calibrating the acceleration sensor 25 and the gyro 26, which is executed according to the voice guidance output from the smartphone 10, will be described.

[0047] FIG. 6 is a diagram showing an example of the execution procedure for calibrating the acceleration sensor 25 and the gyro 26 in the smartphone 10. As shown in FIG. 6, the calibration of the acceleration sensor 25 and the gyro 26 can be executed by rotating the smartphone storage box 30 in which the smartphone 10 is stored.

[0048] For example, place the smartphone storage box 30 in which the smartphone 10 is stored on a table and rotate the smartphone storage box 30 in the order of steps S01 to S06 shown in FIG. 6.

[0049] That is, the smartphone storage box 30 in which the smartphone 10 is stored is sequentially rotated as in the following steps S01 to S06. (Step S01) Set the upper surface upward. (Step S02) Set the right side surface upward. (Step S03) Set the bottom surface upward. (Step S04) Set the upper side surface upward. (Step S05) Set the left side surface upward. (Step S06) Set the lower side surface upward.

[0050] In this way, by performing a process of sequentially rotating the six surfaces that make up the smartphone storage box 30 storing the smartphone 10 upward, calibration of the acceleration sensor 25 and the gyro 26 in the smartphone 10 can be performed.

[0051] The user stores the smartphone 10 in the smartphone storage box 30 and performs a process of rotating it according to the calibration execution procedure identification numbers 31 recorded on each surface of the smartphone storage box 30, that is, in the order of 1 to 6. Note that during calibration execution, a guide voice is output from the speaker of the smartphone 10 stored in the smartphone storage box 30, and the user may rotate the smartphone storage box 30 according to the instructions of the guide voice.

[0052] With reference to FIG. 7 and below, the details of the processing procedure when the user performs calibration processing of the acceleration sensor 25 and the gyro 26 in the smartphone 10 will be described.

[0053] FIG. 7 is a diagram showing an example of a UI (user interface) which is a user operation screen displayed on the smartphone 10.

[0054] FIG. 7(a) shows an example in which the user displays "(a) Setting process screen (UI)" on the display unit 15 of the smartphone 10 and selects "Sensor Calibration" from the displayed "(a) Setting process screen (UI)". FIG. 7(b) shows an example of a "(b) Sensor selection screen (UI)" displayed on the display unit 15 of the smartphone 10 by the user's "Sensor Calibration" selection process. The user can select a sensor to be calibrated from the "(b) Sensor selection screen (UI)" displayed on the display unit 15.

[0055] The example of the "(b) Sensor Selection Screen (UI)" shown in FIG. 7 is an example in which the following sensors can be selected as the calibration execution target. * Acceleration sensor & gyro * Proximity sensor * Illuminance sensor & RGB sensor * Distance sensor :

[0056] Each of these sensors has a different calibration execution algorithm. According to the sensor selected by the user as the calibration execution target sensor from the "(b) Sensor Selection Screen (UI)" shown in FIG. 7, the calibration execution program corresponding to the selected sensor is started, and guidance display and voice guidance according to the program are started.

[0057] By using the UI shown in FIG. 7, the user can start the calibration of any sensor at any timing. However, the example of starting sensor calibration using the UI shown in FIG. 7 is just one example.

[0058] In addition to the example using such a UI, for example, when it is necessary to execute sensor calibration, a configuration may be adopted in which a process of notifying the user to execute calibration is performed.

[0059] For example, when the user replaces the battery of the smartphone 10 or when the user replaces the display panel, after the replacement is completed, a notification prompting the execution of the calibration of the acceleration sensor and the gyro is executed, and the calibration execution program may be started according to the response of the user.

[0060] Specifically, for example, immediately after the user replaces the battery of the smartphone 10, a "(c) Sensor Calibration Execution Request Notification Screen (UI)" as shown in FIG. 8 is displayed on the display unit (display) 15 of the smartphone 10. When the user taps "Execute", the calibration execution program is started.

[0061] Also, a configuration may be adopted in which a notification is executed to prompt execution of calibration of a sensor for which a decrease in accuracy is predicted at the timing of the elapse of a predetermined period of time, such as one year, two years, etc., from the start of use of the smartphone 10. Furthermore, a configuration may be adopted in which a notification is executed to prompt execution of calibration of a sensor for which a decrease in accuracy is predicted even when the smartphone 10 is dropped or when a strong impact is detected.

[0062] For example, when the user selects "Acceleration sensor & Gyro" as the sensor to be calibrated from the "(b) Sensor selection screen (UI)" shown in FIG. 7, or when the user taps "Execute" on the "(c) Sensor calibration execution request notification screen (UI)" shown in FIG. 8, the data processing unit of the smartphone 10 starts a calibration execution program for the acceleration sensor and the gyro.

[0063] When the calibration execution program for the acceleration sensor and the gyro is started, first, the data processing unit of the smartphone 10 displays an explanation (guide information) regarding the execution procedure of calibration of the acceleration sensor and the gyro on the display unit (display) 15. A specific example is shown in FIG. 9.

[0064] As shown in FIG. 9, the following explanation (guide information) regarding the execution procedure of calibration of the acceleration sensor and the gyro is displayed on the display unit (display) 15 of the smartphone 10. (1) Tap "Start calibration" at the bottom and store the smartphone in the smartphone storage box. (2) Rotate the smartphone storage box so that each of the six sides numbered 1 to 6 faces upward in accordance with the guidance voice. (3) When the calibration is completed, it will be announced by voice.

[0065] The user checks this explanation (guide information), taps "Calibration Start" displayed at the bottom of the display unit according to the explanation (guide information), and stores the smartphone 10 in the smartphone storage box 30.

[0066] That is, after the user taps "Calibration Start", the user stores the smartphone 10 in the smartphone storage box 30 as shown in FIG. 10. Thereafter, an audio guide is output via the speaker of the smartphone 10. The user executes the process according to this audio guide.

[0067] Referring to FIGS. 11 and 12, the detailed sequence of the calibration process of the acceleration sensor 25 and the gyro 26 executed by the calibration execution program inside the smartphone 10 according to the audio guide output from the speaker of the smartphone 10 and the user operation executed by the user according to this audio guide will be described.

[0068] The processes of steps S101 to S125 shown in FIGS. 11 to 12 are executed in order. Hereinafter, the processes of each step will be sequentially described.

[0069] (Step S101) The process of step S101 is a process executed by the user. In step S101, the user taps "Calibration Start" displayed on the display unit (display) 15 of the smartphone 10 described above with reference to FIG. 9, and stores the smartphone 10 in the smartphone storage box 30.

[0070] (Step S102) The process of step S102 is a process executed by the smartphone 10, and is executed by the data processing unit of the smartphone 10 under the control of the calibration execution program. In step S102, the data processing unit of the smartphone 10 outputs the following message as an operation instruction (guide message) to the user via the speaker. Please place [1] in an upward direction on a sufficiently wide table and keep it stationary.

[0071] Note that [1] in the message is the calibration execution procedure identification number 31 recorded on the upper surface of the smartphone storage box 30, as described with reference to FIGS. 5 and 6 above.

[0072] (Step S103) The process of step S103 is a process executed by the user. The user places the smartphone 10 on the table in a stationary state with the surface where the calibration execution procedure identification number 31 recorded on the smartphone storage box 30 storing the smartphone 10, i.e., the upper surface, facing upward in accordance with the guide message output by the smartphone 10 in step S102.

[0073] (Step S104) The process of step S104 is a process executed by the smartphone 10, and is executed by the data processing unit of the smartphone 10 under the control of the calibration execution program. The data processing unit of the smartphone 10 acquires and internally holds the detected value of the acceleration sensor 25 in step S104.

[0074] Note that in the calibration of the acceleration sensor 25 performed here, it is not necessary to consider the direction of the smartphone 10, i.e., the absolute attitude. Regardless of the direction in which the smartphone 10 is placed, the calibration of the acceleration sensor 25 is performed by solving the error minimization problem based on the fact that the gravitational acceleration G is about 9.8 [m / s 2 . After the process of acquiring and internally holding the detected value of the acceleration sensor 25 in step S104 is completed, the next process is proceeded to.

[0075] (Step S105) The process of step S105 is a process executed by the smartphone 10, and is executed by the data processing unit of the smartphone 10 under the control of the calibration execution program. The data processing unit of the smartphone 10 outputs the following message as an operation instruction (guide message) to the user via the speaker in step S105. "Rotate it so that [2] faces upward without lifting the box, and keep it stationary."

[0076] Note that [2] in the message is the calibration execution procedure identification number 31 recorded on the right side surface of the smartphone storage box 30 as described above with reference to FIGS. 5 and 6.

[0077] The user rotates the smartphone storage box 30 so that the surface of [2], that is, the right side surface, of the smartphone storage box 30 in which the smartphone 10 is stored faces upward in accordance with this guide message.

[0078] (Step S106) The process of step S106 is a process executed by the smartphone 10, and is executed by the data processing unit of the smartphone 10 under the control of the calibration execution program.

[0079] Note that this rotation process is a process executed for the calibration of the gyro 26. Calibration of the gyro 26 is executed by solving the problem of minimizing the error that the integrated value of the gyro 26 when the smartphone 10 is rotated is the attitude change = acceleration change.

[0080] Due to the rotation process of the smartphone storage box 30, the smartphone 10 stored in the smartphone storage box 30 also rotates. This rotation corresponds to a 90-degree counterclockwise rotation about the Y axis among the xyz3 axes described above with reference to FIG. 3(2). The data processing unit of the smartphone 10 observes the output of the gyro 26 during rotation and holds the integrated value internally. When this process is completed, the process proceeds to the next step.

[0081] (Step S107) The process of step S107 is a process executed by the user. The user places the smartphone storage box 30 storing the smartphone 10 on the table and keeps it stationary with the side where the calibration execution procedure identification number 31 recorded on the smartphone storage box 30 storing the smartphone 10 is [2], that is, the right side face, facing upward, in accordance with the guide message output by the smartphone 10 in step S105.

[0082] (Step S108) The process of step S108 is a process executed by the smartphone 10 and is executed by the data processing unit of the smartphone 10 under the control of the calibration execution program. The data processing unit of the smartphone 10 acquires and internally holds the detection value of the acceleration sensor in step S108.

[0083] When the process of the data processing unit of the smartphone 10 acquiring the detection value of the acceleration sensor 25 and storing it in the storage unit of the smartphone 10 is completed in step S108, the next process is proceeded to.

[0084] (Step S109) The process of step S109 is a process executed by the smartphone 10 and is executed by the data processing unit of the smartphone 10 under the control of the calibration execution program. The data processing unit of the smartphone 10 outputs the following message as an operation instruction (guide message) to the user in step S109 via the speaker. "Rotate the box without lifting it so that [3] faces upward and keep it in a stationary state."

[0085] Note that [3] in the message is the calibration execution procedure identification number 31 recorded on the bottom surface of the smartphone storage box 30 as described above with reference to FIGS. 5 and 6.

[0086] The user rotates the smartphone storage box 30 so that the [3] face of the smartphone storage box 30 storing the smartphone 10, that is, the bottom face, faces upward in accordance with this guide message.

[0087] (Step S110) The process of step S110 is a process executed by the smartphone 10, and is executed by the data processing unit of the smartphone 10 under the control of the calibration execution program.

[0088] By the rotation process of the smartphone storage box 30, the smartphone 10 stored in the smartphone storage box 30 also rotates. This rotation corresponds to a 90-degree counterclockwise rotation with respect to the Y-axis among the xyz3 axes described with reference to FIG. 3(2) above.

[0089] The data processing unit of the smartphone 10 observes the output of the gyro 26 during rotation and holds the integrated value internally. When this process is completed, it proceeds to the next step.

[0090] (Step S111) The process of step S111 is a process executed by the user. The user places the smartphone 10 on the table and sets it stationary with the calibration execution procedure identification number 31 recorded on the smartphone storage box 30 storing the smartphone 10 facing upward, i.e., the bottom surface, according to the guide message output by the smartphone 10 in step S109.

[0091] (Step S112) The process of step S112 is a process executed by the smartphone 10, and is executed by the data processing unit of the smartphone 10 under the control of the calibration execution program. The data processing unit of the smartphone 10 acquires the detection value of the acceleration sensor in step S112 and holds it internally.

[0092] When the process of the data processing unit of the smartphone 10 acquiring the detection value of the acceleration sensor 25 and storing it in the storage unit of the smartphone 10 in step S112 is completed, it proceeds to the next process.

[0093] (Step S113) The process of step S113 is a process executed by the smartphone 10, and is executed by the data processing unit of the smartphone 10 under the control of the calibration execution program. The data processing unit of the smartphone 10 outputs the following message as an operation instruction (guide message) to the user via the speaker in step S113. "Rotate it so that [4] faces upward without lifting the box, and keep it stationary."

[0094] Note that [4] in the message is the calibration execution procedure identification number 31 recorded on the upper side surface of the smartphone storage box 30 as described above with reference to FIGS. 5 and 6.

[0095] The user rotates the smartphone storage box 30 so that the [4] surface, that is, the upper side surface of the smartphone storage box 30 in which the smartphone 10 is stored, faces upward according to this guide message.

[0096] (Step S114) The process of step S114 is a process executed by the smartphone 10, and is executed by the data processing unit of the smartphone 10 under the control of the calibration execution program.

[0097] Due to the rotation process of the smartphone storage box 30, the smartphone 10 stored in the smartphone storage box 30 also rotates. This rotation corresponds to a 90-degree clockwise rotation with respect to the X axis among the xyz3 axes described above with reference to FIG. 3(2).

[0098] The data processing unit of the smartphone 10 observes the output of the gyro 26 during rotation and internally holds its integral value. When this process is completed, it proceeds to the next step.

[0099] (Step S115) The process of step S115 is a process executed by the user. The user sets the calibration execution procedure identification number 31 recorded on the smartphone storage box 30 in which the smartphone 10 is stored so that the [4] surface, that is, the upper side surface, faces upward and places it on the table and keeps it stationary according to the guide message output by the smartphone 10 in step S113.

[0100] (Step S116) The process of step S116 is a process executed by the smartphone 10, and is executed by the data processing unit of the smartphone 10 under the control of the calibration execution program. The data processing unit of the smartphone 10 acquires and internally holds the detection value of the acceleration sensor in step S116.

[0101] When the process in which the data processing unit of the smartphone 10 acquires the detection value of the acceleration sensor 25 and stores it in the storage unit of the smartphone 10 is completed in step S116, the next process is proceeded to.

[0102] (Step S117) The process of step S117 is a process executed by the smartphone 10, and is executed by the data processing unit of the smartphone 10 under the control of the calibration execution program. The data processing unit of the smartphone 10 outputs the following message as an operation instruction (guide message) to the user through the speaker in step S117. "Rotate so that [5] faces upward without lifting the box and keep it in a stationary state."

[0103] Note that [5] in the message is the calibration execution procedure identification number 31 recorded on the left side surface of the smartphone storage box 30 as described with reference to FIGS. 5 and 6 above.

[0104] The user rotates the smartphone storage box 30 so that the [5] surface of the smartphone storage box 30 in which the smartphone 10 is stored, that is, the left side surface, faces upward in accordance with this guide message.

[0105] (Step S118) The process of step S118 is a process executed by the smartphone 10, and is executed by the data processing unit of the smartphone 10 under the control of the calibration execution program.

[0106] By rotating the smartphone storage box 30, the smartphone 10 stored in the smartphone storage box 30 also rotates. This rotation corresponds to a 90-degree counterclockwise rotation with respect to the Z-axis among the xyz3 axes described with reference to FIG. 3(2) above.

[0107] The data processing unit of the smartphone 10 observes the output of the gyro 26 during rotation and holds the integrated value internally. When this process is completed, it proceeds to the next step.

[0108] (Step S119) The process of step S119 is a process executed by the user. The user places the smartphone 10 in the smartphone storage box 30 with the calibration execution procedure identification number 31 recorded on the [5] side, that is, the left side surface, facing upward and stationary on the table according to the guide message output by the smartphone 10 in step S117.

[0109] (Step S120) The process of step S120 is a process executed by the smartphone 10, and is executed by the data processing unit of the smartphone 10 under the control of the calibration execution program. The data processing unit of the smartphone 10 acquires the detection value of the acceleration sensor in step S120 and holds it internally.

[0110] When the process of the data processing unit of the smartphone 10 acquiring the detection value of the acceleration sensor 25 and storing it in the storage unit of the smartphone 10 in step S120 is completed, it proceeds to the next process.

[0111] (Step S121) The process of step S121 is a process executed by the smartphone 10, and is executed by the data processing unit of the smartphone 10 under the control of the calibration execution program. The data processing unit of the smartphone 10 outputs the following message as an operation instruction (guide message) to the user in step S121 via the speaker. "Rotate the box so that [6] is facing upward without lifting the box and keep it in a stationary state."

[0112] Note that, as described above with reference to FIGS. 5 and 6, [6] in the message is the calibration execution procedure identification number 31 recorded on the lower side surface of the smartphone storage box 30.

[0113] The user rotates the smartphone storage box 30 so that the surface of [6] of the smartphone storage box 30 in which the smartphone 10 is stored, that is, the lower side surface, faces upward in accordance with this guide message.

[0114] (Step S122) The process of step S122 is a process executed by the smartphone 10, and is executed by the data processing unit of the smartphone 10 under the control of the calibration execution program.

[0115] Due to the rotation process of the smartphone storage box 30, the smartphone 10 stored in the smartphone storage box 30 also rotates. This rotation corresponds to a 90-degree clockwise rotation with respect to the Z-axis among the xyz3 axes described above with reference to FIG. 3(2).

[0116] The data processing unit of the smartphone 10 observes the output of the gyro 26 during rotation and holds the integrated value internally. When this process is completed, the process proceeds to the next step.

[0117] (Step S123) The process of step S123 is a process executed by the user. The user sets the calibration execution procedure identification number 31 recorded on the smartphone storage box 30 in which the smartphone 10 is stored so that the surface of [6], that is, the lower side surface, faces upward and places it on the desk and keeps it stationary in accordance with the guide message output by the smartphone 10 in step S121.

[0118] (Step S124) The process of step S124 is a process executed by the smartphone 10, and is executed by the data processing unit of the smartphone 10 under the control of the calibration execution program. The data processing unit of the smartphone 10 acquires and internally holds the detection value of the acceleration sensor in step S124.

[0119] Furthermore, the data processing unit of the smartphone 10 executes the following processing in step S124. Using the six acceleration values acquired by the acceleration sensor 25 in the above-described six steps S104, S108, S112, S116, S120, and S124, solve the error minimization problem based on the fact that the gravitational acceleration G is approximately 9.8 [m / s 2 and execute the adjustment process of the acceleration sensor 25, that is, the calibration of the acceleration sensor 25. Furthermore, using the integrated values of the gyro 26 acquired in the above-described five steps S106, S110, S114, S118, and S122, solve the error minimization problem that the integrated value of the gyro 26 when the smartphone 10 is rotated is the attitude change = acceleration change, and execute the adjustment process of the gyro 26, that is, the calibration of the gyro 26. When the adjustment processes of the acceleration sensor 25 and the gyro 26 are completed in this way, the process proceeds to the next step S125.

[0120] (Step S125) The process of step S125 is a process executed by the smartphone 10, and is executed by the data processing unit of the smartphone 10 under the control of the calibration execution program. The data processing unit of the smartphone 10 outputs the following message as an operation instruction (guide message) to the user in step S125 via the speaker. "Calibration has been completed"

[0121] Based on this guide message, the user confirms that the calibration of the acceleration sensor 25 and the gyro 26 has been completed. Then, the user takes out the smartphone 10 from the smartphone storage box 30 and shifts to the normal usage state.

[0122] As described above, the user stores the smartphone 10 in the smartphone storage box 30 and rotates the smartphone storage box 30 according to the voice guidance output via the speaker of the smartphone 10. As a result, it becomes possible to have the user correctly perform the operations necessary for the calibration of the acceleration sensor 25 and the gyro 26, and the calibration of the acceleration sensor 25 and the gyro 26 in the smartphone 10 can be completed.

[0123] In the above description, the process of checking whether the user has completed the process according to the voice guidance, for example, the rotation of the smartphone storage box 30, is not executed. However, for example, the user may be made to utter "It has rotated" or "Ready", and the microphone of the smartphone 10 acquires this utterance to confirm the completion of the user's process and proceed to the next step.

[0124] Alternatively, a configuration may be adopted in which a guide voice including a time limit until the completion of user processing, such as "Please rotate within 10 seconds", is used during the voice guidance output from the smartphone 10, or a countdown voice for notifying the remaining time until the completion of the user's processing is output after the voice guidance is output.

[0125] In the above processing example, the adjustment (calibration) of the acceleration sensor 25 is executed during the stationary time after the smartphone storage box 30 is rotated, and the user is made to wait during this execution period. A configuration may be adopted in which voice data such as "beep beep beep" or "Adjusting" is output from the smartphone 10 during this period to notify that the process is being correctly performed.

[0126] Also, when the user executes a process different from the voice guidance output by the smartphone 10, for example, when the smartphone 10 outputs a voice guidance such as "Rotate [2] upward without lifting the box and keep it stationary", but the user sets [3] upward anyway, the data processing unit of the smartphone 10 may be configured to output a notification to the user that an incorrect process has been performed and a voice guidance for redoing the process.

[0127] The data processing unit of the smartphone 10 acquires the sensor detection values of the acceleration sensor 25 and the gyro 26 even during the calibration execution. Even if there are some errors in these sensor detection values, it is possible to detect whether the orientation and rotation direction of the smartphone storage box 30 storing the smartphone 10 are significantly different from the voice guidance, and based on this detection data, it is determined whether the user operation has been performed correctly.

[0128] In this way, when the data processing unit of the smartphone 10 determines based on the sensor detection values of the acceleration sensor 25 and the gyro 26 that the process executed by the user is different from the instruction of the voice guidance, it outputs a voice guidance indicating that the process executed by the user is incorrect and for redoing the process.

[0129] Note that there is also a method of calibrating the acceleration sensor 25 alone or only in one posture, instead of the simultaneous calibration of the acceleration sensor 25 and the gyro 26 by the rotation method described above. In this case, a level is attached to the smartphone storage box 30, and a guidance message is output instructing the user to check the level and place the smartphone storage box 30 on a horizontal plane. For example, when set in the posture of "(a) Up (UP) direction = front surface" in Fig. 3(1), the Down direction should be 1G and the other directions should be 0G, which is the correct value. A method of calculating the difference between this correct value and the output value of the actual acceleration sensor 25 as a correction value can be applied.

[0130] [3. Details of the calibration process of the proximity sensor] Next, the details of the calibration process of the proximity sensor will be described.

[0131] As described above with reference to FIG. 1, the proximity sensor 12 is a sensor that detects whether the distance between the smartphone 10 and another object is equal to or greater than a specified distance (threshold distance) or less than the specified distance (threshold distance). As described above, the proximity sensor 12 is composed of, for example, a light emitting element and a light receiving element for far infrared rays, and detects the reflected light of the output light of the light emitting element with the light receiving element, and based on the intensity of the detection signal, determines whether the distance between the smartphone 10 and another object is equal to or greater than a specified distance (threshold distance) or less than the specified distance (threshold distance).

[0132] The proximity sensor 12 is used, for example, when performing a process of turning off the display unit 15 by detecting that the smartphone 10 has approached the ear when making a call using the smartphone 10, or a process of turning on the display unit 15 by detecting that the call has ended and the smartphone 10 has been removed from the ear.

[0133] An example of using the proximity sensor 12 will be described with reference to FIG. 13. The proximity sensor 12 is attached to the upper part of the smartphone 10 shown in FIG. 13. (1) in the upper right of FIG. 13 shows a state where the user is making a call using the smartphone 10. In such a case, the proximity sensor 12 detects that the smartphone 10 has approached an object, that is, the user's face, and the distance between the smartphone 10 and the object (user's face) has become less than the threshold distance. Based on this detection result, the data processing unit of the smartphone 10 turns off the display unit (display) 15 of the smartphone 10.

[0134] On the other hand, (2) in the lower right of FIG. 13 shows a state where the user has ended a call using the smartphone 10 and moved the smartphone 10 away from the face. In such a case, the proximity sensor 12 detects that the distance between the smartphone 10 and the object (user's face) has become equal to or greater than the threshold distance. Based on this detection result, the data processing unit of the smartphone 10 turns on the display unit (display) 15 of the smartphone 10.

[0135] In this way, the proximity sensor 12 detects whether the distance between the smartphone 10 (=proximity sensor 12) and the object is equal to or greater than a threshold value.

[0136] With reference to FIG. 14 and below, the detailed calibration procedure of the proximity sensor 12 mounted on the smartphone 10 will be described.

[0137] FIG. 14 is a diagram showing an example of a UI (user interface), which is a user operation screen displayed on the smartphone 10, similar to that described above with reference to FIG. 7.

[0138] FIG. 14(a) shows an example in which the user displays “(a) Setting process screen (UI)” on the display unit 15 of the smartphone 10 and selects “Sensor calibration” from the displayed “(a) Setting process screen (UI)”. FIG. 14(b) shows an example of a “(b) Sensor selection screen (UI)” displayed on the display unit 15 of the smartphone 10 by the “Sensor calibration” selection process by the user. The user can select a sensor to be calibrated from the “(b) Sensor selection screen (UI)” displayed on the display unit 15.

[0139] The example shown in FIG. 14 shows an example in which the user selects “Proximity sensor” as the sensor to be calibrated from the “(b) Sensor selection screen (UI)”.

[0140] Similar to the calibration processes of the acceleration sensor and gyroscope described above, the UI shown in FIG. 14 is an example of a UI used when starting sensor calibration. By using the UI shown in FIG. 14, the user can start the calibration of any sensor at any timing.

[0141] In addition to the example using such a UI, a configuration using a UI similar to the UI described with reference to FIG. 8 above may also be employed. That is, when it becomes necessary to execute calibration of the sensor, a UI that notifies the user to execute the calibration may be used.

[0142] When the user selects the "proximity sensor" as the sensor for which calibration is to be executed from the "(b) Sensor Selection Screen (UI)" shown in FIG. 14, the data processing unit of the smartphone 10 starts a calibration execution program for the proximity sensor.

[0143] When the calibration execution program for the proximity sensor is started, first, the data processing unit of the smartphone 10 displays on the display unit (display) 15 an explanation (guide information) regarding the execution procedure of the calibration of the proximity sensor. A specific example is shown in FIG. 15.

[0144] As shown in FIG. 15, the following explanation (guide information) regarding the execution procedure of the calibration of the proximity sensor is displayed on the display unit (display) 15 of the smartphone 10. (1) Align the above line with the entrance of the box tool and tap "Start Calibration" at the bottom. (2) When the calibration is completed, you will be notified by voice.

[0145] The user checks this explanation (guide information), aligns the alignment line 41 displayed on the display unit (display) 15 of the smartphone 10 with the entrance of the box tool according to the explanation (guide information), and taps "Start Calibration" displayed at the bottom of the display unit.

[0146] With reference to FIG. 16, a specific example of the processing executed by the user according to the guide information displayed on the smartphone 10 will be described. FIG. 16 shows a box-type proximity sensor calibration tool 50. The user inserts the smartphone 10 through the entrance of the proximity sensor calibration tool 50, arranges it so that the alignment line 41 displayed on the display unit (display) 15 of the smartphone 10 is aligned with the entrance of the proximity sensor calibration tool 50, and taps "Calibration Start" displayed at the bottom of the display unit.

[0147] When the data processing unit of the smartphone 10 detects the tap operation of "Calibration Start" by the user, it starts the calibration execution program of the proximity tool 12.

[0148] Note that the distance (L) between the lower surface of the A side (the inner surface of the box) of the proximity sensor calibration tool 50 shown in FIG. 16 and the surface of the smartphone 10 (the mounting position of the proximity sensor 12) is set to the distance at which the proximity sensor 12 detects a proximity object (= threshold distance).

[0149] That is, if the distance from the surface of the smartphone 10 (the mounting position of the proximity sensor 12) to an object such as a human face is L or more, the proximity sensor 12 outputs a sensor detection value (for example, 0) indicating "no proximity object", and if the distance to the object is less than L, the proximity sensor 12 outputs a sensor detection value (for example, 1) indicating "proximity object present".

[0150] The calibration process of the proximity sensor 12 using the proximity sensor calibration tool 50 shown in FIG. 16 is executed as a process for correctly storing the threshold distance L of the proximity sensor 12 in the smartphone 10.

[0151] Note that a gray card 51 is attached to the lower surface of the A side (the inner surface of the box) of the proximity sensor calibration tool 50 shown in FIG. 16, that is, the surface facing the proximity sensor 12 of the smartphone 10, as shown in the upper right of FIG. 16. The gray card 51 is a sheet having a predetermined reflectance, for example, a reflectance of 18%. This is a sheet having a reflectance approximately equal to that of a human face, for example.

[0152] As described above, the proximity sensor 12 is composed of, for example, a far-infrared light emitting element and a light receiving element, and detects the reflected light of the output light of the light emitting element with the light receiving element, and based on the intensity of the detection signal, determines whether the distance between the smartphone 10 and another object is equal to or greater than a specified distance (threshold distance) or less than the specified distance (threshold distance).

[0153] As shown in FIG. 16, the user inserts the smartphone 10 from the entrance of the proximity sensor calibration tool 50, arranges the alignment line 41 displayed on the display unit (display) 15 of the smartphone 10 to align with the entrance of the proximity sensor calibration tool 50, and when tapping "Calibration Start" displayed at the lower part of the display unit, the data processing unit of the smartphone 10 starts the acquisition process of the sensor detection value as the calibration process of the proximity sensor.

[0154] The data processing unit of the smartphone 10 inputs the value of the detection signal of the reflected light from the gray card 51 input by the light receiving element of the proximity sensor 12. The data processing unit of the smartphone 10 determines that this detection signal value is the acquisition signal value when the object distance is the threshold distance L, and holds this signal value in the memory (storage unit) of the smartphone 10 as the sensor detection value (determination signal value) corresponding to the threshold distance L.

[0155] Through such processing, the calibration process of the proximity sensor 12 is executed, and the correct sensor detection value (determination signal value) corresponding to the accurate threshold distance L is stored in the memory of the smartphone 10.

[0156] FIG. 17 shows an example of the completion point of the calibration of the proximity sensor 12 using the proximity sensor calibration tool 50 described with reference to FIG. 16.

[0157] As shown in FIG. 17, when the calibration of the proximity sensor 12 by the data processing unit of the smartphone 10 is completed, the data processing unit of the smartphone 10 outputs a message indicating that the calibration is completed via the display unit or the speaker of the smartphone. By outputting this message, the user can confirm that the calibration of the proximity sensor 12 is completed.

[0158] In the above-described embodiment, the user is instructed using the alignment line 41 displayed on the display unit (display) 15 for the position of the smartphone 10 with respect to the proximity sensor calibration tool 50. However, various other methods can be used to correctly position the smartphone 10 for the user.

[0159] For example, the following methods can be used. (1) Display a placement image on the display unit (display) of the smartphone 10 so that the placement position of the smartphone 10 with respect to the proximity sensor calibration tool 50 is in the correct positional relationship. (2) Record a marker on the gray card 51 pasting surface (inner surface of surface A) of the proximity sensor calibration tool 50, display the marker image captured by the front camera 11 of the smartphone 10 on the display unit (display) of the smartphone 10, and cause the user to perform an operation of moving the smartphone 10 so that the position of the displayed marker coincides with the alignment icon displayed on the display unit (display) 15. (3) Record a marker on the gray card 51 pasting surface (inner surface of surface A) of the proximity sensor calibration tool 50, have the data processing unit of the smartphone 10 perform image analysis on the marker image captured by the front camera 11 of the smartphone 10, and determine whether the position and height are appropriate and notify the user with OK / NG as voice or display data.

[0160] It may also be configured to perform a process of correctly adjusting the placement position of the smartphone 10 with respect to the proximity sensor calibration tool 50 by applying any of the above processes.

[0161] In the calibration process of the proximity sensor 12 described with reference to FIGS. 16 and 17, a process of recording a sensor detection value corresponding to a threshold distance L for determining whether the object distance is greater than or less than the threshold was performed.

[0162] However, if the proximity determination of the object is performed using only one threshold distance L, problems such as frequent switching of ON / OFF of the display unit may occur when the object distance frequently moves around the threshold distance L.

[0163] As a configuration for solving such problems, a configuration in which the threshold distance L1 when the object approaches the smartphone and the threshold distance L2 when the object moves away from the smartphone are set to different distances, that is, a configuration having hysteresis, is effective.

[0164] An example of setting the threshold distance with hysteresis will be described with reference to FIG. 18. FIG. 18(1) shows an example of the threshold distance L1 when the smartphone 10 approaches the user's face (= object) and the threshold distance L2 when the smartphone 10 moves away from the user's face (= object). The threshold distance L2 is larger than the threshold distance L1, that is, L1 < L2 is in the above relationship.

[0165] The left graph shown at the bottom of FIG. 18 is a graph showing the change in the output value of the proximity sensor 12 using the threshold distance L1 when the smartphone 10 approaches the user's face (= object). The right graph is a graph showing the change in the output value of the proximity sensor 12 using the threshold distance L2 when the smartphone 10 moves away from the user's face (= object).

[0166] As can be understood from these graphs, when the smartphone 10 approaches the user's face (= object), when the distance between the smartphone 10 and the user's face becomes less than the threshold distance L1, the output value of the proximity sensor 12 changes from the output value "0" indicating "no proximity object" to the output value "1" indicating "proximity object".

[0167] On the other hand, when the smartphone 10 moves away from the user's face (= object), when the distance between the smartphone 10 and the user's face becomes equal to or greater than the threshold distance L2, the output value of the proximity sensor 12 changes from the output value "1" indicating "presence of a proximity object" to the output value "0" indicating "absence of a proximity object".

[0168] In this way, by setting different values for the threshold distance L1 when the object approaches the smartphone and the threshold distance L2 when the object moves away from the smartphone, that is, by providing hysteresis, it becomes possible to prevent, for example, the display unit of the smartphone 10 from switching on and off violently.

[0169] When the proximity sensor 12 has two different threshold values, the calibration of the proximity sensor 12 becomes insufficient in the processes described with reference to FIGS. 16 and 17. A specific example of the calibration process when the proximity sensor 12 has two different threshold values will be described with reference to FIG. 19.

[0170] When the proximity sensor 12 has two different threshold values, as shown in FIG. 19, it is necessary to execute calibration for storing the correct sensor detection values (signal values for determination) corresponding to the two different threshold distances L1 and L2 in the memory of the smartphone 10.

[0171] FIG. 19 shows (1) Calibration corresponding to the threshold distance L1 (2) Calibration corresponding to the threshold distance L2 Examples of execution of these two calibrations are shown.

[0172] That is, FIG. 19(1) shows the calibration process for storing the correct sensor detection value (signal value for determination) corresponding to the threshold distance L1 when the smartphone 10 approaches an object such as the user's face in the memory of the smartphone 10. FIG. 19(2) is a calibration process for storing the correct sensor detection value (determination signal value) corresponding to the threshold distance L2 when the smartphone 10 moves away from an object such as the user's face in the memory of the smartphone 10.

[0173] In FIG. 19(1), the proximity sensor calibration tool 50 is set horizontally, and the distance from the smartphone 10 to the gray card 51 attached to the inside of the A surface of the proximity sensor calibration tool 50 is set to L1. On the other hand, in FIG. 19(2), the proximity sensor calibration tool 50 is set vertically, and the distance from the smartphone 10 to the gray card 51 attached to the inside of the B surface of the proximity sensor calibration tool 50 is set to L2.

[0174] By performing the processes shown in FIGS. 19(1) and (2), the correct sensor detection values (determination signal values) corresponding to the two different threshold distances L1 and L2 are stored in the memory of the smartphone 10.

[0175] In the calibration execution example described with reference to FIGS. 16, 17, and 19, a dedicated proximity sensor calibration tool 50 is used when performing the calibration process of the proximity sensor 12. Without using such a dedicated tool, a configuration using the smartphone storage box (smartphone packaging material) 30 may be adopted, similar to the calibration processes of the acceleration sensor 25 and the gyro 26 described above.

[0176] FIG. 20 will describe a configuration example for performing calibration of the proximity sensor 12 using the smartphone storage box (smartphone packaging material) 30.

[0177] In FIG. 20, similar to FIG. 19 described above, (1) Calibration corresponding to the threshold distance L1 (2) Calibration corresponding to the threshold distance L2 Execution examples of these two calibrations are shown.

[0178] In any of the calibration processes for these two thresholds L1 and L2, the smartphone storage box (smartphone packaging material) 30 is used.

[0179] In the “(1) Calibration corresponding to the threshold distance L1”, the upper cover 30a of the smartphone storage box (smartphone packaging material) is placed horizontally. A gray card 51 is attached to the inner surface of the upper surface of the horizontally placed upper cover 30a of the smartphone storage box (smartphone packaging material). Calibration is performed by making the distance between the gray card 51 and the smartphone 10 coincide with the threshold distance L1.

[0180] For adjusting the distance between this gray card 51 and the smartphone 10, the lower storage part 30b of the smartphone storage box (smartphone packaging material) is placed upside down, and further, height adjustment tools a, 33a are placed on it, and the smartphone 10 is placed on them. Note that it is preferable that these height adjustment tools a, 33a be included in the smartphone storage box (smartphone packaging material) 30 in which the smartphone 10 is stored when the smartphone 10 is purchased.

[0181] On the other hand, in the “(2) Calibration corresponding to the threshold distance L2”, the upper cover 30a of the smartphone storage box (smartphone packaging material) is placed vertically. A gray card 51 is also attached to the inner surface of the upper surface of the vertically placed upper cover 30a of the smartphone storage box (smartphone packaging material). Calibration is performed by making the distance between the gray card 51 and the smartphone 10 coincide with the threshold distance L2.

[0182] For adjusting the distance between this gray card 51 and the smartphone 10, the lower storage part 30b of the smartphone storage box (smartphone packaging material) is placed upside down, and further, height adjustment tools b, 33b are placed on it, and the smartphone 10 is placed on them. Note that it is also preferable that these height adjustment tools b, 33b be included in the smartphone storage box (smartphone packaging material) 30 in which the smartphone 10 is stored when the smartphone 10 is purchased.

[0183] The height adjustment tool a, 33a and the height adjustment tool b, 33b may be individual tools, or may be configured to use one tool whose height can be changed by changing the folding method.

[0184] As shown in FIG. 20, FIG. 20(1) shows a calibration process for storing a correct sensor detection value (determination signal value) corresponding to the threshold distance L1 when the smartphone 10 approaches an object such as the user's face in the memory of the smartphone 10. FIG. 20(2) is a calibration process for storing a correct sensor detection value (determination signal value) corresponding to the threshold distance L2 when the smartphone 10 moves away from an object such as the user's face in the memory of the smartphone 10.

[0185] As shown in FIG. 20(1), the upper cover 30a of the smartphone storage box (smartphone packaging material) is placed horizontally, the distance from the smartphone 10 to the gray card 51 is set to L1, and the sensor detection value (determination signal value) corresponding to the threshold distance L1 is stored in the memory of the smartphone 10. On the other hand, in FIG. 20(2), the upper cover 30a of the smartphone storage box (smartphone packaging material) is placed vertically, the distance from the smartphone 10 to the gray card 51 is set to L2, and the sensor detection value (determination signal value) corresponding to the threshold distance L2 is stored in the memory of the smartphone 10.

[0186] By performing the processes shown in FIGS. 20(1) and (2), correct sensor detection values (determination signal values) corresponding to two different threshold distances L1 and L2 can be stored in the memory of the smartphone 10.

[0187] After the calibration of the proximity sensor 12 is completed in this way, the accuracy of the sensor detection value of the proximity sensor 12 is improved, and a highly accurate detection process for a proximity object can be executed.

[0188] [Details of the calibration process for the illuminance sensor and the RGB sensor] Next, the details of the calibration process for the illuminance sensor and RGB sensor will be described.

[0189] As described above with reference to FIG. 1, the illuminance sensor 13 and the RGB sensor 14 are sensors that detect the color and illuminance of ambient light. Based on the detection information of these illuminance sensors 13 and RGB sensors 14, display brightness and color temperature correction control of the display unit 15 are executed. It is also used for shooting control of the front camera 11 or the like, such as white balance control and shutter speed control.

[0190] With reference to FIG. 21 and below, the details of the calibration procedure for the illuminance sensor 13 or the RGB sensor 14 mounted on the smartphone 10 will be described.

[0191] FIG. 21 is a diagram showing an example of a UI (user interface), which is a user operation screen displayed on the smartphone 10, similar to that described above with reference to FIG. 7.

[0192] FIG. 21(a) shows an example in which the user displays “(a) Setting Process Screen (UI)” on the display unit (display) 15 of the smartphone 10 and selects “Sensor Calibration” from the displayed “(a) Setting Process Screen (UI)”. FIG. 21(b) shows an example of a “(b) Sensor Selection Screen (UI)” displayed on the display unit (display) 15 of the smartphone 10 by the user's “Sensor Calibration” selection process. The user can select the sensor to be calibrated from the “(b) Sensor Selection Screen (UI)” displayed on the display unit (display) 15.

[0193] The example shown in FIG. 21 shows an example in which the user selects “Illuminance Sensor & RGB Sensor” as the sensor to be calibrated from the “(b) Sensor Selection Screen (UI)”.

[0194] Note that, similar to the calibration processes of the acceleration sensor and gyroscope described above, the UI shown in FIG. 21 is an example of the UI used when starting sensor calibration. By using the UI shown in FIG. 21, the user can start the calibration of any sensor at any timing.

[0195] In addition to the example using such a UI, a configuration using a UI similar to the UI described above with reference to FIG. 8 may be employed. That is, a UI that notifies the user to execute calibration when the need to execute sensor calibration arises may be used.

[0196] When the user selects the "Illuminance sensor & RGB sensor" as the sensor to be calibrated from the "(b) Sensor selection screen (UI)" shown in FIG. 21, the data processing unit of the smartphone 10 starts the calibration execution program for at least either the illuminance sensor 13 or the RGB sensor 14. Note that the calibration of the illuminance sensor 13 and the RGB sensor 14 can be executed individually, but it is also possible to perform them together. Here, a processing example of performing the calibration of the illuminance sensor 13 and the RGB sensor 14 together will be described.

[0197] When the calibration execution program for the illuminance sensor 13 and the RGB sensor 14 is started, first, the data processing unit of the smartphone 10 displays on the display unit (display) 15 the explanation (guide information) regarding the execution procedure of the calibration of the illuminance sensor 13 and the RGB sensor 14. A specific example is shown in FIG. 22.

[0198] As shown in FIG. 22, the following explanation (guide information) regarding the execution procedure of the calibration of the illuminance sensor 13 and the RGB sensor 14 is displayed on the display unit (display) 15 of the smartphone 10. (1) Put the smartphone into the smartphone storage box, tap "Calibration Start" at the bottom, and close the smartphone storage box. (2) When the calibration is completed, you will be notified by voice.

[0199] The user checks this explanation (guide information), stores the smartphone 10 in the smartphone storage box 30 according to the explanation (guide information), taps "Calibration Start" displayed on the display unit (display) 15, and executes the process of closing the smartphone storage box 30.

[0200] Note that the data processing unit of the smartphone 10 may output voice guidance via a speaker in conjunction with the output of the guide information for the display unit (display) 15 shown in FIG. 22. For example, "Please store the smartphone in the smartphone storage box." "Please tap 'Calibration Start' at the bottom." "Please close the smartphone storage box." These voice guides may be output at regular time intervals.

[0201] An example of the state where the user puts the smartphone 10 into the smartphone storage box 30 according to these guide information is shown in FIG. 23. As shown in FIG. 23, the smartphone 10 is stored at a predetermined position in the smartphone storage box 30. The smartphone 10 is stored in a concave portion formed in the same shape as the shape of the smartphone so as not to wobble in the box.

[0202] The illuminance sensor 13 and the RGB sensor 14 are set at the upper part on the display unit (display) 15 side of the smartphone 10 and are in an upward state in the smartphone storage state. On the back surface of the cover portion of the smartphone storage box 30, that is, when the smartphone 10 is stored in the smartphone storage box 30 and the cover is closed, a reflective sheet 40 is attached to the surface facing the illuminance sensor 13 and the RGB sensor 14. The reflective sheet 40 is a reflective sheet having a predefined reflectance, for example, reflectance ≒ 100%.

[0203] FIG. 24 shows a diagram for explaining a state in which the user stores the smartphone 10 in the smartphone storage box 30 according to the explanation (guide information), taps "Calibration start" displayed on the display unit (display) 15, and closes the smartphone storage box 30.

[0204] As shown in the left diagram of FIG. 24, the user stores the smartphone 10 in the smartphone storage box 30 and taps "Calibration start" displayed on the display unit (display) 15. Then, as shown in the right diagram of FIG. 24, the user closes the smartphone storage box 30. After these processes, the data processing unit of the smartphone 10 starts the calibration process of the illuminance sensor 13 and the RGB sensor 14.

[0205] The data processing unit of the smartphone 10 outputs a plurality of luminance images and a plurality of color images in a predefined sequence to the display unit (display) 15 of the smartphone 10. The light of these output images is reflected by the reflective sheet 40 on the back surface of the cover portion of the smartphone storage box 30 and is incident on the illuminance sensor 13 and the RGB sensor 14.

[0206] The data processing unit of the smartphone 10 acquires and verifies the sensor detection values of the illuminance sensor 13 and the RGB sensor 14, and performs calibration of the illuminance sensor 13 and the RGB sensor 14, that is, adjusts these sensor detection values so that they accurately reflect the luminance and color of the plurality of luminance images and the plurality of color images displayed on the display unit (display) 15. That is, calibration of the illuminance sensor 13 and the RGB sensor 14 is performed.

[0207] When a series of calibration processes is completed, the data processing unit of the smartphone 10 outputs a message indicating that the calibration has ended via the speaker. Figure 25 shows examples of the states of the illuminance sensor 13 and the RGB sensor 14 of the data processing unit of the smartphone 10 during the execution of the "(1) Calibration process execution" and after the completion of the "(2) Calibration process". As shown in the figure, after the completion of the "(2) Calibration process", a message indicating that the calibration has been completed is output via the speaker of the smartphone 10. By this message output, the user can confirm that the calibration has been completed.

[0208] As shown in Figure 26, instead of the reflective sheet 40, a light emitting unit 45 may be provided on the back surface of the cover portion of the smartphone storage box 30, and the calibration of the illuminance sensor 13 and the RGB sensor 14 may be performed by causing the light emitting unit 45 to emit light. That is, when the smartphone 10 is stored in the smartphone storage box 30 and the cover is closed, the light emitting unit 45 is mounted on the surface facing the illuminance sensor 13 and the RGB sensor 14.

[0209] The light emitting unit 45 outputs light with a predefined luminance and color (color temperature). The smartphone storage box 30 has a built-in battery or a battery connection portion, and emits light by power supply from the built-in or externally connected battery. The smartphone storage box 30 may be configured to supply power from the smartphone 10 by having a terminal (such as a USB connection terminal) for connecting to the smartphone 10.

[0210] After the user taps "Calibration start" displayed on the display unit (display) 15 of the smartphone 10, the smartphone 10 is stored in the smartphone storage box 30 as shown in the left figure of Figure 26. Then, the smartphone storage box 30 is closed as shown in the right figure of Figure 26. After these processes, the data processing unit of the smartphone 10 starts the calibration process of the illuminance sensor 13 and the RGB sensor 14 configured in the smartphone 10.

[0211] The output light of the light emitting unit 45 of the smartphone storage box 30 is incident on the illuminance sensor 13 and the RGB sensor 14 of the smartphone 10. The data processing unit of the smartphone 10 acquires the sensor detection values of the illuminance sensor 13 and the RGB sensor 14, and executes a process of adjusting these sensor detection values so that they accurately reflect the luminance and color of the light emitting unit 45. That is, calibration of the illuminance sensor 13 and the RGB sensor 14 is performed.

[0212] In a configuration where the smartphone storage box 30 and the smartphone 10 can be connected, according to the calibration program executed by the data processing unit of the smartphone 10, the luminance and color of the light emitting unit 45 of the smartphone storage box 30 are sequentially changed according to a specified sequence, and adjustment (calibration) of the sensor detection values is performed according to various luminances and colors. It may be configured as follows.

[0213] Furthermore, calibration of the illuminance sensor and the RGB sensor on the back surface of the smartphone 10 can also be performed by using the light of the light emitting unit 45 of the smartphone storage box 30. A specific example will be described with reference to FIG. 27. When calibrating the illuminance sensor 19 and the RGB sensor 20 on the back surface of the smartphone 10, as shown in FIG. 27, the smartphone 10 is stored in the smartphone storage box 30 with the back side facing inward.

[0214] The light emitting unit 45 is mounted on the back surface of the cover portion of the smartphone storage box 30. When the smartphone 10 is stored in the smartphone storage box 30 with the back side facing inward and the cover is closed, the light emitting unit 45 is positioned so as to face the illuminance sensor 19 and the RGB sensor 20.

[0215] After the user taps "Calibration Start" displayed on the display unit (display) 15 of the smartphone 10, the smartphone 10 is stored in the smartphone storage box 30 with the back side facing inward as shown in the left diagram of FIG. 27. Then, as shown in the right diagram of FIG. 27, the smartphone storage box 30 is closed. After these processes, the data processing unit of the smartphone 10 starts calibration processes for the illuminance sensor 19 and the RGB sensor 20 configured on the back side of the smartphone 10.

[0216] The output light of the light emitting unit 45 of the smartphone storage box 30 is incident on the illuminance sensor 19 and the RGB sensor 20 on the back surface of the smartphone 10. The data processing unit of the smartphone 10 acquires the sensor detection values of the illuminance sensor 19 and the RGB sensor 20, and executes a process of adjusting these sensor detection values so that they accurately reflect the luminance and color of the light emitting unit 45. That is, calibration of the illuminance sensor 19 and the RGB sensor 20 is executed.

[0217] [Details of the calibration process of the display unit (display)] Next, details of the calibration process of the display unit (display) will be described.

[0218] The smartphone 10 has a display unit (display) 15 as a device that performs display processing. Texts, RGB color images, etc. are displayed on the display unit (display) 15. The display unit (display) 15 also preferably undergoes calibration as an adjustment process for changes in luminance and output color, for example, due to long-term use, at regular intervals.

[0219] With reference to FIG. 28 and below, details of the calibration procedure for the display unit (display) 15 attached to the smartphone 10 will be described.

[0220] FIG. 28 is a diagram showing an example of a UI (user interface) which is a user operation screen displayed on the smartphone 10, similar to that described above with reference to FIG. 7.

[0221] FIG. 28(a) shows an example in which the user displays the “(a) setting process screen (UI)” on the display unit (display) 15 of the smartphone 10 and selects “sensor calibration” from the displayed “(a) setting process screen (UI)”. Figure 28(b) shows an example of the "(b) Sensor Selection Screen (UI)" displayed on the display unit 15 of the smartphone 10 by the "Sensor Calibration" selection process by the user. The user can select a sensor to be calibrated from the "(b) Sensor Selection Screen (UI)" displayed on the display unit (display) 15.

[0222] The example shown in Figure 28 shows an example in which the user selects "Display" as the sensor to be calibrated from the "(b) Sensor Selection Screen (UI)".

[0223] Note that similar to the calibration processes of the acceleration sensor and gyro described above, the UI shown in Figure 28 is an example of the UI used when starting sensor calibration. By using the UI shown in Figure 28, the user can start the calibration of any sensor at any timing.

[0224] In addition to the example using such a UI, a configuration using a UI similar to the UI described above with reference to Figure 8 may be adopted. That is, a UI that notifies the user to perform calibration when it becomes necessary to perform sensor calibration may be used.

[0225] When the user selects the "display unit (display)" as the sensor to be calibrated from the "(b) Sensor Selection Screen (UI)" shown in Figure 28, the data processing unit of the smartphone 10 starts the calibration execution program for the display unit (display).

[0226] When the calibration execution program for the display unit (display) is started, first, the data processing unit of the smartphone 10 displays an explanation of the execution procedure of the calibration of the display unit (display) on the display unit (display) 15. A specific example is shown in Figure 29.

[0227] As shown in FIG. 29, the following description (guide information) regarding the execution procedure for calibrating the display unit of the smartphone 10 is displayed on the display unit 15 of the smartphone 10. (1) Place the smartphone in the smartphone storage box, tap "Start Calibration" at the bottom, and close the smartphone storage box. (2) When the calibration is completed, you will be notified by voice.

[0228] The user checks this description (guide information), stores the smartphone 10 in the smartphone storage box 30 according to the description (guide information), taps "Start Calibration" displayed on the display unit 15, and executes the process of closing the smartphone storage box 30.

[0229] Note that the data processing unit of the smartphone 10 may output voice guidance via a speaker in conjunction with the output of guide information for the display unit 15 shown in FIG. 22. For example, "Please store the smartphone in the smartphone storage box." "Please tap 'Start Calibration' at the bottom." "Please close the smartphone storage box." These voice guides may be output at regular time intervals.

[0230] An example of the state where the user puts the smartphone 10 into the smartphone storage box 30 according to these guide information is shown in FIG. 30. As shown in FIG. 30, the smartphone 10 is stored at a predetermined position inside the smartphone storage box 30. The smartphone 10 is stored in a concave portion formed in the same shape as the shape of the smartphone so as not to wobble inside the box.

[0231] The display unit 15 of the smartphone 10 is in an upward state when the smartphone is stored. On the back surface of the cover portion of the smartphone storage box 30, that is, when the smartphone 10 is stored in the smartphone storage box 30 and the cover is closed, a reflective sheet 40 is attached to the surface facing the display unit (display) 15, the illuminance sensor 13, and the RGB sensor 14. The reflective sheet 40 is the same reflective sheet as the reflective sheet 40 described above with reference to FIG. 23, and is a reflective sheet having a predefined reflectance, for example, a reflectance ≒ 100%.

[0232] FIG. 31 shows a diagram illustrating a state in which the user stores the smartphone 10 in the smartphone storage box 30 according to the explanation (guide information), taps "Calibration Start" displayed on the display unit (display) 15, and closes the smartphone storage box 30.

[0233] As shown in the left diagram of FIG. 31, the user stores the smartphone 10 in the smartphone storage box 30 and taps "Calibration Start" displayed on the display unit (display) 15. Then, as shown in the right diagram of FIG. 31, the user closes the smartphone storage box 30. After these processes, the data processing unit of the smartphone 10 starts the calibration process of the display unit (display) 15.

[0234] The data processing unit of the smartphone 10 outputs a plurality of luminance images and a plurality of color images to the display unit (display) 15 of the smartphone 10 in a predefined sequence. The light of these output images is reflected by the reflective sheet 40 on the back surface of the cover portion of the smartphone storage box 30 and is incident on the illuminance sensor 13 and the RGB sensor 14.

[0235] The data processing unit of the smartphone 10 acquires the sensor detection values of the illuminance sensor 13 and the RGB sensor 14, and based on these sensor detection values, performs adjustment processes (calibration) such as luminance, color adjustment, and white balance adjustment of the display unit (display) 15.

[0236] When a series of calibration processes are completed, the data processing unit of the smartphone 10 outputs a message indicating that the calibration has ended via the speaker. FIG. 32 shows examples of the state of “(1) During calibration process execution” and the state after “(2) Calibration process completed” of the display unit (display) 15 executed by the data processing unit of the smartphone 10. As shown in the figure, after “(2) Calibration process completed”, a message indicating that the calibration has ended is output via the speaker of the smartphone 10. By this message output, the user can confirm that the calibration has ended.

[0237] [Regarding the processing sequence executed by the calibration execution device] Next, the processing sequence executed by the calibration execution device will be described.

[0238] The flowchart shown in FIG. 33 is a flowchart for explaining the processing sequence executed by the calibration execution device. Note that the calibration execution device is, for example, a smartphone.

[0239] The flowchart shown in FIG. 33 is executed in the data processing unit of the smartphone which is the calibration execution device. Note that the data processing unit has a CPU etc. with a program execution function, and executes processing according to the flowchart shown in FIG. 33 according to the program stored in the storage unit of the smartphone. Hereinafter, the processing of each step of the flowchart shown in FIG. 33 will be sequentially described.

[0240] (Step S501) First, in step S501, the data processing unit of the smartphone which is the calibration execution device inputs a calibration execution request from the user.

[0241] This is a detection process for user input processing using a UI (user interface) described with reference to FIG. 7(a) above, for example. As described above, FIG. 7(a) shows an example where the user displays the “(a) setting process screen (UI)” on the display unit 15 of the smartphone 10 and selects “sensor calibration” from the displayed “(a) setting process screen (UI)”.

[0242] In step S501, the data processing unit of the smartphone 10 uses the UI (user interface) described with reference to FIG. 7(a) to detect that the user has input a calibration execution request.

[0243] (Step S502) Next, in step S502, the data processing unit of the smartphone displays a calibration execution target selection UI on the display unit 15 of the smartphone 10.

[0244] This process is to display the “(b) sensor selection screen (UI)” described with reference to FIG. 7(b) above on the display unit 15 of the smartphone 10. The user can select a sensor to be the calibration execution target from the “(b) sensor selection screen (UI)” displayed on the display unit 15.

[0245] (Step S503) Next, in step S503, the data processing unit of the smartphone inputs calibration execution target selection information.

[0246] This is a user selection input process using the sensor selection screen (UI) shown in FIG. 7(b), that is, an input detection process for selection information of a sensor to execute calibration.

[0247] (Step S504) Next, in step S504, the data processing unit of the smartphone displays calibration guide information corresponding to the calibration execution target selected by the user on the display unit 15 of the smartphone 10.

[0248] This process is, for example, a process of displaying guide information explaining the calibration procedure as shown in FIG. 9 on the display unit 15 of the smartphone 10. Note that the guide information to be displayed differs depending on the type of sensor to be calibrated.

[0249] The guide information shown in FIG. 9 is the guide information displayed when the user selects the acceleration sensor and gyro as the calibration execution target sensors. When the user selects the proximity sensor as the calibration execution target sensor, the guide information shown in FIG. 15 is displayed. Also, when the user selects the illuminance sensor or the RGB sensor as the calibration execution target sensor, the guide information shown in FIG. 22 is displayed. Furthermore, when the user selects the display as the calibration execution target sensor, the guide information shown in FIG. 29 is displayed.

[0250] In this flow, steps S501 to S503 are described as an example in which the user voluntarily selects the calibration execution target sensor. However, as described above, for example, when it becomes necessary to execute the calibration of the sensor, a configuration may be adopted in which a process of notifying the user to execute the calibration is performed, and the calibration execution program is started according to the response of the user.

[0251] For example, when the user replaces the battery of the smartphone 10 or when the display panel is replaced, after the replacement is completed, a notification prompting the execution of the calibration of the acceleration sensor and the gyro is performed, and the calibration execution program may be started according to the response of the user.

[0252] For example, immediately after the user replaces the battery of the smartphone 10, a “(c) Sensor Calibration Execution Request Notification Screen (UI)” as shown in FIG. 8 is displayed on the display unit 15 of the smartphone 10. When the user taps “Execute” on this UI, it may be configured to execute each process below the guide display process in step S504. In such a case, the processes of steps S501 to S503 are not performed.

[0253] (Step S505) In step S504, when calibration guide information corresponding to the calibration execution target is displayed on the display unit 15 of the smartphone 10, the user executes the process according to the guide display and taps “Calibration Start” displayed on the display unit 15 of the smartphone 10. In step S505, the tap operation information of “Calibration Start” by this user is input.

[0254] For example, when the user selects the acceleration sensor and gyro as the calibration execution target sensors, the guide information shown in FIG. 9 is displayed, and the user stores the smartphone 10 in the smartphone storage box 30 according to this guide information, and then taps “Calibration Start” displayed on the display unit 15 of the smartphone 10.

[0255] (Step S506) In step S505, when the tap operation information of “Calibration Start” by the user is input, the data processing unit of the smartphone 10 starts the calibration of the calibration execution target selected by the user in step S506.

[0256] Note that during calibration execution, guide information for requesting the user's process is output as necessary. For example, guide information is output using voice information via the speaker of the smartphone 10 or display information for the display unit 15, and the user is asked to perform the process according to the guide information.

[0257] For example, when calibrating an acceleration sensor or a gyroscope, as described above with reference to FIGS. 11 and 12, guide information for having the user perform a process of rotating the smartphone storage box 30 is output as audio information via the speaker of the smartphone 10.

[0258] (Step S507) Step S507 is a calibration completion determination process by the data processing unit of the smartphone 10. In step S507, if it is determined that the calibration has not been completed, the calibration in step S506 is continuously executed.

[0259] In step S507, if it is determined that the calibration has been completed, the process proceeds to step S508.

[0260] (Step S508) In step S507, if it is determined that the calibration has been completed, the data processing unit of the smartphone 10 executes a calibration completion notification to the user in step S508.

[0261] For example, as audio information via the speaker of the smartphone 10, a message indicating that the calibration has been completed is output. Alternatively, as display information for the display unit 15, a message indicating that the calibration has been completed is output.

[0262] As described above, the calibration execution device such as the smartphone 10 of the present disclosure enables the calibration of the sensor mounted on the smartphone 10 to be correctly and reliably executed based on user operations by providing the user with guide information about the user operations necessary for correctly executing the calibration.

[0263] [7. Other Embodiments] Next, other embodiments different from the above-described embodiments will be described.

[0264] In the above-described embodiments, the smartphone 10 was described as an example of a calibration execution device. An embodiment was described in which calibration of devices such as various sensors attached to the smartphone 10 is executed using the smartphone storage box 30, which is the packaging material of the smartphone 10.

[0265] The devices such as sensors that were the targets of calibration in the above-described embodiments are (1) Acceleration sensor, gyro (2) Proximity sensor (3) Illuminance sensor, RGB sensor (4) Display These are the devices such as sensors.

[0266] In addition to those described in the embodiments, various sensors are attached to the smartphone 10. For example, as described above with reference to FIG. 1, there are a fingerprint sensor 16, a touch sensor 17, a distance sensor (TOF sensor) 21, and the like.

[0267] Regarding the calibration of these sensors as well, by providing the user with guide information corresponding to each sensor, even a user who has no knowledge of calibration can execute correct calibration processing.

[0268] For example, the optical fingerprint sensor 16 can shut out external light that becomes noise by storing the smartphone 10 in the smartphone storage box 30. Also, for a capacitive fingerprint sensor or touch sensor, by storing the smartphone 10 in the smartphone storage box 30, it is possible to surely ensure a state where the user is not touching. Therefore, by presenting guide information including instruction information for causing the user to store the smartphone 10 in the smartphone storage box 30 when calibrating these sensors, it is possible to surely form an environment optimal for calibration.

[0269] In the above-described embodiment, the smartphone 10 was described as an example of the calibration execution device. However, the processing of the present disclosure can be applied not only to the smartphone 10 but also to various devices equipped with sensors.

[0270] An example of a device to which the processing of the present disclosure can be applied will be described with reference to FIG. 34. For example, the tablet terminal 70 shown in FIG. 34 can also perform calibration of various sensors and devices attached to the tablet terminal 70 using the tablet terminal storage box 71.

[0271] The head-mounted display 72 can also perform calibration of various sensors and devices attached to the head-mounted display 72 using the head-mounted display storage box 73.

[0272] Also, the earphone 74 is, for example, a wireless earphone, and some have a function of detecting the movement of the neck of a user wearing the earphone 74 by an acceleration sensor or a gyro and controlling the volume. This earphone 74 can also perform calibration of various sensors and devices attached to the earphone 74 using the earphone storage box 75.

[0273] Various sensors are also attached to the smartwatch 76. This smartwatch 76 can also perform calibration of various sensors and devices attached to the smartwatch 77 using the smartwatch storage box 77.

[0274] Various sensors are also attached to the drone 78. This drone 78 can also perform calibration of various sensors and devices attached to the drone 78 using the drone storage box 79.

[0275] Note that, for example, the earphone 74 does not have a display unit, and if the earphone 74 is stored in the earphone storage box 75, voice that can be heard by the user cannot be output. In such a device, the configuration is such that guidance information is notified using the smartphone 10, that is, the guidance information is notified using the speaker or the display unit of the smartphone 10.

[0276] A specific example is shown in FIG. 35. FIG. 35 shows an example in which the earphone 74 provided with the sensor to be calibrated is stored in the earphone storage box 75. On the display unit of the smartphone 10, guidance information indicating the execution procedure of calibration of the acceleration sensor and the gyro, which are the sensors mounted on the earphone 74, is displayed.

[0277] That is, the following guidance information is displayed. (1) Store the earphone in the earphone storage box and tap "Start Calibration" at the bottom. (2) Rotate the earphone storage box so that each of the surfaces numbered 1 to 6 faces upward in order according to the guidance voice. (3) When the calibration is completed, it will be announced by voice.

[0278] The user checks this explanation (guidance information), stores the earphone 74 in the earphone storage box 75 according to the explanation (guidance information), and taps "Start Calibration" displayed at the bottom of the display unit. Thereafter, a voice guide is output via the speaker of the smartphone 10. The user executes the process according to this voice guide.

[0279] The user executes a process of rotating the earphone storage box 75 so that each of the surfaces numbered 1 to 6 faces upward in order according to the voice guide. This process is the same as the process described above with reference to FIGS. 11 and 12.

[0280] By these processes, the calibration of the acceleration sensor and gyroscope mounted on the earphone 74 is correctly and surely executed.

[0281] Thus, in the case of a device that does not have a speaker or a display unit and has difficulty in outputting guide information, it is possible to cause the user to correctly perform calibration by performing voice output or display processing of guide information using an external device such as a smartphone or a PC.

[0282] [8. Hardware configuration example of calibration execution device] Next, with reference to FIG. 36, a hardware configuration example of the calibration execution device of the present disclosure will be described. The calibration execution device is configured by various electronic devices such as, for example, a smartphone, a tablet terminal, and a head-mounted display. A configuration example of the calibration execution device will be described with reference to FIG. 36.

[0283] The CPU (Central Processing Unit) 301 functions as a data processing unit that executes various processes according to a program stored in the ROM (Read Only Memory) 302 or the storage unit 308. For example, it executes the processes according to the sequence described in the above-described embodiments. Programs and data executed by the CPU 301 are stored in the RAM (Random Access Memory) 303. These CPU 301, ROM 302, and RAM 303 are interconnected by a bus 304.

[0284] The CPU 301 is connected to the input / output interface 305 via the bus 304. Connected to the input / output interface 305 are an input unit 306 composed of various switches, a keyboard, a touch panel, a mouse, a microphone, and a detection data acquisition unit for various sensors such as a user input unit, a camera, an acceleration sensor, and a gyro, and an output unit 307 composed of a display, a speaker, and the like.

[0285] The CPU 301 receives commands, status data, etc. input from the input unit 306, executes various processes, and outputs the processing results to, for example, the output unit 307. The storage unit 308 connected to the input / output interface 305 consists of, for example, a hard disk, and stores programs and various data executed by the CPU 301. The communication unit 309 functions as a transmission / reception unit for data communication via a network such as the Internet or a local area network, and communicates with external devices.

[0286] The drive 310 connected to the input / output interface 305 drives a removable medium 311 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory such as a memory card, and executes data recording or reading.

[0287] [Summary of the Configuration of the Present Disclosure] As described above, the embodiments of the present disclosure have been described in detail with reference to specific examples. However, it is obvious that those skilled in the art can modify or substitute the examples without departing from the gist of the present disclosure. That is, the present invention has been disclosed in the form of examples and should not be construed in a limited manner. To determine the gist of the present disclosure, the claims section should be referred to.

[0288] Note that the technology disclosed in this specification can be configured as follows. (1) It has a data processing unit that outputs calibration guide information for a device mounted on an electronic device, The data processing unit, outputs guide information explaining the processes to be executed by the user when calibrating the device, The guide information, is a calibration execution device including user processing for a box that is a calibration tool having functions or information used when executing calibration.

[0289] (2) The box, The calibration execution device according to (1), which is an electronic device storage box that is a packaging material for the electronic device.

[0290] (3) The data processing unit The calibration execution device according to (1) or (2), which outputs the guide information using voice information via a speaker or display information for a display unit.

[0291] (4) The data processing unit The calibration execution device according to any one of (1) to (3), which starts calibration of the device based on an input of a calibration start instruction from a user.

[0292] (5) The data processing unit The calibration execution device according to any one of (1) to (4), which starts calibration of the device based on detection of a tap on a calibration start instruction input unit displayed on a display unit of the electronic device.

[0293] (6) The data processing unit The calibration execution device according to any one of (1) to (5), which executes output processing of notification information indicating that calibration has been completed when calibration of the device is completed.

[0294] (7) The device to be calibrated is at least one of an acceleration sensor or a gyro sensor, The data processing unit (a) Input processing of a calibration start instruction, (b) Processing of storing the electronic device in an electronic device storage box, (c) Processing of rotating the electronic device storage box storing the electronic device according to a specified sequence, The calibration execution device according to any one of (1) to (6), which outputs guide information for causing the user to execute at least each of the above (a) to (c) processes.

[0295] (8) The electronic device storage box is a rectangular parallelepiped, and identification numbers indicating the order of rotation processing are recorded on each surface of the electronic device storage box. The data processing unit The calibration execution device according to (7), which outputs guide information specifying the identification number as instruction information on the rotation direction of the electronic device storage box.

[0296] (9) The data processing unit is configured to perform calibration of the acceleration sensor while executing a process of rotating the electronic device storage box storing the electronic device according to a specified sequence. The calibration execution device according to (7) or (8), which sequentially obtains detection values of the acceleration sensor in a state where each surface of the electronic device storage box is sequentially set upward in a specified sequence according to the guide information, and executes calibration of the acceleration sensor.

[0297] (10) The data processing unit is configured to perform calibration of the gyro while executing a process of rotating the electronic device storage box storing the electronic device according to a specified sequence. The calibration execution device according to any one of (7) to (9), which sequentially obtains detection values of the gyro in a state where the electronic device storage box rotates in a specified direction in a specified sequence according to the guide information, and executes calibration of the gyro.

[0298] (11) The device to be calibrated is a proximity sensor. The data processing unit (a) A process of arranging the electronic device at a specified position with respect to a box that is a proximity sensor calibration tool (b) An input process for an instruction to start calibration, The calibration execution device according to any one of (1) to (10), which outputs guide information for causing the user to execute at least each of the above processes (a) to (b).

[0299] (12) The box has a configuration in which a gray card having a predetermined reflectance is attached, When the electronic device is disposed at the specified position, the distance between the proximity sensor of the electronic device and the gray card is set to a distance corresponding to a threshold distance applied to detection of the presence or absence of a proximity object by the proximity sensor. The calibration execution device according to (11).

[0300] (13) The proximity sensor, is a proximity sensor having a hysteresis with two threshold distances, a first threshold distance applied when an object approaches and a second threshold distance applied when an object moves away, for detection of the presence or absence of a proximity object, The data processing unit, a first calibration with the distance between the proximity sensor of the electronic device and the gray card set to the first threshold distance, and a second calibration with the distance between the proximity sensor of the electronic device and the gray card set to the second threshold distance are executed. The calibration execution device according to (12).

[0301] (14) The device to be calibrated is at least one of an illuminance sensor or an RGB sensor, The data processing unit, (a) a process of storing the electronic device in an electronic device storage box, (b) an input process of an instruction to start calibration, Guide information for causing the user to execute at least each of the above processes (a) to (b) is output. The calibration execution device according to any one of (1) to (13).

[0302] (15) The box is a box to which a reflective sheet having a predetermined reflectance is attached, The data processing unit, After storing the electronic device in the electronic device storage box, an image with a specified brightness and color is output to the display unit of the electronic device. The calibration execution device according to (14), which verifies the sensor detection value of an illuminance sensor or an RGB sensor that inputs the output image light reflected by the reflection sheet, and executes calibration of at least one of the illuminance sensor and the RGB sensor.

[0303] (16) The box is a box having a light emitting part. The data processing unit After storing the electronic device in the electronic device storage box, the sensor detection value of an illuminance sensor or an RGB sensor that inputs light with a specified brightness and color output by the light emitting part is verified, and calibration of at least one of the illuminance sensor and the RGB sensor is executed. The calibration execution device according to (14) or (15).

[0304] (17) The device to be calibrated is a display. The data processing unit (a) A process of storing the electronic device in the electronic device storage box. (b) An input process for an instruction to start calibration. The calibration execution device according to any one of (1) to (16), which outputs guide information for causing the user to execute at least each of the above processes (a) to (b).

[0305] (18) The box is a box to which a reflection sheet having a predetermined reflectance is attached. The data processing unit After storing the electronic device in the electronic device storage box, an image with a specified brightness and color is output to the display unit of the electronic device. The calibration execution device according to (17), which verifies the sensor detection value of an illuminance sensor or an RGB sensor that inputs the output image light reflected by the reflection sheet, and executes calibration of the display.

[0306] (19) The data processing unit executes at least one of the adjustment processes of brightness adjustment, color tone adjustment, or white balance adjustment as the calibration of the display, in the calibration execution device according to (18).

[0307] (20) A calibration execution method executed in the calibration execution device, wherein the calibration execution device has a data processing unit that outputs guide information for calibration of a device mounted on an electronic device, and the data processing unit outputs guide information explaining the processes to be executed by the user during the execution of the calibration of the device, and the guide information is a calibration execution method including user processing for a box that is a calibration tool having functions or information used when executing calibration.

[0308] Note that the series of processes described in the specification can be executed by hardware, software, or a combined configuration of both. When executing the process by software, a program recording the process sequence is installed in the memory in a computer incorporated in dedicated hardware and executed, or the program can be installed in a general-purpose computer capable of executing various processes and executed. For example, the program can be recorded in a recording medium in advance. In addition to installing from the recording medium to the computer, the program can be received via a network such as a LAN (Local Area Network) or the Internet and installed in a recording medium such as a built-in hard disk.

[0309] In addition, various processes described in the specification are not only executed in time series according to the description, but may also be executed in parallel or individually according to the processing capacity of the device that executes the processes or as necessary. Further, in this specification, a system is a logical collective configuration of a plurality of devices, and is not limited to those in which the devices of each configuration are within the same housing.

Industrial Applicability

[0310] As described above, according to the configuration of an embodiment of the present disclosure, it becomes possible for a user to correctly perform calibration of sensors mounted on an electronic device such as a smartphone. Specifically, for example, guide information for explaining the execution procedure and the like of calibration of various sensors mounted on an electronic device such as a smartphone is output. The guide information is instruction information for user processing with respect to a box that is a calibration tool having functions or information that can be used when performing calibration. The box is, for example, an electronic device storage box that is a packaging material for an electronic device such as a smartphone. By performing processing using the electronic device storage box according to the guide information, the user can correctly perform calibration of various sensors such as an acceleration sensor and a gyro. With this configuration, it becomes possible for a user to correctly perform calibration of sensors mounted on an electronic device such as a smartphone.

Explanation of Signs

[0311] 10 Smartphone 11 Front Camera 12 Proximity Sensor 13 Illuminance Sensor 14 RGB Sensor 15 Display 16 Fingerprint Sensor 17 Touch Sensor 18 Main Camera (Rear Camera) 19 Illuminance Sensor 20 RGB Sensor 21 Distance Sensor (TOF Sensor) 24 IMU (Inertial Measurement Unit) 25 Acceleration Sensor 26 Gyro 30 Smartphone Storage Box 31 Calibration Execution Procedure Identification Number 33 Height Adjustment Tool 40 Reflective Sheet 41 Alignment Line 45 Light Emitting Unit 50 Proximity Sensor Calibration Tool 51 Gray Card 70 Tablet Terminal 71 Tablet Terminal Storage Box 72 Head-Mounted Display 73 Head-Mounted Display Storage Box 74 Earphone 75 Earphone Storage Box 76 Smartwatch 77 Smartwatch Storage Box 78 Drone 79 Drone Storage Box 301 CPU 302 ROM 303 RAM 304 Bus 305 Input / Output Interface 306 Input Unit 307 Output Unit 308 Storage Unit 309 Communication Unit 310 Drive 311 Removable Media

Claims

1. A calibration execution device having a data processing unit that outputs guide information for calibrating a device attached to an electronic device, wherein the data processing unit outputs guide information explaining the processing to be executed by the user when calibrating the device, wherein the guide information is a calibration execution device including user processing for a box that is a calibration tool having functions or information used when executing calibration.

2. The calibration execution device according to claim 1, wherein the box is an electronic device storage box that is a packaging material for the electronic device.

3. The calibration execution device according to claim 1, wherein the data processing unit outputs the guide information using voice information via a speaker or display information for a display unit.

4. The calibration execution device according to claim 1, wherein the data processing unit starts calibration of the device based on an input of a calibration start instruction from the user.

5. The calibration execution device according to claim 1, wherein the data processing unit starts calibration of the device based on detection of a tap on a calibration start instruction input unit displayed on a display unit of the electronic device.

6. The calibration execution device according to claim 1, wherein the data processing unit executes output processing of notification information indicating that calibration has been completed when calibration of the device is completed.

7. The device to be calibrated is at least one of an acceleration sensor or a gyro, wherein the data processing unit (a) input processing of a calibration start instruction, (b) processing of storing the electronic device in an electronic device storage box, (c) processing of rotating the electronic device storage box storing the electronic device according to a specified sequence, The calibration execution device according to claim 1, which outputs guide information for causing the user to execute at least each of the above (a) to (c) processes.

8. The electronic device storage box is a rectangular parallelepiped, and an identification number indicating the order of rotation processing is recorded on each surface of the electronic device storage box, wherein the data processing unit outputs guide information designating the identification number as instruction information on the rotation direction of the electronic device storage box.

9. The data processing unit is configured to perform calibration of the acceleration sensor while executing a process of rotating an electronic device storage box storing the electronic device according to a specified sequence, and to perform calibration of the acceleration sensor by sequentially acquiring detection values of the acceleration sensor in a state where each surface of the electronic device storage box is sequentially set upward in a specified sequence according to the guide information. The calibration execution device according to claim 7.

10. The data processing unit is configured to perform calibration of the gyro while executing a process of rotating an electronic device storage box storing the electronic device according to a specified sequence, and to perform calibration of the gyro by sequentially acquiring detection values of the gyro in a state where the electronic device storage box rotates in a specified direction in a specified sequence according to the guide information. The calibration execution device according to claim 7.

11. The device to be calibrated is a proximity sensor, and the data processing unit performs (a) a process of arranging the electronic device at a specified position with respect to a box that is a proximity sensor calibration tool, and (b) an input process for an instruction to start calibration, and outputs guide information for causing the user to execute at least each of the above processes (a) to (b). The calibration execution device according to claim 1.

12. The box is configured such that a gray card having a predetermined reflectance is attached, and when the electronic device is arranged at the specified position, the distance between the proximity sensor of the electronic device and the gray card is set to a distance corresponding to a threshold distance applied to detection of the presence or absence of a proximity object by the proximity sensor. The calibration execution device according to claim 11.

13. The proximity sensor is a proximity sensor having hysteresis with two threshold distances, a first threshold distance applied when an object approaches and a second threshold distance applied when an object moves away, for detecting the presence or absence of a proximity object, and the data processing unit performs first calibration in a state where the distance between the proximity sensor of the electronic device and the gray card is set to the first threshold distance, and The calibration execution device according to claim 12, which executes a second calibration in a state where the distance between the proximity sensor of the electronic device and the gray card is set to the second threshold distance.

14. The device to be calibrated is at least one of an illuminance sensor or an RGB sensor, The data processing unit, (a) A process of storing the electronic device in an electronic device storage box, (b) An input process for an instruction to start calibration, The calibration execution device according to claim 1, which outputs guide information for causing the user to execute at least each of the processes (a) to (b) above.

15. The box is a box to which a reflective sheet having a predetermined reflectance is attached, The data processing unit, After storing the electronic device in the electronic device storage box, an image with a specified brightness and color is output to the display unit of the electronic device, The calibration execution device according to claim 14, which verifies the sensor detection value of an illuminance sensor or an RGB sensor that inputs the output image light reflected by the reflective sheet, and calibrates at least one of the illuminance sensor or the RGB sensor.

16. The box is a box having a light emitting unit, The data processing unit, After storing the electronic device in the electronic device storage box, the sensor detection value of an illuminance sensor or an RGB sensor that inputs light with a specified brightness and color output by the light emitting unit is verified, and at least one of the illuminance sensor or the RGB sensor is calibrated. The calibration execution device according to claim 14.

17. The device to be calibrated is a display, The data processing unit, (a) A process of storing the electronic device in an electronic device storage box, (b) An input process for an instruction to start calibration, The calibration execution device according to claim 1, which outputs guide information for causing the user to execute at least each of the processes (a) to (b) above.

18. The box is a box to which a reflective sheet having a predetermined reflectance is attached, The data processing unit, After storing the electronic device in the electronic device storage box, an image with a specified brightness and color is output to the display unit of the electronic device, The calibration execution device according to claim 17, which verifies the sensor detection value of an illuminance sensor or an RGB sensor that has received the output image light reflected by the reflection sheet and executes calibration of the display.

19. The data processing unit The calibration execution device according to claim 18, which executes at least one of adjustment processes of luminance adjustment, color adjustment, or white balance adjustment as calibration of the display.

20. A calibration execution method executed in a calibration execution device, The calibration execution device has a data processing unit that outputs guide information for calibration of a device attached to an electronic device, The data processing unit outputs guide information explaining the process to be executed by the user when executing calibration of the device, The guide information A calibration execution method including user processing for a box that is a calibration tool having a function or information used when executing calibration.

Images