Portable information terminal, terminal body, and accessory

Abstract

The invention provides a technology for improving visibility of a projected image in a portable information terminal capable of adding an image projection function. A portable information terminal includes a terminal body and an accessory mounted on the terminal body and communicably connected with the terminal body. The attachment has a projection unit that projects an image on the basis of image information obtained from the terminal body, and is configured such that the direction of a projection opening of the projection unit is variable with respect to the terminal body. The terminal body or the accessory determines a state of the portable information terminal including a position of the accessory relative to the terminal body. The terminal body or the accessory performs projection control of the image based on the determined state. The projection control includes, for example, image rotation control, image shape control, or projection angle control.

Description

Technical Field

[0001] The invention relates to a portable information terminal, a terminal main body and accessories. Background Art

[0002] In recent years, a type of portable information terminal called a smart watch that is worn on the arm has become known. The smart watch is equipped with a touch screen, various control devices, sensors, etc. The user can use various functions by touching the text or icons displayed on the touch screen, for example, displaying biological information such as heart rate measured by a sensor, or displaying the status of email reception.

[0003] As one of the above-mentioned portable information terminals of the type worn on the arm, a terminal is known which has a small display unit mounted outside the display screen of the main body in order to make it easier for the user to view information, and has a function of displaying information on the small display unit. For example, Patent Document 1 describes the following electronic device.

[0004] The housing of the electronic device has a first portion located on the front side of the housing, a second portion located on the side of the housing, a first strap mounting portion, and a second strap mounting portion. The second portion has a function of displaying an image. The first strap mounting portion is located on the side located on the upper side as viewed from the front side of the housing. The second portion and the second strap mounting portion are located on the side located on the lower side as viewed from the front side of the housing. The first portion has a function of displaying an image, or has at least one of an hour hand, a minute hand, and a second hand. With such a structure, it is easy for a user to read the displayed information.

[0005] Prior art literature

[0006] Patent Literature

[0007] Patent Document 1: Japanese Patent Application Publication No. 2022-23057 Summary of the invention

[0008] Technical problem to be solved by the invention

[0009] The electronic device described in Patent Document 1 has a structure in which a small display unit is mounted on the side of the housing. Therefore, it is not considered that, for example, when a user wearing the electronic device wants to share the displayed information with a person other than the user, the information can be easily recognized by people other than the user. In addition, for example, if only a second display screen is added to the narrow side of the electronic device, it is difficult to say that it has sufficiently high usability when the user wants to view more information. That is, there is room for improvement in the recognizability of the displayed information.

[0010] Under the circumstances described above, there is a demand for a technology for further improving the visibility of displayed information in a portable information terminal.

[0011] Technical means of solving problems

[0012] One of the representative embodiments of the present invention is a portable information terminal that can be worn on an arm, which includes a terminal body and an accessory, wherein the accessory is installed on the terminal body and is communicatively connected to the terminal body, wherein the accessory has a projection unit that projects an image based on image information obtained from the terminal body, and is constructed so that the direction of the projection port of the projection unit is variable relative to the terminal body, the terminal body or the accessory determines a state of the portable information terminal, wherein the state includes a position of the accessory relative to the terminal body, and the terminal body or the accessory controls the projection of the image based on the determined state.

[0013] One of the representative embodiments of the present invention is a terminal body for constituting a portable information terminal that can be worn on an arm, comprising: a mechanism for installing an accessory, wherein the accessory has a projection portion for projecting an image, and is configured so that the direction of a projection port of the projection portion is variable relative to the terminal body; a communication portion that exchanges information with the accessory; a generation unit that generates image information to be sent to the accessory via the communication portion; and an acquisition unit that acquires information indicating the direction of the projection port from the accessory, wherein the image information is edited based on the information acquired by the acquisition unit.

[0014] One of the representative embodiments of the present invention is an accessory for constituting a portable information terminal that can be worn on an arm, which can be installed on the main body of the portable information terminal, is communicatively connected to the main body, has a projection unit that projects an image based on image information obtained from the main body, and is constructed so that the direction of the projection port of the projection unit is variable relative to the main body, the main body or the accessory determines the state of the portable information terminal, wherein the state includes the position of the accessory relative to the main body, and the main body or the accessory controls the projection of the image based on the determined state.

[0015] Effects of the Invention

[0016] According to a typical embodiment of the present invention, it is possible to provide a technology for further improving the visibility of information displayed in a portable information terminal. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1A This is a front view of the portable information terminal according to Embodiment 1.

[0018] Figure 1B This is a side view of the portable information terminal according to the first embodiment.

[0019] Figure 2It is a cross-sectional view taken along line AA of the portable information terminal shown in FIG. 1 .

[0020] Figure 3 This is a front view of the terminal body as viewed from the display surface side.

[0021] Figure 4 yes Figure 3 A cross-sectional view of the terminal body taken along line BB is shown.

[0022] Figure 5 It is the front view of the attachment.

[0023] Figure 6 yes Figure 5 A cross-sectional view of the accessory along line CC shown.

[0024] Figure 7 yes Figure 5 A cross-sectional view of the accessory along line DD is shown.

[0025] Figure 8 It is the back view of the accessories.

[0026] Fig. 9 is a timing diagram of the output signal obtained from the pattern detection sensor.

[0027] Fig.10 It is a rear view of a portable information terminal.

[0028] Fig.11 This is a diagram showing an example of the hardware configuration of a terminal main body.

[0029] Fig.12 It is a diagram showing a configuration example of a projection unit in the appendix.

[0030] Fig.13 This is a flowchart showing the initialization process when the accessory is installed.

[0031] Fig.14 The diagram shows an example of message display.

[0032] Fig.15A It is a front view of the portable information terminal of the first embodiment.

[0033] Fig. 15B It is a side view of the portable information terminal of the first embodiment.

[0034] Fig.16A It is a front view of the portable information terminal of the second embodiment.

[0035] Fig. 16B It is a side view of the portable information terminal of the second embodiment.

[0036] Fig.17A It is a front view of the portable information terminal of the third embodiment.

[0037] Fig. 17B It is a side view of the portable information terminal of the third embodiment.

[0038] Fig.18A It is a front view of the portable information terminal of the fourth embodiment.

[0039] Fig.18B It is a side view of the portable information terminal of the fourth embodiment.

[0040] Fig.19 It is a front view of the portable information terminal of the fifth embodiment.

[0041] Fig. 20A It is a front view of the portable information terminal of the sixth embodiment.

[0042] Fig. 20B It is a side view of the portable information terminal of the sixth embodiment.

[0043] Fig.21 It is a front view of the portable information terminal of the seventh embodiment.

[0044] Fig.22A It is a front view of the portable information terminal of the eighth embodiment.

[0045] Fig. 22B It is a side view of the portable information terminal of the eighth embodiment.

[0046] Fig.23 It is a front view of the portable information terminal of the ninth embodiment.

[0047] Fig.24 This is a diagram showing an example of a setting information table.

[0048] Fig.25 It is a diagram showing an example of detailed contents of a setting information table.

[0049] Fig.26 This is a diagram showing an example of a table showing the correspondence relationship between the accessory rotation position and the accessory rotation angle.

[0050] Fig. 27 This is a diagram showing a table that gives an example of the correspondence between the terminal body posture, the inclination direction of the terminal body, and the upward inclination angle.

[0051] Fig.28 This is a diagram showing an example of the contents of the setting information associated with the setting information table.

[0052] Fig.29 This is a flowchart showing an example of processing for automatically determining whether the arm on which the portable information terminal is worn is the left or right arm.

[0053] Fig.30 This is a flowchart showing an example of processing for determining whether the portable information terminal is worn on the inside or outside of the arm.

[0054] Fig.31 This is a flowchart showing an example of processing related to projection of display content in a portable information terminal.

[0055] Fig.32A This is a front view of a portable information terminal according to a first modified example of the first embodiment.

[0056] Fig.32B This is a side view of a portable information terminal according to a first modified example of the first embodiment.

[0057] Fig.33 This is a diagram showing an example of a portable information terminal according to a first variation of the first embodiment.

[0058] Fig.34 Yes means Fig.33 A diagram showing a modified example of the embodiment of the portable information terminal shown.

[0059] Fig.35 This is a diagram showing an example of a setting information table.

[0060] Fig.36 It is a diagram showing an example of detailed contents of a setting information table.

[0061] Fig.37A This is a front view of a portable information terminal according to a second modified example of the first embodiment.

[0062] Fig.37B This is a side view of a portable information terminal according to a second modified example of the first embodiment.

[0063] Fig.38 This is a diagram showing a configuration example of a portable information terminal according to the second embodiment.

[0064] Fig.39 This is a diagram showing a portable information terminal according to a first variant of the second embodiment. DETAILED DESCRIPTION

[0065] The following is an explanation of the embodiments of the present invention using the accompanying drawings. In each embodiment and the accompanying drawings, the same reference numerals and signs are given to the same or equivalent components, and repeated explanations are omitted except for special cases.

[0066] (Implementation method 1)

[0067] The portable information terminal of the first embodiment is described. The portable information terminal of the first embodiment has a function of projecting an image or a dynamic image (hereinafter referred to as an image) as a display content. In addition, the portable information terminal of the first embodiment is, for example, a so-called watch-type device worn on the arm of the user. First, the structure of the portable information terminal of the first embodiment is described.

[0068] <Structure of portable information terminal>

[0069] Figure 1A This is a front view of the portable information terminal 10 according to the first embodiment. Figure 1B 1 is a side view of the portable information terminal 10 according to the first embodiment. Figure 1A , Figure 1B As shown, when viewing the display surface of the portable information terminal from the front, the upward direction is set as the front direction F, the downward direction is set as the rear direction B, the right direction is set as the right direction R, the left direction is set as the left direction L, the direction toward the near side (i.e. the front side, the side close to the user) is set as the upper direction U, and the direction toward the far side (i.e. the deep side, the side far from the user) is set as the downward direction D.

[0070] like Figure 1A , Figure 1B As shown, the portable information terminal 10 is mainly composed of a terminal body 11 and an accessory 21 .

[0071] The terminal body 11 has a circular peripheral edge portion. The terminal body 11 also includes a housing 12, a touch panel portion 13, a marking portion 14, a strap 17, and a home button 191 as components.

[0072] The housing 12 is equivalent to the so-called housing of the terminal body 11, and is roughly in the shape of a cylinder with a short columnar axis length, or a thick disc shape. The touch screen unit 13 is arranged on the surface of the housing 12, for example, in a rectangular shape or a disc shape. The touch screen unit 13 is configured so that its display unit and input unit are integrated. The display unit displays the time, biometric information, and other information, and is composed of display elements such as a liquid crystal panel and an organic EL. The input unit receives the user's touch operation and is composed of a touch sensor of an electrostatic capacitance method.

[0073] The marking portion 14 is arranged at a specific direction and position in the housing 12 and functions as a mark. In this embodiment, the marking portion 14 is a triangular mark located at the 12 o'clock direction of a general watch. The strap 17 is connected to the housing 12 and is a component that is wound around the user's arm to wear the portable information terminal 10 on the user's arm.

[0074] The home button 191 is a physical button provided separately from the touch panel unit 13 on the display surface side of the touch panel unit 13 of the housing 12. The home button 191 is used to return the displayed information to the main menu screen, for example.

[0075] The accessory 21 is configured to be detachable from the circumferential edge portion forming the side surface of the housing 12. In addition, the accessory 21 is configured to be rotatable relative to the housing 12 when attached to the circumferential edge portion of the housing 12. In addition, the accessory 21 is configured to be able to communicate with the terminal body 11.

[0076] The attachment 21 is mainly composed of a frame portion 213 and a projection portion 22 .

[0077] The frame portion 213 is configured to be mounted on the peripheral portion of the housing 12. In addition, the frame portion 213 is configured to be a ring-shaped frame portion that surrounds the display screen of the touch screen portion 13 when mounted on the peripheral portion of the housing 12, and is rotatable relative to the housing 12. The projection unit 22 is provided on the frame portion 213 in a manner that is integral with the frame portion 213.

[0078] The projection unit 22 has a function of projecting an image representing display content onto an object such as the back of a hand, a wall, or a table. A projection port 25 is formed in the projection unit 22, and the projection light 10p is diffusely projected from the projection port 25 in the projection port direction PA, which is the central axis direction of the opening of the projection port 25. The details of the structure of the attachment 21 will be described later.

[0079] Figure 2 It is a cross-sectional view taken along line AA of the portable information terminal 10 shown in FIG. 1 . Figure 2 Indicates a state where the accessory 21 is mounted on the housing 12. Figure 2 In FIG. 2 , the oblique line portion represents a cross section of the attachment 21 .

[0080] The portable information terminal 10 has a body information measurement sensor 16. The body information measurement sensor 16 is configured to be in contact with the skin when the user wears the portable information terminal 10 on the arm. The body information measurement sensor 16 has a function of measuring the user's pulse, electrocardiogram, blood flow, etc., and outputs a signal corresponding to the measurement result.

[0081] The housing 12 has a display surface side convex portion 12a and a sensor side convex portion 12b. The display surface side convex portion 12a is a convex portion formed along the circumferential direction on the display surface side of the touch screen portion 13 and has a tapered shape. The sensor side convex portion 12b is a convex portion formed along the circumferential direction on the side of the housing 12 where the body information measurement sensor 16 is arranged and has a width d in the radial direction. In this way, by forming the inner circumference of the frame portion 213 in a manner that imitates the circumferential shape of the housing 12, the portable information terminal 10 is configured so that the frame portion 213 does not detach from the housing 12.

[0082] The portable information terminal 10 has a control circuit board 15 in the housing 12. The control circuit board 15 controls the system of the portable information terminal 10, or controls the display of the touch screen portion 13, or controls the image projected from the projection portion 22 of the frame portion 213. In addition, the portable information terminal 10 has an internal space 22i inside the housing of the projection portion 22 provided on the frame portion 213. In the internal space 22i, a control circuit board 27 of the projection portion 22 described in detail later, a projection optical system not shown, etc. are stored.

[0083] Figure 3 It is a front view of the terminal body 11 viewed from the display surface side. That is, Figure 3 2 shows the state where the frame portion 213 of the portable information terminal 10 is removed. Figure 3 As shown, pattern detection sensors 12c and 12d are provided on the housing 12 of the terminal body 11. The pattern detection sensors 12c and 12d irradiate light and detect the amount of reflected light corresponding to the pattern of the reflecting surface of the irradiated light. The details of the operation of the pattern detection sensors 12c and 12d will be described later.

[0084] Figure 4 yes Figure 3 The BB line cross-sectional view of the terminal body 11 is shown. Figure 4 As shown, a plurality of grooves are formed along the circumferential side of the housing 12, and slip rings 18a to 18d are arranged in these grooves. The frame portion 213 is rotatably engaged with the slip rings 18a to 18d, and the frame portion 213 and the slip rings 18a to 18d are configured to be electrically connected. The slip rings 18a to 18d are electrically insulated from each other.

[0085] Here, for example, slip rings 18a and 18d are allocated as terminals for supplying power from a power source included in the terminal body 11 to the frame portion 213, and slip rings 18b and 18c are allocated as terminals for transmitting and receiving signals to and from the frame portion 213 using differential binary signals.

[0086] like Figure 4As shown, a housing side frame back contact surface 12e is formed on the sensor side protrusion 12b. The pattern detection sensors 12c and 12d are arranged on the housing side frame back contact surface 12e. The housing side frame back contact surface 12e has a width d in the radial direction of the frame portion 213.

[0087] Here, the structure of the attachment 21 is described in detail with reference to the drawings.

[0088] Figure 5 This is the front view of Annex 21. Figure 5 As shown, the frame portion 213 has a first semicircular component 211, a second semicircular component 212, a pin 23 and a fixing member 24. The first semicircular component 211 and the second semicircular component 212 are each roughly semicircular in shape, and a through hole is formed at one end in the circumferential direction. The pin 23 is inserted into the through hole of the first semicircular component 211 when the through hole of the first semicircular component 211 and the through hole of the second semicircular component 212 overlap, and the first semicircular component 211 and the second semicircular component 212 are connected so that they can be opened and closed with the pin 23 as a fulcrum. The fixing member 24 connects and fixes the first semicircular component 211 and the second semicircular component 212 when the first semicircular component 211 and the second semicircular component 212 are closed.

[0089] The projection unit 22 is arranged near the center of the outer periphery of the second semicircular part 212 in a manner that does not interfere with the terminal body 11, and is integrally formed with the first semicircular part 211. The projection unit 22 is configured to project projection light so that display contents such as images or dynamic images representing text, graphics, images, etc. are projected onto an object. The projection port 25 is arranged on the side of the projection unit 22 and is an optical opening for projection of the projection light 10p. Therefore, the projection unit 22 integrated with the frame portion 213 can rotate together with the frame portion 213, and the diffusion direction of the projection light 10p from the projection unit 22 can be freely changed 360 degrees.

[0090] The first semicircular member 211 and the second semicircular member 212 are connected by the fixing member 24 in a closed state so as to surround the side surface of the housing 12, whereby the frame portion 213 is mounted on the terminal body 11. With such a structure, the accessory 21 can be attached to and detached from the terminal body 11.

[0091] Figure 6 yes Figure 5 The CC line cross-sectional view of the attachment 21 shown in FIG. On the back of the first semicircular member 211 and the second semicircular member 212, except for the portion where the projection portion 22 is provided, a contact surface 12e ( Figure 4The main body side frame back contact surface 21b contacts the main body side frame back contact surface 21b. The main body side frame back contact surface 21b has a width d in the radial direction of the frame portion 213.

[0092] Figure 7 yes Figure 5 A cross-sectional view of the DD line of the accessory 21 shown. Terminals 26a to 26d are provided in the portion of the first semicircular member 211 and the second semicircular member 212 where the projection portion 22 is provided. The terminals 26a to 26d are respectively in contact with and electrically connected to the slip rings 18a to 18d when the frame portion 213 is mounted on the housing 12. With such a structure, it is possible to supply power to the frame portion 213 from a power source inside the housing 12, and to send and receive signals between the housing 12 and the frame portion 213. The power supplied to the frame portion 213 is also supplied to the control circuit board 27 etc. inside the projection portion 22.

[0093] Figure 8 This is a back view of the attachment 21. On the back of the frame portion 213, a pattern is formed on the surface of the back contact surface 21b of the main body side frame along the circumference having a width d in the radial direction of the frame portion 213. In this image, the first light reflecting surface 213a shown by the oblique lines and the second light reflecting surface 213b shown by the non-oblique lines are alternately arranged at an angle interval of θp. The light reflectivity of the first light reflecting surface 213a and the second light reflecting surface 213b are different from each other. In this embodiment, the second light reflecting surface 213b>first light reflecting surface 213a is adopted for the light reflectivity.

[0094] Figure 8 In the figure, the position 12c′ represents the pattern detection sensor 12c ( Figure 3 ) position, and similarly, the position 12d′ represents the pattern detection sensor 12d ( Figure 3 ) location.

[0095] Fig. 9 is a timing diagram of the output signal obtained from the pattern detection sensor. Fig. 9 The timing chart shown represents output signals obtained by the pattern detection sensor 12 c and the pattern detection sensor 12 d in a case where the accessory 21 rotates relative to the terminal body 11 . Fig. 9 In the timing chart shown, the horizontal axis represents the elapsed time t. The detection signal of the pattern detection sensor 12c and the detection signal of the pattern detection sensor 12d output an "H (high)" level on the second light reflection surface 213b with a relatively high reflectivity, and output an "L (low)" level on the first light reflection surface 213a with a relatively low reflectivity.

[0096] Here, for example, the pattern detection sensor 12c and the pattern detection sensor 12d are arranged so as to be located along the rotation direction RF ( Figure 8 ) rotate at a constant speed, the angular interval between their positions is 2θp+θp / 2 as mentioned above. Therefore, Fig. 9 As shown, the output signal of the pattern detection sensor 12c is a pulse that rises from the "L" level to the "H" level earlier than the signal output of the pattern detection sensor 12d. Figure 8 ) rotates at a constant speed, such as Fig. 9 As shown, the output signal of the pattern detection sensor 12c is a pulse whose timing of rising from the "L" level to the "H" level is later than the signal output of the pattern detection sensor 12d.

[0097] Therefore, the rotation angle of the frame portion 213 relative to the terminal body 11 can be grasped based on the number of pulses output by the pattern detection sensor 12c and the pattern detection sensor 12d, that is, the number of changes in the H level and the L level. In addition, regarding the rotation direction of the frame portion 213, when the output signal of the pattern detection sensor 12d rises from the "L" level to the "H" level, the signal output of the pattern detection sensor 12c can be determined as the RF direction if it is the "H" level, and can be determined as the RB direction if it is the "L" level.

[0098] In this way, the function of a rotary encoder can be realized by utilizing the pattern on the main body side frame back surface contact surface 21b and the above-mentioned structure of the pattern detection sensors 12c and 12d.

[0099] Although not shown, the terminal body 11 and the frame portion 213 may be configured to provide an operational feel in which the terminals rotate with a click while being locked at a predetermined angle, for example, at a pattern interval θp of the minimum detectable angle.

[0100] Fig.10 1 is a rear view of the portable information terminal 10. Fig.10 As shown, a reset button 192 as a push-type physical button is provided on the back of the terminal body 11 of the portable information terminal 10. The reset button 192 is used to initialize the measurement content of the rotation angle and rotation direction of the frame portion 213 when the frame portion 213 is mounted on the terminal body 11 and rotated. When the reset button 192 is pressed, the initialization process is performed. The details of the initialization process will be described later.

[0101] 〈Internal structure and functions of the terminal body〉

[0102] Fig.11 1 is a diagram showing an example of the hardware configuration of the terminal main body 11. Fig.11As shown, the terminal body 11 has a communication interface (I / F) 113, a control unit 114, a touch screen unit 13, a microphone 161, a speaker 162, a sound input and output unit 160, a home button 191, a reset button 192, a switch input unit 150, a storage device 125, a mobile communication interface (I / F) 131, a memory 132, an acceleration sensor 133, a pulse counter 134, a GPS receiving unit 135, a gyro sensor 136, a geomagnetic sensor 137, a pattern detection sensor 12c, a pattern detection sensor 12d, a pulse counter 134, a switch input unit 150, a body information measurement sensor 16, a sensor interface (I / F) 139, an image output interface (I / F) 170, a battery 180 and slip rings 18a~18d. In addition, each functional unit other than the home button 191 , the reset button 192 , the microphone 161 , the speaker 162 , the biological information measurement sensor 16 , the battery 180 , and the slip rings 18 a to 18 d is connected via the bus 101 .

[0103] The battery 180 is a power source of the portable information terminal 10. The battery 180 supplies power to each component of the terminal body 11, or supplies power to the frame portion 213 and the projection portion 22 via the slip rings 18a and 18d. The battery 180 is, for example, a rechargeable secondary battery such as a lithium-ion battery, and can be charged by a charging circuit not shown. In addition, the battery 180 supplies power to each component and the slip rings 18a and 18d via a power supply voltage conversion circuit not shown as needed.

[0104] The storage device 125 stores application programs. The control unit 114 can realize various functions by loading application programs from the storage device 125 into the memory 132 and executing the loaded application programs.

[0105] In order to simplify the description, various functions realized by the control unit 114 executing the application program will be described below as being realized mainly by various program function units.

[0106] The application program may be stored in the storage device 125 before the terminal body 11 is shipped. Alternatively, the application program may be stored in an optical medium such as a CD (Compact Disk) or a DVD (Digital Versatile Disk) or a semiconductor memory and installed in the terminal body 11 via a medium connection unit (not shown).

[0107] In addition, the application can also be downloaded from an external network (not shown) via the communication interface 113 and a wireless router (not shown) and installed in the terminal body 11. Alternatively, the application can also be downloaded from a distribution source via the mobile communication interface 131 and a base station (not shown) and installed in the terminal body 11.

[0108] Furthermore, the terminal body 11 can be connected to a personal computer that has acquired the application program via a network via an external device connection interface (not shown), and the application program can be moved or copied from the personal computer to the terminal body 11 and installed.

[0109] In addition, the application program can also be realized by hardware as a processing unit having the same function. When realized by hardware, each function is realized mainly by each processing unit.

[0110] The communication interface 113 is connected to a wireless router (not shown) via a wireless LAN (Local Area Network) etc. The communication interface 113 is also connected to an external network via a wireless router to transmit and receive information to and from a server etc. on the external network.

[0111] In addition to or instead of the communication function with the wireless router, the communication interface 113 can directly communicate with the server without going through the wireless router using a wireless LAN technology such as Wi-Fi (registered trademark).

[0112] The communication interface 113 may be equipped with a plurality of chips supporting different communication methods. Alternatively, the communication interface 113 may be equipped with a single chip supporting a plurality of different communication methods. The communication interface 113 may also communicate with other devices using a communication method called BLUETOOTH (registered trademark) for short-range communication.

[0113] The mobile communication interface 131 uses a mobile communication network such as LTE (Long Term Evolution) communication, 4G communication, or 5G communication, and is connected to the communication network through a base station. The mobile communication interface 131 can send and receive information with a server on the communication network, and can share each other's locations between terminals. In addition, the communication method is not limited to the above example.

[0114] Furthermore, the portable information terminal 10 may be configured to give priority to connection to an external network achieved through the communication interface 113 over connection to a communication network achieved through the mobile communication interface 131 .

[0115] The control unit 114 receives a user's operation request from the home button 191 or the reset button 192 via the switch input unit 150, or receives a user's operation request from the microphone 161 via the sound input and output unit 160. The control unit 114 controls the touch screen unit 13, the communication interface 113, and various program function units according to the received operation request.

[0116] Furthermore, the control unit 114 can obtain various information from a server on an external network via the communication interface 113 and a wireless router or via the mobile communication interface 131 and a base station. The control unit 114 has the function of transmitting the obtained various information to various program function units. The user can use these functions to interact with the communication partner through images and sounds to perform voice chat, etc.

[0117] The storage device 125 is controlled by an instruction of the control unit 114 and can store the application program. In addition, the storage device 125 stores various information generated by the application program.

[0118] The storage device 125 can store contents such as video and audio streams based on signals received from the communication interface 113 or the mobile communication interface 131. The storage device 125 can be built into the portable information terminal 10, or can be a memory mounted in a removable frame portion 213 that is detachable from the terminal body 11 of the portable information terminal 10.

[0119] The memory 132 is controlled by instructions from the control unit 114. The functional parts of the application program stored in the storage device 125 are loaded into the memory 132 by the control unit 114.

[0120] The display unit 13 b constituting the touch screen unit 13 is used to display images and videos stored in the storage device 125 , broadcast or distributed videos, a user interface (UI) for performing various operations, images generated by applications, etc. In addition, the display unit 13 b may also display images and videos received from a server on an external network via the communication interface 113 .

[0121] Furthermore, the display unit 13 b may display images and videos received from a television receiver via the communication interface 113 , or may display images and videos distributed from a server on a communication network via the mobile communication interface 131 .

[0122] The home button 191 and the reset button 192 are components for receiving operations performed by the user on the terminal body 11 of the portable information terminal 10 , and are input units for inputting control information related to input operations.

[0123] The drag operation is, for example, an operation of touching an arbitrary object such as an icon displayed on the display screen of the touch panel unit 13 with a finger and moving it in this state. The flick operation is an operation of moving a finger in a flicking manner on the display screen of the touch panel unit 13 .

[0124] When performing a tap operation or a double tap operation, an object such as an icon can be activated or another screen can be switched. A tap operation is an operation of tapping an object once with a finger. A double tap operation is an operation of tapping an object twice with a finger. Here, each operation in the touch screen unit 13 is referred to as a drag operation, a flick operation, and a tap operation for explanation.

[0125] The acceleration sensor 133 measures the acceleration received by the portable information terminal 10. The geomagnetic sensor 137 measures the geomagnetic field at the location where the portable information terminal 10 is located.

[0126] The pulse counter 134 is used to count the pulses ( Fig. 9 ) is counted. The control unit 114 detects the rotation direction of the accessory 21 based on the signal of the pulse. The control unit 114 can obtain the rotation operation angle of the accessory 21 based on the detected rotation direction and the counted number of pulses.

[0127] In addition, the control unit 114 can detect which part of the terminal body 11 is on the top, that is, can detect the inclination, posture, etc. of the terminal body 11 by measuring the gravity acceleration using the acceleration sensor 133, for example. Furthermore, the control unit 114 can determine whether the arm of the user wearing the terminal body 11 is the right arm or the left arm based on the detected inclination, posture, etc. of the terminal body 11. In addition, the control unit 114 controls the shape of the image projected from the projection unit 22 integrally provided on the frame unit 213 installed on the terminal body 11 based on the detected inclination, posture, etc. of the terminal body 11, thereby being able to correct the deformation of the image. The content of this correction will be described later.

[0128] The geomagnetic sensor 137 measures the geomagnetic field using a plurality of magnetic sensors, etc. The GPS receiver 135 receives information transmitted from a plurality of satellites using the GPS (Global Positioning System). The control unit 114 can calculate the position information of the terminal body 11 of the portable information terminal 10 based on the signal received by the GPS receiver 135 .

[0129] The gyro sensor 136 measures an angular velocity of the terminal body 11 generated when the user moves the terminal body 11 or the like.

[0130] The physical information measurement sensor 16 generally adopts a structure that irradiates green light to the user's arm and outputs a signal corresponding to the amount of reflected light, for example, in order to measure the user's heart rate, blood flow, etc. However, the measurement object, measurement method, and structure of the physical information measurement sensor 16 are not limited to the above. The sensor interface 139 converts the output of the physical information measurement sensor 16 into a digital value. The control unit 114 processes the converted digital value through an application program to obtain the heart rate, blood flow, etc., and displays the heart rate, blood flow, etc. on the display unit 13b.

[0131] The audio input / output unit 160 receives an audio input signal from a microphone 161 provided in the portable information terminal 10, and outputs an audio output signal to a speaker 162. The control unit 114 controls the volume of the audio input / output.

[0132] The switch input unit 150 obtains switch information in response to the operation of the home button 191 or the reset button 192, and transmits the information to the control unit 114 via the bus 101. The control unit 114 uses the switch information for controlling various application programs as needed.

[0133] When the home button 191 is pressed, the control unit 114 controls each unit to make the inside of the terminal body 11 an initial state regardless of the operating state of the started application program, and returns the display screen to the initial screen in the operating system. The details of the operation of the terminal body 11 when the reset button 192 is pressed will be described later.

[0134] The image output interface 170 performs external output of the display image generated by the control unit 114 via the slip rings 18b and 18c, and exchanges information about the initialization process when the frame unit 213 is connected to the terminal body 11. In addition, in this embodiment, the display image is an image projected and displayed by the projection unit 22 provided on the detachable frame unit 213.

[0135] 〈Internal structure and function of the frame〉

[0136] Fig.12 2 is a diagram showing an example of the structure of the projection unit 22 in the attachment 21. Fig.12 As shown, the projection unit 22 includes terminals 26a to 26d, an image input interface (I / F) 203, a control unit 204, a nonvolatile memory 205, a memory 206, a display element driver 207, a projection optical system 208, a display element 209, an illumination optical system 210, and a light source 215. In addition, the image input interface 203, the control unit 204, the nonvolatile memory 205, the memory 206, and the display element driver 207 are connected to each other via a bus 201.

[0137] The electric power supplied from the terminal body 11 through the terminals 26 a and 26 d is supplied to each component through a power supply voltage conversion circuit (not shown) as necessary.

[0138] The light source 215 generates light as a source of projection light 10 p used when projecting images, videos, etc., and uses an LED light source, a laser light source, etc. The illumination optical system 210 converges the light generated by the light source 215 , further makes it uniform, and then irradiates the display element 209 .

[0139] The display element 209 is an element that transmits or reflects light from the illumination optical system 210 and modulates the light at this time to generate an image. The display element 209 is, for example, a transmissive liquid crystal panel, a reflective liquid crystal panel, a DMD (Digital Micromirror Device: registered trademark) panel, etc. The display element driving unit 207 sends a driving signal corresponding to the image signal to the display element 209. The projection optical system 208 is an enlarged projection optical system that projects an image, a video, etc. onto an object, and includes at least one of a lens and a reflector.

[0140] Here, the image signal referenced by the display element driving unit 207 is an image signal input from the terminal body 11 of the portable information terminal 10, and is input as a differential binary signal from the terminal 26b and the terminal 26c. In addition, the image signal referenced by the display element driving unit 207 may also be a signal obtained by superimposing an OSD (On Screen Display) image signal generated by the control unit 204 using an image stored in the non-volatile memory 205 on the image signal obtained via the image input interface 203. According to the drive signal generated by the display element driving unit 207 with reference to these image signals, the display element 209 modulates the light to generate an optical image. The generated optical image is projected as a display image by the projection optical system 208 in a manner having the degree of diffusion of the projection light 10p.

[0141] In addition, the protocol of the signal communicated between the slip rings 18b and 18c provided in the terminal body 11 of the portable information terminal 10 and the terminals 26b and 26c provided on the frame portion 213 is not particularly limited. However, if a known protocol such as USB (Universal Serial Bus) is used, existing communication software can be used, and the product development cost of the portable information terminal can be suppressed. As a result, the product of the portable information terminal can be provided to the user at a lower price.

[0142] 〈Initialization process when installing accessories〉

[0143] The portable information terminal 10 has an initialization processing function when the accessory is installed. The initialization processing function when the accessory is installed refers to the control unit 114 ( Fig.11 ) detects the installation of an accessory and performs initialization processing to make the accessory's functions effective (activate its functions).

[0144] Fig.13 This is a flowchart showing the initialization process when the accessory is installed.

[0145] In step S1301, the installation detection of the accessory is performed. Specifically, when the user installs the accessory 21 on the terminal body 11, the control unit 114 detects the installation of the accessory through, for example, the same processing as the processing when the USB is inserted. Then, a signal communication is performed between the control unit 114 and the accessory 21, wherein the signal indicates information about the function of the accessory 21, etc. Such communication processing is effective for increasing the types of accessories. For example, an accessory 21 with functions other than a projector, such as a camera function, can be prepared.

[0146] In step S1302, it is determined whether the accessory has a projection function. Specifically, the control unit 114 determines whether the accessory 21 has a projection function based on the information received from the installed accessory 21. In this determination, if it is determined that the accessory 21 has a projection function (S1302: "Yes"), the control unit 114 advances the processing step to be executed to step S1303. On the other hand, in this determination, if it is determined that the accessory 21 does not have a projection function (S1302: "No"), the control unit 114 transfers the processing step to be executed to step S1306.

[0147] In step S1303, a message is displayed. Specifically, the control unit 114 controls the display unit 13b to display a message for the accessory with a projection function. The displayed message, for example, prompts the user to align the pin 23 of the accessory 21 with the marking portion 14 and press the reset button 192 ( Fig.10 ) news.

[0148] Fig.14 is a diagram showing an example of a message display. Fig.14 As shown, the control unit 114 displays a message such as “Please align the pin of the frame with △ and press the reset button on the back” on the display screen of the display unit 13b.

[0149] In step S1304, it is determined whether the reset button is pressed. Specifically, the control unit 114 determines whether the reset button 192 is pressed. In this determination, if it is determined that the reset button 192 is pressed (S1304: "Yes"), the control unit 114 transfers the processing step to be executed to the next step S1305. On the other hand, in this determination, if it is determined that the reset button 192 is not pressed (S1304: "No"), the processing step to be executed returns to step S1304. Through such processing, the state is in a standby state before the reset button 192 is pressed.

[0150] In step S1305, the pulse counter 134 is reset. Specifically, the control unit 114 resets the pulse counter 134 ( Fig.11 ) is reset, and the count of pulses counted by the pulse counter 134 is set to zero. When this setting is completed, the initialization process is completed.

[0151] In step S1306, another initialization process for the accessory without a projection function is performed. Specifically, the control unit 114 performs an initialization process corresponding to the function of the installed accessory 21. After performing this process, the initialization process ends.

[0152] In this way, after performing the initialization process when the accessory with a projection function is mounted on the terminal body 11, the control unit 114 reads the pulse count from the pulse counter 134 in substantially real time. Based on the read count, the control unit 114 detects the rotation angle position of the frame portion 213, i.e., the accessory 21, relative to the terminal body 11 (hereinafter referred to as the accessory rotation position).

[0153] In addition, the reset button 192 may also be used as other buttons, for example, may also be used as the home screen button 191 .

[0154] <Image projection control by control unit>

[0155] Here, the image projection control performed by the control unit 114 on the terminal body 11 side is described. The control unit 114 has a function of performing correction on image projection so as to project an image suitable for viewing according to the wearing state of the portable information terminal 10. The image projection control mainly includes image rotation control, image shape control, and image projection angle control. Each control is described below.

[0156] 〈〈Image rotation control〉〉

[0157] The portable information terminal 10 has an image rotation control function. Image rotation control is one of the projection controls performed to improve the visibility of the projected image when projecting display content, that is, an image, so that even if the rotation position of the accessory changes, the up-down relationship of the image is maintained. The control unit 114 ( Fig.11 ) determine the wearing state of the portable information terminal, and according to the determined wearing state, control the image rotation to be suitable for the wearing state.

[0158] Fig.15A It is a front view of the portable information terminal 10 according to the first embodiment. Fig. 15B 1 is a side view of the portable information terminal 10 of the first embodiment. Fig.16A It is a front view of the portable information terminal 10 according to the second embodiment. Fig. 16B FIG. 1 is a side view of a portable information terminal 10 according to the second embodiment. Fig.15A , Fig. 15B , Fig.16A , Fig. 16B In the illustrated embodiment, the portable information terminal 10 is worn on the outside of the user's left arm, and an image representing the text "ABC" is projected.

[0159] Fig.15A , Fig. 15B In the first embodiment shown, the direction of the projection port 25 of the projection unit 22, that is, the projection port direction PA, is set to the 3 o'clock direction of the clock, and the image T1 is projected on the back of the left hand.

[0160] In contrast, Fig.16A , Fig. 16B In the second embodiment shown, the projection port direction PA is set to the 12 o'clock direction of the clock by rotating the accessory 21, and the image T2 is projected on the table 1500 where the user's left hand is placed. At this time, the control unit 114 detects the rotation angle position and the tilt angle of the accessory 21. Then, the control unit 114 corrects the direction and diffusion mode of the projected light corresponding to the image representing the text "ABC" according to the detected rotation angle position and the tilt angle of the accessory 21. This correction is performed in such a way that the text "ABC" represented by the projected image remains horizontal from the user's perspective. Such correction is mainly performed by controlling the image rotation of the display content, and has the effect of improving the recognizability of the projected image.

[0161] Fig.17A It is a front view of the portable information terminal 10 according to the third embodiment. Fig. 17B It is a side view of the portable information terminal 10 according to the third embodiment. Fig.17A , Fig. 17BIn the third embodiment shown, the portable information terminal 10 is worn on the right arm RH of the user, and an image representing the characters "ABC" is projected on the back of the right hand. Fig.15A In the first embodiment shown, the portable information terminal 10 is worn on the left arm LH, but Fig.17A In the third embodiment shown, the portable information terminal 10 is worn on the right arm RH. Fig.15A In the first embodiment, the attachment 21, i.e., the frame portion 213 itself, is rotated 180°. Thus, in order to make it easy for the user to see, it is necessary to make the image representing the text "ABC" as shown in FIG. Fig.17A The shown ground is shown facing the ground.

[0162] When the portable information terminal 10 is worn on the right arm RH, the control unit 114 corrects the projected image, i.e., the projection light, based on the rotation position of the accessory so that the image is easy for the user to see. This correction is mainly performed by image rotation control of the displayed content, which has the effect of improving the recognizability of the projected image.

[0163] 〈〈Image Shape Control〉〉

[0164] The portable information terminal 10 has a function of image shape control. Image shape control is one of the projection controls performed to improve the visibility of the projected image when projecting display content, that is, an image. The control unit 114 ( Fig.11 ) determine the wearing state of the portable information terminal, and according to the determined wearing state, control the image shape suitable for the wearing state accordingly.

[0165] Fig.18A It is a front view of the portable information terminal 10 according to the fourth embodiment. Fig.18B 1 is a side view of the portable information terminal 10 according to the fourth embodiment. Fig.19 FIG. 1 is a front view of a portable information terminal 10 according to the fifth embodiment. Fig.18A , Fig.18B , Fig.19 In the illustrated embodiment, the portable information terminal 10 is worn on the outside of the left arm, and an image representing a square is projected.

[0166] Fig.18A , Fig.18BIn the fourth embodiment shown, the attachment 21 is rotated, the direction of the central axis of the projection port 25 of the projection unit 22, that is, the projection port direction PA, is set to the 12 o'clock direction of the clock, and the image S1 is projected on the table 1500 on which the user's left arm LH is placed. In addition, in the fourth embodiment, the portable information terminal 10 is naturally lifted up and tilted due to the structure and shape of the human skeleton, joints or arms. In the fourth embodiment, the center line of the portable information terminal 10, that is, the front-to-back direction X, is tilted at an inclination angle θr relative to the horizontal direction H. In addition, in the fourth embodiment, a state in which the image is projected on the table 1500 on which the user's left arm LH is placed, is shown, and image correction is not performed based on the existence of the inclination angle. In such a state in which the image correction is not performed based on the inclination angle of the portable information terminal 10, the square shown in the image S1 is deformed into a trapezoidal shape due to the existence of the inclination angle θr relative to the horizontal direction H.

[0167] In contrast, Fig.19 In the fifth embodiment shown in FIG. 1 , the control unit 114 detects the rotation position of the accessory and the tilt angle of the terminal body 11, and corrects the direction and diffusion mode of the projected light corresponding to the image representing the square according to the detected rotation angle and tilt angle. Fig.19 As shown, the square shown in the projected image S2 is maintained in a square shape from the user's perspective. Such correction is mainly performed by image shape control of the displayed content, and has the effect of improving the visibility of the projected image because the deformation of the image is reduced.

[0168] 〈〈Image projection angle control〉〉

[0169] The portable information terminal 10 has a function of controlling the image projection angle. The image projection angle control is one of the projection controls performed to improve the visibility of the projected image when projecting the display content, that is, the image. The control unit 114 ( Fig.11 ) determine the wearing state of the portable information terminal, and according to the determined wearing state, control the image projection angle suitable for the wearing state accordingly.

[0170] Fig. 20A It is a front view of the portable information terminal 10 according to the sixth embodiment. Fig. 20B 1 is a side view of the portable information terminal 10 of the sixth embodiment. Fig.21 FIG. 1 is a front view of a portable information terminal 10 according to the seventh embodiment. Fig. 20A , Fig. 20B , Fig.21 In the illustrated embodiment, the portable information terminal 10 is worn on the outside of the left arm of the user, and the projection port 25 is directed toward the wall surface 1450 in front to project an image.

[0171] Fig. 20A , Fig. 20B In the sixth embodiment shown, the attachment 21 is rotated so that the projection unit 22 faces the 12 o'clock direction of the clock, and an image is projected onto the wall surface 1450 located in front of the user. When the user takes a posture in which the front-to-back direction of the portable information terminal 10 worn on the arm is consistent with the front-to-back direction of the user, due to the structure and shape of the human skeleton, joints, or arms, the front side of the arm is tilted in many cases in such a way that it is lifted up. In the sixth embodiment, the front-to-back direction X of the portable information terminal 10 is tilted at an inclination angle θr relative to the horizontal direction H, and the optical axis of the projection light 10p becomes an optical axis A1 parallel to the front-to-back direction X. In addition, in the sixth embodiment, when an image is projected onto the wall surface 1450 located in front of the user, a state in which the image deformation correction and the projection angle correction are not performed based on the existence of the inclination angle θr is shown.

[0172] When image deformation and projection angle are not corrected based on the tilt angle of the portable information terminal 10, the projected image is deformed into a trapezoidal shape due to the tilt angle θr relative to the horizontal direction H. In addition, the position of the projected image on the wall surface 1450 is also shifted downward.

[0173] In contrast, Fig.21 In the seventh embodiment shown in FIG. 1 , the control unit 114 detects the tilt angle of the portable information terminal 10, that is, the posture of the terminal body 11. Then, as shown in FIG. Fig.21 As in the seventh embodiment shown in FIG. 1 , the control unit 114 controls the image projection angle so that the image projection angle is upward relative to the projection port direction PA serving as a reference in order to project the image substantially vertically onto the wall surface 1450. Fig.21 As shown, the projection angle is controlled so that the optical axis of the projection light 10p becomes the optical axis A2 which is substantially perpendicular to the wall surface 1450. Such correction of the optical axis of the projection light 10p is mainly performed by controlling the projection angle, and the projection position of the image is changed upward, and the deformation of the image is reduced, so that the recognizability of the projected image is improved.

[0174] Fig.22A It is a front view of the portable information terminal 10 according to the eighth embodiment. Fig. 22B 1 is a side view of the portable information terminal 10 of the eighth embodiment. Fig.23 FIG. 1 is a front view of a portable information terminal 10 according to the ninth embodiment. Fig.22A , Fig. 22B , Fig.23 In the illustrated embodiment, the portable information terminal 10 is worn on the outside of the user's left arm and displays content, ie, images, for projection.

[0175] Fig.22A , Fig. 22B In the eighth embodiment shown, the attachment 21 is rotated, the projection port direction PA is set to the 6 o'clock direction of the clock, and an image is projected on a table 1500 on which the user's left arm LH is placed. When the user takes a posture in which the front-to-back direction of the portable information terminal 10 worn on the arm is consistent with the front-to-back direction of the user, due to the structure and shape of the human skeleton, joints, or arms, the front side of the arm is tilted in most cases in a manner that is lifted. In the eighth embodiment, the front-to-back direction X of the portable information terminal 10 is tilted at an inclination angle θr relative to the horizontal direction H. In addition, in the eighth embodiment, a state is shown in which the projection angle is not corrected based on the existence of the inclination angle θr when an image is projected on the table 1500 on which the user's left arm LH is placed. That is, the optical axis of the projection light 10p is the optical axis A3 parallel to the front-to-back direction X on the display surface of the terminal body 11.

[0176] In such a state where the projection angle is not corrected based on the tilt angle of the portable information terminal 10 , since there is a tilt angle θr relative to the horizontal direction H, the projection light 10p representing the image is projected upwards than the horizontal direction H, and the image is hardly projected onto the table 1500 .

[0177] In contrast, in the ninth embodiment, the control unit 114 detects the tilt angle of the attachment 21, that is, the posture of the terminal body 11. Fig.23 As shown in the ninth embodiment, the control unit 114 controls the projection angle of the image in order to project the image on the table 1500, so that the projection angle of the image is downward relative to the projection port direction PA as a reference. Fig.23 The projection angle is controlled as shown so that the optical axis of the projection light 10p becomes the optical axis A4 intersecting the table 1500 near the left arm LH.

[0178] Such correction of the optical axis of the projection light 10p is mainly performed by controlling the image projection angle. The projection position of the image is changed downward, and the entire image is projected to a position that is easy for the user to see, and the image deformation is reduced, thereby having the effect of improving the recognizability of the projected image.

[0179] In addition, the above-mentioned image rotation control and image shape control can be realized by an optical method for operating an optical system, or by an image processing method for operating image information, i.e., image data. In the case of the present embodiment, the lighter and smaller the projection unit 22 for projecting an image, the more practical it is, so it is more preferable to apply the latter image processing method which does not require a mechanism for operating an optical system.

[0180] In the above embodiments, correction based on the rotation operation of the accessory 21, i.e., the rotation angle position, and correction based on the posture of the terminal body 11, i.e., the tilt angle, are described separately for easier understanding, but these corrections may be performed simultaneously.

[0181] As described above, the control unit 114 has a function of detecting the rotation angle of the frame portion 213 based on a predetermined mechanism or sensor, and a function of detecting the tilt angle of the portable information terminal 10. The control unit 114 can perform various display correction processes when projecting an image or video using the projection unit 22 based on the accessory rotation position and the terminal body posture obtained by such functions.

[0182] <Initial settings of projection control according to installation status>

[0183] The portable information terminal 10 has an initial setting function for projection control. The initial setting for projection control is to perform appropriate projection control settings in advance according to the wearing state of the portable information terminal 10 in order to project the display content, that is, the image with good visibility.

[0184] For example, imagine a situation where the portable information terminal 10 is worn on the outside of the user's right arm, and the accessory rotation position is set so that the projection port 25 of the projection unit 22 faces the 9 o'clock direction of the clock. In this case, the display content, that is, the image, is projected onto the back of the user's right hand. Therefore, in this situation, a projection control suitable for projecting an image on the back of the right hand is set in advance. For example, in order to make the up, down, left, and right directions of the image correct, the rotation control is set in such a way that the image is rotated 90° clockwise. In addition, in order to correct the trapezoidal deformation of the image, the shape control is set in such a way that the width of the side farther from the projection port 25 of the image becomes narrower. Furthermore, because the surface of the back of the hand is relatively narrow, in order to prevent the image from being excessively diffused, the projection angle control is set in such a way that the projection angle is slightly downward compared to the display surface direction of the terminal body 11.

[0185] In addition, for example, imagine a situation where the portable information terminal 10 is worn on the outside of the user's left arm, and the projection port 25 of the projection unit 22 is set to face the 12 o'clock direction of the clock. In this case, the display content, i.e., the image, is projected onto the wall surface in front of the user. Therefore, in the case of this situation, a projection control suitable for projecting an image onto the wall surface in front is set in advance. For example, in order to make the up, down, left, and right directions of the image correct, the rotation control is set in a way that the image does not rotate. In addition, based on the structure of the human body, the outside of the arm will naturally be tilted toward the wall in front, so there is a high possibility that the image is projected diagonally downward relative to the wall. Therefore, in order to project the image vertically onto the wall, the projection angle control is set in a way that the projection direction is slightly upward compared to the display surface direction of the terminal body 11.

[0186] Furthermore, in the initial setting of projection control, in order to improve image recognizability, image shape control may be set instead of projection angle control, or vice versa, or both projection angle control and image shape control may be set simultaneously.

[0187] In addition, the initial settings of projection control, i.e., image rotation control, image shape control, and projection angle control, can be determined based on the posture of the terminal body 11, i.e., the tilt direction and degree thereof, in addition to being determined based on the left-right, inside-outside, and direction of the projection port 25 of the arm wearing the portable information terminal 10.

[0188] As described above, in order to achieve user convenience, the control unit 114 determines the wearing state of the portable information terminal 10 when projecting the display content, i.e., the image, and performs initial settings of the projection control in accordance with the determined wearing state. The wearing state of the portable information terminal 10 includes the wearing position of the portable information terminal, the rotation position of the accessory, the terminal body posture, etc.

[0189] In this embodiment, four options are prepared as the wearing position: the outside of the left arm, the outside of the right arm, the inside of the left arm, and the inside of the right arm. In addition, as the accessory rotation position, 12 options are prepared according to the position of the pin 23 of the frame portion 213, that is, the position every hour from 12 o'clock to 11 o'clock on the clock. In addition, as the terminal body posture, 9 options are prepared: horizontal, front upper tilt (small), rear upper tilt (small), upper left tilt (small), upper right tilt (small), front upper tilt (large), rear upper tilt (large), upper left tilt (large), and upper right tilt (large).

[0190] The storage device 125 stores a plurality of different setting information. The plurality of different setting information is formed by associating the wearing state of the portable information terminal 10 with setting information indicating the initial setting of the projection control suitable for the wearing state. The control unit 114 reads the setting information corresponding to the determined wearing state from the storage device 125, and performs the initial setting of the projection control based on the read setting information.

[0191] Fig.24 FIG. 1 is a diagram showing an example of a setting information table. Fig.24 As shown in FIG. 1 , the setting information table collectively prepares setting information of projection control set for each wearing position of the portable information terminal, for example. Fig.24In the example shown, there are shown a setting information table T01 applied when the portable information terminal 10 is worn on the outside of the left arm, a setting information table T02 applied when the wearing position is the outside of the right arm, a setting information table T03 applied when the wearing position is the inside of the left arm, and a setting information table T04 applied when the wearing position is the inside of the right arm.

[0192] In this embodiment, the setting information tables T01 to T04 are stored in the storage device 125. In addition, the setting information table may be one table. In addition, the setting information table may be stored in the memory 132 on the terminal body 11 side, or in the memory 206 on the accessory 21 side.

[0193] Fig.25 It is a diagram showing an example of detailed contents of the setting information table T01. Fig.25 In order to make the table easier to understand, it is shown as a representative example in the setting information tables T01 to T04. Fig.25 As shown, in the setting information table T01, as a combination of items, the items of "accessory rotation position" and "terminal body posture" are set on the premise that the wearing position is "outside" of "left arm", and the "setting information" corresponding to the combination of these items is associated. In addition, here, each setting information is represented by a mark of J (j1, j2, j3, j4). j1 is a value corresponding to whether the wearing position is the left arm or the right arm, j2 is a value corresponding to whether the wearing position is the outside or the inside of the arm, j3 is a value corresponding to the accessory rotation position, and j4 is a value corresponding to the terminal body posture.

[0194] In this embodiment, the "accessory rotation position" is the rotation position of the accessory 21, and is information indicating the rotation position of the projection unit 22, for example, information indicating at what hour the position of the pin 23 as its reference position is in the normal clock direction. Specifically, the "accessory rotation position" indicates any one of the 12 o'clock direction, the 1 o'clock direction, the 2 o'clock direction, ..., and the 11 o'clock direction.

[0195] Fig.26 1 is a diagram showing an example of a table AP1 showing a correspondence between an accessory rotation position and an accessory rotation angle α. The frame rotation angle α is initialized when the frame is installed and is set to 0° when the projection unit is located at the 3 o'clock position. Fig.26 As shown, for example, when 345°≤α<15°, the accessory rotation position is at 3 o'clock. Also, for example, when 255°≤α<285°, the accessory rotation position is at 12 o'clock.

[0196] In addition, in the present embodiment, the "terminal body posture" is information indicating in which direction and to what extent the display surface of the terminal body 11 is tilted. Specifically, the "terminal body posture" indicates one of horizontal, front upper tilt (small), rear upper tilt (small), upper right tilt (small), upper left tilt (small), front upper tilt (large), rear upper tilt (large), upper right tilt (large), and upper left tilt (large). In addition, for example, the front upper tilt (small) means that the front of the terminal body 11 is tilted upward at a small angle. In addition, the upper right tilt (large) means that the right side of the terminal body 11 is tilted upward at a large angle.

[0197] Fig. 27 It is a figure showing an example of a correspondence between the posture of the terminal body, the tilt direction of the terminal body, and the angle β of the upward tilt. The tilt angle β is 0° when the display surface of the terminal body 11 is horizontal. As shown in the figure, for example, when the tilt direction is front, back, left, right, and upward, and the angle β is less than 15°, the posture of the terminal body is horizontal. In addition, for example, when the tilt direction is forward, 30°>β≥15°, the posture of the terminal body is tilted in the front and upward (small). In addition, for example, when the tilt direction is right, β≥30°, it is tilted in the upper right (large).

[0198] Fig.28 This is a diagram showing an example of the contents of the setting information associated with the setting information table T01. Fig.28 Table T11 is shown which shows an example of the contents of the setting information. Fig.28 In the example shown, for example, setting information J (1, 1, 12, 1) is setting information when the portable information terminal 10 is worn on the outside of the left arm, the accessory is rotated at the 12 o'clock position, and the terminal body is horizontal. The setting information includes the settings of the rotation control, shape control, and projection angle control of the display content.

[0199] Fig.28 In the example shown, for example, the setting contents of setting information J(1, 1, 12, 1) are: for the rotation control of the display content, the rotation is set to 0°, for the shape control of the display content, the shape correction is set to linear, that is, no shape correction, and for the projection angle control, the projection angle is set to 0°. In addition, for example, the setting contents of setting information J(1, 1, 6, 3) are: for the rotation control of the display content, the rotation is set to 180° clockwise (CW; ClockWise), for the shape control of the display content, the correction is performed to narrow the image's distant width, and for the projection angle control, the projection angle is set to 30° downward.

[0200] The control unit 114 refers to the setting information table, reads the setting information corresponding to the detected wearing state, and performs the initial setting of the projection control based on the setting information. In addition, in this embodiment, the wearing state and the setting information are simplified and explained for ease of understanding, but in fact, it is conceivable to make the wearing state and the setting information defined by more complex and detailed items. According to such a structure for performing the initial setting of the projection control, since the projection control suitable for the wearing state of the portable information terminal is performed in advance, there is no need to adjust the projection control afterwards, or the user only needs to fine-tune the projection control afterwards, so that the recognizability of the displayed content can be improved.

[0201] In addition, the initial setting of the projection control may be performed based on information input by the user. For example, the user may input the wearing state of the portable information terminal 10, and the control unit 114 may perform the initial setting of the projection control suitable for the input wearing state. Alternatively, the user may directly perform the initial setting or current setting, fine-tuning, etc. of the projection control.

[0202] Several examples of a method for automatically determining the wearing state of a portable information terminal will be described below with reference to the drawings.

[0203] 〈Determine which arm is wearing the device〉

[0204] Fig.29 This is a flowchart showing an example of processing for automatically determining whether the arm on which the portable information terminal 10 is worn is the left or right arm. Fig.29 The flowchart shown shows an example of a process flow performed by the control unit 114 for determining on which arm the portable information terminal 10 is worn. The algorithm of this determination process is based on the premise that the user often hangs his arms downward (in the direction of gravity) when walking.

[0205] In step S2901 , it is determined whether the user is walking. Specifically, the control unit 114 determines whether the user wearing the portable information terminal 10 is walking based on the output history of at least one of the acceleration sensor 133 and the gyro sensor 136 for a certain period of time.

[0206] When the user is walking, it is considered that the output of the acceleration sensor 133 or the gyro sensor 136 repeatedly changes with a change amount greater than a certain level. Therefore, it is possible to determine whether the user is walking based on whether such a feature is recognized.

[0207] In the above determination, if it is determined that the user is walking (S2901: Yes), the control unit 114 advances the step to be executed to S2902. On the other hand, if it is determined that the user is not walking (S2901: No), the control unit 114 advances the step to be executed to S2906.

[0208] In step S2902, it is determined whether the gravity direction of the portable information terminal 10 is in the 3 o'clock direction. Specifically, the control unit 114 determines whether the gravity direction of the portable information terminal 10 is near the 3 o'clock direction of the watch based on the output of the acceleration sensor 133. In this determination, if it is determined that the gravity direction is near the 3 o'clock direction (S2902: "Yes"), the control unit 114 advances the step to be executed to S2904. On the other hand, if it is determined that the gravity direction is not near the 3 o'clock direction (S2902: "No"), the control unit 114 transfers the step to be executed to S2903.

[0209] In step S2903, it is determined whether the gravity direction of the portable information terminal 10 is in the 9 o'clock direction. Specifically, the control unit 114 determines whether the gravity direction of the portable information terminal 10 is near the 9 o'clock direction of the watch based on the output of the acceleration sensor 133. In this determination, if it is determined that the gravity direction is near the 9 o'clock direction (S2903: "Yes"), the control unit 114 advances the step to be executed to S2905. On the other hand, if it is determined that the gravity direction is not near the 3 o'clock direction (S2903: "No"), the control unit 114 transfers the step to be executed to S2906.

[0210] In step S2904, as a process executed when it is determined that the user is walking and the gravity direction output by the acceleration sensor is at the 3 o'clock direction, a process of incrementing the variable LW corresponding to the determination result is performed. Specifically, the control unit 114 adds 1 to the value of the variable LW as the new value of the variable LW. After executing step S2904, the control unit 114 transfers the step to be executed to S2906.

[0211] In S2905, as a process executed when it is determined that the user is walking and the gravity direction output by the acceleration sensor is at 9 o'clock, a process of incrementing the variable RW corresponding to the determination result is performed. Specifically, the control unit 114 adds 1 to the value of the variable RW as the new value of the variable RW. After executing step S2905, the control unit 114 transfers the step to be executed to S2906.

[0212] The variables LW and RW are variables used by the program of the control unit 114 and are initialized to zero when the portable information terminal 10 is powered on or when a system reset process (not shown) is performed by the user.

[0213] In step S2906, it is determined whether the values ​​of the variable LW and the variable RW are significantly different. Specifically, the control unit 114 determines whether a situation exists in which one of the values ​​of the variable LW and the variable RW exceeds the threshold value TH1, and the difference between the proportion of the value of the variable LW and the proportion of the value of the variable RW in the total count exceeds the threshold value TH2. If it is determined that such a situation exists, the control unit 114 advances the step to be executed to S2907. On the other hand, if it is determined that such a situation does not exist, the control unit 114 returns the step to be executed to S2901.

[0214] In step S2907, the value of the variable LW is compared with the value of the variable RW. Specifically, the control unit 114 determines which of the following relationships holds true: (1) the value of the variable LW > the value of the variable RW, or (2) the value of the variable LW < the value of the variable RW. Here, if it is determined that the relationship (1) holds true, the control unit 114 determines that the user is wearing the portable information terminal 10 on the left arm (S2908), and ends the determination process. On the other hand, if it is determined that the relationship (2) holds true, the control unit 114 determines that the user is wearing the portable information terminal 10 on the right arm (S2909), and ends the determination process.

[0215] 〈Determine whether to wear it on the inside or outside of the arm〉

[0216] In addition, it is considered that whether the wearing position of the portable information terminal 10 is the outside or the inside of the arm can be determined based on the output of the body information measurement sensor 16.

[0217] Generally speaking, the body information measurement sensor 16 irradiates a green light source to an object and outputs a signal corresponding to the amount of reflected light from the object. The thickness or number of blood vessels passing near the surface of the arm, that is, the blood flow, is different on the outside of the arm (the back of the hand) and the inside of the arm (the opposite side of the back of the hand). In addition, the amount of reflected light of green light varies depending on the blood flow. That is, the body information measurement sensor 16 outputs different signals when irradiating the outside of the arm with green light and when irradiating the inside of the arm. By using such a feature, it is possible to determine whether the wearing position of the portable information terminal 10 is on the outside or inside of the arm based on the output of the body information measurement sensor 16.

[0218] Fig.30 This is a flowchart showing an example of processing for determining whether the portable information terminal 10 is worn on the inside or outside of the arm.

[0219] like Fig.30 As shown, in step S3001, the arm is illuminated. Specifically, the control unit 114 controls the body information measurement sensor 16, and the body information measurement sensor 16 emits green light to the user's arm.

[0220] In step S3002, the light reflectance of the arm is measured. Specifically, the control unit 114 receives the signal output from the biological information measurement sensor 16, detects the amount of light reflected from the arm by the green light emitted to the arm, and measures the light reflectance of the arm based on the light amount.

[0221] In step S3003, it is determined whether the measured light reflectivity exceeds a threshold value. Specifically, the control unit 114 determines whether the measured light reflectivity of the arm exceeds a predetermined threshold value th. In this determination, if it is determined that the light reflectivity exceeds the threshold value th (S2003: "Yes"), the control unit 114 advances the processing steps to step 3004. On the other hand, if it is determined that the light reflectivity does not exceed the threshold value th (S3003: "No"), the control unit 114 advances the processing steps to step S3005.

[0222] In step S3004, the control unit 114 determines that the portable information terminal 10 is worn on the outside of the user's arm. On the other hand, in step S3005, the control unit 114 determines that the portable information terminal 10 is worn on the inside of the user's arm.

[0223] As described above, if the left and right sides of the arm on which the portable information terminal 10 is worn, and the inside and outside of the arm can be automatically determined, that is, if it can be determined whether the wearing position is the outside of the left arm, the inside of the left arm, the outside of the right arm, or the inside of the right arm, there is no need for the user to perform setting operations for the wearing location, and convenience is improved.

[0224] <Processing flow in portable information terminal>

[0225] Hereinafter, the flow of processing related to projection of display contents in the portable information terminal 10 will be described.

[0226] Fig.31 This is a flowchart showing an example of processing related to projection of display content in the portable information terminal 10 .

[0227] like Fig.31 As shown, in step S3101, the wearing state of the portable information terminal 10 is determined. Specifically, the control unit 114 determines the terminal wearing position, the accessory rotation position and the terminal body posture as items of the wearing state of the portable information terminal 10. Each item of the wearing state is determined, for example, using the above method.

[0228] In step S3102, the setting information of the projection control is read. Specifically, the control unit 114 refers to the setting information table stored in the storage device 125, and reads the setting information of the projection control associated with the combination of items of the determined wearing state from the storage device 125. That is, the control unit 114 reads the setting information of the projection control suitable for the wearing state according to the determined wearing state.

[0229] In step S3103, the initial setting of the projection control is performed. Specifically, the control unit 114 performs the initial setting of the image rotation control, the image shape control, and the image projection angle control based on the read setting information.

[0230] In step S3104, it is determined whether the rotational position of the accessory has changed. Specifically, the control unit 114 determines whether the rotational position of the accessory detected substantially in real time has changed. In this determination, if it is determined that a change has occurred (S3104: "No"), the control unit 114 returns the processing steps to step S3101. On the other hand, in this determination, if it is determined that there is no change (S3104: "Yes"), the control unit 114 advances the processing steps to step S3105.

[0231] In step S3105, the image is projected. Specifically, the control unit 114 performs the set image rotation control and image shape control on the display content, that is, the image, thereby correcting the image. Then, the control unit 114 sends the image information representing the corrected image, that is, the image data, and the setting information of the projection angle control to the projection unit 22. The control unit 204 on the projection unit 22 side controls the projection angle based on the received setting information of the projection angle control. In addition, the control unit 204 projects the image represented by the received image data by controlling each unit involved in the image projection.

[0232] In step S3106, processing is performed to determine whether the adjustment of the projection control, the rotation control of the display content, the shape control, and the projection angle control has occurred through the user's operation. Specifically, the control unit 114 performs processing to detect the user's operation, and when the user's operation is detected, it determines whether the adjustment of the projection control, the rotation control of the display content, the shape control, and the projection angle control has occurred based on the information input by the user. In this judgment, if it is determined that the adjustment has occurred (S1506: "Yes"), the processing step is advanced to step S1507. On the other hand, if it is determined that the adjustment has not occurred (S1506: "No"), the processing step is advanced to step S1508.

[0233] In step S1507 , the projection control adjustment process is performed. Specifically, the control unit 114 adjusts the projection control based on the projection control adjustment information input by the user's operation.

[0234] In step S1508, a judgment is made as to whether the projection is to be ended. Specifically, the control unit 114 confirms whether a cause for ending the projection has occurred. As a cause for ending the projection, for example, an error occurred during processing, an instruction to end the projection was input through a user operation, etc. If a cause for ending the projection has occurred, it is judged that the projection is ended, and if a cause for ending the projection has not occurred, it is judged that the projection is not ended. In this judgment, if it is judged that the projection is to be ended (S3108: "Yes"), the projection is ended. On the other hand, if it is judged that the projection is not to be ended (S3108: "No"), the control unit 114 returns the processing steps to step S1504.

[0235] As described above, according to the portable information terminal of such embodiment 1, since it has the function of image rotation control, when projecting the display content, i.e., the image, the projected image can be rotated to a rotation angle suitable for the wearing state of the portable information terminal. For example, even if the direction of image projection changes, the horizontality of the image can be maintained. As a result, the recognizability of the displayed content can be improved. In particular, when sharing the displayed content with people other than the user, the displayed content can be projected so that it is also well recognizable to people other than the user.

[0236] In addition, according to the portable information terminal of the first embodiment, since it has the function of image shape control, when the display content, i.e., the image, is projected, the image can be deformed into a shape suitable for the wearing state of the portable information terminal. For example, when the surface of the object to which the image is projected is tilted relative to the projection direction, the image will be deformed into a trapezoidal shape, but such trapezoidal deformation can be corrected. As a result, the recognizability of the display content can be improved. In particular, when the display content is shared with people other than the user, the display content that is also highly recognizable to people other than the user can be projected.

[0237] In addition, according to the portable information terminal of embodiment 1, since it has the function of controlling the projection angle, when projecting the display content, i.e., the image, the projection angle can be corrected to an angle suitable for the wearing state of the portable information terminal. For example, when the surface of the object of the projected image is tilted relative to the projection direction, the image will produce trapezoidal deformation, but such trapezoidal deformation can be corrected. As a result, the recognizability of the displayed content can be improved. In particular, when the displayed content is shared with people other than the user, the recognizability of the displayed content for people other than the user is also improved.

[0238] In addition, according to the portable information terminal of the first embodiment, since the initial setting of the projection control suitable for the projection mode of the display content assumed according to the wearing state is performed based on the determined wearing state of the portable information terminal, the recognizability of the projected display content can be further improved. In particular, when the display content is shared with people other than the user, the recognizability of the display content for people other than the user is also improved.

[0239] In addition, according to the portable information terminal of embodiment 1, the wearing state of the portable information terminal, namely the wearing position, accessory rotation position and terminal body posture can be automatically detected using sensors, and the initial setting of projection control can be automatically performed, which is convenient for users.

[0240] In addition, according to the portable information terminal of embodiment 1, the accessories can be detached, and as accessories, in addition to the accessories having the projection function, accessories having functions other than the projection function, such as the camera function, can be installed on the terminal body. According to the portable information terminal of such a structure, the user can use the appropriate accessories according to the purpose, which is convenient for the user.

[0241] In addition, according to the portable information terminal of embodiment 1, an accessory having a projection function can be rotatably mounted on the terminal body. As a result, when sharing the projected display content with people other than the user, the display content can be projected in a direction preferred by the user, which is convenient for the user and makes the display content more recognizable for people other than the user.

[0242] (First Modification of Embodiment 1)

[0243] A first variant of the first embodiment is described. In the portable information terminal of the first variant, as an optional accessory that can be mounted on the terminal body, there is an accessory that is provided with a projection unit, and the projection port direction of the projection unit is a direction different from the diameter direction of the circumference of the frame portion. The projection port direction is, for example, a tangent direction of the circumference of the frame portion.

[0244] Fig.32A 1 is a front view of a portable information terminal 10a according to a first variation of the first embodiment. Fig.32B is a side view of the portable information terminal 10a. Fig.32A and Fig.32B As shown, in the portable information terminal 10a, the projection port of the projection unit 22a of the attachment 21A, i.e., the opening as the exit of the projection light 10p, is formed at one end of the projection unit 22a in the length direction. That is, in the portable information terminal 10a of this embodiment, the projection port direction PA of the projection unit 22a is the tangent direction of the circumference of the frame portion 213.

[0245] Fig.33 It is a diagram showing an embodiment of the portable information terminal 10a. Fig.33 In the embodiment shown, the portable information terminal 10a is worn on the outside of the user's left arm LH, and the projection unit 22 projects a projection light 10p corresponding to the display content, that is, the image T4 representing the text "ABC" onto the back of the user's hand. In addition, in this embodiment, in order to project the image onto the back of the user's left arm LH, the frame unit 213 rotates by a rotation angle θd1. In addition, in this embodiment, the control unit 114 does not perform rotation control of the projected image. That is, an image without rotation correction is projected onto the back of the hand. In this case, the text "ABC" appears tilted to the user.

[0246] Fig.34 Yes means Fig.33 FIG. 1 is a diagram showing a modified example of the embodiment of the portable information terminal 10a. Fig.34 In the modified example shown, the control unit 114 detects the rotation angle θd1 of the attachment 21A, and corrects the shape of the image based on the rotation angle θd1 so that the characters "ABC" are displayed along the length direction of the arm. Therefore, according to this configuration, for the user, the characters "ABC" appear to be displayed along the horizontal direction, that is, the length direction of the arm, and the recognizability of the projected image is improved.

[0247] Fig.35 FIG. 1 is a diagram showing an example of a setting information table. Fig.35 As shown in FIG. 1 , the setting information table collectively prepares setting information of projection control set for each wearing position of the information terminal, for example. Fig.35 In the example shown, the setting information table T11 applied when the portable information terminal 10a is worn on the outside of the left arm, the setting information table T12 applied when the wearing position is on the outside of the right arm, the setting information table T13 applied when the wearing position is on the inside of the left arm, and the setting information table T14 applied when the wearing position is on the inside of the right arm are shown. In this embodiment, the setting information tables T11 to T14 are stored in the storage device 125.

[0248] Fig.36 It is a diagram showing an example of detailed contents of the setting information table T11. Fig.36 In order to make the table easier to understand, it is shown as a representative example in the setting information tables T11 to T14. Fig.36 As shown, in the setting information table T11, as a combined item, based on the premise that the wearing position is the "outside" of the "left arm", in addition to the "accessory rotation position" and "terminal body posture", an item of "projection port direction" is also set, and the "setting information" corresponding to the combination of these items is associated.

[0249] In this embodiment, the "projection port direction" is information indicating the direction of the optical axis or main axis of the projection light 10p emitted from the projection port 25. As options for the "projection port direction", for example, the "diameter direction" and "tangent direction" of the circumference of the frame portion 213 are prepared.

[0250] (Second Modification of Embodiment 1)

[0251] A second variation of the first embodiment is described. In the portable information terminal of the second variation, as an optional accessory that can be mounted on the terminal body, there is an accessory whose projection unit can rotate (swing) relative to the frame unit. That is, the portable information terminal of the second variation is configured so that the projection direction of the image can be changed by changing the rotation position of the projection unit.

[0252] Fig.37A 1 is a front view of a portable information terminal 10b according to a second variation of the first embodiment. Fig.37B This is a side view of a portable information terminal 10b according to a second modified example of the first embodiment.

[0253] like Fig.37A , Fig.37B As shown, the portable information terminal 10b has an accessory 21B, in which the projection unit 22a can rotate relative to the frame unit 213. The accessory 21B has a rotation mechanism 229, which can rotate the projection unit 22a relative to the frame unit 213 with the direction parallel to the display surface direction of the terminal body 11 as the axis. The projection port direction PA of the projection unit 22a is the tangent direction of the circumference of the frame unit 213, similar to the first modified example.

[0254] In this embodiment, as the wearing state of the portable information terminal, in addition to the above-mentioned items, an item of "projection unit rotation angle" is also included. "Projection unit rotation angle" is information indicating the rotation angle of the projection unit 22a relative to the frame portion 213, that is, information indicating the rotation state of the projection unit 22a. In the control unit 114, as the wearing state of the portable information terminal, the initial setting of the appropriate projection control is performed accordingly according to the combination of multiple items including the "projection unit rotation angle". That is, the setting information table is a table in which, as one of the items associated with the setting information, the rotation state of the projection unit 22a, that is, the "projection unit rotation angle" is included.

[0255] (Implementation method 2)

[0256] The portable information terminal of Embodiment 2 is described. The portable information terminal of Embodiment 1 has a rotating frame type accessory, but the portable information terminal of Embodiment 2 has a terminal connection type accessory. That is, the projection direction of the image can be changed according to the connection position of the accessory relative to the terminal body.

[0257] Fig.38 2 is a diagram showing a configuration example of a portable information terminal 10c according to Embodiment 2. Fig.38 As shown, in this embodiment, the portable information terminal 10c has a terminal body 11c that is approximately square in shape. The terminal body 11c has a plurality of different connection terminals, which are respectively arranged in the four directions of the upper, lower, left, and right of the terminal body 11c. The accessory 21C integrated with the projection unit is configured to be detachable by plugging and unplugging at each connection terminal arranged in the four directions of the upper, lower, left, and right of the terminal body 11c.

[0258] Fig.38 In the example shown, the projection direction of the image or video from the accessory 21C is the same as that shown in Fig. 1. That is, when the accessory 21C is attached to the terminal body 11c, the image or video is projected to the side opposite to the terminal body 11c.

[0259] In the case of this structure, the projection port direction is determined by the installation position of the accessory 21C on the terminal body 11c. Therefore, the pattern detection sensors 12c and 12d for detecting the rotation angle of the accessory 21C and the detection pattern as a rotary encoder on the frame portion 213 side, which are required for correcting the projected image, are no longer necessary, and the structure of the portable information terminal can be simplified.

[0260] (First Modification of Embodiment 2)

[0261] A first variant of the second embodiment is described. In the portable information terminal of the first variant, as an optional accessory that can be mounted on the terminal body, there is an accessory in which the projection port direction is a direction different from the radiation direction from the center of the terminal body. The projection port direction is, for example, a direction orthogonal to the radiation direction from the center of the terminal body.

[0262] Fig.39 FIG. 1 is a diagram showing a portable information terminal 10d according to a first variation of the second embodiment. Fig.39 As shown, in this embodiment, the portable information terminal 10d has an attachment 21D integrated with the projection unit. The projection port direction PA of the projection unit in the attachment 21D is a direction orthogonal to the radiation direction from the center of the terminal body 11, specifically, the long side direction of the attachment 21D. That is, the projection port of the projection unit of the attachment 21D is formed at one end of the long side direction of the attachment 21D.

[0263] In the case of this structure, with Fig.38In the example shown, the projection port direction PA is determined by the installation position of the accessory 21D on the terminal body 11c. Therefore, the pattern detection sensors 12c and 12d for detecting the rotation position of the accessory and the detection pattern as a rotary encoder on the side of the accessory 21D required for image correction are no longer necessary, and the structure of the portable information terminal can be simplified.

[0264] In Embodiments 1 to 3, the optical projection angle of the projection unit is assumed to be constant. However, the accessory or the projection unit may be configured such that the entire or a part of the optical system of the projection unit is structurally variable, and the angle is controlled by the control unit.

[0265] In addition, the second modified example of the embodiment describes an example in which the projection unit can rotate and the projection angle can be adjusted by adjusting the rotation angle. Such a structure in which the projection unit itself can rotate can also be applied to other embodiments or other modified examples.

[0266] In addition, the terminal body of the portable information terminal of embodiments 1 to 3 is equipped with a gyro sensor. Therefore, when the user wears the portable information terminal on the arm and projects an image on the wall in front of the user in this state, the vibration and hand shake of the user's arm can be detected and hand shake correction can be performed through image processing.

[0267] In addition, in Embodiments 1 to 3, examples of using slip rings and terminals to realize the electrical connection of power and signals between the terminal body of a portable information terminal and an accessory are shown. However, instead of such a structure, a short-range wireless connection can be used to realize the electrical connection, i.e., transmission and reception of signals. Wireless power supply can be used to realize the electrical connection of power, and a short-range wireless connection can be used to realize the electrical connection of signals. According to such a structure, the sliding part of the electrical connection part can be reduced, the mechanical loss can be reduced, and the waterproof structure can be easily realized. Furthermore, the manufacturing cost can be reduced.

[0268] In addition, in Embodiments 1 to 3, an example is shown in which a mobile communication interface is mounted in the main body of a portable information terminal. However, the mobile communication interface may be mounted on a detachable accessory instead of on the main body. In addition, accessories with different functions may be prepared, such as accessories with communication functions such as LTE, accessories with functions such as camera functions, etc. In this way, the user can obtain accessories with necessary functions as needed in the future and freely expand the functions of the portable information terminal. That is, the product structure of the portable information terminal can be functionally expanded.

[0269] In addition, in embodiments 1 to 3, projection control, i.e., image rotation control, image shape control, and projection angle control, is performed by a control unit on the terminal body side. However, a part or all of the above-mentioned projection control may also be performed by a control unit on the accessory side. For example, the control unit on the terminal body side may use a sensor or the like to obtain information required for the above-mentioned projection control, send the information to the accessory, and the control unit on the accessory side may perform the above-mentioned projection control based on the received information. In addition, for example, the control unit on the terminal body side may send information about the image to be projected to the accessory, and the control unit on the accessory side may use a sensor or the like mounted on itself to obtain information required for the above-mentioned projection control and perform the above-mentioned projection control.

[0270] The above-described embodiments and modified examples, i.e., embodiments, are described in detail to explain the present invention in an easy-to-understand manner, and are not limited to all structures that must be described. In addition, a part of the structure of a certain embodiment can be replaced with the structure of another embodiment, and the structure of another embodiment can be added to the structure of a certain embodiment. In addition, for a part of the structure of each embodiment, other structures can be added, deleted, or replaced.

[0271] In addition, the structures of the above-mentioned embodiments may be partially or entirely constructed by hardware, or may be realized by executing a program with a processor. In addition, control lines and information lines are shown as necessary for explanation, and not all control lines and information lines on the product are necessarily shown. In fact, it can be considered that almost all structures are connected to each other.

[0272] Description of Reference Numerals

[0273] 10...portable information terminal, 10p...projection light, 11...terminal body, 12...housing, 12a...display surface side convex portion, 12b...sensor side convex portion, 12c, 12d...pattern detection sensors, 12e...housing side frame back contact surface, 13...touch screen portion, 14...marking portion, 15...control circuit board, 16...body information measurement sensor, 17...watch strap, 18a~18d...slip ring, 21...accessory, 22...projection portion, 22i...internal space, 23...pin, 24...fixing member, 25...projection port, 26a~26d...terminals, 27...control circuit board, 114...control portion, 191...home screen button, 192...reset button, 204...control portion, 211...first semicircular member, 212...second semicircular member, 213...frame portion, 213a...first light reflecting surface, 213b...second light reflecting surface.

Claims

1. A portable information terminal that can be worn on an arm, characterized in that: include: Terminal body; and an accessory, which is mounted on the terminal body and is communicably connected to the terminal body, The accessory has a projection unit for projecting an image based on image information obtained from the terminal body, and is configured such that a projection port direction of the projection unit is variable relative to the terminal body. The terminal body or the accessory determines the state of the portable information terminal, wherein the state includes the position of the accessory relative to the terminal body, The terminal body or the accessory performs projection control of the image based on the determined state.

2. The portable information terminal according to claim 1, wherein: The terminal body or the accessory stores a plurality of different setting information of the projection control, The terminal body or the accessory reads the setting information corresponding to the determined state and performs the setting of the projection control.

3. The portable information terminal according to claim 2, characterized in that: The projection control includes control of rotation of the image.

4. The portable information terminal according to claim 2, characterized in that: The projection control includes control of the shape of the image.

5. The portable information terminal according to claim 2, characterized in that: The projection control includes controlling a projection angle of the image.

6. The portable information terminal according to claim 2, characterized in that: The terminal body has a circular peripheral edge portion, The attachment is mounted on the peripheral portion and is configured to be rotatable relative to the terminal body. The terminal body or the accessory determines a rotational position of the accessory.

7. The portable information terminal according to claim 2, characterized in that: The terminal body has a plurality of different connection terminals that can be connected to the accessory. The accessory is connected to any one of the plurality of connection terminals, The terminal body or the accessory determines the position of the accessory by determining which of the connection terminals the accessory is connected to.

8. The portable information terminal according to claim 2, characterized in that: The state of the portable information terminal includes at least one of a wearing position of the portable information terminal on a user and a posture of the terminal body.

9. The portable information terminal according to claim 2, characterized in that: The state of the portable information terminal includes the wearing position of the portable information terminal. The terminal body has a sensor that outputs a signal corresponding to acceleration generated in the terminal body, The terminal body or the accessory determines whether the arm on which the terminal body is worn is left or right based on the history of the output of the sensor, and uses the determination as information included in the wearing position.

10. The portable information terminal according to claim 6, characterized in that: The accessory is configured to be attachable to and detachable from the terminal body.

11. The portable information terminal according to claim 1, characterized in that: The projection unit is configured to be rotatable relative to the attachment. The state of the portable information terminal includes a rotation state of the projection unit.

12. The portable information terminal according to claim 3, characterized in that: The terminal body or the accessory controls the rotation of the image in a manner that the vertical relationship of the image is maintained according to the determined state.

13. The portable information terminal according to claim 4, characterized in that: The terminal body or the accessory controls the shape of the image in a manner that reduces deformation of the image according to the determined state.

14. The portable information terminal according to claim 5, characterized in that: The terminal body or the accessory controls the projection angle of the image in the following manner: When the position of the accessory is such that the projection port is located at 12 o'clock on the clock, the image is projected upward compared to the reference. When the position of the accessory is such that the projection port is located at 6 o'clock on the clock, the image is projected downward compared to the reference.

15. A terminal body, used to constitute a portable information terminal that can be worn on an arm, characterized in that: include: A mechanism for installing an accessory, wherein the accessory has a projection portion for projecting an image, and is configured such that a projection port of the projection portion is variable in direction relative to the terminal body; a communication unit that exchanges information with the accessory; a generating unit configured to generate image information to be transmitted to the attached file via the communication unit; and an acquisition unit, which acquires information indicating the direction of the projection port from the attachment, The image information is edited based on the information acquired by the acquisition unit.

16. The terminal body according to claim 15, characterized in that: Setting information for controlling projection of a plurality of different images is stored, the setting information corresponding to the projection port direction indicated by the acquired information is read, and the image information is edited.

17. The terminal body according to claim 15, characterized in that: The editing of the image information includes at least one of image rotation control and image shape control.

18. An accessory for constituting a portable information terminal that can be worn on an arm, characterized in that: can be mounted on the main body of the portable information terminal and connected to the main body in a communicable manner, A projection unit is provided for projecting an image based on image information obtained from the main body, and the projection port of the projection unit is configured to be variable in direction relative to the main body. The main body or the accessory determines the state of the portable information terminal, wherein the state includes the position of the accessory relative to the main body, The main body or the accessory performs projection control of the image based on the determined state.

19. The accessory according to claim 18, characterized in that: The main body or the accessory stores a plurality of different setting information of the projection control, The main body or the accessory reads the setting information corresponding to the determined state, and performs the setting of the projection control.

20. The accessory according to claim 18, characterized in that: The projection control includes at least one of image rotation control, image shape control, and projection angle control.

Images