Mobile information terminal, terminal body, and attachment

The portable information terminal with a rotatable projector attachment addresses visibility issues by allowing flexible image projection, enhancing usability for both personal and shared viewing.

JP7796238B2Active Publication Date: 2026-01-08MAXELL LTD
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
JP2024545321
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-09-07
Publication Date
2026-01-08
Estimated Expiration
2042-09-07

AI Technical Summary

Technical Problem

Existing wrist-worn portable information terminals, such as smartwatches, face challenges in ensuring adequate visibility of displayed information for both the user and others, particularly when large amounts of information need to be shared.

Method used

A portable information terminal with a detachable and rotatable attachment featuring a projector unit that projects images based on image information from the terminal body, allowing the projection direction to be varied relative to the body, and includes mechanisms for identifying the terminal's state and controlling the projection accordingly.

Benefits of technology

Enhances visibility of information by enabling flexible projection directions, improving usability for both individual viewing and sharing with others.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007796238000001
    Figure 0007796238000001
  • Figure 0007796238000002
    Figure 0007796238000002
  • Figure 0007796238000003
    Figure 0007796238000003
Patent Text Reader

Abstract

The present invention provides a technology which makes it possible to improve visibility of a projected image in a portable information terminal to which an image projection function can be added. The portable information terminal comprises: a terminal body; and an attachment fitted to the terminal body and communicably connected to the terminal body. The attachment has a projector unit that projects an image on the basis of image information acquired from the terminal body, and is configured such that the projection port direction of the projector unit is variable with respect to the terminal body. The terminal body or the attachment identifies the state of the portable information terminal including the position of the attachment with respect to the terminal body. The terminal body or the attachment carries out image projection control on the basis of the identified state. The projection control includes, for example, image rotation control, image shape control, or projection angle control.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a portable information terminal, a terminal body, and an attachment. [Background technology]

[0002] In recent years, wrist-worn portable information terminals known as smartwatches have become popular. Smartwatches are equipped with a touchscreen, various control devices, sensors, etc. By touching characters or icons displayed on the touchscreen, users can utilize various functions, such as displaying biometric information such as heart rate measured by a sensor or displaying the status of email reception.

[0003] One of the above-mentioned wrist-worn portable information terminals is known to have a small display unit separate from the main body's display screen, and to have the function of displaying information on the small display unit, so that the user can easily view the information. For example, Patent Document 1 describes the following electronic device.

[0004] The housing of the electronic device has a first portion located on the front of the housing, a second portion located on a side of the housing, a first band attachment portion, and a second band attachment portion. The second portion has a function of displaying an image. The first band attachment portion is located on a side surface located on the upper side when viewed from the front of the housing. The second portion and the second band attachment portion are located on a side surface located on the lower side when viewed from the front of the housing. The first portion has a function of displaying an image or has at least one of an hour hand, a minute hand, and a second hand. This configuration makes it easier for the user to read the displayed information. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2022-23057 Summary of the Invention [Problem to be solved by the invention]

[0006] The electronic device described in Patent Document 1 has a configuration in which a small display unit is mounted on the side of the housing. Therefore, for example, in cases where a user wearing the electronic device wants to share the displayed information with others, the visibility of the information for others is not taken into consideration. Furthermore, for example, simply adding a second display screen to the narrow side of the electronic device is not sufficiently user-friendly even when the user himself or herself wants to view a large amount of information. In other words, there is room for improvement in the visibility of the displayed information.

[0007] In view of the above circumstances, there is a need for a technology that can further improve the visibility of information displayed on a mobile information terminal. [Means for solving the problem]

[0008] One representative embodiment of the present invention is a portable information terminal worn on the arm, comprising a terminal body and an attachment attached to the terminal body and connected to the terminal body so as to be able to communicate with the terminal body, the attachment having a projector unit that projects an image based on image information obtained from the terminal body, the projection port direction of the projector unit being configured to be variable relative to the terminal body, the terminal body or the attachment identifying the state of the portable information terminal including the position of the attachment relative to the terminal body, and the terminal body or the attachment controlling the projection of the image based on the identified state.

[0009] One representative embodiment of the present invention is a terminal body constituting a portable information terminal worn on the arm, comprising: a mechanism for attaching an attachment having a projector unit that projects an image and is configured so that the direction of the projection port of the projector unit is variable relative to the terminal body; a communication unit that exchanges information with the attachment; a generation means that generates image information to be sent to the attachment via the communication unit; and an acquisition means that acquires information indicating the direction of the projection port from the attachment, and the terminal body edits the image information based on the information acquired by the acquisition means.

[0010] One representative embodiment of the present invention is an attachment constituting a portable information terminal worn on the arm, the attachment being attached to the main body of the portable information terminal, being communicatively connected to the main body, and having a projector unit that projects an image based on image information obtained from the main body, the projection port direction of the projector unit being configured to be variable relative to the main body, the main body or the attachment identifying the state of the portable information terminal including the position of the attachment relative to the main body, and the main body or the attachment controlling the projection of the image based on the identified state. [Effects of the Invention]

[0011] According to a representative embodiment of the present invention, it is possible to provide a technique for further improving the visibility of information displayed on a mobile information terminal. [Brief explanation of the drawings]

[0012] [Figure 1A] 1 is a front view of a portable information terminal according to a first embodiment. [Figure 1B] 1 is a side view of a portable information terminal according to a first embodiment. [Figure 2] 2 is a cross-sectional view of the portable information terminal shown in FIG. 1 taken along the line AA. [Figure 3] FIG. 2 is a front view of the terminal body as seen from the display surface side. [Figure 4] 4 is a cross-sectional view of the terminal body taken along line BB in FIG. 3. [Figure 5] FIG. [Figure 6] 6 is a cross-sectional view of the attachment taken along line CC in FIG. 5. [Figure 7] FIG. 6 is a cross-sectional view of the attachment taken along line DD in FIG. 5. [Figure 8] FIG. [Figure 9] 4 is a timing chart of an output signal obtained by a pattern detection sensor. [Figure 10] FIG. [Figure 11] FIG. 2 is a diagram illustrating an example of the hardware configuration of a terminal main body. [Figure 12] FIG. 2 is a diagram illustrating an example of the configuration of a projector unit in an attachment. [Figure 13] FIG. 10 is a flowchart showing an initialization process when an attachment is attached. [Figure 14] FIG. 10 is a diagram illustrating an example of a message display. [Figure 15A] 1 is a front view of a portable information terminal according to a first embodiment. [Figure 15B] 1 is a side view of a portable information terminal according to a first embodiment. [Figure 16A] FIG. 10 is a front view of a portable information terminal according to a second embodiment. [Figure 16B] FIG. 10 is a side view of a portable information terminal according to a second embodiment. [Figure 17A] FIG. 10 is a front view of a portable information terminal according to a third embodiment. [Figure 17B] FIG. 10 is a side view of a portable information terminal according to a third embodiment. [Figure 18A] FIG. 10 is a front view of a portable information terminal according to a fourth embodiment. [Figure 18B] FIG. 10 is a side view of a portable information terminal according to a fourth embodiment. [Figure 19] FIG. 10 is a front view of a portable information terminal according to a fifth embodiment. [Figure 20A] FIG. 13 is a front view of a portable information terminal according to a sixth embodiment. [Figure 20B]FIG. 13 is a side view of a portable information terminal according to a sixth embodiment. [Figure 21] FIG. 13 is a front view of a portable information terminal according to a seventh embodiment. [Figure 22A] FIG. 13 is a front view of a portable information terminal according to an eighth embodiment. [Figure 22B] FIG. 13 is a side view of a portable information terminal according to an eighth embodiment. [Figure 23] FIG. 13 is a front view of a portable information terminal according to a ninth embodiment. [Figure 24] FIG. 10 is a diagram illustrating an example of a setting information table. [Figure 25] FIG. 10 is a diagram illustrating an example of detailed contents of a setting information table. [Figure 26] FIG. 10 is a diagram illustrating a table showing an example of a correspondence relationship between an attachment rotation position and an attachment rotation angle. [Figure 27] 10 is a diagram illustrating a table showing an example of a correspondence relationship between the terminal body attitude and the tilt direction and upward tilt angle of the terminal body. FIG. [Figure 28] FIG. 10 is a diagram illustrating an example of the contents of setting information associated in a setting information table. [Figure 29] FIG. 10 is a flowchart showing an example of a process for automatically determining whether the arm on which the mobile information terminal is worn is left or right. [Figure 30] FIG. 10 is a flow chart showing an example of a process for determining the inside or outside of the arm on which the portable information terminal is worn. [Figure 31] FIG. 10 is a flowchart showing an example of a process related to the projection of display content in a portable information terminal. [Figure 32A] FIG. 10 is a front view of a portable information terminal according to a first modification of the first embodiment. [Figure 32B] FIG. 10 is a side view of a portable information terminal according to a first modified example of the first embodiment. [Figure 33] FIG. 10 is a diagram showing an example of a portable information terminal according to a first modified example of the first embodiment. [Figure 34] FIG. 34 is a diagram showing a modification of the embodiment of the portable information terminal shown in FIG. [Figure 35] FIG. 10 is a diagram illustrating an example of a setting information table. [Figure 36] FIG. 10 is a diagram illustrating an example of detailed contents of a setting information table. [Figure 37A] FIG. 10 is a front view of a portable information terminal according to a second modification of the first embodiment. [Figure 37B] FIG. 10 is a side view of a portable information terminal according to a second modification of the first embodiment. [Figure 38] FIG. 10 is a diagram illustrating an example of the configuration of a portable information terminal according to a second embodiment. [Figure 39] FIG. 10 is a diagram showing a portable information terminal according to a first modified example of the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In each embodiment and drawing, the same or equivalent components are designated by the same numbers or symbols, and repeated descriptions will be omitted unless otherwise specified.

[0014] (Embodiment 1) A mobile information terminal according to embodiment 1 will be described. The mobile information terminal according to embodiment 1 has a function of projecting display content such as images or video images (hereinafter simply referred to as images). In addition, the mobile information terminal according to embodiment 1 is, as an example, a so-called wristwatch type that is worn on the wrist of a user. First, the configuration of the mobile information terminal according to embodiment 1 will be described.

[0015] <Configuration of mobile information terminal> Fig. 1A is a front view of mobile information terminal 10 according to embodiment 1. Fig. 1B is a side view of mobile information terminal 10 according to embodiment 1. In each embodiment described below, as shown in Figs. 1A and 1B, when the display surface of the mobile information terminal is viewed from the front, the upward direction is defined as the forward direction F, the downward direction is defined as the backward direction B, the rightward direction is defined as the rightward direction R, the leftward direction is defined as the leftward direction L, the forward direction is defined as the upward direction U, and the forward direction is defined as the downward direction D.

[0016] As shown in FIGS. 1A and 1B, the mobile information terminal 10 is mainly composed of a terminal main body 11 and an attachment 21.

[0017] The terminal body 11 has a circumferential edge portion. The terminal body 11 also has a housing 12, a touch screen portion 13, a mark portion 14, a belt 17, and a home button 191 as components.

[0018] The housing 12 corresponds to the so-called housing of the terminal main body 11 and has a generally cylindrical shape with a short axis length or a thick disk shape. The touch screen unit 13 is provided on the surface of the housing 12 and has, for example, a rectangular or disk shape. The touch screen unit 13 has a structure in which a display unit and an input unit are integrated. The display unit displays the time, biometric information, and other information, and is composed of a display element such as a liquid crystal panel or organic EL. The input unit accepts touch operations by the user and is composed of a capacitive touch sensor or the like.

[0019] Mark 14 is arranged in a specific direction and position on housing 12 and functions as a landmark. In this embodiment, mark 14 is a triangular mark located at the 12 o'clock position on a typical wristwatch. Belt 17 is connected to housing 12 and is intended to be wrapped around the user's wrist so that mobile information terminal 10 can be worn on the user's wrist.

[0020] The home button 191 is a physical button provided separately from the touch screen unit 13 on the display surface side of the touch screen unit 13 of the housing 12. The home button 191 is used, for example, to return the displayed information to the main menu screen.

[0021] The attachment 21 is configured to be attachable to and detachable from a circumferential edge portion that forms the side surface of the housing 12. Furthermore, when the attachment 21 is attached to the edge portion of the housing 12, the attachment 21 is configured to be rotatable with respect to the housing 12. Furthermore, the attachment 21 is configured to be able to communicate with the terminal main body 11.

[0022] The attachment 21 is mainly composed of a bezel portion 213 and a projector portion 22.

[0023] Bezel section 213 is configured to be attachable to the peripheral edge of housing 12. When bezel section 213 is attached to the peripheral edge of housing 12, it becomes an annular frame that surrounds the display screen of touch screen section 13 and is configured to be rotatable relative to housing 12. Projector section 22 is provided on bezel section 213 so as to be configured integrally with bezel section 213.

[0024] The projector unit 22 has a function of projecting an image representing the display content onto an object such as the back of a hand, a wall, a desk, etc. A projection port 25 is formed in the projector unit 22, and projection light 10p is projected from the projection port 25 in a projection port direction PA, which is the central axial direction of the opening of the projection port 25, so as to spread. The configuration of the attachment 21 will be described in detail later.

[0025] Fig. 2 is a cross-sectional view of the mobile information terminal 10 taken along line AA shown in Fig. 1. Fig. 2 shows a state in which the attachment 21 is attached to the housing 12. In Fig. 2, the shaded area represents the cross section of the attachment 21.

[0026] The mobile information terminal 10 has a body information measurement sensor 16. The body information measurement sensor 16 is arranged so as to come into contact with the skin when the user wears the mobile information terminal 10 on their arm. The body information measurement sensor 16 has the function of measuring the user's pulse rate, electrocardiogram, blood flow, etc., and outputs a signal according to the measurement results.

[0027] The housing 12 has a display surface side convex portion 12a and a sensor side convex portion 12b. The display surface side convex portion 12a is formed along the circumferential direction on the display surface side of the touch screen unit 13 and is a convex portion having a tapered shape. The sensor side convex portion 12b is formed along the circumferential direction on the side of the housing 12 where the physical information measurement sensor 16 is arranged and is a convex portion having a width d in the radial direction. In this way, by forming the inner periphery of the bezel portion 213 to follow the circumferential shape of the housing 12, the mobile information terminal 10 is configured so that the bezel portion 213 does not come off the housing 12.

[0028] The portable information terminal 10 has a control board 15 inside the housing 12. The control board 15 controls the system of the portable information terminal 10, controls the display of the touch screen unit 13, and controls the image projected from the projector unit 22 in the bezel unit 213. The portable information terminal 10 also has an internal space 22i inside the housing of the projector unit 22 provided in the bezel unit 213. The internal space 22i houses a control board 27 of the projector unit 22, which will be described in detail later, or a projection optical system (not shown), etc.

[0029] Fig. 3 is a front view of the terminal body 11 as viewed from the display surface side. That is, Fig. 3 shows the state in which the bezel part 213 of the mobile information terminal 10 is removed. As shown in Fig. 3, pattern detection sensors 12c and 12d are provided on the housing 12 of the terminal body 11. The pattern detection sensors 12c and 12d irradiate light and detect the amount of reflected light according to the pattern of the reflective surface of the irradiated light. The operation of these pattern detection sensors 12c and 12d will be described in detail later.

[0030] Fig. 4 is a cross-sectional view of the terminal main body 11 taken along the line BB shown in Fig. 3. As shown in Fig. 4, a plurality of grooves are formed along the circumferential side surface of the housing 12, and slip rings 18a to 18d are provided in these grooves. The bezel part 213 is rotatably fitted to the slip rings 18a to 18d, and the bezel part 213 and the slip rings 18a to 18d are configured to be electrically connectable. The slip rings 18a to 18d are electrically insulated from each other.

[0031] Here, as an example, slip rings 18a and 18d are assigned as terminals for supplying power from a power source included in terminal body 11 to bezel portion 213, and slip rings 18b and 18c are assigned as terminals for transmitting and receiving signals to and from bezel portion 213 using differential binary signals.

[0032] 4, the sensor-side protrusion 12b is formed with a housing-side bezel rear surface contact surface 12e. The pattern detection sensors 12c and 12d are disposed on the housing-side bezel rear surface contact surface 12e. The housing-side bezel rear surface contact surface 12e has a width d in the radial direction of the bezel portion 213.

[0033] The structure of the attachment 21 will now be described in detail with reference to the drawings.

[0034] FIG. 5 is a front view of the attachment 21. As shown in FIG. 5, the bezel portion 213 has a first semicircular part 211, a second semicircular part 212, a pin 23, and a fastener 24. The first semicircular part 211 and the second semicircular part 212 each have a roughly semicircular shape and have a through hole formed at one end in the circumferential direction. The pin 23 is inserted into the through hole of the first semicircular part 211 and the through hole of the second semicircular part 212 while these parts are overlapped, and connects the first semicircular part 211 and the second semicircular part 212 in an openable and closable manner with the pin 23 as a fulcrum. The fastener 24 connects and fixes the first semicircular part 211 and the second semicircular part 212 together when the first semicircular part 211 and the second semicircular part 212 are in a closed state.

[0035] Projector unit 22 is provided near the center of the outer periphery of second semicircular part 212 so as not to interfere with terminal main body 11, and is configured integrally with first semicircular part 211. Projector unit 22 is configured to project projection light so that display content such as images representing characters, figures, images, etc. or moving images is projected onto an object. Projection port 25 is provided on the side of projector unit 22 and is an optical opening through which projection light 10p is projected. Therefore, projector unit 22, which is integrated with bezel unit 213, can rotate together with bezel unit 213, and the direction in which projection light 10p from projector unit 22 spreads can be freely changed 360 degrees.

[0036] The first semicircular part 211 and the second semicircular part 212 are connected by fasteners 24 in a closed state so as to surround the side surfaces of the housing 12, whereby the bezel part 213 is attached to the terminal body 11. With this configuration, the attachment 21 can be attached to and detached from the terminal body 11.

[0037] Fig. 6 is a cross-sectional view of the attachment 21 taken along line CC in Fig. 5. On the back surfaces of the first semicircular part 211 and the second semicircular part 212, excluding the portion where the projector unit 22 is provided, there is formed a main body bezel back surface contact surface 21b that comes into contact with the housing bezel back surface contact surface 12e (Fig. 4) when the bezel unit 213 is attached to the housing 12. The main body bezel back surface contact surface 21b has a width d in the radial direction of the bezel unit 213.

[0038] 7 is a cross-sectional view of the attachment 21 taken along line DD in FIG. 5. Terminals 26a to 26d are provided on the portions of the first semicircular part 211 and the second semicircular part 212 where the projector unit 22 is provided. When the bezel unit 213 is attached to the housing 12, the terminals 26a to 26d come into contact with and are electrically connected to the slip rings 18a to 18d, respectively. This configuration enables power to be supplied from a power source inside the housing 12 to the bezel unit 213, and signals to be transmitted and received between the housing 12 and the bezel unit 213. The power supplied to the bezel unit 213 is also supplied to the control board 27 and the like inside the projector unit 22.

[0039] 8 is a rear view of the attachment 21. On the rear surface of the bezel portion 213, a pattern is formed on the circumferential main body bezel rear surface contact surface 21b having a width d in the radial direction of the bezel portion 213. The pattern includes first light-reflecting surfaces 213a (shown with diagonal lines) and second light-reflecting surfaces 213b (shown with non-diagonal lines) alternately arranged at an angular interval of θp. The first light-reflecting surfaces 213a and the second light-reflecting surfaces 213b have different light reflectivities. In this embodiment, the second light-reflecting surface 213b has a higher light reflectivity than the first light-reflecting surface 213a.

[0040] In Figure 8, the position of pattern detection sensor 12c (Figure 3) when attachment 21 is attached to terminal body 11 is represented by position 12c', and the position of pattern detection sensor 12d (Figure 3) when attachment 21 is attached to terminal body 11 is represented by position 12d'.

[0041] Fig. 9 is a timing chart of the output signals obtained by the pattern detection sensors. The timing chart shown in Fig. 9 shows the output signals obtained by pattern detection sensors 12c and 12d when attachment 21 rotates relative to terminal body 11. In the timing chart shown in Fig. 9, the horizontal axis represents elapsed time t. The detection signals of pattern detection sensors 12c and 12d output an "H (high)" level when detected by second light reflecting surface 213b, which has a relatively high reflectivity, and an "L (low)" level when detected by first light reflecting surface 213a, which has a relatively low reflectivity.

[0042] Here, for example, the pattern detection sensors 12c and 12d are arranged so that when the bezel portion 213 rotates at a constant speed in the rotation direction RF (FIG. 8), the angular interval between these positions is 2θp+θp / 2 as described above. Therefore, as shown in FIG. 9, the output signal of the pattern detection sensor 12c becomes a pulse whose rising timing from "L" level to "H" level is earlier than the signal output of the pattern detection sensor 12d. When the bezel portion 213 rotates at a constant speed in the rotation direction RB (FIG. 8), the output signal of the pattern detection sensor 12c becomes a pulse whose rising timing from "L" level to "H" level is later than the signal output of the pattern detection sensor 12d, as shown in FIG.

[0043] Therefore, the rotation angle of the bezel part 213 with respect to the terminal body 11 can be grasped from the number of pulses of the outputs of the pattern detection sensors 12c and 12d, i.e., the number of changes between H level and L level. Furthermore, the rotation direction of the bezel part 213 can be determined as the RF direction if the signal output of the pattern detection sensor 12c is at the "H" level when the output signal of the pattern detection sensor 12d rises from the "L" level to the "H" level, and as the RB direction if the signal output of the pattern detection sensor 12c is at the "H" level, and as the RB direction if the signal output is at the "L" level.

[0044] In this way, the pattern on the main body bezel rear contact surface 21b and the above-described configuration of the pattern detection sensors 12c and 12d realize the function of a rotary encoder.

[0045] Although not shown, the terminal body 11 and the bezel portion 213 may be configured so that the operation feels like they are being rotated with a clicking sensation while being locked at a certain angle, for example, at a pattern interval θp of the minimum angle that can be detected.

[0046] Fig. 10 is a rear view of the mobile information terminal 10. As shown in Fig. 10, a reset button 192, which is a push-in physical button, is provided on the rear of the terminal body 11 of the mobile information terminal 10. The reset button 192 is used to initialize the measurement contents of the rotation angle and rotation direction of the bezel part 213 when the bezel part 213 is attached to the terminal body 11 and rotated. When the reset button 192 is pressed, the initialization process is performed. Details of the initialization process will be described later.

[0047] <Internal configuration and functions of the terminal> Fig. 11 is a diagram illustrating an example of the hardware configuration of terminal main body 11. As illustrated in Fig. 11, terminal main body 11 includes communication interface (I / F) 113, control unit 114, touch screen unit 13, microphone 161, speaker 162, audio input / output unit 160, home button 191, reset button 192, switch input unit 150, storage 125, mobile communication interface (I / F) 131, memory 132, acceleration sensor 133, pulse counter 134, GPS receiving unit 135, gyro sensor 136, geomagnetic sensor 137, pattern detection sensor 12c, pattern detection sensor 12d, pulse counter 134, switch input unit 150, body information measurement sensor 16, sensor interface (I / F) 139, image output interface (I / F) 170, battery 180, and slip rings 18a to 18d. Furthermore, the functional units other than the home button 191, the reset button 192, the microphone 161, the speaker 162, the body information measuring sensor 16, the battery 180, and the slip rings 18a to 18d are connected to one another via a bus 101.

[0048] Battery 180 is the power source for mobile information terminal 10. Battery 180 supplies power to each component of terminal main body 11, and also supplies power to bezel unit 213 and projector unit 22 via slip rings 18a and 18d. Battery 180 is, for example, a secondary battery such as a rechargeable lithium-ion battery, and can be charged by a charging circuit (not shown). Battery 180 also supplies power to each component and slip rings 18a and 18d via a power supply voltage conversion circuit (not shown) as needed.

[0049] The storage 125 stores application programs. The control unit 114 loads the application programs from the storage 125 into the memory 132 and executes the loaded application programs, thereby realizing various functions.

[0050] For simplicity of explanation, the following description will be given assuming that the various functions realized by the control unit 114 executing the application programs are realized mainly by the various program function units.

[0051] The application program may be stored in advance in the storage 125 before the terminal main body 11 is shipped. Alternatively, the application program may be stored in a medium such as an optical medium, such as a CD (Compact Disk) or a DVD (Digital Versatile Disk), or a semiconductor memory, and installed in the terminal main body 11 from this medium via a medium connector (not shown).

[0052] The application program may also be downloaded from an external network (not shown) via the communication interface 113 and a wireless router (not shown) and installed in the terminal main body 11. Alternatively, the application program may be downloaded from a distribution source via the mobile communication interface 131 and a base station (not shown) and installed in the terminal main body 11.

[0053] Furthermore, it is also possible to connect the terminal main body 11 to a personal computer that has acquired an application program via a network via an external device connection interface (not shown), and move or copy the application program from this personal computer to the terminal main body 11 and install it.

[0054] The application program can also be implemented in hardware as processing units having the same functions. When implemented in hardware, each processing unit plays a central role in implementing each function.

[0055] The communication interface 113 is connected to a wireless router (not shown) via a wireless LAN (Local Area Network) or the like. The communication interface 113 is also connected to an external network via the wireless router, and transmits and receives information to and from a server on the external network.

[0056] In addition to or instead of the function of communicating with a wireless router, the communication interface 113 is capable of communicating directly with a server without going through a wireless router using a technology such as a wireless LAN, such as Wi-Fi (registered trademark).

[0057] Communication interface 113 may be implemented with multiple chips that handle different communication methods. Alternatively, communication interface 113 may be implemented with a single chip that handles multiple different communication methods. Communication interface 113 may be configured to be able to communicate with other devices using a communication method called BLUETOOTH (registered trademark) for close-proximity communication.

[0058] The mobile communication interface 131 is connected to a communication network through a base station using a mobile communication network such as LTE (Long Term Evolution) communication, 4G communication, or 5G communication. The mobile communication interface 131 can transmit and receive information to and from a server on the communication network, and can also allow terminals to share their locations with each other. Note that the communication method is not limited to the above example.

[0059] Furthermore, the portable information terminal 10 may be configured so that connection to an external network via the communication interface 113 can be given priority over connection to a communication network via the mobile communication interface 131 .

[0060] The control unit 114 receives a user operation request from the home button 191 or the reset button 192 via the switch input unit 150, or from the microphone 161 via the audio input / output unit 160. The control unit 114 controls the touch screen unit 13, the communication interface 113, and various program function units in response to the received operation request.

[0061] Furthermore, the control unit 114 can acquire various information from a server on an external network via the communication interface 113 and a wireless router, or via the mobile communication interface 131 and a base station. The control unit 114 also has a function of passing the acquired information to various program function units. Using these functions, the user can exchange images and voices with the communication partner and engage in voice chats, etc.

[0062] The storage 125 is controlled by instructions from the control unit 114 and is capable of storing application programs. The storage 125 also stores various types of information created by application programs.

[0063] The storage 125 may store content such as a video and audio stream based on a signal received from the communication interface 113 or the mobile communication interface 131. The storage 125 may be built into the mobile information terminal 10, or may be a memory mounted on a portable bezel unit 213 that is detachable from the terminal body 11 of the mobile information terminal 10.

[0064] The memory 132 is controlled by instructions from the control unit 114. The control unit 114 loads into the memory 132 the functional units of the application programs stored in the storage 125.

[0065] Display unit 13b constituting touch screen unit 13 displays images and videos stored in storage 125, broadcast or distributed videos, a user interface (UI) for various operations, images generated by application programs, etc. Display unit 13b may also display images and videos received from a server on an external network via communication interface 113.

[0066] In addition, the display unit 13b may display images and videos received from a television receiver via the communication interface 113, or may display images and videos distributed from a server on a communication network via the mobile communication interface 131.

[0067] The home button 191 and the reset button 192 are used to accept operations on the terminal body 11 of the mobile information terminal 10 from the user, and are input units into which control information relating to input operations is input.

[0068] A drag operation is, for example, an operation of moving an arbitrary object such as a displayed icon while touching it with a finger on the display screen of the touch screen unit 13. A flick operation is an operation of moving a finger on the display screen of the touch screen unit 13 in a flicking motion.

[0069] By performing a tap operation or a double tap operation, an object such as an icon can be activated or a screen can be switched to another. A tap operation is an operation of tapping an object, etc., once with a finger. A double tap operation is an operation of tapping an object, etc., twice with a finger. Here, the above-mentioned operations on the touch screen unit 13 will be described as a drag operation, a flick operation, and a tap operation.

[0070] The acceleration sensor 133 measures the acceleration acting on the mobile information terminal 10. The geomagnetic sensor 137 measures the geomagnetism at the location where the mobile information terminal 10 is located.

[0071] The pulse counter 134 counts pulses (FIG. 9) obtained by the pattern detection sensors 12c, 12d when the attachment 21 attached to the terminal main body 11 is rotated by the user. The control unit 114 detects the rotation direction of the attachment 21 based on the pulse signal. The control unit 114 can obtain the rotation angle of the attachment 21 based on the detected rotation direction and the number of counted pulses.

[0072] Furthermore, the control unit 114 can detect which part of the terminal body 11 is upward, that is, the tilt, attitude, etc. of the terminal body 11, for example, by measuring the gravitational acceleration using the acceleration sensor 133. Furthermore, the control unit 114 can determine whether the arm of the user wearing the terminal body 11 is the right arm or the left arm, based on the detected tilt, attitude, etc. of the terminal body 11. Furthermore, the control unit 114 can correct distortion of the image by controlling the shape of the image projected from the projector unit 22 provided integrally with the bezel unit 213 attached to the terminal body 11, based on the detected tilt, attitude, etc. of the terminal body 11. The details of this correction will be described later.

[0073] The geomagnetic sensor 137 measures geomagnetism by using multiple magnetic sensors. The GPS receiver 135 receives signals transmitted from multiple satellites using the GPS (Global Positioning System). The control unit 114 can calculate position information of the terminal body 11 of the mobile information terminal 10 based on the signals received by the GPS receiver 135.

[0074] The gyro sensor 136 measures the angular velocity of the terminal body 11 that occurs when the user moves the terminal body 11, for example.

[0075] Physical information measuring sensor 16 is generally configured to irradiate the user's arm with green light and output a signal corresponding to the amount of reflected light in order to measure, for example, the user's heart rate, blood flow, etc. However, the measurement target, measurement method, and configuration of physical information measuring sensor 16 are not limited to those described above. Sensor interface 139 converts the output of physical information measuring sensor 16 into digital values. Control unit 114 processes the converted digital values ​​using an application program to obtain the heart rate, blood flow, etc., and displays the heart rate, blood flow, etc. on display unit 13b.

[0076] The audio input / output unit 160 inputs and outputs audio input signals from a microphone 161 equipped in the mobile information terminal 10 and audio output signals to a speaker 162. The control unit 114 controls the volume of the audio input and output.

[0077] The switch input unit 150 acquires switch information in response to the operation of the home button 191 and the reset button 192, and sends it to the control unit 114 via the bus 101. The control unit 114 uses the switch information to control various application programs as necessary.

[0078] When the home button 191 is pressed, the control unit 114 controls each unit so that the inside of the terminal main body 11 is reset to its initial state and the display screen returns to the initial screen of the operating system, regardless of the operating state of the running application program. Details of the operation of the terminal main body 11 when the reset button 192 is pressed will be described later.

[0079] Image output interface 170 outputs the display image generated by control unit 114 to the outside, and exchanges information related to initialization processing when bezel unit 213 is connected to terminal main body 11, via slip rings 18b and 18c. In this embodiment, the display image is an image to be projected and displayed by projector unit 22 provided in detachable and replaceable bezel unit 213.

[0080] <Internal structure and functions of the bezel> Fig. 12 is a diagram showing an example of the configuration of projector unit 22 in attachment 21. As shown in Fig. 12, projector unit 22 has terminals 26a to 26d, an image input interface (I / F) 203, a control unit 204, a nonvolatile memory 205, a memory 206, a display element driving unit 207, a projection optical system 208, a display element 209, an illumination optical system 210, and a light source 215. The functional units of image input interface 203, control unit 204, nonvolatile memory 205, memory 206, and display element driving unit 207 are connected to each other via bus 201.

[0081] Power supplied from the terminal main body 11 via the terminals 26a and 26d is supplied to each component via a power supply voltage conversion circuit (not shown) as needed.

[0082] The light source 215 generates light that is the source of projection light 10p used to project images, videos, etc., and uses an LED light source, a laser light source, etc. The illumination optical system 210 collects the light generated by the light source 215, makes it more uniform, and irradiates the light onto the display element 209.

[0083] The display element 209 is an element that transmits or reflects light from the illumination optical system 210 and modulates the light to generate an image. The display element 209 is, for example, a transmissive liquid crystal panel, a reflective liquid crystal panel, or a DMD (Digital Micromirror Device: registered trademark) panel. The display element driver 207 sends a drive signal corresponding to the video signal to the display element 209. The projection optical system 208 is an enlarged projection optical system that projects an image, video, etc. onto an object, and includes at least one of a lens and a mirror.

[0084] Here, the video signal referred to by the display element driver 207 is a video signal input from the terminal body 11 of the mobile information terminal 10, and is input as a differential binary signal from the terminals 26b and 26c. Note that the video signal referred to by the display element driver 207 may be a signal obtained by superimposing an OSD (On Screen Display) image signal generated by the control unit 204 using an image stored in the nonvolatile memory 205 on a video signal obtained via the image input interface 203. The display element 209 modulates light in accordance with a drive signal generated by the display element driver 207 with reference to these video signals, to generate an optical image. The generated optical image is projected as a display image by the projection optical system 208 with the spread of the projection light 10p.

[0085] The protocol for signals communicating between the slip rings 18b, 18c provided on the terminal body 11 of the mobile information terminal 10 and the terminals 26b, 26c provided on the bezel part 213 is not particularly limited. However, if an existing protocol such as USB (Universal Serial Bus) is used, conventional communication software can be used, and the development costs of the mobile information terminal can be reduced. As a result, the mobile information terminal product can be provided to users at a lower cost.

[0086] <Initialization process when attaching an attachment> Mobile information terminal 10 has an initialization processing function when an attachment is attached. The initialization processing function when an attachment is attached is a process in which, when attachment 21 is attached to terminal body 11 of mobile information terminal 10, control unit 114 (FIG. 11) on terminal body 11 side detects that the attachment is attached and performs initialization to enable the functions of the attachment.

[0087] FIG. 13 is a flowchart showing the initialization process when an attachment is attached.

[0088] In step S1301, attachment of an attachment is detected. Specifically, when a user attaches the attachment 21 to the terminal body 11, the control unit 114 detects the attachment by processing similar to that performed when plugging in a USB, for example. Then, signals representing information about the functions of the attachment 21 are communicated between the control unit 114 and the attachment 21. Performing such communication processing is effective in increasing the variety of attachments. For example, the attachment 21 can be provided with a camera function or other functions in addition to a projector.

[0089] In step S1302, it is determined whether the attachment has a projector function. Specifically, the control unit 114 determines whether the attachment 21 has a projector function based on information received from the attached attachment 21. If it is determined that the attachment 21 has a projector function (S1302: Yes), the control unit 114 proceeds to step S1303. On the other hand, if it is determined that the attachment does not have a projector function (S1302: No), the control unit 114 proceeds to step S1306.

[0090] In step S1303, a message is displayed. Specifically, the control unit 114 controls the display unit 13b to display a message for the attachment with a projector function. The displayed message is, for example, a message for prompting the user to align the pin 23 of the attachment 21 with the mark unit 14 and press the reset button 192 (FIG. 10).

[0091] Fig. 14 is a diagram showing an example of a message display. For example, as shown in Fig. 14, the control unit 114 displays a message such as "Align the bezel pin with the triangle and press the reset button on the back" on the display screen of the display unit 13b.

[0092] In step S1304, it is determined whether the reset button has been pressed. Specifically, control unit 114 determines whether reset button 192 has been pressed. If it is determined that reset button 192 has been pressed (S1304: Yes), control unit 114 shifts the processing step to be executed to the next step S1305. On the other hand, if it is determined that reset button 192 has not been pressed (S1304: No), control unit 114 returns the processing step to be executed to step S1304. This processing puts the device into a standby state until reset button 192 is pressed.

[0093] In step S1305, the pulse counter 134 is reset. Specifically, the control unit 114 resets the pulse counter 134 (FIG. 11) and sets the number of pulses counted by the pulse counter 134 to zero. When this setting is complete, the initialization process ends.

[0094] In step S1306, other initialization processing for attachments without a projector is performed. Specifically, the control unit 114 performs initialization processing corresponding to the functions of the attached attachment 21. After this processing is performed, the initialization processing ends.

[0095] After the initialization process is performed in this way when the attachment with projector function is attached to the terminal body 11, the control unit 114 reads the pulse count number from the pulse counter 134 almost in real time. Based on the read count number, the control unit 114 detects the rotation angle position of the bezel part 213, i.e., the attachment 21, relative to the terminal body 11 (hereinafter also referred to as the attachment rotation position).

[0096] The reset button 192 may also serve as another button, for example, the home button 191.

[0097] <Image projection control by control unit> Here, the image projection control by the control unit 114 on the terminal main body 11 side will be described. The control unit 114 has a function of making corrections related to the image projection so that an image suitable for viewing is projected according to the state in which the mobile information terminal 10 is worn. The image projection control mainly includes image rotation control, image shape control, and image projection angle control. Each control will be described below.

[0098] Image rotation control The mobile information terminal 10 has an image rotation control function. Image rotation control is a type of projection control that is performed when projecting an image that is display content, so that the up-down relationship of the image is maintained even if the rotation position of the attachment changes, in order to improve the visibility of the projected image. The control unit 114 (FIG. 11) on the terminal main body 11 identifies the wearing state of the mobile information terminal, and controls the image rotation appropriate for the identified wearing state.

[0099] Fig. 15A is a front view of the mobile information terminal 10 according to the first embodiment. Fig. 15B is a side view of the mobile information terminal 10 according to the first embodiment. Fig. 16A is a front view of the mobile information terminal 10 according to the second embodiment. Fig. 16B is a side view of the mobile information terminal 10 according to the second embodiment. In the embodiment shown in Figs. 15A, 15B, 16A, and 16B, the mobile information terminal 10 is worn on the outside of the user's left arm, and an image representing the letters "ABC" is projected onto it.

[0100] In the first embodiment shown in Figures 15A and 15B, the orientation of the projection port 25 of the projector unit 22, i.e., the projection port direction PA, is set to the 3 o'clock direction on a clock, and an image T1 is projected onto the back of the left hand.

[0101] In contrast, in the second embodiment shown in FIGS. 16A and 16B, the projection port direction PA is set to 12 o'clock by rotating the attachment 21, and an image T2 is projected onto the desk 1500 on which the user's left hand is placed. At this time, the control unit 114 detects the rotation angle position and tilt angle of the attachment 21. The control unit 114 then corrects the direction and spread of the projection light corresponding to the image representing the letters "ABC" to match the detected rotation angle position and tilt angle of the attachment 21. This correction is performed so that the letters "ABC" represented in the projected image appear to the user to remain horizontal. This correction is mainly performed by image rotation control of the display content, and has the effect of improving the visibility of the projected image.

[0102] FIG. 17A is a front view of a mobile information terminal 10 according to a third embodiment. FIG. 17B is a side view of a mobile information terminal 10 according to a third embodiment. In the third embodiment shown in FIGS. 17A and 17B, the mobile information terminal 10 is worn on the user's right arm RH, and an image representing the letters "ABC" is projected onto the back of the right hand. In the first embodiment shown in FIG. 15A, the mobile information terminal 10 is worn on the left arm LH, but in the third embodiment shown in FIG. 17A, the mobile information terminal 10 is worn on the right arm RH. Therefore, in the third embodiment, the attachment 21, i.e., the bezel portion 213 itself, is rotated 180° compared to the first embodiment shown in FIG. 15A. Therefore, the image representing the letters "ABC" needs to be displayed facing forward as shown in FIG. 17A so that it is easier for the user to see.

[0103] When the mobile information terminal 10 is worn on the right arm RH, the control unit 114 corrects the projected image, i.e., the projection light, based on the rotation position of the attachment so that the image is easier for the user to see. This correction is also performed mainly by controlling the image rotation of the display content, and has the effect of improving the visibility of the projected image.

[0104] 《Image shape control》 The mobile information terminal 10 has an image shape control function. Image shape control is a type of projection control that is performed to improve the visibility of the projected image when projecting an image that is display content. The control unit 114 (FIG. 11) on the terminal main body 11 side identifies the wearing state of the mobile information terminal and controls the image shape appropriate for the wearing state according to the identified wearing state.

[0105] Fig. 18A is a front view of mobile information terminal 10 according to a fourth embodiment. Fig. 18B is a side view of mobile information terminal 10 according to the fourth embodiment. Fig. 19 is a front view of mobile information terminal 10 according to a fifth embodiment. In the embodiments shown in Figs. 18A, 18B, and 19, mobile information terminal 10 is worn on the outside of the left arm, and an image representing a square is projected onto it.

[0106] In a fourth embodiment shown in FIGS. 18A and 18B, the attachment 21 is rotated to set the orientation of the central axis of the projection port 25 of the projector unit 22, i.e., the projection port direction PA, to 12 o'clock, and an image S1 is projected onto a desk 1500 on which a user's left arm LH is placed. In the fourth embodiment, the mobile information terminal 10 is naturally tilted with its front side raised due to the structure and shape of the human skeleton, joints, or arm. In the fourth embodiment, the center line of the mobile information terminal 10, i.e., the front-to-back direction X, is tilted at an inclination angle θr with respect to the horizontal direction H. The fourth embodiment also shows a state in which an image is not corrected based on the inclination angle when projecting the image onto the desk 1500 on which the user's left arm LH is placed. In this state in which the image is not corrected based on the inclination angle of the mobile information terminal 10, the square represented by the image S1 is distorted into a trapezoidal shape due to the inclination angle θr from the horizontal direction H.

[0107] In contrast, in a fifth embodiment shown in Fig. 19, the control unit 114 detects the rotation position of the attachment and the tilt angle of the terminal main body 11, and corrects the direction and spread of the projection light corresponding to the image representing a square in accordance with the detected rotation angle and tilt angle. This correction is performed so that the square represented by the projected image S2 maintains its square shape when viewed from the user, as shown in Fig. 19. This correction is mainly performed by controlling the image shape of the display content, and has the effect of improving the visibility of the projected image by reducing image distortion.

[0108] Image projection angle control The mobile information terminal 10 has a function of controlling the image projection angle. The image projection angle control is a type of projection control that is performed to improve the visibility of the projected image when projecting an image that is display content. The control unit 114 (FIG. 11) on the terminal main body 11 side identifies the wearing state of the mobile information terminal, and controls the image projection angle appropriate for the wearing state according to the identified wearing state.

[0109] Fig. 20A is a front view of a mobile information terminal 10 according to a sixth embodiment. Fig. 20B is a side view of the mobile information terminal 10 according to the sixth embodiment. Fig. 21 is a front view of a mobile information terminal 10 according to a seventh embodiment. In the embodiment shown in Figs. 20A, 20B, and 21, the mobile information terminal 10 is worn on the outside of the user's left arm, and an image is projected with projection port 25 directed toward a wall 1450 in front.

[0110] In a sixth embodiment shown in FIGS. 20A and 20B, attachment 21 is rotated to orient projector unit 22 toward 12 o'clock, projecting an image onto wall surface 1450 in front of the user. When a user assumes a posture such that the front-to-back direction of mobile information terminal 10 worn on the arm coincides with the front-to-back direction of the user, the front side of the arm is often tilted upward due to the structure and shape of the human skeleton, joints, or arm. In the sixth embodiment, the front-to-back direction X of mobile information terminal 10 is tilted at an inclination angle θr with respect to the horizontal direction H, and the optical axis of projection light 10p is optical axis A1 parallel to the front-to-back direction X. The sixth embodiment also illustrates a state in which, when an image is projected onto wall surface 1450 in front of the user, image distortion correction based on the existence of inclination angle θr and projection angle correction are not performed.

[0111] In this way, if image distortion based on the tilt angle of mobile information terminal 10 and the projection angle are not corrected, the projected image will be distorted into a trapezoidal shape due to the tilt angle θr from horizontal direction H. In addition, the position of the projected image relative to wall surface 1450 will also be shifted downward.

[0112] In contrast, in a seventh embodiment shown in FIG. 21 , the control unit 114 detects the tilt angle of the mobile information terminal 10, i.e., the attitude of the terminal body 11. Then, as in the seventh embodiment shown in FIG. 21 , the control unit 114 controls the projection angle of the image so that the image is projected approximately perpendicularly onto the wall surface 1450, and the projection angle of the image is upward relative to the reference projection port direction PA. For example, as shown in FIG. 21 , the projection angle is controlled so that the optical axis of the projection light 10p becomes an optical axis A2 that is approximately perpendicular to the wall surface 1450. Such correction of the optical axis of the projection light 10p is mainly performed by controlling the projection angle, which changes the projection position of the image upward and reduces image distortion, thereby improving the visibility of the projected image.

[0113] Fig. 22A is a front view of a mobile information terminal 10 according to an eighth embodiment. Fig. 22B is a side view of the mobile information terminal 10 according to the eighth embodiment. Fig. 23 is a front view of a mobile information terminal 10 according to a ninth embodiment. In the embodiments shown in Figs. 22A, 22B, and 23, the mobile information terminal 10 is worn on the outside of the user's left arm, and an image that is display content is projected onto it.

[0114] In the eighth embodiment shown in FIGS. 22A and 22B, the attachment 21 is rotated to set the projection port direction PA to the 6 o'clock position, and an image is projected onto the desk 1500 on which the user's left arm LH is placed. When the user assumes a posture such that the front-to-back direction of the mobile information terminal 10 worn on the arm coincides with the front-to-back direction of the user, the front side of the arm often tilts upward due to the structure and shape of the human skeleton, joints, or arm. In the eighth embodiment, the front-to-back direction X of the mobile information terminal 10 is tilted at an inclination angle θr with respect to the horizontal direction H. Also, the eighth embodiment shows a state in which, when an image is projected onto the desk 1500 on which the user's left arm LH is placed, the projection angle is not corrected based on the existence of the inclination angle θr. In other words, the optical axis of the projected light 10p is an optical axis A3 parallel to the front-to-back direction X on the display surface of the terminal main body 11.

[0115] In this way, when the projection angle is not corrected based on the tilt angle of the mobile information terminal 10, the tilt angle θr from the horizontal direction H causes the projection light 10p representing the image to be projected upward from the horizontal direction H, and the image is hardly projected onto the desk 1500.

[0116] In contrast, in the ninth embodiment, the control unit 114 detects the tilt angle of the attachment 21, i.e., the attitude of the terminal main body 11. Then, as in the ninth embodiment shown in Fig. 23, the control unit 114 controls the projection angle of the image so that the projection angle of the image is downward relative to the reference projection port direction PA so that the image is projected onto the desk 1500. For example, as shown in Fig. 23, the projection angle is controlled so that the optical axis of the projection light 10p becomes optical axis A4 that intersects with the desk 1500 near the left arm LH.

[0117] Such correction of the optical axis of the projected light 10p is mainly performed by controlling the image projection angle, which changes the position at which the image is projected downward, projects the entire image at a position that is easy for the user to see, and reduces image distortion, thereby improving the visibility of the projected image.

[0118] The image rotation control and image shape control may be realized by an optical method that manipulates an optical system, or by an image processing method that manipulates image information, i.e., image data. In the present embodiment, since it is more practical for projector unit 22 that projects an image to be lightweight and small, it is more preferable to apply the latter image processing method, which does not require a mechanism for manipulating an optical system.

[0119] In addition, in each of the above embodiments, in order to make the explanation easier to understand, correction based on the rotation operation, i.e., the rotation angle position, of the attachment 21 and correction based on the attitude, i.e., the tilt angle, of the terminal main body 11 are explained separately, but of course, these corrections may be performed together.

[0120] As described above, the control unit 114 has a function of detecting the rotation angle of the bezel unit 213 and a function of detecting the tilt angle of the mobile information terminal 10 based on a predetermined mechanism or sensor. Based on the rotation position of the attachment and the attitude of the terminal body obtained by these functions, the control unit 114 can perform various display correction processes when the projector unit 22 projects an image or video.

[0121] <Initial settings for projection control according to installation status> The mobile information terminal 10 has an initial setting function for projection control. The initial setting of projection control means that appropriate projection control settings are made in advance according to the state in which the mobile information terminal 10 is worn so that images, which are display content, are projected with good visibility.

[0122] For example, when the mobile information terminal 10 is worn on the outside of the user's right arm and the attachment rotation position is set so that the projection port 25 of the projector unit 22 faces the 9 o'clock direction, it is assumed that the image, which is the display content, will be projected onto the back of the user's right hand. Therefore, in such a situation, projection control suitable for projecting the image onto the back of the right hand is set in advance. For example, rotation control is set so that the image is rotated 90° clockwise so that the top, bottom, left, and right of the image are correct. Furthermore, shape control is set so that the width of the image on the side farther from the projection port 25 is narrowed so that keystone distortion of the image is corrected. Furthermore, because the surface of the back of the hand is relatively narrow, projection angle control is set so that the projection angle is slightly downward relative to the direction of the display surface of the terminal body 11 so that the image does not become too wide.

[0123] For example, when the mobile information terminal 10 is worn on the outside of the user's left arm and the projection port 25 of the projector unit 22 is set to face 12 o'clock, it is assumed that the image, which is the display content, will be projected onto the wall in front of the user. Therefore, in such a situation, projection control suitable for projecting the image onto the wall in front is set in advance. For example, rotation control is set so that the image is not rotated so that the top, bottom, left, and right of the image are correct. Furthermore, due to the structure of the human body, the outside of the arm naturally leans toward the wall in front, so the image tends to be projected diagonally downward onto the wall. Therefore, projection angle control is set so that the projection direction is slightly upward relative to the display surface direction of the terminal body 11 so that the image is projected perpendicular to the wall.

[0124] In addition, in the initial setting of projection control, in order to improve the visibility of the image, image shape control may be set instead of projection angle control, or conversely, projection angle control may be set instead of image shape control, or projection angle control and image shape control may be set simultaneously.

[0125] In addition, the initial settings for projection control, i.e., image rotation control, image shape control, and projection angle control, may be determined based on the left / right / inside / outside of the arm on which the mobile information terminal 10 is worn, the direction of the projection port 25, as well as the attitude of the terminal body 11, i.e., the tilt direction and degree thereof.

[0126] As described above, in order to improve user convenience, when an image that is display content is projected, control unit 114 identifies the wearing state of mobile information terminal 10 and performs initial settings for projection control that are suitable for the identified wearing state. The wearing state of mobile information terminal 10 includes the wearing position of the mobile information terminal, the rotation position of the attachment, the attitude of the terminal body, etc.

[0127] In this embodiment, four options are provided for the wearing position: outer left arm, outer right arm, inner left arm, and inner right arm. Also, 12 options are provided for the attachment rotation position, which are positions of the pin 23 of the bezel part 213 in one-hour increments from 12 o'clock to 11 o'clock on a clock. Also, nine options are provided for the terminal body orientation: horizontal, front-up tilt (small), back-up tilt (small), left-up tilt (small), right-up tilt (small), front-up tilt (large), back-up tilt (large), left-up tilt (large), and right-up tilt (large).

[0128] A plurality of different setting information is stored in storage 125. This plurality of different setting information is obtained by associating the wearing state of mobile information terminal 10 with setting information that indicates the initial setting of projection control suited to that wearing state. Control unit 114 reads out the setting information corresponding to the identified wearing state from storage 125, and performs the initial setting of projection control based on the read setting information.

[0129] Fig. 24 is a diagram showing an example of a setting information table. As shown in Fig. 24, the setting information table is prepared by collecting projection control setting information to be set for each wearing position of the mobile information terminal, for example. The example shown in Fig. 24 shows setting information table T01 applied when the wearing position of the mobile information terminal 10 is on the outside of the left arm, setting information table T02 applied when the wearing position is on the outside of the right arm, setting information table T03 applied when the wearing position is on the inside of the left arm, and setting information table T04 applied when the wearing position is on the inside of the right arm.

[0130] In this embodiment, these setting information tables T01 to T04 are stored in the storage 125. The setting information table may be a single table. The setting information table may be stored in the memory 132 on the terminal main body 11 side, or in the memory 206 on the attachment 21 side.

[0131] FIG. 25 is a diagram showing an example of detailed contents of setting information table T01. To facilitate understanding of the table, FIG. 25 shows a representative example of setting information tables T01 to T04. As shown in FIG. 25, setting information table T01 provides the items "attachment rotation position" and "terminal body orientation" as combination items, assuming that the wearing position is "outside" of the "left arm." "Setting information" is associated with each combination of these items. Note that each piece of setting information is represented by the symbol J (j1, j2, j3, j4). j1 is a value corresponding to whether the wearing position is on the left or right side of the arm, j2 is a value corresponding to whether the wearing position is on the outside or inside of the arm, j3 is a value corresponding to the attachment rotation position, and j4 is a value corresponding to the terminal body orientation.

[0132] In this embodiment, the "attachment rotation position" is also the rotation position of the attachment 21, and is information indicating the rotation position of the projector unit 22, for example, the position of the pin 23 as its reference position, in terms of the o'clock position on a typical clock. Specifically, the "attachment rotation position" indicates whether it is 12 o'clock, 1 o'clock, 2 o'clock, ..., or 11 o'clock.

[0133] Fig. 26 is a diagram showing a table AP1 illustrating an example of the correspondence between the attachment rotation position and the attachment rotation angle α. The bezel rotation angle α is initialized when the bezel is attached, and is set to 0° when the projector unit is positioned at the 3 o'clock position. As shown in Fig. 26, for example, when 345°≦α<15°, the attachment rotation position is the 3 o'clock position. Also, for example, when 255°≦α<285°, the attachment rotation position is the 12 o'clock position.

[0134] In addition, in this embodiment, the "terminal body attitude" is information indicating the direction and degree to which the display surface of the terminal body 11 is tilted. Specifically, the "terminal body attitude" indicates whether the terminal body is horizontal, front-upward tilt (small), rear-upward tilt (small), right-upward tilt (small), left-upward tilt (small), front-upward tilt (large), rear-upward tilt (large), right-upward tilt (large), or left-upward tilt (large). For example, a front-upward tilt (small) means that the front of the terminal body 11 is tilted upward at a small angle. A right-upward tilt (large) means that the right side of the terminal body 11 is tilted upward at a large angle.

[0135] FIG. 27 is a diagram showing a table HS1 showing an example of the correspondence relationship between the terminal body posture, the tilt direction of the terminal body, and the upward tilt angle β. The tilt angle β is set to 0° when the display surface of the terminal body 11 is horizontal. As shown in FIG. 1, for example, when the tilt direction is forward, front, back, left, or right, and the upward tilt angle β is less than 15°, the terminal body posture is horizontal. For example, when the tilt direction is forward and 30° > β ≥ 15°, the terminal body posture is a front-upward tilt (small). For example, when the tilt direction is right and β ≥ 30°, the terminal body posture is a right-upward tilt (large).

[0136] Fig. 28 is a diagram showing an example of the contents of setting information associated in setting information table T01. Fig. 28 shows a table T11 showing an example of the contents of setting information. In the example shown in Fig. 28, for example, setting information J(1,1,12,1) is setting information when mobile information terminal 10 is worn on the outside of the left arm, the attachment rotation position is in the 12 o'clock direction, and the terminal body attitude is horizontal. The setting contents of the setting information include settings for rotation control, shape control, and projection angle control of the displayed content.

[0137] 28, for example, the setting contents of setting information J(1,1,12,1) are such that for rotation control of the display content, rotation is 0°, for shape control of the display content, linear (i.e., no shape correction), and for projection angle control, the projection angle is 0°.Also, for example, the setting contents of setting information J(1,1,6,3) are such that for rotation control of the display content, rotation is 180° clockwise (CW; ClockWise), for shape control of the display content, correction is performed to narrow the far width of the image, and for projection angle control, the projection angle is set to 30° downward.

[0138] The control unit 114 references the setting information table described above, reads setting information corresponding to the detected wearing state, and performs initial projection control settings based on the setting information. In this embodiment, the wearing state and setting information have been described in a simplified manner for ease of understanding, but in reality, the wearing state and setting information may be defined by more complex and detailed items. This configuration for initial projection control settings allows projection control appropriate for the wearing state of the mobile information terminal to be performed in advance, thereby improving the visibility of displayed content without any subsequent adjustment of the projection control, or with only subsequent fine adjustment of the projection control by the user.

[0139] The initial settings of the projection control may be made based on information input by the user. For example, the user may input the wearing state of the mobile information terminal 10, and the control unit 114 may make the initial settings of the projection control suitable for the input wearing state. Alternatively, the user may directly make the initial settings or current settings of the projection control, or fine-tune them.

[0140] Now, some examples of processing methods for automatically identifying the wearing state of a portable information terminal will be described with reference to the drawings.

[0141] <Identifying the left or right arm on which the device is worn> Fig. 29 is a flow chart showing an example of a process for automatically determining whether the arm on which the mobile information terminal 10 is worn is left or right. The flow chart shown in Fig. 29 shows an example of a processing procedure by the control unit 114 for determining whether the mobile information terminal 10 is worn on the left or right arm of the user. The algorithm for this determination process is based on the premise that the user often keeps their arm hanging downward (in the direction of gravity) while walking.

[0142] In step S2901, it is determined whether or not the user is walking. Specifically, control unit 114 determines whether or not the user wearing mobile information terminal 10 is walking, based on the output history of at least one of acceleration sensor 133 and gyro sensor 136 over a certain period of time.

[0143] When the user is walking, it is considered that the output of the acceleration sensor 133 or the gyro sensor 136 repeatedly changes by an amount of change equal to or greater than a certain level. Therefore, it is possible to determine whether or not the user is walking based on whether or not such a characteristic is recognized.

[0144] If it is determined that the user is walking (S2901: Yes), control unit 114 proceeds to step S2902. On the other hand, if it is determined that the user is not walking (S2901: No), control unit 114 proceeds to step S2906.

[0145] In step S2902, it is determined whether the direction of gravity on the mobile information terminal 10 is the 3 o'clock direction. Specifically, the control unit 114 determines whether the direction of gravity on the mobile information terminal 10 is near the 3 o'clock direction of the wristwatch, based on the output of the acceleration sensor 133. If it is determined that the direction of gravity is near the 3 o'clock direction (S2902: Yes), the control unit 114 proceeds to step S2904. On the other hand, if it is determined that the direction of gravity is not near the 3 o'clock direction (S2902: No), the control unit 114 proceeds to step S2903.

[0146] In step S2903, it is determined whether the direction of gravity on the mobile information terminal 10 is the 9 o'clock direction. Specifically, the control unit 114 determines whether the direction of gravity on the mobile information terminal 10 is near the 9 o'clock direction of the wristwatch, based on the output of the acceleration sensor 133. If it is determined that the direction of gravity is near the 9 o'clock direction (S2903: Yes), the control unit 114 proceeds to step S2905. On the other hand, if it is determined that the direction of gravity is not near the 3 o'clock direction (S2903: No), the control unit 114 proceeds to step S2906.

[0147] In step S2904, if it is determined that the user is walking and the gravity direction of the acceleration sensor output is the 3 o'clock direction, a process of counting up the variable LW corresponding to the determination result is performed. Specifically, the control unit 114 adds 1 to the value of the variable LW and sets the new value of the variable LW. After step S2904 is executed, the control unit 114 shifts to the step to be executed at S2906.

[0148] In S2905, if it is determined that the user is walking and the gravity direction of the acceleration sensor output is the 9 o'clock direction, a process of counting up the variable RW corresponding to the determination result is performed. Specifically, the control unit 114 adds 1 to the value of the variable RW and sets the new value of the variable RW. After step S2905 is executed, the control unit 114 shifts the step to be executed to S2906.

[0149] The variables LW and RW are variables used in the program of the control unit 114, and are initialized to zero when the mobile information terminal 10 is turned on or when the user performs a system reset process (not shown).

[0150] In step S2906, it is determined whether a significant difference exists between the values ​​of the variables LW and RW. Specifically, the control unit 114 determines whether a situation exists in which either the value of the variable LW or the value of the variable RW exceeds a threshold value TH1 and the difference between the ratio of the value of the variable LW to the total count number and the ratio of the value of the variable RW to the total count number exceeds a threshold value TH2. If it is determined that such a situation exists, the control unit 114 proceeds to step S2907. On the other hand, if it is determined that such a situation does not exist, the control unit 114 returns to step S2901.

[0151] In step S2907, the value of variable LW is compared with the value of variable RW. Specifically, control unit 114 determines whether the following relationship holds: (1) the value of variable LW > the value of variable RW, or (2) the value of variable LW < the value of variable RW. Here, if it is determined that relationship (1) holds, control unit 114 determines that the user is wearing mobile information terminal 10 on the left arm (S2908) and ends the determination process. On the other hand, if it is determined that relationship (2) holds, control unit 114 determines that the user is wearing mobile information terminal 10 on the right arm (S2909) and ends the determination process.

[0152] <Distinguishing between the inside and outside of the arm on which the device is worn> Furthermore, it is conceivable that the determination of whether the mobile information terminal 10 is worn on the outside or inside of the arm can be made based on the output of the body information measuring sensor 16.

[0153] Generally, the body information measuring sensor 16 irradiates a target object with a green light source and outputs a signal according to the amount of light reflected from the target object. The size or number of blood vessels passing near the surface of the arm, i.e., the amount of blood flow, differs between the outside of the arm (the back of the hand) and the inside of the arm (the opposite side of the back of the hand). Furthermore, the amount of reflected green light differs depending on the amount of blood flow. In other words, the body information measuring sensor 16 outputs different signals when the green light is irradiated on the outside of the arm and when it is irradiated on the inside of the arm. By utilizing this feature, it is possible to determine whether the mobile information terminal 10 is worn on the outside or inside of the arm based on the output of the body information measuring sensor 16.

[0154] FIG. 30 is a flow chart showing an example of a process for determining whether the mobile information terminal 10 is worn on the inside or outside of the arm.

[0155] 30, in step S3001, light is emitted to the arm. Specifically, the control unit 114 controls the physical information measuring sensor 16, and the physical information measuring sensor 16 emits green light to the user's arm.

[0156] In step S3002, the light reflectance of the arm is measured. Specifically, the control unit 114 receives a signal output from the body information measurement sensor 16, detects the amount of green light emitted to the arm and reflected from the arm, and measures the light reflectance of the arm based on the amount of light.

[0157] In step S3003, it is determined whether the measured light reflectance exceeds a threshold value. Specifically, control unit 114 determines whether the measured light reflectance of the arm exceeds a predetermined threshold value th. If it is determined that the light reflectance exceeds threshold value th (S2003: Yes), control unit 114 proceeds to step S3004. On the other hand, if it is determined that the light reflectance does not exceed threshold value th (S3003: No), control unit 114 proceeds to step S3005.

[0158] In step S3004, the control unit 114 determines that the mobile information terminal 10 is worn on the outer side of the user's arm. On the other hand, in step S3005, the control unit 114 determines that the mobile information terminal 10 is worn on the inner side of the user's arm.

[0159] As described above, if it is possible to automatically determine whether the mobile information terminal 10 is worn on the left or right arm, or on the inside or outside of the arm, i.e., whether the wearing position is on the outside of the left arm, the inside of the left arm, the outside of the right arm, or the inside of the right arm, the user does not need to perform any setting operation for the wearing position, thereby improving convenience.

[0160] <Processing flow in mobile information terminal> Next, a processing flow relating to the projection of display content in the mobile information terminal 10 will be described.

[0161] FIG. 31 is a flowchart showing an example of processing related to the projection of display content in the mobile information terminal 10. In FIG.

[0162] 31, in step S3101, the wearing state of the mobile information terminal 10 is identified. Specifically, the control unit 114 identifies the terminal wearing position, the attachment rotation position, and the terminal main body attitude as items of the wearing state of the mobile information terminal 10. For example, the above-mentioned method is used to identify each item of the wearing state.

[0163] In step S3102, the projection control setting information is read. Specifically, the control unit 114 refers to the setting information table stored in the storage 125, and reads the projection control setting information associated with the combination of items for the identified mounting state from the storage 125. That is, the control unit 114 reads the projection control setting information appropriate for the identified mounting state in accordance with the identified mounting state.

[0164] In step S3103, projection control is initialized. Specifically, control unit 114 initializes image rotation control, image shape control, and image projection angle control based on the read setting information.

[0165] In step S3104, it is determined whether or not there has been a change in the attachment rotation position. Specifically, the control unit 114 determines whether or not there has been a change in the attachment rotation position detected almost in real time. If it is determined that there has been a change (S3104: No), the control unit 114 returns the processing step to step S3101. On the other hand, if it is determined that there has not been a change (S3104: Yes), the control unit 114 advances the processing step to step S3105.

[0166] In step S3105, an image is projected. Specifically, control unit 114 corrects the image, which is the display content, by performing the set image rotation control and image shape control. Then, control unit 114 transmits image information representing the corrected image, i.e., image data, and setting information for projection angle control to projector unit 22. Control unit 204 on the projector unit 22 side controls the projection angle based on the received setting information for projection angle control. Furthermore, control unit 204 controls each unit involved in image projection to project the image represented by the received image data.

[0167] In step S3106, a process is performed to determine whether or not there is any adjustment of projection control, rotation control, shape control, or projection angle control of the display content due to a user operation. Specifically, control unit 114 executes a process to detect a user operation, and when a user operation is detected, determines whether or not there is any adjustment of projection control, rotation control, shape control, or projection angle control of the display content based on information input by the user. In this determination, if it is determined that there is any adjustment (S1506: Yes), a process is performed to advance the process to step S1507. On the other hand, if it is determined that there is no adjustment (S1506: No), a process is performed to advance the process to step S1508.

[0168] In step S1507, a process for adjusting projection control is performed. Specifically, the control unit 114 adjusts the projection control based on the projection control adjustment information input by the user's operation.

[0169] In step S1508, it is determined whether or not to end projection. Specifically, the control unit 114 checks whether or not a reason for ending projection has occurred. Possible reasons for ending projection include, for example, an error occurring in processing, or a command to end projection being input by a user operation, etc. If a reason for ending projection has occurred, it is determined that projection has ended. If a reason for ending projection has not occurred, it is determined that projection has not ended. In this determination, if it is determined that projection has ended (S3108: Yes), projection is ended. On the other hand, if it is determined that projection has not ended (S3108: No), the control unit 114 returns the processing step to step S1504.

[0170] As described above, the mobile information terminal according to the first embodiment has an image rotation control function, so that when projecting an image as display content, the projected image can be rotated at a rotation angle appropriate for the state of attachment of the mobile information terminal. For example, even if the direction in which the image is projected changes, the horizontality of the image can be maintained. As a result, the visibility of the display content can be improved. In particular, when the display content is shared with persons other than the user, it becomes possible to project the display content with good visibility even for persons other than the user.

[0171] Furthermore, the mobile information terminal according to the first embodiment has an image shape control function, so that when projecting an image as display content, the image can be deformed into a shape suitable for the state of attachment of the mobile information terminal. For example, if the surface of the object onto which the image is projected is tilted with respect to the projection direction, trapezoidal distortion occurs in the image, but such trapezoidal distortion can be corrected. As a result, the visibility of the display content can be improved. In particular, when the display content is shared with persons other than the user, it becomes possible to project the display content with good visibility even for persons other than the user.

[0172] Furthermore, the mobile information terminal according to the first embodiment has a projection angle control function, so that when projecting an image as display content, the projection angle can be corrected to an angle appropriate for the state in which the mobile information terminal is worn. For example, if the surface of the object onto which the image is projected is tilted with respect to the projection direction, trapezoidal distortion occurs in the image, but such trapezoidal distortion can be corrected. As a result, the visibility of the display content can be improved. In particular, when the display content is shared with persons other than the user, the visibility of the display content is improved for persons other than the user as well.

[0173] Furthermore, according to the mobile information terminal of embodiment 1, based on the identified wearing state of the mobile information terminal, the initial setting of projection control is performed that is appropriate for the projection form of the display content that is assumed from the wearing state, thereby further improving the visibility of the projected display content. In particular, when the display content is shared with people other than the user, the visibility of the display content is also improved for people other than the user.

[0174] Furthermore, according to the portable information terminal of embodiment 1, the wearing state of the portable information terminal, i.e., the wearing position, the rotation position of the attachment, and the attitude of the terminal body, can be automatically detected using sensors, and the initial settings for projection control can be performed automatically, which is convenient for the user.

[0175] Furthermore, according to the mobile information terminal of embodiment 1, the attachment is detachable, and in addition to an attachment having a projector function, an attachment having a function other than the projector function, such as an attachment having a camera function, can be attached to the terminal body. With a mobile information terminal configured in this way, the user can use an attachment that is appropriate for the purpose, which is convenient for the user.

[0176] Furthermore, according to the mobile information terminal of embodiment 1, an attachment having a projector function can be rotatably attached to the terminal body. As a result, when projected display content is shared with people other than the user, the display content can be projected in a direction preferred by the user, which is convenient for the user and improves the visibility of the display content for people other than the user.

[0177] (First Modification of the First Embodiment) A first modification of the first embodiment will be described. The mobile information terminal according to the first modification has, as an option for an attachment that can be attached to the terminal body, an attachment provided with a projector unit whose projection port direction is different from the radial direction of the circumference of the bezel unit. The projection port direction is, for example, a tangential direction of the circumference of the bezel unit.

[0178] Fig. 32A is a front view of mobile information terminal 10a according to a first modification of embodiment 1. Fig. 32B is a side view of mobile information terminal 10a. As shown in Figs. 32A and 32B, in mobile information terminal 10a, the projection opening of projector unit 22a in attachment 21A, i.e., the opening through which projection light 10p exits, is formed at one end of projector unit 22a in the longitudinal direction. That is, in mobile information terminal 10a of this example, projection opening direction PA of projector unit 22a is set to the tangent direction of the circumference of bezel part 213.

[0179] FIG. 33 is a diagram illustrating an example of a mobile information terminal 10a. In the example shown in FIG. 33, the mobile information terminal 10a is worn on the outside of the user's left arm LH, and projection light 10p corresponding to an image T4 representing the letters "ABC," which is the display content, is projected from the projector unit 22 onto the back of the user's hand. In this example, the bezel unit 213 is rotated by a rotation angle θd1 to project the image onto the back of the user's left arm LH. In this example, the control unit 114 does not control the rotation of the projected image. That is, an image without rotation correction is projected onto the back of the hand. In this case, the letters "ABC" appear to be tilted to the user.

[0180] Fig. 34 is a diagram showing a modification of the embodiment of the mobile information terminal 10a shown in Fig. 33. In the modification shown in Fig. 34, the control unit 114 detects the rotation angle θd1 of the attachment 21A and corrects the shape of the image based on the rotation angle θd1 so that the letters "ABC" are displayed along the longitudinal direction of the arm. Therefore, with this configuration, the letters "ABC" appear to the user as if they are displayed horizontally, i.e., along the longitudinal direction of the arm, improving the visibility of the projected image.

[0181] Fig. 35 is a diagram showing an example of a setting information table. As shown in Fig. 35, the setting information table is prepared by collecting projection control setting information to be set for each information terminal wearing position, for example. The example shown in Fig. 35 shows setting information table T11 that is applied when the mobile information terminal 10a is worn on the outside of the left arm, setting information table T12 that is applied when the wearing position is on the outside of the right arm, setting information table T13 that is applied when the wearing position is on the inside of the left arm, and setting information table T14 that is applied when the wearing position is on the inside of the right arm. In this embodiment, these setting information tables T11 to T14 are stored in storage 125.

[0182] Fig. 36 is a diagram showing an example of detailed contents of setting information table T11. To facilitate understanding of the table, Fig. 36 shows a representative example of setting information tables T11 to T14. As shown in Fig. 36, in setting information table T11, as combination items, on the premise that the wearing position is "outside" of "left arm", in addition to "attachment rotation position" and "terminal main body attitude", an item for "projection port direction" is provided, and "setting information" corresponding to the combination of these items is associated.

[0183] In this embodiment, the "projection port direction" is information that indicates the direction of the optical axis or the main axis of the projection light 10p emitted from the projection port 25. Options for the "projection port direction" include, for example, the "radial direction" and the "tangential direction" of the circumference of the bezel portion 213.

[0184] (Second Modification of the First Embodiment) A second modification of the first embodiment will be described. The portable information terminal according to the second modification has, as an option for an attachment that can be attached to the terminal body, an attachment that allows the projector unit to rotate relative to the bezel unit. That is, the portable information terminal according to the second modification is configured so that the projection direction of an image can be changed by changing the rotation position of the projector unit.

[0185] Fig. 37A is a front view of mobile information terminal 10b according to a second modified example of embodiment 1. Fig. 37B is a side view of mobile information terminal 10b according to the second modified example of embodiment 1.

[0186] 37A and 37B, mobile information terminal 10b has attachment 21B configured to allow projector unit 22a to rotate relative to bezel unit 213. Attachment 21B has rotation mechanism 229 that allows projector unit 22a to rotate relative to bezel unit 213 about an axis in a direction parallel to the display surface direction of terminal main body 11. Projection opening direction PA of projector unit 22a is the tangent direction to the circumference of bezel unit 213, as in the first modified example.

[0187] In this embodiment, the mounting state of the portable information terminal includes an item of "projector unit rotation angle" in addition to the above-mentioned items. "Projector unit rotation angle" is information that indicates the rotation angle of the projector unit 22a relative to the bezel unit 213, that is, information that indicates the rotation state of the projector unit 22a. The control unit 114 performs initial settings of projection control that are considered appropriate according to a combination of multiple items including the "projector unit rotation angle" as the mounting state of the portable information terminal. In other words, the setting information table is a table that includes the "projector unit rotation angle," which is the rotation state of the projector unit 22a, as one of the items associated with setting information.

[0188] (Embodiment 2) A mobile information terminal according to embodiment 2 will be described. The mobile information terminal according to embodiment 1 has a rotating bezel type attachment, but the mobile information terminal according to embodiment 2 has a terminal connection type attachment. In other words, the projection direction of an image can be changed by changing the connection position of the attachment relative to the terminal body.

[0189] FIG. 38 is a diagram showing a configuration example of a mobile information terminal 10c according to the second embodiment. As shown in FIG. 38, in this example, the mobile information terminal 10c has a terminal main body 11c having an approximately rectangular shape. The terminal main body 11c has a plurality of different connection terminals, and these connection terminals are provided on four sides of the terminal main body 11c, i.e., on the top, bottom, left, and right. An attachment 21C integrated with a projector unit is configured to be insertable into and removable from each of the connection terminals provided on the four sides of the terminal main body 11c, i.e., to be detachable.

[0190] In the example shown in Fig. 38, the projection direction of an image or video from attachment 21C is the same as that shown in Fig. 1. That is, when attachment 21C is attached to terminal main body 11c, an image or video is projected on the side opposite to terminal main body 11c.

[0191] In this configuration, the direction of the projection port is determined by the mounting position of attachment 21C on terminal body 11c. This eliminates the need for pattern detection sensors 12c and 12d for detecting the rotation angle of attachment 21C required to correct the projected image, and for a detection pattern as a rotary encoder on bezel portion 213, thereby simplifying the structure of the mobile information terminal.

[0192] (First Modification of the Second Embodiment) A first modification of the second embodiment will be described. The mobile information terminal according to the first modification has, as an option for an attachment that can be attached to the terminal body, an attachment provided with a projector unit whose projection port direction is different from the radial direction from the center of the terminal body. The projection port direction is, for example, a direction perpendicular to the radial direction from the center of the terminal body.

[0193] Fig. 39 is a diagram showing a mobile information terminal 10d which is a first modified example of the second embodiment. As shown in Fig. 39, in this example, the mobile information terminal 10d has an attachment 21D which is integrated with a projector unit. The projection opening direction PA of the projector unit in the attachment 21D is a direction perpendicular to the radial direction from the center of the terminal body 11, and more specifically, is the longitudinal direction of the attachment 21D. That is, the projection opening of the projector unit of the attachment 21D is formed at one end in the longitudinal direction of the attachment 21D.

[0194] In such a configuration, the projection aperture direction PA is determined by the mounting position of attachment 21D relative to terminal body 11c, as in the example shown in Fig. 38. Therefore, pattern detection sensors 12c and 12d for detecting the rotational position of the attachment required for image correction, a detection pattern as a rotary encoder on attachment 21D, and the like are not required, and the structure of the mobile information terminal can be simplified.

[0195] In the first to third embodiments, the optical projection angle relative to the projector unit has been described as being constant. However, the attachment or the projector unit may be configured so that all or part of the optical system of the projector unit is mechanically variable, and the control unit may control that angle.

[0196] In addition, in the second modified example of the embodiment, an example has been described in which the projector unit is rotatable, and the projection angle can be adjusted by adjusting the angle of rotation. Such a configuration in which the projector unit itself is rotatable can also be applied to other embodiments or other modified examples.

[0197] Furthermore, the mobile information terminals according to the first to third embodiments are equipped with a gyro sensor in their terminal bodies, so that, for example, when a user wears the mobile information terminal on their arm and projects an image or the like onto a wall in front of the user, it is possible to detect the vibration of the user's arm and hand shake, and perform hand shake correction by image processing.

[0198] Furthermore, in the first to third embodiments, an example has been shown in which the electrical connection of power and signals between the terminal body of the mobile information terminal and the attachment is realized using a slip ring and terminals. However, instead of this configuration, the electrical connection of signals, i.e., transmission and reception, may be realized by a proximity wireless connection, or the electrical connection of power may be realized by wireless power supply and the electrical connection of signals may be realized by a proximity wireless connection. With this configuration, the number of sliding parts in the electrical connection can be reduced, thereby reducing mechanical wear and making it easy to achieve a waterproof structure. Furthermore, it is also possible to reduce manufacturing costs.

[0199] In addition, in the first to third embodiments, an example has been shown in which a mobile communication interface is mounted on the main body of a portable information terminal. However, the mobile communication interface may be mounted on a detachable attachment instead of on the main body. Furthermore, attachments having different functions, for example, one having a communication function such as LTE, one having an imaging function, etc., may be prepared. In this way, the user can freely expand the functions of the portable information terminal by acquiring an attachment having the required function later as needed. In other words, the product configuration of the portable information terminal can be made functionally expandable.

[0200] Furthermore, in the first to third embodiments, projection control, i.e., image rotation control, image shape control, and projection angle control, is performed by a control unit on the terminal body side. However, part or all of the projection control may be performed by a control unit on the attachment side. For example, the control unit on the terminal body side may acquire information necessary for the projection control using a sensor or the like and transmit that information to the attachment, and the control unit on the attachment may perform the projection control based on the received information. Also, for example, the control unit on the terminal body side may transmit information about the image to be projected to the attachment, and the control unit on the attachment may acquire information necessary for the projection control using a sensor or the like installed in itself and perform the projection control.

[0201] The above-mentioned embodiments and modified examples have been described in detail to clearly explain the present invention, and are not necessarily limited to those including all of the configurations described. Furthermore, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is possible to add, delete, or replace part of the configuration of each embodiment with other configurations.

[0202] Furthermore, the configurations of the above-described embodiments may be partially or entirely configured in hardware, or may be configured to be realized by executing a program on a processor. Furthermore, the control lines and information lines shown are those considered necessary for explanation, and do not necessarily represent all control lines and information lines in the product. In reality, it may be considered that almost all components are interconnected. [Explanation of symbols]

[0203] 10...mobile information terminal, 10p...projection light, 11...terminal body, 12...casing, 12a...display surface side convex portion, 12b...sensor side convex portion, 12c, 12d...pattern detection sensor, 12e...contact surface on rear surface of bezel on casing side, 13...touch screen portion, 14...mark portion, 15...control board, 16...physical information measurement sensor, 17...belt, 18a to 18d...slip ring, 21...attachment 192...reset button, 204...control unit, 211...first semicircular part, 212...second semicircular part, 213...bezel part, 213a...first light reflecting surface, 213b...second light reflecting surface

Claims

1. A mobile information terminal worn on the arm, The terminal body and an attachment that is attached to the terminal body and is communicably connected to the terminal body; the attachment has a projector unit that projects an image based on image information obtained from the terminal body, and is configured so that a projection port direction of the projector unit is variable with respect to the terminal body; The terminal body has a circumferential edge portion, the attachment is attached to the peripheral portion and configured to be rotatable with respect to the terminal body, The terminal body or the attachment identifies a rotational position of the attachment, the terminal body or the attachment identifies a state of the mobile information terminal including a position of the attachment relative to the terminal body; the terminal body or the attachment controls projection of the image based on the specified state. Mobile information terminal.

2. 2. The portable information terminal according to claim 1, the terminal body or the attachment stores a plurality of different pieces of setting information for the projection control; the terminal body or the attachment reads out the setting information corresponding to the specified state and sets the projection control. Mobile information terminal.

3. 3. The portable information terminal according to claim 2, the projection control includes control of rotation of the image; Mobile information terminal.

4. 3. The portable information terminal according to claim 2, the projection control includes control of the shape of the image; Mobile information terminal.

5. 3. The portable information terminal according to claim 2, the projection control includes control of a projection angle of the image; Mobile information terminal.

6. 3. The portable information terminal according to claim 2, The state of the mobile information terminal includes at least one of a position where the mobile information terminal is worn by a user and an attitude of the terminal body. Mobile information terminal.

7. 3. The portable information terminal according to claim 2, the state of the mobile information terminal includes a mounting position of the mobile information terminal; the terminal body has a sensor that outputs a signal corresponding to acceleration occurring in the terminal body, The terminal body or the attachment identifies whether the terminal body is worn on the left or right arm based on the history of the sensor output as information included in the wearing position. Mobile information terminal.

8. 2. The portable information terminal according to claim 1, The attachment is configured to be detachable from the terminal body. Mobile information terminal.

9. 2. The portable information terminal according to claim 1, the projector unit is configured to be rotatable relative to the attachment, the state of the portable information terminal includes a rotation state of the projector unit, Mobile information terminal.

10. 4. The portable information terminal according to claim 3, The terminal body or the attachment controls the rotation of the image in accordance with the specified state so that the up-down relationship of the image is maintained. Mobile information terminal.

11. 5. The portable information terminal according to claim 4, The terminal body or the attachment controls the shape of the image in accordance with the specified state so as to reduce distortion of the image. Mobile information terminal.

12. A mobile information terminal worn on the arm, The terminal body and an attachment that is attached to the terminal body and is communicably connected to the terminal body; the attachment has a projector unit that projects an image based on image information obtained from the terminal body, and is configured so that a projection port direction of the projector unit is variable with respect to the terminal body; the terminal body has a plurality of different connection terminals to which the attachments are connected, the attachment is connected to any one of the plurality of connection terminals, the terminal body or the attachment identifies the position of the attachment by identifying which of the connection terminals the attachment is connected to; the terminal body or the attachment identifies a state of the mobile information terminal including a position of the attachment relative to the terminal body; the terminal body or the attachment controls projection of the image based on the specified state. Mobile information terminal.

13. 13. The portable information terminal according to claim 12, the terminal body or the attachment stores a plurality of different pieces of setting information for the projection control; the terminal body or the attachment reads out the setting information corresponding to the specified state and sets the projection control. Mobile information terminal.

14. 14. The portable information terminal according to claim 13, the projection control includes control of rotation of the image; Mobile information terminal.

15. 14. The portable information terminal according to claim 13, the projection control includes control of the shape of the image; Mobile information terminal.

16. 14. The portable information terminal according to claim 13, the projection control includes control of a projection angle of the image; Mobile information terminal.

17. A wristwatch-type portable information terminal worn on the wrist, The terminal body and an attachment that is attached to the terminal body and is communicably connected to the terminal body; the attachment has a projector unit that projects an image based on image information obtained from the terminal body, and is configured so that the direction of the projection port of the projector unit is variable with respect to the terminal body, and the terminal body or the attachment identifies the state of the mobile information terminal including the position of the attachment with respect to the terminal body; the terminal body or the attachment controls projection of the image based on the specified state; the projection control includes control of a projection angle of the image; The terminal body or the attachment controls the projection angle of the image so that, when the attachment is positioned such that the projection port direction is 12 o'clock, the image is projected upward from a reference angle, and, when the attachment is positioned such that the projection port direction is 6 o'clock, the image is projected downward from a reference angle. Mobile information terminal.

18. 18. The portable information terminal according to claim 17, the terminal body or the attachment stores a plurality of different pieces of setting information for the projection control; the terminal body or the attachment reads out the setting information corresponding to the specified state and sets the projection control. Mobile information terminal.

19. 19. The portable information terminal according to claim 18, The state of the mobile information terminal includes at least one of a position where the mobile information terminal is worn by a user and an attitude of the terminal body. Mobile information terminal.

20. 19. The portable information terminal according to claim 18, the state of the mobile information terminal includes a mounting position of the mobile information terminal; the terminal body has a sensor that outputs a signal corresponding to acceleration occurring in the terminal body, The terminal body or the attachment identifies whether the terminal body is worn on the left or right arm based on the history of the sensor output as information included in the wearing position. Mobile information terminal.

21. 18. The portable information terminal according to claim 17, the projector unit is configured to be rotatable relative to the attachment, the state of the portable information terminal includes a rotation state of the projector unit, Mobile information terminal.

22. 18. The portable information terminal according to claim 17, the projection control includes control of rotation of the image; The terminal body or the attachment controls the rotation of the image in accordance with the specified state so that the up-down relationship of the image is maintained. Mobile information terminal.

23. 18. The portable information terminal according to claim 17, the projection control includes control of the shape of the image; The terminal body or the attachment controls the shape of the image in accordance with the specified state so as to reduce distortion of the image. Mobile information terminal.

24. A terminal body constituting a mobile information terminal worn on the arm, The terminal body has a circumferential edge portion, a mechanism for attaching an attachment to the peripheral edge portion, the attachment having a projector unit that projects an image and configured so that the projection port direction of the projector unit can be rotated with respect to the terminal body; a communication unit for exchanging information with the attachment; a generating means for generating image information to be transmitted to the attachment via the communication unit; an acquisition means for acquiring information representing a projection port direction including a rotation position from the attachment; editing the image information based on the information acquired by the acquisition means; The device itself.

25. The terminal body according to claim 24, storing setting information for projection control of a plurality of different images, reading out the setting information corresponding to the projection port direction indicated by the acquired information, and editing the image information; The device itself.

26. The terminal body according to claim 24, The editing of the image information includes at least one of image rotation control and image shape control. The device itself.

27. An attachment constituting a mobile information terminal worn on the arm, the portable information terminal has a circumferential edge portion, the device is attached to the peripheral portion of the main body of the portable information terminal and is communicably connected to the main body; a projector unit that projects an image based on image information obtained from the main body, and a projection port direction of the projector unit is configured to be rotatable with respect to the main body; the main body or the attachment identifies a state of the mobile information terminal, including a rotational position of the attachment relative to the main body; the main body or the attachment controls projection of the image based on the specified state. attachment.

28. 28. The attachment of claim 27, the main body or the attachment stores a plurality of different pieces of setting information for the projection control; the main body or the attachment reads out the setting information corresponding to the specified state and sets the projection control. attachment.

29. 28. The attachment of claim 27, the projection control includes at least one of image rotation control, image shape control, and projection angle control; attachment.

Citation Information

Patent Citations

  • Wearable electronic smart watch with projection function

    CN111067206A

  • LED teaching projection clock

    CN206209303U

  • Visual network interaction display device

    CN215991068U

  • Wrist band for cellular phone

    JP2003038217A

  • Mobile terminal having projector function

    JP2007096542A