Input device and display input system

Abstract

The present invention provides an input device and a display input system. The input device includes: a contact body that contacts an object; a pressure sensor that detects the pressure of the contact of the contact body with the object; a vibration device that generates vibrations to give a tactile sensation; and a vibration control unit. The vibration of the vibration device when the pressure detected according to the output of the pressure sensor is large is greater than the vibration of the vibration device when the pressure detected according to the output of the pressure sensor is small.

Description

Technical Field

[0001] The present invention relates to an input device that changes the intensity of vibration according to the output of a sensor that detects an action. In addition, it relates to a display input system including a display device having an image and the input device. Background Art

[0002] An input device is sometimes used for setting and operating a device. Regarding the technology for inputting characters using a device, the following devices are known. Specifically, a brush drawing device is described. The brush drawing device includes a flat plate having a coordinate input surface and a coordinate input unit that inputs coordinates to the coordinate input surface, and performs drawing according to a basic shape of drawing, that is, a locus of a drawing pattern. The brush drawing device has: a coordinate value detection unit that detects coordinate values of coordinates input by the coordinate input unit at regular time intervals; a pressure detection unit that detects the pressure when the coordinate input unit inputs coordinates to the coordinate input surface; a magnification / reduction unit that magnifies or reduces the size of the drawing pattern according to the pressure detected by the pressure detection unit; a movement direction calculation unit that calculates the movement direction of the coordinate input unit according to the coordinate values sequentially detected by the coordinate value detection unit; a drawing pattern rotation unit that rotates the drawing pattern so that the tip portion of the drawing pattern faces the opposite direction of the movement direction calculated by the movement direction calculation unit; a distance interval calculation unit that calculates the adjacent distance intervals of the coordinate values sequentially detected by the coordinate value detection unit; a rotation control unit that controls the drawing pattern rotation unit according to the distance intervals of the coordinate values calculated by the distance interval calculation unit to reduce the rotation amount of the drawing pattern; and a drawing unit that sequentially draws the drawing pattern that has been rotated by the drawing pattern rotation unit or the rotation control unit and has been magnified or reduced by the magnification / reduction unit at the coordinate positions detected by the coordinate value detection unit. By using this flat plate (tablet), natural brush drawing can be reproduced with good texture (refer to Japanese Patent Laid-Open Publication No. 2004-139411).

[0003] Input and operation are sometimes performed using a finger or a tool. For example, a pen is used when writing characters on paper. When a finger or a tool contacts and moves with another object, vibration is transmitted to the hand. For example, when writing characters on paper with a pen, vibration is transmitted from the pen to the hand. In addition, according to the pressure of the contact of the finger or the tool, the magnitude of the vibration transmitted to the hand varies. In order to reproduce the tactile sensation (tactile feeling) when a finger or a tool moves, it is necessary to consider the strength of the vibration. Summary of the Invention

[0004] An object of the present invention is to provide an input device that changes the strength of vibration according to the content of an action, thereby reproducing the tactile sensation when a finger or a tool moves.

[0005] An exemplary input device of the present invention includes: a contact body that contacts an object; a pressure sensor that detects the pressure of the contact of the contact body with the object; a vibration device that generates vibrations to give a tactile sensation; and a vibration control unit that inputs a drive signal to the vibration device to cause the vibration device to operate. The vibration of the vibration device when the pressure detected according to the output of the pressure sensor is large is greater than the vibration of the vibration device when the pressure detected according to the output of the pressure sensor is small.

[0006] Another exemplary input device of the present invention includes: a vibration device that generates vibrations to give a tactile sensation; and a vibration control unit that inputs a drive signal to the vibration device to cause the vibration device to operate. The vibration of the vibration device when the relative position of a stereoscopic display object displayed as a stereoscopic image in the real space to the input device is close or when the relative position of a virtual object to the input device in the virtual reality space is close is greater than the vibration of the vibration device when the relative position of the stereoscopic display object to the input device is far or when the relative position of the virtual object to the input device in the virtual reality space is far.

[0007] In addition, an exemplary display input system of the present invention includes: a display device that displays a stereoscopic image or a virtual reality image; an input device; and a detection unit that detects the position of the input device. The input device includes: a vibration device that generates vibrations to give a tactile sensation; and a vibration control unit that inputs a drive signal to the vibration device to cause the vibration device to operate. The vibration of the vibration device when the relative position of a stereoscopic display object displayed as a stereoscopic image in the real space to the input device is close or when the relative position of a virtual object to the input device in the virtual reality space is close is greater than the vibration of the vibration device when the relative position of the stereoscopic display object to the input device is far or when the relative position of the virtual object to the input device in the virtual reality space is far.

[0008] According to the present invention, the intensity of vibration can be changed according to the content of the action. It is possible to reproduce the touch when moving a finger or a tool.

[0009] From the following detailed description of the preferred embodiments of the present invention, with reference to the accompanying drawings, the above and other features, elements, steps, characteristics and advantages of the present invention can be more clearly understood. Description of the Drawings

[0010] Figure 1This is a diagram showing an example of an input device illustrating an exemplary embodiment of the present invention.

[0011] Figure 2 This is a diagram showing one mode of the first usage example of the input device illustrating an exemplary embodiment of the present invention.

[0012] Figure 3 This is a diagram showing an example of the process of the operation when the input device illustrating an exemplary embodiment of the present invention comes into contact with an object.

[0013] Figure 4 This is a diagram showing an example of a display input system including an input device and a display device for displaying a stereoscopic image.

[0014] Figure 5 This is a diagram showing an example of a display input system including an input device and a display device for displaying a virtual reality image.

[0015] Figure 6 This is a diagram showing an example of a stereoscopic image display device illustrating an exemplary embodiment of the present invention.

[0016] Figure 7 This is a diagram showing an example of a virtual reality image display device illustrating an exemplary embodiment of the present invention.

[0017] Figure 8 This is a diagram showing an example of the process of the operation of the input device illustrating an exemplary embodiment of the present invention.

[0018] Reference Numeral Explanation

[0019] 1: Input device; 11: Vibration device; 12: Pressure sensor; 13: Contact body; 14: Vibration control unit; 15: Storage unit; 16: Communication circuit unit (selection acceptance unit); 19: Movement sensor; 2: Object; 3: Stereoscopic image display device (display device); 30: Stereoscopic image display input system (display input system); 35: Detection unit; 4: Virtual reality image display device (display device); 40: Virtual reality image display input system (display input system); 43: Detection unit; 5: Stereoscopic display object; D1: Vibration mode data; S1: Drive signal. Detailed Embodiment

[0020] Hereinafter, with reference to Figures 1 to 8 , an example of the input device 1 and the display input system of the embodiment of the present invention will be described. The scope of the present invention is not limited to the following embodiments, and can be arbitrarily changed and combined within the scope of the technical idea of the present invention.

[0021] Figure 1This is a diagram showing an example of the input device 1 of the embodiment. The shape of the housing of the input device 1 can be an elongated shape. For example, the housing of the input device 1 can be in the shape of a writing tool (pen). Additionally, the shape of the input device 1 can also be a shape other than a writing tool. For example, the input device 1 can also be a positioning device such as a mouse. Additionally, the input device 1 can also be a device worn by a person (wearable device).

[0022] The input device 1 includes a vibration device 11, a pressure sensor 12, a contact body 13, a vibration control unit 14, a storage unit 15, and a communication circuit unit 16 (selection acceptance unit). The vibration device 11, the pressure sensor 12, the vibration control unit 14, the storage unit 15, and the communication circuit unit 16 are housed inside the housing of the input device 1. Additionally, although not shown, the input device 1 also includes a battery that supplies power to the vibration device 11, the pressure sensor 12, the vibration control unit 14, the storage unit 15, and the communication circuit unit 16.

[0023] The vibration device 11 generates vibrations to give a tactile sensation. That is, the vibration device 11 generates vibrations and applies a tactile sensation to the holder of the input device 1. For example, the vibration device 11 is a vibration motor. For example, the vibration motor can be a motor with an eccentric weight mounted on its shaft. The vibration device 11 can be a device having a piezoelectric element that deforms due to an applied voltage to generate vibrations. The vibration device 11 can be a device that reciprocates a weight linearly (linear actuator).

[0024] The holder brings the contact body 13 of the input device 1 into contact with the object to be contacted (object 2). The contact body 13 contacts the object 2. In the case where the input device 1 is pen-shaped, for example, the contact body 13 is the tip of the pen. The holder brings the contact body 13 into contact with the object 2 and moves the input device 1 while maintaining the contact. Then, the pressure sensor 12 detects the pressure of the contact of the contact body 13 with the object 2. The pressure sensor 12 outputs a value (voltage value) corresponding to the force with which the contact body 13 presses the object 2.

[0025] For example, the vibration control unit 14 includes a controller 17 and a drive circuit 18. The vibration control unit 14 inputs a drive signal S1 to the vibration device 11, causing the vibration device 11 to operate. The vibration control unit 14 controls the magnitude of the vibration. For example, the controller 17 is a Microcontroller Unit. The controller 17 identifies the content of the input operation based on the output of the sensor included in the input device 1. For example, the output of the pressure sensor 12 is input to the controller 17. The controller 17 calculates the pressure with which the contact body 13 presses the object 2 based on the output value of the input pressure sensor 12. The controller 17 gives an instruction of "turn on" / "turn off" of the vibration device 11 to the drive circuit 18. At the time of the "turn on" instruction, the drive circuit 18 generates a drive signal S1 and inputs the drive signal S1 to the vibration device 11. As a result, the vibration device 11 generates vibration.

[0026] For example, the storage unit 15 is a semiconductor memory. The storage unit 15 stores data non-volatilely. The storage unit 15 stores the magnitude of the vibration when the contact body 13 contacts the object 2. In other words, the storage unit 15 stores data (vibration mode data D1) that determines the magnitude of the vibration when contacting the object 2. Moreover, the magnitude of the vibration of the vibration device 11 changes based on the data stored in the storage unit 15 according to the output value of the pressure sensor 12. That is, the vibration control unit 14 refers to the vibration mode data D1 and vibrates the vibration device 11 with a magnitude corresponding to the detected pressure. Thereby, when the input device 1 is moved (input operation), the magnitude of the vibration can be determined according to the output value of the pressure sensor 12. Then, a tactile sensation corresponding to the pressure of the input device 1 is given to the operator. And a tactile sensation when using a finger or a tool can be given to the operator. In addition, a tactile sensation such as contacting the input device 1 with an object (material) different from the object 2 can also be given to the operator.

[0027] The communication circuit unit 16 includes, for example, a wireless communication control circuit, a communication memory, and an antenna. The communication memory stores communication software. For example, the communication circuit unit 16 communicates with a computer 200. The computer 200 can be a PC, a smartphone, or a tablet terminal.

[0028] Also, the input device 1 can house the motion sensor 19. The motion sensor 19 is a sensor that detects the motion of the holder of the input device 1. For example, the motion sensor 19 is a nine-axis sensor. The nine-axis sensor is a sensor that includes a three-axis acceleration sensor, a three-axis angular velocity sensor (gyroscope sensor), and a three-axis orientation sensor (magnetic compass sensor). The acceleration sensor is a sensor that measures the acceleration of the input device 1. The acceleration sensor detects the motion of the input device 1 in three orthogonal axes (three dimensions). The output of the acceleration sensor is input to the controller 17. The angular velocity sensor is a sensor that measures the rotation angle of the input device 1 per unit time. The output of the angular velocity sensor is input to the controller 17. The orientation sensor is a sensor that detects the geomagnetism and thus measures the orientation of the input device 1. The controller 17 performs calculations based on the outputs of the acceleration sensor, the angular velocity sensor, and the orientation sensor. For example, the controller 17 calculates the inclination, moving direction, moving speed, and moving amount of the input device 1.

[0029] Next, a first usage example of the input device 1 will be described. As the first usage example, the usage in which the input device 1 is brought into contact with the object 2 will be described. The object 2 is an object having a physical entity with which the input device 1 comes into contact. Figure 2 This is a diagram showing one aspect of the first usage example of the input device 1 of the embodiment. Figure 2 An example is shown in which the input device 1 is pen-shaped and the object 2 is a tablet terminal (display surface).

[0030] First, the input device 1 can be set. For example, it can be set using the computer 200. For example, an application program for setting the input device 1 is installed in the computer 200. The operator of the input device 1 operates the computer 200 to set the input device 1.

[0031] The computer 200 can be used to select the type (type of the object 2, material) classified according to the characteristics of the object 2. For example, the type of the object 2 can be selected from a plurality of predetermined candidates. Types such as ceramics, glass, rubber, ice, stone, and wood can be selected. Additionally, the type of the object 2 can be selected from a variety of metals such as iron and aluminum. Additionally, the type of the object 2 can be selected from a variety of fabrics such as silk and cotton cloth. Additionally, the type of the object 2 can be selected from a variety of papers such as ordinary paper, Japanese paper, and corrugated paper. Additionally, the type of the object 2 can be selected from a variety of resins. Additionally, the type of the object 2 can be selected from the names of objects such as a notebook and a book. The computer 200 sends data indicating the type of the object 2 selected by the operator to the communication circuit unit 16. The communication circuit unit 16 of the input device 1 receives the data indicating the type of the selected object 2. In this way, it is possible to set what kind of object contacts the input device 1.

[0032] Using the computer 200, the input device 1 can be regarded as a finger or the type of tool regarded as (viewed as) the input device 1 can be selected. The type of finger or tool can be selected from predetermined candidates. The type of finger can also be selected from multiple types. As the type of finger, a finger wearing a wearable device can also be selected. As the type of finger, a finger wrapped with a band can also be selected. The finger can also be selected from five fingers such as the thumb, index finger, middle finger, ring finger, and little finger. Moreover, only one type can be selected as the finger. The tool can also be selected from multiple writing tools such as a pen, a Chinese brush, and a pencil. Tools such as scissors and a cutter can also be selected. The computer 200 sends data indicating the type of finger or tool selected by the operator to the communication circuit unit 16. The communication circuit unit 16 of the input device 1 receives the data indicating the type of the selected finger or tool. In this way, the type of finger or tool for inputting (operating) to the display object can be set. In other words, it is possible to set the input device 1 to reproduce the tactile sensation when which finger contacts the object 2, or to set the input device 1 to reproduce the tactile sensation when which tool contacts.

[0033] Figure 3 It is a diagram showing an example of the process of the operation when the input device 1 of the embodiment contacts the object 2.

[0034] First, the storage unit 15 stores vibration mode data D1. The vibration mode data D1 may also be data representing the mode of vibration for a specified amount of time generated by the vibration device 11. The storage unit 15 stores the vibration mode data D1 for each combination of the type of the object 2 and the type of the finger or tool. In other words, even for the same finger or the same tool, the vibration mode data D1 is determined for each type of the object 2. For example, even for the same finger or the same tool, the vibration mode data D1 for glass is different from the vibration mode data D1 for paper. Also, even if the type of the object 2 is the same, the vibration mode data D1 is determined for each type of the finger or each type of the tool. For example, even if the type of the object 2 is the same, the vibration mode data D1 for a pen is different from the vibration mode data D1 for a cutter.

[0035] For example, the vibration when passing over the object 2 is measured for each type of the finger or each type of the tool and for each type. It is also possible to store the measured vibration or the mode of vibration approximated to the measured vibration as the vibration mode for each combination of the type of the finger or tool and the type of the object 2. The controller 17 of the vibration control unit 14 reads out the vibration mode data D1 corresponding to the selected type of the finger or tool and the type of the object 2 from the storage unit 15. It is also possible that the drive circuit 18 vibrates the vibration device 11 to reproduce the vibration of the read vibration mode data D1. In this case, the drive circuit 18 reproduces the vibration mode included in the vibration mode data D1. For example, the drive circuit 18 makes the intervals and frequencies of the vibrations generated by the vibration device 11 different for each combination of the type of the finger or tool and the type of the object 2.

[0036] In addition, the vibration mode data D1 may also be data determining the mode (waveform) of the drive signal S1 for a specified amount of time. The storage unit 15 may also store different modes of the drive signal S1 for each combination of the type of the object 2 and the type of the finger or tool. For example, the mode of the drive signal S1 is determined in advance in a manner approximated to the vibration received by the hand when passing over the selected object 2 with the selected finger or tool. It is also possible to determine in advance the amplitude of the drive signal S1, the timing of "on" / "off" of the voltage applied to the vibration device 11, the pulse width of the voltage application to the vibration device 11, etc. for each combination of the type of the object 2 and the type of the finger or tool. The controller 17 of the vibration control unit 14 reads out the vibration mode data D1 corresponding to the selected type of the finger or tool and the type of the object 2 from the storage unit 15. The drive circuit 18 generates the drive signal S1 based on the read vibration mode data D1. It is possible to reproduce the vibration received by the hand when passing over the selected object 2 with the selected finger or tool.

[0037] Also, in the combination of the type of a finger or tool and the type of the object 2, different vibration mode data D1 can be determined according to the level (grade) of the magnitude (intensity) of vibration. The vibration mode data D1 can be determined in such a way that the higher (greater) the level during the reproduction of vibration, the greater the vibration. That is, in the combination of the type of a finger or tool and the type of the object 2, a plurality of vibration mode data D1 with different magnitudes of vibration can be determined. For example, when the level of the magnitude of vibration is 10 levels, 10 types of vibration mode data D1 can be determined in the combination of the type of a finger or tool and the type of the object 2. In addition, the number of levels can be more than 10 levels or less than 10 levels.

[0038] Figure 3 The start is the moment when the operation of the input device 1 starts. A switch for "turning on" / "turning off" can also be provided on the input device 1. It can also be capable of operating the computer 200 to switch the input device 1 between "turning on" / "turning off".

[0039] First, the controller 17 determines whether the contact body 13 is in contact with the object 2 based on the output of the pressure sensor 12 (step S11). For example, when the pressure detected based on the output of the pressure sensor 12 is zero or below a specified reference value, the controller 17 can also determine that the contact body 13 is not in contact with the object 2 (the "no" in step S11). In this case, the controller 17 executes step S11 again.

[0040] On the other hand, when the detected pressure is greater than zero or exceeds the specified reference value, the controller 17 determines that the contact body 13 is in contact with the object 2 (the "yes" in step S11). At this time, the controller 17 calculates the magnitude of the pressure at which the contact body 13 is in contact with the object 2 based on the output of the pressure sensor 12 (step S12). Then, the controller 17 determines the level of the intensity of vibration according to the magnitude of the contact pressure (step S13). A corresponding pressure range is predetermined for each level. It can also be that the greater the pressure detected based on the output of the pressure sensor 12, the higher the level of vibration selected by the controller 17. Then, the controller 17 reads out the vibration mode data D1 corresponding to the selected type of finger or tool, corresponding to the object 2, and determined by the level of vibration from the storage unit 15 (step S14).

[0041] Next, the controller 17 determines whether the input device 1 is stationary based on the output of the motion sensor 19 (step S15). For example, when the amount of movement per unit time of the motion sensor 19 is below a prescribed threshold value, the controller 17 determines that the input device 1 is stationary. When the amount of movement per unit time of the motion sensor 19 exceeds the threshold value, the controller 17 determines that the input device 1 is not stationary. Additionally, a device other than the motion sensor 19 may be used to determine whether the input device 1 is stationary. For example, it may be that the object 2 determines the movement of the input device 1 based on the movement information of the input device 1. For example, when the object 2 is a display, it may be that the display recognizes the trajectory of the input device 1 and determines the movement of the input device 1 based on the trajectory.

[0042] When it is determined that the input device 1 is stationary (Yes in step S15), the controller 17 and the drive circuit 18 do not vibrate the vibration device 11 (step S16). Then, the controller 17 executes step S11. In this way, the input device 1 has the motion sensor 19 that detects the movement of the input device 1. Moreover, the vibration device 11 may not vibrate during the period when the input device 1 is stationary. Thereby, when the input device 1 is not moved, the input device 1 does not vibrate. During the period when the operator stops the action, the vibration also stops. For example, in the state where no line is drawn, the vibration stops. On the other hand, when it is determined that the input device 1 is not stationary (moving) (No in step S15), the controller 17 and the drive circuit 18 vibrate the vibration device 11 according to the read vibration pattern data D1 (step S17).

[0043] As a result, the greater the pressure detected by the pressure sensor 12, the greater the vibration generated by the vibration control unit 14 in the vibration device 11. That is, the vibration of the vibration device 11 in the case where the pressure detected based on the output of the pressure sensor 12 is large is greater than the vibration of the vibration device 11 in the case where the pressure detected based on the output of the pressure sensor 12 is small. Thus, according to the pressure when the input device 1 contacts the object 2, the vibration of the vibration device 11 has intensity. Therefore, different tactile sensations can be given to the operator according to the contact pressure of the input device 1. That is, an input device 1 can be provided that not only vibrates simply but also gives various tactile sensations according to the processing method. Here, in the case of a strong stroke and a weak stroke, the vibration received in the case of a strong stroke becomes larger. For example, when using a pen, in most cases, the higher the pen pressure, the greater the vibration returned to the hand. Therefore, the tactile sensation when the input device 1 contacts the object 2 can be emphasized.

[0044] Here, even if the detected pressure is the same as the type of the selected finger or the type of the tool, the vibration mode data D1 varies according to the type of the selected object 2. Therefore, the vibration of the vibration device 11 varies according to the type classified according to the characteristics of the object 2. Thus, the vibration mode can be changed according to the type of the object 2. For example, when contacting cloth and when contacting paper, the vibration mode of the input device 1 changes. Therefore, vibrations conforming to the type and material of the object 2 can be generated. Further, the input device 1 has a selection reception unit that receives the selection of the type of the object 2. The selection reception unit is, for example, the communication circuit unit 16. The vibration control unit 14 causes the vibration device 11 to generate different vibrations according to the type of the selected object 2. That is, the vibration of the vibration device 11 varies according to the type of the selected object 2. The operator of the input device 1 selects the type of the object 2. Thus, vibrations conforming to the contacted object 2 can be generated. That is, vibrations the same as when contacting or swiping across the object 2 can be generated.

[0045] For example, when Figure 2 the surface of the display of the tablet terminal shown is glass, the input device 1 (vibration device 11) can also generate vibrations that reproduce the vibrations when swiping across glass. Further, when the display of the tablet terminal displays paper, the input device 1 (vibration device 11) can also generate vibrations that reproduce the vibrations when swiping across paper.

[0046] Specifically, the frequency of the vibration of the vibration device 11 can also vary according to the type of the selected object 2. The vibration mode data D1 can also be data in which the frequency of the vibration varies according to the type of the selected object 2. The frequency of the vibration when swiping across an object with a smooth surface is lower than the frequency of the vibration when swiping across an object with a rough surface. It can also be that the frequency of the vibration of the input device 1 varies according to the smoothness of the surface of the object 2.

[0047] Moreover, even if the detected pressure is the same as the type of the selected object 2, the vibration mode data D1 varies depending on the type of the selected finger or tool. Therefore, the vibration of the vibration device 11 varies depending on the type of the finger or tool. Thereby, vibrations corresponding to the type of the finger or tool can be generated. Accordingly, when using the input device 1, a tactile sensation as if a finger or tool is swiped across the object 2 is obtained. Further, the selection acceptance unit (communication circuit unit 16) of the input device 1 accepts the selection of the type of the finger or tool. The vibration control unit 14 causes the vibration device 11 to generate different vibrations depending on the type of the selected finger or tool. That is, the vibration of the vibration device 11 varies depending on the type of the selected finger or tool. In addition, the operator of the input device 1 selects which finger or which tool the input device 1 is regarded as. Moreover, through the vibration of the input device 1, a tactile sensation as if the selected finger or the selected tool is used is obtained. For example, when the input device 1 is regarded as a pencil, the vibration device 11 may generate vibrations that reproduce the vibrations received by the hand from the pencil.

[0048] After the vibration starts, the controller 17 determines whether the input device 1 has stopped based on the output of the movement sensor 19 (step S18). When it is determined that the input device 1 has stopped (Yes in step S18), the controller 17 and the drive circuit 18 stop the vibration of the vibration device 11 (step S19). Further, the controller 17 proceeds to step S11. Alternatively, it may be determined whether the input device 1 has stopped by a device other than the movement sensor. As described above, for example, it may be determined whether the input device 1 has moved by the object 2.

[0049] When the input device 1 is not stopped (is moving) (No in step S18), the controller 17 determines whether the contact body 13 is in contact with the object 2 based on the output of the pressure sensor 12 (step S110). When it is determined that there is no contact (No in step S110), the controller 17 and the drive circuit 18 stop the vibration of the vibration device 11 (step S19). Then, the controller 17 proceeds to step S11. When it is determined that there is contact (Yes in step S110), the controller 17 and the drive circuit 18 continue the vibration of the vibration device 11 (step S111). Then, the controller 17 performs the process of step S18.

[0050] The input device 1 includes a motion sensor 19 that detects the motion of the input device 1. Moreover, even when the motion speed changes during the motion of the input device 1, the vibration device 11 can keep the frequency of vibration constant. In other words, even when the motion speed changes during the motion of the input device 1, the vibration control unit 14 can cause the vibration device 11 to vibrate at a constant frequency. The vibration control of the input device 1 becomes easy. The vibration control unit 14 may also not be a complex circuit. Even with a simple configuration, a haptic effect is obtained.

[0051] In addition, during the vibration of the vibration device 11, when the pressure detected by the pressure sensor 12 changes, the vibration device 11 can also change the magnitude (level) of the vibration. In other words, when the pressure changes, the vibration control unit 14 can also change the magnitude of the vibration of the vibration device 11. For example, the controller 17 selects new vibration mode data D1 according to the changed pressure.

[0052] Next, a second usage example of the input device 1 will be described. As the second usage example, the input device 1 for input to a display object without a physical entity will be described. In addition, as the second usage example, a display input system including a display device that displays a stereoscopic image or a virtual reality image, the input device 1, and a detection unit that detects the position of the input device 1 will be described. Figure 4 、 Figure 5 A second usage example of the input device 1 according to the embodiment is shown. Figure 4 An example of a display input system including the input device 1 and a display device that displays a stereoscopic image is shown. Figure 5 An example of a display input system including the input device 1 and a display device (head-mounted display) that displays a virtual reality image is shown. The display device combined with the input device 1 may be a display device that displays a stereoscopic image in the actual space or a display device that displays a virtual reality image.

[0053] In the following description, the display device that displays a stereoscopic image is referred to as the stereoscopic image display device 3. The display input system having the stereoscopic image display device 3 and the input device 1 is referred to as the stereoscopic image display input system 30. The display device that displays a virtual reality image is referred to as the virtual reality image display device 4. The display input system having the virtual reality image display device 4 and the input device 1 is referred to as the virtual reality image display input system 40. In addition, in the stereoscopic image displayed by the stereoscopic image display device 3, the displayed object is referred to as the stereoscopic display object 5. The virtual object that is displayed in the virtual reality image configured in the virtual reality space and displayed by the virtual reality image display device 4 is referred to as a virtual object. And hereinafter, the stereoscopic display object 5 and the virtual object may sometimes be collectively referred to as a display object.

[0054] In addition, the input device 1 in the second usage example (display input system) may also be the same as the input device 1 described in the first usage example. On the other hand, the display object is not an actual object. Therefore, the input device 1 in the second usage example (display input system) may also not have the pressure sensor 12 and the contact body 13.

[0055] Figure 6 FIG. is a diagram showing an example of the stereoscopic image display device 3 of the embodiment. The stereoscopic image display device 3 includes a light source 31, a lens 32, a phase modulation device 33, and an information processing device 34. The stereoscopic image display input system 30 includes an input device 1, the stereoscopic image display device 3, and a detection unit 35. The information processing device 34 is, for example, a PC and has a processor.

[0056] The light source 31 is a light source 31 for displaying a stereoscopic image (stereoscopic display object 5). As the light source 31, a laser irradiation device or an LED can be used. The light source 31 may also be plural. For example, the stereoscopic image display device 3 may have light sources 31 in the colors of R, G, and B. The lens 32 makes the light emitted from the light source 31 parallel. In order to display the stereoscopic display object 5, the phase modulation device 33 diffracts the light from the light source 31. By diffracting the light from the light source 31 by the phase modulation device 33, the stereoscopic display object 5 is displayed in the space on the side opposite to the light incident surface. The information processing device 34 generates holographic data and provides it to the phase modulation device 33. The phase modulation device 33 diffracts the light according to the provided holographic data, thereby reproducing the stereoscopic display object 5 based on the holographic data. For example, when holographic data for reproducing a star is sent to the phase modulation device 33, the star is displayed as the stereoscopic display object 5 (holographic image).

[0057] As Figure 4As shown, the stereoscopic image display device 3 has a plurality of cameras as the detection unit 35. For example, the cameras are provided around the stereoscopic image display device 3. The photographic data obtained by photographing with each camera can also be sent to the information processing device 34. The information processing device 34 can also calculate and determine the positions (coordinates) of the stereoscopic display object 5 and the input device 1 in the actual space based on the parallax of the object reflected in the photographic data of each camera. In addition, the information processing device 34 can also communicate with the communication circuit unit 16 of the input device 1. For example, the communication circuit unit 16 of the input device 1 can send the output value of the motion sensor 19 to the information processing device 34. Thus, the information processing device 34 can also obtain the position of the input device 1 after movement. In addition, the detection unit 35 can also be the same device as the stereoscopic image display device 3. For example, the detection unit 35 can be installed in the information processing device 34. Since the detection unit 35 is integrated with the stereoscopic image display device 3, the structure of the display device becomes simple. Moreover, the detection unit 35 can also be a device other than a camera such as an infrared sensor. For example, the detection unit 35 can be a LiDAR or a ToF sensor (infrared laser and camera).

[0058] Figure 7 FIG. is an example of a virtual reality image display device 4 showing an embodiment. First, the virtual reality image display device 4 has an information processing device 41 and a wearing part 42. The virtual reality image display input system 40 has an input device 1, a virtual reality image display device 4, and a detection unit 43. The information processing device 41 is, for example, a PC and has a processor. The information processing device 41 is a device that provides the data of the image displayed by the wearing part 42. For example, the information processing device 41 provides the data of the image for the left eye and the data of the image for the right eye. As Figure 7 shown, the information processing device 41 may also include a control unit 44, a storage device 45, and a first interface 46. The control unit 44 includes at least one processor (CPU). The control unit 44 executes the program stored in the storage device 45. The storage device 45 includes a RAM, a ROM, and a memory. The first interface 46 is an interface circuit for data communication with the wearing part 42.

[0059] The wearing part 42 has a second interface 47. The second interface 47 is an interface circuit for data communication with the information processing device 41. The first interface 46 performs wired or wireless communication with the second interface 47. For example, the first interface 46 sends the data of the image provided by the information processing device 41 and the control signal to the second interface 47. In addition, the second interface 47 sends various information to the first interface 46.

[0060] The wearing part 42 is worn on the user's head. The wearing part 42 includes an image display part 48 and a motion sensor 49. The image display part 48 is an organic EL display panel or a liquid crystal display panel. The wearing part 42 (image display part 48) forms an image in front of each of the wearer's left and right eyes, thereby displaying a stereoscopic virtual reality image obtained by binocular parallax. The image display part 48 displays an image according to the image data provided from the information processing device 41. The image display part 48 displays an image for the left eye and an image for the right eye. As a result, the image for the left eye is incident on the wearer's left eye. The image for the right eye is incident on the wearer's right eye. In addition, the image display part 48 may also be a retinal irradiation type display element that directly projects an image onto the user's retina.

[0061] The wearing part 42 may also have a plurality of cameras as the detection part 43. That is, the detection part 35 may be the same device as the virtual reality image display device 4. Since the detection part is integrated with the virtual reality image display device 4, the structure of the virtual reality image display device 4 becomes simple. For example, the cameras are arranged in the left-right direction. In addition, the cameras may also be provided outside the wearing part 42. As Figure 5 shown, the detection part 43 (camera) may also be provided on the wall of the room. The photographic data obtained by photographing with each camera may also be sent to the information processing device 41. The information processing device 41 may also calculate the position of the wearing part 42 and the input device 1 and the distance from the input device 1 to the wearing part 42 according to the parallax of the input device 1 reflected in the photographic data of each camera. In addition, the detection part 43 may also be a device other than a camera such as an infrared sensor. For example, the detection part 43 may be a LiDAR or a ToF sensor (infrared laser and camera). The motion sensor 49 is a sensor that measures the inclination, orientation, and motion of the wearer's head (wearing part 42).

[0062] The information processing device 41 virtually arranges virtual objects (objects), a left-eye viewpoint camera, and a right-eye viewpoint camera in the virtual space. The information processing device 41 generates data of an image obtained by observing the virtual space from the left-eye viewpoint camera as data of the left-eye image. In addition, it generates data of an image obtained by observing the virtual space from the right-eye viewpoint camera as data of the right-eye image. When a virtual object is arranged in the virtual space, it appears that the virtual object exists in the virtual reality image displayed in the wearer's field of view. For example, when the virtual object is a table, it appears that there is a table. In addition, the information processing device 41 can arrange the input device 1 in the virtual space according to the position (coordinates) of the input device 1 identified from the photographic data using multiple detection units 43 (cameras). In addition, the information processing device 41 can arrange the input device 1 according to the data of the left-eye image and the data of the right-eye image. As a result, the input device 1 is displayed as a virtual reality image.

[0063] In addition, the information processing device 41 may communicate with the communication circuit unit 16 of the input device 1. For example, the communication circuit unit 16 of the input device 1 may send the output value of the motion sensor 19 to the information processing device 34. The information processing device 41 may move the position (coordinates) of the input device 1 in the virtual space in accordance with the movement of the input device 1 in the real space.

[0064] The setting of the input device 1 can be performed using the computer 200 (refer to Figure 1 ). In the stereoscopic image display input system 30, the computer 200 may be the information processing device 34. In the virtual reality image display input system 40, the computer 200 may be the information processing device 41. The setting of the input device 1 may be performed using a computer 200 other than the information processing device 34 and the information processing device 41.

[0065] The computer 200 can be used to select a type classified according to the characteristics of the physical object of the three-dimensional display object 5 or a type classified according to the characteristics of the physical object of the virtual object (type of the display object, material). For example, the type of the display object can be selected from predetermined candidates. For example, types such as ceramics, glass, rubber, ice, stone, and wood can also be selected. In addition, types can be selected from multiple metals such as iron and aluminum. In addition, types can be selected from multiple fabrics such as silk and cotton cloth. In addition, types can be selected from multiple papers such as ordinary paper, Japanese paper, and corrugated paper. In addition, types can be selected from multiple resins. In addition, types can be selected from the names of objects such as notebooks and books. The computer 200 sends data representing the type of the display object selected by the operator to the communication circuit unit 16. The communication circuit unit 16 of the input device 1 receives the data representing the selected type of the display object. In this way, the type of the entityless object to be displayed can be set.

[0066] In addition, by using the computer 200, the input device 1 can be regarded as a finger, or the type of tool regarded as (viewed as) the input device 1 can be selected. The type of finger or tool can be selected from predetermined candidates. The type of finger can also be selected from multiple types. As the type of finger, a finger wearing a wearable device can also be selected. As the type of finger, a finger wrapped with a band can also be selected. The finger can also be selected from five fingers such as the thumb, index finger, middle finger, ring finger, and little finger. In addition, only one type can be selected as the finger. In addition, tools can be selected from multiple writing tools such as a writing brush, pen, pencil, and crayon. Tools such as scissors and cutters can also be selected. The computer 200 sends data representing the type of finger or tool selected by the operator to the communication circuit unit 16. The communication circuit unit 16 of the input device 1 receives the data representing the selected type of finger or tool. In this way, the type of finger or tool used to input (operate) the display object can be set. In other words, it is possible to set which finger's tactile sensation when contacting the physical object of the display object the input device 1 reproduces, or which tool's tactile sensation when contacting the physical object of the display object the input device 1 reproduces.

[0067] Figure 8FIG. is an example of a flowchart showing the operation of the input device 1 according to an embodiment. First, even in the input device 1 for inputting a display object, the storage unit 15 stores vibration mode data D1. That is, the storage unit 15 of the input device 1 stores the magnitude of vibration corresponding to the relative position between the stereoscopic display object 5 and the input device 1 or the relative position between the input device 1 and the virtual object in the virtual reality space. In other words, the storage unit 15 stores data (vibration mode data D1) that determines the magnitude of vibration corresponding to the relative position between the stereoscopic display object 5 and the input device 1 or the magnitude of vibration corresponding to the relative position between the input device 1 and the virtual object in the virtual reality space. Moreover, the magnitude of the vibration of the vibration device 11 changes based on the data stored in the storage unit 15 according to the relative position between the stereoscopic display object 5 and the input device 1 or the relative position between the virtual object and the input device 1 in the virtual reality space. That is, the vibration control unit 14 refers to the vibration mode data D1 and causes the vibration device 11 to vibrate with a magnitude corresponding to the relative position between the display object and the input device 1. Thus, when the input device 1 is moved (input operation), the magnitude of the vibration can be determined based on the data in the storage unit 15. In addition, a tactile perception corresponding to the movement of the input device 1 is given to the operator. That is, a vibration corresponding to the content of the movement of the input device 1 is given to the operator.

[0068] The vibration mode data D1 may also be data representing the mode of vibration of a predetermined time amount generated by the vibration device 11. The storage unit 15 stores the vibration mode data D1 for each combination of the type of the display object and the type of the finger or tool. This is the same as the input device 1 described in the first usage example. The controller 17 reads out the vibration mode data D1 corresponding to the selected finger or tool and the display object from the storage unit 15. It may also be that the drive circuit 18 causes the vibration device 11 to vibrate to reproduce the vibration of the read vibration mode data D1. In this case, the drive circuit 18 reproduces the vibration mode included in the vibration mode data D1. For example, the drive circuit 18 makes the intervals, frequencies, and amplitudes of the vibrations generated by the vibration device 11 different for each combination of the type of the finger or tool and the type of the display object.

[0069] In addition, the vibration mode data D1 can also be data that determines the mode (waveform) of the drive signal S1 for a specified amount of time. As parameters of the mode (waveform), there are amplitude, frequency, "on" time, "off" time, etc. The storage unit 15 can also store different drive signal S1 modes for each combination of the type of the display object and the type of the finger or tool. For example, the drive signal S1 mode is determined in advance in a manner approximating the vibration received by the hand when the selected finger or tool is swiped across the selected display object. For example, the amplitude of the drive signal S1, the timing of "on" / "off" of the voltage applied to the vibration device 11, the pulse width of the voltage application to the vibration device 11, etc. can be determined in advance for each combination of the type of the display object and the type of the finger or tool. The controller 17 of the vibration control unit 14 reads out the vibration mode data D1 corresponding to the selected finger or tool and the selected display object from the storage unit 15. The drive circuit 18 generates the drive signal S1 based on the read vibration mode data D1. It is possible to reproduce the vibration received by the hand when the physical object of the selected finger or tool is swiped across the selected display object.

[0070] Moreover, in a combination of one finger or tool and the type of the display object, different vibration mode data D1 can be determined according to the level (grade) of the vibration magnitude (intensity). The vibration mode data D1 can be determined such that the higher (greater) the level, the greater the vibration. That is, in a combination of one finger or tool and the type of the display object, multiple vibration mode data D1 can be determined according to the level of the vibration magnitude. For example, when the level of the vibration magnitude is 10 levels, 10 kinds of vibration mode data D1 can be determined in a combination of one finger or tool and the type of the display object. In addition, the number of levels can be more than 10 levels or less than 10 levels.

[0071] Figure 8 The start is the moment when the operation of the input device 1 starts. A switch for performing "on" / "off" can also be provided on the input device 1. In addition, it is also possible to operate the computer 200 to switch the "on" / "off" of the input device 1.

[0072] First, the controller 17 identifies the positional relationship between the input device 1 and the display object (step S21). In the case of the stereoscopic image display input system 30, the controller 17 identifies the positional relationship between the stereoscopic display object 5 (display object) and the input device 1 in the actual space. For example, the information processing device 34 identifies the position (coordinates) of the input device 1 and the position (coordinates) of the stereoscopic display object 5 in the actual space based on the photographic data output from the detection unit (camera). The information processing device 34 can also use the output of the position sensor to identify the position of the input device 1. For example, the coordinates are three-dimensional, and the input device 1 and the stereoscopic display object 5 occupy a certain space. The information processing device 34 sends the identification result to the communication circuit unit 16 of the input device 1. The controller 17 identifies the positional relationship between the input device 1 and the stereoscopic display object 5 in the actual space based on the data received by the communication circuit unit 16. The information processing device 34 periodically sends data representing the position (coordinates) of the input device 1 and the position (coordinates) of the stereoscopic display object 5.

[0073] In the case of the virtual reality image display input system 40, the positional relationship between the virtual object in the virtual space and the input device 1 is identified. For example, the information processing device 41 can also identify the position of the input device 1 based on the photographic data output from the detection unit (camera). The information processing device 41 can also use the output of the position sensor to identify the position of the input device 1. Then, the information processing device 41 assigns a position (coordinates) in the virtual space to the input device 1 based on the identified position of the input device 1. The information processing device 41 also assigns positions (coordinates) to the virtual objects (display objects) in the virtual space. For example, the coordinates of the input device 1 and the virtual object are three-dimensional. The input device 1 and the virtual object occupy a certain space in the virtual space. The information processing device 41 sends the identification result to the communication circuit unit 16 of the input device 1. The controller 17 identifies the positional relationship between the input device 1 and the virtual object in the virtual space based on the data received by the communication circuit unit 16. The information processing device 41 periodically sends data representing the position (coordinates) of the input device 1 and the position (coordinates) of the virtual object in the virtual space.

[0074] Moreover, the controller 17 determines whether the display object and the input device 1 are in contact based on the identified positional relationship (step S22). In the case of the stereoscopic image display input system 30, when the position (coordinates) of the input device 1 overlaps with the position (coordinates) of the stereoscopic display object 5, the controller 17 can also determine that in the actual space, the stereoscopic display object 5 is in contact with the input device 1. Additionally, when the position (coordinates) of the input device 1 does not overlap with the position (coordinates) of the stereoscopic display object 5, the controller 17 determines that in the actual space, the stereoscopic display object 5 is not in contact with the input device 1.

[0075] In the case of the virtual reality image display input system 40, in the virtual space, when the position (coordinates) of the input device 1 overlaps with the position (coordinates) of the virtual object, the controller 17 may also determine that the virtual object is in contact with the input device 1. Further, in the virtual space, when the position (coordinates) of the input device 1 does not overlap with the position (coordinates) of the virtual object, the controller 17 may also determine that the virtual object is not in contact with the input device 1.

[0076] In the real space or the virtual space, when it is determined that the display object is not in contact with the input device 1 (No in step S22), the controller 17 executes step S11 again. On the other hand, in the real space or the virtual space, when it is determined that the display object is in contact with the input device 1 (Yes in step 22), the controller 17 obtains the level of the depth of contact between the input device 1 and the display object (step S23).

[0077] In the case of the stereoscopic image display input system 30, for example, the controller 17 may also obtain the volume of the portion of the input device 1 that overlaps with the stereoscopic display object 5 based on the coordinates of the stereoscopic display object 5 and the coordinates of the input device 1. It may also be that the larger the obtained volume, the deeper the controller 17 determines that the input device 1 is in contact with the display object. For example, the range of the volume is determined in advance according to the level of the depth of contact. The controller 17 may also obtain the level of the depth of contact of the input device 1 based on the obtained volume.

[0078] Further, in the case of the virtual reality image display input system 40, for example, the controller 17 may also obtain the volume of the portion of the input device 1 that overlaps with the virtual object in the virtual space based on the coordinates of the virtual object in the virtual space and the coordinates of the input device 1. It may also be that the larger the obtained volume, the deeper the controller 17 determines that the input device 1 is in contact with the display object. The controller 17 may also obtain the level of the depth of contact of the input device 1 based on the obtained volume.

[0079] The controller 17 determines the level of the intensity of vibration according to the level of the depth of contact (step S24). In the present embodiment, the level of the intensity of vibration corresponding to the level of the depth of contact is determined in advance. The deeper the contact, the larger the vibration level selected by the controller 17. Then, the controller 17 selects the vibration mode data D1 of the selected vibration level corresponding to the selected finger or tool and the display object (step S25).

[0080] Next, the controller 17 determines whether the input device 1 is stationary based on the output of the motion sensor 19 (step S26). For example, when the amount of movement per unit time of the motion sensor 19 is equal to or less than the threshold value, the controller 17 determines that the input device 1 is stationary. When the amount of movement per unit time of the motion sensor 19 exceeds the threshold value, the controller 17 determines that the input device 1 is not stationary.

[0081] When it is determined that the input device 1 is stationary (Yes in step S26), the controller 17 and the drive circuit 18 do not vibrate the vibration device 11 (step S27). Then, the process returns to step S21. In the input device 1 and the display input system, the input device 1 has a motion sensor 19 that detects the movement of the input device 1. Also, the vibration device 11 may not vibrate during the period when the input device 1 is stationary. Thus, when the input device 1 is not moved, the input device 1 does not vibrate. During the period when the operator stops the action, the vibration also stops. For example, in a state where the input device 1 is not used to draw a line, the vibration stops.

[0082] On the other hand, when it is determined that the input device 1 is moving (No in step S26), the controller 17 and the drive circuit 18 vibrate the vibration device 11 according to the read vibration mode data D1 (step S28). As a result, the closer the relative position of the display object and the input device 1 is, the greater the vibration generated by the vibration device 11 is. That is, in the input device 1 and the display input system, the vibration of the vibration device 11 is greater when the relative position of the stereoscopic display object 5 displayed as a stereoscopic image in the real space and the input device 1 is closer or when the relative position of the virtual object and the input device 1 in the virtual reality space is closer than when the relative position of the stereoscopic display object 5 and the input device 1 in the real space is farther or when the relative position of the virtual object and the input device 1 in the virtual reality space is farther. Thus, according to the position difference (distance) between the input device 1 and the stereoscopic display object 5 displayed as a stereoscopic image, the vibration of the vibration device 11 has intensity. In addition, according to the position difference (distance) between the position of the input device 1 in the virtual space and the position of the virtual reality image, the vibration of the vibration device 11 has intensity. Therefore, different tactile sensations can be given to the operator according to the position (distance) between the input device 1 and the object. An input device 1 that can provide various tactile sensations according to the processing method as well as simply vibrating can be provided.

[0083] Here, even if the relative positions and the selected finger or tool are the same, the vibration pattern data D1 varies according to the type of the selected display object. Therefore, the vibration of the vibration device 11 varies according to the type classified according to the characteristics of the physical object of the three-dimensional display object 5 or the type classified according to the characteristics of the physical object of the virtual object. Also, the input device 1 has a selection reception unit that receives the selection of the type of the three-dimensional display object 5 or the type of the virtual object. The selection reception unit is, for example, the communication circuit unit 16. The vibration control unit 14 causes the vibration device 11 to generate different vibrations according to the type of the selected display object. That is, the vibration of the vibration device 11 varies according to the selected type. Thus, it is possible to change the vibration mode according to the physical type and material of the display object. For example, when the display object is cloth and when the display object is paper, the vibration mode of the input device 1 changes. Therefore, it is possible to generate vibrations that match the material of the physical object of the display object. Moreover, the operator of the input device 1 can select the physical type of the display object. Therefore, it is possible to reproduce the vibration when contacting the physical object of the display object. That is, the same tactile sensation as when sliding across the physical object of the display object is obtained.

[0084] For example, when the three-dimensional display object 5 is a tablet terminal, the input device 1 (vibration device 11) may also generate vibrations that reproduce the vibrations when sliding across glass. Additionally, when the virtual object is paper, the input device 1 (vibration device 11) may also generate vibrations that reproduce the vibrations when sliding across paper.

[0085] For example, the frequency of the vibration of the vibration device 11 may also vary according to the type of the selected display object. The vibration pattern data D1 may also be data in which the frequency of the vibration varies according to the type of the selected display object. The frequency of the vibration when sliding across an object with a smooth surface is lower than the frequency of the vibration when sliding across an object with a rough surface. The frequency of the vibration of the input device 1 changes according to the smoothness of the surface of the physical object of the display object.

[0086] Also, even if the relative positions and the types of the displayed objects are the same, the vibration mode data D1 varies according to the type of the selected finger or the type of the tool. Therefore, the vibration of the vibration device 11 varies according to the type of the finger or the tool. Also, the selection reception unit of the input device 1 receives the selection of the type of the finger or the tool. The selection reception unit is, for example, the communication circuit unit 16. The vibration control unit 14 causes the vibration device 11 to generate different vibrations according to the type of the selected finger or the tool. That is, the vibration of the vibration device 11 varies according to the type of the selected finger or the tool. Thereby, vibrations corresponding to the type of the finger or the tool can be generated. Therefore, when using the input device 1, a tactile sensation as if a finger or a tool is swiped across the displayed object in reality can be obtained. Moreover, the operator of the input device 1 selects which finger or which tool the input device 1 is regarded as. Then, through the vibration of the input device 1, a tactile sensation as if the selected finger or tool is used can be obtained. For example, when the input device 1 is regarded as a cutter, the input device 1 (vibration device 11) may generate vibrations that reproduce the vibrations when a cutter is swiped across the displayed object in reality.

[0087] After the vibration starts, the controller 17 determines whether the input device 1 has stopped based on the output of the motion sensor 19 (step S29). When it is determined that the input device 1 has stopped (Yes in step S29), the controller 17 and the drive circuit 18 stop the vibration of the vibration device 11 (step S210). Then, the controller 17 proceeds to step S21 (returns to step S21).

[0088] When the input device 1 is not stopped (is in motion) (No in step S29), similar to step S22, the controller 17 determines whether the displayed object is in contact with the input device 1 (step S211). When it is determined that the three-dimensional displayed object 5 is not in contact with the input device 1 in the actual space or the virtual object is not in contact with the input device 1 in the virtual space (No in step S211), the controller 17 and the drive circuit 18 stop the vibration of the vibration device 11 (step S210). Then, the controller 17 proceeds to step S21 (returns to step S21). When it is determined that the displayed object is in contact with the input device 1 (Yes in step S211), the controller 17 and the drive circuit 18 continue the vibration of the vibration device 11 (step S212). Then, the controller 17 performs the process of step S29.

[0089] In a display input system, an input device 1 includes a motion sensor 19 that detects the motion of the input device 1. Moreover, even when the motion speed changes during the motion of the input device 1, the vibration device 11 can maintain the frequency of vibration as constant. In other words, even when the motion speed changes during the motion of the input device 1, the vibration control unit 14 can cause the vibration device 11 to vibrate at a constant frequency. The vibration control of the input device 1 becomes easy. The vibration control unit 14 may not be a complex circuit either. Even a simple structure can achieve a haptic effect.

[0090] In addition, in a display input system, during the period when the input device 1 moves and the vibration device 11 vibrates, when the relative position of the three-dimensional display object 5 and the input device 1 or the relative position of the virtual object and the input device 1 in the virtual space changes, the vibration device 11 can also change the magnitude (level) of vibration. When recognizing the change in the relative position between the input device 1 and the image, the vibration control unit 14 can also change the magnitude of vibration of the vibration device 11. For example, the controller 17 selects new vibration mode data D1 according to the level of the changed contact depth.

[0091] The embodiments and modification examples of the present invention have been described, but each structure and their combinations in the embodiments and modification examples are just examples. Additions, omissions, replacements, and other changes to the structure can be made without departing from the gist of the present invention. In addition, the present invention is not limited by the embodiments.

[0092] The present invention can be used for an input device and a display input system having the input device.

Claims

1. An input device having: a contact body that contacts an object; a pressure sensor that detects the pressure of the contact of the contact body with the object; a vibration device that generates vibration to give a tactile sensation; and a vibration control unit that inputs a drive signal to the vibration device to cause the vibration device to operate, wherein when the pressure detected based on the output of the pressure sensor is large, the vibration of the vibration device is greater than when the pressure detected based on the output of the pressure sensor is small, the input device further has a selection reception unit that receives selection of the type of a finger or a tool, the vibration of the vibration device varies according to the selected type of the finger or the tool, and the drive circuit of the vibration control unit varies the interval and frequency of the vibration generated by the vibration device for each combination of the type of the finger or the tool and the type of the object.

2. The input device according to claim 1, wherein the input device has a storage unit that stores the magnitude of vibration when the contact body contacts the object, the magnitude of the vibration of the vibration device varies based on the data stored in the storage unit according to the output value of the pressure sensor.

3. The input device according to claim 1 or 2, wherein the vibration of the vibration device varies according to the type classified according to the characteristics of the object.

4. The input device according to claim 3, wherein the input device has a selection reception unit that receives selection of the type of the object, the vibration of the vibration device varies according to the selected type of the object.

5. The input device according to claim 4, wherein the frequency of the vibration of the vibration device varies according to the selected type of the object.

6. The input device according to claim 1 or 2, wherein the input device has a movement sensor that detects the movement of the input device, the vibration device does not vibrate during the period when the input device is stationary.

7. The input device according to claim 1 or 2, wherein the input device includes a movement sensor that detects the movement of the input device, even when the movement speed changes during the movement of the input device, the vibration device maintains the frequency of vibration as constant.

8. An input device having: a vibration device that generates vibration to give a tactile sensation; and a vibration control unit that inputs a drive signal to the vibration device to cause the vibration device to operate, wherein When the relative position between the stereoscopic display object displayed as a stereoscopic image in the real space and the input device is relatively close, or when the relative position between the virtual object and the input device in the virtual reality space is relatively close, the vibration of the vibration device is greater than when the relative position between the stereoscopic display object and the input device is relatively far, or when the relative position between the virtual object and the input device in the virtual reality space is relatively far. The input device further has a selection reception unit that receives the selection of the type of finger or tool. The vibration of the vibration device varies according to the type of finger or tool selected, and the drive circuit of the vibration control unit makes the intervals and frequencies of the vibrations generated by the vibration device different for each combination of the type of finger or tool and the type of the stereoscopic display object or the type of the virtual object.

9. The input device according to claim 8, wherein: The input device has a storage unit that stores the magnitude of the vibration corresponding to the relative position between the stereoscopic display object and the input device or the relative position between the virtual object and the input device in the virtual reality space. The magnitude of the vibration of the vibration device changes based on the data stored in the storage unit according to the relative position between the stereoscopic display object and the input device or the relative position between the virtual object and the input device in the virtual reality space.

10. The input device according to claim 8 or 9, wherein: The vibration of the vibration device is different according to the type classified according to the characteristics of the physical object of the stereoscopic display object or the type classified according to the characteristics of the physical object of the virtual object.

11. The input device according to claim 10, wherein: The input device has a selection reception unit that receives the selection of the type of the stereoscopic display object or the type of the virtual object. The vibration of the vibration device is different according to the selected type.

12. The input device according to claim 11, wherein: The frequency of the vibration of the vibration device is different according to the selected type.

13. The input device according to claim 8 or 9, wherein: The input device has a motion sensor that detects the movement of the input device. The vibration device does not vibrate during the period when the input device is stationary.

14. The input device according to claim 8 or 9, wherein: The input device includes a motion sensor that detects the movement of the input device. Even when the moving speed changes during the movement of the input device, the vibration device maintains the frequency of vibration constant.

15. A display input system, comprising: A display device that displays a stereoscopic image or a virtual reality image; An input device; and A detection unit that detects the position of the input device. The input device has: A vibration device that generates vibrations to give a tactile perception; and A vibration control unit that inputs a drive signal to the vibration device to cause the vibration device to operate. Characterized in that: When the stereoscopic display object displayed as a stereoscopic image in the actual space is relatively close to the input device or when the virtual object in the virtual reality space is relatively close to the input device, the vibration of the vibration device is greater than when the stereoscopic display object is relatively far from the input device or when the virtual object in the virtual reality space is relatively far from the input device. The input device further has a selection reception unit that receives the selection of the type of finger or tool, the vibration of the vibration device varies according to the selected type of finger or tool, and the drive circuit of the vibration control unit makes the intervals and frequencies of the vibrations generated by the vibration device different for each combination of the type of finger or tool and the type of the stereoscopic display object or the virtual object.

16. The display input system according to claim 15, wherein: The display input system has a storage unit that stores the magnitudes of vibrations corresponding to the relative position of the stereoscopic display object and the input device or the relative position of the virtual object in the virtual reality space and the input device. The magnitude of the vibration of the vibration device varies based on the data stored in the storage unit according to the relative position of the stereoscopic display object and the input device or the relative position of the virtual object in the virtual reality space and the input device.

17. The display input system according to claim 15 or 16, wherein: The vibration of the vibration device varies according to the type classified according to the characteristics of the actual object of the stereoscopic display object or the type classified according to the characteristics of the actual object of the virtual object.

18. The display input system according to claim 17, wherein: The display input system has a selection reception unit that receives the selection of the type of the stereoscopic display object or the type of the virtual object. The vibration of the vibration device varies according to the selected type.

19. The display input system according to claim 18, wherein: The frequency of the vibration of the vibration device varies according to the selected type.

20. The display input system according to claim 15 or 16, wherein: The input device has a movement sensor that detects the movement of the input device. The vibration device does not vibrate during the period when the input device is stationary.

21. The display input system according to claim 15 or 16, wherein: The input device includes a movement sensor that detects the movement of the input device. Even if the movement speed changes during the movement of the input device, the vibration device keeps the frequency of vibration constant.

22. The display input system according to claim 15 or 16, wherein: The detection unit and the display device are the same device.

Images