Tactile sensor, tactile sensor system and program

Abstract

To provide a tactile sensor which enables easy downsizing, and to provide a tactile sensor system and a program.SOLUTION: A tactile sensor includes: a transmission part including a first surface which may contact with an object to be held and a second surface which is a rear surface of the first surface; an imaging part which can capture images of an object existing on the one surface side of the transmission part from the second surface side; and a reflection part which is disposed on the second surface side of the transmission part and causes light from an area in at least part of the transmission part to reflect to guide the light into an imaging field angle of the imaging part.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to a tactile sensor, a tactile sensor system, and a program. [Background technology]

[0002] Conventionally, a method for detecting an object that comes into contact with the outer surface of a rubber skin is known as a method for realizing a tactile sensor (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2000-288973 A Summary of the Invention [Problem to be solved by the invention]

[0004] In conventional tactile sensors, the imaging optical axis of the imaging unit is parallel to the normal direction of the rubber skin (hereinafter referred to as the contact surface.) The imaging unit captures an image of the contact surface and detects the displacement of the contact surface when an object comes into contact with it, thereby detecting the gripping state of the object. Here, there are cases where it is better for the tactile sensor to be small, such as when the object to be touched is small. When considering miniaturization of the tactile sensor, the issues are to shorten the distance between the imaging unit that captures the image of the object and the contact surface, and to miniaturize the imaging unit itself. In conventional tactile sensors, if the distance between the imaging unit and the contact surface is to be shortened, a lens with a wide imaging angle must be used. When a lens with a wide imaging angle is used, problems such as distortion and problems with securing the amount of light arise. Furthermore, even when trying to miniaturize the imaging unit, there is a limit to how small the imaging unit can be made because it involves a decrease in image sensitivity, and it is impossible to make the tactile sensor smaller than the imaging unit. In other words, when considering miniaturizing the tactile sensor, problems have arisen in that it is difficult to maintain image quality by shortening the distance between the imaging unit and the contact surface, and there is a limit to how small the imaging unit can be made. That is, according to the conventional method, there is a problem in that it is not easy to reduce the size of the tactile sensor.

[0005] The present invention has been made in consideration of the above circumstances, and has an object to provide a tactile sensor, a tactile sensor system, and a program that can be easily miniaturized. [Means for solving the problem]

[0006] A tactile sensor according to one aspect of the present invention includes a transmission section having a first surface capable of contacting a grasp target and a second surface that is a reverse surface of the first surface, an imaging section capable of capturing an image of an object present on the first surface side of the transmission section from the second surface side, and a reflection section that is disposed on the second surface side of the transmission section and reflects light from at least a partial area of ​​the transmission section to guide it within an imaging angle of view of the imaging section. The imaging unit can capture an image of the object reflected by the reflecting unit. .

[0007] Moreover, in a tactile sensor according to one aspect of the present invention, the transparent portion is at least partially deformed to conform to the shape of an object to be grasped that has come into contact with the first surface, and the imaging portion is capable of imaging both an image of an object present on the first surface side and an image of a marker attached to the transparent portion that indicates the deformation of the transparent portion from the second surface side.

[0008] In a tactile sensor according to an aspect of the present invention, the imaging section is disposed such that an imaging optical axis of the imaging section and a normal to the second surface of the transmission section intersect at a point.

[0009] In a tactile sensor according to an aspect of the present invention, the reflecting section includes a plurality of reflecting surfaces whose normal angles with respect to an imaging optical axis of the imaging section are different from one another.

[0010] Furthermore, in a tactile sensor according to one embodiment of the present invention, the imaging section captures both a first image, which is an image of the imaging target area of ​​the transparent section formed by light incident without passing through the reflecting section, and a second image, which is an image of the imaging target area of ​​the transparent section formed by light reflected by the reflecting section and incident thereon, as images of the transparent section.

[0011] Furthermore, in a tactile sensation according to one aspect of the present invention, the transparent portion has a plurality of regions having different angles of normal to the imaging optical axis of the imaging portion, and the imaging portion is capable of capturing images of an object present on the first surface side by light respectively incident through the plurality of regions of the transparent portion.

[0012] Furthermore, a tactile sensor system according to one embodiment of the present invention includes the above-mentioned tactile sensor and a detection unit that acquires an image captured by the imaging unit and detects a contact state of an object with the first surface based on the acquired image.

[0013] A program according to one aspect of the present invention includes a transmission unit having a first surface capable of contacting a grasp target and a second surface that is a reverse surface of the first surface, an imaging unit capable of imaging an image of an object present on the first surface side of the transmission unit from the second surface side, and a reflection unit that is disposed on the second surface side of the transmission unit and reflects light from at least a partial area of ​​the transmission unit to guide the light within an imaging angle of view of the imaging unit. The imaging unit can capture a reflected image of the object to be grasped by the reflecting unit. A computer connected to the tactile sensor executes an image acquisition step of acquiring an image captured by the imaging unit, and a detection step of detecting a contact state of an object with the first surface based on the image acquired by the image acquisition step. Effect of the Invention

[0014] According to the present invention, it is possible to provide a tactile sensor, a tactile sensor system, and a program that can be easily miniaturized. [Brief description of the drawings]

[0015] [Figure 1] FIG. 1 illustrates an example of a robot system according to an embodiment. [Diagram 2] 1A and 1B are diagrams illustrating an example of a tactile sensor module according to an embodiment. [Diagram 3] FIG. 2 is a diagram showing an example of a cross-sectional view of a tactile sensor according to an embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a range that can be captured by an imaging unit in the embodiment. [Diagram 5] FIG. 4 is a diagram showing an example of an image captured by an imaging unit in the embodiment. [Figure 6] 1 is a diagram showing an example of a cross-sectional view of a tactile sensor when an object to be grasped touches a contact surface in an embodiment. FIG. [Figure 7] 11A and 11B are diagrams illustrating an example of an image captured by a tactile sensor when an object to be grasped touches a contact surface in an embodiment. [Figure 8] FIG. 2 illustrates an example of a robot system control unit according to an embodiment. [Figure 9] FIG. 4 is a diagram illustrating an example of the operation of a robot system control unit in the embodiment. [Figure 10] FIG. 13 is a diagram showing an example of a cross-sectional view of a tactile sensor according to a second embodiment. [Figure 11] 13 is a diagram showing an example of a range that can be imaged by an imaging section in the second embodiment; FIG. [Figure 12] FIG. 13 is a diagram showing an example of a cross-sectional view of a tactile sensor according to a third embodiment. [Figure 13] 13 is a diagram showing an example of a range that can be imaged by an imaging section in the third embodiment. FIG. [Figure 14] FIG. 13 is a diagram showing an example of a cross-sectional view of a tactile sensor according to a fourth embodiment. [Figure 15] FIG. 13 is a diagram showing an example of a range that can be imaged by an imaging section in the fourth embodiment. [Figure 16] FIG. 13 is a diagram showing an example of a cross-sectional view of a tactile sensor according to a fifth embodiment. [Figure 17] FIG. 13 is a diagram showing an example of a range that can be imaged by an imaging section in the fifth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. [Configuration of robot system 100] 1 is a diagram showing an example of a robot system 100 according to an embodiment. The robot system 100 according to the present embodiment grasps an object to be grasped while detecting a grasped state by contacting the object to be grasped. In this embodiment, the robot system 100 includes a tactile sensor module 10, a robot system control unit 90, a tip portion 110, an upper arm portion 120, a joint portion 130, a lower arm portion 140, a main horizontal shaft portion 150, a main vertical shaft portion 160, and a base portion 170.

[0017] The base portion 170 is a portion that is connected to the main vertical shaft portion 160 . The main vertical shaft portion 160 is a portion that connects the main horizontal shaft portion 150 and the base portion 170. The main vertical shaft portion 160 is controlled by the robot system control portion 90, and displaces the main horizontal shaft portion 150 around its axis. The main horizontal shaft portion 150 is a portion that connects the lower arm portion 140 and the main vertical shaft portion 160. The main horizontal shaft portion 150 is controlled by the robot system control portion 90, and displaces the lower arm portion 140 around the axis of the main horizontal shaft portion 150. The lower arm portion 140 is a portion that connects the joint portion 130 and the main horizontal shaft portion 150 . The joint portion 130 is a portion that connects the upper arm portion 120 and the lower arm portion 140. The joint portion 130 is controlled by the robot system control unit 90, and displaces the upper arm portion 120 around the axis of the joint portion 130. The upper arm portion 120 is a portion that connects the tip portion 110 and the joint portion 130 . The tip portion 110 is connected to the tactile sensor module 10. The attitude (e.g., position and direction) of the tip portion 110 is controlled by the robot system control unit 90. The attitude of the tactile sensor module 10 changes as the attitude of the tip portion 110 changes. The tactile sensor module 10 detects the contact state of the object to be grasped, and outputs information indicating the detected contact state of the object to be grasped to the robot system control unit 90. The robot system control unit 90 acquires the information output by the tactile sensor module 10 . The robot system control unit 90 moves the tactile sensor module 10 by displacing each part (the tip part 110, the upper arm part 120, the joint part 130, the lower arm part 140, the main horizontal shaft part 150, and the main vertical shaft part 160) of the robot system 100 using a driving device (not shown). The robot system control unit 90 controls the robot system 100 based on information acquired from the tactile sensor module 10.

[0018] 2 is a diagram showing an example of a tactile sensor module 10 in an embodiment. The tactile sensor module 10 in this embodiment includes a sensor connection unit 11, a first tactile sensor 1a, and a second tactile sensor 1b. In the following description, the attitude of the tactile sensor module 10 may be shown using a three-dimensional orthogonal coordinate system of x-axis, y-axis, and z-axis. The sensor connection portion 11 is a portion that connects the tip portion 110 to the first tactile sensor 1a and the second tactile sensor 1b. The first tactile sensor 1a is connected to the sensor connection portion 11. The first tactile sensor 1a includes a first transmission portion contact surface 40a. The second tactile sensor 1b is connected to the sensor connection portion 11. The second tactile sensor 1b includes a second transmission portion contact surface 40b. The first tactile sensor 1a and the second tactile sensor 1b are disposed in a position where the first transparent portion contact surface 40a and the second transparent portion contact surface 40b face each other. The sensor connection unit 11 includes a driving device (not shown) and displaces the first tactile sensor 1a and the second tactile sensor 1b (or one of these sensors; the same applies in the following description) in the y-axis direction based on an instruction from the robot system control unit 90. The tactile sensor module 10 drives the first tactile sensor 1a and the second tactile sensor 1b in the y-axis direction to grip an object to be gripped that is between the first tactile sensor 1a and the second tactile sensor 1b.

[0019] [Configuration of tactile sensor 1] Fig. 3 is a diagram showing an example of a cross-sectional view of a tactile sensor in an embodiment. This figure shows a cross-sectional view on the xy plane of the first tactile sensor 1a shown in Fig. 2. The orientation of the tactile sensor module 10 is shown by a three-dimensional orthogonal coordinate system of the x-axis, y-axis, and z-axis. Since the first tactile sensor 1a and the second tactile sensor 1b have the same configuration, only the first tactile sensor 1a will be described and a description of the second tactile sensor 1b will be omitted.

[0020] The first tactile sensor 1a includes a first imaging section 30a, a first reflecting section 20a, a first transparent section 43a, a first marker 45a, a first transparent section contact surface 40a, a first transparent section non-contact surface 47a, a first hard layer 70a, and a first frame 50a. In the following, the first imaging section 30a will be referred to as imaging section 30, the first reflecting section 20a as reflecting section 20, the first transparent section 43a as transparent section 43, the first marker 45a as marker 45, the first transparent section contact surface 40a as transparent section contact surface 40, the first transparent section non-contact surface 47a as transparent section non-contact surface 47, the first rigid layer 70a as rigid layer 70, and the first frame 50a as frame 50. The frame 50 holds the imaging section 30 , the reflective section 20 , the transmissive section 43 , and the hard layer 70 .

[0021] The transmissive portion 43 is made of a transparent material that transmits light, and includes a transmissive portion contact surface 40 and a transmissive portion non-contact surface 47. For example, a specific material for the transmissive portion 43 is a silicone material that is 2 millimeters thick and has a transmittance of approximately 94 percent. The transmission part contact surface 40 is a surface that can come into contact with an object to be grasped among the front and back surfaces of the transmission part 43. The transmission part non-contact surface 47 is a surface that does not come into contact with an object to be grasped among the front and back surfaces of the transmission part 43. In the following description, the surface of the transmitting portion 43 that can come into contact with the object to be grasped (i.e., the transmitting portion contact surface 40) is also referred to as the front surface or the first surface, and the surface that does not come into contact with the object to be grasped (i.e., the transmitting portion non-contact surface 47) is also referred to as the back surface or the second surface. That is, the transmitting portion 43 includes the transmitting portion contact surface 40, which is a contact surface that can come into contact with the object to be grasped, and the transmitting portion non-contact surface 47, which is a non-contact surface that is the back surface of the contact surface and does not come into contact with the object to be grasped. Moreover, the transmitting portion 43 is made of a transparent material. In this example, at least a part of the transmitting portion 43 deforms along the shape of the object to be grasped that comes into contact with the transmitting portion contact surface 40, which is the contact surface.

[0022] A plurality of markers 45 are arranged at predetermined positions of the transmission section 43. In one example of this embodiment, the markers 45 are opaque members arranged at lattice points divided at equal intervals inside the transmission section 43. The markers 45 are described as being arranged inside the transmission section 43, but are not limited to this, and may be provided on the transmission section contact surface 40 or the transmission section non-contact surface 47. The markers 45 are described as being discretely arranged at lattice points, but are not limited to this. The markers 45 may be a lattice pattern or other continuous patterns. The pattern of the markers 45 may be an irregular pattern so that the gripping state of the object to be grasped can be easily detected. The markers 45 have been described as being opaque, but are not limited to this, and may be semi-transparent or transparent as long as the displacement when the object to be grasped comes into contact with the markers can be optically recognized.

[0023] The hard layer 70 is provided at a position in contact with the non-contact surface 47 of the transmission portion 43. The hard layer 70 is made of a transparent and hard material such as acrylic. The hard layer 70 restricts the amount of deformation of the transmission portion 43 when the object to be grasped is grasped. In this embodiment, the transparent portion 43 and the hard layer 70 are described as separate components. If the deformation amount of the transparent portion 43 when the grasped object is grasped falls within a predetermined range, the hard layer 70 may be omitted.

[0024] The reflecting unit 20 has a reflecting surface, such as a mirror, that reflects light. This reflecting surface is disposed on the non-contact surface side of the transmitting unit 43. The reflecting unit 20 reflects the light that has passed through the transmitting unit 43, and guides the reflected light to the imaging unit 30. The reflecting unit 20 reflects light from at least a partial region of the transmitting unit 43. That is, the reflecting unit 20 is disposed on the non-contact surface (e.g., the transmitting unit non-contact surface 47) side of the transmitting unit 43, and reflects light from at least a partial region of the transmitting unit 43 to guide the light to within the imaging angle of view of the imaging unit 30.

[0025] The imaging unit 30 is disposed on the side of the transmissive portion non-contact surface 47 of the front and back surfaces of the transmissive portion 43. More specifically, the imaging unit 30 is disposed so that the imaging optical axis OA of the imaging unit 30 and the normal N41 of the transmissive portion non-contact surface 47 of the transmissive portion 43 intersect (so that the imaging optical axis OA and the normal N41 are not parallel to each other). The imaging unit 30 captures an image within an imaging angle of view centered on the imaging optical axis OA, and outputs the imaging result as image information. The imaging unit 30 can capture an image of an object present on the transmission-part contact surface 40 side of the transmission part 43 from the transmission-part non-contact surface 47 side. Here, the light transmitted through the transmitting portion 43 includes an image of an object present on the transmitting portion contact surface 40 side of the transmitting portion 43. The light transmitted through the transmitting portion 43 also includes an image of the marker 45 arranged on the transmitting portion 43 (i.e., an image of the transmitting portion 43 or an image of the transmitting portion). That is, the imaging unit 30 can image both an image of an object present on the transmitting portion contact surface 40 side, which is the contact surface side of the transmitting portion 43, and an image of a marker attached to the transmitting portion 43 indicating deformation of the transmitting portion 43, from the transmitting portion non-contact surface 47 side, which is the non-contact surface side. The imageable range of the imaging unit 30 includes an image formed by light that has passed through the transmitting portion 43 and been reflected by the reflecting portion 20, and an image formed by light that has passed through the transmitting portion 43 and reached the imaging unit 30 directly without passing through the reflecting portion 20. In the following description, an image formed by light that has passed through the transmitting portion 43 and reached the imaging unit 30 directly without passing through the reflecting portion 20 is also referred to as a direct image. An image formed by light that has passed through the transmitting portion 43 and been reflected by the reflecting portion 20 is also referred to as a reflected image. The imageable range of the imaging unit 30 will be described with reference to FIGS. 4 and 5.

[0026] [Area that can be captured by the imaging unit 30] 4 is a diagram showing an example of a range that can be imaged by the imaging section 30 in the embodiment. The range that can be imaged by the imaging section 30 included in the tactile sensor 1 will be described. In this example, the imaging range of the imaging unit 30 is determined by the geometrical relationship between the angle of view A10 of the imaging unit 30 and the arrangement of the reflecting unit 20. The imaging range of the imaging unit 30 includes an area where a direct image can be captured and an area where a reflected image can be captured.

[0027] For example, when the angle of incidence of light incident on the reflector 20 from the transmissive portion contact surface 40 side is a first incident angle IA10, the light incident on the reflector 20 is emitted in the direction of a first reflection angle RA10. When the angle of incidence of light incident on the reflector 20 from the transmissive portion contact surface 40 side is a second incident angle IA20, the light incident on the reflector 20 is emitted in the direction of a second reflection angle RA20. Furthermore, when the angle of incidence of light incident on the reflecting unit 20 from the transmitting unit contact surface 40 side is a third incident angle IA30, the light incident on the reflecting unit 20 is emitted in the direction of the third reflection angle RA30 (in this example, the imaging optical axis OA). When an image formed by the light emitted from the reflecting section 20 (that is, a reflected image) is included within the angle of view A10, the imaging section 30 can capture an image of the light emitted from the reflecting section 20.

[0028] The first imaging range AR1 is a range in which the imaging section 30 can capture a direct image, and is a range in which the imaging section 30 cannot capture a reflected image. The second imaging range AR2 is a range in which the imaging section 30 can capture both a direct image and a reflected image. The third imaging range AR3 is a range in which the imaging section 30 cannot capture a direct image, and is a range in which the imaging section 30 can capture a reflected image.

[0029] 5 is a diagram showing an example of an image captured by the imaging unit 30 in the embodiment. The captured image P includes a direct-view captured image R and a reflected-view captured image M as image components. c Axis and y c It is shown in a two-dimensional Cartesian coordinate system with x c y c The plane indicates the image plane where the yz plane is imaged in FIG. The direct-view imaging marker RM is an image of the marker 45 captured directly by the imaging unit 30 . The reflected vision imaging marker MM is an image of the reflected image of the marker 45 captured by the imaging unit 30. Hereinafter, the first object OB1 to the third object OB3 will be described as an example with reference to FIG. 4 and FIG.

[0030] In this example, the first object OB1 is present in the first imaging range AR1. In this case, the imaging section 30 can capture a direct image of the first object OB1, but cannot capture a reflected image of the first object OB1. The second object OB2 is present in the second imaging range AR2. In this case, the imaging section 30 is capable of capturing a direct image and a reflected image of the second object OB2. The third object OB3 is present in the third imaging range AR3. In this case, the imaging section 30 cannot capture a direct image of the third object OB3, but can capture a reflected image of the third object OB3.

[0031] The imaging unit 30 captures both a first image, which is an image of the imaging target area of ​​the transparent unit 43 formed by light incident without passing through the reflecting unit 20, and a second image, which is an image of the imaging target area of ​​the transparent unit 43 formed by light reflected by the reflecting unit 20 and incident thereon, as images of the transparent unit 43. That is, the imaging section 30 can capture a direct-view image R and a reflected-view image M simultaneously.

[0032] [When the object to be grasped comes into contact with the contact surface 40 of the transmission part] 6 is a diagram showing an example of a cross-sectional view of the tactile sensor when an object to be grasped touches the contact surface in the embodiment. As an example, a case where an object OB4 touches the transmission part contact surface 40 will be described. In this example, an object OB4, which is an object to be grasped, is in contact with the transparent portion contact surface 40. The range in which the object OB4 is in contact with the transparent portion contact surface 40 is defined as an object detection range ODA. A marker 45 in the object detection range ODA is displaced before and after the object comes into contact with the transparent portion contact surface 40. The imaging unit 30 captures images of the marker 45 in the object detection range ODA in time series. In this example, the object OB4 is located at a position that straddles both the second image capturing range AR2 and the third image capturing range AR3, and therefore both direct viewing and reflected viewing are possible.

[0033] 7 is a diagram showing an example of an image captured by the tactile sensor when a grasped object touches the contact surface in the embodiment. The captured image P includes a direct-view captured image R and a reflected-view captured image M as image components. The captured image P when an object OB4 touches the transmission-part contact surface 40 is shown in the figure. A direct-view imaging marker RM is imaged in the direct-view captured image R. Here, the direct-view object detection range RODA is a range that is captured as the direct-view captured image R within the object detection range ODA. A reflected vision imaging marker MM is captured in the reflected vision captured image M. Here, the reflected vision object detection range MODA is a range captured as the reflected vision captured image M within the object detection range ODA.

[0034] Here, the direct image of the marker 45 will be described by comparing the position of the marker 45 before contact with the object OB4 and the position of the marker 45 after contact with the object OB4. The pre-contact direct-vision marker image RMB is the direct-vision imaging marker RM before the object OB4 contacts the transmission portion contact surface 40 in the direct-vision object detection range RODA. The post-contact direct-vision marker image RMA is a direct-vision imaging marker RM after the object OB4 comes into contact with the transmission portion contact surface 40 in the direct-vision object detection range RODA.

[0035] Here, the difference in the position of the marker 45 in the image due to the change over time is represented by a marker vector. As shown in the figure, a difference in position occurs in the image between the pre-contact direct-view marker image RMB and the post-contact direct-view marker image RMA. The direct-view marker vector RAR indicates the difference between the pre-contact direct-view marker image RMB and the post-contact direct-view marker image RMA. The robot system 100 can detect the gripping state of the object OB4 by determining the direct-view marker vector RAR.

[0036] Similarly to the direct image, the difference in the position of the marker 45 in the image due to time change can be expressed by a marker vector for the reflected image of the marker 45. That is, as shown in the figure, a difference in position occurs in the image between the pre-contact reflected marker image MMB and the post-contact reflected marker image MMA. The reflected marker vector MAR indicates the difference between the pre-contact reflected marker image MMB and the post-contact reflected marker image MMA. The robot system 100 can detect the gripping state of the object OB4 by determining the reflected marker vector MAR.

[0037] [When the object to be grasped touches the contact surface 40 of the transmission part] FIG. 8 is a diagram illustrating an example of a robot system control unit 90 in the embodiment. The robot system control unit 90 includes a robot control unit 91, an input unit 92, an output unit 93, and a gripping state detection unit 80. The robot control unit 91 includes a microcomputer, memories such as a random access memory (RAM) and a read only memory (ROM), and a communication unit for communicating with external devices, all of which are not shown. The input unit 92 acquires information from sensors such as a pressure sensor, a position sensor, a temperature sensor, and an acceleration sensor, a camera, a microphone (none of which are shown), and the like. The output unit 93 outputs a drive signal to a motor (not shown) for driving a robot (not shown) or the like. The grip state detection unit 80 includes an image acquisition unit 81, an image processing unit 82, a control unit 83, and a reference state storage unit 84. In the robot system 100, the grip state detection unit 80, which is a detection unit, acquires the image captured by the imaging unit 30, and detects the contact state of the object with the transmission unit contact surface 40 based on the acquired image. The gripping state detection unit 80 provides the detected gripping state to the robot control unit 91.

[0038] The image acquiring section 81 acquires image information captured by the imaging section 30. The image acquiring section 81 provides the image acquired by the imaging section 30 to the image processing section . In this example, the image captured by the imaging section 30 is described as a still image, but the image captured by the imaging section 30 may be a moving image. The image processing unit 82 acquires the image from the image acquisition unit 81. The image processing unit 82 performs processing to detect the position of the marker 45 based on the acquired image. The reference state storage unit 84 stores position information of the marker 45 in a state in which an object is not detected, i.e., reference position information. That is, the reference state storage unit 84 stores reference position information of a direct-vision imaging marker RM in which the marker 45 is captured in a direct-vision imaging image R, and reference position information of a reflected-vision imaging marker MM in which the marker 45 is captured in a reflected-vision imaging image M. The control unit 83 acquires, from the image processing unit 82, reference position information of the direct vision imaging marker RM, reference position information of the reflected vision imaging marker MM, and a detection result of the position of the marker 45. The detection result of the position of the marker 45 includes the position information of the direct vision imaging marker RM and the position information of the reflected vision imaging marker MM. The control unit 83 also acquires reference position information of the direct-vision imaging marker RM and reference position information of the reflected-vision imaging marker MM from the reference state storage unit 84. The control unit 83 determines the displacement of the direct-vision imaging marker RM (for example, a direct-vision marker vector RAR) based on the position information of the direct-vision imaging marker RM indicated by the captured image P and the reference position information of the direct-vision imaging marker RM acquired from the reference state storage unit 84. The control unit 83 also acquires the displacement of the reflected-vision imaging marker MM (for example, a reflected-vision marker vector MAR) based on the position information of the reflected-vision imaging marker MM indicated by the captured image P and the reference position information of the reflected-vision imaging marker MM acquired from the reference state storage unit 84. The control unit 83 outputs the displacement information of the marker 45 to the robot control unit 91. This displacement information of the marker 45 indicates the gripping state of the gripping object. That is, the control unit 83 detects the gripping state of the gripping object.

[0039] The control unit 83 may determine that the object has come into contact with the transmission unit contact surface 40 when the amount of displacement of the marker 45 exceeds a predetermined value. Furthermore, the control unit 83 and the image acquisition unit 81 may output the image captured by the imaging unit 30 to the robot control unit 91. The image captured by the imaging unit 30 includes an image of an object present on the transparent part contact surface 40 side of the transparent part 43. In other words, the image captured by the imaging unit 30 includes an image of the outside world that can be observed through the transparent part 43. According to the gripping state detection unit 80 configured in this manner, it is possible to cause the robot control unit 91 to grasp the state around the transparent part contact surface 40, regardless of whether an object is in contact with the transparent part contact surface 40 or not.

[0040] 9 is a diagram showing an example of the operation of the robot system control unit 90 in the embodiment. An example of the operation of the robot system control unit 90 will be described with reference to FIG. (Step S10) The image acquisition unit 81 acquires image information captured by the imaging unit 30. The image acquisition unit 81 provides the image acquired by the imaging unit 30 to the image processing unit . (Step S20) The image processing unit 82 acquires an image from the image acquisition unit 81. The image processing unit 82 processes the acquired image. The image processing unit 82 identifies the range of the direct-vision image R of the captured image P and the range of the reflected-vision image M. The image processing unit 82 provides the control unit 83 with position information of the direct-vision imaging marker RM present within the range of the direct-vision image R, position information of the reflected-vision imaging marker MM present within the range of the reflected-vision image M, and the captured image P. The control unit 83 acquires the position information of the direct-vision imaging marker RM, the position information of the reflected-vision imaging marker MM, and the captured image P from the image processing unit 82. The control unit 83 also acquires the position information of the direct-vision imaging marker RM and the position information of the reflected-vision imaging marker MM in a state where an object is not detected from the reference state storage unit 84. The control unit 83 compares the position information of the direct-vision imaging marker RM and the position information of the reflected-vision imaging marker MM acquired from the image processing unit 82 with the position information of the direct-vision imaging marker RM and the position information of the reflected-vision imaging marker MM acquired from the reference state storage unit 84. (Step S30) If there is a difference in the comparison results (Step S30; YES), the control unit 83 determines that the object has contacted the transmission portion contact surface 40, and proceeds to step S40. If there is no difference in the comparison results (Step S30; NO), the control unit 83 determines that the object has not contacted the transmission portion contact surface 40, and proceeds to step S10. (Step S40) The control unit 83 notifies the robot control unit 91 of the gripping state. Specifically, the control unit 83 notifies the robot control unit 91 of displacement information of the direct vision imaging marker RM and the reflected vision imaging marker MM. The control unit 83 also simultaneously provides the robot control unit 91 with a captured image P when the displacement is detected.

[0041] [Second embodiment] FIG. 10 is a diagram illustrating an example of a cross-sectional view of the tactile sensor according to the second embodiment. In the above-described embodiment, the reflective portion 20 is described as being one flat surface. The second embodiment differs from the above-described embodiment in that the reflective portion 20 has a plurality of different angles. In the second embodiment, the tactile sensor 1 includes a reflecting portion 20 having a plurality of different angles. In this example, the tactile sensor 1 includes a first angle reflecting portion 21 and a second angle reflecting portion 22. (Hereinafter, in this embodiment, when there is no need to distinguish between the first angle reflecting portion 21 and the second angle reflecting portion 22, they will be referred to as the reflecting portion 20.) Normal N21 is the normal to the first angle reflecting portion 21. Normal N22 is the normal to the second angle reflecting section 22. Here, the normal line N21 and the normal line N22 intersect at an intersection point IP. That is, the tactile sensor 1 includes a plurality of reflective surfaces whose normal angles with respect to the imaging optical axis OA of the imaging section 30 are different from one another. In the second embodiment, the tactile sensor 1 has multiple reflecting sections 20 with different angles, so that the imaging section 30 can observe a wider range even when the angle of view A10 is the same as in the first embodiment. In this example, the reflecting section 20 is composed of reflecting sections having a plurality of different angles (first angle reflecting section 21 and second angle reflecting section 22). These reflecting sections may be composed of different reflecting members. Also, a reflecting section having a similar effect may be constructed by constructing a plurality of reflecting sections having different angles on one reflecting member.

[0042] 11 is a diagram showing an example of the range that can be captured by the imaging section 30 in the second embodiment. In the second embodiment, the captured image P includes, as image components, a direct-view captured image R, a reflected-view captured image M1 corresponding to the first-angle reflector 21, and a reflected-view captured image M2 corresponding to the second-angle reflector 22. (Hereinafter, in this embodiment, when there is no need to distinguish between the reflected-view captured image M1 corresponding to the first-angle reflector 21 and the reflected-view captured image M2 corresponding to the second-angle reflector 22, they will be referred to as the reflected-view captured image M.) As in the first embodiment, a direct-view imaging marker RM is captured in the direct-view imaging image R. Also, a reflected-view imaging marker MM is captured in the reflected-view imaging image M. The imaging unit 30 detects the gripping state by observing the direct vision imaging marker RM and the reflected vision imaging marker MM.

[0043] [Third embodiment] FIG. 12 is a diagram illustrating an example of a cross-sectional view of a tactile sensor according to the third embodiment. In the above-described embodiments, the transmission portion contact surface 40 is described as being flat. The third embodiment differs from the above-described embodiments in that the transmission portion contact surface 40 has a plurality of different angles (i.e., has a curved surface). In the third embodiment, the tactile sensor 1 includes a transparent portion contact surface 40 having a plurality of different angles. In this example, the tactile sensor 1 includes a first angle transparent portion contact surface 41 and a second angle transparent portion contact surface 42. (In the following, in this embodiment, when there is no need to distinguish between the first angle transparent portion contact surface 41 and the second angle transparent portion contact surface 42, they will be referred to as the transparent portion contact surface 40.) The normal line N41 is a normal line to the first angle transmission portion contact surface 41. The normal N42 is a normal to the second angle transmission portion contact surface 42. Here, the normal line N41 and the normal line N42 intersect at an intersection point IP. That is, the transmission section 43 has a plurality of regions whose normal lines have different angles with respect to the imaging optical axis OA of the imaging section 30. The imaging section 30 can capture images of objects present on the transmission section contact surface 40 side by light respectively incident through the plurality of regions of the transmission section 43.

[0044] In the third embodiment, the tactile sensor 1 has a plurality of transparent portion contact surfaces 40 with different angles, so that the imaging unit 30 can observe a wider range even when the angle of view A10 is the same as that of the first embodiment. In particular, in the third embodiment, the second angle transparent portion contact surface 42 is provided, so that a wider range can be observed in the x-axis direction. Therefore, when the robot system control unit 90 moves the position of the tactile sensor module 10 in the x-axis direction, a collision with an object in the traveling direction can be detected in advance based on the image captured by the imaging unit 30 of the tactile sensor 1. That is, in the third embodiment, the tactile sensor 1 is provided with the second angle transparent portion contact surface 42, so that the tactile sensor 1 detects an object present in the traveling direction. Therefore, the tactile sensor 1 can avoid a collision with an object present in the traveling direction.

[0045] 13 is a diagram showing an example of a range that can be captured by the imaging section 30 in the third embodiment. In the third embodiment, the captured image P includes, as image components, a direct-view captured image R1 corresponding to the first-angle transparent section contact surface 41, a direct-view captured image R2 corresponding to the second-angle transparent section contact surface 42, and a reflected-view captured image M. (Hereinafter, in this embodiment, when there is no need to distinguish between the direct-view captured image R1 corresponding to the first-angle transparent section contact surface 41 and the direct-view captured image R2 corresponding to the second-angle transparent section contact surface 42, they will be referred to as the direct-view captured image R.) As in the first embodiment, a direct-view imaging marker RM is captured in the direct-view imaging image R. Also, a reflected-view imaging marker MM is captured in the reflected-view imaging image M. The imaging unit 30 detects the gripping state by observing the direct vision imaging marker RM and the reflected vision imaging marker MM.

[0046] [Fourth embodiment] FIG. 14 is a diagram illustrating an example of a cross-sectional view of a tactile sensor according to the fourth embodiment. In the above-mentioned second embodiment, an embodiment in which the reflective portion 20 has a plurality of different angles has been described. Also, in the above-mentioned third embodiment, an embodiment in which the transmissive portion contact surface 40 has a plurality of different angles has been described. The fourth embodiment differs from the above-mentioned embodiments in that the reflective portion 20 has a plurality of different angles and the transmissive portion contact surface 40 has a plurality of different angles. In the fourth embodiment, the tactile sensor 1 includes a reflecting portion 20 having a plurality of different angles. The tactile sensor 1 also includes a transmissive portion contact surface 40 having a plurality of different angles. In this example, the tactile sensor 1 includes a first angle reflecting portion 21, a second angle reflecting portion 22, a first angle transmissive portion contact surface 41, and a second angle transmissive portion contact surface 42. (Hereinafter, in this embodiment, when there is no need to distinguish between the first angle reflecting portion 21 and the second angle reflecting portion 22, they will be referred to as the reflecting portion 20. When there is no need to distinguish between the first angle transmissive portion contact surface 41 and the second angle transmissive portion contact surface 42, they will be referred to as the transmissive portion contact surface 40.) In the fourth embodiment, the tactile sensor 1 has a plurality of reflecting parts 20 with different angles, so that the imaging unit 30 can observe a wider range even when the imaging unit 30 has the same angle of view A10 as in the first embodiment. In this example, the tactile sensor 1 has a plurality of transparent part contact surfaces 40 with different angles, so that the imaging unit 30 can observe a wider range even when the imaging unit 30 has the same angle of view A10 as in the first embodiment. In particular, in the fourth embodiment, the second angle transparent part contact surface 42 is provided, so that observation is possible in the x-axis direction as well. Therefore, when the robot system control unit 90 moves the position of the tactile sensor module 10 in the x-axis direction, a collision with an object in the traveling direction can be detected in advance by the image captured by the imaging unit 30 of the tactile sensor 1.

[0047] 15 is a diagram showing an example of a range that the imaging unit 30 in the fourth embodiment can capture. In the fourth embodiment, the captured image P includes a direct-view captured image R1 corresponding to the first-angle transmission contact surface 41, a direct-view captured image R2 corresponding to the second-angle transmission contact surface 42, a reflected-view captured image M1 corresponding to the first-angle reflection portion 21, and a reflected-view captured image M2 corresponding to the second-angle reflection portion 22 as image components. (Hereinafter, in this embodiment, when the direct-view captured image R1 corresponding to the first-angle transmission contact surface 41 and the direct-view captured image R2 corresponding to the second-angle transmission contact surface 42 are not distinguished, they are referred to as direct-view captured images R. Also, when the reflected-view captured image M1 corresponding to the first-angle reflection portion 21 and the reflected-view captured image M2 corresponding to the second-angle reflection portion 22 are not distinguished, they are referred to as reflected-view captured images M.) As in the first embodiment, a direct-view imaging marker RM is captured in the direct-view imaging image R. Also, a reflected-view imaging marker MM is captured in the reflected-view imaging image M. The imaging unit 30 detects the gripping state by observing the direct vision imaging marker RM and the reflected vision imaging marker MM.

[0048] [Fifth embodiment] FIG. 16 is a diagram illustrating an example of a cross-sectional view of a tactile sensor according to the fifth embodiment. In the above-described embodiments, the transmission portion contact surface 40 has been described as being flat. Also, in the above-described third and fourth embodiments, embodiments have been described in which the transmission portion contact surface 40 has a plurality of different angles. In particular, the transmission portion contact surface 40 has been described as having a plurality of angles only in the x-axis direction, but the fifth embodiment differs from the third and fourth embodiments in that the transmission portion contact surface 40 also has a plurality of angles in the z-axis direction. In the fifth embodiment, the tactile sensor 1 includes a transmissive portion contact surface 40 having a plurality of different angles. Here, in the third and fourth embodiments, it has been described that the transmissive portion contact surface 40 has a plurality of different angles with respect to the x-axis direction. In the fifth embodiment, the transmissive portion contact surface 40 further has a plurality of different angles with respect to the z-axis direction. The tactile sensor 1 includes a plurality of reflecting portions 20. In this example, the tactile sensor 1 includes a first angle reflecting portion 21 and a second angle reflecting portion 22. (Hereinafter, in this embodiment, when there is no need to distinguish between the first angle reflecting portion 21 and the second angle reflecting portion 22, they will be referred to as reflecting portions 20.) The tactile sensor 1 includes a plurality of different angled transparent portion contact surfaces 40. In this example, the tactile sensor 1 includes a first angled transparent portion contact surface 41 and a second angled transparent portion contact surface 42. Furthermore, the first angle transmittance portion contact surface 41 has a first angle transmittance portion contact surface 41S having a different angle in the z-axis direction. The second angle transmittance portion contact surface 42 has a second angle transmittance portion contact surface 42S having a different angle in the z-axis direction. (Hereinafter, in this embodiment, when there is no need to distinguish between the first angle transmittance portion contact surface 41, the second angle transmittance portion contact surface 42, the first angle transmittance portion contact surface 41S, and the second angle transmittance portion contact surface 42S, they will be referred to as the transmittance portion contact surface 40.) In the fifth embodiment, the tactile sensor 1 has a transparent portion contact surface 40S with a plurality of different angles with respect to the z-axis direction, which enables observation of a wider range in the z-axis direction as well. When the robot system control unit 90 moves the position of the tactile sensor module 10 in the z-axis direction, it is possible to detect in advance a collision with an object in the traveling direction based on an image captured by the imaging unit 30 of the tactile sensor 1. That is, in the fifth embodiment, the tactile sensor 1 is capable of avoiding collisions.

[0049] FIG. 17 is a diagram showing an example of a range that the imaging unit 30 in the fifth embodiment can capture. In the fifth embodiment, the captured image P includes a direct-view captured image R1 corresponding to the first angle transmission part contact surface 41, a direct-view captured image RS1 corresponding to the first angle transmission part contact surface 41S, a direct-view captured image R2 corresponding to the second angle transmission part contact surface 42, a direct-view captured image RS2 corresponding to the second angle transmission part contact surface 42S, a reflected-view captured image M1 corresponding to the first angle reflection part 21, and a reflected-view captured image M2 corresponding to the second angle reflection part 22 as components of the image. (Hereinafter, in this embodiment, when the direct-view captured image R1, the direct-view captured image R2, the direct-view captured image RS1, and the direct-view captured image RS2 are not distinguished from each other, they are referred to as the direct-view captured image R. Also, when the reflected-view captured image M1 corresponding to the first angle reflection part 21 and the reflected-view captured image M2 corresponding to the second angle reflection part 22 are not distinguished from each other, they are referred to as the reflected-view captured image M.) The reflected vision captured image M1 has MS1 reflected from the transparent portion contact surface 40S. The reflected vision captured image M2 has an MS2 that reflects the transparent portion contact surface 40S. As in the first embodiment, a direct-view imaging marker RM is captured in the direct-view imaging image R. Also, a reflected-view imaging marker MM is captured in the reflected-view imaging image M. The imaging unit 30 detects the gripping state by observing the direct vision imaging marker RM and the reflected vision imaging marker MM. The above-mentioned tactile sensor module 10 and the gripping state detection unit 80 are collectively referred to as a tactile sensor system.

[0050] [Summary of Effects of the Embodiments] As described above, the tactile sensor 1 of this embodiment can detect the gripping state by observing the transparent transmission section 43 that deforms along the shape of the gripping object that comes into contact with the contact surface. The tactile sensor 1 includes a reflection section 20, and by observing the direct vision captured image R and the reflected vision captured image M, it becomes possible to observe outside the range of the angle of view A10 of the imaging section 30. Here, in one example of a conventional tactile sensor, the imaging section is disposed perpendicular to the transmission section and does not include a reflection section. Therefore, in order to miniaturize the tactile sensor, it was necessary to shorten the distance between the imaging section and the transmission section by using an imaging section with a wide angle of view, or to miniaturize the imaging section itself. If the angle of view of the imaging section is made wider or the imaging section is made smaller, there is a problem that the imaging quality is degraded and the detection accuracy of the gripping state of the object is degraded. In other words, there was a problem that miniaturization was not easy with the conventional method. According to the tactile sensor 1 of this embodiment, in addition to directly observing the transmissive portion 43, it is possible to observe the transmissive portion 43 through the reflecting portion 20. Therefore, it is not necessary to place an imaging portion at a position where the transmissive portion 43 is imaged by direct vision (a position where the imaging optical axis of the imaging portion is parallel to the normal direction of the transmissive portion). Furthermore, according to the tactile sensor 1 of this embodiment, in addition to directly observing the transmissive portion 43, a technique is used in which the transmissive portion 43 is observed through the reflecting portion 20, so that imaging of a wider range is possible. This makes it possible to configure the tactile sensor 1 without making the imaging portion 30 wider-angle or without making the imaging portion 30 smaller. That is, the tactile sensor 1 of this embodiment can be easily miniaturized.

[0051] Another example of a conventional tactile sensor does not include a transmission section 43, and is configured so that the imaging section cannot capture an image of the grasped object being grasped. This other example of a conventional tactile sensor has a problem in that even if the grasped object is slipping when being grasped, the imaging section cannot detect this. According to the tactile sensor 1 of the present embodiment, since it is provided with the transmission section 43, the imaging section 30 can directly view the grasped object and detect when the grasped object has slipped.

[0052] That is, according to the tactile sensor 1 of this embodiment, the imaging unit 30 not only directly observes the transparent portion 43, but also observes the transparent portion 43 through the reflecting portion 20, thereby enabling imaging of a wider range, and further, by directly viewing the object to be grasped, the imaging unit 30 can detect when the object to be grasped has slipped.

[0053] Furthermore, according to the embodiment described above, the imaging section 30 is disposed so that the imaging optical axis OA of the imaging section 30 and the normal to the transmission section non-contact surface 47 of the transmission section 43 intersect at a point. In the conventional technology, the imaging unit 30 is disposed in a position where the imaging optical axis OA of the imaging unit 30 is parallel to the normal line of the transparent portion non-contact surface 47 of the transparent portion 43. Therefore, the size of the tactile sensor 1 depends on the size of the imaging unit 30. However, according to the embodiment described above, the imaging section 30 can be installed so that the imaging optical axis OA of the imaging section 30 and the normal to the transmission section non-contact surface 47 of the transmission section 43 intersect at a point. That is, the tactile sensor 1 of this embodiment can be easily miniaturized.

[0054] According to the above-described embodiment, the reflecting unit 20 includes a plurality of reflecting surfaces whose normal angles are different from one another. Therefore, the imaging unit 30 provides a field of view that intentionally narrows the range that can be observed. The tactile sensor 1 observes the grasped object through the plurality of reflecting surfaces, and can thereby limit the range in which the grasped object exists in three-dimensional space. Therefore, the tactile sensor 1 can specify that the object to be grasped exists in a more limited three-dimensional space, and can detect the grasped state more accurately. Furthermore, by accurately grasping the three-dimensional space, the tactile sensor 1 can find the object to be grasped more quickly when the robot system 100 drives the tactile sensor 1 to approach the object to be grasped.

[0055] Furthermore, according to the embodiment described above, the transmissive section 43 has a plurality of regions whose normal angles with respect to the imaging optical axis OA of the imaging section 30 are different from one another, and the imaging section 30 can capture images of an object present on the transmissive section contact surface 40 side that are incident via the plurality of regions of the transmissive section 43. The tactile sensor 1 can grasp the grasped object more accurately by observing the grasped object by both direct vision and reflected vision. That is, according to the above-described embodiment, the tactile sensor 1 can detect the gripping state more accurately.

[0056] Moreover, according to the above-described embodiment, the transmission section 43 includes a plurality of regions having different angles of normal to the imaging optical axis OA of the imaging section 30. The imaging section 30 can capture images of objects present on the transmission section contact surface 40 side that are incident via the plurality of regions of the transmission section 43. Therefore, the imaging section 30 can capture images of a wider range by direct vision compared to when the transmission section 43 is a flat surface. In other words, when the robot system control unit 90 moves the position of the tactile sensor module 10, the tactile sensor 1 can detect the image of the object. Therefore, the tactile sensor 1 in the above-mentioned embodiment can avoid collisions.

[0057] Furthermore, according to the above-described embodiment, the grip state detection unit 80 acquires the image captured by the imaging unit 30, and detects the contact state of the object with respect to the contact surface based on the acquired image. In other words, by including the gripping state detection unit 80, the robot system 100 can detect the gripping state of an object. The gripping state detection unit 80 provides information to the robot control unit 91, which can control the robot system 100.

[0058] The above describes the form for carrying out the present invention using an embodiment, but the present invention is not limited to such an embodiment, and various modifications and substitutions can be made within the scope that does not deviate from the spirit of the present invention. [Explanation of symbols]

[0059] 1...tactile sensor, 10...tactile sensor module, 11...sensor connection section, 100...robot system, 110...tip section, 120...upper arm section, 130...joint section, 140...lower arm section, 150...main horizontal axis section, 160...main vertical axis section, 170...base section, 90...robot system control section, 20...reflection section, 30...imaging section, 40...transparent section contact surface, 47...transparent section non-contact surface, 43...transparent section, 45...marker, 50...frame, 70...hard layer, 91...robot control section, 92...input section, 93...output section, 80...grasping state detection section, 81...image Acquisition unit, 82... image processing unit, 83... control unit, 84... reference state memory unit, A10... angle of view, OA... imaging optical axis, IA10... first incidence angle, RA10... first reflection angle, IA20... second incidence angle, RA20... second reflection angle, IA30... third incidence angle, RA30... third reflection angle, AR1... first imaging range, AR2... second imaging range, AR3... third imaging range, OB1... first object, OB2... second object, OB3... third object, RM... direct vision imaging marker, MM... reflected vision imaging marker, R... direct vision imaging image, M... reflected vision imaging image, P... imaging image

Claims

1. A transmission unit including a first surface capable of contacting a gripping object and a second surface that is a reverse surface of the first surface; an imaging section capable of imaging an image of an object present on the first surface side of the transmission section from the second surface side; a reflecting section that is disposed on the second surface side of the transmitting section and reflects light from at least a partial region of the transmitting section and guides the light to an imaging angle of view of the imaging section; Equipped with The imaging unit can capture a reflected image of the object to be grasped by the reflecting unit. Tactile sensor.

2. At least a part of the transmission portion is deformed along a shape of the object to be grasped that is in contact with the first surface, The imaging unit includes: Both an image of an object present on the first surface side and an image of a marker attached to the transparent portion that indicates the deformation of the transparent portion can be captured from the second surface side. The tactile sensor according to claim 1 .

3. The imaging unit includes: The imaging optical axis of the imaging section and the normal to the second surface of the transmission section are disposed to have an intersection. The tactile sensor according to claim 1 or 2.

4. The reflecting portion is a plurality of reflecting surfaces each having a different angle of a normal to an imaging optical axis of the imaging unit; The tactile sensor according to claim 1 or 3.

5. The imaging unit includes: A first image, which is an image of an imaging target area of ​​the transmission section formed by light incident without passing through the reflection section, and a second image, which is an image of an imaging target area of ​​the transmission section formed by light reflected by the reflection section and incident thereon, are both captured as images of the transmission section. The tactile sensor according to claim 1 .

6. The transmission portion is a plurality of regions each having a different angle of a normal to an imaging optical axis of the imaging unit; The imaging unit includes: The light transmitting portion is capable of capturing an image of an object present on the first surface side by the light incident through each of the plurality of regions of the transmitting portion. The tactile sensor according to claim 1 .

7. A tactile sensor according to any one of claims 1 to 6, a detection unit that acquires an image captured by the imaging unit and detects a contact state of an object with respect to the first surface based on the acquired image; A tactile sensor system comprising:

8. A transmission unit including a first surface capable of contacting a gripping object and a second surface that is a reverse surface of the first surface; an imaging section capable of imaging an image of an object present on the first surface side of the transmission section from the second surface side; a reflecting section that is disposed on the second surface side of the transmitting section and reflects light from at least a partial region of the transmitting section and guides the light to an imaging angle of view of the imaging section; Equipped with The imaging unit can capture a reflected image of the object to be grasped by the reflecting unit. A computer connected to the tactile sensor an image acquiring step of acquiring an image captured by the imaging unit; a detection step of detecting a contact state of an object with respect to the first surface based on the image acquired by the image acquisition step; A program that executes the following.

Images