Tactile sample presentation system, tactile sample presentation method and ar tactile sample

Abstract

To provide a tactile sample presentation system capable of presenting various kinds of impression to an evaluator.SOLUTION: A tactile sample presentation system 1 includes: a tactile sample 10 including a material piece 11 having arbitrary physical properties; a camera 23 configured to image the tactile sample 10; an image database 42 configured to hold a plurality of texture images D1 having a visual impression element; an image processing part 41 configured to generate a texture sample image D3 corresponding to the tactile sample 10 from a texture image D1 selected from the image database 42; and an image presentation part 43 configured to present a cross-reality tactile sample 50 with the texture sample image D3 imparted to the tactile sample 10.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a tactile sample presentation system, a tactile sample presentation method, and an AR tactile sample. [Background technology]

[0002] In the housing equipment, interior design, and fashion industries, material samples (touch samples), which are actual pieces of materials directly attached to a mount, are used during business negotiations, etc. They are highly valued because both the provider and the purchaser can see and touch the material sample to directly check the appearance and feel of the material. However, in order to create such material samples, it is necessary to procure the actual materials, which increases the time and cost required for production. Therefore, a material sample made of a printed material that imitates the texture of the actual material has been proposed. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2002-67468 A [Patent Document 2] JP 2003-223108 A Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, not only have the materials used in real life become more diverse, but the tastes of evaluators (purchasers) have also become more diverse. For this reason, the demand for material samples with a wide variety of material pieces is increasing year by year. Even with the same material, different colors can change the tactile sensation and impression. There are an infinite number of combinations of material appearances and textures. In order to respond to the preferences of evaluators, it is necessary to present a wide variety of material pieces. However, with conventional material samples, there is a limit to how many material pieces can be increased, making it difficult to present material pieces that correspond to the evaluator's preferences, etc. Therefore, an object of the present invention is to provide a tactile sample presentation system and the like that can present a wide variety of sensations to an evaluator. [Means for solving the problem]

[0005] The present invention encompasses the following aspects. [1] A tactile sample presentation system comprising: a tactile sample consisting of a piece of material having any physical properties; a camera for capturing an image of the tactile sample; an image database for holding a plurality of texture images having visual impression elements; an image processing unit for generating a texture sample image corresponding to the tactile sample from the texture image selected from the image database; and an image presentation unit for presenting a cross-reality tactile sample in which the texture sample image is applied to the tactile sample. [2] The tactile sample presentation system according to [1], further comprising a camera for capturing an image of the tactile sample, the image presentation unit being a display for displaying the tactile sample image acquired from the camera, and the display presenting an AR tactile sample in which the texture sample image is superimposed on the tactile sample image. [3] The tactile sample presentation system according to [1], wherein the image presentation unit is a video-transmitting or optically-transmitting head-mounted display, and the head-mounted display presents an MR tactile sample in which the texture sample image is superimposed on a transmitted image of the tactile sample. [4] The tactile sample presentation system according to any one of [1] to [3], wherein the image processing unit generates a composite texture image by alpha-blending the two texture images. [5] The tactile sample presentation system according to [4], wherein one of the texture images is a color image and the other is a pattern image. [6] The tactile sample presentation system according to any one of [1] to [5], wherein the image processing unit performs a trimming process on the area of ​​the texture sample image that is hidden by the evaluator's finger when the evaluator touches the tactile sample. [7] The tactile sample presentation system according to any one of [1] to [6], wherein the tactile sample is at least partially made of resin, the outer periphery of the sample is shape-stably maintained, and the front and back surfaces are opened to form a tactile confirmation area. [8] A tactile sample presentation method comprising: a tactile sample presentation step of presenting a tactile sample made of a piece of material having given physical properties; an imaging step of imaging the tactile sample with a camera; a texture image selection step of selecting a desired texture image from an image database that holds a plurality of texture images having visual impression elements; an image processing step of generating a texture sample image corresponding to the tactile sample from the texture image selected from the image database; and an image presentation step of presenting a cross-reality tactile sample in which the texture sample image is imparted to the tactile sample. [9] An AR tactile sample comprising a tactile sample made of a piece of material having any physical properties, and a texture sample image obtained by adding a texture image having a visual impression element to an image of the tactile sample. Effect of the Invention

[0006] The present invention provides a tactile sample presentation system and a tactile sample presentation method that can present a wide variety of sensations to an evaluator. [Brief description of the drawings]

[0007] [Figure 1] 1 is a schematic diagram showing a schematic configuration of a tactile sample presentation system 1. FIG. [Diagram 2] FIG. 1 shows a tactile sample 10. [Diagram 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of a computer 20. [Figure 4] FIG. 2 is a diagram illustrating an example of the software configuration of a computer 20. [Diagram 5] FIG. 11 is a flow chart showing a tactile sample presentation method. [Figure 6] FIG. 13 is a diagram illustrating the generation of an AR haptic sample 52, showing a texture image selection step S3. [Figure 7] 1A and 1B are diagrams for explaining the generation of an AR tactile sample 52, showing (A) an image processing step S4 and (B) an image presentation step S5. [Figure 8] FIG. 13 is a diagram showing image processing when the texture sample image D3 and the evaluator's finger overlap. [Figure 9] 1A and 1B are diagrams showing a tactile sample 15, in which (A) is a plan view and (B) is a cross-sectional view. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] The present invention will be described in detail below. Note that the following description of the constituent elements is merely an example for explaining the present invention, and the present invention is not limited to the contents thereof.

[0009] [Tactile sample presentation system] FIG. 1 is a schematic diagram showing the general configuration of a tactile sample presentation system 1. As shown in FIG. The tactile sample presentation system 1 of this embodiment uses AR technology, and includes a tactile sample 10 and a computer 20.

[0010] <Texture sample 10> FIG. 2 is a diagram showing the tactile sample 10. As shown in FIG. The tactile sample 10 is a material sample whose surface is directly touched by an evaluator with his / her finger to feel (sense) the tactile sensation. The tactile sample 10 has one or more material pieces 11 formed, for example, in the shape of a quadrilateral sheet or plate. The material piece 11 is attached to a mount such as cardboard and placed on a flat surface such as a table. The evaluator may hold the tactile sample 10 in his / her hand or change the position and orientation of the tactile sample 10 as long as it is within the range (angle of view) that can be captured by a camera 23, which will be described later.

[0011] The material piece 11 is, for example, a building material for a house, and the material (raw material) thereof is arbitrary. The material of the material pieces 11 is, for example, polyurethane. The material pieces 11 may also be polyethylene, polypropylene, ethylene-propylene copolymer, polybutadiene, polyvinyl acetate, polyester, polyacrylic, polyamide, polystyrene, or the like. The material pieces 11 may also be viscoelastic polymers such as natural rubber and latex, gel-like substances, or the like. The material pieces 11 may also be paper, wood, metal, plaster, diatomaceous earth, mortar, rocks, or the like. The physical properties of the portion (surface) of the material piece 11 that the evaluator touches with his / her finger are arbitrary. The physical properties are physical properties of the material piece 11, such as mass, density, volume, surface properties, elastic modulus (Young's modulus), thermal conductivity, refractive index, etc. Electrical and magnetic properties are also included. Depending on the physical properties of the material piece 11, an evaluator who touches the surface with his / her finger can feel various tactile sensations (memorize them). When the material piece 11 is made of polyurethane, the Young's modulus can be changed by changing the degree of cross-linking of the urethane, and the softness of the material when touched can be changed.

[0012] The size (area) of material piece 11 is also arbitrary. For example, when checking the tactile sensation by rubbing the surface of material piece 11 with a fingertip, the size may be slightly larger than the index finger of an evaluator (length 30 mm, width 50 mm). For example, when checking the tactile sensation by pinching the material piece 11 with the fingertips, the material piece needs to be large enough to be pinched between the evaluator's thumb and index finger (50 mm long, 50 mm wide). The thickness of the material piece 11 is preferably 50 μm or more and 20 mm or less. If the material piece 11 has a thickness in this range, the evaluator can touch or pinch it with his / her fingers.

[0013] An AR marker 12 is attached to the mount on which the material piece 11 is attached, and serves as a guide when detecting the position and orientation of the material piece 11. When there are multiple material pieces 11, one AR marker 12 is attached to each material piece 11. The AR marker 12 is preferably a designated marker that reads a dedicated marker image, but may also be a free marker that uses a free design. When a designated marker is used as the AR marker 12, for example, a marker called a ChArUco board can be used. Also, a marker consisting of a square black frame and a predetermined pattern drawn inside the black frame can be used.

[0014] <Computer 20 (hardware configuration)> FIG. 3 is a diagram illustrating an example of a hardware configuration of the computer 20. As shown in FIG. The computer 20 is, for example, a desktop personal computer, and is placed near the tactile sample 10 . The computer 20 includes a control unit 21, an operation unit 22, a camera 23, a display 24, and the like.

[0015] The control unit 21 includes a CPU 31 , a display I / F 37 , and the like, and controls the computer 20 in an integrated manner. The CPU 31 reads out a control program stored in the ROM 32, and executes and controls various functions of the computer 20, such as image capture, image processing, image synthesis, image projection, and the like. The RAM 33 is used as a temporary storage area such as a main memory and a work area for the CPU 31 .

[0016] The HDD 34 is a large-capacity storage unit that holds (stores) a plurality of image data and various programs. The HDD 34 stores a wide variety of texture images D1. The texture image D1 is an image having visual impression elements, and includes, for example, a color image D1a and a pattern image D1b. The visual impression elements are color, pattern, gloss, texture, etc., and give an impression when touched (tactile impression) based on their appearance (visual sensation). For example, red is an element that gives the observer a sense of warmth. The color image D1a is an image having a large number of colors represented by the three attributes of color: hue, lightness, and saturation. The color image D1a includes not only chromatic images but also achromatic images. The pattern image D1b is an image that imitates the appearance (surface texture) of various materials. For example, it is an image having irregular patterns such as unevenness, wood grain, ripples (water surface), marble, etc., and geometric patterns such as checks, stripes, and dots. In addition, it may be an image that includes not only one pattern, but also multiple patterns. If the visual impression elements of the texture image D1 deviate too far from the physical properties (such as unevenness) of the sample piece 11, the evaluator will feel uncomfortable when touching the sample piece 11. For this reason, it is desirable that the visual impression elements of the texture image D1 are similar to the physical properties of the sample piece 11.

[0017] The operation unit I / F 35 is an interface that connects the operation unit 22 and the control unit 21. The operation unit 22 is equipped with a mouse, keyboard, etc., and accepts operations / inputs / instructions from the evaluator.

[0018] The camera I / F 36 is an interface that connects the camera 23 and the control unit 21. The camera 23 captures an image of the imaging target (the tactile sample 10) and inputs image data of the imaging target (tactile sample image Dc) to the control unit 21 via the camera I / F 36. The camera 23 is fixedly disposed above the tactile sample 10.

[0019] The display I / F 37 is an interface that connects the display 24 and the control unit 21 . The display 24 displays an image (tactile sample image Dc) of the tactile sample 10 captured by the camera 23. The display 24 is fixedly disposed between the evaluator and the tactile sample 10. The evaluator is allowed to touch the tactile sample 10 (material piece 11) with his / her fingertips while viewing the tactile sample image Dc displayed on the display 24.

[0020] <Computer 20 (Software Configuration)> FIG. 4 is a diagram showing an example of the software configuration of the computer 20. As shown in FIG. The computer 20 includes an image processing unit 41, a data management unit 42, a display control unit 43, and the like.

[0021] The image processing unit 41 appropriately instructs various processes to the data management unit 42 and the display control unit 43. In particular, the image processing unit 41 processes and modifies (renders) the image (texture image D1) stored in the HDD 34 and the image (touch sample image Dc) captured by the camera 23. The image processing section 41 functions as the image processing section of the present invention.

[0022] The image processing unit 41 is a so-called AR engine, which is software for expressing AR (Augmented reality). It is sometimes expressed as an AR framework, and commercially available software is also available. For example, OpenCV, an open source library developed and published by Intel Corporation in the United States, can be used. The image processing unit 41 generates an image expressing AR (texture sample image D3). Specifically, the image processing unit 41 selects a desired texture image D1 from the texture images D1 stored in the HDD 34, and processes the texture image D1 to generate a texture sample image D3 that corresponds to (is superimposed on) the captured image of the tactile sample 10 (tactile sample image Dc). When generating the texture sample image D3, a composite texture image D2 obtained by alpha-blending two texture images D1a and D1b can also be used. In other words, the texture sample image includes not only one texture image D1 that has been processed, but also two texture images D1 that have been processed and synthesized. One of the two texture images is a color image D1a, and the other is a pattern image D1b.

[0023] Furthermore, when the evaluator touches the surface of the tactile sample 10, the image processing section 41 processes the texture sample image D3. When the evaluator's fingertip touches the surface of the material piece 11, the fingertip and the texture sample image D3 overlap, that is, the texture sample image D3 is projected onto the upper surface of the fingertip. Therefore, the area of ​​the texture sample image D3 that overlaps with the evaluator's finger (where the surface of the material piece 11 is hidden by the finger) is trimmed, so that the texture sample image D3 is not projected onto the upper surface of the fingertip.

[0024] The data management section 42 stores and manages information relating to the tactile sample 10, information relating to images stored in the HDD 34, and various settings. The data management unit 42 cooperates with the HDD 34 to function as the image database of the present invention.

[0025] The display control unit 43 displays various images on the display 24 based on instructions from the image processing unit 41. The display control unit 43 displays images generated by the image processing unit 41 and images captured by the camera 23. The display control unit 43 cooperates with the display 24 to function as an image presentation unit of the present invention.

[0026] [Method of presenting tactile samples] The tactile sample provision method of this embodiment is carried out using the tactile sample provision system 1 described above. FIG. 5 is a flow chart showing a tactile sample presentation method. 6 and 7 are diagrams for explaining the generation of the AR haptic sample 52 (cross reality haptic sample 50). Fig. 6 shows the texture image selection step S3, Fig. 7(A) shows the image processing step S4, and Fig. 7(B) shows the image presentation step S5.

[0027] The tactile sample presentation method includes a tactile sample presentation step S1, an imaging step S2, a texture image selection step S3, an image processing step S4 (texture image synthesis S41, AR image generation S42), and an image presentation step S5. The tactile sample presentation method further includes an image trimming processing step S6, and an image modification determination step S7.

[0028] <Tactile sample presentation process S1> In the tactile sample presentation step S1, a tactile sample 10 made of a material having predetermined physical properties is presented. The tactile sample 10 is placed within reach of the evaluator and within a range where the camera 23 can capture an image.

[0029] <Imaging process S2> In the imaging step S2, the tactile sample 10 is imaged by the camera 23. The camera 23 outputs the image of the tactile sample 10 (tactile sample image Dc) to the data management section 42 of the computer 20 (see FIG. 6).

[0030] <Texture image selection process S3> In the texture image selection step S3, an arbitrary image is selected from the multiple texture images D1 held by the data management unit 42. The image may be selected by the image processing unit 41 according to a predetermined rule or may be selected randomly. Alternatively, a plurality of texture images D1 may be displayed on the display 24 of the computer 20, and the evaluator may use the operation unit 22 to select any two texture images D1 from among them (see FIG. 6). For example, eight texture images D11 to D18 are displayed. Texture images D11 to D14 are color images D1a, and texture images D15 to D18 are pattern images D1b. Of the selected texture images D1, one is color image D1a, and the other is pattern image D1b. For example, texture image D12 is selected from color image D1a, and texture image D17 is selected from pattern image D1b. In addition to selecting one each of the color image D1a and the pattern image D1b, it is also possible to select either the color image D1a or the pattern image D1b.

[0031] <Image processing step S4> In the image processing step S4, a texture sample image D3 corresponding to the surface of the material piece 11 of the tactile sample 10 is generated based on the texture image D1 selected in the texture image selection step S3. The texture sample image D3 is an image expressing AR, and is generated by processing and synthesizing the texture image D1. The image processing step S4 includes texture image synthesis S41 and AR image generation S42.

[0032] (Texture image synthesis S41) The texture image synthesis S41 is executed when one color image D1a and one pattern image D1b are selected in the texture image selection step S3. The image processing unit 41 generates a composite texture image D2 by alpha-blending two texture images D1 (a color image D1a and a pattern image D1b) (see FIG. 7(A)). Alpha blending is the process of overlaying two images and synthesizing them based on the transparency (alpha value) set for each pixel. It allows you to see the image behind the transparent image overlapping through the transparent image.

[0033] The alpha value used when combining the color image D1a and the pattern image D1b can be set arbitrarily. The alpha value ranges from 0 to 255, with 0 representing a completely transparent image and 255 representing a completely opaque image. The alpha value may be always set to a predetermined value (e.g., 128) or may be set randomly each time. In addition, the alpha value may also be set when the evaluator selects the texture image D1 in the texture image selection step S3. It should be noted that if only one of the color image D1a and the pattern image D1b is selected in the texture image selection step S3, the alpha value is set to, for example, 255 (completely opaque). When two texture images D1 are alpha blended, a wide variety of texture sample images D3 can be generated by arbitrarily setting the alpha value.

[0034] (AR image generation S42) In the AR image generation S42, the texture image D1 or the composite texture image D2 is processed to generate a texture sample image D3. As described above, the texture sample image D3 is an image that expresses AR, and is an image that is superimposed on the tactile sample image Dc. The image processing unit 41 processes the texture image D1 or the synthetic texture image D2 to generate image data (texture sample image D3) having the same shape as the surface of the material piece 11 displayed in the tactile sample image Dc (see FIG. 7(A)). Next, the image processing unit 41 superimposes (combines) this texture sample image D3 onto the surface of the material piece 11 in the tactile sample image Dc.

[0035] Position information and the like of the surface of the material piece 11 in the tactile sample image Dc is determined using the AR marker 12. To realize AR, it is essential to obtain position information of the tactile sample 10 (material piece 11). Highly accurate position recognition of the material piece 11 is required to avoid giving the evaluator a sense of incongruity. Therefore, the AR marker 12 is imaged by the camera 23, and image recognition technology is used to obtain position information of the material piece 11. This type of position recognition is called a vision-based type or an image recognition type. When the AR marker 12 has a square black frame and a predetermined pattern drawn inside the black frame, the AR marker 12 is detected using the black frame, and the AR marker 12 is identified by the pattern inside the black frame. The pattern inside the black frame is then compared with the pattern file stored in the HDD 24, and the matching rate is calculated, so that the AR marker 12 is correctly detected. Furthermore, accurate position information of the material piece 11 is obtained by comparing the marker coordinate system calculated by extracting the outline of the AR marker 12 with the relative coordinates of the tactile sample 10 and the AR marker 12 stored in the HDD 24.

[0036] Based on the position information acquired using the AR marker 12, the texture sample image D3 is superimposed on the surface of the material piece 11 in the tactile sample image Dc (see FIG. 7(B)). The texture sample image D3 is placed in the same position as the surface of the material piece 11. In an image (AR image Dr) in which the texture sample image D3 is synthesized with the tactile sample image Dc, the surface of the material piece 11 and the texture sample image D3 perfectly match. In this manner, by superimposing the texture sample image D3 on the tactile sample image Dc, an AR image Dr capable of expressing AR is generated.

[0037] <Image presentation step S5> In the image presenting step S5, the AR image generated by the image processing unit 41 is presented to the evaluator. That is, the image processing unit 41 outputs an AR image Dr in which the texture sample image D3 is superimposed (applied) on the tactile sample image Dc to the display control unit 43. Then, the display control unit 43 causes the display 24 to display this AR image Dr (see FIG. 7(B)).

[0038] As a result, the tactile sample 10 is presented within reach of the evaluator, and the AR image Dr displayed on the display 24 is also presented in front of the evaluator. In other words, an AR tactile sample 52 (cross-reality tactile sample 50) consisting of the tactile sample 10 and the AR image Dr is presented to the evaluator. The evaluator can touch the surface of the material piece 11 of the tactile sample 10 while looking at the AR image Dr displayed on the display 24. The evaluator can use his / her sense of touch to feel (observe) the physical properties of material piece 11 by touching the surface of material piece 11 with his / her fingertips. The physical properties of material piece 11 include the surface properties, Young's modulus, thermal conductivity, etc. of material piece 11. The surface properties give the evaluator a tactile sensation of roughness, unevenness, friction, etc., the Young's modulus gives the evaluator a tactile sensation of hardness or softness, and the thermal conductivity gives the evaluator a tactile sensation of hot / cold.

[0039] When the evaluator touches the tactile sample 10 (piece of material 11) while looking at the AR image Dr displayed on the display 24 (without looking at the tactile sample 10), a cross-modal interaction (interaction between senses) occurs. Cross-modal interaction is an interaction between different senses, and in this embodiment occurs through touch and vision. That is, when the evaluator recognizes the real piece of material 11 through touch while recognizing the virtual piece of material 11 (AR image Dr) through vision, the integration of touch and vision produces a sensation that cannot be obtained through touch or vision alone. That is, the tactile sensations recognized by the evaluator, such as roughness, unevenness, friction, hardness / softness, and hot / coldness of the piece of material 11, change.

[0040] Specifically, when a warm color image is superimposed on the material piece 11, the evaluator feels a warmer touch than when the material piece 11 is left as is without a color image. Also, when a cool color image is superimposed on the material piece 11, the evaluator feels a cooler touch than when the material piece 11 is left as is without a color image. Also, when a wood grain pattern image is superimposed on the material piece 11, the evaluator feels a natural warmth and calmness more than when the material piece 11 is left as is without a pattern image. In this way, by using the AR tactile sample 52, it is possible to realize a material sample that presents a plurality of tactile sensations to the evaluator even with a single material piece 11. In other words, it is possible to realize a material sample that presents a wide variety of sensations to the evaluator with little effort, even without preparing a plurality of different material pieces 11.

[0041] <Image trimming process S6> FIG. 8 is a diagram showing image processing when the texture sample image D3 and the evaluator's finger overlap. When the evaluator touches the actual material piece 11 while looking at the image (AR image Dr) of the material piece 11, the evaluator's finger is reflected in the tactile sample image Dc. The texture sample image D3 is then superimposed on the image of the evaluator's finger. This may give the evaluator who viewed the AR image Dr a strange feeling, which may result in a change in the tactile sensation of the material piece 11. Therefore, the image processing unit 41 performs a trimming process (cropping process) on the area of ​​the texture sample image D3 that is hidden by the evaluator's finger when the evaluator touches the material piece 11 of the texture sample 10. The image trimming process is performed using an existing method. As a result, the AR image Dr is presented only to the area excluding the evaluator's finger on the surface of the material piece 11. Therefore, it is possible to provide the AR tactile sample 52 that does not give the evaluator a sense of incongruity when he or she sees the AR image Dr.

[0042] <Image change determination process S7> Finally, it is determined (selected) whether to continue the tactile sample presentation method, in other words, whether to present again the AR tactile sample 52 that gives a different impression. If the evaluator desires an AR tactile sample 52 that gives a different impression, he or she issues an instruction to continue presenting the tactile sample via the operation unit 22. Upon receiving the instruction to continue, the image processing unit 41 returns to the texture image selection step S3 and repeats the texture image selection step S3 to the image trimming processing step S6. On the other hand, when the evaluator issues an instruction to end the tactile sample presentation from the operation unit 22, the tactile sample presentation method ends.

[0043] In this way, the tactile sample presentation system and tactile sample presentation method of this embodiment can present a wide variety of sensations to the evaluator by using the AR tactile sample 52 (cross-reality tactile sample 50) that utilizes cross-modal interaction. In other words, a plurality of tactile textures and tactile impressions (virtual tactile sensations, pseudo-tactile sensations) can be presented to the evaluator who touches the tactile sample 10 (material piece 11) of the AR tactile sample 52. Even if the tactile sample 10 consists of only one material piece 11, it is possible to present a plurality of different sensations to the evaluator. This eliminates the need to prepare a plurality of different material pieces 11, and allows the cost and time required for producing the tactile sample 10 to be significantly reduced. The size and weight of the tactile sample 10 can also be reduced. Furthermore, the cost of disposing of the tactile sample 10 can also be reduced.

[0044] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention.

[0045] The present invention can present a cross-reality tactile sample 50 using XR (Cross Reality / Extended reality) technology, which is a general term for technologies that combine the real world and the virtual world. That is, although the case of using AR (Augmented reality) technology has been described, the present invention is not limited to this. When a head mounted display is used as the display 24, an MR tactile sample using MR (Mixed Reality) technology can be presented as the cross reality tactile sample 50. The head mounted display presents an AR image Dr in which a texture sample image D3 is superimposed on a transparent image of the tactile sample 10. Furthermore, as the cross-reality haptic sample 50, a VR haptic sample using VR (Virtual Reality) technology may be presented.

[0046] FIG. 9 shows a tactile sample 15, where (A) is a plan view and (B) is a cross-sectional view. The tactile sample 10 is not limited to one in which the tactile confirmation area is only on the front side (material piece 11), but may also be one in which the back side (rear side) is also included (tactile sample 15). The tactile sample 15 has a material piece 16 at least partly made of resin, and the outer periphery of the material piece 16 is held in a shape-stably manner. A front surface 16a and a back surface 16b are exposed (released) to form a tactile confirmation area. The evaluator can touch not only the front surface 16a of the material piece 16 but also both surfaces (front surface 16a and back surface 16b) of the material piece 16. This allows the evaluator to hold or pinch the material piece 16 between his / her index finger and thumb, and to grasp the tactile sensation such as hardness and thickness.

[0047] The tactile samples 10, 15 are not limited to having one material piece 11, 16. The tactile samples 10, 15 may each have a plurality of material pieces 11, 16. When there are a plurality of material pieces 11, 16, there may be one AR marker 12 or a plurality of AR markers 12 (for example, arranged at the four corners of a mount). Also, one AR marker 12 may be arranged for each material piece 11, 16.

[0048] The shape of the material pieces 11, 16 is not limited to a rectangle (quadrangle), and may be a circle, an ellipse, or even a sphere (semisphere).

[0049] Although a desktop personal computer has been used as the computer 20 in the above description, the present invention is not limited to this. A notebook PC, a tablet PC, a smartphone, or other portable computer may also be used. When a portable computer is used, the evaluator may use a camera mounted on the portable computer to capture an image of the tactile sample 10. Then, the position information of the camera 23 and the display 24 is obtained using a GPS mounted on the portable computer.

[0050] A mobile display or a head-mounted display may be used as the display 24. The head-mounted display may be of a so-called sealed type, an optical transmission type, or a video transmission type. When a video-transmitting head-mounted display is used, the camera 23 mounted on the video-transmitting head-mounted display captures an image of the tactile sample 10. In addition, the position information of the camera 23 and the display 24 is obtained using a GPS mounted on the video-transmitting head-mounted display.

[0051] The position and orientation of the material piece 11 may be detected by a markerless method without using the AR marker 12. For example, the four corners or feature points of the mount on which the material piece 11 is attached or the desk on which the texture sample 10 is placed are used instead of the AR marker 12. [Explanation of symbols]

[0052] 1. Tactile sample presentation system 10 Texture Sample 11 Material pieces 15 Texture Sample 16 material pieces 16a surface 16b Back 12 AR Marker 20 Computers 21 Control section 22 Control section 23 Camera 24 Display (image display unit) 31 CPU 32 ROM 33 RAM 34 HDD (image database) 41 Image processing section 42 Data Management Department (Image Database) 43 Display control unit (image presentation unit) 50 Cross reality texture samples 51 AR tactile sample Dc Texture Sample Image D1 Texture Image D1a color image D1b Pattern image D2 Synthetic Texture Image D3 Texture Sample Image Dr AR Images

Claims

1. A tactile sample consisting of a piece of material having any physical property; A camera for capturing an image of the tactile sample; an image database that stores a plurality of texture images having visual impression elements; an image processing unit that generates a texture sample image corresponding to the tactile sample from the texture image selected from the image database; an image presentation unit that presents a cross-reality tactile sample obtained by adding the texture sample image to the tactile sample; A tactile sample presentation system comprising:

2. the image presentation unit is a display that displays a tactile sample image acquired by the camera, The tactile sample presentation system according to claim 1 , wherein the display presents an AR tactile sample in which the texture sample image is superimposed on the tactile sample image.

3. the image display unit is a video-transmitting or optical-transmitting head-mounted display, 2. The tactile sample presentation system according to claim 1, wherein the head mounted display presents an MR tactile sample in which the texture sample image is superimposed on a transparent image of the tactile sample.

4. The tactile sample presentation system according to claim 1 , wherein the image processing unit generates a composite texture image by alpha-blending the two texture images.

5. 5. The tactile sample presentation system according to claim 4, wherein one of the texture images is a color image and the other is a pattern image.

6. 2. The tactile sample presentation system according to claim 1, wherein said image processing section performs a trimming process on said texture sample image to remove an area hidden by a finger of said evaluator when said evaluator touches said tactile sample.

7. 2. The tactile sample presentation system according to claim 1, wherein the tactile sample is at least partially made of resin, the outer periphery of the sample is held in a shape-stably manner, and the front and back surfaces are opened to form a tactile confirmation area.

8. a tactile sample providing step of providing a tactile sample made of a material piece having any physical property; an imaging step of imaging the tactile sample with a camera; a texture image selection step of selecting a desired texture image from an image database that holds a plurality of texture images having visual impression elements; an image processing step of generating a texture sample image corresponding to the tactile sample from the texture image selected from the image database; an image presenting step of presenting a cross-reality tactile sample obtained by adding the texture sample image to the tactile sample; The tactile sample presentation method includes the steps of:

9. A tactile sample consisting of a piece of material having any physical property; a texture sample image obtained by adding a texture image having a visual impression element to the image of the tactile sample; and An AR tactile sample consisting of:

Images