Tactile presentation touch panel display

Abstract

We provide a haptic touch panel display with excellent design. [Solution] The tactile presentation touch panel display comprises a display panel 30 having a display area, a touch panel 20 positioned on the upper surface of the display panel or within the display area, a plurality of actuators 40 for vibrating the display panel, a translucent decorative film 10 supported in the display area of ​​the display panel, a haptic control circuit 50 for driving the plurality of actuators so that at least a portion of the translucent decorative film vibrates with respect to a first texture represented by the appearance of the translucent decorative film, and a control device 60 for controlling the display panel, touch panel and haptic control circuit.

Description

Technical Field

[0001] This disclosure relates to a tactile presentation touch panel display.

Background Art

[0002] For the purpose of providing good operability to users, touch panel displays with tactile presentation functions have been developed. For example, Patent Document 1 discloses a display device with a tactile presentation function capable of obtaining good visual and tactile sensations.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Such touch panel displays with tactile presentation functions are used in various applications, and depending on the form of use, excellent designability may be required. The purpose of this disclosure is to provide a tactile presentation touch panel display with excellent designability when the display is in black display.

Means for Solving the Problems

[0005] A tactile presentation touch panel display according to the embodiment of the present disclosure comprises: a display panel having a display area; a touch panel disposed on the upper surface of the display panel or within the display area; a plurality of actuators for vibrating the display panel; a translucent decorative film supported on the display area of ​​the display panel; a haptic control circuit for driving the plurality of actuators so that at least a portion of the translucent decorative film vibrates with respect to a first texture represented by the appearance of the translucent decorative film; and a control device for controlling the display panel, the touch panel and the haptic control circuit. [Effects of the Invention]

[0006] According to one embodiment of this disclosure, a translucent decorative film having a predetermined design is placed in the display area of ​​the display panel. As a result, when the tactile touch panel display is in a black display state, the predetermined design is visible in the display area of ​​the display panel. Thus, a tactile touch panel display is provided that can be harmonized with the surrounding interior design. [Brief explanation of the drawing]

[0007] [Figure 1] Figure 1 is a schematic diagram showing the instrument panel of a vehicle equipped with a tactile touch panel display according to the first embodiment. [Figure 2A] Figure 2A is a schematic diagram showing the appearance of a haptic touch panel display when it is not in operation. [Figure 2B] Figure 2B is a schematic diagram showing the appearance of a haptic touch panel display in operation. [Figure 3] Figure 3 is a schematic plan view of a haptic touch panel display. [Figure 4] Figure 4 is a schematic cross-sectional view of a haptic touch panel display. [Figure 5] Figure 5 is a block diagram showing the configuration of a haptic touch panel display. [Figure 6]Figure 6 is a flowchart showing the control of a tactile presentation touch panel display according to the first display mode. [Figure 7] Figure 7 is a flowchart showing the control of a tactile presentation touch panel display according to the first display mode. [Figure 8A] Figure 8A shows an example of image data in the first display mode. [Figure 8B] Figure 8B shows an example of the display appearance in the first display mode. [Figure 9] Figure 9 is a flowchart showing the control of a haptic presentation touch panel display according to the second display mode. [Figure 10] Figure 10 is a flowchart showing the control of a tactile presentation touch panel display according to the second display mode. [Figure 11A] Figure 11A shows an example of image data in the second display mode. [Figure 11B] Figure 11B shows an example of the display appearance in the second display mode. [Figure 12] Figure 12 shows an example of the application area in the second display mode. [Figure 13] Figure 13 is a flowchart showing the control of a haptic presentation touch panel display for presenting other tactile effects. [Figure 14] Figure 14 is a flowchart showing the control of a haptic presentation touch panel display for presenting other tactile effects. [Figure 15] Figure 15 is a flowchart showing the control of a haptic presentation touch panel display for presenting other tactile effects. [Figure 16] Figure 16 is a schematic cross-sectional view of a haptic presentation touch panel display according to a second embodiment. [Figure 17] Figure 17 is a schematic cross-sectional view of a haptic presentation touch panel display according to the third embodiment. [Modes for carrying out the invention]

[0008] Embodiments of the present disclosure will be described based on the drawings. The present disclosure is not limited to the following embodiments, and design changes can be made as appropriate within the scope that satisfies the configuration of the present disclosure. In the following description, the same reference numerals are commonly used for the same parts or parts having the same functions among different drawings, and repeated descriptions may be omitted. In addition, each configuration described in the embodiments and modification examples may be appropriately combined or changed without departing from the gist of the present disclosure. For the sake of clarity of explanation, in the drawings referred to below, the configuration may be shown in a simplified or schematic manner, or some components may be omitted. Also, the dimensional ratios between the components shown in each figure do not necessarily indicate the actual dimensional ratios.

[0009] The tactile presentation touch panel display of this embodiment is excellent in design and operability, and is suitably used, for example, as an information display terminal arranged on the instrument panel of an automobile that requires a high-class feeling, a display device and an input device arranged on the interior wall surface, a display device and an input device arranged on furniture and household appliances, etc. In the following, this embodiment will be described by taking an information terminal arranged on the instrument panel of a vehicle as an example.

[0010] (First Embodiment) FIG. 1 is a schematic diagram showing an instrument panel 200 of a vehicle equipped with a tactile presentation touch panel display 101 of this embodiment. The instrument panel 200 is located at the front part of the vehicle interior. In the present disclosure, tactile presentation (haptic) refers to a technology that gives a tactile sensation by applying force, vibration, movement, etc. to an operator.

[0011] The tactile presentation touch panel display 101 is disposed, for example, at the center of the instrument panel 200. In the present embodiment, the tactile presentation touch panel display 101 is an information display terminal, and can display various information of the vehicle, an operation screen for the vehicle, surrounding images captured by an in-vehicle camera, a map used in a car navigation system, traffic information and an operation screen, a screen of an application using various information that can be acquired through an Internet line, and the like.

[0012] The instrument panel 200 is disposed in front of the driver's seat 202 and the front passenger seat 203. The instrument panel 200 includes, for example, a main panel 200A disposed from the front of the driver's seat 202 to the front of the front passenger seat 203. A translucent decorative film 10 is disposed on the entire surface of the main panel 200A. The translucent decorative film 10 has a predetermined design that appears on the exterior. The predetermined design is, for example, a surface pattern of a material or a processing mark such as a wood grain of wood, a hairline processing of metal, a mirror finish, or the like. When the tactile presentation touch panel display 101 is used other than in a vehicle, the predetermined design may be a surface pattern of a material or a processing mark of various materials such as concrete, fabric, paper, and earthen wall. In the present embodiment, the translucent decorative film 10 has a wood grain design.

[0013] FIG. 2A shows an appearance when the tactile presentation touch panel display 101 presents a black display over the entire display area, and FIG. 2B is a schematic diagram showing a state in which the tactile presentation touch panel display 101 is operating and displaying an image other than the black display. The black display is a display in which the gradation value of each pixel is zero or a low gradation value equal to or less than a predetermined value. For example, when the gradation value is represented by 8 bits (0 to 255), the predetermined value is a gradation value of 10 or less. The black display is typically presented when the tactile presentation touch panel display 101 is in an OFF state in which it is not operating or in a standby state in which no image is being displayed. Alternatively, the black display may be presented to the operator by operating the tactile presentation touch panel display 101 and displaying an image in which the entire display area is represented by the black display.

[0014] As shown in Figure 2A, when the tactile touch panel display 101 displays a black image across its entire display area, only the wood grain pattern is visible on the tactile touch panel display 101. This wood grain pattern is continuous across the entire main panel 200A. Therefore, because the screen is not visible, the presence of the tactile touch panel display 101 is not noticeable, and the instrument panel 200 can present an excellent appearance.

[0015] On the other hand, as shown in Figure 2B, when the haptic presentation touch panel display 101 is operating, for example, the content image 301C and the icon image 301A are displayed within the display area 30r, and only the wood grain pattern is displayed in the background area 30b surrounding them, just as when the haptic presentation touch panel display 101 is not operating.

[0016] Figure 3 is a schematic plan view of the haptic touch panel display 101, and Figure 4 is a schematic cross-sectional view of the haptic touch panel display 101. Figure 5 is a block diagram showing the configuration of the haptic touch panel display 101.

[0017] The haptic presentation touch panel display 101 comprises a display panel 30, a touch panel 20, a touch panel control circuit 21, a translucent decorative film 10, a plurality of actuators 40, a haptic control circuit 50, and a control device 60.

[0018] The display panel 30 is, for example, a liquid crystal display, and there are no particular restrictions on the driving method. There are also no particular restrictions on the size of the display panel 30, and the size can be determined according to the application. The display panel 30 has a display area 30r, and any pixel in the display area 30r can be displayed with a brightness gradation value from the lowest (0) to the highest (for example, 255 with an 8-bit gradation value).

[0019] In this embodiment, since the tactile presentation touch panel display 101 is placed on the instrument panel 200, the size of the display panel 30 is, for example, 6 inches or more and 15 inches or less. In order to efficiently vibrate the display panel 30 with the actuator 40 as described later, it is preferable that the thickness of the display panel 30 be small.

[0020] In the configuration shown in Figure 4, the touch panel 20 is located on the top surface of the display panel 30. The touch panel 20 detects the position of contact with a finger or stylus in the display area 30r of the haptic presentation touch panel display 101. The touch panel 20 may be a touch panel of various types, such as capacitive, resistive, ultrasonic surface acoustic wave, or infrared. The touch panel 20 may be arranged on the display panel 30 in an in-cell, on-cell, or out-cell manner. In other words, part or all of the touch panel 20 may be located on the top surface of the display panel 30, or part or all of the touch panel 20 may be located inside the display panel 30.

[0021] Furthermore, the touch panel 20 may be a touch panel that detects position and pressure. The touch panel 20 may, for example, include a drive electrode, a position sense electrode and a pressure sense electrode, and a drive signal is applied to the drive electrode, the position sense electrode detects a change in capacitance due to contact by a finger or the like, and the pressure sense electrode detects a change in capacitance due to pressure by a finger or the like. Such a touch panel 20 is disclosed, for example, in Japanese Patent Application Publication No. 2021-128511. The disclosure of Japanese Patent Application Publication No. 2021-128511 is incorporated herein by reference.

[0022] As mentioned above, the translucent decorative film 10 has a design that replicates the surface pattern or processing marks of a material, such as the wood grain of wood or the hairline finish of metal. These designs can be formed, for example, by printing them on the surface of the translucent decorative film 10, or by laminating a protective film onto a film on which the design is printed. Such translucent decorative films 10 are commercially available and can be used commercially.

[0023] In this embodiment, the upper surface 10a of the translucent decorative film 10, at least within the display area 30r, is flat and has no irregularities. Because the upper surface 10a is flat, the light emitted from the display panel 30 is scattered by the upper surface 10a, which suppresses blurring of the image displayed by the display panel 30.

[0024] The translucent decorative film 10 is made of, for example, resin and transmits visible light. In areas where strong visible light is transmitted, the image created by visible light is visible from the outside, while the design becomes difficult to see.

[0025] Multiple actuators 40 are drive units that provide tactile feedback in the haptic touch panel display 101. The actuators 40 are positioned directly below the display panel 30, that is, in a position that overlaps with the display panel 30 in a plan view, and they vibrate the haptic touch panel display 101.

[0026] The actuator 40 is an element that converts electrical energy into mechanical energy through electromechanical conversion, and is specifically a piezoelectric element. For example, the actuator 40 preferably has a vibration surface with sides of about 9 mm to 30 mm, and vibrates at tens to hundreds of Hz when an AC voltage of about 10 V to 100 V is applied.

[0027] Multiple actuators 40 are supported by a support 41. For example, the support 41 has multiple storage spaces 41c, and the multiple actuators 40 are arranged in each of the multiple storage spaces 41c. The support 41 is positioned relative to the display panel 30 such that each actuator 40 in the storage space 41c is in contact with the display panel 30. For example, in this embodiment, the actuators 40 are arranged in a 4x5 grid relative to the display area 30r of the display panel 30.

[0028] The control device 60 includes a host computer and controls the touch panel 20, the display panel 30, and the actuator 40. Specifically, the control device 60 receives display image data to be displayed on the display panel 30 from an external source and outputs the display image data to the display panel 30.

[0029] The touch panel control circuit 21 periodically outputs drive signals to the electrodes of the touch panel 20 and receives detection signals from the touch panel in order to detect the operator's touch on the display area 30r. Furthermore, the touch panel control circuit 21 outputs the detection signals to the control device 60 at a predetermined interval.

[0030] The haptic control circuit 50 includes a microcontroller 51 and drivers 52 corresponding to the number of actuators 40 in order to drive the actuators 40. The microcontroller 51 receives, for example, position information from the control device 60 regarding which area of ​​the display area 30r the translucent decorative film should be vibrated, and texture information regarding what texture should be given to the operator. The microcontroller 51 then controls the drivers 52 so that the multiple actuators 40 vibrate according to the position information and texture information.

[0031] The microcontroller 51 controls the driver 52 so that a predetermined area of ​​the translucent decorative film 10 vibrates with respect to a texture represented by a predetermined design of the translucent decorative film 10 (first texture) and a different texture (second texture). The term "texture" can be used in various senses, but in this disclosure it is used primarily to mean touch or feel.

[0032] In this embodiment, since the example of a predetermined design is wood grain, the microcontroller 51 controls the driver 52 to vibrate the actuator 40 so that when the operator touches the translucent decorative film 10 with their finger, the user can feel the texture of wood grain (first texture). In addition, in areas where icons or the like are displayed, the microcontroller 51 controls the driver 52 to vibrate the actuator 40 so that when the operator touches the translucent decorative film 10 with their finger, the user can feel a texture different from wood grain (second texture).

[0033] (1) First display mode Next, the operation of the haptic presentation touch panel display 101 will be described. Figures 6 and 7 are flowcharts showing the control of the haptic presentation touch panel display 101 in the first display mode, and Figures 8A and 8B show examples of image data and display appearance. In the first display mode, only the content image is displayed in the display area 30r. Before the haptic presentation touch panel display 101 displays an image in the display area 30r, the wood grain pattern design of the translucent decorative film 10 is visible from the outside in the display area 30r, as shown in Figure 2A.

[0034] The control device 60 receives image data of the display image 301 shown in Figure 8A from an external source and outputs it to the display panel 30.

[0035] The display panel 30 displays the display image 301 in the display area 30r (S1). The display image 301 includes a content image 301C and a background image 301B, with the content image 301C and background image 301B located in the content area 30c and background area 30b of the display area 30r, respectively. In Figure 8A, the background image 301B is shown with shading, but the actual background image 301B is displayed as black with a gradation value of zero or a predetermined low gradation value.

[0036] As shown in Figure 8B, in the content area 30c, the light from the content image 301C passes through the translucent decorative film 10 placed on the display panel 30, making the content image 301C visible from the outside. On the other hand, in the background area 30b, since the background image 301B is displayed in black, there is little to no light transmitted. Therefore, in the background area 30b, the design of the translucent decorative film 10, namely the wood grain pattern, is visible from the outside.

[0037] The control device 60 extracts from the image data of the display image 301 an area where the grayscale value is zero or less than or equal to a predetermined value and is larger than a predetermined size (S2). For example, an area larger than a predetermined size is an area in the x-axis direction that is larger than the x-axis width of the content area 30c. By extracting an area under these conditions, the control device 60 can appropriately extract the background area 30b on which the background image 301B is located.

[0038] The control device 60 controls the haptic control circuit 50 and drives the actuator 40 so that the translucent decorative film 10 vibrates with the texture represented by the design of the translucent decorative film 10 in the extracted area, i.e., the background area 30b (S3). The control device 60 controls the haptic control circuit 50 so that the translucent decorative film 10 does not vibrate with the texture represented by the design of the translucent decorative film 10 in the area of ​​the display area 30r other than the extracted area, i.e., the content area 30c (S5). The control device 60 may control the haptic control circuit 50 so that the translucent decorative film 10 does not vibrate in the content area 30c, or it may control the haptic control circuit 50 so that the translucent decorative film 10 vibrates with a texture different from the texture represented by the design of the translucent decorative film 10.

[0039] The control device 60 receives the next frame image data of the display image 301 from an external source and outputs it to the display panel 30. The display panel 30 updates the display image 301 to be displayed in the display area 30r (S4). Furthermore, the control device 60 repeats the steps S2 to S4 described above.

[0040] According to this control, when the content image 301C is displayed within the display area 30r, the translucent decorative film 10 vibrates in the background area 30b, regardless of whether the user is touching it or not. However, the control device 60 may also cause the translucent decorative film 10 to vibrate only when the user touches the translucent decorative film 10.

[0041] As shown in Figure 7, the control device 60 receives image data of the display image 301 shown in Figure 8A from an external source and outputs it to the display panel 30. The display panel 30 displays the display image 301 in the display area 30r (S11).

[0042] When a user touches the upper surface 10a of the translucent decorative film 10 in the display area 30r of the haptic presentation touch panel display 101, the control device 60 obtains the user's touch position (x, y) from the detection signal received from the touch panel 20 (S12).

[0043] The control device 60 extracts an area from the image data of the display image 301 where the grayscale value is zero or less than or equal to a predetermined value and is larger than a predetermined size, and determines whether the touch position is within the background area 30b (S13).

[0044] If the touch position is within the background area 30b, the control device 60 controls the haptic control circuit 50 so that the translucent decorative film 10 vibrates in the background area 30b with a texture represented by the design of the translucent decorative film 10 (S14).

[0045] If the touch position is not in the background area 30b, the touch position is in the content area 30c. In this case, the control device 60 controls the haptic control circuit 50 so that the translucent decorative film 10 does not vibrate in the content area 30c due to the texture represented by the design of the translucent decorative film 10 (S15).

[0046] The control device 60 receives a detection signal from the touch panel 20 at a predetermined interval. If no user touch is detected from the detection signal (S16), the control device 60 controls the haptic control circuit 50 to stop the vibration of the translucent decorative film 10 (S17). If a user touch is detected, the steps S11 to S16 described above are repeated. In this way, the control device 60 can control the haptic control circuit 50 so that the translucent decorative film 10 vibrates in the background area 30b with the texture represented by the design of the translucent decorative film 10 while the touch position is detected within the background area 30b.

[0047] Thus, with the tactile presentation touch panel display 101 of this embodiment, when no image is displayed, in other words, when the entire display area is black, the design of the translucent decorative film 10 is presented. Therefore, compared to when the black area of ​​the display is presented when no image is displayed, the tactile presentation touch panel display 101 harmonizes with its surrounding components and presents a good appearance. For example, when the tactile presentation touch panel display 101 is installed on the instrument panel 200 of a vehicle, when no image is displayed, the presence of the display is not recognized, and a high-quality wood-grain appearance can be presented.

[0048] On the other hand, when the content image is displayed on the haptic presentation touch panel display 101, the content image is displayed by passing through the translucent decorative film 10. As a result, the design of the translucent decorative film 10 is displayed around the content image, so the bezel area of ​​the display is not visible, and the content image can be displayed in a high-quality manner.

[0049] Furthermore, by using display image data composed of a black background image surrounding the content image, the content image can be surrounded by the design of the translucent decorative film 10 even if its size is changed. As a result, blank spaces that would occur when displaying an image that does not match the size of the display area are not presented.

[0050] Furthermore, the texture of the design of the translucent decorative film 10 is obtained in the area where the design of the translucent decorative film 10 is presented. Since the design of the translucent decorative film 10 is recognized visually and tactilely, the user can be given the sensation that the actual material represented by the design of the translucent decorative film 10 is placed around the content image.

[0051] Furthermore, since the texture of the design of the translucent decorative film 10 is not available in the area where the content image is displayed, it is possible to suppress any sense of incongruity when touching the content image to perform input operations. By using the display image data including the background image described above, the design of the translucent decorative film 10 can surround the content image even if the size of the content image is changed. In addition, since there are no bumps or irregularities corresponding to the design of the translucent decorative film 10 in the area where the content image is displayed, it is possible to suppress the scattering and blurring of the content image due to bumps or irregularities.

[0052] (2) Second display method Next, an example of displaying content images and icons on the haptic presentation touch panel display 101 will be described. Figures 9 and 10 are flowcharts showing the case when content images and icons are displayed in the display area 30r of the haptic presentation touch panel display 101, and Figures 11A and 11B show examples of image data and display appearance in the second display mode, respectively. Figure 12 shows an example of the application area in the second display mode.

[0053] Similar to the first display mode, before the tactile presentation touch panel display 101 displays an image in the display area 30r, the wood grain pattern design of the translucent decorative film 10 is visible from the outside in the display area 30r, as shown in Figure 2A.

[0054] The control device 60 receives image data of the display image 302 shown in Figure 11A from an external source and outputs it to the display panel 30, which then displays the display image 302 in the display area 30r (S31). The display image 302 includes a content image 301C, a background image 301B, and an icon image 301A. The content image 301C, background image 301B, and icon image 301A are located in the content area 30c, background area 30b, and application area 30a of the display area 30r. As shown in Figure 11B, the control device 60 stores the position information of the application area 30a within the display area 30r.

[0055] Similar to the first display mode, the background image 301B is displayed in black. The icon image 301A also includes a symbol related to a function that is executed when selected by the user by touch. The symbol is depicted in, for example, a bright white or light color, and the background is shown in, for example, the same black as the background image 301B.

[0056] As shown in Figure 11B, in the content area 30c, the light from the content image 301C passes through the translucent decorative film 10 placed on the display panel 30, making the content image 301C visible from the outside. In the background area 30b, since the background image 301B is displayed in black, the wood grain pattern of the translucent decorative film 10 is visible.

[0057] In addition, in the application area 30a, the symbol of the icon image 301A is depicted in white or a light color. The background of the application area 30a shows a wood grain pattern that is continuous with the background area 30b.

[0058] The control device 60 extracts from the image data of the display image 302 an area where the grayscale value is zero or less than or equal to a predetermined value and which is larger than a predetermined size (S32). For example, an area larger than a predetermined size, as in the first display mode, is an area in the x-axis direction that is larger than the x-axis width of the content area 30c. This allows the control device 60 to appropriately extract the background area 30b on which the background image 301B is located.

[0059] The control device 60 controls the haptic control circuit 50 so that the translucent decorative film 10 vibrates in the extracted region, i.e., the background region 30b, with the texture represented by the design of the translucent decorative film 10 (S34).

[0060] The control device 60 extracts the application area 30a from the area of ​​the display area 30r other than the extracted background area 30b (S33), and controls the haptic control circuit 50 so that the translucent decorative film 10 vibrates with a texture different from the texture represented by the design of the translucent decorative film 10 (S35). Furthermore, the haptic control circuit 50 is controlled so that the translucent decorative film 10 does not vibrate in the area other than the application area 30a, i.e., the content area 30c (S36).

[0061] The control device 60 receives the next frame image data of the display image 302 from an external source and outputs it to the display panel 30. The display panel 30 updates the display image 302 to be displayed in the display area 30r (S37). Furthermore, the control device 60 repeats the steps S32 to S36 described above.

[0062] If the translucent decorative film 10 is to be vibrated only when the user touches it, the control device 60 controls the tactile presentation touch panel display 101 according to the flowchart shown in Figure 10.

[0063] Specifically, first, the control device 60 receives image data of the display image 302 shown in Figure 11A from an external source and outputs it to the display panel 30. The display panel 30 displays the display image 302 in the display area 30r (S41).

[0064] When a user touches the upper surface 10a of the translucent decorative film 10 in the display area 30r of the haptic presentation touch panel display 101, the control device 60 obtains the user's touch position (x, y) from the detection signal received from the touch panel 20 (S42).

[0065] The control device 60 extracts an area from the image data of the displayed image 302 in which the grayscale value is zero or less than or equal to a predetermined value and is larger than a predetermined size, as the background area 30b, and determines whether or not the touch position is within the background area 30b (S43).

[0066] If the touch position is within the background area 30b, the control device 60 controls the haptic control circuit 50 and drives the actuator 40 so that the translucent decorative film 10 vibrates in the background area 30b with the texture represented by the design of the translucent decorative film 10 (S45).

[0067] If the touch position is within the application area 30a, the control device 60 controls the haptic control circuit 50 and drives the actuator 40 so that the translucent decorative film 10 vibrates in the application area 30a with a texture different from the texture represented by the design of the translucent decorative film 10 (S46).

[0068] Furthermore, if a touch position is located in an area other than the background area 30b and the application area 30a, i.e., in the content area 30c, the haptic control circuit 50 is controlled to stop the actuator so that the translucent decorative film 10 does not vibrate (S47).

[0069] The control device 60 receives a detection signal from the touch panel 20 at a predetermined interval. If no user touch is detected from the detection signal (YES in S48), the control device 60 controls the haptic control circuit 50 to stop the vibration of the translucent decorative film 10 (S49). If a user touch is detected (NO in S48), the steps S42 to S48 described above are repeated. In other words, if the touch position is within the background area 30b, the control device 60 vibrates the translucent decorative film 10 in the background area 30b with a texture represented by the design of the translucent decorative film 10, and if the touch position is within the application area 30a, the control device 60 vibrates the translucent decorative film 10 in the application area 30a with a texture different from the texture represented by the design of the translucent decorative film 10. Furthermore, if the touch position is within the content area 30c, the control device 60 does not vibrate the translucent decorative film 10 in the content area 30c.

[0070] According to the second display mode, when an icon is displayed in the display area 30r, the area of ​​the icon vibrates with a texture different from the texture of the design of the translucent decorative film 10. As a result, the user can recognize that they have touched the icon and obtain a superior tactile sensation.

[0071] (3) Other tactile effects 1 The haptic presentation touch panel display 101 may present the user with haptic effects other than those described above.

[0072] For example, in the display image 302 shown in Figure 11B, the background image may be set so that there are variations in the wood grain pattern of the translucent decorative film 10 shown in the background area 30b, and the vibration intensity of the translucent decorative film 10 may be changed according to the variations in the wood grain pattern. Specifically, as shown in Figure 11B, the display effect area 30e is placed in the wood grain pattern shown in the background area 30b. In the display effect area 30e, the center is brighter and the wood grain pattern is fainter, and it becomes darker and the wood grain pattern is darker towards the outside. For example, by placing such a display effect area 30e, it is possible to obtain the effect that the icon image 301A located above the display effect area 30e appears to stand out.

[0073] To achieve this type of display, for example, as shown in Figure 11A, data for a display image 302 is prepared in which a display effect image 301E is placed within a background image 301B, where the grayscale value is high in the center and decreases towards the periphery.

[0074] Figures 13 and 14 are flowcharts showing the control of the haptic presentation touch panel display 101 when the display effect area 30e is displayed in the display area 30r of the haptic presentation touch panel display 101.

[0075] The control device 60 receives image data of the display image 302 shown in Figure 11A from an external source and outputs it to the display panel 30, which then displays the display image 302 in the display area 30r (S51). As a result, the content image 301C and the icon image 301A shown in Figure 11A are displayed in the display area 30r, and a wood grain pattern with a brightened display effect area 30e is displayed in the background area 30b.

[0076] The control device 60 controls the haptic control circuit 50 so that the vibration intensity changes in the background region 30b according to the distribution of grayscale values ​​of the background image 301B. Specifically, the control device 60 extracts the background region 30b from the display region 30r, divides the background region 30b into meshes of an appropriate size, and calculates the average grayscale value within the divided meshes, similar to the first display mode. Furthermore, the control device 60 controls the haptic control circuit so that the translucent decorative film vibrates at the coordinates of each section with an intensity corresponding to the calculated average grayscale value (S52). For example, if the average grayscale value is small, the vibration intensity is increased, and if the average grayscale value is large, the vibration intensity is decreased.

[0077] The control device 60 receives the next frame image data of the display image 302 from an external source and outputs it to the display panel 30. The display panel 30 updates the display image 302 to be displayed in the display area 30r (S53). Furthermore, the control device 60 repeats the steps S51 to S53 described above.

[0078] If the translucent decorative film 10 is to be vibrated only when the user touches it, the control device 60 controls the tactile presentation touch panel display 101 according to the flowchart shown in Figure 14.

[0079] First, the control device 60 receives image data of the display image 302 shown in Figure 11A from an external source and outputs it to the display panel 30. The display panel 30 displays the display image 302 in the display area 30r (S61).

[0080] When a user touches the upper surface 10a of the translucent decorative film 10 in the display area 30r of the haptic presentation touch panel display 101, the control device 60 obtains the user's touch position (x, y) from the detection signal received from the touch panel 20 (S62).

[0081] The control device 60 controls the haptic control circuit 50 so that the translucent decorative film 10 vibrates with an intensity corresponding to the grayscale value of the touch position when the touch position is within the background area 30b (S63). Specifically, for example, the vibration intensity is increased when the grayscale value is small, and decreased when the grayscale value is large.

[0082] The control device 60 receives a detection signal from the touch panel 20 at a predetermined interval. If no user touch is detected from the detection signal (S64), the control device 60 controls the haptic control circuit 50 to stop the vibration of the translucent decorative film 10 (S65). If a user touch is detected, steps S61 to S64 described above are repeated.

[0083] By implementing this type of control, users can obtain textures that match the visual effects. Therefore, users can experience a superior sense of control.

[0084] (4) Other tactile effects 2 Furthermore, the haptic touch panel display 101 may present the user with effects that assist the user's touch input. For example, in the display images 302 shown in Figures 11A and 11B, when the user's touch position moves beyond the boundary B between the background area 30b and the content area 30c, a texture may be presented to inform the user that the touch position has moved to a different area.

[0085] Figure 15 is a flowchart showing the control of the tactile presentation touch panel display 101 when providing such notifications.

[0086] First, the control device 60 receives image data of the display image 302 shown in Figure 11A from an external source and outputs it to the display panel 30. The display panel 30 displays the display image 302 in the display area 30r (S71).

[0087] When a user touches the upper surface 10a of the translucent decorative film 10 in the display area 30r of the haptic presentation touch panel display 101, the control device 60 obtains the user's touch position (x, y) from the detection signal received from the touch panel 20 (S72).

[0088] The control device 60 determines whether the touch position is (a) in the background area 30b, or (b) outside the background area 30b and outside the application area, i.e., in the content area 30c (S73).

[0089] If the touch position is in the background area 30b, the control device 60 controls the haptic control circuit 50 so that the translucent decorative film 10 vibrates in the background area 30b with a texture represented by the design of the translucent decorative film 10 (S74).

[0090] The control device receives a detection signal from the touch panel 20 at a predetermined interval (S75) and determines whether the detected position is within the content area 30c (S76). If the detected position is not within the content area 30c, steps S75 and S76 are repeated.

[0091] It is determined whether the touch position is within the content area 30c (S76). If the detected position is not within the content area 30c, steps S75 and S76 are repeated.

[0092] If the touch position is in the content area 30c, the touch position has moved beyond the boundary between the background area 30b and the content area 30c. In this case, the control device 60 controls the haptic control circuit 50 so that the translucent decorative film 10 vibrates more strongly at the touch position within the content area 30c, which is the area after the movement (S77). The vibration at this time is greater than the vibration in step S74.

[0093] The control device 60 receives a detection signal from the touch panel 20 at a predetermined interval. If no user touch is detected from the detection signal (S78), the control device 60 controls the haptic control circuit 50 to stop the vibration of the translucent decorative film 10 (S79). If a user touch is detected, steps S71 to S78 described above are repeated.

[0094] Furthermore, in step S73, if the touch position is in the content area 30c, the control device 60 controls the haptic control circuit 50 so that the translucent decorative film 10 does not vibrate (S80).

[0095] The control device 60 receives a detection signal from the touch panel 20 at a predetermined interval (S81) and determines whether the detection position is within the background area 30b (S82). If the detection position is not within the background area 30b, steps S81 and S82 are repeated.

[0096] If the touch position is in the background area 30b, the touch position has moved beyond the boundary between the content area 30c and the background area 30b. In this case, the control device 60 controls the haptic control circuit 50 so that the translucent decorative film 10 vibrates more strongly at the touch position within the background area 30b, which is the area after the movement (S83). The vibration at this time is greater than the vibration in step S74.

[0097] When the touch position moves beyond the boundary between the content area 30c and the background area 30b, the control device 60 controls the haptic control circuit 50 so that the translucent decorative film 10 vibrates more strongly at the touch position in the area after the movement than the vibration of the translucent decorative film 10 in step S74.

[0098] The control device 60 receives detection signals from the touch panel 20 at predetermined intervals. If no user touch is detected from the detection signal (S78), the control device 60 controls the haptic control circuit 50 to stop the vibration of the translucent decorative film 10 (S79). If a user touch is detected, steps S71 to S78S described above are repeated.

[0099] With this type of control, when the user's touch position moves between the background area 30b and the content area 30c, the user can more clearly recognize that the area being touched is moving through touch. Therefore, the haptic presentation touch panel display 101 can present the user with superior operability.

[0100] In the above explanation, we described the case where the touch position moves between the background area 30b and the content area 30c, but the above control may also be performed when the touch position moves between the background area 30b and the application area 30a. Also, the vibration intensity in step S77 and the vibration intensity in step S83 may be the same or different.

[0101] Furthermore, in the above embodiment, movement to a different area is detected by a change in touch position, and the haptic control circuit 50 is controlled to cause the translucent decorative film 10 to vibrate more strongly. However, the translucent decorative film 10 may be configured to vibrate more strongly by other control methods. For example, a band-shaped boundary area including the boundary between the background area 30b and the content area 30c may be provided, and the translucent decorative film 10 may vibrate more strongly when the touch position is within the boundary area.

[0102] (Second Embodiment) Figure 16 is a schematic cross-sectional view of the tactile touch panel display 102 of this embodiment. The tactile touch panel display 102 differs from the first embodiment in that the display panel 30' is a self-emissive panel. Specifically, the display panel 30' is a self-emissive panel such as an organic EL panel or a micro LED panel. Because the display panel 30' is a self-emissive panel, the thickness of the display panel 30' can be made smaller compared to the case where it is a liquid crystal panel. This allows the vibrations of the actuator 40 located on the back to be transmitted to the translucent decorative film 10 with greater vibration.

[0103] (Third embodiment) Figure 17 is a schematic cross-sectional view of the tactile presentation touch panel display 103 of this embodiment. The tactile presentation touch panel display 103 differs from the first embodiment in that the translucent decorative film 10 has irregularities 10d on its upper surface 10a.

[0104] Preferably, the uneven surface 10d has a shape corresponding to the design of the translucent decorative film 10. If the design of the translucent decorative film 10 is wood grain, the uneven surface 10d is also distributed in a shape corresponding to the wood grain design. Furthermore, it is preferable that the uneven surface 10d does not significantly degrade the display characteristics of the tactile presentation touch panel display 103 of this embodiment. Specifically, it is preferable that the height of the uneven surface 10d is set small enough so that the image displayed in the display area 30r does not become blurry or smudged.

[0105] When the haptic control circuit 50 vibrates the actuator 40, the haptic control circuit 50 drives the actuator 40 so that the bumps 10d can be felt more strongly in the background area 30b. In the content area 30c, the actuator 40 is driven so that the bumps 10d are less easily felt.

[0106] By creating irregularities 10d on the upper surface 10a of the translucent decorative film 10 in this way, it becomes possible to make the texture of the design of the translucent decorative film 10 more strongly felt by the user, and even if the translucent decorative film 10 is made of resin or the like, it is possible to obtain a visual and tactile sensation as if it were made of real material.

[0107] (Other forms) The tactile presentation touch panel display of this disclosure is not limited to the embodiments described above, and various modifications may be made. For example, the display modes and display effects described in the first embodiment may be realized in the tactile presentation touch panel displays of the second and third embodiments. Furthermore, the control method for the tactile presentation touch panel display described in each embodiment is not limited to the procedures shown in the flowcharts referenced in each embodiment, but may be performed by other procedures.

[0108] Furthermore, the number and arrangement of the actuators 40, and the structure of the support 41 that supports the actuators 40, are not limited to the above embodiment. Partitions or the like that can be provided between multiple actuators 40 to suppress vibrations.

[0109] The haptic touch panel display of this disclosure can also be described as follows:

[0110] The haptic presentation touch panel display relating to the first configuration is: A display panel having a display area, In the aforementioned display area, a touch panel is located on the upper surface of the display panel or within the display panel, Multiple actuators that vibrate the aforementioned display panel, A translucent decorative film supported in the display area of ​​the display panel, A haptic control circuit that drives the plurality of actuators so that at least a portion of the translucent decorative film vibrates in a first texture represented by the appearance of the translucent decorative film, A control device that controls the display panel, the touch panel, and the haptic control circuit, It is equipped with.

[0111] According to the first configuration, when no image is displayed, the design of the translucent decorative film is presented. Therefore, compared to the case where the black area of ​​the display in the OFF state is presented, the tactile presentation touch panel display harmonizes with its surrounding components and presents a good appearance. In addition, in the area where the design of the translucent decorative film 10 is presented, the texture of the design of the translucent decorative film is obtained, and the user can be given the feeling that the actual material shown by the design of the translucent decorative film is placed around the content image.

[0112] In the second configuration of the haptic presentation touch panel display, in the first configuration, the display panel displays a content image in a part of the display area, the translucent decorative film transmits the content image, and the control device may drive the haptic control circuit to drive the plurality of actuators so that the translucent decorative film does not vibrate in the content area where the content image is displayed.

[0113] In the third configuration of the haptic presentation touch panel display, in the second configuration, the control device may receive data of a display image, including the content image, that is displayed in the display area from an external source, output it to the display panel, detect a background area from the display image in which a background image is located that has a grayscale value of less than or equal to a predetermined value and is larger than a predetermined size, and control the haptic control circuit in the background area so that the translucent decorative film vibrates with the first texture.

[0114] In the fourth configuration of the haptic presentation touch panel display, the control device may control the haptic control circuit in the background region such that the intensity of the vibration changes according to the distribution of the grayscale values ​​of the background image.

[0115] In the fifth configuration, the haptic presentation touch panel display, in the fourth configuration, includes an image of an icon indicating an operation on the haptic presentation touch panel display, and the control device may control the haptic control circuit so that the translucent decorative film vibrates with a second texture different from the first texture in the application area of ​​the display area where the icon is placed.

[0116] In the sixth configuration of the haptic presentation touch panel display, in the third configuration, the touch panel transmits a detection signal to a control device at a predetermined period, the control device obtains a touch position from the detection signal, and while the touch position is detected within the background area, the haptic control circuit may be controlled so that the translucent decorative film with the first texture vibrates within the background area.

[0117] In the seventh configuration of the haptic presentation touch panel display, in the third configuration, the touch panel transmits a detection signal to a control device at a predetermined period, the control device obtains a touch position from the detection signal, and when the touch position moves beyond the boundary between the content area and the background area, the haptic control circuit may be controlled such that the translucent decorative film vibrates more strongly at the touch position in the area after the movement than the vibration of the translucent decorative film in the background area.

[0118] In the eighth configuration of the haptic presentation touch panel display, in the third configuration, the translucent decorative film has irregularities on its surface, and the control device may control the haptic control circuit so that the first texture is emphasized by the irregularities.

[0119] In the tactile presentation touch panel display according to the ninth configuration, the display panel may be a liquid crystal display panel in any one of the first to eighth configurations.

[0120] In the tenth configuration of the tactile presentation touch panel display, the display panel may be a self-illuminating panel in any one of the first to eighth configurations.

[0121] The vehicle according to the 11th configuration comprises a tactile presentation touch panel display according to any one of the first to eighth configurations, and an instrument panel on which the tactile presentation touch panel display is arranged, wherein the translucent decorative film of the instrument panel and the translucent decorative film of the tactile presentation touch panel display are integrally continuous. [Explanation of Symbols]

[0122] 10…Translucent decorative film, 10a…Top surface, 10d…Texture, 20…Touch panel, 21…Touch panel control circuit, 30,30'…Display panel, 30a…Application area, 30b…Background area, 30c…Content area, 30e…Display effect area, 30r…Display area 40...Actuator, 41...Support, 41c...Storage space, 50...Haptic control circuit 51...Microcontroller, 52...Driver, 60...Control device, 101~103...Haptic touch panel display, 101a...Display surface, 200...Instrument panel, 200A...Main panel, 202...Driver's seat, 203...Passenger seat, 301...Display image, 301A...Icon image, 301B...Background image, 301C...Content image, 301E...Display effect image, 302...Display image

Claims

1. A display panel having a display area, In the aforementioned display area, a touch panel is located on the upper surface of the display panel or within the display panel, Multiple actuators that vibrate the aforementioned display panel, A translucent decorative film supported in the display area of ​​the display panel, A haptic control circuit that drives the plurality of actuators so that at least a portion of the translucent decorative film vibrates in a first texture represented by the appearance of the translucent decorative film, A control device that controls the display panel, the touch panel, and the haptic control circuit, A haptic touch panel display equipped with tactile feedback.

2. The display panel displays a content image in a portion of the display area. The light-transmitting decorative film allows the content image to pass through, The control device causes the haptic control circuit to drive the plurality of actuators so that the translucent decorative film does not vibrate in the content area where the content image is displayed. The tactile presentation touch panel display according to claim 1.

3. The control device is A display image including the aforementioned content image, which receives data of the display image displayed in the display area from an external source and outputs it to the display panel. From the displayed image, a background region is detected in which a background image is located that has a grayscale value less than or equal to a predetermined value and is larger than a predetermined size. The haptic control circuit is controlled so that the translucent decorative film vibrates in the background region with respect to the first texture, according to claim 2.

4. The control device is The haptic control circuit is controlled in the background region such that the intensity of the vibration changes according to the distribution of the grayscale values ​​of the background image, as described in claim 3.

5. The display image includes an image of an icon indicating an operation on the tactile touch panel display, The control device is The haptic display touch panel display according to claim 4, wherein the haptic control circuit is controlled so that the translucent decorative film vibrates with a second texture different from the first texture in the application area of ​​the display area where the icons are arranged.

6. The touch panel transmits a detection signal to the control device at a predetermined interval. The control device is The touch position is obtained from the aforementioned detection signal. The haptic display touch panel display according to claim 3, wherein the haptic control circuit is controlled so that the translucent decorative film vibrates in the background region with the first texture while the touch position is detected within the background region.

7. The touch panel transmits a detection signal to the control device at a predetermined interval. The control device is The touch position is obtained from the aforementioned detection signal. The haptic presentation touch panel display according to claim 3, wherein when the touch position moves beyond the boundary between the content area and the background area, the haptic control circuit is controlled such that the translucent decorative film vibrates more strongly at the touch position in the area after the movement than the vibration of the translucent decorative film in the background area.

8. The aforementioned translucent decorative film has an uneven surface, The control device controls the haptic control circuit so that the first texture is emphasized by the irregularities, as described in claim 3 for the tactile presentation touch panel display.

9. The tactile touch panel display according to any one of claims 1 to 8, wherein the display panel is a liquid crystal display panel.

10. The tactile presentation touch panel display according to any one of claims 1 to 8, wherein the display panel is a self-illuminating panel.

Images