Haptic feedback device, haptic feedback method, and vehicle
The tactile presentation device addresses the safety and convenience issue by using a flexible layer and fluid-driven deformation to provide tactile feedback at any touched position, ensuring safe and cost-effective operation without requiring visual attention.
Patent Information
- Application Number
- PCT/JP2024/014482
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-31
- Filing Date
- 2024-04-10
- Publication Date
- 2024-12-05
AI Technical Summary
Existing tactile presentation devices require users to visually recognize the tactile presentation position, which can be unsafe and inconvenient, especially in applications like vehicles where attention should not be diverted from the primary task.
A tactile presentation device with a flexible layer and a regulation layer, where a tactile sensation generating unit moves to the contact area of the user and deforms the flexible layer by suctioning or discharging fluid through through holes, allowing tactile feedback at any touched position without the need for visual attention, using a fluid as a driving source for remote operation and cost-effective structure.
Enables safe and convenient tactile feedback at any user-contacted position without the need for visual attention, simplifying the device structure and reducing costs by allowing fluid-driven deformation of the flexible layer, providing different tactile sensations through shape changes and friction variations.
Smart Images

Figure JP2024014482_05122024_PF_FP_ABST
Abstract
Description
Tactile presentation device, tactile presentation method, and vehicle
[0001] The present disclosure relates to a tactile presentation device that presents a tactile sensation to a user, a tactile presentation method, and a vehicle having a tactile presentation device.
[0002] Various tactile presentation devices are known. For example, Patent Document 1 discloses a tactile presentation device equipped with a surface deformation device that uses a fluid transfer device and deforms by expanding and contracting the surface depending on whether or not a fluid is supplied (paragraph 0037). Patent Document 2 discloses an electronic device that can provide feedback to a user at any time on the results of the user's operation of a deformation interface (paragraph 0005).
[0003] International Publication No. 2019 / 044111 International Publication No. 2020 / 090266
[0004] Typically, the tactile presentation position of a tactile presentation device is specified, so the user can recognize the tactile presentation position by visual inspection. However, there are cases where it is desirable to avoid shifting one's gaze for safety or convenience reasons.
[0005] In view of the above circumstances, an object of the present disclosure is to provide a tactile presentation device that does not require a user to visually recognize a tactile presentation position.
[0006] A tactile presentation device according to one embodiment of the present disclosure comprises: a flexible layer whose surface is exposed so as to be touchable by a user and which is flexible and deformable; a defining layer whose surface faces the back surface of the flexible layer and defines the shape of the flexible layer; and a tactile generation unit that faces the back surface of the defining layer and moves to a position corresponding to a contact portion of the flexible layer that is a portion of the flexible layer that the user touches, and deforms the contact portion of the flexible layer.
[0007] When presenting a tactile sensation at a specified position, the tactile sensation presentation position is literally specified, so the user's attention needs to be directed to the tactile sensation presentation position. However, the present invention can present a tactile sensation to any position that the user touches. In particular, in in-vehicle applications, there is no need to direct the user's gaze or attention to the tactile sensation presentation position, ensuring safety. By moving and driving the tactile sensation generation unit to any position that the user touches, there is no need to cover the entire surface with tactile sensation generation units, which simplifies the structure and contributes to cost reduction.
[0008] The defining layer may have a plurality of through holes drilled facing the flexible layer, and the tactile generating unit may deform the flexible layer by sucking and / or ejecting fluid into the flexible layer through at least one of the through holes in the defining layer.
[0009] When using a fluid as the driving source, remote operation and driving at any position (driving possible according to the flow path configuration) are suitable. When using external air as the driving source, installation is possible regardless of location. In addition, since the surface shape is changed by suction and discharge of fluid, the structure is simple and contributes to cost reduction.
[0010] The tactile generation unit may have an annular member that contacts the back surface of the stipulating layer, and may suck the fluid in a fluid chamber defined by the back surface of the stipulating layer and inside the annular member, and may deform the area of the flexible layer defined by the shape of the annular member by sucking the fluid from the inner fluid chamber.
[0011] The user can tactilely recognize that the contact area of the flexible layer has been transformed into an uneven surface by the change in friction state.
[0012] The tactile sensation generating unit may have an inner annular member that contacts the back surface of the stipulating layer, and an outer annular member that contacts the back surface of the stipulating layer and surrounds the inner annular member, and may deform the area of the flexible layer defined by the shape of the inner annular member by sucking in the fluid in an outer fluid chamber defined by the back surface of the stipulating layer, the inner annular member, and the outer annular member, and sucking and / or discharging the fluid into an inner fluid chamber defined inside the back surface of the stipulating layer and the inner annular member.
[0013] In this embodiment, fluid may be drawn from the outer fluid chamber to define the deformation area of the flexible layer.
[0014] The tactile sensation generating unit may be configured to: place the inner annular member around one through hole corresponding to the contact area; suck the fluid in the inner fluid chamber to draw the flexible layer into the through hole and deform the flexible layer into a concave surface; and eject the fluid into the inner fluid chamber to bulge the flexible layer and deform the flexible layer into a convex surface.
[0015] In this embodiment, a common contact area can be transformed into two different shapes, thereby presenting different tactile sensations to the user.
[0016] The tactile sensation generating unit may include: placing the inner annular member over a plurality of minute through holes corresponding to the contact area; sucking the fluid in the inner fluid chamber to draw the flexible layer into the plurality of minute through holes and deforming the flexible layer into an uneven surface; and ejecting the fluid into the inner fluid chamber to bulge the flexible layer and deform the flexible layer into a convex surface.
[0017] In this embodiment, a common contact area can be deformed into two different shapes, and different tactile sensations can be presented to the user.
[0018] The tactile sensation generating unit may vibrate the flexible layer by repeatedly suctioning and discharging the fluid from the internal fluid chamber.
[0019] The shape change that provides the tactile sensation and the friction change seen microscopically are state changes between a concave surface and a convex surface, and it is preferable to use negative pressure and positive pressure fluid as the driving source.
[0020] The defining layer may have a plurality of through-holes of different sizes, and the tactile sensation generating unit may present different tactile sensations by sucking and / or ejecting the fluid into the plurality of through-holes of different sizes.
[0021] This allows the user to be presented with a combination of different tactile sensations, or tactile sensations that change periodically over time.
[0022] The haptic generation unit may further move in the thickness direction of the flexible layer.
[0023] This may result in a more positive airtight and liquidtight state.
[0024] The tactile presentation device may further include a sensor that detects the contact area on the flexible layer.
[0025] The sensor detects resistance, capacitance, piezoelectricity, fluid pressure, amount of received light, sound, or a combination of these.
[0026] A tactile presentation method according to one embodiment of the present disclosure is a tactile presentation method using a tactile presentation device having: a flexible layer whose surface is exposed so that it can be touched by a user and is flexible and deformable; a definition layer whose surface faces the back surface of the flexible layer and defines the shape of the flexible layer; and a tactile generation unit, wherein the tactile generation unit moves to a position facing the back surface of the definition layer and corresponding to a contact area of the flexible layer that is the area of the flexible layer that the user will touch, and the tactile generation unit deforms the contact area of the flexible layer.
[0027] A vehicle according to one embodiment of the present disclosure is equipped with a tactile presentation device having: a flexible layer whose surface is exposed so as to be touchable by a user and which is flexible and deformable; a defining layer whose surface faces the back surface of the flexible layer and defines the shape of the flexible layer; and a tactile generation unit that faces the back surface of the defining layer and moves to a position corresponding to a contact portion of the flexible layer that is a portion of the flexible layer that the user touches, and deforms the contact portion of the flexible layer.
[0028] 1 is a perspective view showing a main part of a tactile presentation device according to a first embodiment of the present disclosure; FIG. 2 is a side view showing a main part of a tactile presentation device; FIG. 3 is a schematic diagram showing a modification of the tactile presentation device; FIG. 4 is a diagram showing a hardware configuration of the tactile presentation device; FIG. 5 is a diagram showing an operation flow of the tactile presentation device; FIG. 6 is an exploded perspective view showing a main part of a tactile presentation device according to a second embodiment of the present disclosure; FIG. 7 is a top view showing a tactile generation unit; FIG. 8 is a top view showing a definition layer and a part of the tactile generation unit; FIG. 9 is a side view showing a main part of the tactile presentation device; FIG. 10 is a schematic diagram showing a modification of the tactile presentation device; FIG. 11 is a block diagram showing an example configuration of a vehicle; FIG. 12 is a diagram showing an example of a sensing area;
[0029] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.
[0030] I. First Embodiment
[0031] 1. Main parts of the tactile presentation device
[0032] Fig. 1 is a perspective view showing a main part of a tactile presentation device according to a first embodiment of the present disclosure, and Fig. 2 is a side view showing the main part of the tactile presentation device.
[0033] The tactile presentation device 1 includes a flexible layer 100 , a regulation layer 200 , and a tactile generation unit 300 .
[0034] The flexible layer 100 has an exposed surface 101 that can be touched by a user. The flexible layer 100 constitutes the surface (flat or curved) of an object that a user normally touches with their fingers. For example, the flexible layer 100 may constitute an interior wall surface of a house that functions as an in-house interface, or the surface of various electronic devices that function as a tactile display. Furthermore, the flexible layer 100 may constitute an in-vehicle console that functions as an operation interface, an in-vehicle steering wheel that functions as an operation system or danger notification interface, or an interior surface of the vehicle.
[0035] The user touches any part of the surface 101 of the flexible layer 100. The part of the surface 101 of the flexible layer 100 that the user touches is called the contact part 103. The contact part 103 is not a specific part of the flexible layer 100, but a part that the user's fingers touch at will, and is a different part each time. The flexible layer 100 is flexible and deformable. The material of the flexible layer 100 may be, for example, a silicone material or urethane. For example, if the material of the flexible layer 100 is a silicone material, it may have a Shore A hardness of about 40 and a thickness of about 1 mm.
[0036] The surface 201 of the regulatory layer 200 faces the back surface 102 of the flexible layer 100. Typically, the surface 201 contacts the back surface 102 of the flexible layer 100. Unlike the flexible layer 100, the regulatory layer 200 is not flexible and does not deform even when a user touches the flexible layer 100. The regulatory layer 200 may be made of, for example, stainless steel. For example, if the regulatory layer 200 is made of stainless steel, its thickness may be approximately 1 mm. The regulatory layer 200 defines the shape of the flexible layer 100 (the shape before deformation and the shape after deformation). In other words, it can be said that the regulatory layer 200 defines the tactile sensation presented to a user who touches the flexible layer 100.
[0037] The defining layer 200 has a plurality of through holes 203 drilled facing the rear surface 102 of the flexible layer 100. The through holes 203 penetrate from the front surface 201 to the rear surface 202 of the defining layer 200. In this example, each through hole 203 has a slit-like, elongated, approximately rectangular shape in a planar view. The width of each through hole 203 (the length of the short side of the approximately rectangular shape) is, for example, about 4 mm. The multiple through holes 203 are aligned in a row parallel to one another at a constant pitch (for example, about 6 mm) in the width direction. The shape of each through hole 203 in a planar view and the arrangement of the multiple through holes 203 can be arbitrarily selected to achieve the shape of the flexible layer 100 after deformation, in other words, a shape that realizes a tactile sensation presented to the user. Conversely, the shape of the flexible layer 100 after deformation, or in other words, the tactile sensation presented to the user, is determined by the shape of each through hole 203 in a planar view and the arrangement of the multiple through holes 203.
[0038] The tactile generation unit 300 faces the rear surface 202 of the regulation layer 200. The tactile generation unit 300 moves to a position corresponding to (typically facing) a contact portion 103 of the flexible layer 100 from the user, and deforms the contact portion 103 of the flexible layer 100. The tactile generation unit 300 has a main body 310 and an annular member 320.
[0039] The main body 310 has a surface 311 facing the back surface 202 of the defining layer 200. Typically, when the defining layer 200 is flat, the surface 311 of the main body 310 is also flat. The interior of the main body 310 is a space that forms an internal space (not shown). A layer-side opening 312 opens into the surface 311 of the main body 310. The layer-side opening 312 communicates with the internal space of the main body 310. A pump-side opening 314 opens into a surface of the main body 310 other than the surface 311 (a side surface 313 in this example). The pump-side opening 314 communicates with the internal space of the main body 310. In other words, the pump-side opening 314 communicates with the layer-side opening 312 via the internal space. Fluid can move from the layer-side opening 312 via the internal space to the pump-side opening 314. Conversely, fluid can move from the pump-side opening 314 via the internal space to the layer-side opening 312. The fluid may be a gas or a liquid, typically air.
[0040] The annular member 320 is provided on the surface 311 of the main body 310 and has an annular shape, for example, like an O-ring. The annular member 320 is installed so as to surround the layer-side opening 312 on the surface 311. The annular member 320 is made of an airtight material, such as rubber. The annular member 320 faces the back surface 202 of the defining layer 200. The annular member 320 is in close contact with the back surface 202 of the defining layer 200, and makes a fluid chamber 321, which is a space defined between the back surface 202 of the defining layer 200 and the inside of the annular member 320, airtight and liquidtight.
[0041] The tactile generating unit 300 moves on the rear surface 202 side of the regulation layer 200 by a movement mechanism (not shown). For example, the tactile generating unit 300 can move back and forth along one axis (arrows in FIGS. 1 and 2 ), along two axes, or freely on a plane parallel to the rear surface 202 of the regulation layer 200. The tactile generating unit 300 may also be movable in a direction perpendicular to the rear surface 202 of the regulation layer 200 (thickness direction of the flexible layer 100 and the regulation layer 200). If the flexible layer 100 and the regulation layer 200 are not flat but have a three-dimensional shape, the tactile generating unit 300 also moves three-dimensionally so as to come into close contact with the rear surface 202 of the regulation layer 200. The movement mechanism of the tactile generating unit 300 may be, for example, a one-axis stage, a two-axis stage, or a three-axis stage using a ball screw or pulley, or a linear transport stage such as a magnetic levitation type.
[0042] 2. Behavior of the tactile presentation device
[0043] FIG. 3 shows a schematic diagram of a modification of the tactile presentation device.
[0044] A contact area 103 on the surface 101 of the flexible layer 100 made by the user is detected by a sensor 401 (described later). Then, the tactile generation unit 300 moves to a position on the flexible layer 100 corresponding to the contact area 103 made by the user. The annular member 320 of the tactile generation unit 300 contacts the back surface 202 of the regulating layer 200 or faces the back surface 202 of the regulating layer 200 with a small gap therebetween. At this point, the annular member 320 may be in close contact with the back surface 202 of the regulating layer 200, and the fluid chamber 321 defined between the back surface 202 of the regulating layer 200 and the inside of the annular member 320 may or may not be in an airtight and liquidtight state. The tactile generation unit 300 may be moved upward toward the regulating layer 200 by a moving mechanism so that the annular member 320 of the tactile generation unit 300 approaches the back surface 202 of the regulating layer 200, thereby more actively creating an airtight and liquidtight state.
[0045] Fluid (air) is sucked through the layer-side opening 312 of the main body 310. A fluid chamber 321 defined between the rear surface 202 of the defining layer 200 and the inside of the annular member 320 becomes airtight and liquid-tight. Specifically, the fluid (air) in the fluid chamber 321 is discharged from the pump-side opening 314 via the layer-side opening 312 and the internal space. As a result, the fluid (air) in the fluid chamber 321 becomes negative pressure (e.g., −50 KPa), and the flexible layer 100 adheres to the defining layer 200. The portions of the flexible layer 100 facing the multiple through-holes 203 of the defining layer 200 are drawn into the multiple through-holes 203. As a result, a region including the contact portion 103 on the surface 101 of the flexible layer 100, specifically, a region of the flexible layer 100 defined by the shape of the inner circumference of the annular member 320, is deformed into an uneven surface. The user can tactilely recognize that the contact area 103 has been transformed into an uneven surface by the change in the friction state.
[0046] When the suction of the fluid is stopped and the negative pressure of the fluid (air) in the fluid chamber 321 returns to atmospheric pressure, the portions of the flexible layer 100 that were drawn into the through-holes 203 of the defining layer 200 escape from the through-holes 203 and return to a flat state. Note that stopping the suction includes discharging the fluid and not suctioning or discharging the fluid.
[0047] Furthermore, by alternately and continuously repeating suction and suction stop, flexible layer 100 can be vibrated.
[0048] Specific examples of materials for the flexible layer 100 and the defining layer 200 have been described above. However, these are merely examples. The specific materials described above are conditions under which the user perceives a flat surface (negative pressure off = atmospheric pressure) and a concave surface (negative pressure on = -50 KPa). The example materials and dimensions of the flexible layer 100 and the defining layer 200 can be changed by increasing or decreasing the capacity of the driving source that draws fluid and generates negative pressure.
[0049] 3. Hardware configuration of the tactile presentation device
[0050] FIG. 4 shows the hardware configuration of the tactile presentation device.
[0051] In addition to the flexible layer 100, the definition layer 200, and the tactile generation unit 300, the tactile presentation device 1 further includes a sensor 401, a sensor system circuit 402, a main processor 403, a fluid drive source 404, a fluid driver 405, a motor drive source 406, a motor driver 407, a setting input device 408, a status indicator 409, a signal output device 410, a power supply circuit 411, and a power supply battery 412. The fluid drive source 404, the fluid driver 405, the motor drive source 406, and the motor driver 407 connected to the tactile generation unit 300 are installed in parallel in multiple sets according to the number of tactile generation units 300.
[0052] The sensor 401 detects resistance, capacitance, piezoelectricity, fluid pressure, light reception, sound, or a combination thereof. The sensor 401 detects a contact area 103 on the surface 101 of the flexible layer 100 by a user. The sensor 401 may be integrated with the flexible layer 100. The sensor system circuit 402 notifies the main processor 403 of the contact area 103 detected by the sensor 401. The main processor 403 receives the notification from the sensor system circuit 402 and controls a motor driver 407 and a fluid driver 405. The motor driver 407 is controlled by the main processor 403 to drive a motor drive source 406 to move the tactile generation unit 300 via a movement mechanism (not shown). The fluid driver 405 is controlled by the main processor 403 to drive a fluid drive source 404 to suck or discharge fluid and deform the flexible layer 100. The fluid drive source 404 includes a pump that sucks in and discharges fluid (air), and is connected to the pump-side opening 314 of the tactile generation unit 300. The fluid drive source 404 sucks in and discharges fluid to the tactile generation unit 300 via the pump-side opening 314.
[0053] The signal output device 410 outputs a signal corresponding to the user's operation on the contact portion 103 to an external device to be controlled 413. The setting input device 408 accepts user input of settings for the tactile presentation device 1. The status display device 409 displays the settings of the tactile presentation device 1 to the user. The power supply circuit 411 supplies power from a power supply battery 412 to the main processor 403 and the like. The power supply battery 412 may be an in-vehicle battery, a secondary battery or primary battery built into an electronic device, an in-house AC power supply, etc.
[0054] 4. Operation flow of the tactile presentation device
[0055] FIG. 5 shows the operation flow of the tactile presentation device.
[0056] The sensor 401 is a pressure sensor or the like, and detects the contact area 103 on the surface 101 of the flexible layer 100 made by the user. The sensor system circuit 402 notifies the main processor 403 of the contact area 103 detected by the sensor 401 (step S1). Upon receiving the notification from the sensor system circuit 402, the main processor 403 controls the motor driver 407 to drive the motor drive source 406 and move the haptic generation unit 300 to a position corresponding to (typically facing) the contact area 103 via a movement mechanism (not shown) (step S2). Specifically, when the haptic generation unit 300 moves to a position corresponding to the contact area 103 on the flexible layer 100 made by the user, the space inside the annular member 320 faces the contact area 103.
[0057] Upon receiving the notification from the sensor system circuit 402, the main processor 403 further controls the fluid driver 405 to drive the fluid drive source 404 (pump) to deform the flexible layer 100 (step S3). As a result, a portion of the flexible layer 100 is deformed into an uneven surface. The user tactilely recognizes that the contact portion 103 of the flexible layer 100 has been deformed into an uneven surface by a change in the friction state. Particularly in automotive applications, there is no need to direct the user's gaze or attention to the tactile presentation position, ensuring safety. The user inputs an operation (push down, tap, swipe, etc.) to the contact portion 103 of the deformed flexible layer 100. The sensor system circuit 402 notifies the main processor 403 of the user's operation input to the contact portion 103 detected by the sensor 401 (step S4).
[0058] The main processor 403 controls the signal output device 410 to output a signal corresponding to the user's operation on the contact portion 103 to the external control device 413. The main processor 403 further controls the fluid driver 405 to drive the fluid driving source 404 (pump) to further deform the flexible layer 100 and provide haptic feedback to the user (step S5). The haptic feedback may be, for example, returning the flexible layer 100 to a flat state or vibrating the flexible layer 100 by repeatedly and alternately turning on and off suction.
[0059] II. Second embodiment
[0060] Hereinafter, the description of the configurations and operations etc. that have already been described will be omitted, and different configurations and operations etc. will be mainly described.
[0061] 1. Main parts of the tactile presentation device
[0062] Fig. 6 is an exploded perspective view showing a main part of a tactile presentation device according to a second embodiment of the present disclosure. Fig. 7 is a top view showing a tactile generation unit. Fig. 8 is a top view showing a definition layer and a part of the tactile generation unit. Fig. 9 is a side view showing a main part of the tactile presentation device. Fig. 10 schematically shows a deformation of the tactile presentation device.
[0063] The difference between the tactile presentation device 1 according to the first embodiment and the tactile presentation device 2 according to the second embodiment is the definition layer 200 and the tactile generation unit 300 .
[0064] The defining layer 210 has a plurality of through holes 213. In this example, each through hole 213 has a minute circular shape in a plan view. The diameter of each through hole 213 is, for example, about several millimeters. The plurality of through holes 213 are arranged two-dimensionally at equal distances from one another and at a constant pitch (for example, about several millimeters). The defining layer 210 is a so-called punched metal.
[0065] The haptic generation unit 301 has a body 350 , an inner annular member 330 and an outer annular member 340 .
[0066] The main body 350 has a surface 351 that faces the back surface 212 of the defining layer 210. The main body 350 has an inner space chamber 355 and an outer space chamber 356, which are internal spaces. The inner space chamber 355 is provided in the center of the main body 350 in a plan view. The outer space chamber 356 is spaced apart from the inner space chamber 355 and is installed so as to surround the inner space chamber 355. A fluid (air) can flow through the inner space chamber 355, and a fluid (air) can flow through the outer space chamber 356. The inner space chamber 355 and the outer space chamber 356 are isolated and independent, with no fluid movement between them.
[0067] An inner layer side opening 352 opens on a surface 351 of the inner space chamber 355 of the main body 350. The inner layer side opening 352 communicates with the inner space chamber 355 of the main body 350. An inner pump side opening 354 opens on a surface of the main body 350 other than the surface 351 of the inner space chamber 355 (in this example, the bottom surface 353). The inner pump side opening 354 communicates with the inner space chamber 355 of the main body 350. That is, the inner pump side opening 354 communicates with the inner space chamber 355 of the main body 350. Fluid can move from the inner layer side opening 352 through the inner space chamber 355 to the inner pump side opening 354. Conversely, fluid can move from the inner pump side opening 354 through the inner space chamber 355 to the inner layer side opening 352.
[0068] An outer layer side opening 357 opens on a surface 351 of the outer space chamber 356 of the main body 350. The outer layer side opening 357 communicates with the outer space chamber 356 of the main body 350. An outer pump side opening 358 opens on a surface of the outer space chamber 356 of the main body 350 other than the surface 351 (in this example, the bottom surface 353). The outer pump side opening 358 communicates with the outer space chamber 356 of the main body 350. That is, the outer pump side opening 358 communicates with the outer space chamber 356 of the main body 350. Fluid can move from the outer layer side opening 357 through the outer space chamber 356 to the outer pump side opening 358. Conversely, fluid can move from the outer pump side opening 358 through the outer space chamber 356 to the outer layer side opening 357.
[0069] The inner pump side opening 354 and the outer pump side opening 358 are connected to independent fluid driving sources 404A and 404B, respectively. The fluid driving sources 404A and 404B each include a pump that independently draws in or discharges a fluid (air). The fluid driving source 404A draws in or discharges a fluid to the inner chamber 355 via the inner pump side opening 354. The fluid driving source 404B draws in or discharges a fluid to the outer chamber 356 via the outer pump side opening 358.
[0070] The inner annular member 330 is annular, for example, like an O-ring, and is installed to surround an inner space chamber 355, which has an inner layer-side opening 352 of the main body 350. The surface of the inner annular member 330 is located higher than the surfaces 351 of the inner space chamber 355 and the outer space chamber 356, i.e., the distance from the defining layer 210 is short. The inner annular member 330 is made of an airtight material such as rubber. The inner annular member 330 faces the back surface 212 of the defining layer 210. The inner annular member 330 is in close contact with the back surface 212 of the defining layer 210, and keeps an inner fluid chamber 331, which is a space defined between the back surface 212 of the defining layer 210 and the inner annular member 330, airtight and liquidtight.
[0071] The outer annular member 340 is annular, e.g., like an O-ring, and is installed to surround the outer space chamber 356, which has an outer layer-side opening 357 of the main body 350, and the inner annular member 330 located inside it. The surface of the outer annular member 340 is higher than the surfaces 351 of the inner space chamber 355 and the outer space chamber 356, i.e., the distance from the defining layer 210 is short. The surfaces of the outer annular member 340 and the inner annular member 330 are at the same height. The outer annular member 340 is made of an airtight material such as rubber. The outer annular member 340 faces the back surface 212 of the defining layer 210. The outer annular member 340 is in close contact with the back surface 212 of the defining layer 210, maintaining an airtight and liquid-tight outer fluid chamber 341, which is a space defined by the back surface 212 of the defining layer 210, the outside of the inner annular member 330, and the inside of the outer annular member 340. The outer fluid chamber 341 and the inner fluid chamber 331 are completely separated by the inner annular member 330 .
[0072] 2. Behavior of the tactile presentation device
[0073] A modification of the tactile presentation device will be described with reference to FIG.
[0074] The sensor 401 detects the contact area 103 of the surface 101 of the flexible layer 100, which is in the standby state as shown in (A). Then, as shown in (B), the tactile generation unit 301 moves to a position on the flexible layer 100 corresponding to the contact area 103 of the user. As shown in (C), the inner annular member 330 and the outer annular member 340 of the tactile generation unit 301 come into contact with the back surface 212 of the regulating layer 210 or face the back surface 212 of the regulating layer 210 with a small gap between them. At this point, the inner annular member 330 and the outer annular member 340 may be in close contact with the back surface 212 of the regulating layer 210, and the inner fluid chamber 331 and the outer fluid chamber 341 may or may not be in an airtight and liquidtight state. The tactile generation unit 301 may be moved upward toward the regulating layer 210 by a moving mechanism so that the inner annular member 330 and the outer annular member 340 of the tactile generation unit 301 approach the back surface 212 of the regulating layer 210.
[0075] As shown in (D), when fluid (air) is sucked through the outer layer side opening 357 of the main body 350, the outer fluid chamber 341 becomes airtight and liquidtight. Specifically, the fluid (air) in the outer fluid chamber 341 passes through the outer layer side opening 357 and the outer space chamber 356 and is discharged from the outer pump side opening 358. As a result, the fluid (air) in the outer fluid chamber 341 becomes negative pressure (for example, −50 KPa), and the flexible layer 100 adheres to the defining layer 210. The portions of the flexible layer 100 facing the multiple through holes 213 of the defining layer 210 are drawn into the multiple through holes 213. As a result, the annular region 104 around the contact portion 103 on the surface 101 of the flexible layer 100, specifically the annular region 104 of the flexible layer 100 defined by the shapes of the outer periphery of the inner annular member 330 and the inner periphery of the outer annular member 340, is deformed into an uneven surface. Note that, depending on the combination of the fluid (air) pressure in the outer fluid chamber 341 and the materials and dimensions of the flexible layer 100 and the defining layer 210, the annular region 104 of the flexible layer 100 defined by the shapes of the outer periphery of the inner annular member 330 and the inner periphery of the outer annular member 340 may remain flat without deforming into an uneven surface.
[0076] Meanwhile, fluid (air) is discharged from the inner layer-side opening 352 of the main body 350 into the inner fluid chamber 331. Specifically, the fluid is discharged from the inner pump-side opening 354 through the inner space chamber 355 and the inner layer-side opening 352 into the inner fluid chamber 331. This causes the fluid (air) in the inner fluid chamber 331 to become positive pressure. This causes a region including the contact portion 103 on the surface 101 of the flexible layer 100, specifically, a deformation region 105 inside the annular region 104 that adheres to the defining layer 210, to bulge. The user can tactilely recognize that the contact portion 103 has been deformed into a convex shape.
[0077] When the discharge of fluid into the inner fluid chamber 331 is stopped and the positive pressure of the fluid (air) in the inner fluid chamber 331 returns to atmospheric pressure, the bulging portion of the flexible layer 100 returns to a flat state.
[0078] Conversely, when fluid (air) is sucked through the inner layer-side opening 352 of the main body 350, the inner fluid chamber 331 becomes airtight and liquid-tight. Specifically, the fluid (air) in the inner fluid chamber 331 is discharged from the inner pump-side opening 354 via the inner layer-side opening 352 and the inner space chamber 355. As a result, the fluid (air) in the inner fluid chamber 331 becomes negative pressure (e.g., −50 KPa), and the flexible layer 100 adheres to the defining layer 210. The portions of the flexible layer 100 facing the multiple through-holes 213 of the defining layer 210 are drawn into the multiple through-holes 213. As a result, a region including the contact portion 103 on the surface 101 of the flexible layer 100, specifically, a deformation region 105 inside the annular region 104 that adheres to the defining layer 210, is deformed into an uneven surface (porous surface). The user can tactilely recognize that the contact area 103 has been transformed into an uneven surface (porous surface) by the change in the friction state.
[0079] When the suction of fluid from the inner fluid chamber 331 is stopped and the negative pressure of the fluid (air) in the inner fluid chamber 331 returns to atmospheric pressure, the portions of the flexible layer 100 that were pulled into the multiple through holes 203 of the defining layer 210 escape from the multiple through holes 203 and return to a flat state.
[0080] Furthermore, by alternately and continuously repeating suction and suction stop on the inner fluid chamber 331, the flexible layer 100 can be vibrated.
[0081] In this embodiment, the annular region 104, which is the outline of the deformation region 105 of the flexible layer 100, is defined by suctioning fluid from the outer fluid chamber 341. Meanwhile, the deformation region 105 of the inner fluid chamber 331 can be deformed into a convex surface by ejecting fluid therefrom, and can be deformed into an uneven surface (porous surface) by suctioning fluid therefrom. In other words, the common contact area 103 can be deformed into two different shapes, providing different tactile sensations to the user. Furthermore, by periodically changing the deformation region 105 of the flexible layer 100 between a convex surface and an uneven surface, a tactile sensation that periodically changes over time can be provided to the user.
[0082] III. Modifications
[0083] FIG. 11 is a schematic diagram showing a modification of a tactile presentation device according to a modified example.
[0084] In the second embodiment, a plurality of minute through-holes 213 are provided in the defining layer 210 corresponding to the deformation region 105 of the flexible layer 100. Alternatively, a single through-hole having a size equivalent to the tip of a user's finger (e.g., several centimeters in diameter) may be provided in the defining layer 210 corresponding to the deformation region 105 of the flexible layer 100. As shown in (A), by sucking fluid, the flexible layer 100 is drawn into the through-hole, forming a concave surface the size of the through-hole. On the other hand, as shown in (B), by ejecting fluid, the deformation region 105 defined by the annular region 104 of the flexible layer 100 becomes a convex surface, as in the second embodiment.
[0085] As in the second embodiment, a plurality of minute through-holes 213 are provided in the defining layer 210 corresponding to the deformation region 105 of the flexible layer 100. The tactile sense generating unit 301 can eject and suck fluid independently from each of the through-holes 213. As shown in (C), by sucking fluid, the flexible layer 100 is drawn into the plurality of minute through-holes, forming an uneven surface (porous surface). On the other hand, as shown in (D), by ejecting fluid, the flexible layer 100 forms an uneven surface in which it bulges (protrudes) minutely from the plurality of minute through-holes.
[0086] The defining layer 210 may have a plurality of through-holes of different sizes. The tactile generation unit 301 may present different tactile sensations by sucking and / or ejecting fluid through the plurality of through-holes of different sizes. For example, relatively large through-holes (e.g., several centimeters in diameter) corresponding to the tip of a user's finger may be alternately arranged with a plurality of groups of fine through-holes periodically arranged to surround the relatively large through-holes. Suction of fluid through one large through-hole transforms the surface into a concave surface (A), and ejection of fluid transforms the surface into a convex surface (B). Suction of fluid through a plurality of groups of fine through-holes transforms the surface into an uneven surface (porous surface) (C), and ejection of fluid transforms the surface into a raised uneven surface (D).
[0087] As shown in (E), (F), (G), and (H), one or more relatively large through-holes and one or more groups of minute through-holes that are adjacent to each other are deformed by suction and discharge. This makes it possible to present a combination of different tactile sensations to the user. Furthermore, by repeatedly discharging and suctioning one or more relatively large through-holes and one or more groups of minute through-holes and periodically changing the deformation, it is possible to present the user with tactile sensations that change periodically over time, as shown in (I).
[0088] IV. summary
[0089] Typically, haptic devices with flat surfaces have a fixed presentation position, so users must visually obtain clues to the haptic presentation position. For in-vehicle haptic devices in particular, it is desirable to avoid shifting one's gaze for safety reasons.
[0090] A touch panel is an example of a tactile presentation device that usually has a flat surface. Touch panels require the user to visually confirm the touch position, and for safety reasons, moving one's gaze is undesirable. To achieve a change from a flat state to a tactile presentation state, a motor using a mechanical top to drive the device up and down could be considered. However, this would require the installation of drive devices and individual drive for the entire tactile presentation area, resulting in a complex structure.
[0091] In contrast, in this embodiment, the surface is normally flat and has a flexible layer that provides friction and shape changes. Below the flexible layer is a defining layer that produces the desired haptic effect. The normally flat surface detects any position the user touches, and the haptic generation unit moves to that position and generates a haptic sensation by sucking or dispensing a fluid.
[0092] While tactile presentation at a specified position literally requires the user to direct their attention to the tactile presentation position, the present invention can present a tactile sensation at any position the user touches. Particularly in in-vehicle applications, there is no need to direct the user's gaze or attention to the tactile presentation position, ensuring safety.
[0093] Since the tactile generation unit moves and drives in response to any position of user contact, there is no need to cover the entire surface area with tactile generation units, simplifying the structure and contributing to lower costs. In particular, when fluid is used as the driving source, remote operation and driving at any position (driving possible according to the flow path configuration) are preferable. When external air is used as the driving source, installation can be performed anywhere. Furthermore, since the surface shape is changed by suction and discharge of fluid, the structure is simple and contributes to lower costs. The shape change that imparts tactile sensation and the friction change seen microscopically are state changes between concave and convex surfaces, and it is preferable to use negative and positive pressure fluid as the driving source.
[0094] According to this embodiment, there is no need to visually determine the location of the tactile presentation, and tactile presentation of friction or shape change is possible at any position where the user touches the device.Since the surface is usually flat, the interface also improves the appearance, thereby realizing reliable operability while ensuring safety, and also realizing customer value by improving the appearance when not in use.
[0095] V. Vehicle Configuration Examples
[0096] FIG. 12 is a block diagram showing an example of the configuration of a vehicle to which the present technology is applied.
[0097] The vehicle control system 11 is installed in a vehicle and performs processing related to automated driving of the vehicle. This automated driving includes automated driving of levels 1 to 5, and remote driving and remote assistance of the vehicle by a remote driver.
[0098] The vehicle control system 11 includes a vehicle control ECU (Electronic Control Unit) 21, a communication unit 22, a map information storage unit 23, a location information acquisition unit 24, an external recognition sensor 25, an in-vehicle sensor 26, a vehicle sensor 27, a memory unit 28, a driving automation control unit 29, a DMS (Driver Monitoring System) 30, an HMI (Human Machine Interface) 31, and a vehicle control unit 32.
[0099] The vehicle control ECU 21, communication unit 22, map information storage unit 23, position information acquisition unit 24, external recognition sensor 25, in-vehicle sensor 26, vehicle sensor 27, memory unit 28, driving automation control unit 29, DMS 30, HMI 31, and vehicle control unit 32 are connected to each other so as to be able to communicate with each other via a communication network 41. The communication network 41 is configured, for example, by an in-vehicle communication network or bus conforming to a digital two-way communication standard such as CAN (Controller Area Network), LIN (Local Interconnect Network), LAN (Local Area Network), FlexRay (registered trademark), or Ethernet (registered trademark). Different communication networks 41 may be used depending on the type of data being transmitted. For example, CAN may be used for data related to vehicle control, and Ethernet may be used for large-volume data. In addition, each part of the vehicle control system 11 may be directly connected without going through the communication network 41, using wireless communication intended for communication over relatively short distances, such as near field communication (NFC) or Bluetooth (registered trademark).
[0100] In the following description, when each unit of the vehicle control system 11 communicates via the communication network 41, the description of the communication network 41 will be omitted. For example, when the vehicle control ECU 21 and the communication unit 22 communicate via the communication network 41, it will simply be described that the vehicle control ECU 21 and the communication unit 22 communicate with each other.
[0101] The vehicle control ECU 21 is configured with various processors such as a CPU (Central Processing Unit), an MPU (Micro Processing Unit), etc. The vehicle control ECU 21 controls the entire or part of the functions of the vehicle control system 11.
[0102] The communication unit 22 communicates with various devices inside and outside the vehicle, other vehicles, servers, base stations, etc., and transmits and receives various data. At this time, the communication unit 22 can communicate using a plurality of communication methods.
[0103] The following provides an overview of communication with the outside of the vehicle that can be performed by the communication unit 22. The communication unit 22 communicates with a server (hereinafter referred to as an external server) or the like on an external network via a base station or an access point using a wireless communication method such as 5G (fifth generation mobile communication system), LTE (Long Term Evolution), or DSRC (Dedicated Short Range Communications). The external network with which the communication unit 22 communicates is, for example, the Internet, a cloud network, or a network specific to a carrier. The communication method used by the communication unit 22 with the external network is not particularly limited as long as it is a wireless communication method that enables digital two-way communication at a communication speed equal to or higher than a predetermined distance.
[0104] Furthermore, for example, the communication unit 22 can communicate with a terminal located near the vehicle using P2P (Peer to Peer) technology. The terminal located near the vehicle can be, for example, a terminal worn by a mobile object moving at a relatively slow speed, such as a pedestrian or a bicycle, a terminal installed at a fixed location in a store, or an MTC (Machine Type Communication) terminal. Furthermore, the communication unit 22 can also perform V2X communication. V2X communication refers to communication between the vehicle and others, such as vehicle-to-vehicle communication with another vehicle, vehicle-to-infrastructure communication with a roadside unit, vehicle-to-home communication, and vehicle-to-pedestrian communication with a terminal carried by a pedestrian.
[0105] The communication unit 22 can receive, for example, a program for updating software that controls the operation of the vehicle control system 11 from the outside (over the air). The communication unit 22 can also receive map information, traffic information, information about the surroundings of the vehicle, and the like from the outside. For example, the communication unit 22 can also transmit information about the vehicle and information about the surroundings of the vehicle to the outside. Examples of the information about the vehicle that the communication unit 22 transmits to the outside include data indicating the vehicle status and the recognition result by the recognition unit 73. Furthermore, for example, the communication unit 22 performs communication corresponding to a vehicle emergency notification system such as e-call.
[0106] For example, the communication unit 22 receives electromagnetic waves transmitted by a road traffic information and communication system (VICS (Vehicle Information and Communication System) (registered trademark)) such as a radio beacon, an optical beacon, or FM multiplex broadcasting.
[0107] The following provides an overview of communication with the vehicle interior that can be performed by the communication unit 22. The communication unit 22 can communicate with each device in the vehicle using, for example, wireless communication. The communication unit 22 can communicate with each device in the vehicle using a communication method that enables bidirectional digital communication at a predetermined communication speed or higher via wireless communication, such as wireless LAN, Bluetooth, NFC, or Wireless USB (WUSB). The communication unit 22 can also communicate with each device in the vehicle using wired communication. For example, the communication unit 22 can communicate with each device in the vehicle using wired communication via a cable connected to a connection terminal (not shown). The communication unit 22 can communicate with each device in the vehicle using a communication method that enables bidirectional digital communication at a predetermined communication speed or higher via wired communication, such as Universal Serial Bus (USB), High-Definition Multimedia Interface (HDMI) (registered trademark), or Mobile High-Definition Link (MHL).
[0108] Here, the in-vehicle device refers to, for example, a device in the vehicle that is not connected to the communication network 41. Possible in-vehicle devices include, for example, a mobile device or wearable device carried by a user in the vehicle, such as a driver, and an information device brought into the vehicle and temporarily installed therein.
[0109] The map information storage unit 23 stores one or both of maps acquired from an external source and maps created in the vehicle. For example, the map information storage unit 23 stores a three-dimensional high-precision map, a global map that is less accurate than a high-precision map and covers a wide area, and the like.
[0110] High-precision maps include, for example, dynamic maps, point cloud maps, and vector maps. Dynamic maps are maps consisting of, for example, four layers of dynamic information, quasi-dynamic information, quasi-static information, and static information, and are provided to vehicles from an external server or the like. Point cloud maps are maps made up of point clouds (point cloud data). Vector maps are maps adapted for automated driving by associating traffic information, such as the positions of lanes and traffic lights, with point cloud maps.
[0111] The point cloud map and vector map may be provided, for example, from an external server or the like, or may be created in the vehicle based on sensing results from the camera 51, radar 52, LiDAR 53, etc. as a map for matching with a local map described later, and stored in the map information storage unit 23. Furthermore, when a high-precision map is provided from an external server or the like, map data of, for example, an area of several hundred square meters relating to the planned route along which the vehicle will travel is acquired from the external server or the like in order to reduce communication capacity.
[0112] The location information acquisition unit 24 receives GNSS (Global Navigation Satellite System) signals from GNSS satellites and acquires location information of the vehicle. The acquired location information is supplied to the driving automation control unit 29. Note that the method used by the location information acquisition unit 24 is not limited to using GNSS signals, and it may also acquire location information using a beacon, for example.
[0113] The external recognition sensor 25 includes various sensors used to recognize the situation outside the vehicle, and supplies sensor data from each sensor to each part of the vehicle control system 11. The type and number of sensors included in the external recognition sensor 25 are arbitrary.
[0114] For example, the external recognition sensor 25 includes a camera 51, a radar 52, a LiDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging) 53, and an ultrasonic sensor 54. Without being limited to this, the external recognition sensor 25 may be configured to include one or more types of sensors selected from the camera 51, the radar 52, the LiDAR 53, and the ultrasonic sensor 54. The number of cameras 51, radars 52, LiDARs 53, and ultrasonic sensors 54 is not particularly limited as long as the number is a number that can be realistically installed on the vehicle. Furthermore, the types of sensors included in the external recognition sensor 25 are not limited to this example, and the external recognition sensor 25 may include other types of sensors. Examples of sensing areas of each sensor included in the external recognition sensor 25 will be described later.
[0115] The imaging method of the camera 51 is not particularly limited. For example, cameras of various imaging methods capable of distance measurement, such as a time-of-flight (ToF) camera, a stereo camera, a monocular camera, and an infrared camera, can be applied to the camera 51 as needed. However, the camera 51 may simply acquire an image without distance measurement.
[0116] Furthermore, for example, the external recognition sensor 25 may include an environmental sensor for detecting the environment surrounding the vehicle. The environmental sensor is a sensor for detecting the environment such as weather, climate, brightness, etc., and may include various sensors such as a raindrop sensor, a fog sensor, a sunlight sensor, a snow sensor, and an illuminance sensor.
[0117] Furthermore, for example, the external recognition sensor 25 includes a microphone used to detect sounds around the vehicle and the location of sound sources.
[0118] The interior sensor 26 includes various sensors for detecting information inside the vehicle, and supplies sensor data from each sensor to each unit of the vehicle control system 11. The types and number of the various sensors included in the interior sensor 26 are not particularly limited as long as they are of types and numbers that can be realistically installed in the vehicle.
[0119] For example, the interior sensor 26 may include one or more types of sensors selected from the group consisting of a camera, radar, a seating sensor, a steering wheel sensor, a microphone, and a biometric sensor. The camera included in the interior sensor 26 may be a camera using any of various imaging methods capable of measuring distances, such as a Time of Flight (ToF) camera, a stereo camera, a monocular camera, or an infrared camera. The camera included in the interior sensor 26 may also be a camera simply for acquiring captured images, regardless of distance measurement. The biometric sensor included in the interior sensor 26 may be provided, for example, on a seat, a steering wheel, or the like, and detect various types of biometric information of the user.
[0120] The vehicle sensor 27 includes various sensors for detecting the state of the vehicle, and supplies sensor data from each sensor to each unit of the vehicle control system 11. The types and number of the various sensors included in the vehicle sensor 27 are not particularly limited as long as they are of types and numbers that can be realistically installed in the vehicle.
[0121] For example, the vehicle sensor 27 includes a speed sensor, an acceleration sensor, an angular velocity sensor (gyro sensor), and an inertial measurement unit (IMU) that integrates these sensors. For example, the vehicle sensor 27 includes a steering angle sensor that detects the steering angle of the steering wheel, a yaw rate sensor, an accelerator sensor that detects the amount of accelerator pedal operation, and a brake sensor that detects the amount of brake pedal operation. For example, the vehicle sensor 27 includes a rotation sensor that detects the number of rotations of the engine or motor, an air pressure sensor that detects tire air pressure, a slip ratio sensor that detects tire slip ratio, and a wheel speed sensor that detects the rotation speed of the wheels. For example, the vehicle sensor 27 includes a battery sensor that detects the remaining battery charge and temperature, and an impact sensor that detects external impacts.
[0122] The storage unit 28 includes at least one of a non-volatile storage medium and a volatile storage medium, and stores data and programs. The storage unit 28 is used, for example, as an electrically erasable programmable read-only memory (EEPROM) and a random access memory (RAM). Examples of storage media that can be used include a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, and a magneto-optical storage device. The storage unit 28 stores various programs and data used by each component of the vehicle control system 11. For example, the storage unit 28 includes an event data recorder (EDR) and a data storage system for automated driving (DSSAD), and stores vehicle information before and after an event such as an accident, as well as information acquired by the in-vehicle sensors 26.
[0123] The driving automation control unit 29 controls the driving automation function of the vehicle. For example, the driving automation control unit 29 includes an analysis unit 61, an action planning unit 62, and an operation control unit 63.
[0124] The analysis unit 61 performs an analysis process of the vehicle and the surrounding situation. The analysis unit 61 includes a self-position estimation unit 71, a sensor fusion unit 72, and a recognition unit 73.
[0125] The self-position estimation unit 71 estimates the self-position of the vehicle based on the sensor data from the external recognition sensor 25 and the high-precision map stored in the map information storage unit 23. For example, the self-position estimation unit 71 generates a local map based on the sensor data from the external recognition sensor 25 and estimates the self-position of the vehicle by matching the local map with the high-precision map. The position of the vehicle is based on, for example, the center of the rear wheel pair axle.
[0126] The local map is, for example, a three-dimensional high-precision map or an occupancy grid map created using a technology such as SLAM (Simultaneous Localization and Mapping). The three-dimensional high-precision map is, for example, the point cloud map described above. The occupancy grid map is a map in which the three-dimensional or two-dimensional space around the vehicle is divided into grids of a predetermined size and the occupancy status of objects is indicated on a grid-by-grid basis. The occupancy status of objects is indicated, for example, by the presence or absence of an object and its probability of existence. The local map is also used, for example, in the detection process and recognition process of the situation outside the vehicle by the recognition unit 73.
[0127] The self-position estimation unit 71 may estimate the self-position of the vehicle based on the position information acquired by the position information acquisition unit 24 and the sensor data from the vehicle sensor 27 .
[0128] The sensor fusion unit 72 performs sensor fusion processing to obtain information by combining multiple different types of sensor data (for example, image data supplied from the camera 51 and sensor data supplied from the radar 52). Methods for combining different types of sensor data include compounding, integration, fusion, and association.
[0129] The recognition unit 73 executes a detection process for detecting the situation outside the vehicle and a recognition process for recognizing the situation outside the vehicle.
[0130] For example, the recognition unit 73 performs detection processing and recognition processing of the situation outside the vehicle based on information from the external recognition sensor 25, information from the self-position estimation unit 71, information from the sensor fusion unit 72, and the like.
[0131] Specifically, for example, the recognition unit 73 performs detection processing and recognition processing of objects around the vehicle. Object detection processing is processing to detect, for example, the presence or absence, size, shape, position, movement, etc. of an object. Object recognition processing is processing to recognize, for example, attributes such as the type of object, or to identify a specific object. However, detection processing and recognition processing are not necessarily clearly separated, and may overlap.
[0132] For example, the recognition unit 73 detects objects around the vehicle by performing clustering to classify a point cloud based on sensor data from the radar 52, the LiDAR 53, or the like into clusters of points, thereby detecting the presence, size, shape, and position of objects around the vehicle.
[0133] For example, the recognition unit 73 detects the movement of objects around the vehicle by tracking the movement of clusters of points classified by clustering, thereby detecting the speed and direction of travel (movement vector) of the objects around the vehicle.
[0134] For example, the recognition unit 73 detects or recognizes vehicles, people, bicycles, obstacles, structures, roads, traffic lights, traffic signs, road markings, etc. based on image data supplied from the camera 51. The recognition unit 73 may also recognize the types of objects around the vehicle by performing recognition processing such as semantic segmentation.
[0135] For example, the recognition unit 73 can perform a recognition process of traffic rules around the vehicle based on the map stored in the map information storage unit 23, the result of estimation of the self-position by the self-position estimation unit 71, and the result of recognition of objects around the vehicle by the recognition unit 73. Through this process, the recognition unit 73 can recognize the positions and states of traffic lights, the contents of traffic signs and road markings, the contents of traffic regulations, and lanes that can be traveled, etc.
[0136] For example, the recognition unit 73 can perform a process of recognizing the environment around the vehicle. The surrounding environment to be recognized by the recognition unit 73 may include weather, temperature, humidity, brightness, and road surface conditions.
[0137] The behavior planning unit 62 creates a behavior plan for the vehicle. For example, the behavior planning unit 62 creates the behavior plan by performing route planning and route tracking processing.
[0138] Note that path planning includes global path planning and local path planning. Global path planning involves planning a rough route from a start to a goal. Local path planning, also known as trajectory planning, involves generating a trajectory that allows safe and smooth travel in the vicinity of the vehicle, taking into account the vehicle's motion characteristics on the planned route.
[0139] Path following is a process of planning an operation for safely and accurately traveling along a route planned by a route plan within a planned time. The behavior planning unit 62 can, for example, calculate a target speed and a target angular velocity of the vehicle based on the results of this path following process.
[0140] The operation control unit 63 controls the operation of the vehicle in order to realize the action plan created by the action planning unit 62 .
[0141] For example, the operation control unit 63 controls a steering control unit 81, a brake control unit 82, and a drive control unit 83 included in a vehicle control unit 32 described later, to perform lateral vehicle motion control and longitudinal vehicle motion control so that the vehicle travels along the trajectory calculated by the trajectory plan. For example, the operation control unit 63 performs control aimed at driver assistance functions such as collision avoidance or impact mitigation, following driving, vehicle speed maintenance driving, host vehicle collision warning, host vehicle lane departure warning, and driving automation such as driving without operation by the driver or a remote driver.
[0142] The DMS 30 performs processes such as authenticating the driver and recognizing the driver's state based on sensor data from the in-vehicle sensors 26 and input data input to the HMI 31 (described later). Examples of the driver's state to be recognized include physical condition, level of alertness, level of concentration, level of fatigue, line of sight, level of intoxication, driving operation, and posture.
[0143] The DMS 30 may be configured to perform authentication processing for users other than the driver and recognition processing for the status of the users. Furthermore, for example, the DMS 30 may be configured to perform recognition processing for the status inside the vehicle based on sensor data from the in-vehicle sensor 26. Examples of the status inside the vehicle that may be recognized include temperature, humidity, brightness, and odor.
[0144] The HMI 31 inputs various data and instructions and presents various data to the user.
[0145] The following provides an overview of data input via the HMI 31. The HMI 31 includes input devices for a person to input data. The HMI 31 generates input signals based on data, instructions, and the like input via the input devices and supplies the signals to each component of the vehicle control system 11. The HMI 31 includes, as input devices, controls such as a touch panel, buttons, switches, and levers. The HMI 31 may also include input devices that allow information to be input by voice, gestures, or other means other than manual operation. Furthermore, the HMI 31 may use, as input devices, externally connected devices such as a remote control device using infrared or radio waves, or a mobile or wearable device compatible with the operation of the vehicle control system 11.
[0146] The presentation of data by the HMI 31 will be briefly described. The HMI 31 generates visual information, auditory information, and tactile information for the user or the outside of the vehicle. The HMI 31 also performs output control, controlling the output, output content, output timing, output method, etc. of each piece of generated information. The HMI 31 generates and outputs, as visual information, information indicated by images or lights, such as an operation screen, vehicle status display, warning display, and monitor image showing the situation around the vehicle. The HMI 31 also generates and outputs, as auditory information, information indicated by sounds, such as voice guidance, warning sounds, and warning messages. The HMI 31 also generates and outputs, as tactile information, information imparted to the user's sense of touch by force, vibration, movement, etc.
[0147] Examples of output devices that the HMI 31 uses to output visual information include a display device that displays an image on its own to present visual information and a projector device that projects an image to present visual information. The display device may be a device that displays visual information within the user's field of vision, such as a head-up display, a transmissive display, or a wearable device with an augmented reality (AR) function, in addition to a display device with a normal display. The HMI 31 may also use display devices included in a navigation system, an instrument panel, a camera monitoring system (CMS), an electronic mirror, a lamp, or the like provided in the vehicle as output devices that output visual information.
[0148] As an output device for the HMI 31 to output auditory information, for example, an audio speaker, a headphone, or an earphone can be applied.
[0149] For example, a haptic element using haptic technology can be applied as an output device for outputting tactile information from the HMI 31. The haptic element is provided on a part that the user touches, such as a steering wheel or a seat.
[0150] The vehicle control unit 32 controls each part of the vehicle and includes a steering control unit 81, a brake control unit 82, a drive control unit 83, a body system control unit 84, a light control unit 85, and a horn control unit 86.
[0151] The steering control unit 81 detects and controls the state of the steering system of the vehicle. The steering system includes, for example, a steering mechanism including a steering wheel, an electric power steering, etc. The steering control unit 81 includes, for example, a steering ECU that controls the steering system, an actuator that drives the steering system, etc.
[0152] The brake control unit 82 detects and controls the state of the vehicle's brake system. The brake system includes, for example, a brake mechanism including a brake pedal, an antilock brake system (ABS), a regenerative brake mechanism, etc. The brake control unit 82 includes, for example, a brake ECU that controls the brake system, an actuator that drives the brake system, etc.
[0153] The drive control unit 83 detects and controls the state of the vehicle's drive system. The drive system includes, for example, an accelerator pedal, a drive force generating device for generating drive force such as an internal combustion engine or drive motor, and a drive force transmission mechanism for transmitting the drive force to the wheels. The drive control unit 83 includes, for example, a drive ECU for controlling the drive system, and an actuator for driving the drive system.
[0154] The body system control unit 84 detects and controls the status of the body system of the vehicle. The body system includes, for example, a keyless entry system, a smart key system, a power window device, a power seat, an air conditioning system, an airbag, a seat belt, a shift lever, etc. The body system control unit 84 includes, for example, a body system ECU that controls the body system, an actuator that drives the body system, etc.
[0155] The light control unit 85 detects and controls the status of various lights of the vehicle. Examples of lights to be controlled include headlights, backlights, fog lights, turn signals, brake lights, projections, and bumper displays. The light control unit 85 includes a light ECU that controls the lights, an actuator that drives the lights, and the like.
[0156] The horn control unit 86 detects and controls the state of the car horn of the vehicle, etc. The horn control unit 86 includes, for example, a horn ECU that controls the car horn, an actuator that drives the car horn, etc.
[0157] 13 is a diagram showing an example of a sensing area by the camera 51, radar 52, LiDAR 53, ultrasonic sensor 54, etc. of the external recognition sensor 25. Note that in this figure, the vehicle is shown as viewed from above, with the left end side being the front end (front) of the vehicle and the right end side being the rear end (rear) of the vehicle.
[0158] Sensing area 101F and sensing area 101B are examples of sensing areas of the ultrasonic sensors 54. Sensing area 101F covers the periphery of the front end of the vehicle with multiple ultrasonic sensors 54. Sensing area 101B covers the periphery of the rear end of the vehicle with multiple ultrasonic sensors 54.
[0159] The sensing results in the sensing area 101F and the sensing area 101B are used for, for example, vehicle parking assistance.
[0160] Sensing areas 102F to 102B show examples of sensing areas of a short-range or medium-range radar 52. Sensing area 102F covers a position farther in front of the vehicle than sensing area 101F. Sensing area 102B covers a position farther behind the vehicle than sensing area 101B. Sensing area 102L covers the periphery behind the left side of the vehicle. Sensing area 102R covers the periphery behind the right side of the vehicle.
[0161] The sensing results in sensing area 102F are used, for example, to detect vehicles or pedestrians in front of the vehicle. The sensing results in sensing area 102B are used, for example, for collision prevention functions behind the vehicle. The sensing results in sensing area 102L and sensing area 102R are used, for example, to detect objects in blind spots on the sides of the vehicle.
[0162] Sensing areas 103F to 103B show examples of sensing areas sensed by camera 51. Sensing area 103F covers a position farther in front of the vehicle than sensing area 102F. Sensing area 103B covers a position farther in the rear of the vehicle than sensing area 102B. Sensing area 103L covers the periphery of the left side of the vehicle. Sensing area 103R covers the periphery of the right side of the vehicle.
[0163] The sensing results in the sensing area 103F can be used for, for example, recognition of traffic lights and traffic signs, lane departure prevention assistance systems, and automatic headlight control systems. The sensing results in the sensing area 103B can be used for, for example, parking assistance and surround view systems. The sensing results in the sensing areas 103L and 103R can be used for, for example, surround view systems.
[0164] Sensing area 104 shows an example of the sensing area of LiDAR 53. Sensing area 104 covers a position further ahead of the vehicle than sensing area 103F. On the other hand, sensing area 104 has a narrower range in the left-right direction than sensing area 103F.
[0165] The sensing results in the sensing area 104 are used to detect objects such as surrounding vehicles, for example.
[0166] A sensing area 105 shows an example of the sensing area of the long-range radar 52. The sensing area 105 covers a position further ahead of the vehicle than the sensing area 104. On the other hand, the sensing area 105 has a narrower range in the left-right direction than the sensing area 104.
[0167] The sensing results in the sensing area 105 are used for, for example, adaptive cruise control (ACC), emergency braking, collision avoidance, and the like.
[0168] The sensing areas of the cameras 51, radars 52, LiDARs 53, and ultrasonic sensors 54 included in the external recognition sensor 25 may have various configurations other than those shown in the figure. Specifically, the ultrasonic sensors 54 may also sense the sides of the vehicle, and the LiDARs 53 may sense the rear of the vehicle. The installation positions of the sensors are not limited to the above-described examples. The number of each sensor may be one or more.
[0169] The present disclosure may have the following configurations.
[0170] (1) A tactile presentation device comprising: a flexible layer whose surface is exposed so as to be touchable by a user and which is flexible and deformable, a definition layer whose surface faces the back surface of the flexible layer and defines the shape of the flexible layer, and a tactile generation unit that faces the back surface of the definition layer and moves to a position corresponding to a contact portion of the flexible layer that is a portion of the flexible layer that the user touches, and deforms the contact portion of the flexible layer. (2) The tactile presentation device according to (1), wherein the definition layer has a plurality of through-holes that are perforated facing the flexible layer, and the tactile generation unit deforms the flexible layer by sucking and / or discharging a fluid onto the flexible layer through at least one of the through-holes of the definition layer. (3) The tactile presentation device described in (2) above, wherein the tactile generation unit has an annular member in contact with the back surface of the defining layer, and aspirates the fluid in a fluid chamber defined by the back surface of the defining layer and the inner annular member, and deforms a region of the flexible layer defined by the shape of the annular member by aspirating the fluid from the inner fluid chamber. (4) The tactile presentation device described in (2) above, wherein the tactile generation unit has an annular inner annular member in contact with the back surface of the defining layer, and an annular outer annular member in contact with the back surface of the defining layer and surrounding the inner annular member, and aspirates the fluid in an outer fluid chamber defined by the back surface of the defining layer, the inner annular member, and the outer annular member, and deforms a region of the flexible layer defined by the shape of the inner annular member by aspirating and / or discharging the fluid to the back surface of the defining layer and the inner fluid chamber defined by the inner annular member.(5) The tactile presentation device according to (4) above, wherein the tactile generation unit: installs the inner annular member around one through-hole corresponding to the contact site, sucks the fluid from the inner fluid chamber to draw the flexible layer into the through-hole and deform the flexible layer into a concave surface, and ejects the fluid into the inner fluid chamber to swell the flexible layer and deform the flexible layer into a convex surface. (6) The tactile presentation device according to (4) or (5) above, wherein the tactile generation unit: installs the inner annular member with respect to a plurality of fine through-holes corresponding to the contact site, sucks the fluid from the inner fluid chamber to draw the flexible layer into the plurality of fine through-holes and deform the flexible layer into a concave-convex surface, and ejects the fluid into the inner fluid chamber to swell the flexible layer and deform the flexible layer into a convex surface. (7) The tactile presentation device according to any one of (4) to (6) above, wherein the tactile generation unit vibrates the flexible layer by continuously repeating suction and discharge of the fluid from the inner fluid chamber. (8) The tactile presentation device according to any one of (2) to (7) above, wherein the defining layer has a plurality of through-holes of different sizes, and the tactile generation unit presents different tactile sensations by suctioning and / or discharging the fluid into the plurality of through-holes of different sizes. (9) The tactile presentation device according to any one of (1) to (8) above, wherein the tactile generation unit further moves in a thickness direction of the flexible layer. (10) The tactile presentation device according to any one of (1) to (9) above, further comprising a sensor that detects the contact portion of the flexible layer.(11) The tactile presentation device according to any one of (1) to (10) above, wherein a surface of the flexible layer is an interior wall surface of a house that functions as an in-house interface, a surface of various electronic devices that functions as a tactile display, an in-vehicle console that functions as an operation system interface, or an in-vehicle steering wheel or interior surface of a vehicle that functions as an interface for an operation system or a hazard notification. (12) A tactile presentation method using a tactile presentation device having: a flexible layer whose surface is exposed so as to be touchable by a user and is flexible and deformable, a defining layer whose surface faces a back surface of the flexible layer and defines a shape of the flexible layer, and a tactile generation unit, wherein the tactile generation unit faces the back surface of the defining layer and moves to a position corresponding to a contact portion of the flexible layer that is a portion of the flexible layer that the user touches, and the tactile generation unit deforms the contact portion of the flexible layer. (13) A vehicle equipped with a tactile presentation device having: a flexible layer whose surface is exposed so that it can be touched by a user and is flexible and deformable; a defining layer whose surface faces the back surface of the flexible layer and defines the shape of the flexible layer; and a tactile generation unit that faces the back surface of the defining layer and moves to a position corresponding to a contact portion of the flexible layer that is a portion of the flexible layer that the user touches, and deforms the contact portion of the flexible layer.
[0171] Although the embodiments and modified examples of the present technology have been described above, the present technology is not limited to the above-described embodiments, and it goes without saying that various modifications can be made within the scope of the gist of the present technology.
[0172] 1 tactile presentation device 100 flexible layer 200 regulation layer 300 tactile generation unit
Claims
1. A tactile presentation device comprising: a flexible layer whose surface is exposed so as to be touchable by a user and which is flexible and deformable; a definition layer whose surface faces the back surface of the flexible layer and defines the shape of the flexible layer; and a tactile generation unit that faces the back surface of the definition layer and moves to a position corresponding to a contact portion of the flexible layer that is the portion of the flexible layer that the user touches, and deforms the contact portion of the flexible layer.
2. A tactile presentation device as described in claim 1, wherein the prescribed layer has a plurality of through holes drilled facing the flexible layer, and the tactile generating unit deforms the flexible layer by sucking and / or ejecting fluid into the flexible layer through at least one of the through holes in the prescribed layer.
3. A tactile presentation device as described in claim 2, wherein the tactile generation unit has an annular member in contact with the back surface of the defined layer, and sucks in the fluid within a fluid chamber defined between the back surface of the defined layer and the inside of the inner annular member, and by sucking in the fluid from the inner fluid chamber, deforms an area of the flexible layer defined by the shape of the annular member.
4. A tactile presentation device as described in claim 2, wherein the tactile generation unit has an annular inner annular member in contact with the back surface of the prescribed layer, and an annular outer annular member in contact with the back surface of the prescribed layer and surrounding the inner annular member, and deforms a region of the flexible layer defined by the shape of the inner annular member by sucking in the fluid within an outer fluid chamber defined by the back surface of the prescribed layer, the inner annular member and the outer annular member, and sucking in and / or ejecting the fluid into an inner fluid chamber defined inside the back surface of the prescribed layer and the inner annular member.
5. A tactile presentation device as described in claim 4, wherein the tactile generating unit: places the inner annular member around one through hole corresponding to the contact area; sucks in the fluid in the inner fluid chamber to draw the flexible layer into the through hole and deforms the flexible layer into a concave surface; and ejects the fluid into the inner fluid chamber to bulge the flexible layer and deforms the flexible layer into a convex surface.
6. A tactile presentation device as described in claim 4, wherein the tactile generating unit: places the inner annular member against a plurality of fine through holes corresponding to the contact area; sucks in the fluid in the inner fluid chamber to draw the flexible layer into the plurality of fine through holes and deforms the flexible layer into an uneven surface; and ejects the fluid into the inner fluid chamber to bulge the flexible layer and deform the flexible layer into a convex surface.
7. A tactile presentation device according to claim 4, wherein the tactile generation unit vibrates the flexible layer by repeatedly sucking and discharging the fluid from the inner fluid chamber.
8. A tactile presentation device as described in claim 2, wherein the defining layer has a plurality of through holes of different sizes, and the tactile generation unit presents different tactile sensations by sucking and / or ejecting the fluid into the plurality of through holes of different sizes.
9. A tactile presentation device according to claim 1, wherein the tactile generating unit further moves in the thickness direction of the flexible layer.
10. A tactile presentation device as claimed in claim 1, further comprising a sensor for detecting the contact area of the flexible layer.
11. A tactile presentation device as described in claim 1, wherein the surface of the flexible layer is an interior wall surface of a house functioning as an in-house interface, the surface of various electronic devices functioning as a tactile display, an in-vehicle console functioning as an operation interface, or an in-vehicle steering wheel or interior surface of a vehicle functioning as an interface for the operation system or hazard notification.
12. A tactile presentation method using a tactile presentation device having a flexible layer whose surface is exposed so that it can be touched by a user and which is flexible and deformable, a definition layer whose surface faces the back surface of the flexible layer and defines the shape of the flexible layer, and a tactile generating unit, wherein the tactile generating unit moves to a position facing the back surface of the definition layer and corresponding to a contact portion of the flexible layer that is the portion of the flexible layer that the user will touch, and the tactile generating unit deforms the contact portion of the flexible layer.
13. A vehicle equipped with a tactile presentation device having: a flexible layer whose surface is exposed so as to be touchable by a user and which is flexible and deformable; a definition layer whose surface faces the back surface of the flexible layer and defines the shape of the flexible layer; and a tactile generation unit that faces the back surface of the definition layer and moves to a position corresponding to a contact portion of the flexible layer that is the portion of the flexible layer that the user touches, and deforms the contact portion of the flexible layer.
Citation Information
Patent Citations
User interface device and personal digital assistant
JP2009064357A
Human-machine interface device and CAD system
JP2012242998A
Control devices for automated vehicles
JP2017531870A
