In-vehicle information delivery device

Abstract

The present application has an object to deliver sufficient information even when an occupant has a visual and auditory disorder. A vehicle interior information delivery device includes a control section for converting character information indicating a message input from a vehicle side into Braille information, and a touch panel for presenting the converted Braille information as tactile information.

Description

Technical Field

[0001] This invention relates to an information transmission device inside a vehicle. Background Technology

[0002] Patent Document 1 discloses a seat system in which, when a backrest adjustment process is determined to be performed due to a switch from non-autonomous to autonomous driving, the system pre-determines whether there is an obstacle within the seat trajectory, and begins performing the backrest adjustment process if no obstacle is found. In this seat system, the determination result of the backrest adjustment process is communicated to the occupant via voice information, sound information, image information, vibration, or the vehicle's internal speakers or interior lights.

[0003] Patent Document 2 discloses a vehicle alarm device that, when the vehicle is determined to be in a dangerous state, uses an input operation device (display, mobile phone) to issue a warning to the occupants. In this vehicle alarm device, a tactile operation device (operational reaction force, vibration, weak current) is used as the input operation device.

[0004] Patent Document 1: Japanese Patent Application Publication No. 2022-147750 Patent Document 2: Japanese Patent Application Publication No. 2007-326492 Summary of the Invention Previous alarm systems were designed for healthy individuals or those with some degree of visual or hearing impairment, and the amount of information conveyed was significantly limited. Therefore, it was difficult to adequately inform passengers with severe visual or hearing impairments. In the future, a technology is needed to address the broader need for accessible mobility for a wider range of people.

[0005] The purpose of this invention is to provide an in-vehicle information transmission device that can transmit sufficient information even when the occupant has visual or auditory impairments.

[0006] The in-vehicle information transmission device described in technical solution 1 includes: a control unit for converting character information representing messages input from the vehicle side into Braille information; and a touch panel for providing the converted Braille information as tactile information.

[0007] In the in-vehicle information transmission device described in technical solution 1, the control unit converts character information representing messages input from the vehicle side into Braille information. The touch panel then uses the converted Braille information as tactile feedback.

[0008] In this in-vehicle information transmission device, character information representing messages input from the vehicle side is converted into Braille information and presented to the occupants as tactile feedback. Therefore, sufficient information can be transmitted even when the occupants have visual or hearing impairments.

[0009] In the in-vehicle information transmission device described in technical solution 1, the touch panel of technical solution 2 accepts user input and provides tactile feedback through tactile output.

[0010] In the in-vehicle information transmission device described in technical solution 2, the touch panel accepts user input and provides tactile feedback through tactile output. Here, tactile output refers to providing skin sensory feedback by applying force, vibration, or movement to the occupant. According to this in-vehicle information transmission device, the touch panel can also accept user input.

[0011] In the in-vehicle information transmission device described in technical solution 1, the control unit further acquires character information describing the scenery represented by the image captured by the camera, and converts the character information into Braille information.

[0012] In the in-vehicle information transmission device described in technical solution 3, the control unit acquires an image representing the vehicle's surroundings captured by a camera, obtains character information describing the scenery depicted in the image, and converts the character information into Braille information. The touch panel provides tactile feedback using the converted Braille information. According to this in-vehicle information transmission device, information describing the scenery surrounding the vehicle can be transmitted even when the occupant has visual or hearing impairments.

[0013] Invention Effects According to the present invention, sufficient information can be transmitted even when the occupants have visual or auditory impairments. Attached Figure Description

[0014] Figure 1 This is a block diagram illustrating the hardware structure of the vehicle according to this embodiment.

[0015] Figure 2 This is a block diagram illustrating the functional structure of the in-vehicle information transmission device according to this embodiment.

[0016] Figure 3 This is a diagram illustrating an example of the touch panel configuration in this embodiment.

[0017] Figure 4 This is a block diagram showing the hardware structure of the control unit in this embodiment.

[0018] Figure 5This is a flowchart illustrating the process executed in the control unit of the in-vehicle information transmission device in this embodiment.

[0019] Figure 6 This is a flowchart illustrating the process executed in the control unit of the in-vehicle information transmission device in this embodiment. Detailed Implementation

[0020] (Overall structure) like Figure 1 As shown, the vehicle 12 according to this embodiment is configured to include a vehicle-mounted unit 20 and an in-vehicle information transmission device 30. The vehicle-mounted unit 20 and the in-vehicle information transmission device 30 are connected via wired or wireless communication.

[0021] The vehicle-mounted device 20 controls the vehicle based on images of the vehicle's surroundings captured by the camera 22.

[0022] like Figure 2 As shown, the in-vehicle information transmission device 30 is composed of a control unit 32 and a touch panel 34.

[0023] The control unit 32 converts the character information representing the message input from the vehicle-mounted device 20 on the vehicle 12 side into Braille information.

[0024] The touch panel 34 provides tactile feedback by converting the Braille information.

[0025] Specifically, the touch panel 34 includes an input receiving unit 36 ​​and a tactile output unit 38. The input receiving unit 36 ​​accepts user input. The tactile output unit 38 outputs tactile prompts.

[0026] For example, such as Figure 3 As shown, the touch panel 34 is located in front of the armrest of the seat.

[0027] like Figure 4 As shown, the control unit 32 comprises a central processing unit (CPU) 32A, a read-only memory (ROM) 32B, a random access memory (RAM) 32C, a storage device 32D, and a communication interface (I / F) 32E. The CPU 32A, ROM 32B, RAM 32C, storage device 32D, and communication I / F 32E are communicatively connected to each other via an internal bus 32G.

[0028] The CPU32A is the central processing unit, which executes various programs or controls other parts. That is, the CPU32A reads programs from the ROM32B or storage device 32D and uses the RAM32C as the working area to execute the programs.

[0029] ROM32B stores various programs and data. In this embodiment, ROM32B stores a control program. The control program is used to display Braille information based on the vehicle-mounted device 20 or user input.

[0030] RAM32C is used as temporary storage for programs or data in the work area.

[0031] The storage device 32D, which serves as a memory, consists of a hard disk drive (HDD) or a solid state drive (SSD) and stores various programs and data. Additionally, the storage device 32D can also store control programs.

[0032] The Communication I / F32E is a communication module used to communicate with the vehicle-mounted unit 20 and the touch panel 34. This communication module may use communication standards such as 5G, LTE, Wi-Fi (registered trademark), or a CAN-based communication standard.

[0033] (Control process) use Figure 5 , Figure 6 The flowchart below describes the processing flow performed in the control unit 32 of the in-vehicle information transmission device 30 in this embodiment.

[0034] First, if a message for prompting occupants (e.g., traffic congestion information or an alarm related to vehicle 12) is input from the on-board unit 20 on the vehicle 12 side, then execution is performed. Figure 5 The processing shown.

[0035] In step S100, the control unit 32 acquires a message input from the vehicle-mounted device 20 on the vehicle 12 side.

[0036] In step S102, the control unit 32 converts the message obtained in step S100 into character information.

[0037] In step S104, the control unit 32 uses existing Braille translation software to convert the character information converted in step S102 into Braille information.

[0038] In step S106, the control unit 32 controls the tactile output unit 38 to output tactile information that indicates the converted Braille information.

[0039] Furthermore, if input from the user is received in the input receiving unit 36 ​​of the touch panel 34, then the following is executed: Figure 6 The processing shown.

[0040] For example, the tactile output unit 38 displays Braille information for each menu button, including a language description of the scenery outside the car window, an inquiry about whether it is an area where autonomous driving is possible, and an inquiry about road information, through tactile output prompts, while the input receiving unit 36 ​​receives input from the user who selects a menu button.

[0041] In step S110, the control unit 32 acquires the input received from the user.

[0042] In step S112, the control unit 32 determines which menu button selection corresponds to the user input obtained in step S110. If the user input is a selection of a menu button corresponding to a verbal description of the scenery outside the car window, the process proceeds to step S114. If the user input is a selection of a menu button corresponding to an inquiry about whether the area is a region suitable for automated driving, the process proceeds to step S118. If the user input is a selection of a menu button corresponding to an inquiry about road information, the process proceeds to step S122.

[0043] In step S114, the control unit 32 acquires images of the vehicle's surroundings captured by the camera 22 from the vehicle-mounted device 20.

[0044] In step S116, the control unit 32 acquires character information describing the scenery represented by the acquired image of the vehicle's surroundings. For example, it uses a generative AI model to generate character information describing the scenery represented by the image.

[0045] In step S118, the control unit 32 queries the vehicle-mounted device 20 to determine whether it is an area where autonomous driving is possible, and determines whether it is an area where autonomous driving is possible based on the response from the vehicle-mounted device 20.

[0046] In step S120, the control unit 32 acquires character information indicating whether it is a region suitable for autonomous driving. For example, it uses a generative AI model to generate character information explaining whether it is a region suitable for autonomous driving.

[0047] In step S122, the control unit 32 obtains road information from the vehicle-mounted device 20.

[0048] In step S124, the control unit 32 obtains character information describing the acquired road information based on the acquired road information. For example, it uses a generative AI model to generate character information describing the road information.

[0049] In step S126, the control unit 32 converts the character information generated in steps S116, S120 or S124 into Braille information.

[0050] In step S128, the control unit 32 controls the tactile output unit 38 to output tactile information that indicates the converted Braille information.

[0051] (Summary of implementation methods) In this in-vehicle information transmission device, character information representing messages input from the vehicle side is converted into Braille information and presented to the occupants as tactile feedback. Therefore, sufficient information can be transmitted even to occupants with visual or hearing impairments. Furthermore, alarms and other information can be transmitted to occupants in real time without significantly limiting the amount of information.

[0052] Furthermore, by using a two-way Braille panel that combines AI language description and tactile technology, it is possible to provide effective information from the vehicle side and communicate with the occupants.

[0053] Symbol Explanation 12-Vehicle, 20-Vehicle unit, 22-Camera, 30-Indoor information transmission device, 32-Control unit, 34-Touch panel, 36-Input receiving unit, 38-Tactile output unit.

Claims

1. An in-vehicle information transmission device, characterized in that, include: The control unit is used to convert character information representing messages input from the vehicle side into Braille information; and A touch panel is used to provide tactile feedback by presenting the converted Braille information.

2. The in-vehicle information transmission device according to claim 1, characterized in that, The touch panel accepts user input and provides tactile feedback through haptic output.

3. The in-vehicle information transmission device according to claim 1, characterized in that, The control unit further acquires character information describing the scenery represented by the image captured by the camera, and converts the character information into Braille information.

Images