TELEPRINT SYSTEM

Abstract

A teletypewriter (TTY) system for a vehicle includes a display, a microphone coupled to the vehicle and configured to capture voice data, and an imager coupled to the vehicle and configured to capture image data. The TTY system includes an electronic control unit (ECU) communicatively connected to the display, the microphone, and the imager. The ECU includes a TTY application and is configured to project the TTY application onto the display in response to at least one of the voice data and the image data.

Description

INTRODUCTION

[0001] The information provided in this section is intended to provide a general context for the disclosure. Work by the inventors identified herein, to the extent described in this section, as well as aspects of the description that may not be prior art at the time of filing, are neither expressly nor impliedly acknowledged as prior art over the present disclosure.

[0002] The present disclosure relates generally to a teletypewriter (TTY) system for a vehicle.

[0003] When customizing a vehicle, the user must typically manually adjust the vehicle settings by entering the vehicle's system settings. For example, accessibility settings are typically located in the vehicle's audio settings, which can be accessed from the home menu. Some vehicles may also be equipped with mobile device connectivity options. For example, a user can connect a mobile device via a cable or wirelessly to view features of the mobile device on a vehicle display. However, the mobile device's settings typically remain separate from the vehicle, regardless of the connectivity settings.

[0004] In a rideshare scenario, the driver of a vehicle may have a mobile device connected to the vehicle, but the passenger does not. In this situation, connecting the passenger's mobile device to the vehicle would allow the passenger to share information with the driver. However, this requires the passenger to navigate to the vehicle's settings to establish a connection between the passenger's mobile device and the vehicle, which can be inconvenient during a rideshare, which is often of limited duration and generally not recurring. Thus, there is a need to improve the ease of actuation of settings that may be advantageous or useful for users who use accessibility settings both in the vehicle and on a mobile device. SUMMARY

[0005] In some aspects, a remote type interface (TTY) system for a vehicle includes a display and an infotainment head unit (IHU) communicatively coupled to the display. The IHU includes an electronic control unit (ECU) configured to project a TTY application onto the display, and the ECU includes computing hardware and storage hardware that stores a driver profile. The computing hardware includes the TTY application and is configured to execute the TTY application in response to a detected audio device and / or detected TTY settings from a user device.

[0006] In some examples, the TTY system may include a microphone communicatively coupled to the IHU and configured to capture voice data. The TTY application may be configured to execute a voice profile of the stored driver profile in response to the voice data. Optionally, the TTY system may include an image sensor communicatively coupled to the IHU and configured to capture image data. The TTY application may be configured to issue a notification in response to the captured image data. The TTY application may include accessibility settings and audio settings, and the notification may include at least one of the accessibility settings and the audio settings. In some embodiments, the IHU may be connected to a headrest of the vehicle.In other cases, the TTY application may include a hearing test, and the TTY application may be configured to perform the hearing test in response to the detected audio device. Optionally, the stored driver profile may include a digital key profile, and the TTY application may be configured to identify the digital key profile based on a detected digital key of the user device, and may be configured to adjust at least one of the audio settings and accessibility settings based on the identified digital key profile.

[0007] In other aspects, a teletypewriter (TTY) system for a vehicle includes a display and a microphone connected to the vehicle. The microphone is configured to capture voice data. The TTY system also includes an imager connected to the vehicle. The imager is configured to detect image data. The TTY system further includes an infotainment head unit communicatively connected to the display, the microphone, and the imager. The infotainment head unit includes an electronic control unit configured to project a TTY application onto the display. The electronic control unit includes computing hardware and storage hardware, and the computing hardware includes the TTY application.The data processing hardware is configured to execute the TTY application in response to at least one of the voice data, the image data, and the detected TTY settings from a user device.

[0008] In some examples, the storage hardware may store a voice profile. The TTY application may be configured to identify the voice profile based on the voice data and may be configured to execute accessibility settings based on the voice profile. Optionally, the TTY application may be configured to trigger a notification in response to the detected image data. The TTY application may include accessibility settings and audio settings, wherein the notification includes at least one of the accessibility settings and the audio settings. In some cases, the infotainment head unit may be connected to a headrest of the vehicle. In further embodiments, the TTY application may include a hearing test, and the TTY application may be configured to execute the hearing test in response to a detected audio device.Optionally, the storage hardware may store a digital key profile, and the TTY application may be configured to identify the digital key profile based on a recognized digital key of the user device, and may be configured to adjust at least one of the audio settings and accessibility settings based on the identified digital key profile.

[0009] In further aspects, a teletypewriter (TTY) system for a vehicle includes a display, a microphone coupled to the vehicle and configured to capture voice data, and an imager coupled to the vehicle and configured to capture image data. The TTY system includes an electronic control unit (ECU) communicatively coupled to the display, the microphone, and the imager. The ECU includes a TTY application and is configured to project the TTY application onto the display in response to at least one of the voice data and the image data.

[0010] In some examples, the controller includes storage hardware capable of storing a speech profile. The TTY application may be configured to identify the speech profile based on the speech data, and may be configured to execute accessibility settings based on the speech profile. Optionally, the TTY application may be configured to trigger a notification in response to the detected image data. The TTY application may include accessibility settings and audio settings, and the notification may include at least one of the accessibility settings and the audio settings. In some cases, the TTY application may include a hearing test, and the TTY application may be configured to execute the hearing test in response to a detected audio device.Optionally, the storage hardware may store a digital key profile, and the TTY application may be configured to identify the digital key profile based on a recognized digital key of a user device, and may be configured to adjust at least one of the audio settings and accessibility settings based on the identified digital key profile. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The drawings described herein are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Fig. 1 is a schematic representation of a vehicle equipped with a remote type writing (TTY) application according to the present disclosure, with a user approaching the vehicle with a user device; Fig. 2 is a functional block diagram of a TTY system according to the present disclosure; Fig. 3 is a partial perspective view of the interior of a vehicle in which a driver and a passenger communicate using sign language; Fig. 4 is a schematic representation of a TTY system according to the present disclosure in communication with a user device; Fig. 5 is an exemplary flow diagram of a TTY system according to the present disclosure; Fig. Figure 6 is another example flowchart of a TTY system of the Fig. 5; Fig. 7 is yet another exemplary flow diagram of a TTY system according to the present disclosure; Fig. 8 is another exemplary flow diagram of a TTY system according to the present disclosure; Fig. 9 is yet another exemplary flow diagram of a TTY system according to the present disclosure; Fig. 10 is another exemplary flow diagram of a TTY system according to the present disclosure; and Fig. 11 is another exemplary flow diagram of a TTY system according to the present disclosure.

[0012] Corresponding reference symbols indicate the corresponding parts in the drawings. DETAILED DESCRIPTION

[0013] Example embodiments will now be described in more detail with reference to the accompanying drawings. Example embodiments are provided so that this disclosure will be thorough and will fully convey the scope of the disclosure to those skilled in the art. Specific details, such as examples of particular components, devices, and methods, are set forth in order to provide a thorough understanding of the embodiments of the present disclosure. It will be apparent to those skilled in the art that specific details need not be used, that example embodiments may be embodied in many different forms, and that the specific details and example embodiments should not be construed to limit the scope of the disclosure.

[0014] The terminology used herein is for the purpose of describing particular exemplary embodiments only and is not intended to be limiting. As used herein, the articles “a,” “an,” “the,” “the,” and “the” include the plural forms unless the context clearly indicates otherwise. The terms “comprises,” “containing,” “include,” and “having” are all-inclusive and therefore specify the presence of features, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and / or groups thereof. The method steps, processes, and operations described herein should not be construed as requiring that they be performed in the order discussed or illustrated unless they are expressly identified as being in order of performance.Additional or alternative steps may be applied.

[0015] When an element or layer is described as being arranged "on" or "engaging with" another element or layer, or as being "connected" or "coupled" or "attached" to it, it may be arranged directly on or engaging with the other component, element, or layer, or it may be connected, coupled, or attached to it, or there may be intervening elements or layers. On the other hand, when an element is described as being "directly on" or "directly engaging with," "directly connected," "directly attached to," or "directly coupled" to another element or layer, there must be no intervening elements or layers. Other words used to describe the relationship between elements should be interpreted similarly (e.g.,(e.g., "between" versus "directly between," "adjacent" or "contiguous" versus "directly adjacent" or "directly adjacent," etc.). The term "and / or" as used herein includes all combinations of one or more of the above.

[0016] The terms "first," "second," "third," etc., may be used herein to describe various elements, components, regions, layers, and / or sections. These elements, components, regions, layers, and / or sections should not be limited by these terms. These terms may only be used to distinguish one element, component, region, layer, or section from another region, layer, or section. Terms such as "first," "second," and other numerical terms do not imply an order unless clearly indicated by the context. Thus, a first element, component, region, layer, or section discussed below could also be referred to as a second element, component, region, layer, or section without departing from the teachings of the exemplary embodiments.

[0017] In this application, including the definitions below, the term "module" may be replaced by the term "circuit". The term "module" may refer to, be part of, or include an application-specific integrated circuit (ASIC), a digital, analog, or mixed analog / digital discrete circuit, a digital, analog, or mixed analog / digital integrated circuit, a combinational logic circuit, a field-programmable gate array (FPGA); a processor (common, dedicated, or group) executing code; a memory (common, dedicated, or group) storing code executed by a processor; other suitable hardware components providing the described functionality; or a combination of some or all of the above, e.g., in a system-on-chip.

[0018] The term "code" as used above can include software, firmware and / or microcode and can refer to programs, routines, functions, classes and / or objects. The term "shared processor" includes a single processor that executes some or all of the code of multiple modules. The term "group processor" includes a processor that, in combination with other processors, executes some or all of the code of one or more modules. The term "shared memory" includes a single memory that stores some or all of the code of multiple modules. The term "group memory" includes memory that, in combination with other memory, stores some or all of the code of one or more modules. The term "memory" can be a subset of the term "computer-readable medium".The term "computer-readable medium" does not encompass transitory electrical and electromagnetic signals propagating through a medium and can therefore be considered tangible and non-transitory storage. Non-limiting examples of non-transitory storage include tangible, computer-readable medium, including non-volatile memory, magnetic storage, and optical storage.

[0019] The devices and methods described in this application may be implemented partially or entirely by one or more computer programs executed by one or more processors. The computer programs include processor-executable instructions stored on at least one non-transitory, tangible, computer-readable medium. The computer programs may also include and / or access stored data.

[0020] A software application (i.e., a software resource) may refer to computer software that causes a computing device to perform a task. In some examples, a software application may be referred to as an "application," "app," or "program." Example applications include, but are not limited to, system diagnostic applications, system management applications, system maintenance applications, word processing applications, spreadsheet applications, messaging applications, media streaming applications, social networking applications, and gaming applications.

[0021] Non-transitory memory may be physical devices used to temporarily or permanently store programs (e.g., instruction sequences) or data (e.g., program state information) for use by a computing device. Non-transitory memory may be volatile and / or non-volatile addressable semiconductor memory. Examples of non-volatile memory include, but are not limited to, flash memory and read-only memory (ROM) / programmable read-only memory (PROM) / erasable programmable read-only memory (EPROM) / electronically erasable programmable read-only memory (EEPROM) (e.g., typically used for firmware such as boot programs). Examples of volatile memory include, but are not limited to, random-access memory (RAM), dynamic random-access memory (DRAM), static random-access memory (SRAM), phase-change memory (PCM), and floppy disks or tapes.

[0022] These computer programs (also referred to as programs, software, software applications, or code) comprise machine instructions for a programmable processor and may be implemented in a procedural and / or object-oriented programming language and / or assembly / machine language. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, non-transitory computer-readable medium, apparatus, and / or device (e.g., magnetic disks, optical disks, memories, programmable logic devices (PLDs)) designed to provide machine instructions and / or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal designed to provide machine instructions and / or data to a programmable processor.

[0023] Various implementations of the systems and techniques described herein may be realized in digital electronic and / or optical circuits, integrated circuits, purpose-built ASICs (Application Specific Integrated Circuits), computer hardware, firmware, software, and / or combinations thereof. These various implementations may include implementation in one or more computer programs executable and / or interpretable on a programmable system comprising at least one programmable processor, which may be special-purpose or general-purpose, coupled to receive data and instructions from and transmit data and instructions to a storage system, and at least one input device and at least one output device.

[0024] The processes and logic flows described in this specification may be executed by one or more programmable processors, also referred to as data processing hardware, which execute one or more computer programs to perform functions by responding to input data and generating output. The processes and logic flows may also be executed by special-purpose logic circuits, such as an FPGA (Field Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit). Processors suitable for executing a computer program include, for example, both general-purpose and special-purpose microprocessors, as well as one or more processors of any type of digital computer. Generally, a processor receives instructions and data from read-only memory or random-access memory, or both.The essential elements of a computer are a processor for executing instructions, and one or more storage devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to, one or more mass storage devices for storing data, such as magnetic, magneto-optical, or optical disks, or to receive or transfer data to or from them, or both. However, a computer is not required to have such devices. Computer-readable media suitable for storing computer program instructions and data includes all forms of non-volatile memory, media, and storage devices, including, for example, semiconductor storage devices, such as EPROM, EEPROM, and flash memory devices; magnetic disks, such as internal hard disks or removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks.The processor and memory can be supplemented by or integrated into special logic circuits.

[0025] To provide interaction with a user, one or more aspects of the disclosure may be implemented on a computer having a display device, e.g., a CRT (cathode ray tube), LCD (liquid crystal display) monitor, or a touchscreen for displaying information to the user, and optionally a keyboard and pointing device, e.g., a mouse or trackball, with which the user can provide input to the computer. Other types of devices may also be used to interact with the user; e.g., the user may receive any form of sensory feedback, e.g., visual feedback, auditory feedback, or tactile feedback, and user input may be received in any form, including auditory, voice, or tactile input.In addition, a computer can interact with a user by sending and receiving documents to and from a device used by the user, for example, by sending web pages to a web browser on a client device of the user in response to requests received from the web browser.

[0026] Referring now to the figures, a teletypewriter (TTY) system 10 includes a user device 100, an audio device 102, and a vehicle 200 equipped with an infotainment head unit (IHU) 12. The IHU 12 includes an electronic control unit (ECU) 14 configured with a TTY application 16, as described herein. The ECU 14 is configured to project the TTY application 16 onto a display 202 of the vehicle 200, and the TTY application 16 is executed by data processing hardware 18 of the ECU 14. The ECU 14 also includes memory hardware 20 that communicates with the data processing hardware 18 and is configured to store operations performed by the data processing hardware 18. The storage hardware 20 also stores a driver profile 22, which includes a digital key profile 24, a voice profile 26, and the driver audio preferences 28.As described herein, the digital key profile 24 stored on the storage hardware 20 may correspond to one or more user devices 100.

[0027] The TTY application 16 includes accessibility settings 30 and audio settings 32. The accessibility settings 30 may, for example, include TTY functions 30a. For example, the TTY functions 30a may provide the user with the ability to communicate via text instead of speaking or listening. The accessibility and audio settings 30, 32 are configured to adjust the acoustic settings of the vehicle 200. The TTY application 16 is configured to issue a notification 34 in response to the detected user device 100, which is described in more detail below. The notification 34 may include a hearing test 36 that may assist the user in adjusting and / or setting the accessibility settings 30. As described herein, the TTY application 16 may update the driver profile 22 in response to inputs to the IHU 12 and the hearing test 36.For example, the results of the hearing test 36 may be stored as part of the driver audio preferences 28 in the driver profile 22. In some examples, the TTY application 16 is configured to receive TTY settings 104 from the user device 100 via short-range communication. For example, the IHU 12 and the user device 100 are each configured with short-range communication to communicate with external devices. For example, the IHU 12 may communicate with the user device 100 via one or more short-range wireless communication protocols, including, but not limited to, Bluetooth®, Bluetooth® Low Energy (BLE), Wi-Fi®, low frequency (LF), and ultra-wideband (UWB).

[0028] The audio device 102 may also be in short-range communication with the IHU 12 and the user device 100, or both. In some examples, the audio device 102 may be a hearing aid, as shown in Fig. 3. However, the audio device 102 may also include other audio devices used by the user for audio purposes, including, but not limited to, wireless or wired headphones. The user may use the audio device 102 to amplify or otherwise enhance audio signals. The TTY system 10 is configured to optionally and automatically interconnect the IHU 12, the user device 100, and the audio device 102. For example, upon detection of the audio device 102 by the TTY system 10, the TTY application 16 may be activated and request and / or execute the hearing test 36 in response to the detected audio device 102. In some cases, the TTY application 16 may provide the option to use the audio device 102 for audio output.

[0029] The user device 100 may be configured with TTY settings 104, which may be recognized by the TTY application 16 upon connecting to the IHU 12. The user device 100 may be connected to the IHU 12 via a media sharing application 106. The media sharing application 106 is generally configured to project media from the user device 100 onto a display 202 of the vehicle 200. The display 202 may be configured as part of the IHU 12. The TTY application 16 may receive the TTY settings 104 of the user device 100 as a result of the connection from the media sharing application 106. For example, the user may connect the user device 100 to the IHU 12 via the media sharing application 106, and the TTY settings 104 may be automatically uploaded or otherwise shared with the TTY application 16 of the IHU 12.In this way, the existing TTY settings 104 active on the user device 100 may be communicated with the TTY application 16. The TTY application 16 may utilize the media sharing application 106 to facilitate the transfer of the TTY settings 104.

[0030] The TTY application 16 may issue the notification 34 including an option to automatically adjust the accessibility settings 30 to the TTY settings 104 received from the user device 100. If the user allows the option to apply the TTY settings 104, the TTY application 16 automatically updates the accessibility settings 30 and / or the audio settings 32 to reflect the TTY settings 104 from the user device 100. In this way, the user can easily configure personalized TTY settings 104 without having to manually navigate to the accessibility settings 30 and / or audio settings 32 via the IHU 12. In other examples, the IHU 12 may detect the audio device 102, and the TTY application 16 may issue the notification 34 including a prompt to adjust the audio settings 32.For example, the TTY application 16 may adjust the audio settings 32 to play sound from the audio device 102 instead of from a speaker system of the vehicle 200.

[0031] If the user confirms the option to use the audio device 102 rather than the speaker system of the vehicle 200 for audio playback, the TTY application 16 executes and adjusts the audio settings 32. Additionally, the TTY application 16 may prompt the notification 34 to recommend saving the audio settings 32 as part of the driver profile 22. A similar notification 34 may be issued when TTY settings 104 are received from the user device 100. Updating or saving the accessibility settings 30 and the audio settings 32 in the driver profile 22 simplifies the process in the future, allowing the TTY settings 104 to be automatically set for the user upon the next use.

[0032] In some examples, the user may choose not to use the audio device 102 for audio projection from the vehicle 200. In this example, the TTY application 16 may prompt the user to complete the hearing test 36. The hearing test 36 includes a series of audio prompts and feedback. The TTY application 16 utilizes the user's feedback via the feedback prompts to automatically adjust the audio settings 32. While the audio signals may be projected through a speaker system of the vehicle 200, the TTY application 16 may be used to sharpen and tune the audio signals to optimize the user experience. Optionally, the user may forgo the hearing test 36 or complete a portion of the hearing test 36. In each example, the TTY application 16 is configured to automatically adjust the audio settings 32 and to save the adjusted audio settings 32 to the respective driver profile 22.

[0033] With reference to the Fig. 2-4, the vehicle 200 may be equipped with an image converter 204 that is communicatively connected to the IHU 12. The image converter 204 is, for example, in Fig. 3 as being located near the display 202. However, the imager 204 may be located at any practical location within the interior 206 of the vehicle 200. The imager 204 is configured to capture and / or recognize image data 208 within the vehicle 200 and communicate the image data 208 with the ECU 14 of the IHU 12. In response, the ECU 14 may activate the TTY application 16, which may be configured to trigger a notification 34 in response to the captured image data 208.

[0034] For example, Fig. 3 depicts a passenger of vehicle 200 communicating via sign language. Image converter 204 is configured to capture image data 208, including using sign language, and transmit image data 208 to TTY application 16. Based on the detected image data 208, TTY application 16 may automatically adjust accessibility settings 30 and / or audio settings 32. In some examples, in response to image data 208, TTY application 16 may issue notification 34 asking the user whether to enable accessibility settings 30. As described above, the user may enable accessibility settings 30 and / or decline notification 34.

[0035] The TTY application 16 may also be configured to automatically prompt the user with notification 34 whether the user wishes to enable the accessibility settings 30 in response to the user's navigation patterns. For example, the IHU 12 may detect that the user is navigating to the accessibility settings 30 and / or the audio settings 32 of the IHU 12 on the display 202. In response, the TTY application 16 may issue notification 34 asking the user whether they wish to perform the hearing test 36 described above, rather than manually adjusting and setting the settings 30, 32. When the user performs the hearing test 36, the TTY application 16 automatically adjusts the settings 30, 32 based on the results of the hearing test 36.

[0036] As in Fig. 1, the user can access the vehicle 200 using a digital key 108. The digital key 108 can be associated with the digital key profile 24 stored as part of the driver profile 22. In this way, the TTY application 16 can recognize the driver profile 22 based on the digital key profile 24 and automatically adjust the settings 30, 32 of the IHU 12 to correspond to all possible TTY settings 104. For example, the user can unlock the vehicle 200 using the digital key 108 on the user device 100, thereby alerting the TTY application 16 that a digital key profile 24 associated with a previously set driver profile 22 is active.Thus, if the user has previously completed one of the processes described herein with respect to the TTY application 16, the detection of the digital key profile 24 triggers the TTY application 16 to execute the associated driver profile 22.

[0037] The vehicle 200 may also be equipped with a microphone 210 communicatively coupled to the IHU 12 and configured to capture voice data 212. The microphone 210 may, for example, be located on an exterior of the vehicle 200. The voice data 212 is communicated with the ECU 14 and may be matched to the voice profile 26 of the driver profile 22. Thus, the ECU 14 may identify the user based on the voice data 212. For example, the user may say a predetermined phrase (e.g., "open vehicle"), and the ECU 14 receives the voice data 212 to determine the corresponding driver profile 22. In response, the TTY application 16 is configured to execute the voice profile 26 based on the voice data 212.

[0038] Similar to recognizing the digital key 108, the TTY application 16 can automatically adjust the settings 30, 32 based on the voice data 212. The voice data 212 can, for example, include the voice biometrics 26a stored as part of the voice profile 26. The TTY application 16 can compare the voice data 212 to the voice biometric data 26a to determine whether the recognized user has previously performed the processes for adjusting the settings 30, 32. Once the driver profile 22 is recognized, the TTY application 16 automatically adjusts the settings 30, 32 to the previously established settings. Thus, the voice biometrics 26a can facilitate the tasks of the digital key 108 and provide an alternative modality for confirming the driver profile 22.

[0039] In some examples, the user device 100 may transmit the TTY settings 104 to the ECU 14 via a third-party account 40 stored as part of the driver profile 22. The third-party account 40 may correspond to a third-party server 300 that communicates with the user device 100. For example, the user may have the third-party account 40 set up and stored on the user device 100 to perform various functions on the user device 100. After connecting the user device 100 to the IHU 12 and / or recognizing the user device 100 by the ECU 14, the third-party account 40 may be identified by the ECU 14 and stored as part of the respective driver profile 22. Once the third-party account 40 is stored in the driver profile 22, the data associated with the third-party account 40, including any TTY settings 104, may be transferred and incorporated as part of the driver profile 22.

[0040] The third-party account 40 may be configured with routines 42 that may include the TTY settings 104. Upon detecting the user device 100 and identifying the third-party account 40, the TTY application 16 may execute the routines 42 associated with the TTY settings 104. For example, the TTY application 16 may adjust the accessibility settings 30 in response to one of the routines 42 stored in the third-party account 40. Although Fig. 2 as being stored in the storage hardware 20, the third-party account 40 may initially be transmitted from the user device 100.

[0041] In some examples, routines 42 may be associated with a time of day that may affect noise outside vehicle 200. For example, during busier times of day, outside noise may affect the audio signals inside the interior 206 of vehicle 200. Thus, based on routine 42 and the time of day, TTY application 16 may adjust audio settings 32 to balance the audio signals inside the interior 206 relative to the outside noise. In some cases, in response to detecting a routine 42, TTY application 16 may first issue a notification 34 to prompt the user to choose to change accessibility settings 30 and / or audio settings 32 or to ignore it.

[0042] As described herein, the TTY application 16 is configured to automatically adjust the IHU 12 to include the TTY settings 104 received from a user device 100 and / or to enable the audio preferences of the driver 28 based on a stored driver profile 22. In some examples, the vehicle 200 may be a ride-sharing vehicle 200 where the user of the user device 100 is a passenger in a new vehicle 200. In this example, the IHU 12 or the Rear Seat Entertainment (RSE) monitor may be disposed on or connected to a rear surface 214 of headrests 216 of the vehicle 200, and the user may connect the user device 100 to at least one of the displays 202 on the headrests 216 or the IHU 12 of the vehicle.

[0043] When a user connects to the display 202 on the headrest 216, the TTY application 16 can receive any potential TTY settings 104 from the user device 100 in the manner described herein. For example, the TTY application 16 can utilize the media sharing application 106 to capture the TTY settings 104 of the user device 100. The rideshare vehicle 200 can also be equipped with the image converter 204, which, as mentioned above, can detect the use of sign language between passengers. Detecting the sign language can automatically cause the TTY application 16 to display a notification 34 on the passenger's display 202 asking if the passenger would like to adjust the accessibility settings 30 and / or the audio settings 32 of the IHU 12. In this way, the overall user experience for people with hearing impairments during a ride can be improved.In addition, the driver of the ride-sharing vehicle 200 can communicate better with the passengers and understand them better.

[0044] With reference now to the Fig. 1-11, a series of sample flowcharts for the TTY system 10 are described, incorporating the processes and options described herein. With particular reference to the Fig. 5 and Fig. 6, the TTY system 10 detects a device at 600. In some examples, the TTY system 10 detects a user device 100 and then determines the TTY settings 104 at 602. The TTY system 10 then displays a notification 34 via the TTY application 16 at 604 to set or otherwise adjust the accessibility settings 30 and the audio settings 32. In other examples, the TTY system 10 detects an audio device 102 at 606. Then, the TTY system 10 offers the option to use the audio device 102 for audio output via the notification 34 at 608 via the TTY application 16. The TTY system 10 then determines whether the user has used the audio device 102 for audio output at 610. If so, the TTY system 10 uses the audio device 102 for audio output at 612 and prompts the user at 614 to update the driver profile 22.

[0045] If the user does not select to use the audio device 102, the TTY system 10 prompts the user at 616 to perform the hearing test 36. The TTY system 10 determines at 618 whether the user has completed the hearing test 36. If the user does not complete the hearing test 36, the IHU 12 returns to a home screen at 620. If the user passes the hearing test 36, the TTY system 10 adjusts the acoustic settings of the interior 206 at 622. The TTY system 10 then tests the audio playback for the user with the adjusted acoustic settings via the TTY application 16 at 624. The user can accept the new settings 30, 32 at 626. In other cases, the user can reject the settings 30, 32 at 628 and manually adjust or tune the settings 30, 32. Otherwise, at 630, the user can simply reject settings 30, 32 and the IHU 12 will return to the home screen.

[0046] With particular reference to Fig. Figure 7 outlines another example of a flowchart for the TTY system 10. At 700, the TTY system recognizes a user based on a digital key 108. The TTY system 10 may also recognize the user at 702 based on the voice data 212 and the voice profile 26. Further, the TTY system 10 may recognize the user at 704 based on a third-party account 40. If the TTY system 10 recognizes the user based on the voice data 212, the TTY system 10 may identify and locate the voice data 212 at 706. Once the user has been recognized by the TTY system 10, the TTY system 10 may enable the accessibility settings 30 at 708.

[0047] With reference now to Fig. 8 illustrates another example of a flowchart for the TTY system 10. At 800, the TTY system 10 detects that a user device 100 is connected to the IHU 12 via a media sharing application 106. Through the media sharing application 106, the TTY system 10 may detect the TTY settings 104 at 802. The TTY system 10 may issue a notification 34 via the TTY application 16 at 804 recommending that the TTY application 16 be adjusted based on the TTY settings 104.

[0048] With reference to Fig. 9, the user may set the IHU 12 to support the TTY functions 30a at 900. The TTY application 16 may be set to scan for short-range wireless connections at 902. In some examples, the image converter 204 is enabled at 904. The TTY system 10 may detect the user device 100 and / or audio device 102 of a second user or passenger at 906. In some cases, the TTY system 10 may detect which sign language the second user is using at 908. In response to the detected user device 100, audio device 102, and / or use of sign language, the TTY system 10 may prompt the second user to share the TTY settings 104 with the IHU 12. If this is accepted, the TTY application 16 is activated to adjust the settings 30, 32.

[0049] With reference now to Fig. 10, the image converter 204 is activated at 1000 and detects the sign language at 1002. In response, the TTY system 10 may trigger a notification 34 to activate the TTY application 16 to adjust the settings 30, 32. In some examples, the TTY system 10 may detect the adjustment of the accessibility settings 30 at 1006 and subsequently trigger the notification 34 at 1004.

[0050] Fig.11 shows another example of a flowchart for the TTY system 10, where the TTY system 10 detects inputs to the IHU 12 that match the accessibility settings 30 at 1100. In response, the TTY system 10 may activate the TTY application 16 at 1102. The TTY system 10 may also initiate the hearing test 36 at 1104. The user may complete the hearing test 36 at 1106, and the TTY system 10 may adjust the settings 30, 32 at 1108. The TTY system 10 then tests the new settings 30, 32 at 1110. The user may accept the settings 30, 32 at 1112 or reject the settings 30, 32 at 1114. If the user rejects settings 30, 32, he can manually adjust settings 30, 32 at 1116 or return to perform the hearing test 36 again.

[0051] While a number of implementations have been described, it should be understood that various changes may be made without departing from the spirit and scope of the disclosure. Accordingly, other embodiments are intended to be within the scope of the following claims.

[0052] The foregoing description is for purposes of illustration and description only. It is not intended to be exhaustive or limiting of the disclosure. Individual elements or features of a particular embodiment are generally not limited to that specific embodiment, but may be interchangeable and used in a selected embodiment even if not specifically shown or described. These may also be varied in many respects. Such variations are not to be considered a departure from the disclosure, and all such changes are intended to be included within the scope of the disclosure. legend

[0053] In the drawings, N stands for No and Y stands for Yes.

Claims

[1] Teletype system (TTY) for a vehicle, the TTY system comprising: a display; and an infotainment head unit (IHU) communicatively coupled to the display and comprising an electronic control unit (ECU) configured to project a TTY application onto the display, the ECU comprising computing hardware and storage hardware that stores a driver profile, the computing hardware comprising the TTY application and configured to execute the TTY application in response to at least one of a detected audio device and detected TTY settings from a user device. [2] The TTY system of claim 1, further comprising a microphone communicatively coupled to the IHU and configured to capture voice data. [3] The TTY system of claim 2, wherein the storage hardware stores a voice profile and the TTY application is configured to identify the voice profile based on the voice data and is configured to perform accessibility settings based on the voice profile. [4] The TTY system of claim 1, further comprising an imager communicatively coupled to the IHU and configured to capture image data, wherein the TTY application is configured to trigger a notification in response to the captured image data. [5] The TTY system of claim 4, wherein the TTY application comprises accessibility settings and audio settings, wherein the notification comprises at least one of the accessibility settings and the audio settings. [6] The TTY system of claim 1, wherein the IHU is connected to a headrest of the vehicle. [7] The TTY system of claim 1, wherein the TTY application comprises a hearing test, the TTY application being configured to perform the hearing test in response to the detected audio device. [8] The TTY system of claim 1, wherein the stored driver profile comprises a digital key profile. [9] The TTY system of claim 8, wherein the TTY application is configured to identify the digital key profile based on a recognized digital key of the user device. [10] The TTY system of claim 9, wherein the TTY application is configured to adjust at least one of the audio settings and accessibility settings based on the identified digital key profile.

Images