Non visual interactive system

The non-visual interactive system addresses the limitation of existing assistive technologies by integrating a controller with AI and sensors to provide real-time output of surrounding conditions, enhancing safety and convenience for visually and hearing impaired individuals.

KR103045160B1Active Publication Date: 2026-11-05DONGSEO UNIV TECH HEADQUARTERS
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
KR1020240115806
Authority / Receiving Office
KR · KR
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-08-28
Publication Date
2026-11-05
Estimated Expiration
2044-08-28

AI Technical Summary

Technical Problem

Existing assistive technologies for the visually and hearing impaired fail to simultaneously monitor and output surrounding conditions in real time upon request, limiting their effectiveness.

Method used

A non-visual interactive system comprising a controller with input/output units, AI module, storage unit, and sensors, including a camera for the visually impaired and sound player for the hearing impaired, utilizing ChatGPT for real-time output of surrounding conditions.

Benefits of technology

Enhances convenience and safety by providing real-time output of surrounding situations to individuals with disabilities, using a device that adjusts voice output based on ambient noise and supports Braille display.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 112024094225787-PAT00001_ABST
    Figure 112024094225787-PAT00001_ABST
Patent Text Reader

Abstract

Devices for the disabled and; The device for the disabled comprises a controller; and a camera; and a sound player for the hearing impaired. Composed of a digital braille player for the visually impaired, Therefore, it has a significant effect in promoting convenience and safety.
Need to check novelty before this filing date? Find Prior Art

Description

Technology Field

[0001] The present invention relates to a non-visual interactive system, and more specifically, to a non-visual interactive system that promotes convenience and safety by outputting surrounding conditions in real time through an output means upon the request of a person with hearing or visual impairments. Background Technology

[0002] Generally, electronic devices for the visually and hearing impaired are widely used as assistive devices, and as an example of prior patent technology, Publication No. 10-2022-0023458 describes a configuration of a wearable device for safety management of the visually impaired that collects real-time information regarding the surrounding environment of the site of the visually impaired, integrates dualized aggregated information through video information and IR sensing information in a central processing unit (MCU), analyzes risk factors and elements requiring information guidance, and performs real-time information transmission to the user.

[0003] A configuration of a wearable device is disclosed, comprising: a step in which a local central processing unit worn by a user in a wearable form directly collects and analyzes image information and proximity obstacle information without other additional equipment; a step in which the central processing unit performs analysis content, including, as a major analysis content, identification of crosswalks, status of traffic lights and traffic light colors (green, red), bus numbers of approaching buses at bus stops, etc., and whether surrounding people and vehicles are moving in close proximity; and a step of transmitting voice to the user through a speaker module included in the wearable device based on the analysis results. Additionally, Publication No. 10-2018-0033484 discloses a wearable information providing device for the visually impaired, and Publication No. 10-2021-0109940 discloses a recognition unit that measures sound or movement around the user;

[0004] A mobile terminal that transmits a control signal to control information detected in conjunction with the above-mentioned recognition unit;

[0005] An assistive system for the hearing impaired using a wearable device is disclosed, characterized by including: a wearable device that provides notification to the user according to a set signal system in conjunction with the mobile terminal or the recognition unit.

[0006] However, the aforementioned conventional technologies had a disadvantage in that they could not monitor hearing and vision together and output surrounding conditions in real time via an output means upon a request from a person with a disability, which limited their use. The problem to be solved

[0007] Therefore, the present invention has been devised to solve the aforementioned problems and aims to provide a non-visual interactive system that promotes convenience and safety by outputting the surrounding situation in real time via an output means upon the request of hearing or visual impaired persons. means of solving the problem

[0008] Devices for the disabled and;

[0009] The device for the disabled comprises a controller; and a camera; and a sound player for the hearing impaired.

[0010] A non-visual interactive system characterized by being composed of a digital braille player for the visually impaired Effects of the invention

[0011] Therefore, the present invention has a significant effect of promoting convenience and safety by outputting the surrounding situation in real time to an output means upon request by hearing or visual impaired persons. Brief explanation of the drawing

[0012] FIG. 1 is an explanatory diagram of the non-visual interactive system of the present invention. FIG. 2 is a configuration diagram of the present invention and FIG. 1 is a configuration diagram of the non-visual interactive controller of the present invention. Specific details for implementing the invention

[0013] The present invention relates to a non-visual interactive system, comprising a device for disabled persons;

[0014] It is characterized by being composed of a controller.

[0015] The controller is characterized by being composed of an input / output unit such as a touchscreen or touchpad, an AI module, a control unit, and a storage unit.

[0016] The AI ​​module is characterized by including chatgpt.

[0017] The above-mentioned device for the disabled comprises a camera; and a sound player for the hearing impaired;

[0018] It is characterized by being composed of a digital braille player for the visually impaired.

[0019] When a person with a disability requests it, the control unit is characterized by outputting the situation using a device for people with disabilities.

[0020] ChatGPT is characterized by being utilized as an interface for TV or video playback, viewing, and searching for people with disabilities.

[0022] The present invention will be described in detail with reference to the attached drawings as follows.

[0023] FIG. 1 is an explanatory diagram of the non-visual interactive system of the present invention, FIG. 2 is a configuration diagram of the non-visual interactive controller of the present invention.

[0024] The non-visual interactive system of the present invention comprises a device for disabled persons and a controller.

[0025] The controller consists of input / output units such as a touchscreen and touchpad, an AI module, a control unit, and a storage unit, and can use a PC.

[0026] The AI ​​module includes ChatGPT and is utilized as an interface for TV or video playback, viewing, and searching for people with disabilities.

[0027] The above-mentioned device for the disabled comprises a camera; and a sound player for the hearing impaired;

[0028] It consists of a digital Braille player for the visually impaired. In particular, the control unit displays new models, such as Braille players, on the output unit when they are released. User reviews are also displayed simultaneously. A communication module is installed in the controller to record usage status and evaluations in a server database, allowing for the purchase and recommendation of the appropriate device for the disabled based on usage frequency and other factors. Specifically, when the sound player is playing, the controller's sensor detects the surrounding sound decibels and adjusts the voice output to be louder and clearer than the surrounding noise, thereby enhancing the convenience of the disabled. The sensor is a sound detection sensor.

[0029] Therefore, if a person with a disability requests it, the control unit outputs the situation using a device for the disabled.

[0030] Therefore, the present invention has a significant effect of promoting convenience and safety by outputting the surrounding situation in real time to an output means upon request by hearing or visual impaired persons.

Claims

Claim 1 A non-visual interactive system comprising a device for persons with disabilities and a controller, wherein the device for persons with disabilities comprises a camera, a sound player for the hearing impaired, and a digital Braille player for the visually impaired; wherein, upon a request by a person with disabilities, the control unit of the controller outputs a situation using the device for persons with disabilities; wherein ChatGPT is utilized as an interface for TV or video playback, viewing, and searching by the person with disabilities, the control unit displays a new model of the Braille player on the output unit when it is released, and simultaneously outputs user reviews; wherein a communication module is installed in the controller to record usage status and evaluations in a server database, thereby recommending the purchase of the appropriate device for persons with disabilities by reflecting usage frequency; wherein, when the sound player is playing, the controller's sensor detects the surrounding sound decibels and adjusts the voice output to be louder and clearer than the surrounding noise to promote the convenience of the person with disabilities, and wherein the sensor is a sound detection sensor. Claim 2 delete Claim 3 delete

Citation Information

Patent Citations

  • Safety and security guiding apparatus for the visually-impaired

    KR1020220023458A