A system and method for narrating information for visually impaired individuals on digital media and platforms.

Abstract

This system enables visually impaired individuals to have the content they watch on digital media and platforms supported with real-time audio descriptions. Its features include: User login unit (101), which allows the user (K) to log in to the application and enter their personal information and preferences; Content selection unit (102), which allows the user (K) to select the content they want to watch; Audio description language selection unit (103), which allows the user (K) to select the available audio description language for the content they are watching; User options and settings unit (104), which allows the user (K) to personalize the speed, tone, and detail level of the description; Content audio description unit (105), which provides real-time audio descriptions analyzed by the artificial intelligence unit (108) according to the selected content and settings; and Feedback unit (106), which allows the user to provide feedback on the quality of the audio description.The system includes the Statistics and Development Unit (107), which provides suggestions for the development of the application and ensures continuous learning based on user (K) feedback and interaction data analyzed by the artificial intelligence unit (108), the Artificial Intelligence Unit (108), which analyzes user (K) behavior by interacting with every step of the system, creates the most suitable content suggestions for user (K) and improves the quality of description by learning from feedback, and the database (109), which stores all the data used in the system.

Description

1 TARIFF A system and method for narrating information for visually impaired individuals on digital media and platforms. Technical Area 5 The invention enables visually impaired individuals to access content viewed by users on digital media and platforms. It relates to the system and method that enables the descriptions to be supported with real-time audio descriptions. State of the Art 10 Currently, visually impaired individuals have very limited access to digital media and platforms. This is the case. Some solutions have been developed to address this. These include: YouDescribe: Allows users to add audio descriptions to YouTube videos. 15 It is a platform that recognizes; these are generally created through voluntary contributions. Volunteering Because it is based on this principle, it does not guarantee a continuous and comprehensive audio description service. Users may not find audio descriptions for certain content. This may be particularly relevant for visually impaired individuals. Their inability to access and participate in this content violates the principle of social equality. It has negative effects. 20 Aira: A platform that provides real-time support for visually impaired individuals. It is an application. It provides information about situations they experience outside. It is a paid application. Because it's a service and always requires an internet connection, this application is not for everyone. This makes it inaccessible. 25 people who do not have internet access or cannot afford the service. The inability of individuals to benefit from such solutions leads to access restrictions. Be My Eyes: Visually impaired individuals are matched with volunteers to receive immediate assistance they need. This allows them to receive any kind of support. Again, this platform also operates through voluntary contributions, It also does not guarantee fast and continuous support. Waiting times in the matching processes are 30 This can lead to not receiving the necessary help in a timely manner during emergencies. While these current applications provide significant benefits for visually impaired individuals, sign language... It shows shortcomings in critical areas such as translation and continuous audio description. Hearing impaired serious restrictions on access to content for individuals and visually impaired individuals 35 It is located. 2 The application with number 2024 / 002965 was revealed as a result of technical investigations. Summary: "The invention is an AI-powered digital video platform for individuals with hearing and visual impairments." It is related to, and is an interface, integrated into video-on-demand platforms, of the platform By analyzing and processing the video played on the interface, it converts it into sign language for hearing-impaired individuals. by translating and visually presenting it to the user on the interface via a virtual sign language interpreter. presenting video scenes played on the interface for visually impaired individuals before the dialogue. It includes an operating unit that presents the information to the user audibly.” As can be seen, the system is related to an AI-powered digital video platform, of which 10 alongside a structure that can provide solutions to the disadvantages mentioned above It does not mention it. In conclusion, due to the negative aspects described above and the current solutions, the subject matter... Due to its shortcomings, it has become necessary to make improvements in the relevant technical field. 15 Purpose of the Invention The invention represents a new breakthrough in this field, unlike the structures used in existing technology. It aims to create a structure with different technical specifications that bring about different results. 20 The primary purpose of the invention is to provide users with real-time audio descriptions of the content they are watching. The goal is to ensure that it is supported. One aim of the invention is to remedy the shortcomings mentioned above and to provide audio description and content 25 The goal is to offer comprehensive solutions to increase access. This promotes social equality and accessibility. By increasing access, it will make digital content more accessible. The invention makes it easier for visually impaired individuals to interact with all content and access information. makes it more accessible. The system in question, which is the subject of the invention, allows users to adjust their voice tone, voice speed, and 30... It allows for personalization of the level of detail in the description. This reflects the different preferences of each individual. By taking this into consideration, it offers a better experience. The invention provides audio description in multiple languages. Its ability to provide content in different languages ​​appeals to a wide user base. It supports social inclusion by increasing access. Artificial intelligence processes the content selected by users. It analyzes and gathers the information needed to create appropriate audio descriptions. This process takes 35 minutes. 3 It is optimized according to the context of the content and user settings, thus providing a more fluid and meaningful experience. It offers detailed descriptions. Users provide feedback on their audio description experiences. By enabling them to be found, artificial intelligence analyzes this data. User feedback, It plays a fundamental role in improving the quality of description and enhancing the user experience. It plays. The application continuously updates itself using data collected from user interactions. 5 This enables learning. This allows artificial intelligence to understand user behavior and future... It enables the creation of suggestions to personalize experiences. Machine learning algorithms analyze data from users to provide content recommendations and These are algorithms that are effectively used in the process of creating audio descriptions. Thanks to this, 10 The app learns user preferences and continuously optimizes the experience. Natural Language Through NLP (Neuro-Linguistic Programming), the browser and the text within the content are analyzed to understand the context and emotions. They are processed as algorithms aimed at understanding the situation. This means that the descriptions convey emotion and meaning. It enables the perception of layers. Multilingual Translation Models, on the other hand, provide audio descriptions in different languages. Sensors and online resources necessary to provide this service are utilized. Users 15 Techniques that systematically analyze suggestions and experiences, continuous application This allows for the development of the application that is the subject of the invention. These elements and features enable the development of the application that is the subject of the invention. It eliminates technical problems that exist in other applications and improves the user experience. It enables enrichment. Increased accessibility, user satisfaction and social inclusion, this This approach will have significant consequences. 20 The invention allows users to access a wide variety of content, including series, films, and documentaries, on digital content platforms. It allows them to access a wealth of content. Users can get instant audio through the application. They are able to follow the flow of the content through descriptions, thus gaining a better understanding of the world they live in. They are able to establish a deep connection. This feature is not only relevant for visually impaired individuals, but also for all 25 at the same time, their families and friends can also more effectively use the content. It allows them to experience it. The invention raises the accessibility standards of digital platforms, reaching a wider audience. It helps it reach its target audience. The application that is the subject of the invention provides 30 visually impaired individuals with access to visually impaired content. By offering audio description services, it increases social inclusion, which in turn benefits digital platforms. It contributes to creating an innovative brand image with a sense of social responsibility. The application in question, which is the subject of the invention, makes all digital content more accessible, thus enabling all digital platforms should provide social interaction while ensuring users have equal access to content. It allows for benefits and enriches the viewer experience. This collaboration makes 35 accessible. It is positioned as a pioneering step in the field of media solutions. 4 The additional features of the system that is the subject of the invention are as follows:  Gamification Elements: Enhancing users' audio description and content comprehension skills Gamification elements are being added to enhance their performance. For example, specific tasks Users can earn rewards when they complete them. 5  Listening and Comprehension Tests: Test users' understanding of audio-based content. There are interactive quizzes and exercises that users can do. This allows users to learn. They can reinforce their processes.  Learning Modules: Provides modules on training topics to give users access. They are enabled to obtain valuable information beyond the content provided. 10  Community Building: A space where users can discuss content and share their experiences. A community space is being created where they can share and receive support. This is social It strengthens interaction and increases user loyalty.  Audio Description Creators: Allow users to record their own content with audio descriptions. and a feature that opens up alternative ways to create content by offering the possibility of sharing. 15 It can be added.  Goal Setting and Tracking: Users can set personal development goals and track them. They need to create a system to track their progress toward achieving their goals. It can be provided.  Screen Sharing and Interaction: Users can share their content with others through screen sharing. 20 a feature that allows users to monitor and communicate with each other, providing real-time feedback. It can be added.  Comprehensive Support and Training Materials: Provides users with information on how to use the application. By providing comprehensive guides and training materials, it helps new users adapt quickly. It is being helped to become so. 25 These additional features enhance the functionality of the invention, enriching the user experience. It provides important steps in this direction. The application is more suitable for visually impaired individuals. while providing an inclusive solution, it enables users to interact and learn. It increases opportunities to strengthen their processes. To achieve the purposes described above, the invention is used in digital media and platforms. Content viewed by users is provided with real-time audio descriptions for visually impaired individuals. It is a system that enables support, and its feature is;  The user logs into the application and enters their personal information and preferences. the user input unit providing, 35  Content selection unit that allows the user to choose the content they want to watch,  Allows the user to select the available audio description language for the content they are watching. descriptive language selection unit,  allows the user to personalize the speed, tone, and level of detail of the speech. User options and settings unit that provides  Audio 5 analyzed by the AI ​​unit according to the selected content and settings Audio description of the content that enables descriptions to be presented in real time. unit,  allows the user to provide feedback on the quality of the audio description. feedback unit,  User feedback and interaction analyzed by the artificial intelligence unit 10 According to the data, it provides suggestions for the development of the application and continuous learning. Statistics and development unit providing  Analyzing user behavior by interacting with each step of the system to ensure that the most relevant content recommendations are created for the user and to gather feedback. As a result, the artificial intelligence unit, which improves the quality of description by learning, 15  A database that stores all the data used in the system. It includes. The structural and characteristic features and all the advantages of the invention are given in the figures below. Thanks to the detailed explanation written with references to the figures, it is clearer than ever. 20 This will be understood, and therefore the evaluation should also take these figures and detailed explanations into account. It must be done by taking it. Figures that will help understand the invention. Figure 1 is a schematic representation of the system and method that is the subject of the invention. Figure 2 shows a general representation of the system that is the subject of the invention. The drawings do not necessarily need to be scaled and are necessary for understanding the invention. Details that are not present may have been overlooked. Furthermore, at least to a large extent, 30 Elements that are identical or at least have substantially identical functions are numbered the same. It is shown. Explanation of Part References 35 User K. 6 101. User input unit 102. Content selection unit 103. Descriptive language selection unit 104. User Options and Settings Unit 105. Content audio description unit 5 106. Feedback Unit 107. Statistics and Development Unit 108. Artificial intelligence unit 109. Database A. Computer 10 B. Television C. Smartphone X. Beginning Y. End 1001. User (K) logs into the system via user input unit (101) personal They should state their information and preferences and the AI ​​unit (108) analyzes this data. by determining personalized initial preferences, 1002. The user (K) selects the content he / she wants to watch via the content selection unit (102) and The AI ​​unit (108) analyzes the user's viewing history and preferences. by providing the most suitable content suggestions, 1003. User's (K) choice of audio description via the description language selection unit (103). the language chosen and the artificial intelligence unit (108) takes this preference into account and the most automatic generation of appropriate audio description, 1004. The user (K) can control the speed of sound, sound 25 via the user options and settings unit (104). personalize the tone and level of detail of the description and by the artificial intelligence unit (108) Analyzing these settings and optimizing audio descriptions, 1005. After user options and settings are personalized, the content is audio-described by the audio description unit. (105) started to provide an audio description of the content, 1006. The artificial intelligence unit (108) processes the information about the content and sets the specified settings 30 in line with this, real-time audio description is provided and the emotional state in the content is reflected. and providing fluent descriptions appropriate to the context, 1007. User (K) reports the quality of audio description via feedback unit (106). by providing feedback, the artificial intelligence unit (108) analyzes this feedback Improving descriptive processes and offering suggestions for improvement, 35 7 1008. The artificial intelligence unit (108) analyzes user feedback and interaction data. and the user developing strategies to improve the experience, 1009. User data, interaction history and feedback collected by the artificial intelligence unit (108). notifications are stored in the database (109) and artificial intelligence is trained with user (K) data. Intelligence models constantly improve themselves by using this data in the learning process. improvement and subsequent application of the resulting models to enhance user experience. For the purpose of making predictions and recommendations, 1010. The user (K) completes the monitoring process and the AI ​​unit (108) user (K) 10 to personalize future experiences by recording habits and preferences. using. Detailed Description of the Invention In this detailed explanation, the preferred configurations of the invention are presented, only to better understand the subject matter. in order to facilitate understanding and without imposing any limiting effects It is explained. The invention enables visually impaired users (K) to watch content on digital media and platforms. with a system and method that provides real-time audio descriptions for individuals 20 It is related. The elements and functions used in the system and method that are the subject of the invention are as follows: User login unit (101) allows the user (K) to log in to the application and enter their personal information and 25 It is the unit that enables users to enter their preferences. The artificial intelligence unit (108) analyzes user information. It suggests initial preferences by listing the following: User (K), computer (A), television (B), smart It is possible to log in to the system via devices such as the phone (C). The content selection unit (102) is the unit that enables the user (K) to select the content they want to watch. 30 The artificial intelligence unit (108) finds the most suitable user based on their viewing history and preferences. It provides content suggestions. The descriptive language selection unit (103) is the available audio description for the content the user (K) is watching. It is the unit that enables students to choose their language. To ensure a professional and fluent experience, 35 It offers options. 8 User options and settings unit (104), user (K), speed of sound, tone of voice and description This unit allows the user to personalize the level of detail. These settings enhance the user experience. It is privatizing. Content audio description unit (105), AI unit (108) according to selected content and settings enabling the real-time presentation of audio descriptions analyzed by It is a unit. The feedback unit (106) receives feedback from the user about the quality of the audio description. It is the unit that enables finding. The artificial intelligence unit (108) collects and analyzes this feedback. It improves and enhances translation processes. User analyzed by Statistics and Development Unit (107), Artificial Intelligence Unit (108) (K) 15 that made suggestions for the development of the application based on feedback and interaction data. It is a unit that provides continuous learning. The artificial intelligence unit (108) interacts with the user (K) at every step of the system. analyzing user behavior and creating the most suitable content recommendations for user (K) It is the unit that improves the quality of descriptions by learning from feedback. 20 The database (109) is the unit that enables the storage of all data used in the system. The steps involved in the process carried out with the system that is the subject of the invention are listed below:  The user (K) logs into the system via the user input unit (101) and accesses personal information. They should state their information and preferences and these data are processed by the artificial intelligence unit (108). Determining personalized initial preferences by analyzing (1001),  The user selects the content he / she wants to watch via the content selection unit (K) (102) and The user’s viewing history and preferences are analyzed by the artificial intelligence unit (108). by providing the most suitable content suggestions (1002), 30  User's (K) choice of audio description via the description language selection unit (103) the language chosen and the artificial intelligence unit (108) takes this preference into account and the most Automatic generation of appropriate audio description (1003),  The user (K) can adjust the speed of sound, sound through the user options and settings unit (104). personalize the tone and detail level of description and the artificial intelligence unit (108) 35 9 these settings are analyzed and audio descriptions are optimized. (1004),  After user options and settings are personalized, the content is audio-described by the audio description unit. (105) started to provide an audio description of the content (1005),  The artificial intelligence unit (108) processes the information about the content and sets the specified settings 5 in line with this, real-time audio description is provided and the emotions in the content are captured. providing fluent descriptions appropriate to the situation and context (1006),  User (K) about the quality of audio description via feedback unit (106) by providing feedback, the artificial intelligence unit (108) analyzes this feedback to improve description processes and offer suggestions for improvement (1007), 10  The artificial intelligence unit (108) analyzes user feedback and interaction data. and to make suggestions for the continuous improvement of the application based on this data. developing strategies to improve user experience (1008),  User data, interaction history and collected by the artificial intelligence unit (108) feedback is stored in the database (109) and trained with user (K) data 15 Artificial intelligence models constantly improve themselves by using this data in the learning process. this improves and then applies the resulting models to the user experience. (1009)  The user (K) completes the monitoring process and the artificial intelligence unit (108) user (K) Personalizing future experiences by recording habits and preferences 20 to use for (1010). The operating principle of the system that is the subject of the invention is as follows: User (K) logs into the digital platform via the user input unit (101). Artificial intelligence 25 Unit (108) suggests initial preferences by analyzing user (K) information. User (K), It selects the content it wants to watch via the content selection unit (102). The artificial intelligence unit (108), It provides the most suitable content recommendations based on the user's (K) viewing history and preferences. User (K) selects the available description language options for the content they are watching. images via unit (103) and, if requested, suggestions from the AI ​​unit (108) 30 The user can choose their preferred audio description via the description language selection unit (103). The user selects the language and has the opportunity to customize settings such as voice speed and tone. This customization, It further enriches the user experience. The user (K) can customize their options and settings. After personalization, the process moves to the audio description step for the content. The selected content and settings are then displayed. Accordingly, the artificial intelligence unit (108) analyzes the content and provides audio in real time. Audio descriptions are created through the descriptive unit (105). Descriptions are created based on the main content. By highlighting elements, mood, and context, it provides the user with a clear experience. User (K) receives feedback about translation quality during monitoring via unit (106). It provides feedback. The artificial intelligence unit (108) collects and analyzes this feedback and Improves translation processes. The artificial intelligence unit (108) takes into account user feedback and interaction. It analyzes the data, makes suggestions for the development of the system based on this data, and continuous learning 5 It enables the user (K) to provide feedback on the quality of the audio description, thereby improving the process. It contributes to its improvement. The artificial intelligence unit (108) evaluates this feedback. This information guides the continuous development of the application. This information guides the artificial intelligence unit (108) system. Its performance and translation quality are evaluated for continuous improvement. User (K), monitoring completes the process. The artificial intelligence unit (108) analyzes user habits and preferences. It uses the data to personalize future experiences. Artificial intelligence unit (108) User data, interaction history and feedback collected by are in the database (109) It is stored. Artificial intelligence models trained with user data use this data in the learning process. They continuously improve themselves by using these methods. The resulting models are then used by the user. It is used to make predictions and suggestions in order to improve the user experience. User (K), monitoring 15 completes the process. The artificial intelligence unit (108) analyzes user habits and preferences. It records this data and uses it to personalize future experiences. The system and method described in the invention enable users (K) to recognize different description languages ​​and It offers an innovative platform that provides an opportunity for understanding. Technology and artificial intelligence 20 By leveraging its power, it provides an accessible communication experience for the visually impaired.

Claims

11 REQUESTS 1. Content watched by users (K) on digital media and platforms for visually impaired individuals It is a system that provides real-time audio descriptions, and its feature is;  The user (K) must log in to the application and enter their personal information and preferences. 5 providing user input unit (101),  Content selection unit (102) that enables the user (K) to select the content they want to watch,  Enables the user (K) to select the available audio description language for the content they are watching. descriptive language selection unit (103),  Allows the user (K) to personalize the speed of the voice, the tone of the voice, and the level of detail in the description. 10 User options and settings unit (104),  voice analyzed by the AI ​​unit (108) according to the selected content and settings Audio description of the content that enables descriptions to be presented in real time. unit (105),  15 that allows the user to provide feedback on the quality of audio description. feedback unit (106),  User (K) feedback analyzed by the artificial intelligence unit (108) and Based on interaction data, it provides suggestions for the development of the application and continuously... Statistics and development unit providing learning (107),  By interacting with each step of the system, the user's (K) behavior is analyzed. 20 to ensure that the most appropriate content recommendations are created for user (K) and feedback is received. artificial intelligence that improves descriptive quality by learning from feedback. intelligence unit (108),  database that enables the storage of all data used in the system (109) It includes. 25 2. Content watched by users (K) on digital media and platforms for visually impaired individuals It is a method that provides real-time audio descriptions for the purpose; its feature is:  The user (K) logs into the system via the user input unit (101) to access personal information. 30 by stating their information and preferences and by the artificial intelligence unit (108) Determining personalized initial preferences by analyzing (1001),  The user selects the content he / she wants to watch via the content selection unit (K) (102) and The user’s viewing history and preferences are analyzed by the artificial intelligence unit (108). by providing the most suitable content suggestions (1002), 12  User's (K) choice of audio description via the description language selection unit (103) the language chosen and the artificial intelligence unit (108) takes this preference into account and the most Automatic generation of appropriate audio description (1003),  The user (K) can adjust the speed of sound, sound through the user options and settings unit (104). personalize the tone and detail level of description and the artificial intelligence unit (108) 5 these settings are analyzed and audio descriptions are optimized. (1004),  After user options and settings are personalized, the content is audio-described by the audio description unit. (105) started to provide an audio description of the content (1005),  The artificial intelligence unit (108) processes the information about the content and sets the specified settings. in line with this, real-time audio description is provided and the emotions in the content are captured. providing fluent descriptions appropriate to the situation and context (1006),  User (K) about the quality of audio description via feedback unit (106) by providing feedback, the artificial intelligence unit (108) analyzes this feedback to improve description processes and offer suggestions for improvement (1007), 15  The artificial intelligence unit (108) analyzes user feedback and interaction data. and to make suggestions for the continuous improvement of the application based on this data. developing strategies to improve user experience (1008),  User data, interaction history and collected by the artificial intelligence unit (108) feedback is stored in the database (109) and trained with user (K) data 20 Artificial intelligence models constantly improve themselves by using this data in the learning process. this improves and then applies the resulting models to the user experience. (1009)  The user (K) completes the monitoring process and the artificial intelligence unit (108) user (K) Personalizing future experiences by recording habits and preferences 25 (1010) It includes the steps of the process.

Images