Visual solution method and system for visually impaired and old people, and medium

Abstract

The embodiment of the invention provides a visual solution method and system for visually impaired and old people and a medium, and the method comprises the steps: capturing a visual image, and carrying out the preprocessing of the visual image, and obtaining a preprocessed image; performing image content analysis and interpretation on the preprocessed image based on a visual identification model to obtain an analysis result; adjusting an image analysis focus according to the specific demand information of the user to optimize the analysis result to obtain optimization result information; the optimization result information is transmitted to an interactive interface in real time, and feedback information is generated; evaluating and modifying the optimization result based on the feedback information to obtain visual identification information; according to the method, the captured image can be adjusted in real time according to the specific needs of the user, so that the image is more suitable for the visual ability of the user, and the user interface and interaction logic are specially designed for vision-limited and elderly users, so that the operation is more intuitive and simpler.

Description

Technical Field

[0001] The present application relates to the field of visual processing technology, and in particular, to a visual solution method, system and medium for the visually impaired and elderly population. Background Art

[0002] Currently, Birdbath-related AR glasses have gradually become mainstream, but their application scenarios are mainly for watching movies, which is very limited. With the popularization of Meta glasses, more AR glasses will be equipped with cameras to adapt to more usage scenarios. Existing visual solutions cannot adjust the captured images in real time, making it difficult to dynamically adapt to the user's visual ability, resulting in unclear visual acquisition for users. Summary of the invention

[0003] The purpose of the embodiments of the present application is to provide a visual solution method, system and medium for the visually impaired and the elderly, to adjust the captured image in real time according to the specific needs of the user, to make the image more suitable for the user's visual ability, and to specially design a user interface and interaction logic for users with limited vision and the elderly, so that the operation is more intuitive and simple.

[0004] The present application also provides a visual solution for the visually impaired and the elderly, including:

[0005] Capturing a visual image, and preprocessing the visual image to obtain a preprocessed image;

[0006] Perform image content analysis and interpretation on the preprocessed image based on the visual recognition model to obtain analysis results;

[0007] According to the user's specific demand information, the image analysis focus is adjusted to optimize the analysis results and obtain optimized result information;

[0008] Transmit optimization result information to the interactive interface in real time to generate feedback information;

[0009] The optimization results are evaluated and modified based on the feedback information to obtain visual recognition information.

[0010] Optionally, in the visual solution for the visually impaired and the elderly described in the embodiment of the present application, capturing a visual image and preprocessing the visual image to obtain a preprocessed image specifically includes:

[0011] Acquire a visual image, perform feature extraction on the visual image, and obtain image features;

[0012] Based on the image features, edge features are screened out to obtain the image edge region, and the image edge region is enhanced to obtain an enhanced image;

[0013] Filter out noise features based on image features, and remove the noise features to obtain a denoised image;

[0014] The denoised image is fused with the enhanced image to generate a preprocessed image.

[0015] Optionally, in the visual solution method for the visually impaired and the elderly described in the embodiment of the present application, image content analysis and interpretation are performed on the pre-processed image based on the visual recognition model to obtain analysis results, which specifically include:

[0016] Based on big data technology, a number of training images are obtained, masks are set on the number of training images, and a training set consisting of the number of training images is generated;

[0017] Iteratively train the model based on the training set, and dynamically adjust the model parameters according to the set mask to generate a visual recognition model;

[0018] The preprocessed image is input into the visual recognition model for image content analysis and interpretation to obtain the analysis result.

[0019] Optionally, in the visual solution method for the visually impaired and the elderly described in the embodiment of the present application, the image analysis focus is adjusted according to the specific demand information of the user to optimize the analysis result, and the optimization result information is obtained, which specifically includes:

[0020] Obtaining the user's visual limitation information, and generating a current analysis focus according to the user's visual limitation information;

[0021] Analyze the acquisition parameters and image parameters of the visual image based on the current analysis focus to obtain the analysis results; the acquisition parameters of the visual image include acquisition angle, acquisition frequency and acquisition time, and the image parameters include image brightness, image contrast and image resolution;

[0022] Determine whether the analysis results meet the set condition information;

[0023] If the set condition information is not met, the current analysis focus is adjusted, and optimization information is generated, and the analysis results are optimized based on the optimization information.

[0024] Optionally, in the visual solution method for the visually impaired and the elderly described in the embodiment of the present application, the optimization result is evaluated and modified based on the feedback information to obtain the visual recognition information, specifically including:

[0025] Obtain optimization results, evaluate the optimization results based on evaluation rules, and obtain evaluation information;

[0026] Compare the evaluation information according to the set evaluation interval to obtain the evaluation level;

[0027] Determine whether the evaluation level is greater than the set level threshold;

[0028] If it is greater, the optimization result will be transmitted to the interactive interface in real time;

[0029] If it is less than or equal to, feedback information is generated, modification parameters are established based on the feedback information, and the optimization result is modified based on the modification parameters to obtain visual recognition information.

[0030] Optionally, in the visual solution method for the visually impaired and the elderly described in the embodiment of the present application, the optimization result information is transmitted to the interactive interface in real time, specifically including:

[0031] Acquire visual images based on the optimization results and analyze the bandwidth requirement information of the visual images;

[0032] comparing the bandwidth demand information with a transmission bandwidth threshold;

[0033] If the bandwidth requirement information is greater than or equal to the transmission bandwidth threshold, compression information is generated, and the visual image is compressed based on the compression information;

[0034] If it is less than the transmission bandwidth threshold, the optimization result will be transmitted to the interactive interface in real time.

[0035] In a second aspect, an embodiment of the present application provides a visual solution system for the visually impaired and the elderly, the system comprising: a memory and a processor, the memory comprising a program for a visual solution for the visually impaired and the elderly, the program for a visual solution for the visually impaired and the elderly being executed by the processor to implement the following steps:

[0036] Capturing a visual image, and preprocessing the visual image to obtain a preprocessed image;

[0037] Perform image content analysis and interpretation on the preprocessed image based on the visual recognition model to obtain analysis results;

[0038] According to the user's specific demand information, the image analysis focus is adjusted to optimize the analysis results and obtain optimized result information;

[0039] Transmit optimization result information to the interactive interface in real time to generate feedback information;

[0040] The optimization results are evaluated and modified based on the feedback information to obtain visual recognition information.

[0041] Optionally, in the visual solution system for the visually impaired and the elderly described in the embodiment of the present application, capturing a visual image and preprocessing the visual image to obtain a preprocessed image specifically includes:

[0042] Acquire a visual image, perform feature extraction on the visual image, and obtain image features;

[0043] Based on the image features, edge features are screened out to obtain the image edge region, and the image edge region is enhanced to obtain an enhanced image;

[0044] Filter out noise features based on image features, and remove the noise features to obtain a denoised image;

[0045] The denoised image is fused with the enhanced image to generate a preprocessed image.

[0046] Optionally, in the visual solution system for the visually impaired and elderly people described in the embodiment of the present application, image content analysis and interpretation are performed on the pre-processed image based on the visual recognition model to obtain analysis results, which specifically include:

[0047] Based on big data technology, a number of training images are obtained, masks are set on the number of training images, and a training set consisting of the number of training images is generated;

[0048] Iteratively train the model based on the training set, and dynamically adjust the model parameters according to the set mask to generate a visual recognition model;

[0049] The preprocessed image is input into the visual recognition model for image content analysis and interpretation to obtain the analysis result.

[0050] In a third aspect, an embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium includes a visual solution program for the visually impaired and the elderly. When the visual solution program for the visually impaired and the elderly is executed by a processor, the steps of the visual solution for the visually impaired and the elderly as described in any one of the above items are implemented.

[0051] As can be seen from the above, the embodiments of the present application provide a visual solution method, system and medium for the visually impaired and elderly people, which captures visual images, preprocesses the visual images, and obtains preprocessed images; performs image content analysis and interpretation on the preprocessed images based on a visual recognition model to obtain analysis results; adjusts the image analysis focus according to the user's specific demand information to optimize the analysis results and obtains optimization result information; transmits the optimization result information to the interactive interface in real time to generate feedback information; evaluates and modifies the optimization results based on the feedback information to obtain visual recognition information; the present application can adjust the captured images in real time according to the specific needs of the user, so that the images are more suitable for the user's visual ability, and the user interface and interaction logic are specially designed for users with limited vision and elderly users, making the operation more intuitive and simple. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0053] Figure 1 A flow chart of a visual solution for the visually impaired and elderly population provided in an embodiment of the present application;

[0054] Figure 2 A flow chart of a visual image preprocessing method for a visual solution for the visually impaired and elderly population provided in an embodiment of the present application;

[0055] Figure 3 A flow chart for obtaining analysis results of the visual solution for the visually impaired and elderly population provided in an embodiment of the present application. DETAILED DESCRIPTION

[0056] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0057] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0058] Please refer to Figure 1 , Figure 1 This is a flow chart of a visual solution method for the visually impaired and the elderly in some embodiments of the present application. The visual solution method for the visually impaired and the elderly is used in a terminal device, and the visual solution method for the visually impaired and the elderly includes the following steps:

[0059] S101, capturing a visual image, and preprocessing the visual image to obtain a preprocessed image;

[0060] S102, performing image content analysis and interpretation on the preprocessed image based on the visual recognition model to obtain analysis results;

[0061] S103, adjusting the image analysis focus according to the user's specific requirement information to optimize the analysis result and obtain optimization result information;

[0062] S104, transmitting the optimization result information to the interactive interface in real time to generate feedback information;

[0063] S105, evaluating and modifying the optimization result based on the feedback information to obtain visual recognition information.

[0064] It should be noted that the pictures you want to capture, such as books, scenes, etc., are captured by the glasses. The XR Station captures the captured pictures, performs adaptive analysis through the visual recognition model, and transmits the results back to the glasses in the form of perfected images, text or audio to help the elderly or visually impaired people perceive the scene.

[0065] Specifically, the XR Station consists of the following structures:

[0066] Main processor: Equipped with high-performance CPU and GPU to handle complex image recognition and data analysis tasks.

[0067] Memory and Storage: Ample RAM and high-speed solid-state storage for efficient processing and temporary storage of large amounts of image data.

[0068] Communication module: High-speed wireless communication module, supporting high-bandwidth and low-latency data transmission.

[0069] Power Management: Efficient power management system ensures long-term operation and stable power supply of the device.

[0070] Specifically, the interactive interface is displayed through a display screen, which uses transparent OLED or micro LED display technology to ensure that images and text information can be clearly displayed directly in the field of view.

[0071] Furthermore, during the visual image acquisition process, data is collected through sensors, including gyroscopes, accelerometers and proximity sensors, which are used to detect the user's head movements and the relative position of the glasses to optimize the image capture timing.

[0072] Please refer to Figure 2 , Figure 2 This is a flow chart of a visual image preprocessing method for a visual solution for the visually impaired and the elderly in some embodiments of the present application. According to an embodiment of the present invention, capturing a visual image, preprocessing the visual image, and obtaining a preprocessed image specifically includes:

[0073] S201, acquiring a visual image, performing feature extraction on the visual image, and obtaining image features;

[0074] S202, filtering out edge features based on image features to obtain an image edge region, and performing enhancement processing on the image edge region to obtain an enhanced image;

[0075] S203, filtering out noise features based on image features, and removing the noise features to obtain a denoised image;

[0076] S204: Fusing the denoised image with the enhanced image to generate a preprocessed image.

[0077] It should be noted that visual images are collected through high-resolution cameras that support wide dynamic range and low-light shooting to ensure that clear images can be captured in various environments, ensure fast startup and efficient image capture, and use advanced image processing algorithms (such as noise suppression, edge enhancement, etc.) to improve image quality and adapt to the needs of the model.

[0078] Please refer to Figure 3 , Figure 3 This is a flowchart of obtaining the analysis results of a visual solution for the visually impaired and the elderly in some embodiments of the present application. According to an embodiment of the present invention, the image content analysis and interpretation of the pre-processed image is performed based on the visual recognition model to obtain the analysis results, which specifically include:

[0079] S301, acquiring a plurality of training images based on big data technology, setting masks on the plurality of training images, and generating a training set consisting of the plurality of training images;

[0080] S302, iteratively training the model based on the training set, and dynamically adjusting the model parameters according to the set mask to generate a visual recognition model;

[0081] S303, inputting the preprocessed image into the visual recognition model to perform image content analysis and interpretation to obtain analysis results.

[0082] It should be noted that using advanced large language models (LLMs) such as CLIP to perform in-depth analysis of image content and more accurately understand and describe captured scenes and objects can provide richer and more detailed information to help users better understand their environment.

[0083] Image content analysis and interpretation are performed through visual recognition models. The focus and processing flow of image analysis are adjusted according to the specific needs of users (such as enhanced text reading ability), and easy-to-understand text, voice or visual feedback is generated based on the analysis results.

[0084] According to an embodiment of the present invention, the image analysis focus is adjusted according to the specific requirement information of the user to optimize the analysis result, and the optimization result information is obtained, which specifically includes:

[0085] Obtaining the user's visual limitation information, and generating a current analysis focus according to the user's visual limitation information;

[0086] Analyze the acquisition parameters and image parameters of the visual image based on the current analysis focus to obtain the analysis results; the acquisition parameters of the visual image include acquisition angle, acquisition frequency and acquisition time, and the image parameters include image brightness, image contrast and image resolution;

[0087] Determine whether the analysis results meet the set condition information;

[0088] If the set condition information is not met, the current analysis focus is adjusted, and optimization information is generated, and the analysis results are optimized based on the optimization information.

[0089] It should be noted that the captured image can be adjusted in real time according to the specific needs of the user (such as vision limitations), such as enhancing contrast, adjusting brightness or clarity, so that the image is more suitable for the user's visual ability. In addition, the application can output information in multiple forms (text, image, audio), which increases the flexibility and adaptability of use. The user interface and interaction logic are specially designed for vision-limited and elderly users, and support control through simple gestures and voice commands, making the operation more intuitive and simple.

[0090] According to an embodiment of the present invention, the optimization result is evaluated and modified based on the feedback information to obtain visual recognition information, which specifically includes:

[0091] Obtain optimization results, evaluate the optimization results based on evaluation rules, and obtain evaluation information;

[0092] Compare the evaluation information according to the set evaluation interval to obtain the evaluation level;

[0093] Determine whether the evaluation level is greater than the set level threshold;

[0094] If it is greater, the optimization result will be transmitted to the interactive interface in real time;

[0095] If it is less than or equal to, feedback information is generated, modification parameters are established based on the feedback information, and the optimization result is modified based on the modification parameters to obtain visual recognition information.

[0096] According to an embodiment of the present invention, the optimization result information is transmitted to the interactive interface in real time, specifically including:

[0097] Acquire visual images based on the optimization results and analyze the bandwidth requirement information of the visual images;

[0098] comparing the bandwidth demand information with a transmission bandwidth threshold;

[0099] If the bandwidth requirement information is greater than or equal to the transmission bandwidth threshold, compression information is generated, and the visual image is compressed based on the compression information;

[0100] If it is less than the transmission bandwidth threshold, the optimization result will be transmitted to the interactive interface in real time.

[0101] It should be noted that by analyzing the transmission bandwidth requirements during data transmission, data compression and transmission are carried out to implement an efficient image compression algorithm, thereby reducing the bandwidth requirements during data transmission while maintaining image quality.

[0102] According to an embodiment of the present invention, it also includes:

[0103] The user interaction interface is a customized UI or UX interface, a simple and intuitive user interface designed for users with limited vision and the elderly, which supports interaction through simple gestures or voice commands.

[0104] A feedback mechanism and a real-time feedback system are set up to allow users to evaluate the recognition results and make modification suggestions, so as to conduct self-learning and optimization.

[0105] All data transmitted between devices is end-to-end encrypted, and strict data access and processing policies are implemented to ensure the privacy and security of user data.

[0106] In a second aspect, an embodiment of the present application provides a visual solution system for the visually impaired and the elderly, the system comprising: a memory and a processor, the memory comprising a program for a visual solution for the visually impaired and the elderly, and when the program for a visual solution for the visually impaired and the elderly is executed by the processor, the following steps are implemented:

[0107] Capturing a visual image, and preprocessing the visual image to obtain a preprocessed image;

[0108] Perform image content analysis and interpretation on the preprocessed image based on the visual recognition model to obtain analysis results;

[0109] According to the user's specific demand information, the image analysis focus is adjusted to optimize the analysis results and obtain optimized result information;

[0110] Transmit optimization result information to the interactive interface in real time to generate feedback information;

[0111] The optimization results are evaluated and modified based on the feedback information to obtain visual recognition information.

[0112] It should be noted that the pictures you want to capture, such as books, scenes, etc., are captured by the glasses. The XR Station captures the captured pictures, performs adaptive analysis through the visual recognition model, and transmits the results back to the glasses in the form of perfected images, text or audio to help the elderly or visually impaired people perceive the scene.

[0113] Specifically, the XR Station consists of the following structures:

[0114] Main processor: Equipped with high-performance CPU and GPU to handle complex image recognition and data analysis tasks.

[0115] Memory and Storage: Ample RAM and high-speed solid-state storage for efficient processing and temporary storage of large amounts of image data.

[0116] Communication module: High-speed wireless communication module, supporting high-bandwidth and low-latency data transmission.

[0117] Power Management: Efficient power management system ensures long-term operation and stable power supply of the device.

[0118] According to an embodiment of the present invention, capturing a visual image and preprocessing the visual image to obtain a preprocessed image specifically includes:

[0119] Acquire a visual image, perform feature extraction on the visual image, and obtain image features;

[0120] Based on the image features, edge features are screened out to obtain the image edge region, and the image edge region is enhanced to obtain an enhanced image;

[0121] Filter out noise features based on image features, and remove the noise features to obtain a denoised image;

[0122] The denoised image is fused with the enhanced image to generate a preprocessed image.

[0123] It should be noted that visual images are collected through high-resolution cameras that support wide dynamic range and low-light shooting to ensure that clear images can be captured in various environments, ensure fast startup and efficient image capture, and use advanced image processing algorithms (such as noise suppression, edge enhancement, etc.) to improve image quality and adapt to the needs of the model.

[0124] According to an embodiment of the present invention, image content analysis and interpretation are performed on the preprocessed image based on the visual recognition model to obtain analysis results, which specifically include:

[0125] Based on big data technology, a number of training images are obtained, masks are set on the number of training images, and a training set consisting of the number of training images is generated;

[0126] Iteratively train the model based on the training set, and dynamically adjust the model parameters according to the set mask to generate a visual recognition model;

[0127] The preprocessed image is input into the visual recognition model for image content analysis and interpretation to obtain the analysis result.

[0128] It should be noted that using advanced large language models (LLMs) such as CLIP to perform in-depth analysis of image content and more accurately understand and describe captured scenes and objects can provide richer and more detailed information to help users better understand their environment.

[0129] Image content analysis and interpretation are performed through visual recognition models. The focus and processing flow of image analysis are adjusted according to the specific needs of users (such as enhanced text reading ability), and easy-to-understand text, voice or visual feedback is generated based on the analysis results.

[0130] According to an embodiment of the present invention, the image analysis focus is adjusted according to the specific requirement information of the user to optimize the analysis result, and the optimization result information is obtained, which specifically includes:

[0131] Obtaining the user's visual limitation information, and generating a current analysis focus according to the user's visual limitation information;

[0132] Analyze the acquisition parameters and image parameters of the visual image based on the current analysis focus to obtain the analysis results; the acquisition parameters of the visual image include acquisition angle, acquisition frequency and acquisition time, and the image parameters include image brightness, image contrast and image resolution;

[0133] Determine whether the analysis results meet the set condition information;

[0134] If the set condition information is not met, the current analysis focus is adjusted, and optimization information is generated, and the analysis results are optimized based on the optimization information.

[0135] It should be noted that the captured image can be adjusted in real time according to the specific needs of the user (such as vision limitations), such as enhancing contrast, adjusting brightness or clarity, so that the image is more suitable for the user's visual ability. In addition, the application can output information in multiple forms (text, image, audio), which increases the flexibility and adaptability of use. The user interface and interaction logic are specially designed for vision-limited and elderly users, and support control through simple gestures and voice commands, making the operation more intuitive and simple.

[0136] According to an embodiment of the present invention, the optimization result is evaluated and modified based on the feedback information to obtain visual recognition information, which specifically includes:

[0137] Obtain optimization results, evaluate the optimization results based on evaluation rules, and obtain evaluation information;

[0138] Compare the evaluation information according to the set evaluation interval to obtain the evaluation level;

[0139] Determine whether the evaluation level is greater than the set level threshold;

[0140] If it is greater, the optimization result will be transmitted to the interactive interface in real time;

[0141] If it is less than or equal to, feedback information is generated, modification parameters are established based on the feedback information, and the optimization result is modified based on the modification parameters to obtain visual recognition information.

[0142] According to an embodiment of the present invention, the optimization result information is transmitted to the interactive interface in real time, specifically including:

[0143] Acquire visual images based on the optimization results and analyze the bandwidth requirement information of the visual images;

[0144] comparing the bandwidth demand information with a transmission bandwidth threshold;

[0145] If the bandwidth requirement information is greater than or equal to the transmission bandwidth threshold, compression information is generated, and the visual image is compressed based on the compression information;

[0146] If it is less than the transmission bandwidth threshold, the optimization result will be transmitted to the interactive interface in real time.

[0147] It should be noted that by analyzing the transmission bandwidth requirements during data transmission, data compression and transmission are carried out to implement an efficient image compression algorithm, thereby reducing the bandwidth requirements during data transmission while maintaining image quality.

[0148] According to an embodiment of the present invention, it also includes:

[0149] The user interaction interface is a customized UI or UX interface, a simple and intuitive user interface designed for users with limited vision and the elderly, which supports interaction through simple gestures or voice commands.

[0150] A feedback mechanism and a real-time feedback system are set up to allow users to evaluate the recognition results and make modification suggestions, so as to conduct self-learning and optimization.

[0151] All data transmitted between devices is end-to-end encrypted, and strict data access and processing policies are implemented to ensure the privacy and security of user data.

[0152] The third aspect of the present invention provides a computer-readable storage medium, which includes a visual solution program for the visually impaired and the elderly. When the visual solution program for the visually impaired and the elderly is executed by a processor, the steps of any of the above-mentioned visual solution steps for the visually impaired and the elderly are implemented.

[0153] The present invention discloses a vision solution method, system and medium for the visually impaired and elderly people, which captures visual images, pre-processes the visual images to obtain pre-processed images; performs image content analysis and interpretation on the pre-processed images based on a visual recognition model to obtain analysis results; adjusts the image analysis focus according to specific demand information of the user to optimize the analysis results to obtain optimization result information; transmits the optimization result information to an interactive interface in real time to generate feedback information; evaluates and modifies the optimization results based on the feedback information to obtain visual recognition information; the application can adjust the captured images in real time according to the specific needs of the user, so that the images are more suitable for the user's visual ability, and the user interface and interaction logic are specially designed for users with limited vision and the elderly, making the operation more intuitive and simple.

[0154] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.

[0155] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0156] In addition, all functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately used as a unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0157] Those skilled in the art can understand that: all or part of the steps of implementing the above method embodiments can be completed by hardware related to program instructions, the aforementioned program can be stored in a readable storage medium, and when the program is executed, it executes the steps of the above method embodiments; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), disks or optical disks, and other media that can store program codes.

[0158] Or, if the above-mentioned integrated unit of the present invention is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present invention can be essentially or partly reflected in the form of a software product that contributes to the prior art. The software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the methods described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROM, RAM, magnetic disks or optical disks.

Claims

1. A visual solution for the visually impaired and elderly population, characterized in that: include: Capturing a visual image, and preprocessing the visual image to obtain a preprocessed image; Perform image content analysis and interpretation on the preprocessed image based on the visual recognition model to obtain analysis results; According to the user's specific demand information, the image analysis focus is adjusted to optimize the analysis results and obtain optimized result information; Transmit optimization result information to the interactive interface in real time to generate feedback information; The optimization results are evaluated and modified based on the feedback information to obtain visual recognition information.

2. The visual solution for the visually impaired and elderly according to claim 1, characterized in that: Capturing a visual image and preprocessing the visual image to obtain a preprocessed image, specifically including: Acquire a visual image, perform feature extraction on the visual image, and obtain image features; Based on the image features, edge features are screened out to obtain the image edge region, and the image edge region is enhanced to obtain an enhanced image; Filter out noise features based on image features, and remove the noise features to obtain a denoised image; The denoised image is fused with the enhanced image to generate a preprocessed image.

3. The visual solution for the visually impaired and elderly according to claim 2, characterized in that: Based on the visual recognition model, the image content of the preprocessed image is analyzed and interpreted to obtain the analysis results, including: Based on big data technology, a number of training images are obtained, masks are set on the number of training images, and a training set consisting of the number of training images is generated; Iteratively train the model based on the training set, and dynamically adjust the model parameters according to the set mask to generate a visual recognition model; The preprocessed image is input into the visual recognition model for image content analysis and interpretation to obtain the analysis result.

4. The visual solution for the visually impaired and elderly according to claim 3, characterized in that: According to the user's specific needs, the image analysis focus is adjusted to optimize the analysis results, and the optimized result information is obtained, including: Obtaining the user's visual limitation information, and generating a current analysis focus according to the user's visual limitation information; Analyze the acquisition parameters and image parameters of the visual image based on the current analysis focus to obtain the analysis results; the acquisition parameters of the visual image include acquisition angle, acquisition frequency and acquisition time, and the image parameters include image brightness, image contrast and image resolution; Determine whether the analysis results meet the set condition information; If the set condition information is not met, the current analysis focus is adjusted, and optimization information is generated, and the analysis results are optimized based on the optimization information.

5. The visual solution for the visually impaired and elderly according to claim 4, characterized in that: Based on the feedback information, the optimization results are evaluated and modified to obtain visual recognition information, including: Obtain optimization results, evaluate the optimization results based on evaluation rules, and obtain evaluation information; Compare the evaluation information according to the set evaluation interval to obtain the evaluation level; Determine whether the evaluation level is greater than the set level threshold; If it is greater, the optimization result will be transmitted to the interactive interface in real time; If it is less than or equal to, feedback information is generated, modification parameters are established based on the feedback information, and the optimization result is modified based on the modification parameters to obtain visual recognition information.

6. The visual solution for the visually impaired and elderly according to claim 5, characterized in that: The optimization result information is transmitted to the interactive interface in real time, including: Acquire visual images based on the optimization results and analyze the bandwidth requirement information of the visual images; comparing the bandwidth demand information with a transmission bandwidth threshold; If the bandwidth requirement information is greater than or equal to the transmission bandwidth threshold, compression information is generated, and the visual image is compressed based on the compression information; If it is less than the transmission bandwidth threshold, the optimization result will be transmitted to the interactive interface in real time.

7. A visual solution system for the visually impaired and elderly population, characterized in that: The system comprises: a memory and a processor, wherein the memory comprises a program for visual solutions for the visually impaired and the elderly, and when the program for visual solutions for the visually impaired and the elderly is executed by the processor, the following steps are implemented: Capturing a visual image, and preprocessing the visual image to obtain a preprocessed image; Perform image content analysis and interpretation on the preprocessed image based on the visual recognition model to obtain analysis results; According to the user's specific demand information, the image analysis focus is adjusted to optimize the analysis results and obtain optimized result information; Transmit optimization result information to the interactive interface in real time to generate feedback information; The optimization results are evaluated and modified based on the feedback information to obtain visual recognition information.

8. The visual solution system for the visually impaired and the elderly according to claim 7, characterized in that: Capturing a visual image and preprocessing the visual image to obtain a preprocessed image, specifically including: Acquire a visual image, perform feature extraction on the visual image, and obtain image features; Based on the image features, edge features are screened out to obtain the image edge region, and the image edge region is enhanced to obtain an enhanced image; Filter out noise features based on image features, and remove the noise features to obtain a denoised image; The denoised image is fused with the enhanced image to generate a preprocessed image.

9. The visual solution system for the visually impaired and the elderly according to claim 8, characterized in that: Based on the visual recognition model, the image content of the preprocessed image is analyzed and interpreted to obtain the analysis results, including: Based on big data technology, a number of training images are obtained, masks are set on the number of training images, and a training set consisting of the number of training images is generated; Iteratively train the model based on the training set, and dynamically adjust the model parameters according to the set mask to generate a visual recognition model; The preprocessed image is input into the visual recognition model for image content analysis and interpretation to obtain the analysis result.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a visual solution program for the visually impaired and the elderly. When the visual solution program for the visually impaired and the elderly is executed by a processor, the steps of the visual solution for the visually impaired and the elderly as described in any one of claims 1 to 6 are implemented.

Images