Application method and device of visual impairment application program
By realizing the information memory and voice broadcasting functions of the target object in visually impaired applications, the problems of insufficient functions and rigid voice prompts in the prior art are solved, and the intelligence level of the application and user convenience are improved.
Patent Information
- Application Number
- CN202510342671.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-03-21
- Publication Date
- 2025-06-27
AI Technical Summary
The existing visually impaired applications are not rich enough, the voice prompts are relatively stiff and the degree of intelligence is low, which reduces the convenience of visually impaired users.
It provides an application method and device for a visually impaired application program, which saves object information of a target object by receiving input, and performs voice broadcasting based on object information. For static objects, feature information and location information are obtained and saved to the local area; for moving objects, biometric information and identity relationship information are obtained and uploaded to the server for storage.
By adding information memory function, visually impaired applications can obtain and memorize information based on the object type of the target object, and then perform voice broadcasts in subsequent response to events related to the target object, improving the intelligence of the application and user convenience.
Smart Images
Figure CN120216083A_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the technical field of electronic devices, and particularly relates to an application method and device for a visually impaired application program. Background Art
[0002] With the development of technology, electronic device manufacturers basically provide visually impaired application programs for visually impaired users. Visually impaired users can use the visually impaired application programs to search for items, identify document information, etc., improving the convenience of the lives of visually impaired users.
[0003] However, the functions of current visually impaired application programs are not rich enough. When using a visually impaired application program for voice prompts, there are problems such as relatively rigid voice prompts and poor intelligence, reducing the convenience of visually impaired users using visually impaired application programs. Summary of the Invention
[0004] The purpose of the embodiments of this application is to provide an application method and device for a visually impaired application program, which can enrich the functions of the visually impaired application program and improve the convenience of visually impaired users using the visually impaired application program.
[0005] In a first aspect, the embodiments of this application provide an application method for a visually impaired application program. The method includes: receiving a first input for a target object; in response to the first input, saving the object information of the target object; receiving a second input; in response to the second input, performing a voice broadcast according to the object information; saving the object information of the target object includes: when the target object is a static object, obtaining the feature information and location information of the static object, using the feature information and location information of the static object as the object information, and saving the object information to the local storage space; when the target object is a moving object, obtaining the biometric information and identity relationship information of the moving object, using the biometric information and identity relationship information of the moving object as the object information, and uploading the object information to the server for storage.
[0006] In a second aspect, the embodiments of this application provide an application device for a visually impaired application program. The device includes: a receiving unit, configured to receive a first input for a target object; a storage unit, configured to save the object information of the target object in response to the first input; the receiving unit is further configured to receive a second input; a broadcast unit, configured to perform a voice broadcast according to the object information in response to the second input; the storage unit is specifically configured to: when the target object is a static object, obtain the feature information and location information of the static object, use the feature information and location information of the static object as the object information, and save the object information to the local storage space; when the target object is a moving object, obtain the biometric information and identity relationship information of the moving object, use the biometric information and identity relationship information of the moving object as the object information, and upload the object information to the server for storage.
[0007] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory. The memory stores a program or instructions that can run on the processor. When the program or instructions are executed by the processor, the steps of the application method of the visual impairment application program in the first aspect are implemented.
[0008] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instructions are stored. When the program or instructions are executed by a processor, the steps of the application method of the visual impairment application program in the first aspect are implemented.
[0009] In a fifth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor, and the processor is used to run a program or instructions to implement the steps of the application method of the visual impairment application program in the first aspect.
[0010] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the steps of the application method of the visual impairment application program in the first aspect.
[0011] In the application method of the visual impairment application program provided by the embodiment of the present application, a first input to a target object is received; in response to the first input, the object information of the target object is saved; a second input is received; in response to the second input, voice broadcast is performed according to the object information; saving the object information of the target object includes: when the target object is a stationary object, obtaining the feature information and position information of the stationary object, using the feature information and position information of the stationary object as the object information, and saving the object information to the local storage space; when the target object is a moving object, obtaining the biometric information and identity relationship information of the moving object, using the biometric information and identity relationship information of the moving object as the object information, and uploading the object information to the server for storage. Through the above application method of the visual impairment application program, an information memory function is added to the visual impairment application program. The visual impairment application program can obtain corresponding object information based on the object type of the target object, and perform short-term or long-term memory on it. Furthermore, when responding to events related to the target object subsequently, the previously stored object information is called for voice broadcast. In this way, the functions of the visual impairment application program are enriched, and voice broadcast is performed based on the previously memorized object information, which improves the intelligence level of the visual impairment application program and the convenience of visually impaired users using the visual impairment application program. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] Figure 1 It is a schematic flowchart of the application method of the visual impairment application program provided by the embodiment of the present application;
[0013] Figure 2One of the schematic diagrams of the operation interface of the application method of the visually impaired application program provided by the embodiment of the present application;
[0014] Figure 3 One of the schematic diagrams of the operation interface of the application method of the visually impaired application program provided by the embodiment of the present application;
[0015] Figure 4 One of the schematic diagrams of the operation interface of the application method of the visually impaired application program provided by the embodiment of the present application;
[0016] Figure 5 The structural block diagram of the application device of the visually impaired application program provided by the embodiment of the present application;
[0017] Figure 6 The structural block diagram of the electronic device provided by the embodiment of the present application;
[0018] Figure 7 The schematic diagram of the hardware structure of the electronic device provided by the embodiment of the present application. Detailed implementation manners
[0019] Next, the technical solutions in the embodiments of the present application will be clearly described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art belong to the scope of protection of the present application.
[0020] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, rather than to describe a specific order or sequence. It should be understood that such terms can be interchanged under appropriate circumstances so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are usually of the same type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims means at least one of the connected objects, and the character " / " generally means that the related objects before and after are in an "or" relationship.
[0021] Next, in conjunction with the accompanying drawings, the application method of the visually impaired application program provided by the embodiments of the present application will be described in detail through specific embodiments and their application scenarios.
[0022] As Figure 1 shown, the embodiment of the present application provides an application method of a visually impaired application program, and the method may include the following S102 to S108:
[0023] S102: Receive a first input for a target object.
[0024] The application method of the visually impaired application proposed in the embodiments of the present application is executed by an electronic device, which can specifically be intelligent electronic devices such as smart phones, tablet computers, laptop computers, and smart watches, and no specific limitation is made here.
[0025] Among them, the above-mentioned target object is an object that can be scanned by the camera application of the electronic device during the process of a visually impaired user using the visually impaired application. In the actual application process, the above-mentioned target object includes but is not limited to: people, pets, plants, and items, etc., and no specific limitation is made here.
[0026] Further, the above-mentioned first input can be triggered by the user's operation on the electronic device, and the above-mentioned first input can also be actively triggered by the electronic device, and no specific limitation is made here.
[0027] S104: In response to the first input, save the object information of the target object.
[0028] Among them, the above-mentioned object information includes but is not limited to the feature information, location information, biometric information, and identity relationship information of the target object, etc., and no specific limitation is made here.
[0029] Specifically, in the application method of the visually impaired application proposed in the embodiments of the present application, the electronic device can receive the first input for the target object, and in response to the first input, the electronic device obtains the object information of the target object and stores it in memory for subsequent retrieval and use of the object information.
[0030] In some embodiments, the step of saving the object information of the target object may specifically include S110 and S112 described below:
[0031] S110: When the target object is a stationary object, obtain the feature information and location information of the stationary object, use the feature information and location information of the stationary object as object information, and save the object information to the local storage space.
[0032] Among them, the above-mentioned stationary object is an object whose position can be moved. In the actual application process, the above-mentioned stationary object includes but is not limited to: cups, tables, chairs, stools, headphones, chargers, power banks, pens, tablet computers, mobile phones, watches, and books, etc., and no specific limitation is made here.
[0033] Further, since the stationary object is an object whose position can be moved, the above-mentioned location information is used to indicate the temporary storage location of the stationary object.
[0034] It can be understood that current mainstream visually impaired applications do not have an intelligent memory function and lack the recording of the location information of items. If the memory of visually impaired users is not good, when the users search for items, they need to perform a repeated scanning and searching process each time, which reduces the convenience of users using visually impaired applications.
[0035] Therefore, in the application method of the visually impaired application proposed in the embodiments of the present application, a short-term memory function is added to the visually impaired application. After receiving the first input for the target object, the electronic device responds to the first input. When the target object is a stationary object, the feature information and location information of the stationary object are obtained, and the obtained feature information and location information are saved as object information to the local storage space to perform short-term memory storage on the feature information and location information of the stationary object, facilitating directly retrieving the location information of the item when the user searches for the item, without the need for a repeated scanning and searching process, and improving the convenience of users using the visually impaired application.
[0036] In the actual application process, after performing short-term memory storage on the feature information and location information of the stationary object, the electronic device can respond to the user operation to update the feature information and location information of the stationary object, or the electronic device can actively update the feature information and location information of the stationary object after detecting that the feature information and location information of the stationary object have changed, without specific limitation here.
[0037] S112: When the target object is a moving object, obtain the biometric information and identity relationship information of the moving object, use the biometric information and identity relationship information of the moving object as object information, and upload the object information to the server for storage.
[0038] Among them, the above-mentioned moving object can be a person or a pet.
[0039] Furthermore, the above-mentioned biometric information is used to identify the identity of the target object. In the actual application process, the biometric information can specifically be facial information.
[0040] Furthermore, the above-mentioned identity relationship information is used to indicate the identity relationship between the target object and the visually impaired user, such as father-son relationship, father-daughter relationship, mother-son relationship, mother-daughter relationship, brother relationship, sister relationship, and friend relationship, etc., without specific limitation here.
[0041] It can be understood that current mainstream visually impaired applications do not have an intelligent memory function. Based on this, when a visually impaired application recognizes a person, it usually can only give a voice prompt "The person in the picture is doing something". If the person in the picture is a family member, friend or other familiar person of the user, the above voice prompt will seem rather rigid.
[0042] Therefore, in the application method of the visually impaired application proposed in the embodiments of the present application, a long-term memory function is added to the visually impaired application. After receiving the first input for the target object, in response to the first input, when the target object is a moving object, the electronic device acquires the biometric information and identity relationship information of the moving object, and uploads the acquired biometric information and identity relationship information to the server for storage, so as to perform long-term memory storage on the biometric information and identity relationship information of the moving object, facilitating subsequent voice prompts based on the identity relationship information and improving the naturalness of the voice prompts.
[0043] That is to say, the application method of the visually impaired application proposed in the embodiments of the present application provides a solution for intelligent memory information for visually impaired users, which is divided into short-term memory and long-term memory, enriches the functions of the visually impaired application, and can give friendly voice reminders to visually impaired users, improving the intelligence level of the visually impaired application and the convenience of visually impaired users using the visually impaired application.
[0044] S106: Receive a second input.
[0045] Among them, the above-mentioned second input can be triggered by the user's operation on the electronic device, and the above-mentioned second input can also be actively triggered by the electronic device, and no specific limitation is made here.
[0046] S108: In response to the second input, perform voice broadcast according to the object information.
[0047] Specifically, in the application method of the visually impaired application proposed in the embodiments of the present application, after saving the object information of the target object, if the electronic device subsequently receives a second input related to the target object, the electronic device responds to the second input, retrieves the previously stored object information of the target object, and performs voice broadcast based on the object information.
[0048] The application method of the above visual impairment application program provided by the embodiments of the present application receives a first input for a target object; in response to the first input, saves the object information of the target object; receives a second input; in response to the second input, performs voice broadcast according to the object information. Saving the object information of the target object includes: when the target object is a stationary object, obtaining the feature information and location information of the stationary object, using the feature information and location information of the stationary object as the object information, and saving the object information to the local storage space; when the target object is a moving object, obtaining the biometric information and identity relationship information of the moving object, using the biometric information and identity relationship information of the moving object as the object information, and uploading the object information to the server for storage. Through the application method of the above visual impairment application program, an information memory function is added to the visual impairment application program. The visual impairment application program can save the object type based on the target object, obtain the corresponding object information, and perform short-term or long-term memory on it. Furthermore, when responding to events related to the target object subsequently, the previously stored object information is called for voice broadcast. In this way, the functions of the visual impairment application program are enriched, and voice broadcast is performed based on the previously memorized object information, improving the intelligence level of the visual impairment application program and the convenience of visually impaired users using the visual impairment application program.
[0049] In the embodiments of the present application, the above S104 may specifically include the following S104a, S104b or S104c:
[0050] S104a: In response to the user's voice input for the target object, save the object information of the target object.
[0051] Among them, the above voice input is used to instruct the electronic device to perform an information memory operation on the target object.
[0052] Specifically, in the application method of the visual impairment application program proposed in the embodiments of the present application, the electronic device can analyze the user's intention in response to the user's voice input for the target object, judge whether the visually impaired user needs to perform long-term or short-term memory on the object information of the target object, and then perform an information memory operation on the target object to save the object information of the target object.
[0053] Among them, the above target object can be a stationary object or a moving object.
[0054] Specifically, in the application method of the visually impaired application proposed in the embodiments of the present application, an information memory function is added to the visually impaired application. When a visually impaired user is using the visually impaired application to search for a stationary object, after successfully finding the stationary object, the user can actively click the voice icon through the accessibility talkback (a system software that helps blind or visually impaired users with language assistance), and actively input a voice command such as "Please help me remember the location of this item". After receiving the voice input from the visually impaired user, the visually impaired application uses AI (Artificial Intelligence) capabilities to analyze the feature information and location information of the item, such as the cup is in the middle of the table, etc., and saves the analyzed feature information and location information to the local storage space to perform short-term memory on the feature information and location information of the item.
[0055] Further, when a visually impaired user is using the visually impaired application to scan and identify a moving object, the user can also actively input a voice command such as "This is my daughter, please help me remember". Based on this, the visually impaired application analyzes the user's intention. After confirming the intention of the visually impaired user to long-term save the identity relationship with the moving object, the application extracts the biometric information of the moving object and saves the biometric information and identity relationship information of the moving object to the server to perform long-term memory on the biometric information and identity relationship information of the moving object.
[0056] Exemplarily, as Figure 2 shown, when a visually impaired user is using the visually impaired application to search for a cup, after successfully finding the cup, the user can input a voice command 202 of "Please help me remember the location of the cup", triggering the electronic device to perform short-term memory on the feature information and location information of the cup.
[0057] S104b: In response to the user's setting input for the target object, save the object information of the target object.
[0058] Among them, the above setting input is used to set the object information of the target object.
[0059] Specifically, in the application method of the visually impaired application proposed in the embodiments of the present application, the electronic device can respond to the user's setting input for the target object in the visually impaired application and store the object information of the target object set by the user.
[0060] For example, for moving objects, an input function for active identity relationship information and biometric information can be provided on the settings page of the visually impaired application. Based on this, visually impaired users can actively input the identity relationship information between the moving objects and themselves on the settings page. This identity relationship information can be selected and input from multiple identity relationship information provided by the visually impaired application, or can be custom - input. Further, visually impaired users can input the biometric information of each moving object on the settings page. The visually impaired application then encrypts the input biometric information and the input identity relationship information and uploads them to the server for long - term memory storage.
[0061] Exemplarily, as Figure 3 shown, on the settings page of the visually impaired application, input the identity relationship information 204 between oneself and multiple moving objects, including identity relationships such as father, mother, son, and daughter, and input the biometric information 206 of each moving object to perform long - term memory storage of the object information of the above - mentioned moving objects.
[0062] S104c: In response to the detection input of the target object, save the object information of the target object.
[0063] Specifically, in the application method of the visually impaired application proposed in the embodiments of the present application, the electronic device can, in response to the detection input of the target object, such as when the electronic device scans the target object or when the object information of the target object is detected, actively trigger an information memory operation on the target object and save the object information of the target object.
[0064] In the above - mentioned embodiments provided by the present application, in response to the user's voice input for the target object, save the object information of the target object; or, in response to the user's setting input for the target object, save the object information of the target object; or, in response to the detection input of the target object, save the object information of the target object. In this way, the visually impaired application can passively or actively save the object information of the target object, improving the diversity of the triggering of information saving operations.
[0065] In the embodiments of the present application, the above - mentioned S104c can specifically include the following S114 or S116:
[0066] S114: In response to the scanning input of the target object by the camera application, save the object information of the target object.
[0067] Specifically, in the application method of the visually impaired application proposed in the embodiments of the present application, the electronic device can, in response to the scanning input of the target object by the camera application, actively perform an information memory operation on the target object and save the object information of the target object.
[0068] Specifically, the above-mentioned target object can be a stationary object. When a visually impaired user uses the camera application to scan and find a stationary object, for each frame of the picture detected and scanned by the camera application, the electronic device will analyze and detect the frame of the picture, and in the case of detecting a stationary object, store the object information of the detected stationary object, so as to establish an object information library of common stationary objects in daily indoor environments. This object information library can be stored in the local database of the electronic device for subsequent direct invocation of the object information of the required stationary object from this object information library.
[0069] In the actual application process, after establishing the object information library, the electronic device can update the object information stored in the object information library when the object information of the stationary object stored in the object information library changes, or when a new stationary object is detected.
[0070] S116: In response to the target input of the target object by the album application, save the object information of the target object.
[0071] Among them, the target input is used to transfer the object information of the target object to the visually impaired application.
[0072] Specifically, in the application method of the visually impaired application proposed in the embodiments of the present application, the visually impaired application can be linked with the album application. After the electronic device takes a photo of a person or a pet, such as after taking a photo of the daughter of a visually impaired user, the album application will label and analyze the photo to form an identity relationship information library and a biometric information library corresponding to various photos. This identity relationship information library and biometric information library can be transmitted to the visually impaired application. On this basis, the electronic device can, in response to the target input of the album application to transfer the object information of the target object to the visually impaired application, synchronize the identity relationship information and biometric information transmitted by the album application to the remote server for long-term memory storage, so as to perform targeted object recognition and voice prompts based on the saved identity relationship information and biometric information in the future.
[0073] In the above embodiments provided by the present application, in response to the scan input of the target object by the camera application, save the object information of the target object; or, in response to the target input of the target object by the album application, save the object information of the target object, and the target input is used to transfer the object information of the target object to the visually impaired application. In this way, the visually impaired application can actively save the object information of the target object in multiple ways, while improving the diversity of triggering information saving operations, and can timely store and update the object information, ensuring the timeliness of subsequent information invocation.
[0074] In the embodiments of the present application, the above S108 may specifically include the following S108a to S108c:
[0075] S108a: In response to the user's voice input for the target object, call the object information of the target object.
[0076] Wherein, the above voice input is used to input question information, and the question information includes the name or identity information of the target object. For example, the question information can be "Where is the cup?" or "Where is my daughter?".
[0077] Furthermore, the above object information includes but is not limited to: feature information, location information, biometric information, and identity relationship information, etc., and no specific limitation is made here.
[0078] Specifically, in the application method of the visually impaired application program proposed in the embodiments of the present application, the electronic device can respond to the voice input of the user's question information for the target object and call the object information of the target object.
[0079] S108b: Generate a reply message for the question information according to the object information.
[0080] Specifically, in the application method of the visually impaired application program proposed in the embodiments of the present application, after retrieving the object information of the target object corresponding to the question information, the electronic device replies to the question information according to the object information and generates a corresponding reply message.
[0081] S108c: Perform voice broadcast according to the reply message.
[0082] Specifically, in the application method of the visually impaired application program proposed in the embodiments of the present application, after generating the reply message, the electronic device broadcasts the reply message to answer the question raised by the visually impaired user.
[0083] Exemplarily, as Figure 4 shown, the visually impaired user can actively input the question information 208 of "Where is the cup?" through the voice dialogue entry in the page of the visually impaired application program. The visually impaired application program reads the location information of the cup from the object information library and broadcasts the reply message 210 of "The cup is in the middle of the table".
[0084] In the above embodiments provided by the present application, in response to the user's voice input for the target object, call the object information of the target object, where the voice input is used to input question information; generate a reply message for the question information according to the object information; perform voice broadcast according to the reply message. In this way, directly call the previously stored object information to reply to the user's question, without repeating the scanning and detection process of the target object, improving the convenience of the visually impaired user using the visually impaired application program.
[0085] In the embodiments of the present application, the above S108 may specifically include the following S108d to S108f:
[0086] S108d: In response to the scanning input of the target object by the camera application, call the object information of the target object.
[0087] Specifically, in the application method of the visually impaired application proposed in the embodiments of the present application, during the process of scanning and recognition by the visually impaired user through the camera application, the electronic device can, in response to the scanning input of the target object by the camera application, actively call the object information of the target object.
[0088] Among them, the above object information includes the biometric information and identity relationship information of the target object.
[0089] S108e: Generate the behavior description information of the target object according to the object information.
[0090] Among them, the above behavior description information includes the identity information of the target object.
[0091] Specifically, in the application method of the visually impaired application proposed in the embodiments of the present application, after the electronic device, based on the scanning input of the target object by the camera application, retrieves the previously stored object information of the target object, the electronic device will identify the target object according to the retrieved object information, analyze the behavior actions of the target object, and generate the behavior description information of the target object.
[0092] S108f: Perform voice broadcast according to the behavior description information.
[0093] Specifically, in the application method of the visually impaired application proposed in the embodiments of the present application, after generating the behavior description information, the electronic device broadcasts the behavior description information to provide voice prompts to the visually impaired user.
[0094] For example, the visually impaired application saves the biometric information and identity relationship information of the family members and friends of the visually impaired user. When the camera application scans a person, the visually impaired application, based on the stored biometric information and identity relationship information, performs identity recognition and behavior recognition on the scanned person, confirms that the scanned person is the daughter of the visually impaired user, and actively gives a voice reminder based on the person's behavior, such as "Your daughter is smiling now" or "Your daughter is drawing now". In this way, a friendly and human reminder is given, reducing the stiffness of the voice prompt and enabling the visually impaired application to form a more friendly and human long-term relationship.
[0095] In the above embodiments provided by the present application, in response to the scanning input of the target object by the camera application, call the object information of the target object; generate the behavior description information of the target object according to the object information; perform voice broadcast according to the behavior description information. In this way, based on the previously stored object information, voice broadcast is actively performed, improving the naturalness of the voice broadcast and the intelligence level of the visually impaired application.
[0096] The application method of the visually impaired application provided by the embodiments of the present application may be executed by the application device of the visually impaired application. In the embodiments of the present application, taking the application device of the visually impaired application as an example to execute the above application method of the visually impaired application, the application device of the visually impaired application provided by the embodiments of the present application is described.
[0097] As Figure 5 shown, the embodiments of the present application provide an application device 500 for a visually impaired application, and the device may include the following receiving unit 502, storage unit 504, and broadcasting unit 506.
[0098] The receiving unit 502 is configured to receive a first input to a target object;
[0099] The storage unit 504 is configured to save the object information of the target object in response to the first input;
[0100] The receiving unit 502 is further configured to receive a second input;
[0101] The broadcasting unit 506 is configured to perform voice broadcasting according to the object information in response to the second input.
[0102] Specifically, the storage unit 504 is configured to: in the case where the target object is a stationary object, obtain the feature information and position information of the stationary object, use the feature information and position information of the stationary object as the object information, and save the object information to the local storage space; in the case where the target object is a moving object, obtain the biometric information and identity relationship information of the moving object, use the biometric information and identity relationship information of the moving object as the object information, and upload the object information to the server for storage.
[0103] The application device 500 of the visually impaired application provided by the embodiment of the present application receives a first input for a target object; in response to the first input, saves the object information of the target object; receives a second input; in response to the second input, performs voice broadcast according to the object information. Saving the object information of the target object includes: when the target object is a stationary object, obtaining the feature information and location information of the stationary object, using the feature information and location information of the stationary object as the object information, and saving the object information to the local storage space; when the target object is a moving object, obtaining the biometric information and identity relationship information of the moving object, using the biometric information and identity relationship information of the moving object as the object information, and uploading the object information to the server for storage. Through the above application device 500 of the visually impaired application, an information memory function is added to the visually impaired application. The visually impaired application can obtain corresponding object information based on the object type of the target object, and perform short-term or long-term memory on it. Furthermore, when responding to events related to the target object subsequently, the previously stored object information is called for voice broadcast. In this way, the functions of the visually impaired application are enriched, and voice broadcast is performed based on the previously memorized object information, improving the intelligence level of the visually impaired application and the convenience of visually impaired users using the visually impaired application.
[0104] In the embodiment of the present application, the receiving unit 502 is specifically configured to: in response to a voice input of a user for a target object, save the object information of the target object; or, in response to a setting input of the user for the target object, save the object information of the target object; or, in response to a detection input for the target object, save the object information of the target object.
[0105] In the above embodiment provided by the present application, in response to a voice input of a user for a target object, save the object information of the target object; or, in response to a setting input of the user for the target object, save the object information of the target object; or, in response to a detection input for the target object, save the object information of the target object. In this way, the visually impaired application can passively or actively save the object information of the target object, improving the diversity of triggering information saving operations.
[0106] In the embodiment of the present application, the receiving unit 502 is specifically configured to: in response to a scanning input of a camera application for a target object, save the object information of the target object; or, in response to a target input of an album application for the target object, save the object information of the target object, where the target input is used to transfer the object information of the target object to the visually impaired application.
[0107] In the above embodiments provided by the present application, in response to a scan input of a target object by a camera application, object information of the target object is saved; or, in response to a target input of a target object by an album application, the object information of the target object is saved, and the target input is used to transfer the object information of the target object to a visually impaired application. In this way, the visually impaired application can actively save the object information of the target object in various ways. While improving the diversity of triggering information saving operations, it can timely store and update the object information, ensuring the timeliness of subsequent information calls.
[0108] In an embodiment of the present application, the receiving unit 502 is specifically configured to: in response to a voice input of a user for a target object, call the object information of the target object, where the voice input is used to input question information; generate a reply message for the question information according to the object information; the broadcasting unit 506 is specifically configured to: perform voice broadcasting according to the reply message.
[0109] In the above embodiments provided by the present application, in response to a voice input of a user for a target object, call the object information of the target object, where the voice input is used to input question information; generate a reply message for the question information according to the object information; perform voice broadcasting according to the reply message. In this way, directly calling the previously stored object information to reply to the user's question without repeating the scanning and detection process of the target object improves the convenience of visually impaired users using the visually impaired application.
[0110] In an embodiment of the present application, the receiving unit 502 is specifically configured to: in response to a scan input of a target object by a camera application, call the object information of the target object; generate behavior description information of the target object according to the object information; the broadcasting unit 506 is specifically configured to: perform voice broadcasting according to the behavior description information.
[0111] In the above embodiments provided by the present application, in response to a scan input of a target object by a camera application, call the object information of the target object; generate behavior description information of the target object according to the object information; perform voice broadcasting according to the behavior description information. In this way, actively performing voice broadcasting based on the previously stored object information improves the naturalness of the voice broadcasting and the intelligence level of the visually impaired application.
[0112] The application device 500 of the visually impaired application program in the embodiments of the present application may be an electronic device or a component in an electronic device, such as an integrated circuit or a chip. The electronic device may be a terminal or other devices other than terminals. Exemplarily, the electronic device may be a mobile phone, a tablet computer, a laptop computer, a handheld computer, an in-vehicle electronic device, a Mobile Internet Device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. It may also be a server, a Network Attached Storage (NAS), a personal computer (PC), a television (TV), a teller machine, or a self-service machine, etc. The embodiments of the present application do not make specific limitations.
[0113] The application device 500 of the visually impaired application program in the embodiments of the present application may be a device with an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems. The embodiments of the present application do not make specific limitations.
[0114] The application device 500 of the visually impaired application program provided in the embodiments of the present application can implement Figure 1 each process implemented by the method embodiments. To avoid repetition, it will not be elaborated here.
[0115] Optionally, as Figure 6 shown, the embodiments of the present application further provide an electronic device 600, including a processor 602 and a memory 604. A program or instruction that can run on the processor 602 is stored on the memory 604. When the program or instruction is executed by the processor 602, it implements each step of the application method embodiments of the above-mentioned visually impaired application program and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.
[0116] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.
[0117] Figure 7 It is a schematic diagram of the hardware structure of an electronic device for implementing the embodiments of the present application.
[0118] The electronic device 700 includes, but is not limited to, components such as a radio frequency unit 701, a network module 702, an audio output unit 703, an input unit 704, a sensor 705, a display unit 706, a user input unit 707, an interface unit 708, a memory 709, and a processor 710.
[0119] Those skilled in the art can understand that the electronic device 700 may further include a power source (such as a battery) for supplying power to each component. The power source can be logically connected to the processor 710 through a power management system, so as to implement functions such as management of charging, discharging, and power consumption management through the power management system. Figure 7 The structure of the electronic device shown does not limit the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.
[0120] Among them, the processor 710 is configured to receive a first input for a target object.
[0121] The memory 709 is configured to save the object information of the target object in response to the first input.
[0122] The processor 710 is further configured to receive a second input.
[0123] The audio output unit 703 is configured to perform voice broadcast according to the object information in response to the second input.
[0124] Specifically, the memory 709 is configured to: in the case where the target object is a stationary object, obtain the feature information and location information of the stationary object, use the feature information and location information of the stationary object as the object information, and save the object information to the local storage space; in the case where the target object is a moving object, obtain the biometric information and identity relationship information of the moving object, use the biometric information and identity relationship information of the moving object as the object information, and upload the object information to the server for storage.
[0125] In an embodiment of the present application, a first input for a target object is received; in response to the first input, the object information of the target object is saved; a second input is received; in response to the second input, voice broadcast is performed according to the object information; when the target object is a stationary object, the feature information and location information of the stationary object are obtained, the feature information and location information of the stationary object are used as the object information, and the object information is saved to the local storage space; when the target object is a moving object, the biometric information and identity relationship information of the moving object are obtained, the biometric information and identity relationship information of the moving object are used as the object information, and the object information is uploaded to the server for storage. In an embodiment of the present application, an information memory function is added to the visually impaired application. The visually impaired application can obtain the corresponding object information based on the object type of the target object, and perform short-term or long-term memory on it. Then, when responding to an event related to the target object subsequently, the previously stored object information is called for voice broadcast. In this way, the functions of the visually impaired application are enriched, and voice broadcast is performed based on the previously memorized object information, improving the intelligence level of the visually impaired application and the convenience of visually impaired users using the visually impaired application.
[0126] Optionally, the processor 710 is specifically configured to: in response to a voice input of a user for a target object, save the object information of the target object; or, in response to a setting input of the user for the target object, save the object information of the target object; or, in response to a detection input for the target object, save the object information of the target object.
[0127] In the above embodiment provided by the present application, in response to a voice input of a user for a target object, save the object information of the target object; or, in response to a setting input of the user for the target object, save the object information of the target object; or, in response to a detection input for the target object, save the object information of the target object. In this way, the visually impaired application can passively or actively save the object information of the target object, improving the diversity of triggering information saving operations.
[0128] Optionally, the processor 710 is specifically configured to: in response to a scanning input of a camera application for a target object, save the object information of the target object; or, in response to a target input of an album application for the target object, save the object information of the target object, where the target input is used to transfer the object information of the target object to the visually impaired application.
[0129] In the above embodiments provided by the present application, in response to a scan input of a target object by a camera application, object information of the target object is saved; alternatively, in response to a target input of a target object by an album application, the object information of the target object is saved, and the target input is used to transfer the object information of the target object to a visually impaired application. In this way, the visually impaired application can actively save the object information of the target object in multiple ways. While improving the diversity of triggering information saving operations, it can timely store and update the object information, ensuring the timeliness of subsequent information calls.
[0130] Optionally, the processor 710 is specifically configured to: in response to a voice input of a user for a target object, call the object information of the target object, where the voice input is used to input question information; generate a reply message for the question information according to the object information; the audio output unit 703 is specifically configured to: perform voice broadcast according to the reply message.
[0131] In the above embodiments provided by the present application, in response to a voice input of a user for a target object, call the object information of the target object, where the voice input is used to input question information; generate a reply message for the question information according to the object information; perform voice broadcast according to the reply message. In this way, directly calling the previously stored object information to reply to the user's question without repeating the scan detection process of the target object improves the convenience of visually impaired users using the visually impaired application.
[0132] Optionally, the processor 710 is specifically configured to: in response to a scan input of a target object by a camera application, call the object information of the target object; generate behavior description information of the target object according to the object information; the audio output unit 703 is specifically configured to: perform voice broadcast according to the behavior description information.
[0133] In the above embodiments provided by the present application, in response to a scan input of a target object by a camera application, call the object information of the target object; generate behavior description information of the target object according to the object information; perform voice broadcast according to the behavior description information. In this way, actively performing voice broadcast based on the previously stored object information improves the naturalness of the voice broadcast and the intelligent level of the visually impaired application.
[0134] It should be understood that in the embodiments of the present application, the input unit 704 may include a Graphics Processing Unit (GPU) 7041 and a microphone 7042. The GPU 7041 processes the image data of static pictures or videos obtained by an image capturing device (such as a camera) in a video capture mode or an image capture mode. The display unit 706 may include a display panel 7061, and the display panel 7061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 707 includes at least one of a touch panel 7071 and other input devices 7072. The touch panel 7071 is also referred to as a touch screen. The touch panel 7071 may include two parts: a touch detection device and a touch controller. The other input devices 7072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, power on / off keys, etc.), a trackball, a mouse, and a joystick, which will not be elaborated herein.
[0135] The memory 709 can be used to store software programs and various data. The memory 709 mainly includes a first storage area for storing programs or instructions and a second storage area for storing data. Among them, the first storage area can store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 709 may include a volatile memory or a non-volatile memory, or the memory 709 may include both a volatile memory and a non-volatile memory. Among them, the non-volatile memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash memory. The volatile memory may be a Random Access Memory (RAM), a Static RAM (SRAM), a Dynamic RAM (DRAM), a Synchronous DRAM (SDRAM), a Double Data Rate SDRAM (DDR SDRAM), an Enhanced SDRAM (ESDRAM), a Synch link DRAM (SLDRAM), and a Direct Rambus RAM (DRRAM). The memory 709 in the embodiments of the present application includes, but is not limited to, these and any other suitable types of memories.
[0136] The processor 710 may include one or more processing units; optionally, the processor 710 integrates an application processor and a modem processor. Among them, the application processor mainly processes operations related to the operating system, user interface, application programs, etc., and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the above-mentioned modem processor may not be integrated into the processor 710 either.
[0137] The embodiment of the present application further provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, it implements each process of the application method embodiment of the above-mentioned visually impaired application program and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.
[0138] Among them, the processor is the processor in the electronic device in the above-mentioned embodiment. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk, or an optical disc, etc.
[0139] The embodiment of the present application further provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run a program or instruction to implement each process of the application method embodiment of the above-mentioned visually impaired application program and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.
[0140] It should be understood that the chip mentioned in the embodiment of the present application may also be referred to as a system-on-chip, a system chip, a chip system, or a system-on-chip, etc.
[0141] The embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement each process of the application method embodiment of the above-mentioned visually impaired application program and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.
[0142] It should be noted that in this text, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "comprising one..." does not exclude the presence of additional identical elements in the process, method, article or device comprising such element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the reverse order according to the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
[0143] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-described example methods can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. The computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions for causing a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods of the various embodiments of the present application.
[0144] The embodiments of the present application have been described above with reference to the accompanying drawings. However, the present application is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Those of ordinary skill in the art, under the inspiration of the present application and without departing from the spirit of the present application and the scope protected by the claims, can also make many forms, all of which fall within the protection scope of the present application.
Claims
1. A method for applying a visually impaired application program, characterized in that: include: Receiving a first input to a target object; In response to the first input, saving object information of the target object; receiving a second input; In response to the second input, voice broadcasting according to the object information; The storing of the object information of the target object includes: In the case where the target object is a stationary object, acquiring feature information and position information of the stationary object, using the feature information and position information of the stationary object as the object information, and saving the object information to a local storage space; In the case that the target object is a moving object, the biometric information and identity relationship information of the moving object are obtained, the biometric information and identity relationship information of the moving object are used as the object information, and the object information is uploaded to the server for storage.
2. The application method of the visually impaired application according to claim 1, characterized in that: The step of saving the object information of the target object in response to the first input includes: In response to a user's voice input for the target object, saving the object information of the target object; or, In response to a user's setting input for the target object, saving the object information of the target object; or, In response to a detection input of the target object, object information of the target object is saved.
3. The application method of the visually impaired application program according to claim 2, characterized in that: The step of saving object information of the target object in response to the detection input of the target object includes: In response to a scan input of the target object by a camera application, saving object information of the target object; or, In response to a target input of the target object by the album application, object information of the target object is saved, and the target input is used to transfer the object information of the target object to the visually impaired application.
4. The application method of the visually impaired application program according to any one of claims 1 to 3, characterized in that: The step of performing voice broadcasting according to the object information in response to the second input includes: In response to a user's voice input for the target object, calling the object information of the target object, wherein the voice input is used to input question information; generating answer information for the question information according to the object information; Perform voice broadcast according to the reply information.
5. The application method of the visually impaired application program according to any one of claims 1 to 3, characterized in that: The step of performing voice broadcasting according to the object information in response to the second input includes: In response to a scan input of the target object by a camera application, calling object information of the target object; generating behavior description information of the target object according to the object information; Perform voice broadcast according to the behavior description information.
6. An application device for visually impaired applications, characterized in that: include: A receiving unit, configured to receive a first input to a target object; a storage unit, configured to store the object information of the target object in response to the first input; The receiving unit is further used to receive a second input; a broadcasting unit, configured to perform voice broadcasting according to the object information in response to the second input; The storage unit is specifically used for: In the case where the target object is a stationary object, acquiring feature information and position information of the stationary object, using the feature information and position information of the stationary object as the object information, and saving the object information to a local storage space; In the case that the target object is a moving object, the biometric information and identity relationship information of the moving object are obtained, the biometric information and identity relationship information of the moving object are used as the object information, and the object information is uploaded to the server for storage.
7. The application device of the visually impaired application program according to claim 6, characterized in that: The storage unit is specifically used for: In response to a user's voice input for the target object, saving the object information of the target object; or, In response to a user's setting input for the target object, saving the object information of the target object; or, In response to a detection input of the target object, object information of the target object is saved.
8. The application device of the visually impaired application program according to claim 7, characterized in that: The storage unit is specifically used for: In response to a scan input of the target object by a camera application, saving object information of the target object; or, In response to a target input of the target object by the album application, object information of the target object is saved, and the target input is used to transfer the object information of the target object to the visually impaired application.
9. The application device of the visually impaired application program according to any one of claims 6 to 8, characterized in that: The broadcast unit is specifically used for: In response to a user's voice input for the target object, calling the object information of the target object, wherein the voice input is used to input question information; generating answer information for the question information according to the object information; Perform voice broadcast according to the reply information.
10. The application device of the visually impaired application program according to any one of claims 6 to 8, characterized in that: The broadcast unit is specifically used for: In response to a scan input of the target object by a camera application, calling object information of the target object; generating behavior description information of the target object according to the object information; Perform voice broadcast according to the behavior description information.