Control method and device of smart glasses, electronic equipment and storage medium
Patent Information
- Application Number
- CN202210993349.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-08-18
- Publication Date
- 2026-09-04
- Estimated Expiration
- 2042-08-18
AI Technical Summary
[0019]第五方面,本申请实施例提供了一种芯片,所述芯片包括处理器和通信接口,所述通信接口和所述处理器耦合,所述处理器用于运行程序或指令,实现如第一方面所述的方法。
Smart Images

Figure CN115359153B_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the field of digital sensing technology, and specifically relates to a control method, device and electronic device for smart glasses. Background Technology
[0002] Smart glasses typically refer to human-computer interaction glasses that overlay virtual information onto the real world based on augmented reality (AR) or virtual reality (VR) technologies.
[0003] Currently, people usually acquire knowledge through the Internet. In this case, users need to extract images or keywords of the object to be searched themselves. With the development of smart glasses technology, how to combine smart glasses with knowledge popularization scenarios has become one of the current research directions. Summary of the Invention
[0004] The purpose of this application is to provide a control method, device, electronic device, and storage medium for smart glasses, which can improve the convenience of knowledge dissemination.
[0005] In a first aspect, embodiments of this application provide a control method for smart glasses, applied to smart glasses, comprising:
[0006] Acquire the first image;
[0007] If the first image includes a target object, obtain the category information and description information of the target object;
[0008] Based on the category information of the target object, determine the target display information that matches the category information of the target object;
[0009] Based on the target display information, the first image and the description information of the target object are fused to generate a second image, which includes the description information of the target object.
[0010] The second image is displayed.
[0011] Secondly, embodiments of this application provide a control device for smart glasses, applied to smart glasses, comprising:
[0012] The acquisition module is used to acquire the first image;
[0013] The first acquisition module is used to acquire category information and description information of the target object when the first image includes a target object;
[0014] The first determining module is used to determine target display information that matches the category information of the target object based on the category information of the target object;
[0015] A generation module is used to perform fusion processing on the first image and the description information of the target object based on the target display information to generate a second image, wherein the second image includes the description information of the target object;
[0016] The display module is used to display the second image.
[0017] Thirdly, embodiments of this application provide an electronic device including a processor, a memory, and a program or instructions stored in the memory and executable on the processor, wherein the program or instructions, when executed by the processor, implement the steps of the method described in the first aspect.
[0018] Fourthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method described in the first aspect.
[0019] Fifthly, embodiments of this application provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the method as described in the first aspect.
[0020] In this embodiment, smart glasses can identify target objects in the display area based on AR or VR technology, match different display information according to the category information of the target object, and then fuse the image currently displayed by the smart glasses with the descriptive information of the target object based on the matched display information to present the descriptive information of the target object to the user. Utilizing the wearable and portable nature of smart glasses, users can access descriptive information of target objects within their field of vision anytime, anywhere, improving the convenience of knowledge dissemination. Furthermore, smart glasses can adaptively display descriptive information of target objects according to the characteristics of different object categories, providing users with a more personalized descriptive information display effect. Attached Figure Description
[0021] Figure 1 This is a flowchart of a control method for smart glasses provided in an embodiment of this application;
[0022] Figure 2 This is one of the schematic diagrams showing a second image provided in the embodiments of this application;
[0023] Figure 3 This is a second schematic diagram of a second image provided in an embodiment of this application;
[0024] Figure 4This is a structural block diagram of a control device for smart glasses provided in an embodiment of this application;
[0025] Figure 5 This is a structural block diagram of an electronic device provided in an embodiment of this application. Detailed Implementation
[0026] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.
[0027] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and are not limited in number; for example, the target object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.
[0028] The control method for smart glasses provided in this application will be described in detail below with reference to the accompanying drawings, through specific embodiments and application scenarios.
[0029] Please see Figure 1 , Figure 1 This is a flowchart illustrating a control method for smart glasses provided in an embodiment of this application. The control method for smart glasses is executed by the smart glasses themselves. It should be noted that the optical implementation of the smart glasses is not limited here; it can be determined according to actual circumstances. For example, the smart glasses can be AR glasses, where the image seen by the user is a virtual-real image displayed based on AR technology. Alternatively, the smart glasses can also be VR glasses, where the image seen by the user is a virtual image displayed based on VR technology.
[0030] like Figure 1 As shown, the control method for smart glasses includes the following steps:
[0031] Step 101: Acquire the first image.
[0032] After a user wears smart glasses, images can be displayed based on the settings of the smart glasses. For example, a user might wear AR glasses while shopping, studying, or working in daily life; or they might wear AR or VR glasses for gaming; or they might wear AR glasses for stargazing. The first image is any image currently displayed by the smart glasses, which, depending on the type of smart glasses, could be an image displayed based on AR technology or an image displayed based on VR technology.
[0033] Step 102: If the first image includes the target object, obtain the category information of the target object and the description information of the target object.
[0034] In practice, the category information of the target object is used to indicate the object category of the target object. The object category may include, but is not limited to, human objects, animal objects, plant objects, astronomical objects, building objects, vehicle objects, item objects, text objects, and logo objects. The specific category can be determined according to the actual situation and is not limited here.
[0035] The category information of the target object can also be determined hierarchically. For example, it can include the primary object category of the target object, such as animals, plants, astronomical objects, etc., and it can also include the secondary object category of the target object, such as land animals, marine animals, trees, flowers and grasses, stars, constellations, etc. In addition, the category information of the target object can also include descriptive information and feature information corresponding to the object category, etc., which are not specifically limited here.
[0036] If the first image includes the target object, the smart glasses can obtain the category information of the target object. Specifically, the smart glasses can perform category analysis on their own to obtain the category information of the target object. Alternatively, due to limitations in the computing power of the smart glasses or other reasons, if the first image includes the target object, the smart glasses can also send the first image to the corresponding server to request the server to perform image recognition on the first image and perform category analysis on the target object to obtain the category information of the target object. In this case, the smart glasses can receive and obtain the category information of the target object.
[0037] Smart glasses can also obtain introductory information about a target object. Specifically, smart glasses can retrieve introductory information about a target object locally, or they can send the relevant query information to the cloud, where the cloud will retrieve and return the introductory information.
[0038] For example, if the first image is an astronomical image, such as an image displayed after the smart glasses activate stargazing mode, then the target object is an astronomical object in the first image. This astronomical object can be a star, satellite, constellation, star cluster, etc. To obtain information about the astronomical object, the smart glasses can calculate the actual azimuth and altitude of the astronomical object based on its position in the first image, the smart glasses' geographical location, its posture, and the current time. Based on these parameters, the glasses can determine the object's identification information and then obtain its descriptive information. Alternatively, the smart glasses can send the target object to a cloud server in a first image, along with the smart glasses' geographical location, posture, and current time. The server can then perform image recognition on the first image to obtain the target object's location information within it. Based on this location information, the server can calculate the target object's actual azimuth and altitude. It can then determine the target object's identification information and, based on the astronomical object's identification information, determine the target object's descriptive information before sending this descriptive information back to the smart glasses.
[0039] The location information of the astronomical object in the first image can be obtained through image recognition. The geographical location information of the smart glasses can include their Global Positioning System (GPS) coordinates, longitude, and latitude. The smart glasses can be equipped with a GPS module to obtain this geographical location information. The attitude information of the smart glasses can include their pitch, yaw, and roll angles. Based on this attitude information, the position of the target object relative to the celestial sphere can be determined. The smart glasses can be equipped with an attitude measurement module such as a gyroscope to obtain this attitude information. The actual azimuth and altitude information of the astronomical object can uniquely identify it within the celestial sphere, thus allowing the acquisition of its identification information. This identification information can include the object's name or a serial number, and is not limited here. Based on the object's identification information, its descriptive information can be retrieved from an information database.
[0040] For example, if the first image is a real street image, the target object can be any object in the real street image. Taking a plant on the side of the street as an example, to obtain the descriptive information of the plant object, the smart glasses can compare and identify the plant object with the images in the plant image database to determine the identification information that matches the plant object. Then, based on the identification information of the plant object, the glasses can query the descriptive information database to obtain the descriptive information of the plant object.
[0041] Step 103: Based on the category information of the target object, determine the target display information that matches the category information of the target object.
[0042] Step 104: Based on the target display information, the first image and the description information of the target object are fused to generate the second image.
[0043] The second image includes descriptive information about the target object.
[0044] In this embodiment, different category information is matched with different display information. Therefore, based on the characteristics of different object categories, the introductory information of the first image and the target object is adaptively fused, allowing the introductory information of the target object to be displayed to the user in a more suitable manner. The display information indicates the processing information for fusing the introductory information of the first image and the target object, as well as the display information for the second image obtained after the fusion process. For example, for plant and animal objects, the growth and movement patterns of plants and animals can be displayed through growth animations, motion animations, etc.; for astronomical objects, the origins and characteristics of astronomical objects can be introduced through text; for architectural or vehicle objects, the appearance and structure of buildings or vehicles can be displayed through multi-views, 3D structural diagrams, etc.
[0045] In practice, smart glasses can pre-determine the display information matching different categories of information and store it locally on the smart glasses or in the cloud. Once the smart glasses obtain the category information of the target object, they can query the matching target display information locally or in the cloud.
[0046] The target display information indicates the displayed information after fusing the first image and the introductory information of the target object. Specifically, it may include, but is not limited to, at least one of the following: fusion processing information, display position information, display format information, display color information, display font information, display content information, display sound effect information, and rendering information. Specifically, the fusion processing information indicates the method, process, and parameters for fusing the first image and the introductory information of the target object. The display position information indicates the position where the introductory information is displayed. The display format information indicates the form in which the introductory information is presented in the second image, such as text, 2D animation, or 3D animation. The display content information indicates the scope of the displayed introductory information, such as the number of fields displayed, the number of lines displayed, and the depth of the displayed content. The display sound effect information indicates the sound effect information output by the smart glasses when displaying the introductory information. The rendering information indicates the rendering method, process, and parameters when displaying the introductory information using 2D or 3D rendering.
[0047] In an optional implementation, before step 103, the smart glasses may also acquire scene information of the first image. Then, the smart glasses can determine target display information that matches both the category information of the target object and the scene information of the first image based on the category information of the target object and the scene information of the first image.
[0048] In this embodiment, scene information is used to characterize the display scene of the first image, such as an everyday scene, a game scene, a movie scene, a simulated stargazing scene, etc. Different scene information can be combined with different category information to match different display information, thereby adaptively displaying the introductory information of the target object based on the characteristics of different object categories and different display scenes.
[0049] In practice, smart glasses can pre-determine the display information matching different categories and scene information, and store it locally on the smart glasses or in the cloud. Once the smart glasses obtain the category information and scene information of the target object, they can query the matching target display information locally or in the cloud.
[0050] Step 105: Display the second image.
[0051] To facilitate understanding, the display of the second image is illustrated here: taking the first image as an astronomical image and the target object as an astronomical object as an example, such as... Figure 2As shown, the fused second image includes: a background image 10 for displaying scene content, wherein the background image 10 is the original astronomical image, and the astronomical image includes at least one astronomical object 20; the fused second image also includes: introductory information 30 of the astronomical object, which is located in the target area of the second image, wherein the introductory information of the astronomical object includes the name of the astronomical object. It should be noted that the specific parameters of the aforementioned target area, such as position, shape, size, etc., can be pre-configured for different astronomical objects. For example, such as... Figure 2 As shown, if the astronomical object 20 is a star, the target area corresponding to the star is located in the blank area around the star, that is, the name of the star is displayed in the blank area around the star; if the astronomical object 20 is a constellation, the bright stars in it can be connected by lines to form the corresponding pattern, then the target area corresponding to the constellation is located in the middle of the multiple stars included in the constellation, that is, the name of the constellation is displayed in the middle of the multiple stars included in the constellation.
[0052] In this embodiment, smart glasses can identify target objects in the display area based on AR or VR technology, match different display information according to the category information of the target object, and then fuse the image currently displayed by the smart glasses with the descriptive information of the target object based on the matched display information to present the descriptive information of the target object to the user. Utilizing the wearable and portable nature of smart glasses, users can access descriptive information of target objects within their field of vision anytime, anywhere, improving the convenience of knowledge dissemination. Furthermore, smart glasses can adaptively display descriptive information of target objects according to the characteristics of different object categories, providing users with a more personalized descriptive information display effect.
[0053] Furthermore, the smart glasses can also perform other control operations around the first image or target object, as detailed below:
[0054] In an optional implementation, if the description information of the target object includes first target information and second target information, then step 105 includes:
[0055] Display the first target information, which includes the identification information of the target object;
[0056] Upon recognizing the user's first action, second target information is displayed, which includes description and feature information of the target object.
[0057] In this embodiment, after determining the target display information, the smart glasses can fuse the identification information of the target object and the first image and display them. If the user has further interest in the descriptive information of the target object, the user can perform a first operation to control the smart glasses to fuse other descriptive information of the target object and the first image and display them. The aforementioned other descriptive information may include, but is not limited to, the descriptive information of the target object, the feature information of the target object, etc. For example, if the first image is an astronomical image and the target object is an astronomical object, such as... Figure 2 As shown, the smart glasses can first display the name 30 of the astronomical object. Upon recognizing a first operation, for example, recognizing an operation targeting "Betelgeuse," it then displays other introductory information 40 about "Betelgeuse," such as its properties, evolutionary history, and related myths. Figure 3 As shown. The implementation of the first operation can be determined with reference to relevant technologies. For example, the first operation can be an operation based on eye control, gesture control, or voice control, and is not specifically limited here.
[0058] In an alternative implementation, step 105 is followed by:
[0059] Upon recognizing the user's second action, a second image is sent to the target device so that the target device displays the second image. The target device includes devices other than smart glasses, such as other smart glasses, other AR devices, or VR devices; no limitation is made here.
[0060] In this embodiment, after the smart glasses display a second image that incorporates introductory information about the target object, the second image can be sent to other devices based on the user's second operation, so that the other devices can also display the second image. This enables information sharing and linkage of introductory information about the target object among multiple devices.
[0061] In practice, the second operation can be an operation initiated by the user or a response operation initiated based on a sharing request message sent by the target device to the smart glasses. The implementation form of the second operation can be determined with reference to relevant technologies. For example, the second operation can be an operation based on eye control, gesture control or voice control, and no specific limitation is made here.
[0062] It is understandable that smart glasses can also project the currently displayed real-time image onto other devices based on user operations, such as other smart glasses, other AR devices, or VR devices, to achieve information sharing and linkage between multiple devices. The aforementioned user operations can also be operations initiated by the user or response operations initiated based on sharing request messages sent by other devices to the smart glasses. The specific implementation can refer to the implementation of the second operation mentioned above, which will not be elaborated here.
[0063] It should be noted that in this embodiment, the target object in the first image can be one or more. In some scenarios, if it is necessary to determine a unique target object, the smart glasses can lock the target object by receiving user operations. For example, if the first image includes two or more objects, in this case, before step 102, the smart glasses can determine a unique target object in the first image based on user operations.
[0064] Specifically, in response to the user's third action, the target object is determined based on the action attribute information of the third action. The third action is used to uniquely identify the target object.
[0065] The implementation of the aforementioned third operation can be determined with reference to relevant technologies. For example, the third operation can be based on eye control, gesture control, or voice control, and is not specifically limited here. The operation attribute information of the third operation may include, for example, at least one of the following: position information of the third operation, effect parameter information of the third operation, etc. The position information of the third operation is used to indicate the position of the third operation in the first image; the effect parameter information of the third operation can be set according to actual needs, and is not specifically limited here. In specific implementation, after the third operation is applied to the first image, the effect achieved by the third operation on the first image can be determined based on the position information and the effect parameter information of the third operation. The effect achieved by the third operation on the first image may include, for example, at least one of the following: enlarging or reducing the first image, enlarging or reducing a portion of the first image, highlighting a certain object in the first image, etc.
[0066] The aforementioned zooming in or out of the first image refers to: controlling the first image to be zoomed in or out as a whole according to a specific ratio, so that only one object exists in the image currently displayed by the smart glasses, and that object can be identified as the target object. Zooming in or out of a portion of the first image refers to: first determining a specific area in the first image based on the operation attribute information of the third operation; while keeping the display of other areas unchanged, controlling the image of that specific area to be zoomed in or out according to a specific ratio, so that only one object exists in the zoomed-out specific area, and that object can be identified as the target object. Highlighting a specific object in the first image refers to: highlighting a specific object, or zooming in on a specific object, or displaying specific controls around a specific object, so that the object is uniquely distinguished from other objects in the first image, and that object can be identified as the target object.
[0067] The control method for smart glasses provided in this application can be executed by a control device for smart glasses. This control device can be located within the aforementioned control equipment, or it can be a control unit within the control device for executing the control method for smart glasses. This application embodiment uses the execution of the control method for smart glasses by a control device for smart glasses as an example for illustration.
[0068] See Figure 4 , Figure 4 This is a structural diagram of the control device 400 for smart glasses provided in an embodiment of this application.
[0069] Acquisition module 401 is used to acquire the first image;
[0070] The first acquisition module 402 is used to acquire the category information and description information of the target object when the first image includes a target object;
[0071] The first determining module 403 is used to determine target display information that matches the category information of the target object based on the category information of the target object;
[0072] The generation module 404 is used to perform a fusion process on the first image and the description information of the target object based on the target display information to generate a second image, wherein the second image includes the description information of the target object;
[0073] Display module 405 is used to display the second image.
[0074] Optionally, the control device 400 for the smart glasses also includes:
[0075] The second acquisition module is used to acquire scene information of the first image;
[0076] The first determination module is used for:
[0077] Based on the category information of the target object and the scene information of the first image, target display information that matches both the category information of the target object and the scene information of the first image is determined.
[0078] Optionally, when the first image is an astronomical image, the first determining module 203 is used to:
[0079] If the astronomical image includes a target object, and the target object is an astronomical object, then obtain the category information and description information of the target object.
[0080] Optionally, the first acquisition module 402 includes:
[0081] The calculation unit is used to calculate the actual azimuth and altitude information of the astronomical object based on the position information of the astronomical object in the first image, the geographical location information of the smart glasses, the posture information of the smart glasses, and the current time information.
[0082] The first determining unit is used to determine the identification information of the astronomical object based on the actual azimuth and altitude information of the astronomical object. The identification information of the astronomical object includes the name of the astronomical object.
[0083] The acquisition unit is used to acquire the introductory information of the astronomical object based on the identification information of the astronomical object.
[0084] Optionally, the first acquisition module 402 includes:
[0085] The second determining unit is used to determine the geographical location information, the posture information, and the current time information of the smart glasses;
[0086] The sending unit is used to send the target object's location information in the first image, the smart glasses' posture information, and the current time information to the server.
[0087] A receiving unit is used to receive the description information of the target object sent by the server;
[0088] The description information of the target object is obtained by the server performing image recognition on the first image to obtain the location information of the target object in the first image, and calculating the actual azimuth and altitude information of the target object based on the location information of the target object in the first image, the geographical location information of the smart glasses, the posture information of the smart glasses, and the current time information. Based on the actual azimuth and altitude information of the target object, the identification information of the target object is determined, and the identification information of the astronomical object is obtained based on the identification information of the astronomical object, which includes the name of the astronomical object.
[0089] Optionally, the description information of the target object includes first target information and second target information; the display module 405 includes:
[0090] A first display unit is configured to display the first target information, wherein the first target information includes the identification information of the target object;
[0091] The second display unit is used to display the second target information upon recognizing the user's first operation. The second target information includes description information and feature information of the target object.
[0092] Optionally, the control device 400 for the smart glasses also includes:
[0093] The sending module is configured to send the second image to the target device upon recognizing a second user operation, so that the target device displays the second image;
[0094] The target device includes other devices besides the smart glasses.
[0095] Optionally, when the first image includes two or more objects or does not include any objects, the control device 400 of the smart glasses further includes:
[0096] The second determining module is used to determine the target object based on the operation attribute information of the third operation in response to the user's third operation.
[0097] The control device 400 of the smart glasses can implement the various processes of the above method embodiments and achieve the same beneficial effects. To avoid repetition, it will not be described again here.
[0098] This application also provides an electronic device. Please refer to... Figure 5 The electronic device 500 may include a processor 501, a memory 502, and a computer program 5021 stored in the memory 502 and executable on the processor 501. When the computer program 5021 is executed by the processor 501, it can implement any of the steps in the above method embodiments and achieve the same beneficial effects, which will not be elaborated here.
[0099] Those skilled in the art will understand that all or part of the steps of the methods described in the above embodiments can be implemented by hardware related to program instructions, and the program can be stored in a readable medium. This application also provides a readable storage medium storing a computer program. When the computer program is executed by a processor, it can implement any step in the above method embodiments and achieve the same technical effect. To avoid repetition, further details are omitted here.
[0100] The storage medium may be a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
[0101] The above description represents the preferred embodiments of this application. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principles described in this application, and these improvements and modifications should also be considered within the scope of protection of this application.
Claims
1. A control method for smart glasses, characterized in that, Applications in smart glasses include: Acquire the first image; If the first image includes a target object, obtain the category information and description information of the target object; Based on the category information of the target object, determine the target display information that matches the category information of the target object; Based on the target display information, the first image and the description information of the target object are fused to generate a second image, which includes the description information of the target object. Display the second image; When the first image is an astronomical image, and when the first image includes a target object, obtaining the category information and descriptive information of the target object includes: If the astronomical image includes a target object, and the target object is an astronomical object, then obtain the category information and descriptive information of the target object. Obtaining the introductory information of the target object includes: The smart glasses calculate the actual azimuth and altitude information of the astronomical object based on the position information of the astronomical object in the first image, the geographical location information of the smart glasses, the posture information of the smart glasses, and the current time information. Based on the actual azimuth and altitude information of the astronomical object, the identification information of the astronomical object is determined, including the name of the astronomical object; Then, based on the identification information of the astronomical object, obtain the introductory information of the astronomical object; Before determining the target display information matching the category information of the target object based on the category information of the target object, the method further includes: Obtain scene information from the first image; The step of determining target display information that matches the category information of the target object based on the category information of the target object includes: Based on the category information of the target object and the scene information of the first image, target display information that matches both the category information of the target object and the scene information of the first image is determined.
2. The method according to claim 1, characterized in that, Obtaining the description information of the target object includes: The geographical location information, posture information, and current time information of the smart glasses are determined. Send the first image, the geographical location information of the smart glasses, the posture information of the smart glasses, and the current time information to the server; Receive the description information of the target object sent by the server; The description information of the target object is obtained by the server performing image recognition on the first image to obtain the location information of the target object in the first image, and calculating the actual azimuth and altitude information of the target object based on the location information of the target object in the first image, the geographical location information of the smart glasses, the posture information of the smart glasses, and the current time information. Based on the actual azimuth and altitude information of the target object, the identification information of the target object is determined, and the identification information of the astronomical object is obtained based on the identification information of the astronomical object, which includes the name of the astronomical object.
3. The method according to claim 1, characterized in that, The description information of the target object includes first target information and second target information; displaying the second image includes: Display the first target information, which includes the identification information of the target object; Upon recognizing the user's first action, the second target information is displayed, which includes the description and feature information of the target object.
4. The method according to claim 1, characterized in that, After displaying the second image, the method further includes: Upon detecting a second user action, the second image is sent to the target device so that the target device displays the second image. The target device includes other devices besides the smart glasses.
5. The method according to claim 1, characterized in that, When the first image includes two or more objects, the target object is determined according to the following steps: In response to a third user action, the target object is determined based on the action attribute information of the third action.
6. A control device for smart glasses, characterized in that, Applications in smart glasses include: The acquisition module is used to acquire the first image; The first acquisition module is used to acquire category information and description information of the target object when the first image includes a target object; The first determining module is used to determine target display information that matches the category information of the target object based on the category information of the target object; A generation module is used to perform fusion processing on the first image and the description information of the target object based on the target display information to generate a second image, wherein the second image includes the description information of the target object; A display module is used to display the second image; When the first image is an astronomical image, the first determining module is used to: If the astronomical image includes a target object, and the target object is an astronomical object, then obtain the category information and descriptive information of the target object. The first acquisition module includes: The calculation unit is used by the smart glasses to calculate the actual azimuth and altitude information of the astronomical object based on the position information of the astronomical object in the first image, the geographical location information of the smart glasses, the attitude information of the smart glasses, and the current time information. The first determining unit is used by the smart glasses to determine the identification information of the astronomical object based on the actual azimuth and altitude information of the astronomical object, wherein the identification information of the astronomical object includes the name of the astronomical object; The acquisition unit is used by the smart glasses to acquire the introductory information of the astronomical object based on the identification information of the astronomical object; The control device for the smart glasses also includes: The second acquisition module is used to acquire scene information of the first image; The first determination module is used for: Based on the category information of the target object and the scene information of the first image, target display information that matches both the category information of the target object and the scene information of the first image is determined.
7. An electronic device, characterized in that, It includes a processor, a memory, and a program or instructions stored in the memory and executable on the processor, wherein the program or instructions, when executed by the processor, implement the steps of the method as described in any one of claims 1 to 5.
8. A readable storage medium, characterized in that, The readable storage medium stores a program or instructions that, when executed by a processor, implement the steps of the method as described in any one of claims 1 to 5.
Citation Information
Patent Citations
Information prompting method and device, storage medium and electronic equipment
CN112733620A