Intelligent glasses interactive display method, intelligent glasses, medium and program product

Abstract

The embodiment of the invention discloses a smart glasses interactive display method, smart glasses, a medium and a program product. Comprising the steps of receiving a preloaded texture pattern transmitted by a mobile terminal when pairing with the mobile terminal is successful, and caching the preloaded texture pattern; when a call switching instruction is received, calling the pre-loaded texture pattern from the cache, rendering the pre-loaded texture pattern, and displaying the rendered pre-loaded texture pattern at a fixed position of an interface; wherein the pre-loaded texture pattern is a texture corresponding to a fixed or common element in the display interface. In the embodiment of the invention, only the variable content which is different from the common elements of the background and the fixed position in the interface display, can change during each display and needs to be acquired in real time by the mobile terminal or the cloud is acquired, so that the bandwidth waste is reduced, the data transmission quantity is reduced, and the interface display efficiency is improved. The occupation of the storage space of the intelligent glasses is reduced, and the use requirements of the user for the intelligent glasses with different computing capabilities and storage capacities can be fully met.

Description

Technical Field

[0001] This invention relates to the field of smart glasses technology, and in particular to a smart glasses interactive display method, smart glasses, media, and program products. Background Technology

[0002] With the continuous development of smart glasses technology, smart glasses have become an essential tool in people's lives. To meet people's needs, most smart glasses come pre-installed with a large number of applications. However, the inherent data of these applications consumes a significant amount of storage space on smart glasses, and the cache generated during application use further consumes storage space, affecting the storage and operating speed of smart glasses and reducing the user experience.

[0003] Even with current collaboration between mobile devices and smart glasses, where the main processing is done on the mobile device and the interface is only displayed on the smart glasses to minimize storage space usage, directly transmitting all display data to the cloud results in a large data transfer volume. Furthermore, unchanging information within the display data, such as the interface background, consumes significant bandwidth, leading to higher latency in the smart glasses interface. Conversely, using all background information locally on the smart glasses still consumes considerable storage space, hindering the optimization of the user experience. Summary of the Invention

[0004] This invention provides a smart glasses interactive display method, smart glasses, media, and program products. It preloads fixed or frequently used elements of the smart glasses' display interface into the smart glasses' cache. This eliminates the need for the smart glasses to acquire resources from the mobile terminal or cloud when displaying a corresponding interface; instead, it only needs to transmit the variable content of the interface, reducing bandwidth waste, lowering data transmission volume, and improving interface display efficiency. Furthermore, since the entire display interface is not preloaded, it reduces the storage space occupied by the smart glasses themselves, fully adapting to users' needs for smart glasses with different computing capabilities and storage capacities.

[0005] In a first aspect, embodiments of the present invention provide an interactive display method for smart glasses, applied to smart glasses, comprising:

[0006] When successfully paired with a mobile terminal, the system receives a preloaded texture pattern transmitted by the mobile terminal and caches the preloaded texture pattern.

[0007] When a switching instruction is received, a preloaded texture pattern is retrieved from the cache, and the preloaded texture pattern is rendered and displayed in a fixed position on the interface.

[0008] Among them, the preloaded texture patterns are the textures corresponding to fixed or frequently used elements in the display interface.

[0009] Secondly, embodiments of the present invention also provide smart glasses, the smart glasses comprising:

[0010] At least one processor;

[0011] and memory that is communicatively connected to at least one processor;

[0012] The memory stores a computer program that can be executed by at least one processor, which is then executed by the at least one processor to enable the at least one processor to perform the smart glasses interactive display method provided in any of the above embodiments.

[0013] Thirdly, embodiments of the present invention also provide a storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to perform the smart glasses interactive display method provided in any of the above embodiments.

[0014] Fourthly, embodiments of the present invention also provide a computer program product, including a computer program that, when executed by a processor, implements the smart glasses interactive display method provided in any of the above embodiments.

[0015] This invention provides an interactive display method for smart glasses, smart glasses, a medium, and a program product, including: when successfully paired with a mobile terminal, receiving a preloaded texture pattern transmitted by the mobile terminal and caching the preloaded texture pattern; when receiving a call switching command, calling the preloaded texture pattern from the cache, rendering the preloaded texture pattern, and displaying it at a fixed position on the interface; wherein the preloaded texture pattern is a texture corresponding to a fixed or frequently used element in the display interface. By adopting the above technical solution, when the smart glasses are successfully paired with the mobile terminal, the pre-loaded texture patterns corresponding to fixed or frequently used elements in the interface to be displayed by the smart glasses are transmitted from the mobile terminal to the smart glasses and cached by the smart glasses. This allows the smart glasses to directly call the cached pre-loaded texture patterns when the calling conditions are met. After only simple rendering of the pre-loaded texture patterns, the corresponding button images can be displayed in fixed positions on the interface. This eliminates the need for the mobile terminal or cloud to acquire all the resources required for displaying the corresponding interface each time. Instead, the smart glasses only need to acquire the variable content that differs from the background and frequently used elements in fixed positions, which may change with each display and require real-time acquisition by the mobile terminal or cloud. This reduces bandwidth waste, lowers data transmission volume, and improves interface display efficiency. At the same time, since the entire display screen is not pre-loaded, the storage space occupied by the smart glasses themselves is reduced, which can fully adapt to the user needs of smart glasses with different computing power and storage capacity.

[0016] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0017] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 This is a flowchart of an interactive display method for smart glasses provided in Embodiment 1 of the present invention;

[0019] Figure 2 This is an example diagram of a mobile terminal display interface provided in Embodiment 1 of the present invention;

[0020] Figure 3 This is an example diagram of a smart glasses display interface provided in Embodiment 1 of the present invention;

[0021] Figure 4 This is a flowchart of an interactive display method for smart glasses provided in Embodiment 2 of the present invention;

[0022] Figure 5 This is a schematic diagram of the structure of an intelligent glasses interactive display device provided in Embodiment 3 of the present invention;

[0023] Figure 6 This is a schematic diagram of the structure of a smart glasses provided in Embodiment 4 of the present invention. Detailed Implementation

[0024] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0025] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0026] Example 1

[0027] Figure 1 This is a flowchart of an interactive display method for smart glasses provided in Embodiment 1 of the present invention. This embodiment of the present invention can be applied to situations in which fixed positions or commonly used elements within the interface are quickly rendered and displayed during the display of the smart glasses interface in order to improve the efficiency of the interface interactive display. This method can be executed by the smart glasses.

[0028] like Figure 1 As shown, this embodiment of the invention provides a smart glasses interactive display method, which specifically includes the following steps:

[0029] S101. When pairing with a mobile terminal is successful, receive the preloaded texture pattern transmitted by the mobile terminal and cache the preloaded texture pattern.

[0030] Among them, the preloaded texture patterns are the textures corresponding to fixed or frequently used elements in the display interface.

[0031] In this embodiment, the mobile terminal can be specifically understood as an electronic device that is matched and connected to the smart glasses, used to run software to process data, and manage the content displayed on the smart glasses. Optionally, the mobile terminal can be a mobile phone, tablet, etc., which may run a smart glasses display management interface or management software. Users can manage the smart glasses (such as adding, deleting, or hiding them) through control operations on the mobile terminal, and can also control the display content of the smart glasses through control operations on the mobile terminal. This embodiment of the invention does not limit this.

[0032] In this embodiment, successful pairing can be specifically understood as the smart glasses and the mobile terminal switching from a state of disconnected communication to a state of communication connection.

[0033] In some examples, smart glasses may receive pre-loaded texture patterns transmitted from a mobile terminal upon successful initial pairing.

[0034] In this embodiment, successful initial pairing can be understood as the smart glasses successfully pairing with the mobile terminal for the first time when preset conditions are met. These preset conditions can be time-related or other conditions, and this embodiment of the invention does not impose any limitations on them.

[0035] For example, the time condition could be that the first successful pairing between the smart glasses and the mobile terminal after a preset time threshold is exceeded is considered a successful first pairing. Optionally, the preset time threshold can be set according to actual needs, such as 3 days, 5 days, and 7 days. The preset time threshold can be set according to user preferences or the update frequency of the device system. The setting method can be manual or automatic, and this embodiment of the invention does not limit this.

[0036] In one embodiment, successful pairing with a mobile terminal includes: successful pairing with the mobile terminal for the first time after a preset time threshold has been exceeded.

[0037] In this embodiment of the invention, by using a method where the smart glasses receive a pre-loaded texture pattern transmitted by the mobile terminal upon successful initial pairing, the interface display content detection that the smart glasses need to perform every time they are successfully paired with the mobile terminal can be avoided. This is because within a preset time threshold, there is only a very small probability that the user has modified the interface or updated the software. Therefore, this setting can eliminate the detection step during the process of launching the interface each time the smart glasses are successfully paired with the mobile terminal, thereby improving the interface response efficiency of the smart glasses and thus enhancing the user experience.

[0038] In this embodiment, the preloaded texture pattern can be understood as texture data preloaded into the smart glasses, generated by the mobile terminal rendering the graphic or icon elements that need to be rendered in the interface to be displayed by the smart glasses. For example, the graphic or icon elements corresponding to the preloaded texture pattern can be software icons or indicator icons that are permanently located in a fixed position in the interface to be displayed by the smart glasses, or software icons or indicator icons commonly used in the software supported by the mobile terminal that need to be displayed in the smart glasses, such as icons for taking photos, translating, and playing music. Each texture pattern can be assigned a unique identifier during storage for subsequent calling, querying, and deletion. This embodiment of the invention does not impose any limitations on this.

[0039] For example, the elements corresponding to the preloaded texture pattern may include:

[0040] 1) Display elements; such as interface components in the APP management startup display interface, APP application icon, function icons and status labels in the toolbar, etc.

[0041] 2) Interactive elements; that is, the core components that can be clicked to trigger operations, such as buttons, menus, sliders, toggle switches, icon buttons (icons only), text buttons (text only), and graphic buttons, etc.

[0042] 3) Navigation elements; these are the elements that guide users through the interface, such as the menu bar, bottom navigation, breadcrumb navigation, start menu, drop-up menu, and drop-down menu.

[0043] 4) Containers and layout elements; such as dialog boxes and standalone windows.

[0044] Understandably, due to the powerful computing capabilities of mobile terminals, various software can run and be managed on them, resulting in relatively numerous and complex display pages. Each displayed software icon has the function of opening the corresponding software and displaying it on the corresponding screen based on control commands. However, transmitting excessive display page content to smart glasses consumes significant bandwidth and requires the smart glasses to provide more local resources for storage, thus necessitating high-performance processors and heat dissipation capabilities. Therefore, the display interface of smart glasses is often relatively simple, typically not including all software icons supported by the mobile terminal, but only those for some frequently used software. Furthermore, the positions of these icons are often fixed, and the software icons in smart glasses do not function to open applications; they are merely images rendered on the screen. Based on this, the following two figures in this embodiment illustrate the differences between the display interfaces of the mobile terminal and the smart glasses. Figure 2 This is an example diagram of a mobile terminal display interface provided in Embodiment 1 of the present invention. Figure 3 This is an example diagram of a smart glasses display interface provided in Embodiment 1 of the present invention. Wherein, Figure 2 Area 1 indicates that the mobile terminal display interface is used for state management of the smart glasses; Area 2 indicates that the software currently running in the smart glasses is software C; Area 3 indicates that the supported software is A, B, and C. Figure 3 The solid line in the middle is used to represent and Figure 2 The corresponding software A, B, and C are shown in the diagram, and the icon D, which is indicated by the dotted line, is the indicator icon.

[0045] Understandably, since the preloaded texture pattern will be displayed in a fixed position on the interface after rendering, the smart glasses do not need to obtain additional position instructions from the mobile terminal each time, which further reduces the amount of data transmission between the mobile terminal and the smart glasses.

[0046] Specifically, when smart glasses and a mobile terminal are successfully paired, a communication connection is considered to have been established between them, and data transmission can be performed based on this connection. To facilitate subsequent pairing and use between the smart glasses and the mobile terminal, the mobile terminal can determine the commonly used software and graphic icons that need to be permanently displayed on the smart glasses interface. The mobile terminal renders these elements to obtain preloaded texture patterns, which are then transmitted to the smart glasses for caching. Optionally, when caching the received preloaded texture patterns, the smart glasses can assign a unique identifier to each pattern for subsequent lookup and other processing.

[0047] S102. When receiving a call switching instruction, the preloaded texture pattern is retrieved from the cache, and the preloaded texture pattern is rendered and displayed in a fixed position on the interface.

[0048] In this embodiment, the switching instruction can be specifically understood as an instruction used to trigger the smart glasses to call the preloaded texture pattern stored in the cache and switch the interface to display the graphic or icon element corresponding to the preloaded texture pattern at the corresponding position on the interface.

[0049] Specifically, when the smart glasses receive a switching command, it can be assumed that the smart glasses need to display the interface corresponding to the switching command. At this time, the preloaded texture pattern corresponding to the graphic or icon element to be displayed on the display interface can be retrieved from the cache. Since the data contained in the preloaded texture pattern has been rendered by the mobile terminal, the smart glasses only need to perform simple rendering when re-rendering and displaying it, and can display it in the fixed position required by the interface. This reduces the rendering difficulty and the amount of data that needs to be received by the mobile terminal, and improves the interface display speed.

[0050] In some examples, the mobile terminal will perform full-process rendering of the original visual attributes of the raw data corresponding to the preloaded texture pattern. This may include the generation of basic texture data (such as shape outline, color filling, and material texture simulation (such as metallic luster and glass transparency effects), etc.), and may also include preset dynamic interactive functions, hover highlighting, and click / press deformation logic. When the smart glasses receive the preloaded texture pattern, they are essentially receiving texture data that has already been processed by the mobile terminal. They only need to "paste" the preloaded texture pattern to a fixed position according to the layout of the interface to be displayed. The result is only rendering so that it can be displayed in the corresponding position. The amount of data to be rendered is far less than the amount of data to be rendered by the mobile terminal.

[0051] The technical solution of this embodiment involves receiving a pre-loaded texture pattern transmitted by the mobile terminal when the smart glasses are successfully paired with the mobile terminal, and caching the pre-loaded texture pattern. When a call switching command is received, the pre-loaded texture pattern is called from the cache, rendered, and displayed at a fixed position on the interface. The pre-loaded texture pattern corresponds to a fixed or frequently used element in the display interface. By adopting the above technical solution, when the smart glasses are successfully paired with the mobile terminal, the pre-loaded texture pattern corresponding to the fixed or frequently used element in the display interface required by the smart glasses is transmitted from the mobile terminal to the smart glasses and cached by the smart glasses. This allows the smart glasses to directly call the cached pre-loaded texture pattern when the calling conditions are met. Only a simple rendering process is needed to display the corresponding button image at a fixed position on the interface. This eliminates the need for the mobile terminal or cloud to acquire all the necessary display resources when a corresponding interface needs to be displayed. Instead, the smart glasses only need to acquire variable content that differs from the background and frequently used elements in the fixed position, which may change with each display and requires real-time acquisition by the mobile terminal or cloud. This reduces bandwidth waste, lowers data transmission volume, and improves interface display efficiency. Meanwhile, since the overall display screen is not preloaded, the storage space occupied by the smart glasses themselves is reduced, which can fully adapt to the user's needs for smart glasses with different computing power and storage capacity.

[0052] Example 2

[0053] Figure 4 This is a flowchart of an interactive display method for smart glasses provided in Embodiment 2 of the present invention. Based on the above-mentioned optional technical solutions, this embodiment further optimizes the method by obtaining a call-switching command sent from the mobile terminal to the smart glasses after the smart glasses have completed the pre-loading of texture patterns. Alternatively, the call-switching command can be triggered by the smart glasses themselves, causing the smart glasses to call the cached pre-loaded texture patterns. The called pre-loaded texture patterns are then rendered and displayed on the smart glasses' display interface. This achieves dual-end control of the smart glasses' display interface, enriching the user's interactive options and allowing users to select appropriate triggering conditions based on different usage scenarios to switch the smart glasses' display interface, thus improving operational flexibility and interactive experience.

[0054] like Figure 4 As shown in the figure, an intelligent glasses interactive display method provided by an embodiment of the present invention specifically includes the following steps:

[0055] S201. When the pairing with the mobile terminal is successful for the first time after exceeding the preset time threshold, the preloaded texture pattern transmitted by the mobile terminal is received and the preloaded texture pattern is cached.

[0056] Among them, the preloaded texture patterns are the textures corresponding to fixed or frequently used elements in the display interface.

[0057] Optionally, receiving a preloaded texture pattern transmitted by the mobile terminal includes:

[0058] Based on the interface switching command triggered by the user on the mobile terminal during the last successful pairing, the system receives the preloaded texture pattern transmitted from the mobile terminal after the mobile terminal obtains the interface switching requirement information according to the interface switching command and generates a preloaded texture pattern based on the interface switching requirement information; or

[0059] Based on the interface switching command triggered by the user on the smart glasses during the last successful pairing, the interface switching command is sent to the mobile terminal. The mobile terminal responds to the interface switching command, receives the interface switching requirement information, generates a preloaded texture pattern based on the interface switching requirement information, and then receives the preloaded texture pattern transmitted from the mobile terminal; or

[0060] Based on the preloaded texture pattern preset by the user in the mobile terminal before this pairing was successful, the system receives the preloaded texture pattern transmitted by the mobile terminal.

[0061] In this embodiment, the interface switching instruction can be understood as an instruction given by the user to indicate that the user has a need to switch the display interface of the smart glasses.

[0062] In this embodiment, the interface switching requirement information can be specifically understood as information determined based on the interface switching instruction, indicating the user's requirement for the smart glasses to switch to a specific interface.

[0063] In some examples, when the smart glasses were last successfully paired with the mobile terminal, the mobile terminal may have received an interface switching command triggered by the user during that process. This indicates that the user may have a switching requirement corresponding to the interface switching command in subsequent displays on the smart glasses. At this time, the mobile terminal can determine the specific interface switching requirement the user wants the smart glasses to switch to based on the interface switching command, and determine the texture corresponding to fixed or frequently used elements in the interface to be switched to, as a pre-loaded texture pattern. Then, when the smart glasses are successfully paired with the mobile terminal again, the smart glasses can receive the pre-loaded texture pattern transmitted by the mobile terminal that corresponds to the user's requirement during the previous successful pairing.

[0064] In some examples, when the smart glasses were successfully paired with the mobile terminal last time, the user could trigger the smart glasses during this process, allowing the smart glasses to receive the user's interface switching command. This triggering can be achieved through specific eye-tracking behavior, external triggering hardware set on the smart glasses, etc., and this embodiment of the invention does not limit this. After receiving the interface switching command, the smart glasses can send it to the mobile terminal. At this time, the mobile terminal can determine the specific interface switching requirement information that the user wants the smart glasses to switch to based on the interface switching command, and determine the texture corresponding to the fixed or frequently used elements in the interface to be switched to as a preloaded texture pattern. Then, when the smart glasses are successfully paired with the mobile terminal this time, the smart glasses can receive the preloaded texture pattern transmitted by the mobile terminal that corresponds to the user's requirement when the pairing was successful last time.

[0065] In some examples, before the mobile terminal is paired with the smart glasses, the user can use the app on the mobile terminal to manage the smart glasses to pre-set the pre-loaded texture pattern that needs to be transmitted to the smart glasses. Then, when the smart glasses are successfully paired with the mobile terminal, the smart glasses can receive the pre-loaded texture pattern transmitted from the mobile terminal.

[0066] S202. When receiving a call switching instruction, the preloaded texture pattern is retrieved from the cache, and the preloaded texture pattern is rendered and displayed in a fixed position on the interface.

[0067] Specifically, when the smart glasses receive a switching command, it can be assumed that the smart glasses need to switch the currently displayed interface in response to the switching command. The preloaded texture pattern corresponding to the graphic or icon element to be displayed in the interface to which it needs to switch is retrieved from the cache. Since the data contained in the preloaded texture pattern has been rendered by the mobile terminal, the smart glasses only need to perform simple rendering when re-rendering and displaying it. It can then be displayed in the fixed position required by the interface, completing the display of relatively fixed content in the interface to which it needs to switch. In this way, the smart glasses only need to receive dynamic data information that will change dynamically within the smart glasses' display interface from the mobile terminal, and display the received dynamic data information in the corresponding position in the interface to which it needs to switch according to the preset display requirements. This reduces the rendering difficulty of the smart glasses when switching interfaces and the amount of data that needs to be received by the mobile terminal, thereby improving the interface switching and display speed.

[0068] For example, dynamic data information can be the specific translation content displayed in the translation area of ​​the translation software interface on the smart glasses. This translation content will change dynamically depending on the object to be translated. Therefore, the smart glasses will be dynamically received by the mobile terminal from this dynamically changing information.

[0069] Optionally, receive a switching instruction, including:

[0070] After receiving a user-triggered interface switching command on the mobile terminal, and generating a switching command based on the interface switching command, the system receives the switching command transmitted by the mobile terminal; or

[0071] Receives a user-triggered interface switching command and sends it to the mobile terminal. After the mobile terminal generates a switching command based on the interface switching command, it receives the switching command transmitted from the mobile terminal; or

[0072] The user triggers a call to switch instructions based on the received user information.

[0073] Specifically, the call-switching command received by the smart glasses can be a command sent by the mobile terminal, or a command generated by the smart glasses themselves based on external triggers. In this embodiment of the invention, the source of the call-switching command is illustrated in the following three ways:

[0074] 1) When the mobile terminal receives an active trigger from the user regarding the interface displayed on it, such as... Figure 2 When a user taps an icon on the interface shown, it can be assumed that the mobile terminal needs to open and run the corresponding software and display its interface on the smart glasses. In other words, the smart glasses need to be triggered to switch the displayed interface to the interface corresponding to the software running on the smart glasses. At this time, the mobile terminal can generate a corresponding call switching command based on the interface switching command triggered by the user and send the call switching command to the smart glasses.

[0075] 2) When the smart glasses receive an external trigger from the user and determine that the current display interface needs to be switched, such as when the user triggers the smart glasses to indicate that a new software needs to be called, the smart glasses will actively send the interface switching command received by the user to the mobile terminal. This allows the mobile terminal to respond to the received interface switching command and run the corresponding software. At the same time, the mobile terminal will generate a call switching command corresponding to the interface to be switched to, and send the call switching command to the smart glasses.

[0076] 3) When the smart glasses receive an external trigger from the user and determine that it needs to switch its current display interface, such as when the user triggers the smart glasses to indicate that they need to exit the secondary interface and return to the main interface, or when the user triggers the smart glasses to indicate that they have finished wearing the glasses and need to display the main interface, the smart glasses can generate a switching command based on the user's trigger, and then perform cache calls and texture pattern rendering based on the switching command to achieve interface switching.

[0077] Understandably, software calls, execution, calculations, and icon rendering all require significant computing power and hardware support, resulting in substantial power consumption. Since all of these processing steps occur on the smart glasses, the smart glasses only invoke pre-loaded textures corresponding to the call / switching commands when they are received, and receive relevant commands when the interface changes. Simultaneously, they can collect and display data from sensors on the smart glasses themselves (such as device temperature, body temperature, heart rate, three-axis acceleration, battery level, and volume). This reduces the hardware requirements for the smart glasses themselves, avoids bandwidth waste between the smart glasses and the mobile terminal, and allows for more comprehensive adaptation to users' needs for smart glasses with varying computing capabilities and storage capacities.

[0078] Optional external triggering methods include at least one of the following:

[0079] Triggered by sensor signals detected by the sensors in the smart glasses;

[0080] It is triggered by the trigger signal from the external trigger button on the smart glasses.

[0081] Specifically, smart glasses can be equipped with various sensors for spatial sensing and interaction functions. For example, sensors on the smart glasses can collect sensor signals, which can then be analyzed by the smart glasses or a mobile terminal to track the user's head movements. Since different head movements correspond to different interface display requirements—such as switching the smart glasses from a screen-off state to a screen-on state by looking up, or determining the selected software operation by the number of consecutive head nods—the sensor signals detected by the smart glasses' sensors can be used as one of the external triggers for generating the switching command in this embodiment of the invention.

[0082] Specifically, the smart glasses can also be equipped with buttons that can be directly triggered by pressing them. Users can generate trigger signals by pressing the buttons to indicate different interface display needs. For example, double-clicking the button indicates that the user needs to exit the current display interface and return to the previous display interface. When the user selects the icon corresponding to a certain software in the current display interface through gaze point analysis, clicking the button on the smart glasses indicates that the user has selected the software, and the mobile terminal needs to launch the software and display the corresponding interface on the smart glasses. This embodiment of the invention does not limit this.

[0083] In some examples, to more clearly describe the interaction between the mobile terminal and the smart glasses, their architectures can be described separately. The mobile terminal may include a control layer for managing device connection status and application launch logic, and a layer for managing sensor data (such as Inertial Measurement Unit (IMU) or battery data) and multimedia data (images / audio) from the smart glasses. The smart glasses may include a hardware abstraction layer for encapsulating underlying hardware interfaces (such as optical engines, cameras, microphones, or speakers), a communication layer for enabling bidirectional data transmission with the mobile terminal, a rendering engine for drawing interface elements (text and images), a sensor management layer for acquiring or processing IMU data and head posture data, and a UI layer for displaying the main interface and secondary function interfaces, and receiving user gesture / button input.

[0084] Following the example above, based on the above architecture, when the smart glasses and the mobile terminal are successfully paired for the first time, the mobile terminal can preload a texture pattern (such as CAMERA_BUTTON_ID) to the smart glasses via sendPreloadBitmap(id,byte[]), and the smart glasses can cache the texture pattern.

[0085] Following the example above, when the mobile terminal determines that a certain software has been selected to be launched and the smart glasses need to switch to the corresponding interface, it can send a sendPage(0) to the smart glasses. The smart glasses read the preloaded texture pattern from the cache through displayCachedBitmap(id,width,height,x,y,type) and display the cached button after rendering, without the mobile terminal repeatedly transmitting the data related to the button display.

[0086] Following the example above, when displaying the interface corresponding to a certain software in smart glasses, it can be considered that what the smart glasses are displaying is a secondary interface. At this time, the smart glasses can receive the display interface switching command sent by the mobile terminal, or sense or receive the trigger of the display interface switching command sent by the user to exit the secondary interface and return to display the main interface. Here, we take the method of the user actively triggering the external button of the smart glasses as an example. The user can double-click the external button of the smart glasses to trigger the sendPage(0) command, so that the smart glasses clear the current interface and call the cache to quickly render the main interface.

[0087] Following the example above, users can also select the software to be launched in the smart glasses. For example, they can trigger the highlighting of the sliding switch button on the main interface displayed by the smart glasses, and click to send the sendButton(id) corresponding to the highlighted button to the mobile terminal. This allows the mobile terminal to launch the corresponding application based on sendButton(id) and sendSendPage(1) corresponding to the application interface to the smart glasses, so that the smart glasses can call the cache and jump to the secondary interface. The switch button can be an element displayed in the smart glasses display interface, highlighted or displayed in other forms, which can be clicked by the user to trigger the corresponding function.

[0088] Following the example above, users can also launch the application directly on the mobile terminal, and the mobile terminal will send the sendPage(1) corresponding to the application interface to the smart glasses, so that the smart glasses will respond to the sendPage(1) call cache to jump to the secondary interface.

[0089] Optionally, to further save storage space in smart glasses, the smart glasses interactive display method provided in this embodiment of the invention further includes:

[0090] When a software or display style corresponding to a preloaded texture pattern is deleted on a mobile device, the preloaded texture pattern in the cache is also deleted.

[0091] Specifically, when the software or display style corresponding to the preloaded texture pattern is deleted on the mobile terminal, it can be assumed that the software or display style corresponding to the preloaded texture pattern will no longer be used in subsequent use, that is, there is no need to display it to the user in the smart glasses. At this time, the preloaded texture pattern in the smart glasses cache can be deleted synchronously to save the storage space of the smart glasses.

[0092] Optionally, to further save storage space in smart glasses, the smart glasses interactive display method provided in this embodiment of the invention further includes:

[0093] Monitor the call frequency of preloaded texture patterns and delete the preloaded texture patterns in the cache when the call frequency meets the preset cleanup conditions.

[0094] The preset cleanup condition is that the call frequency is lower than a preset frequency threshold.

[0095] Specifically, during the use of smart glasses, in order to save the space occupied by the cache, the calling frequency of each preloaded texture pattern stored in the cache can be monitored. When some preloaded texture patterns are not called for a preset time, or when the calling frequency is lower than the preset frequency threshold within a certain period of time, it can be considered that the element corresponding to the preloaded texture pattern is no longer a commonly used element. At this time, the preloaded texture pattern in the cache can be deleted.

[0096] Optionally, to further save storage space in smart glasses, the smart glasses interactive display method provided in this embodiment of the invention further includes:

[0097] When the smart glasses are updated, the cache is cleared and the preloaded texture pattern transmitted by the mobile terminal is received again, and the preloaded texture pattern is cached.

[0098] Specifically, since the software supported by smart glasses may change when the version is updated, and the version update itself has the function of cleaning up and integrating the content of the previous version, the old cache of the smart glasses can be cleared first, and the preloaded texture pattern can be re-received from the connected mobile terminal after the version update is completed. The newly received preloaded texture pattern can be cached to support the use of the smart glasses after the version update.

[0099] Optionally, before pairing the smart glasses with the mobile terminal, the elements corresponding to the texture pattern to be preloaded to the smart glasses can be pre-set through the launcher APP on the mobile terminal used to configure the smart glasses. Then, when the smart glasses and the mobile terminal are successfully paired, the preloaded texture pattern can be sent from the mobile terminal to the smart glasses.

[0100] The technical solution of this embodiment, after the smart glasses complete the pre-loading of texture pattern caching, obtains the call switching command sent by the mobile terminal to the smart glasses, or the call switching command is triggered by the smart glasses themselves, triggering the smart glasses to call the cached pre-loaded texture pattern, and renders the called pre-loaded texture pattern on the smart glasses' display interface, realizing dual-end control of the smart glasses' display interface, enriching the user's interactive choices, allowing users to select appropriate trigger conditions according to different usage scenarios to complete the switching trigger of the smart glasses' display interface, improving operational flexibility and interactive experience.

[0101] Example 3

[0102] Figure 5 This is a schematic diagram of the structure of an interactive display device for smart glasses provided in Embodiment 3 of the present invention, as shown below. Figure 5 As shown, the smart glasses interactive display device includes a texture preloading module 31 and a rendering display module 32.

[0103] The texture preloading module 31 is used to receive the preloaded texture pattern transmitted by the mobile terminal when the pairing is successful, and to cache the preloaded texture pattern; the rendering and display module 32 is used to call the preloaded texture pattern from the cache when the call switching instruction is received, and to render the preloaded texture pattern and display it at a fixed position on the interface; wherein the preloaded texture pattern is the texture corresponding to fixed or commonly used elements in the display interface.

[0104] The technical solution of this invention, when the smart glasses are successfully paired with the mobile terminal, transmits pre-loaded texture patterns corresponding to fixed or frequently used elements in the interface to be displayed by the smart glasses from the mobile terminal to the smart glasses, where the smart glasses cache these patterns. This allows the smart glasses to directly call the cached pre-loaded texture patterns when the calling conditions are met. Only simple rendering of the pre-loaded texture patterns is needed to display the corresponding button images in fixed positions on the interface. This eliminates the need for the mobile terminal or cloud to acquire all necessary display resources when a corresponding interface needs to be displayed. Instead, it only needs to acquire variable content that differs from the background and frequently used elements in fixed positions, which may change with each display and require real-time acquisition by the mobile terminal or cloud. This reduces bandwidth waste, lowers data transmission volume, and improves interface display efficiency. Furthermore, since the entire display interface is not pre-loaded, the storage space occupied by the smart glasses is reduced, making it more suitable for users with different computing capabilities and storage capacities.

[0105] Optionally, receiving a preloaded texture pattern transmitted by the mobile terminal includes:

[0106] Based on the interface switching command triggered by the user on the mobile terminal during the last successful pairing, the system receives the preloaded texture pattern transmitted from the mobile terminal after the mobile terminal obtains the interface switching requirement information according to the interface switching command and generates a preloaded texture pattern based on the interface switching requirement information; or

[0107] Based on the interface switching command triggered by the user on the smart glasses during the last successful pairing, the interface switching command is sent to the mobile terminal. The mobile terminal responds to the interface switching command, receives the interface switching requirement information, generates a preloaded texture pattern based on the interface switching requirement information, and then receives the preloaded texture pattern transmitted from the mobile terminal; or

[0108] Based on the preloaded texture pattern preset by the user in the mobile terminal before this pairing was successful, the system receives the preloaded texture pattern transmitted by the mobile terminal.

[0109] Optionally, successful pairing with a mobile terminal includes:

[0110] The pairing with the mobile terminal was successful for the first time after exceeding the preset time threshold.

[0111] Optionally, receive a switching instruction, including:

[0112] After receiving a user-triggered interface switching command on the mobile terminal, and generating a switching command based on the interface switching command, the system receives the switching command transmitted by the mobile terminal; or

[0113] Receives a user-triggered interface switching command and sends it to the mobile terminal. After the mobile terminal generates a switching command based on the interface switching command, it receives the switching command transmitted from the mobile terminal; or

[0114] The user triggers a call to switch instructions based on the received user information.

[0115] Optionally, the smart glasses interactive display device further includes: a first deletion module, used to delete the preloaded texture pattern in the cache when the mobile terminal deletes the software or display style corresponding to the preloaded texture pattern.

[0116] Optionally, the smart glasses interactive display device further includes: a second deletion module, used to monitor the calling frequency of preloaded texture patterns, and delete the preloaded texture patterns in the cache when the calling frequency meets a preset cleanup condition; wherein, the preset cleanup condition is that the calling frequency is lower than a preset frequency threshold.

[0117] Optionally, the smart glasses interactive display device also includes: a third deletion module, used to clear the cache and re-receive the preloaded texture pattern transmitted by the mobile terminal when the smart glasses are updated, and to cache the preloaded texture pattern.

[0118] The smart glasses interactive display device provided in this embodiment of the invention can execute the smart glasses interactive display method provided in any embodiment of the invention, and has the corresponding functional modules and beneficial effects of executing the method.

[0119] Example 4

[0120] Figure 6 This is a schematic diagram of the structure of a smart glasses according to Embodiment 4 of the present invention. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the invention described and / or claimed herein.

[0121] like Figure 6 As shown, the smart glasses 40 includes at least one processor 41 and a memory, such as a read-only memory (ROM) 42 and a random access memory (RAM) 43, communicatively connected to the at least one processor 41. The memory stores computer programs executable by the at least one processor. The processor 41 can perform various appropriate actions and processes based on the computer program stored in the ROM 42 or loaded from storage unit 48 into the RAM 43. The RAM 43 can also store various programs and data required for the operation of the smart glasses 40. The processor 41, ROM 42, and RAM 43 are interconnected via a bus 44. An input / output (I / O) interface 45 is also connected to the bus 44.

[0122] Multiple components in the smart glasses 40 are connected to the I / O interface 45, including: an input unit 46, such as a button, a touchscreen, etc.; an output unit 47, such as various types of displays, speakers, etc.; a storage unit 48, such as a disk, optical disk, etc.; and a communication unit 49, such as a network card, modem, wireless transceiver, etc. The communication unit 49 allows the smart glasses 40 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0123] Processor 41 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 41 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 41 performs the various methods and processes described above, such as the interactive display method for smart glasses.

[0124] In some embodiments, the smart glasses interactive display method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 48. In some embodiments, part or all of the computer program may be loaded and / or installed on the smart glasses 40 via ROM 42 and / or communication unit 49. When the computer program is loaded into RAM 43 and executed by processor 41, one or more steps of the smart glasses interactive display method described above may be performed. Alternatively, in other embodiments, processor 41 may be configured to perform the smart glasses interactive display method by any other suitable means (e.g., by means of firmware).

[0125] Optionally, embodiments of the present invention also provide a computer program product, including a computer program that, when executed by a processor, implements the smart glasses interactive display method provided in any embodiment of the present invention.

[0126] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0127] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0128] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0129] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0130] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0131] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0132] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0133] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A smart glasses interactive display method, characterized in that, Applications in smart glasses include: When pairing with a mobile terminal is successful, the system receives a preloaded texture pattern transmitted by the mobile terminal and caches the preloaded texture pattern. When a switching instruction is received, the preloaded texture pattern is retrieved from the cache, rendered, and displayed at a fixed position on the interface. The preloaded texture pattern is the texture corresponding to a fixed or commonly used element in the display interface.

2. The smart glasses interactive display method according to claim 1, characterized in that, Receiving the preloaded texture pattern transmitted by the mobile terminal includes: Based on the interface switching command triggered by the user on the mobile terminal during the last successful pairing, after the mobile terminal obtains the interface switching requirement information according to the interface switching command and generates the preloaded texture pattern according to the interface switching requirement information, it receives the preloaded texture pattern transmitted by the mobile terminal. or Based on the interface switching command triggered by the user on the smart glasses during the last successful pairing, the interface switching command is sent to the mobile terminal. After the mobile terminal responds to the interface switching command, obtains the interface switching requirement information, and generates the preloaded texture pattern based on the interface switching requirement information, the preloaded texture pattern transmitted by the mobile terminal is received. or Based on the preloaded texture pattern preset by the user in the mobile terminal before this pairing was successful, the system receives the preloaded texture pattern transmitted by the mobile terminal.

3. The smart glasses interactive display method according to claim 1, characterized in that, The successful pairing with the mobile terminal includes: The pairing with the mobile terminal was successful for the first time after exceeding a preset time threshold.

4. The smart glasses interactive display method according to claim 1, characterized in that, The receiving of the switching instruction includes: After the mobile terminal receives the user-triggered interface switching instruction and generates a call switching instruction based on the interface switching instruction, it receives the call switching instruction transmitted by the mobile terminal. or The system receives a user-triggered interface switching command and sends the interface switching command to the mobile terminal. After the mobile terminal generates a call switching command based on the interface switching command, the system receives the call switching command transmitted by the mobile terminal. or The user triggers a call to switch instructions based on the received user information.

5. The smart glasses interactive display method according to claim 1, characterized in that, Also includes: When the mobile terminal deletes the software or display style corresponding to the preloaded texture pattern, the preloaded texture pattern in the cache is deleted.

6. The smart glasses interactive display method according to claim 1, characterized in that, Also includes: Monitor the call frequency of the preloaded texture pattern, and delete the preloaded texture pattern in the cache when the call frequency meets the preset cleanup conditions; The preset cleanup condition is that the call frequency is lower than a preset frequency threshold.

7. The smart glasses interactive display method according to claim 1, characterized in that, Also includes: When the smart glasses are updated, the cache is cleared and the preloaded texture pattern transmitted by the mobile terminal is received again, and the preloaded texture pattern is cached.

8. A type of smart glasses, characterized in that, The smart glasses include: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the smart glasses interactive display method according to any one of claims 1-7.

9. A storage medium containing computer-executable instructions, characterized in that, The computer-executable instructions, when executed by a computer processor, are used to perform the smart glasses interactive display method as described in any one of claims 1-7.

10. A computer program product, characterized in that, It includes a computer program that, when executed by a processor, implements the smart glasses interactive display method as described in any one of claims 1-7.

Images