Control method and apparatus for electronic device, and electronic device and readable storage medium
By displaying device icons from the real-world scene on the smart glasses' interactive interface and responding to user input to display the control interface, the problem of cumbersome operation when wearing smart glasses is solved, enabling convenient multi-device control and information processing.
Patent Information
- Application Number
- PCT/CN2025/096453
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-05-28
- Filing Date
- 2025-05-22
- Publication Date
- 2025-12-04
AI Technical Summary
Users often find it difficult to use other devices in real-world scenarios while wearing smart glasses, requiring them to frequently remove and put on the smart glasses for operation, which makes the process cumbersome.
By receiving user input through the interactive interface of smart glasses, displaying electronic device icons in the real-world scene, and responding to input to display the device control interface, the control and operation of electronic devices can be achieved.
Users can operate other devices without removing their smart glasses, improving convenience and efficiency, avoiding cumbersome operations, and ensuring continuity of use and timely processing of important information.
Smart Images

Figure CN2025096453_04122025_PF_FP_ABST
Abstract
Description
Control methods and apparatus for electronic devices, electronic devices and readable storage media
[0001] Cross-reference to related applications
[0002] This application claims priority to Chinese Patent Application No. 202410669387.3, filed on May 28, 2024, entitled "Control Method and Apparatus for Electronic Device, Electronic Device and Readable Storage Medium", the entire contents of which are incorporated herein by reference. Technical Field
[0003] This application belongs to the field of electronic equipment technology, specifically relating to a control method and apparatus for an electronic device, an electronic device, and a readable storage medium. Background Technology
[0004] When using smart glasses, users may find it difficult to clearly identify the interface content of devices in real-world scenarios due to the obstruction of the interactive interface. This makes it difficult for users to use other devices in real-world scenarios while wearing smart glasses.
[0005] Therefore, when wearing smart glasses, users often need to remove the glasses to operate other devices in the real world, complete the relevant operations, and then put the smart glasses back on. This requires users to frequently remove and put on the smart glasses, making the process cumbersome. Summary of the Invention
[0006] In a first aspect, embodiments of this application provide a control method for an electronic device, which is applied to smart glasses. The control method for the electronic device includes: receiving a first input to a first device identifier in the interactive interface of the smart glasses; and responding to the first input by displaying a device control interface of the electronic device corresponding to the first device identifier.
[0007] Secondly, embodiments of this application provide a control device for an electronic device applied to smart glasses. The control device for the electronic device includes: a receiving unit for receiving a first input to a first device identifier in the interactive interface of the smart glasses; and a display unit for displaying the device control interface of the electronic device corresponding to the first device identifier in response to the first input.
[0008] Thirdly, embodiments of this application provide an electronic device including a processor and a memory. The memory stores programs or instructions that can run on the processor. When the programs or instructions are executed by the processor, they implement the steps of the control method of the electronic device as described in the first aspect.
[0009] Fourthly, embodiments of this application provide a readable storage medium storing a program or instructions that, when executed by a processor, implement the steps of the control method for the electronic device as described in the first aspect.
[0010] Fifthly, embodiments of this application provide a chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the steps of the control method for the electronic device as described in the first aspect.
[0011] In a sixth aspect, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the steps of the control method for an electronic device as described in the first aspect.
[0012] The electronic device control method provided in this application is applied to smart glasses. In this method, a first input is received to a first device identifier in the interactive interface of the smart glasses; in response to the first input, the device control interface of the electronic device corresponding to the first device identifier is displayed. Through this electronic device control method, when a user wears smart glasses, the device identifier of the electronic device in the real-world scene is displayed in the interactive interface of the smart glasses. Furthermore, based on the user's input to the device identifier, the device control interface of the electronic device corresponding to the device identifier can be displayed in the interactive interface of the smart glasses. In this way, the user can operate other electronic devices without repeatedly removing or putting on the smart glasses, thus avoiding cumbersome operations when wearing smart glasses. Attached Figure Description
[0013] Figure 1 is a flowchart illustrating the control method of the electronic device provided in an embodiment of this application;
[0014] Figure 2 is a schematic diagram of one of the operation interfaces of the control method of the electronic device provided in the embodiment of this application;
[0015] Figure 3 is a second schematic diagram of the operation interface of the control method of the electronic device provided in the embodiment of this application;
[0016] Figure 4 is a third schematic diagram of the operation interface of the control method of the electronic device provided in the embodiment of this application;
[0017] Figure 5 is a fourth schematic diagram of the operation interface of the control method of the electronic device provided in the embodiment of this application;
[0018] Figure 6 is a fifth schematic diagram of the operation interface of the control method of the electronic device provided in the embodiment of this application;
[0019] Figure 7 is a schematic diagram of the operation interface of the control method of the electronic device provided in the embodiment of this application;
[0020] Figure 8 is a seventh schematic diagram of the operation interface of the control method of the electronic device provided in the embodiment of this application;
[0021] Figure 9 is an eighth schematic diagram of the operation interface of the control method of the electronic device provided in the embodiment of this application;
[0022] Figure 10 is a schematic diagram of the operation interface of the control method of the electronic device provided in the embodiment of this application;
[0023] Figure 11 is a schematic diagram of the operation interface of the control method of the electronic device provided in the embodiment of this application;
[0024] Figure 12 is an eleventh schematic diagram of the operation interface of the control method of the electronic device provided in the embodiment of this application;
[0025] Figure 13 is a schematic diagram of the operation interface of the control method of the electronic device provided in the embodiment of this application;
[0026] Figure 14 is a schematic diagram of the operation interface of the control method of the electronic device provided in the embodiment of this application;
[0027] Figure 15 is a schematic diagram of the operation interface of the control method of the electronic device provided in the embodiment of this application;
[0028] Figure 16 is a schematic diagram of the operation interface of the control method of the electronic device provided in the embodiment of this application;
[0029] Figure 17 is a schematic diagram of the operation interface of the control method of the electronic device provided in the embodiment of this application;
[0030] Figure 18 is a schematic diagram of the operation interface of the control method of the electronic device provided in the embodiment of this application;
[0031] Figure 19 is an eighteenth schematic diagram of the operation interface of the control method of the electronic device provided in the embodiment of this application;
[0032] Figure 20 is a schematic diagram of the operation interface of the control method of the electronic device provided in the embodiment of this application;
[0033] Figure 21 is a structural block diagram of the control device of the electronic device provided in an embodiment of this application;
[0034] Figure 22 is a structural block diagram of the electronic device provided in an embodiment of this application;
[0035] Figure 23 is a schematic diagram of the hardware structure of the electronic device provided in an embodiment of this application. Detailed Implementation
[0036] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.
[0037] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such terms can be used interchangeably where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.
[0038] The control method for the electronic device provided in this application will be described in detail below with reference to the accompanying drawings, through specific embodiments and application scenarios.
[0039] As shown in Figure 1, this application provides a control method for an electronic device, which is applied to smart glasses. The control method for the electronic device may include the following steps S102 and S104:
[0040] S102: Receive a first input for the first device identifier in the interactive interface of the smart glasses.
[0041] The control method for electronic devices proposed in this application is applied to smart glasses.
[0042] The aforementioned interactive interface is a three-dimensional scene, displaying the operation content of the smart glasses themselves. In areas where no content is displayed on the interactive interface, users can view the content of the real scene through the interactive interface.
[0043] Furthermore, the aforementioned first input is a user's touch input to the interactive interface. Specifically, the touch input can be a single click, a long press, a double click, a swipe, or an input along a preset trajectory. Those skilled in the art can set the specific form of the aforementioned first input according to the actual situation, and no specific restrictions are imposed here.
[0044] Furthermore, the first device identifier corresponds to an electronic device in the real-world scenario. The first device identifier may specifically include the device name of the corresponding electronic device, but this is not specifically limited here.
[0045] Furthermore, the aforementioned first device identifier serves as a control switch for establishing a connection between the smart glasses and the electronic device corresponding to the first device identifier. Specifically, the aforementioned first device identifier may further include a connection control for the corresponding electronic device, allowing the user to control the smart glasses to establish a connection with the electronic device corresponding to the first device identifier through touch input on the first device identifier or its connection control.
[0046] S104: In response to the first input, display the device control interface of the electronic device corresponding to the first device identifier.
[0047] The aforementioned device control interface is used by users to control and operate the electronic devices corresponding to the first device identifier.
[0048] Specifically, when a user wears smart glasses, the smart glasses can receive and respond to the user's first input to a first device identifier in the smart glasses' interactive interface, establish a connection with the electronic device corresponding to the first device identifier, and display the device control interface of the electronic device corresponding to the first device identifier within the interactive interface, so that the user can control or operate the electronic device corresponding to the first device identifier through the device control interface. In this way, when a user wears smart glasses, they can choose to display the device control interface of an electronic device in the real-world scene within the smart glasses' interactive interface, and then operate the corresponding electronic device through the device control interface. The user can operate the electronic device in the real-world scene without removing the smart glasses, avoiding cumbersome operations while wearing smart glasses, ensuring the continuity of the user's smart glasses-based task processing, preventing the user from missing important real-time information, improving the convenience and efficiency of switching between different devices, improving the conversion efficiency between device information from different devices, and improving the efficiency of the user operating multiple devices.
[0049] The electronic device control method provided in this application is applied to smart glasses. In this method, a first input is received to a first device identifier in the interactive interface of the smart glasses; in response to the first input, the device control interface of the electronic device corresponding to the first device identifier is displayed. Through this method, when a user wears smart glasses, the device identifier of an electronic device in the real-world scene is displayed in the interactive interface of the smart glasses. Furthermore, based on the user's input to the device identifier, the device control interface of the electronic device corresponding to the device identifier is displayed in the interactive interface of the smart glasses. This projects the device control interface of the electronic device in the real-world scene onto the CGR (Computer Generated Reality) environment of the smart glasses, forming a unified instruction set on the smart glasses. This allows users to operate the smart glasses and other electronic devices without repeatedly removing or putting on the smart glasses, thus avoiding cumbersome operations and improving the efficiency of using different electronic devices while wearing smart glasses.
[0050] In this embodiment of the application, prior to S102, the control method may further include S106 and S108 as follows:
[0051] S106: Receive a second input to the interactive interface of the smart glasses.
[0052] The aforementioned interactive interface is a three-dimensional scene, displaying the operation content of the smart glasses themselves. In areas where no content is displayed on the interactive interface, users can view the content of the real scene through the interactive interface.
[0053] Furthermore, the aforementioned second input is the user's touch input to the interactive interface. Specifically, the second input is the user's touch input to the target control in the interactive interface. The touch input can be a single click, a long press, a double click, a swipe, or an input along a preset trajectory, etc. Those skilled in the art can set the specific form of the aforementioned second input according to the actual situation, and no specific restrictions are made here.
[0054] S108: In response to the second input, display at least one device identifier in the interactive interface of the smart glasses.
[0055] In this context, at least one device identifier corresponds one-to-one with at least one electronic device in the real-world scenario.
[0056] Furthermore, the aforementioned device identifier may specifically include the device name of the corresponding electronic device, without any specific limitations.
[0057] Furthermore, the aforementioned device identifier serves as a control switch for establishing a connection between the smart glasses and electronic devices in the real-world environment. Specifically, the device identifier may also include a connection control for the corresponding electronic device, allowing the user to control the smart glasses to establish a connection with the electronic device corresponding to that device identifier through touch input on the device identifier or its connection control.
[0058] Specifically, in the control method for electronic devices provided in the embodiments of this application, when a user wears smart glasses, the smart glasses can receive a second input from the user to its interactive interface or a target control in the interactive interface. In response to the second input, the smart glasses search for at least one electronic device in the real scene through spatial positioning, and display the device identifier of each electronic device in its interactive interface so that the user can select the corresponding electronic device to establish a connection with the smart glasses.
[0059] For example, as shown in Figure 2, a target control 204 is displayed in the interactive interface 202 of the smart glasses. The smart glasses receive a click input from the user on the target control 204. In response to the click input, as shown in Figure 3, the smart glasses search for at least one electronic device in the real scene through spatial positioning, and display the device identifier 206 of each electronic device above each electronic device in the interactive interface 202.
[0060] The embodiments provided in this application receive a second input to the smart glasses' interactive interface before receiving a first input to a first device identifier in the smart glasses' interactive interface; in response to the second input, at least one device identifier is displayed in the smart glasses' interactive interface. Thus, when a user wears the smart glasses, by displaying the device identifiers of electronic devices in the real-world scene within the smart glasses' interactive interface, the user can select electronic devices to establish a connection with the smart glasses without removing them, improving the user's ease of switching between multiple devices.
[0061] In this embodiment of the application, the display position of each device identifier in the interactive interface matches the spatial position of the electronic device corresponding to the device identifier in the real scene.
[0062] In the control method for an electronic device provided in this application embodiment, during the process of displaying at least one device identifier in the interactive interface of smart glasses, the display position of each device identifier in the interactive interface can be matched with the spatial position of the electronic device corresponding to the device identifier in the real scene. For example, each device identifier can be displayed above the corresponding electronic device so that the user can distinguish the electronic device corresponding to each device identifier.
[0063] In the embodiments provided in this application, the display position of each device identifier in the interactive interface matches the spatial position of the electronic device corresponding to the device identifier in the real-world scene. This makes it easier for users to distinguish the electronic device corresponding to each device identifier, improving the accuracy and convenience for users to control other electronic devices while wearing smart glasses.
[0064] In this embodiment of the application, S104 may specifically include the following S104a and S104b:
[0065] S104a: In response to the first input, if the electronic device corresponding to the first device identifier is a first type of electronic device, the first interface is displayed.
[0066] The first type of electronic device is one that supports screen mirroring, such as smartphones, tablets, and smartwatches. The first interface is the screen mirroring interface of the electronic device.
[0067] Specifically, during the process of the smart glasses displaying the device control interface of the electronic device corresponding to the first device identifier, if the electronic device corresponding to the first device identifier has a screen mirroring function, such as a smartphone, tablet, or smartwatch that supports screen mirroring, the smart glasses display the screen mirroring interface of the electronic device corresponding to the first device identifier within its interactive interface, so that the user can directly view or operate the interface content of the electronic device corresponding to the first device identifier through the screen mirroring interface.
[0068] During the process of displaying the projection interface of the electronic device corresponding to the first device identifier within its interactive interface, the smart glasses first determine whether there is sufficient space within the interactive interface to accommodate the projection interface of the electronic device corresponding to the first device identifier. If sufficient space exists, the smart glasses can place the projection interface of the electronic device corresponding to the first device identifier in a specific arrangement order, such as from left to right or from top to bottom, around other windows in the interactive interface. If insufficient space exists, the smart glasses can float the projection interface of the electronic device corresponding to the first device identifier above other windows in the interactive interface.
[0069] Furthermore, the projection interface of the electronic device corresponding to the first device identifier is placed within the interactive interface. The projection interface of the electronic device corresponding to the first device identifier will be projected onto the interactive interface proportionally and in real time. Users can control and operate the electronic devices in the real-world scene through the projection interface displayed in the interactive interface.
[0070] In practical applications, after the projection interface is displayed in the interactive interface, users can manually adjust the size and position of the projection interface through touch input on the interactive interface, without any specific restrictions.
[0071] Furthermore, during the process of displaying the screen projection interface of the electronic device on the interactive interface, the eighth control, the fourth control, and the device name of the electronic device can also be displayed in the surrounding area of the screen projection interface, such as at the top of the screen projection interface.
[0072] The eighth control is used to hide the projection interface of the electronic device. When the projection interface is hidden, it can be displayed as a floating control within the interactive interface until the user interacts with it. The smart glasses then display the projection interface in its original position and aspect ratio within the interactive interface. The floating control can display the corresponding device icon and name, allowing users to easily identify the specific device associated with each control. The fourth control is used to close the projection interface. Users can disconnect the projection connection between the electronic device and the smart glasses by interacting with the fourth control.
[0073] For example, as shown in FIG3, the interactive interface 202 of the smart glasses displays a first device identifier 208 of the first electronic device 244. The first device identifier 208 includes the device name of the first electronic device 244 and a first connection control 210. The first electronic device 244 supports screen projection. The smart glasses receive a user's click input on the first device identifier 208 or the first connection control 210. In response to the click input, as shown in FIG4, the smart glasses display the screen projection interface 212 of the first electronic device, the device name, the eighth control 214, and the fourth control 216 in the interactive interface 202. Based on this, the smart glasses can receive a user's click input on the eighth control 214. In response to the click input, the smart glasses hide the screen projection interface 212 of the first electronic device. Furthermore, as shown in FIG5, a floating control 218 is displayed in the interactive interface 202. The floating control 218 displays the device icon 220 and the device name of the first electronic device 244. Furthermore, the smart glasses can receive user click input on the floating control 218. In response to this click input, as shown in Figure 4, the smart glasses display the projection interface 212 of the first electronic device, the device name, the eighth control 214, and the fourth control 216 within the interactive interface 202, according to their original display positions and proportions. Furthermore, the smart glasses can receive user click input on the fourth control 216. In response to this click input, the smart glasses disconnect the projection connection between the first electronic device and the smart glasses. Additionally, as shown in Figure 6, a fifth control 222 for expanding more operation controls for the first electronic device can also be displayed above the projection interface 212.
[0074] S104b: If the electronic device corresponding to the first device identifier is a second type of electronic device, display the second interface.
[0075] The second type of electronic device is those that do not support screen mirroring, such as smart speakers, smart refrigerators, and smart air conditioners.
[0076] Furthermore, the second interface is a shortcut function control interface for electronic devices.
[0077] Furthermore, the aforementioned shortcut function control interface includes shortcut function controls for electronic devices.
[0078] The aforementioned shortcut function controls can be controls used to display operating information of electronic devices, such as controls displaying the current temperature and food storage information of a refrigerator. These shortcut function controls can also be controls used to implement shortcut functions of electronic devices, such as volume control controls and playlists on a smart speaker.
[0079] Specifically, when the smart glasses display the device control interface of the electronic device corresponding to the first device identifier in its interactive interface, if the electronic device corresponding to the first device identifier does not have a screen projection function, such as if the electronic device corresponding to the first device identifier is a smart speaker, smart refrigerator, or smart air conditioner, the smart glasses display the shortcut function control interface of the electronic device corresponding to the first device identifier in its interactive interface, so that the user can view the basic working information of the electronic device or realize the shortcut function of the electronic device through the shortcut function control interface.
[0080] When displaying the shortcut function control interface of the electronic device corresponding to the first device identifier, the smart glasses can also display a fifth control, a fourth control, and the device name of the electronic device corresponding to the first device identifier within the interactive interface. The fifth control is used to display more operation controls of the electronic device, and the fourth control is used to disconnect the electronic device from the smart glasses.
[0081] For example, as shown in FIG7, the interactive interface 202 of the smart glasses displays a first device identifier 208 of the first electronic device 244. The first device identifier 208 includes the device name of the first electronic device 244 and a first connection control 210. The first electronic device 244 does not support screen mirroring. The smart glasses receive a click input from the user on the first device identifier 208 or the first connection control 210. In response to the click input, as shown in FIG8, the smart glasses display a shortcut function control interface 260, a fifth control 222, a fourth control 216, and the device name of the first electronic device in the interactive interface 202. Among them, the shortcut function control interface 260 includes a shortcut function control 224 of the first electronic device, which is used by the user to perform quick operations on the first electronic device to realize the shortcut functions of the first electronic device. The fifth control 222 is used to display more operation controls of the first electronic device, and the fourth control 216 is used to disconnect the first electronic device from the smart glasses.
[0082] In the embodiments provided in this application, during the process of displaying the device control interface of the electronic device corresponding to the first device identifier in response to the first input, a first interface is displayed when the electronic device corresponding to the first device identifier is a first type of electronic device; and a second interface is displayed when the electronic device corresponding to the first device identifier is a second type of electronic device. Thus, based on the type of electronic device, either the first or second interface is displayed within the interactive interface of the smart glasses, allowing users to operate electronic devices in real-world scenarios without removing their smart glasses. This ensures the continuity of user operations using smart glasses, prevents users from missing important real-time information, improves the convenience and efficiency of switching between different devices, and enhances the efficiency of operating multiple devices.
[0083] In this embodiment of the application, the first interface is the screen projection interface of the electronic device, and the second interface is the shortcut function control interface of the electronic device.
[0084] In the control method for an electronic device provided in this application embodiment, when the electronic device corresponding to the first device identifier has a screen mirroring function, the smart glasses display the screen mirroring interface of the electronic device corresponding to the first device identifier in its interactive interface; when the electronic device corresponding to the first device identifier does not have a screen mirroring function, the smart glasses display the shortcut function control interface of the electronic device corresponding to the first device identifier in its interactive interface. Thus, depending on whether the electronic device has a screen mirroring function, displaying either the screen mirroring interface or the shortcut function control interface of the electronic device in the interactive interface of the smart glasses allows the user to directly view or operate the interface content of the electronic device corresponding to the first device identifier through the screen mirroring interface, or to view basic operating information of the electronic device or access shortcut functions of the electronic device through the shortcut function control interface.
[0085] In the embodiments provided in this application, the first interface is the projection interface of the electronic device, and the second interface is the shortcut function control interface of the electronic device. Thus, based on the type of electronic device, the projection interface or shortcut function controls of the electronic device in the real-world scene are displayed within the interactive interface of the smart glasses. This allows users to operate the electronic device in the real-world scene without removing the smart glasses, ensuring the continuity of user tasks while using the smart glasses, preventing users from missing important real-time information, improving the convenience and efficiency of switching between different devices, and increasing the efficiency of operating multiple devices.
[0086] In this embodiment of the application, the control method for the above-mentioned electronic device may further include the following S110:
[0087] S110: When the electronic device corresponding to the second device identifier receives an incoming call message, the location guidance information of the electronic device corresponding to the second device identifier is displayed.
[0088] The aforementioned incoming call messages may include telephone call messages, video call messages, voice call messages, etc., without specific limitations.
[0089] Furthermore, the second device identifier corresponds to an electronic device in the real-world scenario. The second device identifier may specifically include the device name of the corresponding electronic device, but this is not specifically limited here.
[0090] Furthermore, the aforementioned second device identifier serves as a control switch for establishing a connection between the smart glasses and the electronic device corresponding to the second device identifier. The second device identifier may also include a connection control for the corresponding electronic device, allowing the user to control the smart glasses to establish a connection with the electronic device corresponding to the second device identifier through touch input on the second device identifier or its connection control.
[0091] In practical applications, the aforementioned second device identifier can be the device identifier of an electronic device that displays a device control interface in the interactive interface of the smart glasses. The aforementioned second device identifier can also be the device identifier of an electronic device that has established a connection with the smart glasses but does not display a device control interface in the interactive interface of the smart glasses. No specific restrictions are imposed here.
[0092] Furthermore, the aforementioned location guidance information is used to indicate the location of the electronic device corresponding to the second device identifier to the user, so that the user can quickly find the electronic device corresponding to the second device identifier.
[0093] Specifically, when the electronic device corresponding to the second device identifier in the smart glasses' interactive interface receives an incoming call, the smart glasses display location guidance information of the electronic device corresponding to the second device identifier in its interactive interface to indicate the location of the electronic device corresponding to the second device identifier to the user, thereby making it easier for the user to quickly find the electronic device corresponding to the second device identifier and answer the aforementioned incoming call through the electronic device.
[0094] The embodiments provided in this application display location guidance information for the electronic device corresponding to the second device identifier when the electronic device receives an incoming call. This allows users to quickly locate the corresponding electronic device and answer the incoming call through it.
[0095] In this embodiment of the application, S110 may specifically include the following S110a to S110c:
[0096] S110a: When the electronic device corresponding to the second device identifier receives an incoming call message, the first control is displayed.
[0097] The first control mentioned above is used to allow users to answer the aforementioned incoming call messages on their electronic devices.
[0098] S110b: Receives a third input to the first control.
[0099] The third input mentioned above is the user's touch input to the first control. Specifically, the touch input can be a single click, a long press, a double click, a swipe, or an input along a preset trajectory. Those skilled in the art can set the specific form of the third input according to the actual situation, and no specific restrictions are made here.
[0100] S110c: In response to the third input, display location guidance information for the electronic device corresponding to the second device identifier.
[0101] Specifically, when the electronic device corresponding to the second device identifier in the smart glasses' interface receives an incoming call, the smart glasses display a first control within its interface. Furthermore, in response to a third input from the user to the first control, the smart glasses display location guidance information for the electronic device corresponding to the second device identifier within its interface. This indicates the location of the electronic device to the user, allowing them to quickly locate it and answer the incoming call.
[0102] Specifically, the smart glasses receive and respond to the user's third input to the first control, detect the distance between the smart glasses and the electronic device corresponding to the second device identifier, and if the distance is less than a second threshold, such as when the user is carrying the electronic device corresponding to the second device identifier, the smart glasses directly display a prompt message on its interactive interface to prompt the user to answer the incoming call through the electronic device corresponding to the second device identifier. If the distance is greater than the first threshold, the smart glasses display location guidance information for the electronic device corresponding to the second device identifier on its interactive interface to instruct the user to move towards the electronic device corresponding to the second device identifier, until the smart glasses detect that the distance between itself and the electronic device corresponding to the second device identifier is less than the second threshold, and then display a prompt message to prompt the user to answer the incoming call through the electronic device corresponding to the second device identifier.
[0103] The first threshold is greater than the second threshold. Those skilled in the art can set the specific values of the first and second thresholds according to actual circumstances, and no specific restrictions are imposed here.
[0104] In addition, in practical applications, when the electronic device corresponding to the second device identifier receives an incoming call message, a second control can be displayed. The second control is used for the user to answer the aforementioned incoming call message on the smart glasses.
[0105] For example, as shown in Figure 12, the interactive interface 202 displays a second device identifier 254, an incoming call message 226, a first control 230, and a fourth control 216. The smart glasses receive a user's click input on the first control 230. In response to this click input, the smart glasses detect the distance between themselves and the second electronic device corresponding to the second device identifier 254. If the distance is greater than a first threshold, as shown in Figure 13, the smart glasses display location guidance information 236 for the second electronic device 246 within the interactive interface 202, instructing the user to move towards the second electronic device 246. This continues until the smart glasses detect that the distance between themselves and the second electronic device 246 is less than the second threshold, at which point a prompt message 238 is displayed, prompting the user to answer the incoming call message 226 via the second electronic device 246. Additionally, as shown in Figure 12, a second control 232 may be displayed on the incoming call message 226. The user can answer the incoming call message 226 directly on the smart glasses by touching the second control 232.
[0106] The embodiments provided in this application, when the electronic device corresponding to the second device identifier receives an incoming call, display a first control; receive a third input to the first control; and in response to the third input, display location guidance information for the electronic device corresponding to the second device identifier. In this way, when the user chooses to answer the incoming call on the electronic device, the spatial location of the electronic device is guided to the user, making it easier for the user to quickly find the electronic device to answer the call.
[0107] In this embodiment of the application, the control method for the above-mentioned electronic device may further include the following steps S112 to S116:
[0108] S112: When the electronic device corresponding to the third device identifier receives a session message, the third control is displayed.
[0109] The third device identifier corresponds to an electronic device in the real-world scenario. The third device identifier may include the device name of the corresponding electronic device, but this is not specifically limited here.
[0110] Furthermore, the aforementioned third device identifier serves as a control switch for establishing a connection between the smart glasses and the electronic device corresponding to the third device identifier. The third device identifier may also include a connection control for the corresponding electronic device, allowing the user to control the smart glasses to establish a connection with the electronic device corresponding to the third device identifier through touch input on the third device identifier or its connection control.
[0111] In practical applications, the aforementioned third device identifier can be the device identifier of an electronic device that displays a device control interface in the interactive interface of the smart glasses. The aforementioned third device identifier can also be the device identifier of an electronic device that has established a connection with the smart glasses but does not display a device control interface in the interactive interface of the smart glasses. No specific restrictions are imposed here.
[0112] Furthermore, the aforementioned notification messages include, but are not limited to, chat session messages, push session messages, advertising session messages, SMS session messages, and service session messages, etc., without specific limitations.
[0113] Furthermore, the aforementioned third control is used to allow users to process the aforementioned conversation messages on the smart glasses.
[0114] Specifically, in the control method of the electronic device provided in the embodiments of this application, when the electronic device corresponding to the third device identifier in the interactive interface of the smart glasses receives a session message, the smart glasses display a third control in its interactive interface so that the user can process the aforementioned session message on the smart glasses.
[0115] In practical applications, a fourth control can also be displayed within the interactive interface. This fourth control is used to disable notification messages.
[0116] For example, after the smart glasses establish a connection with the third electronic device, as shown in Figure 9, the interactive interface 202 displays a third device identifier 258. When the third electronic device corresponding to the third device identifier 258 receives the session message 228, the session message 228, the third control 256, and the fourth control 216 are displayed floating in the interactive interface 202. The user can directly process the session message 228 on the smart glasses through touch input of the third control 256.
[0117] In addition, smart glasses can also determine the urgency and importance of conversation messages. If a conversation message is determined to be urgent or important, such as when the user has marked the message with an important or urgent tag, the smart glasses will directly display the message in the center of the interactive interface to ensure that the user does not miss important or urgent information.
[0118] S114: Receive the user's fourth input to the third control.
[0119] The fourth input mentioned above is the user's touch input to the third control.
[0120] S116: In response to the fourth input, display the message handling interface for the session message.
[0121] Specifically, after displaying the conversation messages and the third control on the interactive interface, the smart glasses can receive a fourth input from the user to the third control. In response to this fourth input, the smart glasses display a message processing interface for the conversation messages within the interactive interface, allowing the user to process the conversation messages directly on the smart glasses' interactive interface via touch input. This direct processing of the conversation messages on the smart glasses reduces visual interference from the displayed content on the interactive interface, improves the consistency of interaction across different devices, and increases the efficiency of the user's operation across different devices.
[0122] In addition, after the smart glasses display conversation messages on their interactive interface, the smart glasses can also respond to the user's touch input on the conversation messages, such as long press input, to display the conversation messages in the central area of the interactive interface. At the same time, the specific content of the conversation messages is expanded to display, and quick reply controls are displayed in the interactive interface so that the user can quickly view and reply to the conversation messages.
[0123] For example, as shown in FIG10, a conversation message 228 of the third electronic device 262 corresponding to the third device identifier 258 is displayed floating in the interactive interface 202. The smart glasses receive and respond to the user's long press input on the conversation message 228. As shown in FIG11, the conversation message 228 is displayed in the central area of the interactive interface 202, the specific content of the conversation message 228 is expanded to display, and a quick reply control 234 is displayed in the interactive interface 202 so that the user can quickly view and reply to the conversation message 228.
[0124] The embodiments provided in this application, when the electronic device corresponding to the third device identifier receives a session message, display a third control; receive a fourth input from the user to the third control; and in response to the fourth input, display a message processing interface for the session message. In this way, the user can process session messages on the smart glasses by inputting into the smart glasses' interactive interface, improving the convenience and efficiency of switching between different devices and increasing the efficiency of operating multiple devices.
[0125] In this embodiment of the application, the control method for the above-mentioned electronic device may further include the following steps S118 and S120:
[0126] S118: Receives the fifth input to the interactive interface of the smart glasses.
[0127] The fifth input mentioned above is the user's touch input to the smart glasses' interactive interface.
[0128] Furthermore, the fifth input is used to switch the display mode of the device control interface in the interactive interface.
[0129] S120: In response to the fifth input, adjust the display mode of the device control interface to the first display mode or the second display mode.
[0130] In the first display mode, the display position of the device control interface of the electronic device corresponding to the first device identifier matches the spatial position of the electronic device corresponding to the first device identifier in the real scene. In the second display mode, the device control interface of the electronic device corresponding to the first device identifier is locked in the interactive interface of the smart glasses.
[0131] Specifically, after the device control interface of the electronic device corresponding to the first device identifier is displayed on the smart glasses' interactive interface, the smart glasses can receive a fifth input from the user to the smart glasses' interactive interface. In response to this fifth input, the smart glasses adjust the display mode of the device control interface of the electronic device corresponding to the first device identifier to a first display mode, so that the display position of the device control interface of the electronic device corresponding to the first device identifier matches the spatial position of the electronic device corresponding to the first device identifier in the real-world scene. Alternatively, in response to this fifth input, the smart glasses adjust the display mode of the device control interface of the electronic device corresponding to the first device identifier to a second display mode, so that the device control interface of the electronic device corresponding to the first device identifier is locked in the smart glasses' interactive interface, allowing the device control interface to follow the user's field of view, thereby facilitating the user to operate the electronic device in real time through the device control interface.
[0132] In the first display mode, the device control interface of the electronic device corresponding to the first device identifier can be fixedly displayed at the location of the electronic device in the real scene, making it easy for users to distinguish and view the device control interface of different electronic devices. For example, a cooking countdown can be displayed above a kitchen stove.
[0133] In addition, in the first display mode, the device control interface of the electronic device corresponding to the first device identifier can be fixedly displayed in a spatial location set by the user, so that the user can view the device control interface of a specific device in the real space.
[0134] Furthermore, in the second display mode, users can customize the locked display position of the device control interface within the smart glasses' interactive interface. For example, for information that needs to be displayed for a long time, such as countdown information, schedule reminders, and weather forecasts, users can choose to keep this information permanently displayed in a specific location on the smart glasses' interactive interface for real-time viewing. In addition, users can also hide or hide the information displayed on the smart glasses' interactive interface at any time through touch input.
[0135] For example, as shown in Figure 14, the interactive interface 202 displays the shortcut function control interface 260, the fifth control 222, the fourth control 216, and the device name of the first electronic device 244. The smart glasses receive a user's click input on the fifth control 222. In response to this click input, the smart glasses display the sixth control 240, which is used to switch the display mode of the shortcut function control interface 260. Furthermore, the smart glasses receive a user's click input on the sixth control 240. In response to this click input, as shown in Figure 15, the smart glasses fix the shortcut function control interface 260, the fifth control 222, the fourth control 216, and the device name at the location of the first electronic device 244 in the real-world scene.
[0136] For example, as shown in FIG16, a first device control interface 242 of the first electronic device 244 is displayed in the interactive interface 202. As shown in FIG17, the smart glasses receive the user's drag input on the first device control interface 242, and in response to the drag input, as shown in FIG18, the smart glasses fix the first device control interface 242 at the location of the second electronic device 246 in the real scene.
[0137] The embodiments provided in this application receive a fifth input to the interactive interface of the smart glasses; in response to the fifth input, the display mode of the device control interface is adjusted to a first display mode or a second display mode; wherein, in the first display mode, the display position of the device control interface of the electronic device corresponding to the first device identifier matches the spatial position of the electronic device corresponding to the first device identifier in the real scene; in the second display mode, the device control interface of the electronic device corresponding to the first device identifier is locked in the interactive interface of the smart glasses. In this way, by setting the device control interface to display according to the user's field of vision or to be fixed in a spatial position, it is convenient for the user to set the viewing method of the device control interface according to their needs, and to facilitate the user to view the device information of different devices in a timely manner.
[0138] In this embodiment of the application, the interactive interface of the smart glasses includes at least two device identifiers, and the control method of the above-mentioned electronic device may further include the following S122 and S124:
[0139] S122: Receive the sixth input to the interactive interface of the smart glasses.
[0140] The sixth input mentioned above is the user's touch input to the smart glasses' interactive interface.
[0141] S124: In response to the sixth input, display the device control interface of the electronic device corresponding to each device identifier in the interactive interface of the smart glasses.
[0142] Specifically, the smart glasses' interactive interface includes at least two device identifiers. The smart glasses can receive and respond to the user's sixth input to the seventh control within the interactive interface, and display the device control interface of the electronic device corresponding to each device identifier in the interactive interface of the smart glasses, so that the user can simultaneously view the device information of the electronic device corresponding to each device identifier.
[0143] In addition, when multiple device control interfaces are displayed within the interactive interface, the smart glasses can receive and respond to the user's touch input to the smart glasses' interactive interface, and display the multiple device control interfaces displayed within the interactive interface in the central area of the interactive interface, so that the user can view and manage the device control interfaces of different electronic devices in a unified manner.
[0144] For example, as shown in FIG16, the interactive interface 202 of the smart glasses displays a seventh control 248, a first device identifier 208, a second device identifier 254, a third device identifier 258, and a first device control interface 242 of the first electronic device 244 corresponding to the first device identifier 208. The smart glasses receive a click input from the user on the seventh control 248. In response to this click input, as shown in FIG19, the smart glasses simultaneously display the first device control interface 242, the second device control interface 250, and the third device control interface 252 within the interactive interface 202. Further, the smart glasses receive another click input from the user on the seventh control 248. In response to this click input, as shown in FIG20, the smart glasses display the first device control interface 242, the second device control interface 250, and the third device control interface 252 together in the central area of the interactive interface 202.
[0145] In the embodiments provided in this application, the interactive interface of the smart glasses includes at least two device identifiers and receives a sixth input to the interactive interface of the smart glasses; in response to the sixth input, the device control interface of the electronic device corresponding to each device identifier in the interactive interface of the smart glasses is displayed. This facilitates users in uniformly viewing and managing the device control interfaces of different electronic devices.
[0146] The control method for an electronic device provided in this application can be executed by a control device for the electronic device. This application uses the example of a control device for an electronic device executing the aforementioned control method to illustrate the control device for the electronic device provided in this application.
[0147] As shown in FIG21, this application embodiment provides a control device 300 for an electronic device, which is applied to smart glasses. The control device 300 for the electronic device may include the receiving unit 302 and the display unit 304 described below.
[0148] The receiving unit 302 is used to receive a first input of a first device identifier in the interactive interface of the smart glasses;
[0149] Display unit 304 is used to display the device control interface of the electronic device corresponding to the first device identifier in response to the first input.
[0150] The control device 300 for an electronic device provided in this application embodiment is applied to smart glasses. Through the control device 300, a first input to a first device identifier in the interactive interface of the smart glasses is received; in response to the first input, the device control interface of the electronic device corresponding to the first device identifier is displayed. Through the aforementioned control device 300, when a user wears the smart glasses, the device identifier of the electronic device in the real-world scene is displayed in the interactive interface of the smart glasses. Furthermore, based on the user's input to the device identifier, the device control interface of the electronic device corresponding to the device identifier is displayed in the interactive interface of the smart glasses. In this way, projecting the device control interface of the electronic device in the real-world scene onto the CGR environment of the smart glasses allows for the formation of a unified instruction set on the smart glasses. This enables users to operate the smart glasses and other electronic devices without repeatedly removing or putting on the smart glasses, thereby avoiding cumbersome operations and improving the efficiency of using different electronic devices while wearing smart glasses.
[0151] In this embodiment of the application, before receiving the first input to the first device identifier in the interactive interface of the smart glasses, the receiving unit 302 is further configured to: receive the second input to the interactive interface of the smart glasses; the display unit 304 is further configured to: display at least one device identifier in the interactive interface of the smart glasses in response to the second input.
[0152] The embodiments provided in this application receive a second input to the smart glasses' interactive interface before receiving a first input to a first device identifier in the smart glasses' interactive interface; in response to the second input, at least one device identifier is displayed in the smart glasses' interactive interface. Thus, when a user wears the smart glasses, by displaying the device identifiers of electronic devices in the real-world scene within the smart glasses' interactive interface, the user can select electronic devices to establish a connection with the smart glasses without removing them, improving the user's ease of switching between multiple devices.
[0153] In this embodiment of the application, the display position of each device identifier in the interactive interface matches the spatial position of the electronic device corresponding to the device identifier in the real scene.
[0154] In the embodiments provided in this application, the display position of each device identifier in the interactive interface matches the spatial position of the electronic device corresponding to the device identifier in the real-world scene. This makes it easier for users to distinguish the electronic device corresponding to each device identifier, improving the accuracy and convenience for users to control other electronic devices while wearing smart glasses.
[0155] In this embodiment of the application, the display unit 304 is specifically used to: in response to the first input, display a first interface when the electronic device corresponding to the first device identifier is a first type of electronic device; and display a second interface when the electronic device corresponding to the first device identifier is a second type of electronic device.
[0156] In the embodiments provided in this application, during the process of displaying the device control interface of the electronic device corresponding to the first device identifier in response to the first input, a first interface is displayed when the electronic device corresponding to the first device identifier is a first type of electronic device; and a second interface is displayed when the electronic device corresponding to the first device identifier is a second type of electronic device. Thus, based on the type of electronic device, either the first or second interface is displayed within the interactive interface of the smart glasses, allowing users to operate electronic devices in real-world scenarios without removing their smart glasses. This ensures the continuity of user operations using smart glasses, prevents users from missing important real-time information, improves the convenience and efficiency of switching between different devices, and enhances the efficiency of operating multiple devices.
[0157] In this embodiment of the application, the first interface is the screen projection interface of the electronic device, and the second interface is the shortcut function control interface of the electronic device.
[0158] In the embodiments provided in this application, the first interface is the projection interface of the electronic device, and the second interface is the shortcut function control interface of the electronic device. Thus, based on the type of electronic device, the projection interface or shortcut function controls of the electronic device in the real-world scene are displayed within the interactive interface of the smart glasses. This allows users to operate the electronic device in the real-world scene without removing the smart glasses, ensuring the continuity of user tasks while using the smart glasses, preventing users from missing important real-time information, improving the convenience and efficiency of switching between different devices, and increasing the efficiency of operating multiple devices.
[0159] In this embodiment of the application, the display unit 304 is further configured to: display location guidance information of the electronic device corresponding to the second device identifier when the electronic device corresponding to the second device identifier receives an incoming call message.
[0160] The embodiments provided in this application display location guidance information for the electronic device corresponding to the second device identifier when the electronic device receives an incoming call. This allows users to quickly locate the corresponding electronic device and answer the incoming call through it.
[0161] In this embodiment of the application, the display unit 304 is specifically used to: display a first control when the electronic device corresponding to the second device identifier receives an incoming call message; the receiving unit 302 is further used to: receive a third input to the first control; the display unit 304 is further used to: display location guidance information of the electronic device corresponding to the second device identifier in response to the third input.
[0162] The embodiments provided in this application, when the electronic device corresponding to the second device identifier receives an incoming call, display a first control; receive a third input to the first control; and in response to the third input, display location guidance information for the electronic device corresponding to the second device identifier. In this way, when the user chooses to answer the incoming call on the electronic device, the spatial location of the electronic device is guided to the user, making it easier for the user to quickly find the electronic device to answer the call.
[0163] In this embodiment, the display unit 304 is further configured to: display a third control when the electronic device corresponding to the third device identifier receives a session message; the receiving unit 302 is further configured to: receive a fourth input from the user to the third control; and the display unit 304 is further configured to: display the message processing interface of the session message in response to the fourth input.
[0164] The embodiments provided in this application, when the electronic device corresponding to the third device identifier receives a session message, display a third control; receive a fourth input from the user to the third control; and in response to the fourth input, display a message processing interface for the session message. In this way, the user can process session messages on the smart glasses by inputting into the smart glasses' interactive interface, improving the convenience and efficiency of switching between different devices and increasing the efficiency of operating multiple devices.
[0165] In this embodiment, the receiving unit 302 is further configured to: receive a fifth input to the interactive interface of the smart glasses; the display unit 304 is further configured to: in response to the fifth input, adjust the display mode of the device control interface to a first display mode or a second display mode; wherein, in the first display mode, the display position of the device control interface of the electronic device corresponding to the first device identifier matches the spatial position of the electronic device corresponding to the first device identifier in the real scene, and in the second display mode, the device control interface of the electronic device corresponding to the first device identifier is locked and displayed in the interactive interface of the smart glasses.
[0166] The embodiments provided in this application receive a fifth input to the interactive interface of the smart glasses; in response to the fifth input, the display mode of the device control interface is adjusted to a first display mode or a second display mode; wherein, in the first display mode, the display position of the device control interface of the electronic device corresponding to the first device identifier matches the spatial position of the electronic device corresponding to the first device identifier in the real scene; in the second display mode, the device control interface of the electronic device corresponding to the first device identifier is locked in the interactive interface of the smart glasses. In this way, by setting the device control interface to display according to the user's field of vision or to be fixed in a spatial position, it is convenient for the user to set the viewing method of the device control interface according to their needs, and to facilitate the user to view the device information of different devices in a timely manner.
[0167] In this embodiment of the application, the interactive interface of the smart glasses includes at least two device identifiers. The receiving unit 302 is further configured to: receive a sixth input to the interactive interface of the smart glasses; the display unit 304 is further configured to: in response to the sixth input, display the device control interface of the electronic device corresponding to each device identifier in the interactive interface of the smart glasses.
[0168] In the embodiments provided in this application, the interactive interface of the smart glasses includes at least two device identifiers and receives a sixth input to the interactive interface of the smart glasses; in response to the sixth input, the device control interface of the electronic device corresponding to each device identifier in the interactive interface of the smart glasses is displayed. This facilitates users in uniformly viewing and managing the device control interfaces of different electronic devices.
[0169] The control device 300 of the electronic device in this application embodiment can be an electronic device or a component in an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, handheld computer, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, smart glasses, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. The embodiments of this application do not specifically limit it.
[0170] The control device 300 of the electronic device in this embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this embodiment does not specifically limit the specific operating system.
[0171] The control device 300 of the electronic device provided in this application embodiment can implement the various processes implemented in the method embodiment of FIG1. To avoid repetition, it will not be described again here.
[0172] Optionally, as shown in FIG22, this application embodiment also provides an electronic device 400, including a processor 402 and a memory 404. The memory 404 stores a program or instructions that can run on the processor 402. When the program or instructions are executed by the processor 402, they implement the various steps of the control method embodiment of the above-mentioned electronic device and can achieve the same technical effect. To avoid repetition, they will not be described again here.
[0173] It should be noted that the electronic devices in the embodiments of this application include the aforementioned mobile electronic devices and non-mobile electronic devices.
[0174] Figure 23 is a schematic diagram of the hardware structure of an electronic device that implements an embodiment of this application.
[0175] The electronic device 500 includes, but is not limited to, components such as: radio frequency unit 501, network module 502, audio output unit 503, input unit 504, sensor 505, display unit 506, user input unit 507, interface unit 508, memory 509, and processor 510.
[0176] Those skilled in the art will understand that the electronic device 500 may also include a power supply (such as a battery) for powering various components. The power supply can be logically connected to the processor 510 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The electronic device structure shown in Figure 23 does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.
[0177] Specifically, the electronic device 500 can be smart glasses.
[0178] User input unit 507 is used to receive a first input of a first device identifier in the interactive interface of the smart glasses.
[0179] Display unit 506 is used to display the device control interface of the electronic device corresponding to the first device identifier in response to the first input.
[0180] In this embodiment, a first input to a first device identifier in the smart glasses' interactive interface is received; in response to the first input, the device control interface of the electronic device corresponding to the first device identifier is displayed. In this embodiment, when a user wears smart glasses, the device identifier of an electronic device in the real-world scene is displayed in the smart glasses' interactive interface. Then, based on the user's input to the device identifier, the device control interface of the electronic device corresponding to the device identifier is displayed in the smart glasses' interactive interface. This projects the device control interface of the electronic device in the real-world scene onto the CGR environment of the smart glasses, forming a unified instruction set on the smart glasses. This allows users to operate the smart glasses and other electronic devices without repeatedly removing or putting on the smart glasses, thus avoiding cumbersome operations while wearing smart glasses and improving the efficiency of switching and operating between smart glasses and other devices, thereby increasing the efficiency of using different devices.
[0181] Optionally, before receiving the first input of the first device identifier in the interactive interface of the smart glasses, the user input unit 507 is further configured to: receive the second input of the interactive interface of the smart glasses; the display unit 506 is further configured to: display at least one device identifier in the interactive interface of the smart glasses in response to the second input.
[0182] The embodiments provided in this application receive a second input to the smart glasses' interactive interface before receiving a first input to a first device identifier in the smart glasses' interactive interface; in response to the second input, at least one device identifier is displayed in the smart glasses' interactive interface. Thus, when a user wears the smart glasses, by displaying the device identifiers of electronic devices in the real-world scene within the smart glasses' interactive interface, the user can select electronic devices to establish a connection with the smart glasses without removing them, improving the user's ease of switching between multiple devices.
[0183] In this embodiment of the application, the display position of each device identifier in the interactive interface matches the spatial position of the electronic device corresponding to the device identifier in the real scene.
[0184] In the embodiments provided in this application, the display position of each device identifier in the interactive interface matches the spatial position of the electronic device corresponding to the device identifier in the real-world scene. This makes it easier for users to distinguish the electronic device corresponding to each device identifier, improving the accuracy and convenience for users to control other electronic devices while wearing smart glasses.
[0185] Optionally, the display unit 506 is specifically configured to: in response to the first input, display a first interface when the electronic device corresponding to the first device identifier is a first type of electronic device; and display a second interface when the electronic device corresponding to the first device identifier is a second type of electronic device.
[0186] The embodiments provided in this application, in response to a first input, display a first interface when the electronic device corresponding to the first device identifier is a first type of electronic device; and display a second interface when the electronic device corresponding to the first device identifier is a second type of electronic device. Thus, based on the type of electronic device, displaying either a first or second interface within the smart glasses' interactive interface allows users to operate devices in real-world scenarios without removing their smart glasses. This ensures the continuity of user operations using smart glasses, prevents users from missing important real-time information, improves the convenience and efficiency of switching between different devices, and enhances the efficiency of operating multiple devices.
[0187] Optionally, the first interface is the screen mirroring interface of the electronic device, and the second interface is the shortcut function control interface of the electronic device.
[0188] In the embodiments provided in this application, the first interface is the projection interface of the electronic device, and the second interface is the shortcut function control interface of the electronic device. Thus, based on the type of electronic device, the projection interface or shortcut function controls of the electronic device in the real-world scene are displayed within the interactive interface of the smart glasses. This allows users to operate the electronic device in the real-world scene without removing the smart glasses, ensuring the continuity of user tasks while using the smart glasses, preventing users from missing important real-time information, improving the convenience and efficiency of switching between different devices, and increasing the efficiency of operating multiple devices.
[0189] Optionally, the display unit 506 is further configured to: display location guidance information of the electronic device corresponding to the second device identifier when the electronic device corresponding to the second device identifier receives an incoming call message.
[0190] The embodiments provided in this application display location guidance information for the electronic device corresponding to the second device identifier when the electronic device receives an incoming call. This allows users to quickly locate the corresponding electronic device and answer the incoming call through it.
[0191] Optionally, the display unit 506 is specifically configured to: display a first control when the electronic device corresponding to the second device identifier receives an incoming call message; the user input unit 507 is further configured to: receive a third input to the first control; and the display unit 506 is further configured to: display location guidance information of the electronic device corresponding to the second device identifier in response to the third input.
[0192] The embodiments provided in this application, when the electronic device corresponding to the second device identifier receives an incoming call, display a first control; receive a third input to the first control; and in response to the third input, display location guidance information for the electronic device corresponding to the second device identifier. In this way, when the user chooses to answer the incoming call on the electronic device, the spatial location of the electronic device is guided to the user, making it easier for the user to quickly find the electronic device to answer the call.
[0193] Optionally, the display unit 506 is further configured to: display a third control when the electronic device corresponding to the third device identifier receives a session message; the user input unit 507 is further configured to: receive a fourth input from the user to the third control; and the display unit 506 is further configured to: display the message processing interface of the session message in response to the fourth input.
[0194] The embodiments provided in this application, when the electronic device corresponding to the third device identifier receives a session message, display a third control; receive a fourth input from the user to the third control; and in response to the fourth input, display a message processing interface for the session message. In this way, the user can process session messages on the smart glasses by inputting into the smart glasses' interactive interface, improving the convenience and efficiency of switching between different devices and increasing the efficiency of operating multiple devices.
[0195] Optionally, the user input unit 507 is further configured to: receive a fifth input to the interactive interface of the smart glasses; the display unit 506 is further configured to: in response to the fifth input, adjust the display mode of the device control interface to a first display mode or a second display mode; wherein, in the first display mode, the display position of the device control interface of the electronic device corresponding to the first device identifier matches the spatial position of the electronic device corresponding to the first device identifier in the real scene, and in the second display mode, the device control interface of the electronic device corresponding to the first device identifier is locked in the interactive interface of the smart glasses.
[0196] The embodiments provided in this application receive a fifth input to the interactive interface of the smart glasses; in response to the fifth input, the display mode of the device control interface is adjusted to a first display mode or a second display mode; wherein, in the first display mode, the display position of the device control interface of the electronic device corresponding to the first device identifier matches the spatial position of the electronic device corresponding to the first device identifier in the real scene; in the second display mode, the device control interface of the electronic device corresponding to the first device identifier is locked in the interactive interface of the smart glasses. In this way, by setting the device control interface to display according to the user's field of vision or to be fixed in a spatial position, it is convenient for the user to set the viewing method of the device control interface according to their needs, and to facilitate the user to view the device information of different devices in a timely manner.
[0197] Optionally, the interactive interface of the smart glasses includes at least two device identifiers, and the user input unit 507 is further configured to: receive a sixth input to the interactive interface of the smart glasses; the display unit 506 is further configured to: in response to the sixth input, display the device control interface of the electronic device corresponding to each device identifier in the interactive interface of the smart glasses.
[0198] In the embodiments provided in this application, the interactive interface of the smart glasses includes at least two device identifiers and receives a sixth input to the interactive interface of the smart glasses; in response to the sixth input, the device control interface of the electronic device corresponding to each device identifier in the interactive interface of the smart glasses is displayed. This facilitates users in uniformly viewing and managing the device control interfaces of different electronic devices.
[0199] It should be understood that, in this embodiment, the input unit 504 may include a graphics processing unit (GPU) 5041 and a microphone 5042. The GPU 5041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 506 may include a display panel 5061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 507 includes at least one of a touch panel 5071 and other input devices 5072. The touch panel 5071 is also called a touch screen. The touch panel 5071 may include a touch detection device and a touch controller. Other input devices 5072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.
[0200] The memory 509 can be used to store software programs and various data. The memory 509 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 509 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 509 in this embodiment includes, but is not limited to, these and any other suitable types of memory.
[0201] Processor 510 may include one or more processing units; optionally, processor 510 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 510.
[0202] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the control method embodiment of the above-described electronic device and achieve the same technical effect. To avoid repetition, they will not be described again here.
[0203] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.
[0204] This application also provides a chip, which includes a processor and a communication interface. The communication interface and the processor are coupled. The processor is used to run programs or instructions to implement the various processes of the control method embodiments of the above-mentioned electronic device and can achieve the same technical effect. To avoid repetition, it will not be described again here.
[0205] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.
[0206] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the control method embodiment of the electronic device described above, and can achieve the same technical effect. To avoid repetition, it will not be described again here.
[0207] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
[0208] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods of the various embodiments of this application.
[0209] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.
Claims
1. A control method for an electronic device, applied to smart glasses, the method comprising: Receive a first input of a first device identifier in the interactive interface of the smart glasses; In response to the first input, the device control interface of the electronic device corresponding to the first device identifier is displayed.
2. The control method for an electronic device according to claim 1, wherein, Before receiving the first input of a first device identifier in the interactive interface of the smart glasses, the method further includes: Receive a second input to the interactive interface of the smart glasses; In response to the second input, at least one device identifier is displayed in the interactive interface of the smart glasses.
3. The control method for an electronic device according to claim 2, wherein, The display position of each device identifier in the interactive interface matches the spatial position of the electronic device corresponding to the device identifier in the real scene.
4. The control method for an electronic device according to claim 1, wherein, The device control interface that displays the electronic device corresponding to the first device identifier in response to the first input includes: In response to the first input, if the electronic device corresponding to the first device identifier is a first type of electronic device, the first interface is displayed; If the electronic device corresponding to the first device identifier is a second type of electronic device, the second interface is displayed.
5. The control method for an electronic device according to claim 4, wherein, The first interface is the screen mirroring interface of the electronic device, and the second interface is the shortcut function control interface of the electronic device.
6. The control method for an electronic device according to claim 1, wherein, The method further includes: When the electronic device corresponding to the second device identifier receives an incoming call, it displays location guidance information for the electronic device corresponding to the second device identifier.
7. The control method for an electronic device according to claim 6, wherein, When the electronic device corresponding to the second device identifier receives an incoming call message, the location guidance information of the electronic device corresponding to the second device identifier is displayed, including: When the electronic device corresponding to the second device identifier receives an incoming call message, the first control is displayed; Receive a third input to the first control; In response to the third input, location guidance information for the electronic device corresponding to the second device identifier is displayed.
8. The control method for an electronic device according to claim 1, wherein, The method further includes: When the electronic device corresponding to the third device identifier receives a session message, the third control is displayed; Receive a fourth input to the third control; In response to the fourth input, the message processing interface of the session message is displayed.
9. The control method for an electronic device according to claim 1, wherein, The method further includes: Receive a fifth input to the interactive interface of the smart glasses; In response to the fifth input, the display mode of the device control interface is adjusted to either the first display mode or the second display mode; In the first display mode, the display position of the device control interface of the electronic device corresponding to the first device identifier matches the spatial position of the electronic device corresponding to the first device identifier in the real scene; in the second display mode, the device control interface of the electronic device corresponding to the first device identifier is locked in the interactive interface of the smart glasses.
10. The control method for an electronic device according to claim 1, wherein, The smart glasses' interface includes at least two device identifiers; The method further includes: Receive a sixth input to the interactive interface of the smart glasses; In response to the sixth input, the device control interface of the electronic device corresponding to each device identifier in the interactive interface of the smart glasses is displayed.
11. A control device for an electronic device, applied to smart glasses, the device comprising: A receiving unit is configured to receive a first input of a first device identifier in the interactive interface of the smart glasses; The display unit is configured to display the device control interface of the electronic device corresponding to the first device identifier in response to the first input.
12. The control device for the electronic device according to claim 11, wherein, Before receiving the first input of the first device identifier in the interactive interface of the smart glasses, the receiving unit is further configured to: Receive a second input to the interactive interface of the smart glasses; The display unit is also used for: In response to the second input, at least one device identifier is displayed in the interactive interface of the smart glasses.
13. The control device for the electronic device according to claim 12, wherein, The display position of each device identifier in the interactive interface matches the spatial position of the electronic device corresponding to the device identifier in the real scene.
14. An electronic device comprising a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions, when executed by the processor, implementing the steps of the control method of the electronic device as claimed in any one of claims 1 to 10.
15. A readable storage medium storing a program or instructions that, when executed by a processor, implement the steps of the control method of the electronic device as claimed in any one of claims 1 to 10.
Citation Information
Patent Citations
Method and device for prompting user
CN104065818A
Watch-type mobile terminal and method for controlling the same
CN106411346A
Equipment control method and device and electronic equipment
CN112286070A
Equipment control method and device, head-mounted equipment and readable storage medium
CN117572955A
Electronic equipment control method and device, electronic equipment and readable storage medium
CN118605727A