A communication method, related electronic equipment and system

Abstract

This application discloses a communication method applied to a smart wearable device. This method allows the smart wearable device to serve as a carrier, fulfilling the user's communication needs, including voice calls, video chats, and other information processing and transmission functions. The technical solution provided by this application integrates the hardware and software capabilities of different devices, offering users a multifunctional, intelligent, and more convenient communication experience. By implementing the technical solution provided by this application, users can address their communication needs anytime, anywhere while wearing the wearable device, freeing their hands from constantly holding a mobile phone, further improving human-computer interaction performance and providing users with greater communication convenience.

Description

[0001] This application is a divisional application. The original application has the application number 202110745607.2 and the original application date is June 30, 2021. The entire contents of the original application are incorporated herein by reference. Technical Field

[0002] This application relates to the field of terminal technology, and in particular to a communication method, related electronic equipment and system. Background Technology

[0003] With the upgrading of consumer spending, the market size of smart wearable devices is gradually expanding. The purpose of smart wearable devices is to explore new ways of human-computer interaction. By wearing them on the human body, smart devices provide consumers with exclusive, multifunctional, personalized, and more convenient services.

[0004] As an emerging smart wearable device, smart glasses are favored by many consumers due to their multifunctionality, portability, and practicality. Smart glasses need to be worn on the user's ears, and the daily wearing time can be as long as 12 to 16 hours. Besides providing basic optical correction or decorative functions, smart glasses need further development of communication functions to provide users with more convenience. Summary of the Invention

[0005] This application provides a communication method, related electronic device, and system for use in smart wearable devices. This communication method enables smart wearable devices to serve as carriers, fulfilling users' communication needs, including functions such as voice calls, video chats, and information processing and transmission.

[0006] The aforementioned and other objectives will be achieved through the features described in the independent claims. Further implementations are illustrated in the dependent claims, the specification, and the drawings.

[0007] In a first aspect, embodiments of this application provide a communication method applied to a communication system, the communication system including a first device, a second device, a third device and a fourth device, wherein the first device and the fourth device are wearable devices, the first device establishes a first connection with the second device, and the third device establishes a second connection with the fourth device.

[0008] The method includes: a first device detecting a first user operation, the first user operation being used to instruct the first device to start collecting sound.

[0009] The first device collects sound. After the first device finishes collecting sound, it generates the first voice data, which is the data of the collected sound.

[0010] The first device sends first voice data to the second device via a first connection. After receiving the first voice data, the second device sends the first voice data to the third device. After receiving the first voice data, the third device sends the first voice data to the fourth device via a second connection. The fourth device plays the first voice data.

[0011] By implementing the first approach, users can address their communication needs anytime, anywhere while wearing wearable devices such as smart glasses. They can communicate with specific contacts without constantly holding their phones, freeing their hands and further improving human-computer interaction performance, providing users with greater communication convenience. This method can integrate the hardware and software capabilities of different devices, offering users a multifunctional, intelligent, and more convenient communication experience.

[0012] In conjunction with the first aspect, in some embodiments, the first connection or the second connection is a short-range communication connection, such as a Bluetooth connection, a hotspot connection, or a wireless fidelity point-to-point connection.

[0013] In conjunction with the first aspect, in some embodiments, the first voice data is voice data collected within a first time period, where the first time period is a continuous period of time. The start time of the first time period is the time when the first device begins collecting sound, and the end time of the first time period is the time when the first device ends collecting sound. The first voice data sent by the second device to the third device is carried in the voice message.

[0014] In conjunction with the first aspect, in some embodiments, the first user operation includes any one or more of the following operations or combinations thereof: tapping, pinching, sliding, releasing, etc. The first user operation can be applied to a preset component or preset area of ​​the first device. For example, when the first device is smart glasses, the preset component is the temple of the smart glasses, and the first user operation can be a tapping, pinching, sliding, releasing, etc., applied to the temple of the smart glasses.

[0015] In conjunction with the first aspect, in some embodiments, if the first device receives second voice data sent by the second device within a first time period, then after the sound collection ends, the first device plays the second voice data. The second voice data may be voice data collected by a third or fourth device, sent from the third device to the second device, and then to the first device.

[0016] In conjunction with the first aspect, in some embodiments, the acquisition duration of the first voice data is the same as the playback duration.

[0017] In conjunction with the first aspect, in some embodiments, before the first device ends sound acquisition, the first device detects a second user operation, the second user operation being used to instruct the first device to end sound acquisition.

[0018] In conjunction with the first aspect, in some embodiments, the second user operation includes any one or more of the following operations or combinations thereof: tapping, pinching, sliding, and releasing. The second user operation can act on a preset component or preset area of ​​the first device. For example, when the first device is smart glasses, the preset component is the temple of the smart glasses, and the second user operation can be an operation that releases a press / release state on the temple of the smart glasses.

[0019] In conjunction with the first aspect, in some embodiments, the first device can automatically determine the end of the acquisition. For example, if no sound is detected for more than 2 seconds, the acquisition of voice will automatically end without manual operation by the user.

[0020] In conjunction with the first aspect, in some embodiments, before the first device sends the first voice data to the second device via the first connection, the first device detects a third user operation. The third user operation is an operation instructing the transmission of the first voice data, and includes any one or more of the following operations or combinations thereof: tapping, pinching, sliding, and releasing. For example, the third user operation could be a forward sliding operation applied to a preset component of the first device (such as the temple of smart glasses). In response to the third user operation, the first device sends the first voice data to the second device via the first connection.

[0021] In conjunction with the first aspect, in some embodiments, after receiving the first voice data, the second device saves the first voice data. After receiving the first voice data, the third device saves the first voice data. Saving voice messages allows users to easily listen to them again later, or avoids missing unlistened voice messages.

[0022] In conjunction with the first aspect, in some embodiments, a first communication application is installed on both the second and third devices, and the first communication application stores first voice data. The second device sends the first voice data to the third device through the first communication application. The third device receives the first voice data from the second device through the first communication application.

[0023] In conjunction with the first aspect, in some embodiments, before the third device sends the first voice data to the fourth device via the second connection, the third device confirms that the fourth device is being worn by a user. Upon confirming that the fourth device is being worn by a user, the third device sends the first voice data to the fourth device via the second connection. If it is detected that the user is not wearing the fourth device, then the third device does not need to send the first voice data to the fourth device.

[0024] In conjunction with the first aspect, in some embodiments, before the second device sends the first voice data to the third device, the second device detects a fourth user operation. The second device confirms that the first contact has been selected. The second device sends a pairing invitation request to the third device, where the third device is the device of the first contact. The third device detects a fifth user operation. The third device sends a message to the second device confirming receipt of the pairing invitation request. For example, the fourth user operation may be a click operation on the second device, such as a mobile phone touchscreen. The fifth user operation may be a click operation on the third device, such as a mobile phone touchscreen.

[0025] After a first user successfully pairs with a specific contact (i.e., the first contact), they can wear the first device to communicate with that contact. Within a given time period, the first user's first device and second device can only establish a seamless chat session with one contact. The seamless chat session refers to the logical communication channel through which the first user communicates with the first contact via the first device.

[0026] In conjunction with the first aspect, in some embodiments, after the third device sends a message confirming receipt of the pairing invitation request to the second device, the second device, upon receiving the confirmation message from the third device, sends a notification to the first device. The first device issues a first notification message, which includes any one or more of the following: a notification sound, vibration, or indicator light. The first notification message is used to notify the user that pairing with the first contact has been successful.

[0027] In conjunction with the first aspect, in some embodiments, before the second device sends a pairing invitation request to the third device, the first device detects a sixth user operation, which includes any one or more of the following operations: tapping, pinching, sliding, and releasing. The first device sends a first instruction to the second device, which instructs the second device to send a pairing invitation request to the third device. The sixth user operation may be a pinching operation performed on a preset component of the first device, such as the temple of smart glasses.

[0028] In conjunction with the first aspect, in some embodiments, before the first device collects sound, the first device obtains information from the second device that the fourth device is being worn. The first device issues a second notification message to notify the user that the fourth device is being worn. The second notification message includes any one or more of the following: a notification sound, vibration, or indicator light. For example, before the first device detects each user operation and collects sound, the first device may issue different notification sounds to indicate to the user whether the other party's first contact is currently wearing the fourth device.

[0029] In conjunction with the first aspect, in some embodiments, the fourth device detects a seventh user operation, which includes any one or a combination of the following operations: tapping, pinching, sliding, and releasing. The seventh user operation may be a backward sliding operation applied to a preset component of the first device, such as the temple of smart glasses. In response to the seventh user operation, the fourth device cancels the playback of the first voice data. For example, a user can cancel / pause / interrupt the playback of currently playing or about-to-play voice data by sliding a sensor backward or forward on the temple of the smart glasses.

[0030] In conjunction with the first aspect, in some embodiments, unread voice data can be marked as unread, such as a red dot, in the chat session interface of the first communication application.

[0031] In conjunction with the first aspect, in some embodiments, when the third device receives the first text message on the first communication application, the third device performs speech recognition on the text message, converts it into third voice data, and then sends it to the fourth device, which plays the third voice data.

[0032] In conjunction with the first aspect, in some embodiments, wearable devices include: smart glasses, wireless earphones, smart bracelets, smartwatches, smart rings, smart earrings, smart necklaces, smart goggles, and smart helmets. When the wearable device is smart glasses, user operations performed on the smart glasses include any one or more of the following operations in combination: tapping, pinching, sliding, and releasing.

[0033] Secondly, embodiments of this application provide a communication method applied to a communication system, which includes a first device, a second device, a third device, and a fourth device. The communication method is executed by the second device, the first device and the fourth device are wearable devices, the first device establishes a first connection with the second device, and the third device establishes a second connection with the fourth device.

[0034] The method may include: a second device receiving first voice data from a first device through a first connection, wherein the first voice data is data generated by the first device collecting sound.

[0035] The second device sends the first voice data to the third device, the first voice data is sent to the fourth device through the third device, and the first voice data is played through the fourth device.

[0036] Implementing the second approach allows users to address their communication needs anytime, anywhere while wearing wearable devices such as smart glasses. This enables them to communicate with specific contacts without constantly holding their phones, freeing their hands and further improving human-computer interaction performance, providing users with greater communication convenience. This method can integrate the hardware and software capabilities of different devices, offering users a multifunctional, intelligent, and more convenient communication experience.

[0037] In conjunction with the second aspect, in some embodiments, the first voice data is voice data collected within a first time period. The first time period is a continuous period of time, the start time of which is the moment when the first device begins collecting sound, and the end time of the first time period is the moment when the first device ends collecting sound. The first voice data sent by the second device to the third device is carried in the voice message.

[0038] In conjunction with the second aspect, in some embodiments, the acquisition duration of the first voice data is the same as the playback duration.

[0039] In conjunction with the second aspect, in some embodiments, the first or second connection is a short-range communication connection, such as a Bluetooth connection, a hotspot connection, or a wireless fidelity point-to-point connection.

[0040] In conjunction with the second aspect, in some embodiments, a first communication application is installed on the second and third devices, the first communication application stores first voice data, and the second device sends the first voice data to the third device through the first communication application.

[0041] In conjunction with the second aspect, in some embodiments, after receiving the first voice data, the second device saves the first voice data. Saving voice messages allows users to easily listen to them again later, or avoids missing unlistened voice messages.

[0042] In conjunction with the second aspect, in some embodiments, the second device confirms that the first device is being worn by a user. The second device sends second voice data to the first device via the first connection. If it is detected that the user is not wearing the first device, the second device does not need to send the first voice data to the first device.

[0043] In conjunction with the second aspect, in some embodiments, the second device detects a fourth user action before sending the first voice data to the third device. The second device confirms that the first contact has been selected. The second device sends a pairing invitation request to the third device, which is the device of the first contact. The second device receives a message from the third device confirming receipt of the pairing invitation request. For example, the fourth user action could be a click operation on the second device, such as a mobile phone touchscreen.

[0044] In conjunction with the second aspect, in some embodiments, after the second device receives a message from the third device confirming receipt of the pairing invitation request, the second device sends a notification to the first device. The notification instructs the first device to issue a first prompt message, which includes any one or more of the following: a prompt sound, vibration, or indicator light. The first prompt message is used to notify the user that pairing with the first contact has been successful.

[0045] In conjunction with the second aspect, in some embodiments, before the second device sends a pairing invitation request to the third device, the second device receives a first instruction sent by the first device, the first instruction being used to notify the second device to send a pairing invitation request to the third device.

[0046] In conjunction with the second aspect, in some embodiments, the second device obtains information about the fourth device being worn through the third device. The second device notifies the first device to issue a second notification message. The second notification message is used to inform the user that the fourth device is being worn, and the second notification message includes any one or more of the following: a notification sound, vibration, or indicator light. For example, before the first device detects each user operation and collects sound, the first device may issue different notification sounds to indicate to the user whether the other party's first contact is currently wearing the fourth device.

[0047] In conjunction with the second aspect, in some embodiments, unread voice data can be marked as unread, such as a red dot, in the chat session interface of the first communication application.

[0048] In conjunction with the second aspect, in some embodiments, when the second device receives a first text message on the first communication application, the second device performs speech recognition on the text message, converts it into third voice data, and then sends it to the first device, which then plays the third voice data.

[0049] In conjunction with the second aspect, in some embodiments, wearable devices include: smart glasses, wireless earphones, smart bracelets, smartwatches, smart rings, smart earrings, smart necklaces, smart goggles, and smart helmets. When the wearable device is smart glasses, user operations performed on the smart glasses include any one or more of the following operations or combinations thereof: tapping, pinching, sliding, and releasing.

[0050] Thirdly, embodiments of this application provide a communication method applied to a communication system, which includes a first device, a second device, a third device, and a fourth device. The communication method is executed by the third device, the first device and the fourth device are wearable devices, the first device establishes a first connection with the second device, and the third device establishes a second connection with the fourth device.

[0051] The method includes: a third device receiving first voice data from a second device, wherein the first voice data is data generated by the first device collecting sound; the third device sending the first voice data to a fourth device via a second connection; and the first voice data being played by the fourth device.

[0052] Implementing the third approach allows users to address their communication needs anytime, anywhere while wearing wearable devices such as smart glasses. This enables them to communicate with specific contacts without constantly holding their phones, freeing their hands and further improving human-computer interaction performance, providing users with greater communication convenience. This method can integrate the hardware and software capabilities of different devices, offering users a multifunctional, intelligent, and more convenient communication experience.

[0053] In conjunction with the third aspect, in some embodiments, the first or second connection is a short-range communication connection, such as a Bluetooth connection, a hotspot connection, or a wireless fidelity point-to-point connection.

[0054] In conjunction with the third aspect, in some embodiments, the first voice data is voice data collected within a first time period, where the first time period is a continuous period of time. The start time of the first time period is the time when the first device begins collecting sound, and the end time of the first time period is the time when the first device ends collecting sound. The first voice data sent by the second device to the third device is carried in the voice message.

[0055] In conjunction with the third aspect, in some embodiments, the acquisition duration of the first voice data is the same as the playback duration.

[0056] In conjunction with the third aspect, in some embodiments, after receiving the first voice data, the third device saves the first voice data. Saving voice messages allows users to easily listen to them again later, or avoids missing unlistened voice messages.

[0057] In conjunction with the third aspect, in some embodiments, a first communication application is installed on both the third device and the second device, and the first communication application stores first voice data. The third device receives the first voice data from the second device through the first communication application.

[0058] In conjunction with the third aspect, in some embodiments, before the third device sends the first voice data to the fourth device via the second connection, the third device confirms that the fourth device is being worn by a user. If the third device confirms that the fourth device is being worn by a user, then the third device sends the first voice data to the fourth device via the second connection. If it is detected that the user is not wearing the fourth device, then the third device does not need to send the first voice data to the fourth device.

[0059] In conjunction with the third aspect, in some embodiments, before the third device sends the first voice data to the fourth device via the second connection, the third device receives a pairing invitation request from the second device, where the third device is the first contact. The third device detects a fifth user action. The third device sends a message to the second device confirming receipt of the pairing invitation request. The fifth user action may be a click operation on the third device, such as a mobile phone touchscreen.

[0060] After a first user successfully pairs with a specific contact (i.e., the first contact), they can wear the first device to communicate with that contact. Within a given time period, the first user's first device and second device can only establish a seamless chat session with one contact. The seamless chat session refers to the logical communication channel through which the first user communicates with the first contact via the first device.

[0061] In conjunction with the third aspect, in some embodiments, after the third device confirms that the fourth device is being worn by the user, the third device notifies the second device that the fourth device is being worn by the user.

[0062] In conjunction with the third aspect, in some embodiments, unread voice data can be marked as unread, such as a red dot, in the chat session interface of the first communication application.

[0063] In conjunction with the third aspect, in some embodiments, when the third device receives the first text message on the first communication application, the third device performs speech recognition on the text message, converts it into third voice data, and then sends it to the fourth device, which plays the third voice data.

[0064] In conjunction with the third aspect, in some embodiments, wearable devices include: smart glasses, wireless earphones, smart bracelets, smartwatches, smart rings, smart earrings, smart necklaces, smart goggles, and smart helmets. When the wearable device is smart glasses, user operations performed on the smart glasses include any one or more of the following operations in combination: tapping, pinching, sliding, and releasing.

[0065] Fourthly, embodiments of this application provide a communication method applied to a communication system, which includes a first device, a second device, a third device, and a fourth device. The communication method is executed by the first device, and the first and fourth devices are wearable devices. The first device establishes a first connection with the second device, and the third device establishes a second connection with the fourth device.

[0066] The method includes: a first device detecting a first user operation, the first user operation instructing the first device to start collecting sound; the first device collecting sound; the first device ending sound collection and generating first voice data, the first voice data being the collected sound data.

[0067] The first device sends first voice data to the second device through the first connection. The first voice data is then sent to the fourth device through the second and third devices, and is played back through the fourth device.

[0068] Implementing the fourth approach allows users to address their communication needs anytime, anywhere while wearing wearable devices such as smart glasses. This enables them to communicate with specific contacts without constantly holding their phones, freeing their hands and further improving human-computer interaction performance, providing users with greater communication convenience. This method can integrate the hardware and software capabilities of different devices, offering users a multifunctional, intelligent, and more convenient communication experience.

[0069] In conjunction with the fourth aspect, in some embodiments, the first or second connection is a short-range communication connection, such as a Bluetooth connection, a hotspot connection, or a wireless fidelity point-to-point connection.

[0070] In conjunction with the fourth aspect, in some embodiments, the first voice data is voice data collected within a first time period, where the first time period is a continuous period of time. The start time of the first time period is the time when the first device begins collecting sound, and the end time of the first time period is the time when the first device ends collecting sound. The first voice data sent by the second device to the third device is carried in the voice message.

[0071] In conjunction with the fourth aspect, in some embodiments, the acquisition duration of the first voice data is the same as the playback duration.

[0072] In conjunction with the fourth aspect, in some embodiments, if the first device receives second voice data sent by the second device within a first time period, then after the sound collection ends, the first device plays the second voice data. The second voice data may be voice data collected by a third or fourth device, sent from the third device to the second device, and then to the first device.

[0073] In conjunction with the fourth aspect, in some embodiments, the first user operation includes any one or more of the following operations or combinations thereof: tapping, pinching, sliding, releasing, etc. The first user operation can be applied to a preset component or preset area of ​​the first device. For example, when the first device is smart glasses, the preset component is the temple of the smart glasses, and the first user operation can be a tapping, pinching, sliding, releasing, etc., applied to the temple of the smart glasses.

[0074] In conjunction with the fourth aspect, in some embodiments, before the first device ends sound acquisition, the first device detects a second user operation, the second user operation being used to instruct the first device to end sound acquisition.

[0075] In conjunction with the fourth aspect, in some embodiments, the second user operation includes any one or more of the following operations or combinations thereof: tapping, pinching, sliding, and releasing. The second user operation can act on a preset component or preset area of ​​the first device. For example, when the first device is smart glasses, the preset component is the temple of the smart glasses, and the second user operation can be an operation that releases a press / release state on the temple of the smart glasses.

[0076] In conjunction with the fourth aspect, in some embodiments, the first device can automatically determine the end of the acquisition. For example, if no sound is detected for more than 2 seconds, the acquisition of voice will automatically end without manual operation by the user.

[0077] In conjunction with the fourth aspect, in some embodiments, before the first device sends the first voice data to the second device via the first connection, the first device detects a third user operation, which includes any one or more of the following operations: tapping, pinching, sliding, and releasing. In response to the third user operation, the first device sends the first voice data to the second device via the first connection. For example, the third user operation could be a forward sliding action performed on a preset component of the first device (such as the temple of smart glasses).

[0078] In conjunction with the fourth aspect, in some embodiments, the first device detects that it is being worn by a user. The first device notifies the second device that the first device is being worn by a user.

[0079] In conjunction with the fourth aspect, in some embodiments, before the first device collects sound, the first device obtains information from the second device that the fourth device is being worn. The first device issues a second notification message to notify the user that the fourth device is being worn. The second notification message includes any one or more of the following: a notification sound, vibration, or indicator light. For example, before the first device detects each user operation and collects sound, the first device may issue different notification sounds to indicate to the user whether the other party's first contact is currently wearing the fourth device.

[0080] In conjunction with the fourth aspect, in some embodiments, before the first device sends the first voice data to the second device via the first connection, the first device receives a message from the second device confirming receipt of the pairing invitation request from the third device. The first device issues a first notification message, which includes any one or more of the following: a notification sound, vibration, or indicator light. The first notification message is used to notify the user that pairing with the first contact has been successful.

[0081] In conjunction with the fourth aspect, in some embodiments, before the first device receives a message from the second device confirming receipt of the pairing invitation request from the third device, the first device detects a sixth user operation. The sixth user operation includes any one or more of the following operations: tapping, pinching, sliding, and releasing. The first device sends a first instruction to the second device, which instructs the second device to send a pairing invitation request to the third device. The sixth user operation may be a pinching operation performed on a preset component of the first device, such as the temple of smart glasses.

[0082] In conjunction with the fourth aspect, in some embodiments, the unread voice data can be marked as an unread message, such as a red dot, in the chat session interface of the first communication application.

[0083] In conjunction with the fourth aspect, in some embodiments, when the second device receives the first text message on the first communication application, the second device performs speech recognition on the text message, converts it into third voice data, and then sends it to the first device, which then plays the third voice data.

[0084] In conjunction with the fourth aspect, in some embodiments, wearable devices include: smart glasses, wireless earphones, smart bracelets, smartwatches, smart rings, smart earrings, smart necklaces, smart goggles, and smart helmets. When the wearable device is smart glasses, user operations performed on the smart glasses include any one or more of the following operations in combination: tapping, pinching, sliding, and releasing.

[0085] Fifthly, embodiments of this application provide a communication method applied to a communication system, the communication system including a first device, a second device, a third device, and a fourth device, wherein the communication method is executed by the fourth device, the first device and the fourth device are wearable devices, the first device establishes a first connection with the second device, and the third device establishes a second connection with the fourth device.

[0086] The method includes: The fourth device receives the first voice data from the third device through the second connection, wherein the first voice data is data generated by the first device collecting sound.

[0087] The fourth device plays the first voice data.

[0088] Implementing the fifth approach allows users to address their communication needs anytime, anywhere while wearing wearable devices such as smart glasses. This enables them to communicate with specific contacts without constantly holding their phones, freeing their hands and further improving human-computer interaction performance, providing users with greater communication convenience. This method can integrate the hardware and software capabilities of different devices, offering users a multifunctional, intelligent, and more convenient communication experience.

[0089] In conjunction with the fifth aspect, in some embodiments, the first connection or the second connection is a short-range communication connection, such as a Bluetooth connection, a hotspot connection, or a wireless fidelity point-to-point connection.

[0090] In conjunction with the fifth aspect, in some embodiments, the acquisition duration of the first voice data is the same as the playback duration.

[0091] In conjunction with the fifth aspect, in some embodiments, the first voice data is voice data collected within a first time period, where the first time period is a continuous period of time. The start time of the first time period is the time when the first device begins collecting sound, and the end time of the first time period is the time when the first device ends collecting sound. The first voice data sent by the second device to the third device is carried in the voice message.

[0092] In conjunction with the fifth aspect, in some embodiments, a first communication application is installed on the second and third devices, and the first communication application stores first voice data.

[0093] In conjunction with the fifth aspect, in some embodiments, the fourth device can detect whether it is being worn by a user, and the fourth device can notify the third device whether it is currently being worn by a user.

[0094] In conjunction with the fifth aspect, in some embodiments, the fourth device can obtain whether the first device is being worn through the third device. The fourth device issues a third notification message to notify the user that the first device is being worn. The third notification message includes any one or more of the following: a notification sound, vibration, or indicator light.

[0095] In conjunction with the fifth aspect, in some embodiments, the fourth device detects a seventh user operation, which includes any one or more of the following operations: tapping, pinching, sliding, and releasing. The seventh user operation may be a backward sliding operation performed on a preset component of the first device, such as the temple of smart glasses. In response to the seventh user operation, the fourth device cancels the playback of the first voice data. For example, a user can cancel / pause / interrupt the playback of a currently playing or about-to-play voice message by sliding a sensor backward or forward on the temple of the smart glasses.

[0096] In conjunction with the fifth aspect, in some embodiments, an unread voice message can be marked as an unread marker, such as a red dot, in the chat session interface of the first communication application.

[0097] In conjunction with the fifth aspect, in some embodiments, the fourth device can play third voice data from the third device. The third voice data is voice data generated by the third device performing speech recognition on the text message when it receives the first text message on the first communication application. After receiving the third voice data sent by the third device, the fourth device can play the third voice data.

[0098] In conjunction with the fifth aspect, in some embodiments, wearable devices include: smart glasses, wireless earphones, smart bracelets, smartwatches, smart rings, smart earrings, smart necklaces, smart goggles, and smart helmets. When the wearable device is smart glasses, user operations performed on the smart glasses include any one or more of the following operations in combination: tapping, pinching, sliding, and releasing.

[0099] Sixthly, embodiments of this application provide a communication method applied to a communication system, the communication system including a first device, a second device, a third device and a fourth device, wherein the first device and the fourth device are wearable devices, the first device establishes a first connection with the second device, and the third device establishes a second connection with the fourth device.

[0100] The method includes: The second device receives the first voice data generated by the sound collected by the first device through the first connection. After receiving the first voice data, the second device sends the first voice data to the third device. After receiving the first voice data, the third device sends the first voice data to the fourth device via the second connection. The first voice data is then played back by the fourth device.

[0101] Implementing the sixth approach allows users to address their communication needs anytime, anywhere while wearing wearable devices such as smart glasses. This enables them to communicate with specific contacts without constantly holding their phones, freeing their hands and further improving human-computer interaction performance, providing users with greater communication convenience. This method can integrate the hardware and software capabilities of different devices, offering users a multifunctional, intelligent, and more convenient communication experience.

[0102] In conjunction with the sixth aspect, in some embodiments, the first connection or the second connection is a short-range communication connection, such as a Bluetooth connection, a hotspot connection, or a wireless fidelity point-to-point connection.

[0103] In conjunction with the sixth aspect, in some embodiments, the first voice data is voice data collected within a first time period, where the first time period is a continuous period of time. The start time of the first time period is the time when the first device begins collecting sound, and the end time of the first time period is the time when the first device ends collecting sound. The first voice data sent by the second device to the third device is carried in the voice message.

[0104] In conjunction with the sixth aspect, in some embodiments, the acquisition duration of the first voice data is the same as the playback duration.

[0105] In conjunction with the sixth aspect, in some embodiments, after receiving the first voice data, the second device saves the first voice data. After receiving the first voice data, the third device saves the first voice data. Saving voice messages allows users to easily listen to them again later or avoids missing unlistened voice messages.

[0106] In conjunction with the sixth aspect, in some embodiments, a first communication application is installed on both the second and third devices, and the first communication application stores first voice data. The second device sends the first voice data to the third device through the first communication application. The third device receives the first voice data from the second device through the first communication application.

[0107] In conjunction with the sixth aspect, in some embodiments, before the third device sends the first voice data to the fourth device via the second connection, the third device confirms that the fourth device is being worn by a user. If the third device confirms that the fourth device is being worn by a user, then the third device sends the first voice data to the fourth device via the second connection. If it is detected that the user is not wearing the fourth device, then the third device does not need to send the first voice data to the fourth device.

[0108] In conjunction with the sixth aspect, in some embodiments, before the second device sends the first voice data to the third device, the second device detects a fourth user operation. The second device confirms that the first contact has been selected. The second device sends a pairing invitation request to the third device, where the third device is the device of the first contact. The third device detects a fifth user operation. The third device sends a message to the second device confirming receipt of the pairing invitation request. For example, the fourth user operation may be a click operation on the second device, such as a mobile phone touchscreen. The fifth user operation may be a click operation on the third device, such as a mobile phone touchscreen.

[0109] After a first user successfully pairs with a specific contact (i.e., the first contact), they can wear the first device to communicate with that contact. Within a given time period, the first user's first device and second device can only establish a seamless chat session with one contact. The seamless chat session refers to the logical communication channel through which the first user communicates with the first contact via the first device.

[0110] In conjunction with the sixth aspect, in some embodiments, after the third device sends a message confirming receipt of the pairing invitation request to the second device, the second device, upon receiving the confirmation message from the third device, sends a notification to the first device. This notification instructs the first device to issue a first prompt message, which includes any one or more of the following: a prompt sound, vibration, or indicator light. The first prompt message is used to notify the user that pairing with the first contact has been successful.

[0111] In conjunction with the sixth aspect, in some embodiments, before the second device sends a pairing invitation request to the third device, the second device receives a first instruction sent by the first device, the first instruction being used to notify the second device to send a pairing invitation request to the third device.

[0112] In conjunction with the sixth aspect, in some embodiments, the second device obtains information about the fourth device being worn through the third device. The second device notifies the first device to issue a second notification message. The second notification message is used to inform the user that the fourth device is being worn, and the second notification message includes any one or more of the following: a notification sound, vibration, or indicator light. For example, before the first device detects each user operation and collects sound, the first device may issue different notification sounds to indicate to the user whether the other party's first contact is currently wearing the fourth device.

[0113] In conjunction with the sixth aspect, in some embodiments, after the third device confirms that the fourth device is being worn by the user, the third device notifies the second device that the fourth device is being worn by the user.

[0114] In conjunction with the sixth aspect, in some embodiments, unread voice data can be marked with an unread flag, such as a red dot, in the chat session interface of the first communication application.

[0115] In conjunction with the sixth aspect, in some embodiments, when the third device receives the first text message on the first communication application, the third device performs speech recognition on the text message, converts it into third voice data, and then sends it to the fourth device, which plays the third voice data.

[0116] In conjunction with the sixth aspect, in some embodiments, the wearable device includes: smart glasses, wireless earphones, smart bracelets, smartwatches, smart rings, smart earrings, smart necklaces, smart goggles, and smart helmets. When the wearable device is smart glasses, user operations performed on the smart glasses include any one or more of the following operations or combinations thereof: tapping, pinching, sliding, and releasing.

[0117] In a seventh aspect, embodiments of this application provide a communication method applied to a communication system, the communication system including a first device, a second device, a third device and a fourth device, wherein the first device and the fourth device are wearable devices, the first device establishes a first connection with the second device, and the third device establishes a second connection with the fourth device.

[0118] The method includes: a first device detecting a first user operation, the first user operation being used to instruct the first device to start collecting sound.

[0119] The first device collects sound. After the first device finishes collecting sound, it generates the first voice data, which is the data of the collected sound.

[0120] The first device sends first voice data to the second device via a first connection. After receiving the first voice data, the second device sends the first voice data to the third device. The first voice data is then sent to the fourth device via the third device, and played back via the fourth device.

[0121] Implementing the seventh approach allows users to address their communication needs anytime, anywhere while wearing wearable devices such as smart glasses. This enables them to communicate with specific contacts without constantly holding their phones, freeing their hands and further improving human-computer interaction performance, providing users with greater communication convenience. This method can integrate the hardware and software capabilities of different devices, offering users a multifunctional, intelligent, and more convenient communication experience.

[0122] In conjunction with the seventh aspect, in some embodiments, the first connection or the second connection is a short-range communication connection, such as a Bluetooth connection, a hotspot connection, or a wireless fidelity point-to-point connection.

[0123] In conjunction with the seventh aspect, in some embodiments, the first voice data is voice data collected within a first time period, where the first time period is a continuous period of time. The start time of the first time period is the time when the first device begins collecting sound, and the end time of the first time period is the time when the first device ends collecting sound. The first voice data sent by the second device to the third device is carried in a voice message.

[0124] In conjunction with the seventh aspect, in some embodiments, if the first device receives second voice data sent by the second device within a first time period, then after the sound collection ends, the first device plays the second voice data. The second voice data may be voice data collected by a third or fourth device, sent from the third device to the second device, and then to the first device.

[0125] In conjunction with the seventh aspect, in some embodiments, the acquisition duration of the first voice data is the same as the playback duration.

[0126] In conjunction with the seventh aspect, in some embodiments, the first user operation includes any one or more of the following operations or combinations thereof: tapping, pinching, sliding, releasing, etc. The first user operation can be applied to a preset component or preset area of ​​the first device. For example, when the first device is smart glasses, the preset component is the temple of the smart glasses, and the first user operation can be a tapping, pinching, sliding, releasing, etc., applied to the temple of the smart glasses.

[0127] In conjunction with the seventh aspect, in some embodiments, before the first device ends sound acquisition, the first device detects a second user operation, the second user operation being used to instruct the first device to end sound acquisition.

[0128] In conjunction with the seventh aspect, in some embodiments, the second user operation includes any one or more of the following operations or combinations thereof: tapping, pinching, sliding, and releasing. The second user operation can act on a preset component or preset area of ​​the first device. For example, when the first device is smart glasses, the preset component is the temple of the smart glasses, and the second user operation can be an operation that releases a press / release state on the temple of the smart glasses.

[0129] In conjunction with the seventh aspect, in some embodiments, the first device can automatically determine the end of the acquisition. For example, if no sound is detected for more than 2 seconds, the acquisition of voice will automatically end without manual operation by the user.

[0130] In conjunction with the seventh aspect, in some embodiments, before the first device sends the first voice data to the second device via the first connection, the first device detects a third user operation. The third user operation is an operation instructing the transmission of the first voice data, and includes any one or more of the following operations or combinations thereof: tapping, pinching, sliding, and releasing. For example, the third user operation could be a forward sliding operation acting on a preset component of the first device (such as the temple of smart glasses). In response to the third user operation, the first device sends the first voice data to the second device via the first connection.

[0131] In conjunction with the seventh aspect, in some embodiments, after receiving the first voice data, the second device saves the first voice data. Saving voice messages allows users to easily listen to them again later, or avoids missing unlistened voice messages.

[0132] In conjunction with the seventh aspect, in some embodiments, a first communication application is installed on both the second and third devices, and the first communication application stores first voice data. The second device sends the first voice data to the third device through the first communication application.

[0133] In conjunction with the seventh aspect, in some embodiments, the second device detects a fourth user action before sending the first voice data to the third device. The second device confirms that the first contact has been selected. The second device sends a pairing invitation request to the third device, which is the device of the first contact. The second device receives a message from the third device confirming receipt of the pairing invitation request. For example, the fourth user action could be a click operation on the second device, such as a mobile phone touchscreen.

[0134] After a first user successfully pairs with a specific contact (i.e., the first contact), they can wear the first device to communicate with that contact. Within a given time period, the first user's first device and second device can only establish a seamless chat session with one contact. The seamless chat session refers to the logical communication channel through which the first user communicates with the first contact via the first device.

[0135] In conjunction with the seventh aspect, in some embodiments, after the second device receives a message from the third device confirming receipt of the pairing invitation request, the second device sends a notification to the first device. The notification instructs the first device to issue a first prompt message. The first prompt message includes any one or more of the following: a prompt sound, vibration, or indicator light. The first prompt message is used to notify the user that pairing with the first contact has been successful.

[0136] In conjunction with the seventh aspect, in some embodiments, before the second device sends a pairing invitation request to the third device, the first device detects a sixth user operation, which includes any one or more of the following operations: tapping, pinching, sliding, and releasing. The first device sends a first instruction to the second device, which instructs the second device to send a pairing invitation request to the third device. The sixth user operation may be a pinching operation performed on a preset component of the first device, such as the temple of smart glasses.

[0137] In conjunction with the seventh aspect, in some embodiments, before the first device collects sound, the first device obtains information from the second device that the fourth device is being worn. The first device issues a second notification message to notify the user that the fourth device is being worn. The second notification message includes any one or more of the following: a notification sound, vibration, or indicator light. For example, before the first device detects each user operation and collects sound, the first device may issue different notification sounds to indicate to the user whether the other party's first contact is currently wearing the fourth device.

[0138] In conjunction with the seventh aspect, in some embodiments, unread voice data can be marked with an unread flag, such as a red dot, in the chat session interface of the first communication application.

[0139] In conjunction with the seventh aspect, in some embodiments, the wearable device includes: smart glasses, wireless earphones, smart bracelets, smartwatches, smart rings, smart earrings, smart necklaces, smart goggles, and smart helmets. When the wearable device is smart glasses, user operations performed on the smart glasses include any one or more of the following operations or combinations thereof: tapping, pinching, sliding, and releasing.

[0140] Eighthly, embodiments of this application provide an electronic device that may include: a communication device, a memory, and a processor coupled to the memory, multiple application programs, and one or more programs. The memory stores computer-executable instructions, which, when executed by the processor, enable the electronic device to perform any of the functions of the second device described in the second aspect.

[0141] In a ninth aspect, embodiments of this application provide an electronic device that may include: a communication device, a memory, and a processor coupled to the memory, multiple application programs, and one or more programs. The memory stores computer-executable instructions, which, when executed by the processor, enable the electronic device to perform any of the functions described in the third aspect of the application.

[0142] In a tenth aspect, embodiments of this application provide an electronic device that may include: a communication device, a memory, and a processor coupled to the memory, multiple application programs, and one or more programs. The memory stores computer-executable instructions, which, when executed by the processor, enable the electronic device to perform any of the functions possessed by the first device in the fourth aspect.

[0143] Eleventhly, embodiments of this application provide an electronic device that may include: a communication device, a memory, and a processor coupled to the memory, multiple application programs, and one or more programs. The memory stores computer-executable instructions, which, when executed by the processor, enable the electronic device to perform any of the functions of the fourth device in the fifth aspect.

[0144] In a twelfth aspect, embodiments of this application provide a communication system that may include the first device, second device, third device, fourth device, etc., described in the foregoing aspects. It is understood that, based on the same inventive concept, in the communication system of the twelfth aspect, the first device may implement the steps performed by the first device in the fourth aspect when it performs the corresponding function; the second device may implement the steps performed by the second device in the second aspect when it performs the corresponding function; the third device may implement the steps performed by the third device in the third aspect when it performs the corresponding function; and the fourth device may implement the steps performed by the fourth device in the fifth aspect when it performs the corresponding function. Further details will not be elaborated here.

[0145] In a thirteenth aspect, embodiments of this application provide a communication system that may include the first device, second device, third device, fourth device, etc., described in the foregoing aspects. It is understood that, based on the same inventive concept, in the communication system of the thirteenth aspect, the second device may implement the steps performed by the second device in the method of the second aspect when it performs the corresponding function, and the third device may implement the steps performed by the third device in the method of the third aspect when it performs the corresponding function; further details will not be elaborated here.

[0146] In a fourteenth aspect, embodiments of this application provide a communication system that may include the first device, second device, third device, fourth device, etc., described in the foregoing aspects. It is understood that, based on the same inventive concept, the first device in the communication system of the fourteenth aspect may implement the steps performed by the first device in the fourth aspect when it performs the corresponding function, and the second device may implement the steps performed by the second device in the method of the second aspect when it performs the corresponding function; further details will not be elaborated here.

[0147] In a fifteenth aspect, embodiments of this application provide a computer storage medium storing a computer program, the computer program including executable instructions, which, when executed by a processor, cause the processor to perform operations corresponding to the methods provided in the second, third, fourth, or fifth aspects.

[0148] In a sixteenth aspect, embodiments of this application provide a computer program product that, when run on an electronic device, causes the electronic device to perform any possible implementation of the second, third, fourth, or fifth aspect.

[0149] In a seventeenth aspect, embodiments of this application provide a chip system that can be applied to an electronic device. The chip includes one or more processors that invoke computer instructions to cause the electronic device to implement any possible implementation as described in the second, third, fourth, or fifth aspects.

[0150] By implementing the aspects provided in this application, users can meet their communication needs anytime, anywhere while wearing wearable devices such as smart glasses, communicating with specific contacts without constantly holding their phones, thus freeing their hands, further improving human-computer interaction performance, and providing users with greater communication convenience. This method can integrate the hardware and software capabilities of different devices, providing users with a multifunctional, intelligent, and more convenient communication experience. Attached Figure Description

[0151] Figure 1 This is a schematic diagram of the structure of a smart wearable device provided in an embodiment of this application; Figure 2 A schematic diagram of the hardware structure of the electronic device provided in the embodiments of this application; Figure 3A A schematic diagram of a communication system provided in an embodiment of this application; Figure 3B This application provides a schematic diagram of the functional modules of a communication system according to an embodiment of the present application. Figure 4 A schematic diagram of a communication system provided in an embodiment of this application; Figure 5 This application provides a schematic diagram of a user interaction operation as an embodiment. Figure 6 This application provides a schematic diagram of a user interaction operation as an embodiment. Figure 7 This application provides a schematic diagram of a user interaction operation. Figure 8 A schematic diagram illustrating a business scenario provided in an embodiment of this application; Figure 9 A schematic diagram illustrating a business scenario provided in an embodiment of this application; Figure 10 A schematic diagram of the user interface provided for an embodiment of this application; Figure 11 A schematic diagram of the user interface provided for an embodiment of this application; Figure 12 A schematic diagram of the user interface provided for an embodiment of this application; Figure 13 A schematic diagram of the user interface provided for an embodiment of this application; Figure 14 A schematic diagram of the user interface provided for an embodiment of this application; Figure 15 A schematic diagram of the user interface provided for an embodiment of this application; Figure 16 A schematic diagram of the user interface provided for an embodiment of this application; Figure 17 A schematic diagram of the user interface provided for an embodiment of this application; Figure 18 A schematic diagram of the user interface provided for an embodiment of this application; Figure 19 A schematic diagram of the user interface provided for an embodiment of this application; Figure 20 A schematic diagram of the user interface provided for an embodiment of this application; Figure 21 A flowchart illustrating a communication method provided in an embodiment of this application. Detailed Implementation

[0152] The technical solutions in the embodiments of this application will be clearly and thoroughly described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; the word "and / or" in the text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone.

[0153] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more.

[0154] In the following embodiments of this application, the term "user interface (UI)" refers to the medium interface through which an application (APP) or operating system (OS) interacts and exchanges information with the user. It realizes the conversion between the internal form of information and the form that the user can accept. The user interface is source code written in a specific computer language such as Java or Extensible Markup Language (XML). The interface source code is parsed and rendered on the electronic device, ultimately presenting content that the user can recognize. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be visual interface elements such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets displayed on the screen of an electronic device.

[0155] This application provides a communication method applied to smart wearable devices. This method allows the smart wearable device to act as a carrier, fulfilling the user's communication needs, including functions such as voice calls, video chats, and information processing and transmission. For example, while wearing smart glasses, users can use quick operations such as pinching, sliding, and tapping on the temples of the glasses to efficiently and conveniently send or receive voice messages through the data channel of a communication application on their mobile phone, enabling communication with other users. The technical solution provided in this application can integrate the hardware and software capabilities of different devices, offering users a multifunctional, intelligent, and more convenient communication experience.

[0156] By implementing the technical solution provided in this application, users can meet their communication needs anytime and anywhere while wearing wearable devices. Furthermore, users do not need to hold their mobile phones at all times during communication, freeing their hands, further improving human-computer interaction performance, and providing users with more communication convenience.

[0157] The smart wearable device involved in this application embodiment can be smart glasses, worn on the user's head. In addition to the optical correction, adjustment of visible light or decoration functions of ordinary glasses, it also has communication functions.

[0158] Not limited to smart glasses as an example, the smart wearable devices involved in the embodiments of this application can also be other smart wearable devices that include communication functions, such as head-mounted display devices that can realize technologies such as augmented reality (AR), virtual reality (VR), and mixed reality (MR), or smart headphones, smartwatches, smart bracelets, smart necklaces, smart rings, smart goggles, smart helmets, smart earrings, etc. The embodiments of this application do not limit this.

[0159] In this embodiment of the application, the smart wearable device can trigger corresponding instructions when it detects user operations such as touch, gesture, head movement, and eye movement.

[0160] See Figure 1 , Figure 1 A schematic diagram of an electronic device 100 is shown. In this embodiment, the electronic device 100 is exemplified as smart glasses.

[0161] like Figure 1 As shown, the electronic device 100 may include an eyeglass body 101, and a speaker 104, a microphone 105, a communication device 106, a sensor module 107, and a processor (not shown) disposed on the eyeglass body, etc.

[0162] The glasses body 101 may include a glasses frame 102 and a display device 103, with the display device 103 embedded in the glasses frame 102.

[0163] The eyeglass frame 102 is used to support the user when wearing the electronic device 100 on their head. Typically, the eyeglass frame 102 includes two temples, which are respectively located behind the two spectacle lenses 103. When the user wears the electronic device 100, the two temples rest on the user's two ears.

[0164] The display device 103 is used by users to view real-world objects or virtual images.

[0165] The display device 103 may be a transparent lens or a lens of other colors, a spectacle lens with optical correction function, a lens with adjustable filtering function, sunglasses, or other lenses with decorative effects.

[0166] The display device 103 can also be a display screen or a projection device, which can generate optical signals and project the optical signals into the user's eyes.

[0167] This embodiment does not limit the type of display device 103. In some embodiments, there may be no display device 103, that is, the glasses body 101 may only include a glasses frame 102.

[0168] The speaker 104 is used to play audio and can be positioned on the rear side of the eyeglasses frame 102, closer to the user's ear, which allows the user to hear the sound played by the speaker 104 more clearly.

[0169] Microphone 105 is mounted on the eyeglass frame 102 and is used to collect sound, such as the user's voice information. Electronic device 100 can collect the user's voice information through microphone 105 and parse it to generate corresponding control commands. Alternatively, electronic device 100 can collect the user's voice information through microphone 105 and send it to other electronic devices through communication device 106 for voice communication.

[0170] The communication device 106 is disposed within the eyeglass frame 102 and is used to transmit communication signals, including receiving and sending communication signals such as voice information and control commands. In some embodiments, the electronic device 100 can establish a communication connection with other electronic devices, such as mobile phones and computers, through the communication device 106.

[0171] The communication connection provided by communication device 106 can be, but is not limited to, wired or wireless connections. For example, wireless connections can be short-range transmission technologies such as Wi-Fi, Bluetooth, Near Field Communication (NFC), and ZigBee. Wired connections can be Universal Serial Bus (USB), High Definition Multimedia Interface (HDMI), or DisplayPort (DP). This embodiment does not limit the type of communication connection.

[0172] The sensor module 107 is used to detect user operations and identify user control commands. The sensor module 107 is mounted on the eyeglass frame 102, located on the side, so as not to obstruct the user's view during interactive operations. The sensor module 107 may include, but is not limited to, a pressure sensor 107A, a vibration sensor 107B, a slide sensor 108C, etc. This embodiment does not limit the number and type of sensors included in the electronic device 100.

[0173] The pressure sensor 107A can be used to sense the user's pressing or tapping operation and feed it back to the processor, which then generates corresponding instructions. For example, the user can answer an incoming call by pressing the pressure sensor 107A.

[0174] The vibration sensor 107B is used to provide vibration feedback. For example, the vibration sensor 107B can vibrate briefly to alert the user that a new voice message has been received.

[0175] The swipe sensor 108C can be used to sense the user's swipe operation and feed it back to the processor, which then generates corresponding instructions. For example, when the user's touch operation is applied to the swipe sensor 108C, swiping forward corresponds to an instruction to increase the volume, and swiping backward corresponds to an instruction to decrease the volume.

[0176] In addition to obtaining touch signals from the pressure sensor 107A or the slide sensor 108C, the electronic device 100 may also be equipped with physical buttons to obtain user commands, such as generating control commands by pressing the physical buttons.

[0177] In some embodiments, the electronic device 100 may also include an inertial measurement unit (IMU). An IMU is a sensor used to detect and measure acceleration and rotational motion, and may include accelerometers, angular velocity meters (or gyroscopes), etc. An accelerometer is a sensor that senses axial acceleration and converts it into a usable output signal, and a gyroscope is a sensor that senses the angular velocity of a moving body relative to inertial space.

[0178] The processor (not shown) is used to parse signals or generate instructions, as well as process data and coordinate scheduling processes.

[0179] In other embodiments, the electronic device 100 may be equipped with a bone conduction sensor as an audio playback device for outputting sound to the user. When the audio playback device is a bone conduction sensor, the two temples of the eyeglass frame 102 may have abutment portions, and the bone conduction sensor may be disposed at the abutment portions. When the user wears the electronic device 100, the abutment portions abut against the skull in front of the ear, thereby generating vibrations that allow sound waves to be conducted through the skull and bony labyrinth to the inner ear. The position of the abutment portions, being directly close to the skull, can reduce vibration loss, allowing the user to hear audio more clearly.

[0180] In other embodiments, the electronic device 100 can also capture the user's hand gestures through a camera for gesture control, etc.

[0181] In addition, the electronic device 100 may also be provided with a charging interface (not shown) for providing wired or wireless charging.

[0182] It is understood that the structure of the electronic device 100 described above is merely illustrative and does not constitute a limitation on other embodiments of this application.

[0183] Figure 2 This is a schematic diagram of the hardware structure of the electronic device 100 provided in an embodiment of this application.

[0184] Figure 2 This explanation uses smart glasses as an example of electronic device 100. This application does not limit the specific type of electronic device 100. When electronic device 100 is other electronic devices, such as VR / AR / MR glasses, mobile phones, personal computers (PCs), portable Android devices (PADs), desktop computers, laptops, handheld computers, ultra-mobile personal computers (UMPCs), netbooks, cellular phones, personal digital assistants (PDAs), artificial intelligence (AI) devices, smartwatches or smart bracelets, and other wearable devices, in-vehicle devices, smart home devices, and / or smart city devices, some hardware structures can be added or removed.

[0185] Electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display device 194, an eye-tracking module 195, a SIM card interface 196, etc. The sensor module 180 may include a pressure sensor 180A, a touch sensor 180B, a gyroscope sensor 180C, an accelerometer sensor 180D, a bone conduction sensor 180E, etc.

[0186] It is understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0187] Processor 110 is typically used to control the overall operation of electronic device 100 and may include one or more processing units. For example, processor 110 may include a central processing unit (CPU), application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), video processing unit (VPU), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution.

[0188] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.

[0189] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0190] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs can enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0191] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0192] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, a serial peripheral interface (SPI) interface, etc.

[0193] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180E, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180E through the I2C interface, enabling the processor 110 and the touch sensor 180E to communicate through the I2C bus interface, thereby realizing the touch function of the electronic device 100.

[0194] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface.

[0195] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface. Both the I2S interface and the PCM interface can be used for audio communication.

[0196] The UART interface is a general-purpose serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication.

[0197] In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to play audio.

[0198] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display device 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the electronic device 100 to capture images. The processor 110 and the display device 194 communicate via the DSI interface to enable the electronic device 100 to display images.

[0199] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display device 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0200] USB interface 130 is a USB standard compliant interface, specifically a Mini USB interface, Micro USB interface, USB Type-C interface, etc. USB interface 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. This interface can also be used to connect other electronic devices, such as mobile phones, PCs, smart TVs, etc. The USB interface can be USB 3.0, used for compatibility with high-speed display port (DP) signal transmission, enabling the transmission of high-speed audio and video data.

[0201] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0202] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.

[0203] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, display device 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.

[0204] Electronic device 100 may include wireless communication capabilities, such as receiving and playing voice information from other electronic devices (e.g., mobile phones or cloud servers). The wireless communication capability may be implemented via an antenna (not shown), a mobile communication module 150 or a wireless communication module 160, a modem processor (not shown), and a baseband processor (not shown).

[0205] Antennas are used to transmit and receive electromagnetic wave signals. Electronic device 100 may include multiple antennas, each capable of covering one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antennas can be multiplexed as diversity antennas for a wireless local area network. In some other embodiments, antennas can be used in conjunction with tuning switches.

[0206] The mobile communication module 150 can provide solutions for wireless communication applications on the electronic device 100, including 2G, 3G, 4G, and 5G networks. The mobile communication module 150 may include at least one filter, switch, power amplifier, low-noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via an antenna, filter and amplify the received electromagnetic waves, and transmit them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and radiate it as electromagnetic waves via the antenna. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0207] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through a display device 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0208] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via an antenna, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive signals to be transmitted from the processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via the antenna.

[0209] In some embodiments, the antenna of the electronic device 100 is coupled to the mobile communication module 150 and the wireless communication module 160, enabling the electronic device 100 to communicate with networks and other devices via wireless communication technology. This wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies. GNSS may include Global Positioning System (GPS), Global Navigation Satellite System (GLONASS), BeiDou Navigation Satellite System (BDS), Quasi-Zenith Satellite System (QZSS), and / or Satellite Based Augmentation Systems (SBAS).

[0210] Electronic device 100 can implement display functions through a GPU, display device 194, and application processor. The GPU is a microprocessor for image processing, connecting the display device 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0211] In this embodiment of the application, the display device 194 is used for users to view real-world objects or virtual images.

[0212] The display device 194 may be a transparent lens or a lens of other colors, a spectacle lens with optical correction function, a lens with adjustable filtering function, a sunglasses lens, or other lenses with decorative effects.

[0213] The display device 194 can also be a display screen or a projection device, capable of generating optical signals and mapping them onto the user's eyes for displaying images, videos, etc. The display device 194 can be used to present one or more virtual objects, thereby enabling the electronic device 100 to provide the user with a virtual reality scene.

[0214] The display device 194 may present virtual objects in one or more of the following ways: 1. In some embodiments, the display device 194 may include a display screen, which may include a display panel. The display panel may be used to display physical objects and / or virtual objects, thereby presenting a three-dimensional virtual environment to the user. The user can see the virtual object on the display panel and experience the virtual reality scene. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc.

[0215] 2. In some embodiments, the display device 194 may include an optical projection device for directly projecting optical signals (e.g., a light beam) onto the user's retina. The display device 194 may use one or more optical devices such as mirrors, transmissive mirrors, or optical waveguides to convert a real-pixel image display into a near-eye projected virtual image display. The user can directly see virtual objects through the optical signals projected by the optical device, experience a three-dimensional virtual environment, and achieve a virtual interactive experience, or an interactive experience combining virtual and reality. In one example, the optical device may be a miniature projector, etc.

[0216] Electronic device 100 may include one or N display devices 194, where N is a positive integer greater than 1.

[0217] In some embodiments, the electronic device may have two display devices 194, each corresponding to one of the user's two eyes. The content displayed on these two display devices can be displayed independently. Parallax images can be displayed on these two display devices to enhance the stereoscopic effect of the image. In some possible embodiments, the electronic device may also have only one display device 194, with both of the user's eyes viewing the same image.

[0218] This embodiment does not limit the type of display device 194. In some embodiments, there may be no display device 194, and the user may use other functions provided by the electronic device 100, excluding the display function. For example, some users wear smart glasses without lenses for decorative purposes, but still have other functions such as communication.

[0219] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display device 194 and application processor.

[0220] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0221] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then transmitted to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1. Camera 193 may include, but is not limited to, conventional color cameras (RGB cameras), depth cameras (RGB depth cameras), dynamic vision sensor (DVS) cameras, etc. In some embodiments, camera 193 can be a depth camera. A depth camera can acquire spatial information of the real environment.

[0222] In some embodiments, the camera 193 can capture images including real objects, and the processor 110 can fuse the images of real objects captured by the camera 193 with the images of virtual objects, and display the fused image through the display device 194.

[0223] In some embodiments, the camera 193 can capture images of the user's hand or body, and the processor 110 can analyze the images captured by the camera 193 to identify the hand or body movements input by the user.

[0224] In some embodiments, the camera 193 can be used in conjunction with an infrared device (such as an infrared emitter) to detect the user's eye movements, such as eye gaze direction, blinking, gazing, etc., thereby achieving eye tracking.

[0225] In some embodiments, the electronic device 100 may further include an eye-tracking module 195, which tracks the movement of the human eye to determine the gaze point. For example, the pupil position can be located and the pupil center coordinates can be obtained using image processing technology, thereby calculating the person's gaze point.

[0226] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.).

[0227] In some embodiments of this application, internal memory 121 may be used to store applications for one or more applications, including instructions. When the application is executed by processor 110, it causes the electronic device 100 to generate content for presentation to a user. For example, the application may include applications for managing the electronic device 100, such as game applications, conferencing applications, video applications, desktop applications, or other applications, etc.

[0228] Internal memory 121 may include one or more random access memory (RAM) and one or more non-volatile memory (NVM).

[0229] Random Access Memory (RAM) is characterized by its high read / write speeds and volatility. Volatility means that the data stored in RAM is lost when power is off. Typically, RAM has extremely low static power consumption but relatively high operating power consumption. The data in RAM, also known as memory data, can be read at any time but is lost when power is off.

[0230] Non-volatile memory (NVM) is characterized by its non-volatile nature and stable data storage. Non-volatility means that the stored data will not disappear after a power outage, allowing for long-term data preservation even without power. Data in NVM includes application data, which can be stably stored in NVM for extended periods. Application data refers to content written during the execution of applications or service processes, such as photos or videos captured by camera applications, or text edited by users in document applications.

[0231] Random access memory can include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM, for example, fifth-generation DDR SDRAM is generally called DDR5 SDRAM), etc.

[0232] Non-volatile memory can include magnetic disk storage, flash memory, etc.

[0233] Disk storage devices are storage devices that use disks as storage media. They are characterized by large storage capacity, high data transfer rate, and long-term data preservation.

[0234] Flash memory can be classified according to its operating principle, including NOR FLASH, NAND FLASH, 3D NAND FLASH, etc.; according to the level of the storage cell, including single-level cell (SLC), multi-level cell (MLC), triple-level cell (TLC), quad-level cell (QLC), etc.; and according to the storage specification, including universal flash storage (UFS) and embedded multimedia card (eMMC), etc.

[0235] The random access memory can be directly read and written by the processor 110. It can be used to store executable programs (such as machine instructions) of the operating system or other running programs, as well as user and application data.

[0236] Non-volatile memory can also store executable programs and user and application data, and can be pre-loaded into random access memory for direct reading and writing by the processor 110.

[0237] The external memory interface 120 can be used to connect to external non-volatile memory, thereby expanding the storage capacity of the electronic device 100. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to perform data storage functions. For example, music, video, and other files can be stored in the external non-volatile memory.

[0238] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0239] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0240] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or make hands-free calls through the speaker 170A.

[0241] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.

[0242] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. Electronic device 100 may have at least one microphone 170C. In some embodiments, electronic device 100 may have two microphones 170C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, electronic device 100 may also have three, four, or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, etc.

[0243] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.

[0244] Electronic device 100 may include one or more buttons 190, which can control the electronic device and provide users with access to functions on the electronic device 100. The buttons 190 may be mechanical keys such as buttons, switches, or dials, or they may be touch or proximity sensing devices (such as touch sensors). Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of the electronic device 100. Buttons 190 may include a power button, volume buttons, etc.

[0245] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to touch operations applied to different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations applied to different areas of the electronic device 100. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

[0246] Indicator 192 can be an indicator light, which can be used to indicate charging status, power changes, or to indicate messages, notifications, etc.

[0247] Electronic device 100 may also include other input / output interfaces, through which other devices can be connected to electronic device 100. Components may include, for example, audio / video jacks, data connectors, etc.

[0248] The electronic device 100 is equipped with one or more sensors, including but not limited to a pressure sensor 180A, a touch sensor 180B, a gyroscope sensor 180C, an accelerometer sensor 180D, a bone conduction sensor 180E, etc.

[0249] The pressure sensor 180A is used to sense pressure signals and can convert pressure signals into electrical signals. Figure 1The pressure sensor 107A shown can be a pressure sensor 180A. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. When a touch operation is applied to the electronic device 100, the electronic device 100 detects the intensity of the touch operation based on the pressure sensor 180A. The electronic device 100 can also calculate the touch position based on the detection signal from the pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example, when a touch operation with an intensity less than a first pressure threshold is applied to the pressure sensor 180A, a command to pause audio is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the pressure sensor 180A, a command to mute audio is executed. In some embodiments, touch operations applied to the same touch position but with different touch operation durations can correspond to different operation commands. For example, when a touch operation with a duration less than a first time threshold is applied to the pressure sensor 180A, a confirmation command is executed. When a touch operation with a duration greater than or equal to the first time threshold is applied to the pressure sensor 180A, a power-on / power-off command is executed.

[0250] Touch sensor 180B, also known as a "touch device," is used to detect touch operations applied to or near it. Touch sensor 180B can transmit the detected touch operation to the application processor to determine the type of touch event. Electronic device 100 can provide visual output related to the touch operation through display device 194. Electronic device 100 can also send instructions corresponding to the touch operation to other electronic devices with which it has established a communication connection. Figure 1 The sliding sensor 107C shown can be the touch sensor 180B.

[0251] The gyroscope sensor 180C can be used to determine the motion attitude of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 about three axes (i.e., the x, y, and z axes) can be determined by the gyroscope sensor 180C. The gyroscope sensor 180C can also be used for navigation, motion-sensing game scenarios, camera image stabilization, etc.

[0252] The 180D accelerometer can detect the magnitude of acceleration of electronic device 100 in various directions (generally three axes). When electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic device 100, and can be applied to motion-sensing games, landscape / portrait switching, pedometers, and other applications.

[0253] In some embodiments of this application, the electronic device 100 can track the movement of the user's head based on an accelerometer, a gyroscope, or the like.

[0254] The bone conduction sensor 180E can acquire vibration signals. In some embodiments, the bone conduction sensor 180E can acquire vibration signals from the vibrating bone fragments of the human vocal cords. In some embodiments, the bone conduction sensor 180E can be disposed in the electronic device 100, and the audio module 170 can analyze the speech signal based on the vibration signals of the vibrating bone fragments of the vocal cords acquired by the bone conduction sensor 180E to realize the speech function. The bone conduction sensor 180E can also be used as an audio playback device to output sound to the user. When the audio playback device is a bone conduction sensor, the two temples of the eyeglass frame 102 can be provided with abutment portions, and the bone conduction sensor can be disposed at the position of the abutment portion. When the user wears the electronic device 100, the abutment portion abuts against the skull on the front side of the ear, thereby generating vibration that allows sound waves to be conducted to the inner ear through the skull and bony labyrinth. The position of the abutment portion is directly close to the skull, which can reduce vibration loss and allow the user to hear audio more clearly.

[0255] The SIM card interface 196 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 196 to make contact with and separate from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 196 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 196 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 196 is also compatible with different types of SIM cards. The SIM card interface 196 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0256] The following describes the communication system 30 provided in the embodiments of this application.

[0257] Figure 3A An embodiment of the present application provides a communication system 30.

[0258] like Figure 3AAs shown, the communication system 30 includes electronic device 100 and electronic device 200. A first connection is established between electronic device 100 and electronic device 200. Electronic device 100 and electronic device 200 can communicate through the first connection. The first connection can be a wired connection or a wireless connection, and this embodiment is not limited thereto. In the following embodiments, the electronic device can also be called a terminal device, or simply a terminal. A terminal device is typically an intelligent electronic device that can provide a user interface, interact with the user, and provide business functions to the user.

[0259] exist Figure 3A In this example, electronic device 100 is an example of smart glasses, and electronic device 200 is an example of a mobile phone. However, it is not limited to these examples. Electronic device 100 can also be a smart bracelet, smartwatch, smart necklace, smart earphone, smart earring, smart ring, smart eye mask, smart helmet, VR / AR device, or other smart wearable devices with voice call capabilities. Electronic device 200 can also be one or more PCs, tablets, laptops, cloud hosts / servers, or other desktop computers, laptops, handheld computers, artificial intelligence (AI) devices, smart TVs, in-vehicle devices, game consoles, or other devices with strong processing power. This embodiment does not impose any limitations on these aspects.

[0260] In some embodiments, the electronic device 200 is equipped with a communication application, which allows users to conduct voice or video calls with other users. When a user wears the electronic device 100, the microphone on the electronic device 100 can be used to capture voice, and the voice information can be sent to the electronic device 200 via a first connection. The electronic device 200 then sends the voice information to other electronic devices via the communication application. Simultaneously, when the communication application receives a voice message from another electronic device, the electronic device 200 can also forward it to the electronic device 100 via the first connection, whereby the electronic device 100 plays the voice message. This allows users to directly use the electronic device 100 to conduct voice calls with other electronic devices. The microphone of the electronic device 100 is preferably a noise-canceling microphone to reduce noise interference when the user inputs voice information, thereby improving the user's voice call experience.

[0261] In some embodiments, when electronic device 100 detects user operations, such as pressing or touching, it can convert the user operations collected by the sensor into control commands and send them to electronic device 200, enabling the user to conveniently control electronic device 200. For example, the user can operate electronic device 100 to control functions on electronic device 200 such as answering / hanging up calls, pausing / playing music, and adjusting volume.

[0262] In some embodiments, a user can input voice commands through electronic device 100 to achieve human-computer interaction with electronic device 200. For example, the microphone on electronic device 100 can collect the user's voice and transmit the voice information to a processor to generate control commands, which are then transmitted to electronic device 200 via a communication device through a first connection, thereby controlling electronic device 200 to complete corresponding operations, such as turning on / off, pausing / playing audio, switching audio, deleting files, adjusting volume, etc., or responding to requests from electronic device 200, such as answering / hanging up a call, etc.

[0263] In some embodiments, users can control the operation of electronic device 200 or respond to requests received by electronic device 200 through multiple steps of electronic device 100 to achieve more functions, such as bill payment and recharge, ticket ordering, hotel reservation, logistics tracking, restaurant reservation, food delivery ordering, etc., thereby improving the intelligence level of electronic device 100, improving the convenience of user response to information, and improving the user experience.

[0264] In some embodiments, when electronic device 100 and electronic device 200 are trusted devices to each other, such as when electronic device 200 and electronic device 100 have been paired or connected before, when they are connected again, electronic device 100 will automatically establish a communication connection with electronic device 200 and then perform data interaction, without the need for the user to manually perform the connection or pairing operation again, saving time and effort.

[0265] Android can be installed on electronic device 100 or electronic device 200 in communication system 30. ® System, Windows ® System, iOS ® macOS ® Linux ® System, HarmonyOS ® The operating systems of electronic device 100 and electronic device 200 may be the same or different, whether they are HarmonyOS (HOS) or other types of operating systems. This application does not impose any restrictions on this.

[0266] In some embodiments, multiple terminals in the communication system 30 are equipped with HarmonyOS. ® If the system consists of multiple terminals, then the system can be called HarmonyOS. ® Super Virtual Device (also known as HarmonyOS) ® Super terminals refer to the integration of the capabilities of multiple terminals through distributed technology, storing them in a virtual hardware resource pool. Based on business needs, the terminal capabilities are uniformly managed, scheduled, and integrated to provide services to the outside world, enabling rapid connection, capability mutual assistance, and resource sharing between different terminals.

[0267] The first connection can include a wireless connection, such as a Bluetooth (BT) connection, a Wi-Fi connection, or a hotspot connection, enabling communication between electronic devices 100 and 200 under the same account, without an account, or with different accounts. Wireless connections eliminate the constraints of wires, allowing for greater user freedom of movement. The first connection can also be an Internet connection. In some embodiments, electronic devices 100 and 200 can log in to the same account, thereby connecting and communicating via the Internet. Of course, multiple terminals can also log in to different accounts, but connect through a binding method. For example, electronic devices 100 and 200 can log in to different accounts, and electronic device 200 can bind itself to electronic device 100 in a device management application, then connect through that application. The first connection can also include a wired connection, such as a USB connection, a high-definition multimedia interface (HDMI) connection, or a display port (DP) connection. This application does not limit the type of the first connection; the terminals in the communication system 30 can transmit and interact with data through various communication connection types. Furthermore, the various terminals can also connect and communicate using any of the above methods, and this application embodiment does not impose any restrictions on this.

[0268] Correspondingly, electronic device 100 or electronic device 200 may be configured with a mobile communication module and a wireless communication module for communication. The mobile communication module can provide wireless communication solutions including 2G / 3G / 4G / 5G for terminal applications. The wireless communication module may include a Bluetooth (BT) module and / or a wireless local area network (WLAN) module. The Bluetooth module can provide one or more Bluetooth communication solutions, including Bluetooth Classic (Bluetooth 2.1) or Bluetooth Low Energy (BLE), and the WLAN module can provide one or more WLAN communication solutions, including wireless fidelity peer-to-peer (Wi-Fi P2P), wireless fidelity local area networks (Wi-Fi LAN), or wireless fidelity software access point (Wi-Fi softAP). In some embodiments, Wi-Fi P2P refers to allowing devices in a wireless network to connect to each other in a point-to-point manner without a wireless router, as seen in Android. ® This system is also known as Wireless Fidelity Direct (Wi-Fi Direct). Devices establishing a Wi-Fi P2P connection can exchange data directly via Wi-Fi (must be on the same frequency band) without being connected to a network or hotspot, enabling point-to-point communication such as transferring files, pictures, and videos. Compared to Bluetooth, Wi-Fi P2P has advantages such as faster search and transmission speeds, and longer transmission distances.

[0269] It should be noted that, Figure 3AThe communication system 30 shown is only used to assist in describing the technical solutions provided in the embodiments of this application and does not constitute a limitation on other embodiments of this application. In actual business scenarios, the communication system 30 may include more or fewer terminal devices, such as handheld devices. Electronic devices 100 and / or 200 can be used in conjunction with handheld devices, which may be, for example, gamepads, handheld controllers, gyroscope mice, styluses, or other handheld computing devices. Handheld devices may be configured with various sensors, such as accelerometers, gyroscopes, and magnetometers, which can be used to detect and track their own movement. Handheld devices can communicate with electronic devices 100 or 200 via short-range transmission technologies such as Wi-Fi, Bluetooth, NFC, and ZigBee, and can also communicate via wired connections such as USB interfaces or custom interfaces. This application does not limit the terminal type, number of terminals, connection method, etc. in the communication system 30.

[0270] Combination Figure 3A , Figure 3B The functional modules in the communication system 30 provided in the embodiments of this application are introduced.

[0271] like Figure 3B As shown, the communication system 30 includes electronic device 100 and electronic device 200. A first connection is established between electronic device 100 and electronic device 200. Electronic device 100 and electronic device 200 can communicate through the first connection. The first connection can be a wired connection or a wireless connection, and this embodiment is not limited thereto.

[0272] The electronic device 100 may include functional modules such as a communication module 301, a sensor module 302, a recording module 303, and a playback module 304.

[0273] The communication module 301 can be used for communication between the electronic device 100 and other electronic devices, and can receive or send messages or instructions. For example, the communication module 301 can send the voice data generated by the recording module 303 to the electronic device 200, and the communication module 301 can also receive the voice data of the electronic device 200 and forward it to the playback module 304 for playback.

[0274] The sensor module 302 can be used to detect user operations. For example, the sensor module 302 may include a pressure sensor, a swipe sensor, etc. When it detects user operations on the electronic device 100, such as pressing or touching, it converts the user operations collected by the sensor into control commands and sends them to the communication module 301. The communication module 301 then sends the commands to the electronic device 200, enabling the user to conveniently control the electronic device 200. For example, through the sensor module 302, user operations on the electronic device 100 can be detected, and these user operations can be converted into corresponding control commands and sent to the electronic device 200 through the communication module 301 to control functions such as answering / hanging up calls, pausing / playing music, adjusting volume, and recording / playing music on the electronic device 200.

[0275] The recording module 303 can be used to record sound and generate voice data. For example, the recording module 303 can collect the user's voice through a microphone, generate voice data after encoding, and send it to the communication module 301, which then sends it to other electronic devices.

[0276] The playback module 304 can be used to play sound. For example, the playback module 304 can receive voice data from the electronic device 200 through the communication module 301, and then play the voice information through a speaker after decoding.

[0277] The electronic device 200 may include functional modules such as a communication module 305, a communication application 306, a management module 307, and a display module 308.

[0278] The communication module 305 can be used for communication between the electronic device 200 and other electronic devices, and can receive or send messages or instructions. For example, the communication module 305 can send voice data from the communication application 306 to the electronic device 100, and the communication module 305 can also receive voice data recorded by the electronic device 100 and distribute it to the communication application 306.

[0279] Communication application 306 is an application installed on electronic device 200. Users can use this application to establish communication with other users, such as making voice or video calls. For example, electronic device 200 can send voice data received from electronic device 100 by communication module 305 to other users via communication application 306. Furthermore, electronic device 200 can also receive voice data sent from other electronic devices in communication application 306, and then forward the voice data to electronic device 100 via the first connection, whereby electronic device 100 plays the voice message.

[0280] The management module 307 is used by the user to manage or configure the electronic device 100 through the electronic device 200. For example, it can enable / disable the voice function of the electronic device 100, manage contacts, and set shortcut commands for different user operations, which will be described in detail in subsequent embodiments.

[0281] Display module 308 is used to display user interfaces, such as the user interface for setting up electronic device 100, or the session interface for communication application 306. Related user interfaces can be found later. Figures 10 to 20 The illustrated embodiment will not be described in detail here.

[0282] It should be noted that, Figure 3B The functional modules shown are only used to assist in describing the technical solutions provided in the embodiments of this application and do not constitute a limitation on other embodiments of this application. In actual business scenarios, the communication system 30 may include more or fewer functional modules, or different combinations of functional modules.

[0283] Combination Figure 1 , Figure 2 , Figure 3A , Figure 3B The embodiment shown, Figure 4 This illustrates a call service scenario.

[0284] refer to Figure 4 , Figure 4 An embodiment of the present application provides a communication system 40.

[0285] like Figure 4 As shown, the communication system 40 includes electronic devices 100, 200, 300, and 400. Electronic device 100 may also be referred to as the first device, electronic device 200 as the second device, electronic device 300 as the third device, and electronic device 400 as the fourth device.

[0286] In this embodiment, a first connection is established between electronic devices 100 and 200, a third connection is established between electronic devices 200 and 300, and a second connection is established between electronic devices 300 and 400. Electronic devices 100 and 200 can communicate via the first connection. Electronic devices 200 and 300 can communicate via the third connection. Electronic devices 300 and 400 can communicate via the second connection. Communication between electronic devices 100 and 400 can be achieved through the first, second, and third connections. The first, second, and third connections can be wired or wireless; this embodiment is not limited to any particular connection.

[0287] exist Figure 4In this example, electronic devices 100 and 400 are smart glasses, and electronic devices 200 and 300 are mobile phones. However, they are not limited to these examples. Electronic devices 100 or 400 can also be smart bracelets, smartwatches, smart necklaces, smart headphones, smart rings, smart earrings, smart goggles, smart helmets, VR / AR devices, and other smart wearable devices with voice call capabilities. The device types of electronic devices 100 and 400 can be the same or different. Electronic devices 200 or 300 can also be PCs, tablets, laptops, cloud hosts / servers, or other desktop computers, laptops, handheld computers, AI devices, smart TVs, in-vehicle devices, game consoles, and other devices with strong processing power. This embodiment does not impose any limitations on these.

[0288] Android can be installed on electronic devices 100, 200, 300 or 400 in the communication system 40. ® System, Windows ® System, iOS ® macOS ® Linux ® System, HarmonyOS ® The operating systems of the various terminal devices in the communication system 40 may be the same or different, whether they are HarmonyOS (HOS) or other types of operating systems. This application does not impose any restrictions on this.

[0289] In some embodiments, multiple terminals in the communication system 40 are equipped with HarmonyOS. ® If the system consists of multiple terminals, then the system can be called HarmonyOS. ® Super Virtual Device (also known as HarmonyOS) ® Super terminals refer to the integration of the capabilities of multiple terminals through distributed technology, storing them in a virtual hardware resource pool. Based on business needs, the terminal capabilities are uniformly managed, scheduled, and integrated to provide services to the outside world, enabling rapid connection, capability mutual assistance, and resource sharing between different terminals.

[0290] The first, second, or third connection can include wireless connections, such as Bluetooth (BT) connections, Wi-Fi connections, hotspot connections, etc., to enable communication between electronic devices 100 and 200, or electronic devices 200 and 300, or electronic devices 300 and 400, under the same account, without an account, or with different accounts. Wireless connections are not bound by wires, allowing for greater freedom of user movement. The first, second, or third connection can also be an Internet connection. In some embodiments, electronic devices 100 and 200, and / or electronic devices 200 and 300, and / or electronic devices 300 and 400 can log in to the same account, thereby connecting and communicating via the Internet. Of course, multiple terminals can also log in to different accounts, but connect through binding. For example, electronic devices 300 and 400 can log in to different accounts, and electronic device 300 can bind itself to electronic device 400 in a device management application, and then connect through the device management application. The first, second, or third connection may also include wired connections, such as USB connections, high definition multimedia interface (HDMI) connections, display port (DP) connections, etc.

[0291] For example, the third connection between electronic device 200 and electronic device 300 can be a combination of multiple connections. For instance, electronic device 200 or electronic device 300 can establish a connection with a router via Wi-Fi to access the network, or establish a connection with a base station via cellular signal to access the network. Electronic device 200 and electronic device 300 can communicate through the network. For example, electronic device 200 can send information to a cloud server via the network, and the cloud server can then send the information to electronic device 300 via the network.

[0292] This application embodiment does not limit the type of the first connection, second connection, or third connection. Data transmission and interaction between terminals in the communication system 40 can be achieved through various communication connection types. Furthermore, terminals can also connect and communicate using any combination of the above methods; this application embodiment does not impose any restrictions on this.

[0293] Correspondingly, electronic devices 100, 200, 300, or 400 may be configured with mobile communication modules and wireless communication modules for communication. The mobile communication module can provide wireless communication solutions, including 2G / 3G / 4G / 5G, for applications on the terminal. The wireless communication module may include Bluetooth modules and / or WLAN modules. Specifically, the Bluetooth module can provide solutions for one or more Bluetooth communication methods, including classic Bluetooth (Bluetooth 2.1) or Bluetooth Low Energy, and the WLAN module can provide solutions for one or more WLAN communication methods, including Wi-Fi P2P, Wi-Fi LAN, or Wi-Fi softAP.

[0294] In some embodiments, electronic devices 200 and 300 may have a communication application installed on them. Electronic devices 200 and 300 may log in to the communication application and make voice or video calls through a third connection (such as an Internet connection).

[0295] In some embodiments, a first user holds electronic devices 100 and 200, and a second user holds electronic devices 300 and 400. When the first user wears electronic device 100, the microphone on electronic device 100 can be used to capture voice, and the voice information is sent to electronic device 200 through a first connection. Electronic device 200 then sends the voice information to electronic device 300 through a communication application. Simultaneously, after receiving the voice information from electronic device 200 in the communication application, electronic device 300 forwards the voice information to electronic device 400 through a second connection. When the second user wears electronic device 400, they can choose to have the voice played by electronic device 400. This allows for voice calls between the first and second users, even when the first user is wearing electronic device 100 and the second user is wearing electronic device 400, freeing their hands from holding electronic devices 200 or 300. The microphones of electronic devices 100 and 400 are preferably noise-canceling microphones to reduce noise interference when the user inputs voice information, thus improving the user's voice call experience.

[0296] In some embodiments, when electronic device 100 detects user operations, such as pressing or touching, it can convert the user operations collected by the sensor into control commands and send them to electronic device 200, enabling the user to conveniently control electronic device 200. For example, the user can operate electronic device 100 to control functions on electronic device 200 such as answering / hanging up calls, pausing / playing music, and adjusting volume.

[0297] In some embodiments, a user can input voice commands through electronic device 100 to achieve human-computer interaction with electronic device 200. For example, the microphone on electronic device 100 can collect the user's voice and transmit the voice information to a processor to generate control commands, which are then transmitted to electronic device 200 via a communication device through a first connection, thereby controlling electronic device 200 to complete corresponding operations, such as turning on / off, pausing / playing audio, switching audio, deleting files, adjusting volume, etc., or responding to requests from electronic device 200, such as answering / hanging up a call, etc.

[0298] In some embodiments, users can control the operation of electronic device 200 or respond to requests received by electronic device 200 through multiple steps of electronic device 100 to achieve more functions, such as bill payment and recharge, ticket ordering, hotel reservation, logistics tracking, restaurant reservation, food delivery ordering, etc., thereby improving the intelligence level of electronic device 100, improving the convenience of user response to information, and improving the user experience.

[0299] Similarly, when electronic device 400 detects user operations such as pressing or touching, it can convert the user operations collected by the sensor into control commands and send them to electronic device 300, enabling the user to conveniently control electronic device 300. This will not be elaborated further here.

[0300] It should be noted that, Figure 4 The communication system 40 shown is only used to assist in describing the technical solutions provided in the embodiments of this application, and does not constitute a limitation on other embodiments of this application. Other scenarios based on the same technical solution are all within the protection scope of this application.

[0301] In practical business scenarios, the communication system 40 may include more or fewer terminal devices. For example, the communication system 40 may only include electronic devices 100, 200, and 300. A first user collects voice information through electronic device 100 and sends it to electronic device 200, which then sends the voice information to electronic device 300. A second user then plays the voice using the speaker of electronic device 300. Alternatively, the communication system 40 may include more terminal devices, such as electronic devices 100 or 400, which can be used in conjunction with handheld devices. These handheld devices could be, for example, gamepads, handheld controllers, gyroscope mice, styluses, or other handheld computing devices. This application does not impose any limitations on the type, number, or connection method of the terminals in the communication system 40.

[0302] pass Figure 3A , Figure 3B , Figure 4The communication systems 30 and 40 shown in this application provide a technical solution that can integrate the hardware and software capabilities of different devices, providing users with a multifunctional, intelligent, and more convenient communication experience.

[0303] The following example uses electronic device 100 as smart glasses, combined with... Figure 5 , Figure 6 , Figure 7 This section describes some user operations performed on smart glasses in various embodiments.

[0304] Figure 5 The illustration shows a user tapping the temple of smart glasses. In some embodiments, a pressure sensor may be provided on the upper side of the temple of the smart glasses. When the smart glasses detect a tapping action applied to the pressure sensor, a corresponding command can be triggered.

[0305] In this embodiment, a tap refers to a short press, typically lasting less than a first time threshold, which can be, for example, 0.2 seconds. A tap can be a single click, double click, triple click, etc. If it is a double click or triple click, the interval between each tap cannot exceed a second time threshold, which can be, for example, 0.3 seconds; otherwise, it will be detected as a single tap. Users can also customize the actions triggered by different tap frequencies. For example, if two taps are detected within 0.8 seconds, a command to close the music application is triggered; if two taps are detected within 0.4 seconds, a command to switch to the next song is triggered. If the press duration exceeds a third time threshold, which can be, for example, 0.5 seconds, it may be detected by the smart glasses as a pinch operation, triggering other commands. Users or developers can customize the duration of the first, second, and third time thresholds based on usage habits or actual experience; this embodiment does not impose limitations on this.

[0306] In some embodiments, users can customize the commands corresponding to different keystrokes, making the shortcut operations more in line with the usage habits of different users.

[0307] For example, in some scenarios, when a user is wearing smart glasses connected to their phone, and a music app is running in the foreground on their phone, double-tapping the right temple of the smart glasses will trigger the phone to play / pause music. Double-tapping the left temple of the smart glasses will quickly activate the phone's voice assistant. When the phone receives a call request, double-tapping either the left or right temple of the smart glasses will answer or hang up the call.

[0308] Figure 6The image shows a user pressing and pinching the temple of the smart glasses. Unlike a short tap, a pinch operation involves a relatively longer pressure application to the sensor. For example, if the pressure duration exceeds a third time threshold (e.g., 0.5 seconds), the smart glasses will detect and recognize it as a pinch operation, triggering the corresponding command.

[0309] In some embodiments, different durations of pinch operations can correspond to different commands. Users can customize the commands corresponding to different pinch operations, making the shortcut operations more in line with the usage habits of different users.

[0310] For example, in some implementations, a user pressing and pinching the left temple of the smart glasses for one second can trigger a command to pair the smart glasses with a new device or quickly connect to other devices. As another example, a user pressing and pinching the temple of the smart glasses for two seconds can trigger a command to power the smart glasses on or off.

[0311] Figure 7 The illustration shows a user sliding a touch on the temple of smart glasses. In some embodiments, a slide sensor may be provided on the upper side of the temple of the smart glasses. When the smart glasses detect a slide operation applied to the slide sensor, a corresponding command can be triggered.

[0312] The swipe sensor can be a touch area on the side of the temple of smart glasses, and it can be used to detect the user's touch trajectory.

[0313] Assuming the direction closest to the lens is "forward," a user's finger can touch this touch area and swipe from front to back (backward swipe) or from back to front (forward swipe). Alternatively, it can swipe from bottom to top (upward swipe) or from top to bottom (downward swipe).

[0314] In some embodiments, users can customize the commands corresponding to different swipe operations, making the shortcut operations more in line with the usage habits of different users.

[0315] For example, in some cases, when a user is wearing smart glasses connected to a mobile phone, and a music app is running in the foreground on the phone, the user's forward / backward swipe gesture acts on the smart glasses' swipe sensor, triggering a change of music to the previous / next track. In other cases, the user's forward / backward swipe gesture acts on the smart glasses' swipe sensor, triggering a command to adjust the volume.

[0316] Understandable. Figure 5 , Figure 6 , Figure 7The described embodiments are merely illustrative examples and do not constitute a limitation on other embodiments of this application. Besides user operations such as tapping, pressing, and swiping on smart glasses, smart glasses can also recognize user operations in other ways, such as detecting user gestures through cameras, infrared sensors, distance sensors, ambient light sensors, proximity sensors, etc., or collecting user voice through microphones to generate corresponding operation commands. Furthermore, users can customize shortcut commands for different operations, making shortcut operations more suitable for different users' habits.

[0317] Combination Figure 5 , Figure 6 , Figure 7 The following describes some user operations in examples, where users wear smart glasses to send and receive voice data.

[0318] exist Figure 8 , Figure 9 In the illustrated embodiment, the smart glasses worn by the user have established a communication connection with the mobile phone. The smart glasses and the mobile phone can send commands and data to each other through this communication connection. This communication connection can be a Bluetooth connection, a Wi-Fi P2P connection, etc., and this embodiment is not limited to this.

[0319] When wearing smart glasses, users can efficiently and conveniently send or receive voice data. This function is sometimes referred to as the "Seamless Chat" feature.

[0320] refer to Figure 8 , Figure 8 Some embodiments are shown, illustrating business scenarios where users wear smart glasses to send voice data.

[0321] Specific steps may include: Step ①: Triggering phase.

[0322] Users can trigger voice data recording by pinching the temple of the smart glasses. For example, when the smart glasses detect a pinch operation on the pressure sensor exceeding a fourth time threshold, which can be, for example, 0.8 seconds, the smart glasses will activate the voice data recording function. The length of the fourth time threshold can be customized by users or developers based on usage habits or actual experience; this embodiment does not impose any limitations.

[0323] In some embodiments, the smart glasses may emit a first prompt tone or a first vibration as feedback to indicate to the user that voice data recording has been started.

[0324] In some embodiments, regardless of whether the phone screen is on or off, the user can quickly trigger voice data recording by pressing the temple of the smart glasses.

[0325] Step 2: Recording stage.

[0326] After the smart glasses enable the voice data recording function, the user can press and hold the temple of the smart glasses. During the time the temple is held down, the smart glasses will simultaneously record voice data, which can be captured through the microphone.

[0327] You can set a time limit for each voice message, for example, specifying that the maximum length of a single voice message is 60 seconds.

[0328] Step 3: End of recording.

[0329] Users can loosen the temples of the smart glasses to end the recording of voice data.

[0330] Step 4: Send confirmation phase.

[0331] After recording a voice message, the user can choose to send it to a selected contact or cancel sending the voice data.

[0332] like Figure 8 As shown, in some embodiments, within a fifth time threshold period (e.g., within 3 seconds) after recording ends, the smart glasses detect a forward sliding action of the user on the sliding sensor of the temple of the smart glasses, and confirm the transmission of the just-recorded voice data. Conversely, if the smart glasses detect a backward sliding action of the user on the sliding sensor of the temple of the smart glasses, confirm the cancellation of the transmission of the just-recorded voice data.

[0333] In other embodiments, if the user does not perform any operation within a fifth time threshold period after ending the recording of voice data, the smart glasses confirm the cancellation of sending the newly recorded voice data. The fifth time threshold may be, for example, 3 seconds. The length of the fifth time threshold can be customized by the user or developer based on usage habits or actual experience; this embodiment does not impose any limitations on it.

[0334] Not limited to Figure 8 For example, in some other embodiments, the smart glasses can automatically send the voice data after a sixth time threshold when the voice recording is completed, without user intervention. The sixth time threshold may be, for example, 1 second, and this embodiment is not limited to this. Within the sixth time threshold when the voice recording is completed, the user can confirm the cancellation of sending the just-recorded voice data by sliding a backward motion on the temple of the smart glasses to activate the sensor.

[0335] In some embodiments, the sent voice data record can be retained in the chat session interface of the first communication application, so that the user can listen to the voice data again.

[0336] In some embodiments, the smart glasses may emit a second prompt tone or a second vibration as feedback to indicate to the user that the voice data has been successfully sent.

[0337] In some embodiments, smart glasses may emit feedback information such as a third prompt tone or a third vibration to indicate to the user that voice data transmission has failed or has been canceled.

[0338] Users can customize the above-mentioned first prompt tone, second prompt tone, and third prompt tone, or first vibration, second vibration, and third vibration according to their personal preferences or the developers can customize them according to the debugging situation. This embodiment does not impose any restrictions.

[0339] After the user confirms the sending of voice data, the voice data is transmitted to the phone via the communication connection between the smart glasses and the phone. The phone can then send the voice data to selected contacts through a first-party communication application. If the contact is wearing the smart glasses, they can automatically listen to the voice data; if the contact is not wearing the smart glasses, they can receive the voice data through the communication application and then click to listen to it.

[0340] refer to Figure 9 , Figure 9 Some embodiments are shown, illustrating business scenarios where users wear smart glasses to receive voice data.

[0341] Specific steps may include: Step 5: Message Reception Phase.

[0342] The smart glasses receive voice data through the communication connection between the smart glasses and the mobile phone. This voice data can be voice data sent by other users through the smart glasses or mobile phone in the first communication application, or it can be other voices on the mobile phone, such as the audio corresponding to the video played in the video application on the mobile phone.

[0343] Step 6: Playback phase.

[0344] like Figure 9 As shown, after the smart glasses receive the voice data, they can automatically play the voice data.

[0345] If the smart glasses detect that the current user is not wearing the smart glasses, then the voice data will not be played when voice data is received.

[0346] like Figure 9 As shown, in some embodiments, users can cancel the playback of currently playing or about to play voice data by sliding the sensor on the temple of the smart glasses backward or forward.

[0347] In some embodiments, users can choose to pause or interrupt playback during voice playback. Unfinished voice data can be marked as unread, such as a red dot, in the chat session interface of the first communication application.

[0348] In some embodiments, the voice data sent or received may be recorded in the chat session interface of the first communication application, so that the user can listen to the voice data again.

[0349] In some embodiments, smart glasses can quickly determine whether to automatically play voice data upon receiving it. Historical voice data is not automatically played; historical messages can be viewed in the chat session interface.

[0350] In some embodiments, if the message received on the first communication application is a text message rather than voice data, the smart glasses may simply emit a notification sound without playing the received message.

[0351] In some embodiments, users can configure their phones to receive text messages on a first communication application, perform voice recognition on the received text messages, convert them into voice data, and then send them to smart glasses for playback.

[0352] In some embodiments, the smart glasses may emit a fourth prompt tone or a fourth vibration before each voice message is played to alert the user that the voice message is about to be played. If the user does not wish to listen to the voice message, they can slide the temple of the glasses backward or forward after hearing the prompt tone to cancel playback.

[0353] If the smart glasses receive multiple voice messages, they can automatically play them sequentially. A certain time interval can be allowed between each voice message, such as a 0.5-second gap, to facilitate differentiation between different voice messages.

[0354] After each voice message is played, the smart glasses can emit a fifth prompt tone or a fifth vibration to indicate to the user that the voice message has finished playing.

[0355] Users can customize the above-mentioned fourth and fifth prompt sounds, or fourth and fifth vibrations, according to their personal preferences or the developers can customize them according to the debugging situation. This embodiment does not impose any restrictions.

[0356] In some embodiments, smart glasses can play voice data, regardless of whether the phone screen is on or off.

[0357] Understandable, Figure 8 , Figure 9The described embodiments are merely illustrative examples and do not constitute a limitation on other embodiments of this application. Other embodiments may also use other combinations of user operations to implement the function of sending and receiving voice data. Users can customize other combinations of user operations according to their personal preferences or developers can customize them according to the debugging situation, so that the user operation is more in line with the user's usage habits.

[0358] It is understood that, based on the same inventive concept, in addition to the example of transmitting and receiving voice data through smart glasses, smart glasses can also achieve other quick functions through one or more user operations on the smart glasses, such as playing / turning music, finding the smart glasses, setting an alarm clock, face-to-face translation, recording voice memos, etc., and this embodiment does not impose any limitations.

[0359] In some embodiments, before sending voice data while wearing smart glasses, a user can pair with a contact by initiating a pairing invitation for a smart glasses conversation through a messaging app. The contact will receive a notification of the pairing invitation in the messaging app or on the smart glasses. Once the contact accepts the invitation, the pairing is successful, and both parties can then use the smart glasses to communicate through the messaging app.

[0360] Successfully paired contacts will be displayed with a special icon in the communication application, and the wearing status of the smart glasses can be indicated by different colors or icons. For example, a bright color indicates that the glasses are being worn, and a gray color indicates that they are not being worn.

[0361] In some embodiments, after a user wears the smart glasses, if they want to have a conversation with a paired contact, they can perform user actions on the temples of the smart glasses. For example, before each voice data collection, the user can long-press on the temple of the smart glasses to confirm that the other party is wearing the smart glasses. If the other party is wearing them, a corresponding prompt tone will sound; if they are not wearing them, a corresponding prompt tone will sound, allowing the user to quickly confirm whether the other party is wearing the smart glasses. After issuing a prompt message to the user confirming whether the other party is wearing the smart glasses, the smart glasses can begin collecting voice data.

[0362] In some embodiments, a user wearing smart glasses presses and holds the temple of the glasses while speaking. The smart glasses' microphone then captures the user's voice. After releasing the temple, the user's speech is sent by the smart glasses to the user's mobile phone and transmitted to the recipient's contact via a messaging app.

[0363] If the other party's contact is also wearing smart glasses and chooses to talk to the user, then the other party's contact will receive the voice message in real time and play it directly.

[0364] If the recipient is not wearing smart glasses, they will receive the voice data in the messaging app. They can choose to listen to or view the message on their phone, or wear the smart glasses to listen to the voice data. The voice message within the messaging app carries the voice data.

[0365] The sent voice data will be stored in the communication application, so that both parties can view or listen to it again.

[0366] In combination with the above Figures 1-9 The illustrated embodiments are described below, along with some related schematic user interfaces in the embodiments of this application.

[0367] After the first connection is established between electronic device 100 (such as smart glasses) and electronic device 200 (such as mobile phone), in order to allow users to better experience the function of making voice calls through electronic device 100, namely the seamless voice call function, a settings page about electronic device 100 can be added to the settings interface of electronic device 200, so that users can conveniently manage the functions of smart glasses.

[0368] The following example uses the connection between smart glasses and a mobile phone to enable voice calls, namely the "Changlian NieChat" function, to introduce the user interface related to smart glasses on the mobile phone.

[0369] In the phone's settings, you can add a user interface related to smart glasses management and settings. Below is an example... Figures 10 to 16 The user interface shown is for illustrative purposes only.

[0370] refer to Figure 10 , Figure 10 The settings page on the phone, i.e., user interface 1000, is shown.

[0371] like Figure 10 As shown, the user interface 1000 displays a top status bar 1001 and a settings interface 1002. The top status bar 1001 includes a mobile signal indicator, a wireless network indicator, a battery indicator, a time indicator, etc.

[0372] The settings interface 1002 includes various settings options, such as airplane mode, Wi-Fi, Bluetooth, personal hotspot, mobile network, smart glasses (option 1003), display and brightness, and Huawei account. Among these, smart glasses (option 1003) contains settings related to smart glasses. Clicking on smart glasses (option 1003) will display more options, as shown in the user interface 1100.

[0373] refer to Figure 11 , Figure 11 The smart glasses settings page, i.e., user interface 1100, is shown.

[0374] like Figure 11 As shown, the user interface 1100 may include a top status bar, a smart glasses settings page title bar 1101, a smart glasses schematic diagram 1102, a connection status schematic bar 1103, a connected device bar 1104, a smart listening function option bar 1105, and a more function option bar 1106, etc.

[0375] The smart glasses settings page title bar 1201 includes the smart glasses title and a return control to indicate returning to the previous screen.

[0376] The smart glasses schematic diagram 1102 is used to display schematic diagrams of smart glasses models. Different schematic diagrams can be used depending on the model of the smart glasses.

[0377] The connection status indicator bar 1103 displays the connection status of the smart glasses, such as connected or not connected. If the smart glasses are already connected to the phone, it indicates a connected status; if not, it indicates a not connected status. The connection status indicator bar 1103 can also display the remaining battery power of the smart glasses. Figure 11 90% shown.

[0378] The connected device section 1104 can display a list of connected devices. This list can show currently connected devices, historically connected devices, or detected unconnected devices, etc. Figure 11 The image shows the HUAWEI P40, MateBook, and MatePad. Clicking the control in the upper right corner will display more devices.

[0379] The Smart Listening function option bar 1105 can display frequently used function options, such as... Figure 11 The options shown include Morning Greeting, Personalized Listening, Quick Reminder, and Pinch Chat (option 1107). Clicking on different options will take you to a more detailed function settings page. The Morning Greeting option can be used to set up the playback of weather, date, memos, news, and schedules; the Personalized Listening option can be used to set up music playback; the Quick Reminder option can be used to set up navigation information, alarm clock information, and other reminders; and Pinch Chat (option 1107) is the entry point for the Pinch Chat function. Clicking Pinch Chat (option 1107) will display the Pinch Chat settings page, as shown in user interface 1200.

[0380] The more function options bar 1106 can display other function options, such as Figure 11The options shown include quick operation option 1108, find glasses option, firmware update option, and settings option. Clicking on different options will take you to a more detailed function settings page. Quick operation option 1108 can be used to set the function commands corresponding to quick operations, such as user interface 1600; the find glasses option can quickly locate the smart glasses based on location; the firmware update option is used for upgrading the smart glasses version; and the settings options can list more function options.

[0381] Option 1107 for the "NipNipChat" feature is the entry point for the Changlian NipNipChat function. Clicking option 1107 will display the Changlian NipNipChat settings page, such as... Figure 12 The user interface shown is 1200.

[0382] like Figure 12 As shown, the user interface 1200 may include a top status bar, a Changlian NieChat settings page title bar 1201, a Changlian NieChat function description bar 1202, a Changlian NieChat function enable / disable control 1203, a Changlian NieChat contact option bar 1204, a wear detection function enable / disable control 1205, a wear detection function description bar 1206, an about option bar 1207, etc.

[0383] The title bar 1201 of the Changlian NieChat settings page includes the Changlian NieChat title and a return control for indicating the return to the previous screen.

[0384] The Changlian NieChat function description section 1202 describes the functions of Changlian NieChat, such as the text description shown in the user interface 1200, such as "The Changlian NieChat function supports using smart glasses to send and receive voice messages more conveniently with selected contacts in the Changlian application. Click to view the instructions."

[0385] The "Connect Chat" feature enable / disable control 1203 allows users to quickly enable or disable the "Connect Chat" feature by clicking the control in this setting.

[0386] The Changlian NieChat contact options bar 1204 allows users to select Changlian NieChat contacts. The contact name and avatar can be displayed in the Changlian NieChat contact options bar 1204. The Changlian NieChat contact options bar 1204 typically displays frequently used contacts. If the desired contact is not in this options bar, clicking the control in the upper right corner will display more contacts, as shown in the user interface 1300.

[0387] The wear detection function on / off control 1205 allows users to quickly enable or disable the wear detection function by clicking the control in this setting. In some embodiments, users can disable the MeeTime chat function or set Do Not Disturb messages in MeeTime messages, so that users will not receive MeeTime chat message notifications from the other party.

[0388] The wear detection function description section 1206 can describe the wear detection function, such as the text description shown in the user interface 1200, "The wear detection function will lock the MeeTime chat function when you take off the smart glasses to protect your information security."

[0389] The options bar 1207 can display more other function options for Changlian NieChat.

[0390] like Figure 13 As shown in the figure, when the user clicks the upper right corner control in the Changlian NieChat contact option bar 1204 in the user interface 1200, more contacts can be displayed, as shown in the user interface 1300.

[0391] like Figure 13 As shown, the user interface 1300 may include a contact selection title bar 1301, a contact confirmation control 1302, a contact search bar 1303, and a contact list 1304 that supports Changlian messages, etc.

[0392] The contact selection title bar 1301 includes a contact selection title and a return control to indicate returning to the previous screen.

[0393] The Selected Contact Confirmation Control 1302 can be used by the mobile phone to confirm the contact selected by the user when the user operation on the control is detected.

[0394] The contact search bar 1303 allows users to quickly search for contacts.

[0395] The contact list 1304 that supports Messenger Messenger can list all contacts. Users can swipe up or down on the screen to pull up or down the list for easy contact searching.

[0396] The contact list 1304 that supports seamless messaging may include a contact name initial indicator 1305, contact information 1306, and a contact selection control 1307.

[0397] Among them, the contact name initial indicator 1305 can be identified by uppercase English letters, such as A, B, C, D, etc., making it convenient for users to quickly find contacts by the first letter of their names.

[0398] Contact information 1306 includes contact names and profile pictures, which identify different contacts.

[0399] The Select Contacts control 1307 allows users to select the desired contact.

[0400] like Figure 14As shown in the user interface 1400, after the user clicks the contact selection control 1307 on the right side corresponding to the contact Alice, and then clicks the confirmation contact control 1302, the user operation of confirming Alice as a contact is completed. Then, the user's mobile device will send a pairing invitation message to the contact Alice's mobile phone, such as... Figure 15 The user interface shown is 1500.

[0401] In some embodiments, users can select multiple contacts to form a group chat.

[0402] Figure 15 This illustrates a sample user interface 1500 displayed when a mobile phone receives a pairing invitation message from another user.

[0403] When a mobile phone receives a pairing invitation message from another user, it can display an interface as shown in user interface 1500. On user interface 1500, a pairing invitation message prompt box 1501 can be displayed, including pairing invitation prompt information, such as... Figure 15 The message "Bob has invited you to connect and pair up via Changlian chat. You can easily communicate by agreeing to the invitation. Do you agree?" is shown in the message. The Changlian message pairing invitation prompt box 1501 also includes an "Agree" control 1502 and a "Cancel" control 1503. If the user clicks the "Agree" control 1502, they accept the Changlian message pairing invitation. If the user clicks the "Cancel" control 1503, they reject the Changlian message pairing invitation. The corresponding message indicating acceptance or rejection of the pairing invitation will be returned to the requesting device.

[0404] like Figure 16 As shown, when a user clicks the shortcut operation option 1108 in the user interface 1100, they can set the corresponding function command for the shortcut operation in the shortcut operation interface, as shown in the user interface 1600.

[0405] like Figure 16 As shown, the quick operation settings user interface 1600 may include a quick operation title bar 1601, multiple quick operation options 1602, a smart glasses diagram 1603, operation instructions corresponding to the selected quick operation 1604, a quick command option list 1605, etc.

[0406] The quick operation title bar 1601 includes a quick operation title and a return control for indicating the return to the previous screen.

[0407] Multiple shortcut operation options 1602 are used to indicate different shortcut operation options, such as double-tap, swipe, and pinch. Users can click on different shortcut operation options to select the corresponding shortcut operation settings. For example, the user interface 1600 displays the settings page corresponding to the pinch shortcut operation.

[0408] The smart glasses illustration 1603 is used to display schematic diagrams of different smart glasses models. Different illustrations can be displayed depending on the model of the smart glasses. The smart glasses illustration 1603 can also display illustrative operations for selected shortcuts, such as animated demonstrations showing how the user should operate the buttons.

[0409] The operation instructions 1604 corresponding to the selected shortcut operation are used to explain the key points of the selected shortcut operation. For example, the operation instructions for the pinch operation shown in the user interface 1600 are "four fingers on top, thumb on the bottom, pinch the left temple".

[0410] The shortcut option list 1605 displays multiple shortcuts, allowing users to quickly select the shortcut corresponding to the currently selected shortcut operation. The shortcut option list 1605 may include the shortcut name 1606 on the left and the selection control 1607 on the right. The shortcuts can display some actually developed and implementable functions for user selection, such as face-to-face translation, voice memos, pinch-to-talk, pairing with new devices, and more options, as illustrated in the user interface 1600. In the user interface 1600, when the pinch-to-talk command is selected, after successful setup, the pinch-to-talk function can be quickly activated when the user pinches the smart glasses, allowing the user to make voice calls with other contacts through the smart glasses.

[0411] After completing the relevant settings, the smart glasses can communicate with selected contacts through Huawei's MeeTime messaging app or other third-party communication applications such as WeChat and QQ. Conversation content can include voice messages and text messages. The following example... Figures 17 to 20 The user interface shown is an example to describe a session-related example user interface. Figures 17 to 20 The example user interface uses Huawei's Messenger messaging application as an example. Of course, smart glasses can also communicate through other third-party communication applications, which will not be elaborated here.

[0412] refer to Figure 17 , Figure 17 The session interface of the Connect Messaging application, i.e., user interface 1700, is shown.

[0413] like Figure 17 As shown, the user interface 1700 displays the title bar 1701 of the Changlian Messaging application, a search control 1702, an add control 1703, and a conversation list composed of multiple conversation bars 1704.

[0414] The title bar of the Connect Messaging app (1701) includes the Connect Messaging title.

[0415] The search control 1702 can be used by users to search chat history or contacts.

[0416] Add control 1703 can be used by users to add new contacts or start group chats, or other functions such as scanning, receiving and paying.

[0417] The conversation list includes multiple conversation bars 1704, which indicate conversation messages or group chat messages with other contacts. Clicking on a conversation bar 1704 will take the user to a detailed conversation interface.

[0418] The conversation bar 1704 can include information such as the contact's or group chat name, avatar, most recent conversation message, and most recent conversation time. If the other contact is wearing smart glasses, the conversation bar 1704 can also display an indicator icon 1705 to indicate that the contact is wearing smart glasses and can be used to conduct a seamless chat conversation with that contact.

[0419] In some embodiments, an unread flag can be displayed if a session has unread messages.

[0420] Figure 18 , Figure 19 , Figure 20 A sample interface for a specific session is shown.

[0421] like Figure 18 As shown, user interface 1800 is the chat session interface between the local user and the contact Alice.

[0422] like Figure 18 As shown, the user interface 1800 displays a session title bar 1801, shortcut function controls 1802, date and time indicators 1803, prompt messages 1804, local user avatar 1805, other party contact avatar 1806, local user dialog box 1807, other party contact dialog box 1808, voice input control 1810, input box 1809, emoticon selection control 1811, and confirmation send control 1812, etc.

[0423] The conversation title bar 1801 can include the name of the other party's contact or group chat, and a return control to indicate returning to the previous screen. The user interface 1800 displays the name of the other party's contact, Alice.

[0424] The quick function control 1802 is a control for enabling some commonly used functions, allowing users to quickly activate the corresponding functions, such as initiating a video chat or a phone call.

[0425] Date and time identifier 1803 is used to display the time and date when the message occurred.

[0426] The prompt message 1804 is used to explain or prompt relevant information to the user. For example, in the user interface 1800, after both parties complete the pairing for Changlian NieChat, a prompt message can be displayed: "Alice has been added as a Changlian NieChat contact. Enjoy efficient communication immediately. Click to view the Changlian NieChat tutorial." This is used to inform the user that Alice has been successfully added as a contact after the local user adds Alice as a contact, and both parties can use the Changlian NieChat function to communicate.

[0427] The local user avatar 1805 and the local user dialog box 1807 usually appear together to identify the input information of the local user. The local user dialog box 1807 can contain either voice or text information.

[0428] In the user interface 1800, the local user dialog box 1807 displays the voice message. The user can listen to the voice message by clicking on the local user dialog box 1807. The local user dialog box 1807 also indicates the duration of the voice message. During the listening process, the user can click on the local user dialog box 1807 to pause or end the playback of the voice message.

[0429] Voice messages can be voice recordings captured by the user's smart glasses microphone, voice recordings captured by the phone's microphone, and so on. When the user is wearing smart glasses, voice can be captured through the smart glasses and then sent to the MeeTime messaging session. The MeeTime messaging app then sends the voice message to the recipient's contact. The MeeTime messaging session interface can save the message history for easy replay.

[0430] The other party's avatar (1806) and dialog box (1808) usually appear simultaneously to indicate the input information of the other party's contact. The dialog box (1808) can contain either voice or text information.

[0431] In user interface 1800, the other party's contact dialog box 1808 contains text information.

[0432] exist Figure 18 In one embodiment shown, the other party, Alice, is not wearing smart glasses, so she can send text messages to converse with the local user who is wearing smart glasses. The local user sends voice messages, and the other party, Alice, sends text messages. Of course, the other party, Alice, can also use her mobile phone to capture voice messages for conversation.

[0433] The voice input control 1810 is used by local users to quickly enable voice input.

[0434] Input box 1809 can be used by local users to input session content.

[0435] The emoticon selection control 1811 allows local users to select emoticons. Emoticons are images or animations that express emotions and are commonly used in chat interactions.

[0436] The confirmation send control 1812 can be used by users to confirm sending a message after they have entered the content.

[0437] In some embodiments, if the other party's contact, Alice, is wearing smart glasses, such as Figure 19 As shown in the user interface 1900, a wearing indicator 1902 can be displayed next to the contact name in the conversation title bar 1901 of the conversation interface, indicating that the current contact Alice is wearing smart glasses, making it convenient for local users to identify whether the contact is currently wearing smart glasses.

[0438] If both the local user and the other party's contact are wearing smart glasses, they can communicate via the Smart Connect pinch-to-talk function, making communication more efficient and convenient, just like a voice call. However, compared to real-time voice calls, the voice messages in this embodiment can be retained in the conversation interface for easy replay.

[0439] Both parties can send voice messages to each other, as shown in user interface 1900. The local user dialog box 1903 displays voice messages, and the other party's contact dialog box 1904 also replies with voice messages.

[0440] When a user listens to a voice message in a dialog box, the current playback progress can be indicated by a shaded area covering the dialog box, as shown in dialog box 1904 of the other party's contact.

[0441] In some embodiments, users can drag the progress line in the shaded area to move forward or backward in the audio progress and quickly locate the desired time position.

[0442] During the listening to the voice message, the user can click on the other party's contact dialog box 1904 to pause or end the playback of the voice message.

[0443] In some embodiments, after a local user initiates a Changlian NexChat pairing invitation to a contact, an invitation card for the Changlian NexChat pairing invitation can be displayed in the conversation interface. As shown in user interface 2000, the invitation card 2001 for the Changlian NexChat pairing invitation can display corresponding invitation information, such as "I have initiated a Changlian NexChat exclusive pairing. Once paired successfully, you can chat immediately. Confirm now! Set up the pinch pairing function in the Smart Life APP and enjoy exclusive chat moments." The contact can click on the invitation card 2001 for the Changlian NexChat pairing invitation to go to the corresponding confirmation page to confirm enabling the Changlian NexChat function.

[0444] After both Alice (the other party's contact) and the local user confirm that MeeTime NeckChat is enabled, both parties can communicate using the MeeTime NeckChat function while wearing smart glasses, making communication more efficient and convenient.

[0445] In some embodiments, users can form group chats with multiple contacts. Similarly, in a group chat, multiple contacts can communicate via voice or text. Users wearing smart glasses can capture and listen to voice messages during group chats.

[0446] If multiple users wear smart glasses, they can communicate through the glasses, making communication faster and more efficient, much like a voice call. However, compared to real-time voice calls, the voice messages in this embodiment can be stored in the conversation interface for easy replay.

[0447] In some embodiments, the Connect Messenger app can coordinate the playback order of voice messages in a group chat, playing them in the order in which the Connect Messenger app receives the voice messages.

[0448] In this application, the user interface related to group chat and Figures 18 to 20 The user interface shown is similar, and will not be described again in this application.

[0449] In some embodiments, a user interface related to the Changlian NieChat privacy statement may be added.

[0450] In some embodiments, a user interface related to the Changlian NieChat beginner tutorial can also be added.

[0451] It is understandable that the above Figures 10 to 20 The user interface described herein is merely an example interface, primarily intended to illustrate the relevant functions of smart glasses. It does not constitute a limitation on the user interfaces of other embodiments of this application, and other scenarios based on the same solution are all within the protection scope of this application. In other embodiments, other different user interfaces can also be used to help users send and receive voice messages through quick operations. More or fewer user interfaces and controls can be added or removed, or different human-computer interaction operations can be designed, depending on the actual situation, to make the user interface more user-friendly.

[0452] In combination with the above Figures 1 to 20 The embodiments shown below illustrate a communication method provided by this application.

[0453] This embodiment of the method uses a first communication system composed of a first smart glasses, a first mobile phone, a second mobile phone, and a second smart glasses as an example for illustration. The first communication system is... Figure 4The communication system 40 shown includes the first smart glasses, which is also known as electronic device 100 or the first device; the first mobile phone, which is also known as electronic device 200 or the second device; the second mobile phone, which is also known as electronic device 300 or the third device; and the second smart glasses, which is also known as electronic device 400 or the fourth device.

[0454] As not limited to the example, in the communication system 40, electronic device 100 or electronic device 400 can also be other smart wearable devices with voice call functions, such as smart bracelets, smartwatches, smart necklaces, smart earphones, smart rings, smart earrings, smart goggles, smart helmets, VR / AR devices, etc. The device types of electronic device 100 and electronic device 400 can be the same or different. Electronic device 200 or electronic device 300 can also be PCs, tablets, laptops, cloud hosts / servers or other desktop computers, laptops, handheld computers, AI devices, smart TVs, in-vehicle devices, game consoles, etc., with strong processing power. This embodiment does not impose any limitations on this.

[0455] The first smart glasses, first or second mobile phone, and second smart glasses in the first communication system can be equipped with Android. ® System, Windows ® System, iOS ® macOS ® Linux ® System, HarmonyOS ® The operating systems of the various terminal devices in the first communication system can be the same or different, whether they are HarmonyOS (HOS) or other types of operating systems. This application does not impose any restrictions on this.

[0456] In some embodiments, the first smart glasses, the first mobile phone or the second mobile phone, and the second smart glasses in the first communication system are all equipped with HarmonyOS. ® If the system consists of multiple terminals, then the system can be called HarmonyOS. ® Super Virtual Terminal, also known as HarmonyOS ® HyperTerminal.

[0457] In this embodiment, the first user holds the first smart glasses and the first mobile phone, and the second user holds the second smart glasses and the second mobile phone.

[0458] The examples provided in this embodiment do not constitute any limitation on other embodiments of this application.

[0459] Figure 21 This is a flowchart of the communication method provided in the embodiments of this application, which specifically includes the following steps: S101A, the first smart glasses establish the first connection with the first mobile phone.

[0460] S101B, the first mobile phone establishes a third connection with the second mobile phone.

[0461] S101C: The second smart glasses establish a second connection with the second mobile phone.

[0462] The first smart glasses and the first mobile phone can communicate via a first connection. The first mobile phone and the second mobile phone can communicate via a third connection. The second smart glasses and the second mobile phone can communicate via a second connection.

[0463] Through the first connection, the second connection, and the third connection, message communication between the first smart glasses and the second smart glasses can be realized.

[0464] This embodiment does not restrict the order in which the first, second, and third connections are established. In some embodiments, after the first and third connections are established, the first user may initiate a pairing invitation request or send a voice message to the second user without establishing the second connection. The second user may also receive and listen to the voice messages sent by the first user through the first smart glasses on the second mobile phone. The voice messages transmitted between the first and second mobile phones carry voice data.

[0465] The first connection, the second connection, and the third connection can be wired or wireless; this embodiment does not impose any restrictions.

[0466] The first, second, or third connection can include short-range wireless communication connections, such as Bluetooth, Wi-Fi, or hotspot connections, to enable communication between the first smart glasses and the first mobile phone, or between the first mobile phone and the second mobile phone, or between the second smart glasses and the second mobile phone, whether under the same account, without an account, or with different accounts. Wireless connections are not bound by wires, allowing users greater freedom of movement.

[0467] The first, second, or third connection can also be an Internet connection.

[0468] In some embodiments, the first smart glasses and the first mobile phone, and / or the first mobile phone and the second mobile phone, and / or the second smart glasses and the second mobile phone can log in to the same account, thereby connecting and communicating via the Internet.

[0469] In some embodiments, multiple terminals can log in to different accounts, but connect through a binding method. For example, the first smart glasses and the first mobile phone can log in to different accounts. The first mobile phone sets up a device management application to bind the first smart glasses to itself, and then connects through the device management application.

[0470] The first, second, or third connection may also include wired connections, such as USB connections, DP connections, etc.

[0471] This application embodiment does not limit the type of the first connection, second connection, or third connection. In the first communication system, terminals can transmit and interact with each other through various communication connection types. Furthermore, terminals can also connect and communicate using any combination of the above methods; this application embodiment does not impose any restrictions on this.

[0472] Accordingly, the first smart glasses, the first mobile phone, the second smart glasses, and the second mobile phone can be equipped with mobile communication modules and wireless communication modules for communication. The mobile communication module can provide wireless communication solutions including 2G / 3G / 4G / 5G for terminal applications. The wireless communication module can include Bluetooth modules and / or WLAN modules. Specifically, the Bluetooth module can provide solutions including one or more Bluetooth communication methods such as classic Bluetooth (Bluetooth 2.1) or Bluetooth Low Energy, and the WLAN module can provide solutions including one or more WLAN communication methods such as Wi-Fi P2P, Wi-Fi LAN, or Wi-Fi softAP.

[0473] In some embodiments, the third connection is an internet connection, and the first and second connections are short-range wireless communication connections, such as Bluetooth connections.

[0474] In some embodiments, a first communication application may be installed on the first mobile phone or the second mobile phone. The first user or the second user may log in to the first communication application on the first mobile phone or the second mobile phone and conduct voice calls or video calls through a third connection (such as an Internet connection).

[0475] After establishing a communication connection between the first smart glasses, the first mobile phone, and the second smart glasses and the second mobile phone, the subsequent steps can be divided into a pairing phase and a communication phase. The pairing phase may include steps S102 to S108, and the communication phase may include steps S109 to S117. If the first mobile phone and the second mobile phone have already completed pairing, the communication phase can proceed directly, and the first user and the second user can initiate voice communication by wearing the smart glasses.

[0476] Specifically, Phase 1 Pairing Phase (Steps S102 to S108) S102, in the first communication application, the first mobile phone detects user operation A in which the first user selects the second user as the communication target.

[0477] The first user and the first user can have a conversation with each other through a first communication application. The first communication application can be Huawei's Messenger application or other third-party communication applications, such as WeChat, QQ, etc. The conversation content can include voice messages, text messages, etc. This embodiment does not limit this, and any communication application can be applied to this embodiment.

[0478] After a first user successfully pairs with a specific contact (i.e., the first contact), they can wear the first device to communicate with that contact. Within a given time period, the first user's first device and second device can only establish a seamless chat session with one contact. The seamless chat session refers to the logical communication channel through which the first user communicates with the first contact via the first device.

[0479] Referring to the foregoing embodiments Figures 17 to 20 The user interface shown here is an example session interface related to the first communication application, which will not be described in detail here.

[0480] Referring to the foregoing embodiments Figures 12 to 15 The user interface shown illustrates the interface for enabling the seamless chat function and sending a pairing invitation to the other user.

[0481] In some embodiments, user operation A can be a touch operation performed by a first user on the screen of a first mobile phone, for example... Figure 14 The example shows a user's touch tap action to add Alice as a contact. User action A could also be... Figure 12 The user shown has enabled seamless chat. Figure 13 Click to select contact list. Figure 14 The example illustrates a series of combined operations, such as selecting a contact or selecting a contact after searching for them. This embodiment does not limit the specific method of user operation A; the purpose of user operation A is to select a second user as a communication target.

[0482] User operation A can also be called the fourth user operation. For example, the fourth user operation can be a click operation performed on a second device, such as a mobile phone touch screen.

[0483] S103, the first smart glasses detected the user operation B of the first user.

[0484] Refer to the above. Figure 5 , Figure 6 , Figure 7 , Figure 8 In the described embodiment, the first smart glasses can trigger different commands by detecting different user operations performed on the first smart glasses.

[0485] User operation B can also be referred to as the sixth user operation. The sixth user operation includes any one or more of the following operations or combinations thereof: tapping, pinching, sliding, and releasing. The sixth user operation can be a pinching operation applied to the temple of a first device, such as smart glasses.

[0486] This embodiment does not limit the specific method of user operation B. User operation B can be tapping, pinching, sliding, or a combination thereof. Users or developers can customize the settings according to actual conditions or personal habits. For example, in one embodiment, user operation B is to pinch the left temple of the glasses for 2 seconds.

[0487] The purpose of user operation B is to trigger the first smart glasses to send a first instruction to the first mobile phone, which is to notify the first mobile phone to send a pairing invitation request to the second mobile phone used by the second user.

[0488] S104, the first smart glasses send the first command to the first mobile phone.

[0489] In response to user operation B, the first smart glasses send a first instruction to the first mobile phone via the first connection.

[0490] The first instruction is used by the first smart glasses to notify the first mobile phone to send a pairing invitation request to the second mobile phone used by the second user.

[0491] S105, the first mobile phone sends a pairing invitation request to the second mobile phone.

[0492] In response to the first instruction sent by the first smart glasses, the first mobile phone sends a pairing invitation request to the second mobile phone through a third connection.

[0493] This pairing invitation request is a request from the first user to establish a channel for voice messaging with the second user through smart glasses, such as the "Changlian Niecha" function, which allows both the first and second users to communicate quickly through smart glasses while both are wearing them.

[0494] refer to Figure 15 The user interface shown, for example, after the second mobile phone receives a pairing invitation request sent by the first mobile phone, can display something like this. Figure 15 The user interface shown includes a pairing invitation dialog box 1501, which includes pairing invitation information, such as... Figure 15The pop-up message "Bob has invited you to join a Changlian chat pairing event. You can easily communicate by accepting the invitation. Do you agree?" is shown in the pop-up message pairing invitation prompt box 1501. The pop-up message pairing invitation prompt box 1501 also includes an "Agree" control 1502 and a "Cancel" control 1503. If the user clicks the "Agree" control 1502, they accept the Changlian message pairing invitation; if the user clicks the "Cancel" control 1503, they reject the Changlian message pairing invitation. The corresponding acceptance or rejection message will be returned to the requesting device, i.e., the first mobile phone.

[0495] S106, the second mobile phone detected the user operation C of the second user.

[0496] In some embodiments, user operation C can be a touch operation performed by a second user on the screen of a second mobile phone, such as a user... Figure 15 The touch click operation of the "Agree" control 1502 in this embodiment does not limit the specific method of user operation C. The purpose of user operation C is to notify the second mobile phone to receive the pairing invitation message.

[0497] User operation C can also be called the fifth user operation. For example, the fifth user operation can be a click operation performed on a third device, such as a mobile phone touch screen.

[0498] S107, the second mobile phone sends a message to the first mobile phone confirming receipt of the pairing invitation request.

[0499] In response to user operation C, the second mobile phone sends a message to the first mobile phone via a third connection to confirm receipt of the pairing invitation request.

[0500] S108, the first and second mobile phones have successfully paired and established a seamless chat connection.

[0501] After steps S102 to S107, the first smart glasses, the first mobile phone, the second mobile phone, and the second smart glasses establish a channel for voice message calls through the smart glasses, namely, the seamless connection.

[0502] After the third device sends a confirmation message to the second device acknowledging receipt of the pairing invitation request, the second device, upon receiving the confirmation message from the third device, sends a notification to the first device. The first device then issues a first notification message, which includes one or more of the following: a notification sound, vibration, or indicator light. The first notification message is used to notify the user that pairing with the first contact has been successful.

[0503] After the first user and the second user complete pairing, the first communication application can notify both parties that pairing has been completed and they can communicate via voice messages. For example... Figure 18As shown in the user interface 1800, in the conversation interface of the Changlian Messenger application, after both parties complete the Changlian Nexual Chat pairing, a prompt message can be displayed: "Alice has been added as a Changlian Nexual Chat contact. Enjoy efficient communication immediately. Click to view the Changlian Nexual Chat tutorial." This is used to inform the user that Alice has been successfully added as a contact after the local user adds Alice as a contact, and both parties can use the Changlian Nexual Chat function to communicate.

[0504] Successfully paired contacts can be displayed with a special icon in the communication application, and the wearing status of the smart glasses can also be indicated by different colors or icons, such as a bright color indicating that they are being worn, and a gray color indicating that they are not being worn.

[0505] Phase 2 Communication Phase (Steps S109 to S117) Once paired successfully, the first user and the second user can communicate through the first smart glasses and the second smart glasses.

[0506] The first user holds the first smart glasses and the first mobile phone, and the second user holds the second smart glasses and the second mobile phone.

[0507] When the first user wears the first smart glasses, the microphone on the first smart glasses can be used to collect voice messages, which are then sent to a first mobile phone via a first connection. The first mobile phone then sends the voice messages to a second mobile phone via a first communication application. Simultaneously, after receiving the voice messages from the first mobile phone in the first communication application, the second mobile phone forwards the voice messages to the second smart glasses via a second connection. When the second user wears the second smart glasses, they can choose to have the voice messages played by the second smart glasses.

[0508] In this way, when the first user is wearing the first smart glasses and the second user is wearing the second smart glasses, they can communicate quickly via voice messages through both smart glasses. When communicating through smart glasses, both users do not need to constantly hold a heavy mobile phone, freeing their hands and improving human-computer interaction. Implementing this embodiment provides users with greater communication convenience.

[0509] In some embodiments, after the first user puts on the first smart glasses, if they want to have a conversation with a paired contact, they can perform a user action on the temple of the smart glasses, such as long-pressing the temple, to confirm whether the other party is wearing the smart glasses. If the other party is wearing them, a corresponding prompt tone will sound; if the other party is not wearing them, a corresponding prompt tone will sound, allowing the user to quickly confirm whether the other party is wearing the smart glasses.

[0510] This communication phase can be referenced. Figure 8 , Figure 9 The described embodiments.

[0511] S109, the first smart glasses detect the first user's user operation D and begin collecting the first user's voice.

[0512] Refer to the above. Figure 5 , Figure 6 , Figure 7 , Figure 8 , Figure 9 In the described embodiment, the first smart glasses can trigger different commands by detecting different user operations performed on the first smart glasses.

[0513] User operation D, also known as the first user operation, may include a start action, which is used to instruct the first device to start collecting sound.

[0514] The first user operation can include any one or a combination of the following operations: tapping, pinching, sliding, releasing, etc. The first user operation can be applied to a preset component or preset area of ​​the first device. For example, when the first device is smart glasses, the preset component is the temple of the smart glasses, or the preset area is the area where the sensor is located. The first user operation can be a tapping, pinching, sliding, etc., applied to the temple of the smart glasses.

[0515] This embodiment does not limit the specific method of user operation D. User operation D can be tapping, pinching, sliding, or a combination thereof. Users or developers can customize the settings according to actual conditions or personal habits. For example, in one embodiment, user operation D is pinching the left temple of the glasses.

[0516] The purpose of user operation D is to trigger the first smart glasses to turn on the sound recording function and collect the first user's voice.

[0517] In response to user operation D, the first smart glasses can capture the voice of the first user. This capture device can be the microphone of the first smart glasses.

[0518] For example, in some embodiments, after the first smart glasses detects that the user has pressed and pinched the left temple for 1 second, it will emit a prompt sound or vibration to inform the user that the recording function has been activated. Then, the user continues to press and hold the left temple, and while the user is holding the press down, the first smart glasses will start recording. After the user releases the left temple, the recording will stop.

[0519] In some embodiments, if the first device receives second voice data sent by the second device within a first time period, then after the first sound acquisition ends, the first device plays the second voice data. The second voice data may be voice data acquired by a third or fourth device, sent from the third device to the second device, and then to the first device. The communication between the first and fourth devices may be simplex communication, i.e., not a real-time call, but rather only one of the acquisition or playback channels is active.

[0520] In some embodiments, before the first device collects the first sound, the first device obtains information from the second device that the fourth device is in a wearing state. The first device issues a second notification message to notify the user that the fourth device is in a wearing state. The second notification message includes any one or more of the following: a notification sound, vibration, and indicator light. For example, before the first device detects each user operation and collects the first sound, the first device obtains information from the second device in real time as to whether the fourth device is currently in a wearing state. The second device obtains information from the third device as to whether the fourth device is currently in a wearing state. The fourth device can send the result of detecting whether it is currently being worn by the user to the third device. The third device can then obtain information from the fourth device as to whether the fourth device is currently being worn by the user, and then send this result to the second device. The second device then sends the result of whether the fourth device is currently in a wearing state to the first device. After the first device knows whether the fourth device is in a wearing state, i.e., whether the second user is currently wearing smart glasses, the first device can issue different notification messages, such as a notification sound, indicator light, vibration, etc., to notify the first user whether the first contact is currently wearing the fourth device. The notification messages for wearing a fourth device can be different from those for not wearing a fourth device. For example, if the other party's first contact is wearing a fourth device, it can emit two "beep" sounds, while if the other party's first contact is not wearing a fourth device, it can emit a long "beep" sound.

[0521] S110, the user operation E of the first user is detected, and the first voice data is generated.

[0522] The data contained in the first voice data can be referred to as the first voice data. The first voice data can be transmitted between devices.

[0523] In response to user action E, the user can end the recording of voice data and generate the first voice data. For example, user action E could be the action of loosening the temple of the smart glasses.

[0524] User operation E can also be referred to as the second user operation. The second user operation includes an end action, which is used to instruct the first device to stop collecting sound. The second user operation includes any one or more of the following operations or combinations thereof: tapping, pinching, sliding, and releasing. The second user operation can be applied to a preset component or preset area of ​​the first device. For example, when the first device is smart glasses, the preset component is the temple of the smart glasses, or the preset area is the area where the pressure sensor is located. The second user operation can be an operation that releases the press / release state on the temple of the smart glasses.

[0525] In some embodiments, the first device can automatically determine when to end the audio capture without requiring a second user operation. If no sound is detected for more than 2 seconds, the audio capture will automatically end without requiring manual user intervention, thus improving the user experience.

[0526] The first voice data refers to the voice data collected within a first time period, which is a continuous period of time. The start time of the first time period is the moment when the first device begins collecting sound, and the end time of the first time period is the moment when the first device stops collecting sound.

[0527] Generally, the acquisition time of the first voice data is the same as the playback time.

[0528] In some embodiments, the duration of the first voice data is capped, for example, 60 seconds.

[0529] S111, the first smart glasses detect the user operation F of the first user.

[0530] This embodiment does not limit the specific implementation of user operation F.

[0531] The purpose of the user's operation F is to notify the first smart glasses to confirm the sending of the first voice data.

[0532] User operation F, also known as third user operation, is an operation that instructs the transmission of first voice data. Third user operation includes any one or a combination of the following operations: tapping, pinching, sliding, and releasing. For example, a third user operation could be a forward sliding action on a first device (such as the temple of smart glasses).

[0533] In some embodiments, the user operation F may be a forward sliding operation performed on a sliding sensor on the temple of the first smart glasses.

[0534] In other embodiments, the user can perform a user operation G to cancel the transmission of the first voice data, such as a backward sliding operation on the sliding sensor on the temple of the first smart glasses.

[0535] In some embodiments, the first smart glasses may emit a prompt tone or vibration as feedback to indicate to the first user that a voice message has been sent or canceled.

[0536] If the first smart glasses detect the user's operation G, then the first smart glasses will not send the recorded first voice data. The process ends here, and there are no further steps. The first user can re-record the next voice data.

[0537] S112, the first smart glasses send the first voice data to the first mobile phone.

[0538] In response to user operation F, the first smart glasses send first voice data to the first mobile phone through the first connection.

[0539] S113, the first mobile phone retains the first voice data in the first communication application.

[0540] In some embodiments, after receiving the first voice data sent by the first smart glasses, the first mobile phone can store the first voice data in the first communication application, so that the first user can listen to the first voice data again later, or avoid missing unlistened voice data.

[0541] S114, the first mobile phone sends the first voice data to the second mobile phone.

[0542] After receiving the first voice data sent by the first smart glasses, the first mobile phone sends the first voice data to the second mobile phone via a third connection. The first voice data sent from the first mobile phone to the second mobile phone is carried in the first voice message.

[0543] In some embodiments, the first smart glasses may emit feedback information such as a prompt tone or vibration to indicate whether the first user's voice data transmission was successful or failed.

[0544] S115, the second mobile phone retains the first voice data in the first communication application.

[0545] In some embodiments, after receiving the first voice data sent by the first mobile phone, the second mobile phone may also store the first voice data in the first communication application, so that the second user can listen to the first voice data again later.

[0546] If the second user is not wearing smart glasses, they can listen to the first voice data by clicking on the first communication application.

[0547] S116, the second mobile phone sends the first voice data to the second smart glasses.

[0548] In some embodiments, before sending the first voice data to the second smart glasses, the second mobile phone detects whether the second smart glasses are currently being worn by a user. If the second mobile phone detects that the second smart glasses are currently being worn by a user, it can send the first voice data to the second smart glasses. If the second mobile phone detects that the second smart glasses are not currently being worn, it can temporarily refrain from sending the first voice data to the second smart glasses, and only send the unheard voice data to the second smart glasses when it detects that the second smart glasses are being worn.

[0549] In other embodiments, the second mobile phone can directly send the first voice data to the second smart glasses, and then the second smart glasses can determine whether to play the first voice data. When the second smart glasses detect that the second smart glasses are being worn by a user, the first voice data is played. When the second smart glasses detect that the second smart glasses are not being worn by a user, the first voice data can be temporarily stored and not played. The second smart glasses will then play the unheard voice data when it detects that the second smart glasses are being worn.

[0550] S117, the second smart glasses play the first voice data.

[0551] In some embodiments, the first smart glasses can be configured to automatically play the first voice data after receiving it. The playback device can be the speaker of the first smart glasses.

[0552] In some embodiments, the first smart glasses may be configured to play voice data only after detecting user operation H.

[0553] This embodiment does not restrict the triggering conditions for the second smart glasses to play voice data.

[0554] After the first voice data is played, the second smart glasses can emit a prompt tone or vibration to notify the second user that the first voice data playback is complete.

[0555] In some embodiments, during the playback of the first voice data, the second user can choose to pause or interrupt playback. When the second smart glasses detect user operation I, such as sliding the temples backward, the second smart glasses can pause or cancel the playback of the first voice data. Unread voice messages in the chat interface of the first communication application can display an unread marker, such as a red dot.

[0556] User operation I, also known as the seventh user operation, includes any one or a combination of the following operations: tapping, pinching, sliding, and releasing. The seventh user operation can be a backward sliding action performed on the temple of a first device, such as smart glasses.

[0557] In some embodiments, if the message received by the second mobile phone on the first communication application is a text message instead of a voice message, the second smart glasses may only emit a prompt tone without playing the voice message.

[0558] In some embodiments, if the second mobile phone receives a first text message instead of a voice message on the first communication application, the second mobile phone can perform voice recognition on the text message, convert it into third voice data, and then send it to the second smart glasses, which will then play the third voice data.

[0559] In some embodiments, before the second smart glasses play the first voice data, they may emit a prompt tone or vibration to alert the user that the voice data is about to be played. If the user does not wish to listen to the voice data, they can cancel playback by sliding the temple of their glasses backward after hearing the prompt tone.

[0560] If the second smart glasses receive multiple voice data messages, they can automatically play them sequentially. A certain time interval can be allowed between each voice message, such as a 0.5-second gap, to facilitate differentiation between different voice messages.

[0561] In some embodiments, the second smart glasses can play voice data, regardless of whether the second mobile phone is in a state of being on or off.

[0562] In some embodiments, users can turn off the Connect Meetup feature or set Do Not Disturb in Connect Meetup messages, so that they will not receive Connect Meetup message notifications from the other party.

[0563] In some embodiments, a user can form a group chat with multiple contacts, such as when a first user selects a group chat as the conversation partner instead of a single contact. Similarly, within a group chat, multiple contacts can communicate via voice or text. Users wearing smart glasses can capture and listen to voice messages during group chats.

[0564] If multiple users wear smart glasses, they can communicate through the glasses, making communication faster and more efficient, much like a voice call. However, compared to real-time voice calls, the voice messages in this embodiment can be stored in the conversation interface for easy replay.

[0565] In some embodiments, the Connect Messenger app can coordinate the playback order of voice messages in a group chat, playing them in the order in which the Connect Messenger app receives the voice messages.

[0566] In practical business scenarios, the first communication system may include more or fewer terminal devices. For example, the first communication system may only include a first smart glasses, a first mobile phone, and a second mobile phone. The first user collects voice information through the first smart glasses and sends it to the first mobile phone. The first mobile phone then sends the voice information to the second mobile phone, and the second user plays the voice using the speaker of the second mobile phone. Alternatively, the first communication system may include more terminal devices. For instance, the first or second smart glasses may be used in conjunction with a handheld device, such as a gamepad, handheld controller, gyroscope mouse, stylus, or other handheld computing device. This embodiment does not limit the terminal type, number of terminals, or connection method in the first communication system.

[0567] By implementing the method provided in this embodiment, a first user wearing first smart glasses and a second user wearing second smart glasses can communicate quickly via voice messages through the first and second smart glasses. When communicating through smart glasses, both users do not need to constantly hold a heavy mobile phone, freeing their hands and improving human-computer interaction performance. This embodiment provides users with greater communication convenience.

[0568] The implementation methods described in the above embodiments are merely illustrative and do not constitute any limitation on other embodiments of this application. Specific internal implementation methods may vary depending on the type of electronic device, the operating system it runs, the program used, and the interfaces called. This application's embodiments do not impose any limitations; any implementation that achieves the functional features described in this application's embodiments is sufficient.

[0569] As used in the above embodiments, depending on the context, the term "when..." can be interpreted as meaning "if...", "after...", "in response to determining...", or "in response to detecting...". Similarly, depending on the context, the phrase "when determining..." or "if (the stated condition or event) is interpreted as meaning "if determining...", "in response to determining...", "when (the stated condition or event) is detected", or "in response to detecting (the stated condition or event)".

[0570] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state drive), etc.

[0571] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

[0572] The above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A communication method, characterized in that, The method is applied to a communication system, which includes a first device, a second device, a third device, and a fourth device, wherein the first device and the fourth device are wearable devices, the first device is smart glasses, the first device establishes a first connection with the second device, and the third device establishes a second connection with the fourth device; The method includes: The first device detects a first user operation applied to the temple of the smart glasses, the first user operation being used to instruct the first device to start collecting sound; The first device collects sound; The first device stops collecting the sound and generates first voice data, which is the data of the collected sound. The first device sends the first voice data to the second device through the first connection; After receiving the first voice data, the second device sends the first voice data to the third device; After receiving the first voice data, the third device sends the first voice data to the fourth device through the second connection; The fourth device plays the first voice data.

2. The method according to claim 1, characterized in that, The method further includes: If the first device receives the second voice data sent by the second device within the first time period, then after the sound acquisition ends, the first device plays the second voice data.

3. The method according to claim 1 or 2, characterized in that, Before the first device finishes collecting sound, the method further includes: The first device detects a second user operation, which instructs the first device to stop collecting sound.

4. The method according to any one of claims 1-3, characterized in that, Before the first device sends the first voice data to the second device via the first connection, the method further includes: The first device detects a third user operation, which includes any one or more of the following operations: tapping, pinching, sliding, and releasing. The first device sends the first voice data to the second device through the first connection, specifically including: In response to the third user's action, the first device sends the first voice data to the second device through the first connection.

5. The method according to any one of claims 1-4, characterized in that, The second device and the third device are equipped with a first communication application, which stores the first voice data. The second device sends the first voice data to the third device, specifically including: The second device sends the first voice data to the third device through the first communication application; The third device receives the first voice data from the second device through the first communication application.

6. The method according to any one of claims 1-5, characterized in that, Before the third device sends the first voice data to the fourth device via the second connection, the method further includes: The third device confirms that the fourth device is being worn by the user. The third device sends the first voice data to the fourth device through the second connection, specifically including: When the third device confirms that the fourth device is being worn by the user, the third device sends the first voice data to the fourth device through the second connection.

7. The method according to any one of claims 1-6, characterized in that, Before the second device sends the first voice data to the third device, the method further includes: The second device detected a fourth user action; The second device confirms that the first contact has been selected; The second device sends a pairing invitation request to the third device, where the third device is the device of the first contact. The third device detected the fifth user's operation; The third device sends a message to the second device confirming receipt of the pairing invitation request.

8. The method according to claim 7, characterized in that, After the third device sends a message to the second device confirming receipt of the pairing invitation request, the method further includes: After receiving the confirmation message from the third device confirming receipt of the pairing invitation request, the second device sends a notification to the first device; The first device sends a first notification message, which includes any one or more of the following: a notification sound, vibration, or indicator light. The first notification message is used to notify the user that the pairing with the first contact has been successful.

9. The method according to claim 7 or 8, characterized in that, Before the second device sends a pairing invitation request to the third device, the method further includes: The first device detects a sixth user operation, which includes any one or more of the following operations: tapping, pinching, sliding, and releasing. The first device sends a first instruction to the second device, which instructs the second device to send the pairing invitation request to the third device.

10. The method according to any one of claims 1-9, characterized in that, Before the first device collects sound, the method further includes: The first device obtains information from the second device that the fourth device is in a wearing state; The first device sends a second notification message, which is used to notify the user that the fourth device is in a wearing state. The second notification message includes any one or more of the following: a notification sound, vibration, and indicator light.

11. The method according to any one of claims 1-10, characterized in that, The method further includes: The fourth device detects a seventh user operation, which includes any one or more of the following operations: tapping, pinching, sliding, and releasing. In response to the seventh user's action, the fourth device cancels the playback of the first voice data.

12. The method according to any one of claims 1-11, characterized in that, The first user operation includes any one or more of the following operations: tapping, pinching, sliding, and releasing.

13. The method according to any one of claims 3-12, characterized in that, The second user operation includes any one or a combination of the following operations: tapping, pinching, sliding, and releasing.

14. The method according to any one of claims 1-13, characterized in that, The method further includes: The first device detected the first user's operation again; The first device collects sound again; The first device stops collecting the sound and generates fourth voice data, which is the data of the collected sound. If, within a first duration after the first device finishes collecting the sound, the first device detects a target user operation, it cancels sending the fourth voice data to the second device; or, if the first device detects a third user operation and, in response to the third user operation, begins sending the fourth voice data to the second device, and the first device detects the target user operation and, in response to the target user operation, cancels sending the fourth voice data to the second device.

15. The method according to claim 14, characterized in that, The second user operation is to slide backward on the temple of the smart glasses.

16. A communication method, characterized in that, The method is applied to a communication system, which includes a first device, a second device, a third device, and a fourth device. The communication method is executed by the second device. The first device and the fourth device are wearable devices. The first device is smart glasses. The first device establishes a first connection with the second device, and the third device establishes a second connection with the fourth device. The method includes: The second device receives the first voice data generated by the sound collected by the first device through the first connection; The second device sends the first voice data to the third device, the first voice data is sent to the fourth device through the third device, and the first voice data is played through the fourth device.

17. The method according to claim 16, characterized in that, The second device and the third device are equipped with a first communication application, which stores the first voice data. The second device sends the first voice data to the third device, specifically including: The second device sends the first voice data to the third device through the first communication application.

18. The method according to claim 16 or 17, characterized in that, The method further includes: The second device confirms that the first device is being worn by the user; The second device sends second voice data to the first device through the first connection.

19. The method according to any one of claims 16-18, characterized in that, Before the second device sends the first voice data to the third device, the method further includes: The second device detected a fourth user action; The second device confirms that the first contact has been selected; The second device sends a pairing invitation request to the third device, where the third device is the device of the first contact. The second device receives a message from the third device confirming receipt of the pairing invitation request.

20. The method according to claim 19, characterized in that, After the second device receives a message from the third device confirming receipt of the pairing invitation request, the method further includes: The second device sends a notification to the first device, the notification being used to instruct the first device to issue a first prompt message, the first prompt message including any one or more of the following: a prompt sound, vibration, indicator light, the first prompt message being used to notify the user that pairing with the first contact has been successful.

21. The method according to any one of claims 19 or 20, characterized in that, Before the second device sends a pairing invitation request to the third device, the method further includes: The second device receives a first instruction sent by the first device, the first instruction being used to instruct the second device to send the pairing invitation request to the third device.

22. The method according to any one of claims 16-21, characterized in that, The method further includes: The second device obtains information from the third device that the fourth device is in a wearing state; The second device notifies the first device to issue a second prompt message. The second prompt message is used to notify the user that the fourth device is in a wearing state. The second prompt message includes any one or more of the following: prompt sound, vibration, indicator light.

23. A communication method, characterized in that, The method is applied to a communication system, which includes a first device, a second device, a third device, and a fourth device. The communication method is executed by the third device. The first device and the fourth device are wearable devices. The first device is smart glasses. The first device establishes a first connection with the second device, and the third device establishes a second connection with the fourth device. The method includes: The third device receives the first voice data from the second device, wherein the first voice data is data generated by the first device collecting sound; The third device sends the first voice data to the fourth device through the second connection, and the first voice data is played by the fourth device.

24. The method according to claim 23, characterized in that, The third device and the second device are equipped with a first communication application, which stores the first voice data. The third device receives the first voice data from the second device, specifically including: The third device receives the first voice data from the second device through the first communication application.

25. The method according to claim 23 or 24, characterized in that, Before the third device sends the first voice data to the fourth device via the second connection, the method further includes: The third device confirms that the fourth device is being worn by the user. The third device sends the first voice data to the fourth device through the second connection, specifically including: When the third device confirms that the fourth device is being worn by the user, the third device sends the first voice data to the fourth device through the second connection.

26. The method according to any one of claims 23-25, characterized in that, Before the third device sends the first voice data to the fourth device via the second connection, the method further includes: The third device receives a pairing invitation request from the second device, and the third device is the device of the first contact. The third device detected the fifth user's operation; The third device sends a message to the second device confirming receipt of the pairing invitation request.

27. The method according to claim 25 or 26, characterized in that, After the third device confirms that the fourth device is being worn by the user, the method further includes: The third device notifies the second device that the fourth device is being worn by the user.

28. A communication method, characterized in that, The method is applied to a communication system, which includes a first device, a second device, a third device, and a fourth device. The communication method is executed by the first device. The first device and the fourth device are wearable devices. The first device is smart glasses. The first device establishes a first connection with the second device, and the third device establishes a second connection with the fourth device. The method includes: The first device detects a first user operation applied to the temple of the smart glasses, the first user operation being used to instruct the first device to start collecting sound; The first device collects sound; The first device stops collecting sound and generates first voice data, which is the data of the collected sound. The first device sends the first voice data to the second device through the first connection. The first voice data is then sent to the fourth device through the second and third devices, and is played through the fourth device.

29. The method according to claim 28, characterized in that, The method further includes: If the first device receives the second voice data sent by the second device within the first time period, then after the sound acquisition ends, the first device plays the second voice data.

30. The method according to claim 28 or 29, characterized in that, The first user operation includes any one or more of the following operations: tapping, pinching, sliding, and releasing.

31. The method according to any one of claims 28-30, characterized in that, Before the first device finishes collecting sound, the method further includes: The first device detects a second user operation, which instructs the first device to stop collecting sound.

32. The method according to claim 31, characterized in that, The second user operation includes any one or a combination of the following operations: tapping, pinching, sliding, and releasing.

33. The method according to any one of claims 28-32, characterized in that, Before the first device sends the first voice data to the second device via the first connection, the method further includes: The first device detects a third user operation, which includes any one or more of the following operations: tapping, pinching, sliding, and releasing. The first device sends the first voice data to the second device through the first connection, specifically including: In response to the third user's action, the first device sends the first voice data to the second device through the first connection.

34. The method according to any one of claims 28-33, characterized in that, The method further includes: The first device detects that it is being worn by the user; The first device notifies the second device that the first device is being worn by the user.

35. The method according to any one of claims 28-34, characterized in that, Before the first device collects sound, the method further includes: The first device obtains information from the second device that the fourth device is in a wearing state; The first device sends a second notification message, which is used to notify the user that the fourth device is in a wearing state. The second notification message includes any one or more of the following: a notification sound, vibration, and indicator light.

36. The method according to any one of claims 28-35, characterized in that, Before the first device sends the first voice data to the second device via the first connection, the method further includes: The first device receives a message from the second device confirming that the third device has received the pairing invitation request; The first device sends a first notification message, which includes any one or more of the following: a notification sound, vibration, or indicator light. The first notification message is used to notify the user that the pairing with the first contact has been successful.

37. The method according to claim 36, characterized in that, Before the first device receives the message from the second device confirming receipt of the pairing invitation request from the third device, the method further includes: The first device detects a sixth user operation, which includes any one or more of the following operations: tapping, pinching, sliding, and releasing. The first device sends a first instruction to the second device, which instructs the second device to send the pairing invitation request to the third device.

38. An electronic device, characterized in that, The electronic device includes: a communication device, a memory, and a processor coupled to the memory, and one or more programs; the memory stores computer-executable instructions, and the processor, when executing the instructions, causes the electronic device to perform the method as described in any one of claims 16 to 37.

39. A communication system, characterized in that, The communication system includes a first device, a second device, a third device, and a fourth device, wherein the first device performs the method as described in any one of claims 28 to 37, the second device performs the method as described in any one of claims 16 to 22, the third device performs the method as described in any one of claims 23 to 27, and the fourth device is configured to play the first voice data after receiving the first voice data from the third device.

40. A computer-readable storage medium comprising instructions, characterized in that, When the instructions are executed on an electronic device, the electronic device causes the electronic device to perform the method as described in any one of claims 16 to 22, or claims 23 to 27, or claims 28 to 37.

Images