Electronic apparatus and using method thereof

TWI935615BActive Publication Date: 2026-08-11COMPAL ELECTRONICS INC
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
TW114100181
Authority / Receiving Office
TW · TW
Patent Type
Patents
Current Assignee / Owner
Priority Date
2024-02-04
Filing Date
2025-01-02
Publication Date
2026-08-11
Estimated Expiration
2045-01-01

AI Technical Summary

Technical Problem

Current laptops require a flat surface and both hands for operation, and their built-in microphones are affected by the surrounding environment and distance, limiting mobility and convenience.

Method used

An electronic device equipped with a power switch, processor, and Bluetooth module that activates a voice assistant upon removal of a designated component, enabling Bluetooth connection and identity recognition for hands-free operation.

Benefits of technology

Allows laptops to be operated without a flat surface and both hands, enhancing mobility and reducing environmental sound interference.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure TWG2TB001905554_001
    Figure TWG2TB001905554_001
  • Figure TWG2TB001905554_002
    Figure TWG2TB001905554_002
  • Figure TWG2TB001905554_003
    Figure TWG2TB001905554_003
Patent Text Reader

Abstract

An electronic device and a method of using the same. The electronic device includes a power switch, a processor, and a first Bluetooth module. The method of using the device includes: in response to the power switch being enabled, activating the first Bluetooth module via the processor based on a startup signal to establish a Bluetooth connection via the first Bluetooth module; executing a voice assistant module via the processor according to the startup signal; and in response to receiving a device use signal via the Bluetooth connection, executing an identity verification process via the voice assistant module to log into the operating system upon successful identity verification.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an electronic device and a method for using the same, and in particular to an electronic device assisted by a voice assistant and a method for using the same. Prior Art

[0002] The primary interactive interface of current laptops is located on the screen and operating area. Therefore, the laptop cannot be operated with the lid and base closed and no external devices connected. Furthermore, laptop operation requires a space and the use of both hands, making it impossible to operate the laptop while the user is moving around or using both hands. Furthermore, the built-in microphone in current laptops is typically located on the base, and the sound reception is affected by the surrounding environment and the distance between the user and the keyboard. Summary of the Invention

[0003] The present invention provides an electronic device and a method for using the same, which can increase the convenience of use.

[0004] The present invention provides a method for using an electronic device, wherein the electronic device includes a power switch, a processor, and a first Bluetooth module. The method includes: in response to the power switch being enabled, activating the first Bluetooth module based on an activation signal via the processor to establish a Bluetooth connection via the first Bluetooth module; executing a voice assistant module based on the activation signal via the processor; and in response to receiving a device usage signal via the Bluetooth connection, executing an identity recognition process via the voice assistant module to log into an operating system when the identity recognition process is passed.

[0005] The electronic device of the present invention includes a power switch, a first Bluetooth module, and a processor. The processor is coupled to the power switch and the first Bluetooth module and is configured to: in response to the power switch being enabled, activate the first Bluetooth module based on an activation signal to establish a Bluetooth connection via the first Bluetooth module; execute a voice assistant module based on the activation signal; and, in response to receiving a device usage signal via the Bluetooth connection, execute an identity authentication process via the voice assistant module to log into the operating system upon successful authentication.

[0006] Based on the above, the present disclosure enables the electronic device to be activated by removing a designated component from the electronic device, allowing the electronic device to enter voice assistant mode for use. This allows the electronic device to be used without having to be placed on a table or other flat surface, or using both hands, significantly increasing convenience. Simple diagram description

[0007] FIG1 is a block diagram of an electronic device according to an embodiment of the present invention. FIG. 2 is a flow chart of a method for using an electronic device according to an embodiment of the present invention. FIG. 3 is a block diagram of an electronic device and a sound transceiver according to an embodiment of the present invention. FIG. 4 is a flowchart illustrating an operation of an electronic device according to an embodiment of the present invention. FIG5 is a flow chart of activating a voice assistant when the device is powered off according to an embodiment of the present invention. FIG6 is a flow chart of activating a voice assistant when the computer is powered on and logged in according to an embodiment of the present invention. FIG7 is a flow chart of activating a voice assistant in a dormant state according to an embodiment of the present invention. FIG8 is a flow chart of activating a voice assistant when the computer is powered on but not logged in according to an embodiment of the present invention. FIG9 is a flowchart of question-answer recognition according to an embodiment of the present invention. FIG10 is a flow chart of voiceprint recognition according to an embodiment of the present invention. 11A to 11C are schematic diagrams of a single earphone according to an embodiment of the present invention. FIG. 12 is a schematic diagram of an electronic device according to an embodiment of the present invention. Implementation Method

[0008] FIG1 is a block diagram of an electronic device according to an embodiment of the present invention. Referring to FIG1 , the electronic device 100 includes at least a processor 110, a first Bluetooth module 120, and a power switch 130. The processor 110 is coupled to the first Bluetooth module 120 and the power switch 130.

[0009] The processor 110 may be, for example, a central processing unit (CPU), a physical processing unit (PPU), a programmable microprocessor (MCU), an embedded control chip, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), or other similar devices. The processor 110 may also be implemented by any combination of the aforementioned components. The first Bluetooth module 120 is a hardware circuit that utilizes the Bluetooth wireless communication technology standard. The power switch 130 is used to control the power status of the electronic device 100.

[0010] FIG2 is a flow chart of a method for using an electronic device according to an embodiment of the present invention. Referring to FIG1 and FIG2 simultaneously, in step S205, in response to the activation of power switch 130, processor 110 activates first Bluetooth module 120 based on an activation signal, thereby establishing a Bluetooth connection through first Bluetooth module 120. Next, in step S210, processor 110 executes a voice assistant module based on the activation signal.

[0011] In one embodiment, the storage device of electronic device 100 includes code snippets for a voice assistant module. Voice assistant modules typically combine multiple AI models and machine learning (ML) models to enhance their functionality. For example, the voice assistant function can be used in conjunction with at least one of the following models: a voiceprint recognition model, a speech recognition model, a text generation model, a speech synthesis model, a natural language model, etc.

[0012] In step S215, in response to receiving the device usage signal via the Bluetooth connection, the voice assistant module performs an identity verification process on the user. If the user passes the identity verification process, the user logs into the operating system. For example, the identity verification process is used to determine whether the user is a legitimate user (a user who has previously registered with the electronic device 100). If the user is determined to be a legitimate user, the user logs into the operating system. If the user is determined to be an unauthorized user, the user does not log into the operating system.

[0013] FIG3 is a block diagram of an electronic device and a voice transceiver according to an embodiment of the present invention. Referring to FIG3 , electronic device 100 further includes a firmware storage 310, a storage 320, and a voice transceiver 330. Firmware storage 310 stores startup firmware 311. Storage 320 includes a voice assistant module 321.

[0014] Firmware storage 310 is, for example, read-only memory (ROM) or flash memory. Boot firmware 311 is used to perform hardware initialization and test system hardware components during the boot process, and to load a boot loader or operating system. Boot firmware 311 is, for example, a Basic Input / Output System (BIOS), an Extensible Firmware Interface (EFI) BIOS, or a Unified Extensible Firmware Interface (UEFI) BIOS.

[0015] Memory 320 (storage device) can be implemented as any type of fixed or removable random access memory (RAM), read-only memory (ROM), flash memory, hard drive, or other similar device, or a combination of these devices. Memory 320 can exist independently and be connected to processor 110 via a communication bus, or it can be integrated with processor 110.

[0016] The voice assistant module 321 includes a voiceprint recognition model, a speech recognition model, a text generation model, and a speech synthesis model. The voiceprint recognition model identifies the speaker's voiceprint. The speech recognition model converts speech signals into text signals (speech-to-text). The text generation model converts text X into text Y. For example, suppose text X is a question, and text Y is the answer obtained by the text generation model based on text X. The speech synthesis model converts text into speech signals (text-to-speech).

[0017] In this embodiment, the sound transceiver device 330 is removably mounted in the electronic device 100. In practical applications, the electronic device 100 is provided with a storage space (slot) to accommodate the sound transceiver device 330. When the sound transceiver device 330 is stored in the storage space, the power switch 130 is pushed and enters the pushed state. When the sound transceiver device 330 is removed from the storage space, the power switch 130 enters the released state. The electronic device 100 is configured such that when the power switch 130 transitions from the pushed state to the released state, the power switch 130 is enabled.

[0018] In one embodiment, a snap-fit ​​structure or a magnetic structure is provided in the storage space to secure the sound transceiver device 330 within the storage space. The sound transceiver device 330 includes a wearing detection module 340, a second Bluetooth module 350, a sound receiver 360, and a sound output device 370. The sound transceiver device 330 also includes an integrated circuit (IC) such as a microcontroller, embedded controller, or microprocessor to execute coded instructions, thereby controlling the operation of the wearing detection module 340, the second Bluetooth module 350, the sound receiver 360, and the sound output device 370. The wearing detection module 340, for example, is an infrared sensor that detects whether the sound transceiver device 340 is worn by the user. Upon detecting that the sound transceiver device 340 is worn by the user, the wearing detection module 340 generates (or emits) a device usage signal.

[0019] Figure 4 is a flowchart illustrating the operation of an electronic device according to one embodiment of the present invention. In this embodiment, when the electronic device 100 is powered off, the voice assistant activation process 410-a is executed, followed by the identity verification process 420, and then the voice assistant operation process 430. When the electronic device 100 is in sleep mode, the voice assistant activation process 410-b is executed, followed by the identity verification process 420, and then the voice assistant operation process 430. When the electronic device 100 is powered on but not logged into the operating system, the voice assistant activation process 410-c is executed, followed by the identity verification process 420, and then the voice assistant operation process 430. When the electronic device 100 is powered on and logged into the operating system, the voice assistant activation process 410-d is executed, followed by the voice assistant operation process 430. If the electronic device 100 is logged into the operating system, the identity verification process 420 is not executed.

[0020] The following uses headphones as the implementation of the sound transceiver 330, and Figures 5 to 8 are used to illustrate the voice assistant startup processes 410-a, 410-d, 410-b, and 410-c respectively.

[0021] Figure 5 is a flow chart illustrating activating a voice assistant while the device is powered off, according to one embodiment of the present invention. The process illustrated in Figure 5 is voice assistant activation process 410-a. Referring to Figure 5 , when the electronic device 100 is powered off and the earphones (sound transceiver 330) are removed from the electronic device 100, the electronic device 100 is powered on in step S505. Specifically, when the earphones are removed from the storage space of the electronic device 100 (the power switch 130 switches from a pressed state to a released state), the power switch 130 switches to a released state, thereby generating a power-on signal. Subsequently, the power-on firmware 311 of the electronic device 100 controls the processor 110 to power on and generate a power-on signal based on the power-on signal.

[0022] Next, in step S510, the electronic device 100 establishes a Bluetooth connection with the headset. Specifically, the processor 110 activates the first Bluetooth module 120 based on the activation signal to establish a Bluetooth connection with the headset. Subsequently, in step S515, the electronic device 100 enters voice assistant mode. Specifically, the processor 110 executes the voice assistant module 321 based on the activation signal to enter voice assistant mode.

[0023] Furthermore, in step S520, the wearing detection module 340 detects that the user has put on the headphones, meaning that the electronic device 100 has received a device usage signal via the Bluetooth connection. Subsequently, in step S525, a voice signal based on the greeting is generated. Specifically, the voice assistant module 321 uses a speech synthesis model to generate the greeting voice signal based on a preset greeting (e.g., "Abao says hello"). The voice signal is then transmitted via the first Bluetooth module 120 to the second Bluetooth module 350 on the headphone side, which plays the voice signal through the headphone's sound output 370. Upon hearing the greeting voice signal through the headphones, the user knows that the electronic device 100 has entered voice assistant mode, allowing them to complete the identity verification process 420 through subsequent voice inquiries.

[0024] Figure 6 is a flowchart of activating a voice assistant when the device is powered on and logged in, according to one embodiment of the present invention. The process shown in Figure 6 is voice assistant activation process 410-d. Referring to Figure 6 , when the electronic device 100 is powered on and logged into the operating system, and the earphones (sound transceiver 330) are removed from the electronic device 100, in step S605, the electronic device 100 establishes a Bluetooth connection with the earphones. Specifically, the processor 110 activates the first Bluetooth module 120 based on the activation signal to establish a Bluetooth connection with the earphones. Subsequently, in step S610, the electronic device 100 enters voice assistant mode. Specifically, the processor 110 executes the voice assistant module 321 based on the activation signal to enter voice assistant mode.

[0025] In step S615, the wearing detection module 340 detects that the user has put on headphones. That is, the electronic device 100 receives a device usage signal via the Bluetooth connection. Afterward, the identity verification process 420 can be completed directly through a voice query. In the scenario shown in FIG6 , since the electronic device 100 has already logged into the operating system, after detecting that the user has put on headphones, the identity verification process 420 does not need to be executed. Instead, the voice assistant operation process 430 is directly executed through the voice assistant module 321. Therefore, in this embodiment, after detecting that the user has put on headphones, the electronic device 100 may not transmit a greeting voice signal.

[0026] Figure 7 is a flow chart for activating a voice assistant in a dormant state according to one embodiment of the present invention. The process shown in Figure 7 is voice assistant activation process 410-b. Referring to Figure 7 , when the electronic device 100 is in a dormant state and the earphones (sound transceiver 330) are removed from the electronic device 100, the electronic device 100 is awakened in step S705. Specifically, when the earphones are removed from the storage space of the electronic device 100 (the power switch 130 switches from a pressed state to a released state), the power switch 130 switches to a released state, thereby generating a wake-up signal. Subsequently, the boot firmware 311 of the electronic device 100 wakes up the processor 110 based on the wake-up signal and generates a startup signal.

[0027] Next, in step S710, the electronic device 100 establishes a Bluetooth connection with the headset. Specifically, the processor 110 activates the first Bluetooth module 120 based on the activation signal to establish a Bluetooth connection with the headset. Subsequently, in step S715, the electronic device 100 enters voice assistant mode. In step S720, it is detected that the user has put on the headset. Subsequently, in step S725, the electronic device 100 generates a voice signal based on the greeting. The operations in steps S715, S720, and S725 of Figure 7 are identical to steps S515, S520, and S525 of Figure 5, respectively, and are not further described here.

[0028] Figure 8 is a flow chart for activating a voice assistant when the device is powered on but not logged in, according to one embodiment of the present invention. The process shown in Figure 8 is voice assistant activation process 410-c. Referring to Figure 8 , when the electronic device 100 is powered on but not logged in to the operating system, and the headset (sound transceiver 330) is removed from the electronic device 100, in step S805, the electronic device 100 establishes a Bluetooth connection with the headset. Specifically, the processor 110 activates the first Bluetooth module 120 based on an activation signal to establish a Bluetooth connection with the headset. Subsequently, in step S810, the electronic device 100 enters voice assistant mode. In step S815, it is detected that the user has put on the headset. Subsequently, in step S820, the electronic device 100 generates a voice signal based on a greeting. The operations in steps S810, S815, and S820 of Figure 8 are identical to steps S515, S520, and S525 of Figure 5, respectively, and are not further described here.

[0029] Figure 9 is a flowchart of question-and-answer recognition according to one embodiment of the present invention. Referring to Figure 9 , step S900 of executing the question-and-answer recognition flow includes steps S905 through S925. In step S905, the voice assistant module 321 generates a first voice signal based on the identity query and transmits the first voice signal via a Bluetooth connection. Next, in step S910, a determination is made as to whether a first human voice signal has been received. After the electronic device 100 receives the first human voice signal via the Bluetooth connection, the processor 110 determines whether a reply to the first human voice signal matches the specified content corresponding to the first voice signal. If the reply matches the specified content (passing the identity recognition process), the user is determined to be a legitimate user, and in step S920, the user logs into the operating system. If the reply does not match the specified content (failed the identity recognition process), the user is determined to be an unauthorized user, and in step S925, the user is not logged into the operating system.

[0030] For example, the identity query is generated by the voice assistant module 321 based on the electronic device 100's usage data within a specified time period (e.g., the activation status of a specified software within a week). For example, the identity query may be "When did you last open Creo?" The voice assistant module 321 dynamically generates the identity query based on the historical usage history of the electronic device 100.

[0031] The first voice signal of the identity query is then transmitted to a sound transceiver 330 (e.g., headphones). When the user wears the headphones, upon hearing the identity query voice from the headphone's sound output 370, they can respond with a corresponding reply (e.g., "the day before yesterday"). Upon receiving the user's reply, the headphone's sound receiver 360 generates a first human voice signal.

[0032] After the electronic device 100 receives the first voice signal "the day before yesterday," the voice assistant module 321 uses a speech recognition model to convert the reply "the day before yesterday" to text. The processor 110 then makes a judgment based on the text "the day before yesterday." For example, if the current time is 4:40:40 PM on December 28, 2023, and the last time "Creo" was opened was 3:30:30 PM on December 27, 2023, the designated content corresponding to the first voice signal should be "yesterday." In this example, the reply content does not meet the designated content, and the user is determined to be an unauthorized user and is not allowed to log into the operating system. Alternatively, the electronic device 100 can be further configured to shut down if the user is determined to be an unauthorized user. Alternatively, if the user is determined to be an unauthorized user, the registered user is notified via email or text message.

[0033] On the other hand, let's assume the current time is 4:40:40 PM on December 29, 2023, and the last time Creo was launched was 3:30:30 PM on December 27, 2023. The first voice signal corresponds to the specified content "the day before yesterday." In this example, the reply matches the specified content, confirming that the user is legitimate and logging into the operating system to access the voice assistant process.

[0034] Figure 10 is a flow chart of voiceprint recognition according to one embodiment of the present invention. Referring to Figure 10 , in step S1005, in response to the first Bluetooth module 120 receiving a second voice signal, an identification voiceprint is generated based on the second voice signal. For example, the first Bluetooth module 120 receives a second voice signal (e.g., a voice saying "good morning") from the second Bluetooth module 350. The voice assistant module 321 uses a voiceprint recognition model to generate an identification voiceprint for the second voice signal.

[0035] Next, in step S1010, a determination is made as to whether the identified voiceprint matches the registered user's voiceprint. If the identified voiceprint matches the registered user's voiceprint (passing the identity verification process), the user is determined to be a legitimate user, and in step S1015, the user logs into the operating system. If the identified voiceprint does not match the registered user's voiceprint (failed the identity verification process), in step S900, a question-and-answer verification process (see Figure 9) is executed.

[0036] Once the user is confirmed to be a legitimate user and has logged into the operating system, the voice assistant operation process 430 can be executed via the voice assistant module 321. Specifically, in the voice assistant operation process 430, after the first Bluetooth module 120 transmits a second voice signal based on the first task query to the second Bluetooth module 350, in response to the first Bluetooth module 120 receiving a third voice signal based on the query from the second Bluetooth module 350, the third voice signal is analyzed using a speech recognition model to generate a first text.

[0037] For example, the first task inquiry might be something like "Hello ReMi, how can I help you today?" or "How can I help you today?" After the user hears the first task inquiry through the earphones, the sound receiver 360 receives the voice request "Tell me the latest version of the meeting minutes." It then generates a corresponding third voice signal and transmits it to the electronic device 100. Based on this, the voice assistant module 321 of the electronic device 100 uses a speech recognition model to convert the third voice signal into the first text of "Tell me the latest version of the meeting minutes."

[0038] Next, in response to determining that assistance is needed after analyzing the first text using the natural language model, processor 110 analyzes the first text using the text generation model to generate a first confirmation text. For example, the natural language model analyzes the first text "Tell me the latest version of the meeting minutes" and determines that assistance is needed. Next, the text generation model analyzes the first text "Tell me the latest version of the meeting minutes" to generate a first confirmation text "Do you need the latest version of the monthly meeting minutes?" Subsequently, the speech synthesis model generates a third voice signal (text-to-speech) based on the first confirmation text.

[0039] In addition, if the natural language model analyzes the first text and determines that no assistance is needed, the voice assistant module 321 enters a standby state.

[0040] After receiving the third voice signal corresponding to the question "Do you need the latest version of the monthly meeting minutes?", the third voice signal is transmitted to the second Bluetooth module 350 via the first Bluetooth module 1201. Subsequently, in response to the first Bluetooth module 120 receiving a fourth human voice signal (e.g., a human voice saying "yes" or a human voice saying "no, I want the meeting minutes of the welfare committee") transmitted from the second Bluetooth module 350, the fourth human voice signal is analyzed using a speech recognition model to generate a second text, and a task corresponding to the second text is executed.

[0041] For example, assuming a fourth voice signal corresponding to "yes" is received, processor 110 uses a speech recognition model to convert the fourth voice signal into text. Then, using a natural language model, it analyzes the text to determine the corresponding intent. Processor 110 then performs the task corresponding to the intent, for example, searching for the latest version of the monthly meeting minutes to obtain the text of the monthly meeting minutes. The text generation model is then used to analyze the text of the monthly meeting minutes to generate a voice signal representing the monthly meeting minutes. First Bluetooth module 120 transmits the voice signal representing the monthly meeting minutes to second Bluetooth module 350.

[0042] Furthermore, assuming a fourth voice signal corresponding to "No, I want the meeting minutes of the Welfare Committee," is received, processor 110 uses a speech recognition model to convert the fourth voice signal into text. Then, using a natural language model, it analyzes the text to determine the corresponding intent. Processor 110 then performs the task corresponding to the intent, for example, searching for the latest version of the Welfare Committee's meeting minutes to obtain the text. The text generation model is then used to analyze the text of the Welfare Committee's meeting minutes to generate a voice signal representing the Welfare Committee's meeting minutes. First Bluetooth module 120 transmits the voice signal representing the Welfare Committee's meeting minutes to second Bluetooth module 350.

[0043] In other embodiments, when the user removes the earphones from their ears and the earphone wearing detection module 340 detects that the earphones are no longer in use, the electronic device 100 will suspend execution of the voice assistant module 321. When the earphones are stored in the storage space of the electronic device 100, the electronic device 100 will return to the state before the voice assistant module 321 was activated. Furthermore, if the earphones are detected to be re-worn, the identity recognition process 420 shown in FIG. 4 will be executed again.

[0044] Figures 11A through 11C are schematic diagrams of a single earphone according to an embodiment of the present invention. Figure 11A shows a front view of earphone 1100, Figure 11B shows a side view of earphone 1100, and Figure 11C shows a top view of earphone 1100. Earphone 1100 includes charging contacts 1101 and 1103, an infrared wearing detection module 1111, a magnetic / snap-on structure 1121, a sound outlet 1131, and a sound receiving hole 1141.

[0045] Figure 12 is a schematic diagram of an electronic device according to an embodiment of the present invention. The electronic device 1200 shown in Figure 12 is an example application of the electronic device 100. The electronic device 1200, for example, is a laptop computer and includes a top cover 1210 and a base 1220. A storage space 1230 for accommodating the earphones 1100 is provided on the side of the base 1220. The storage space 1230 includes a charging connector corresponding to the earphones 1100 and a magnetic switch.

[0046] By storing the earphones 1100 on the side of the laptop, the earphones 1100 can still receive audio even when the laptop is closed. However, this is merely an example and does not limit the placement of the storage space. Furthermore, this embodiment can be applied not only to electronic devices 1200 having a top cover 1210 and a base 1220, such as laptops, but also to various other electronic devices, without limitation.

[0047] In summary, the present disclosure allows the user to activate the electronic device by removing a designated component from the device, placing the device in voice assistant mode and using the device. This allows the user to use the device without having to place the device on a table or other flat surface or using both hands, significantly increasing user convenience. In other words, the present disclosure allows the user to use the device while moving around independently or using both hands for other purposes.

[0048] The present disclosure allows an electronic device with a top cover and a base to be operated even when the screen is closed and no external monitor or keyboard is connected. Furthermore, the present disclosure includes a sound receiver within a pluggable sound transceiver. When the sound transceiver is removed from the electronic device for use, the sound reception is less affected by the environment and / or the distance between the user and the electronic device.

[0049] The electronic device disclosed herein can activate the voice assistant module by removing the voice transceiver from the electronic device, regardless of whether the device is powered on or not, thus providing a more convenient usage method.

[0050] Furthermore, the disclosed electronic device further provides a first-stage identity recognition mechanism that includes voiceprint recognition and a second-stage identity recognition mechanism that includes content recognition. If the first-stage identity recognition mechanism fails, the second-stage identity recognition mechanism can be seamlessly integrated to facilitate user login.

[0051] 100, 1200: Electronic devices 110: Processor 120: First Bluetooth module 130: Power switch 310: Firmware Storage 311: Boot Firmware 320: Storage 321: Voice Assistant Module 330: Voice transceiver 340: Wearing detection module 350: Second Bluetooth module 360: Sound Receiver 370: Sound output device 410-a, 410-b, 410-c, 410-d: Voice Assistant Startup Process 420: Identity Identification Process 430: Voice Assistant Operation Process 1100: Headphones 1101, 1103: Charging contacts 1111: Infrared wearable detection module 1121: Magnetic / clip structure 1131: Sound hole 1141: Sound hole 1210: Upper cover 1220: Base 1230: Accommodation space S205~S215, S505~S525, S605~S615, S705~S725, S805~S815, S900, S905~S925, S1005~S1015: Steps

Claims

1. A method of using an electronic device, wherein the electronic device includes a power switch, a processor, a first Bluetooth module, a power-on firmware, and a receiving space for housing a sound transceiver, the method of use comprising: In response to the removal of the audio transceiver from the receiving space, the power switch is determined to change from a pushed state to a released state, and an enable signal is generated through the power switch. The power-on firmware controls the processor to generate a startup signal based on the enable signal, wherein the pushed state is the state in which the power switch is pushed when the audio transceiver is housed in the receiving space; the processor starts a first Bluetooth module based on the startup signal to establish a Bluetooth connection through the first Bluetooth module; according to the startup signal, the processor executes a voice assistant module; and in response to receiving a device usage signal through the Bluetooth connection, the voice assistant module executes an identity verification process to log into an operating system upon passing the identity verification process.

2. The method of using the electronic device as described in claim 1, wherein, The audio transceiver includes a second Bluetooth module and a wear detection module. The second Bluetooth module is used to establish a Bluetooth connection with the first Bluetooth module, and the wear detection module is used to generate a device usage signal when the audio transceiver is detected to be worn.

3. A method of using the electronic device as claimed in claim 1, wherein the enable signal is a power-on signal, and in response to the sound transceiver being removed from the receiving space, the method of determining that the power switch changes from the pushed state to the released state includes: When the electronic device is powered off, the power switch generates the power-on signal. And the boot firmware boots the device based on the boot signal and generates the startup signal.

4. A method of using the electronic device as claimed in claim 1, wherein the enable signal is a wake-up signal, and in response to the sound transceiver being removed from the receiving space, the method of determining that the power switch changes from the pushed state to the released state includes: When the electronic device is in a sleep state, the wake-up signal is generated through the power switch; And the boot firmware wakes up the processor based on the wake-up signal and generates the boot signal.

5. A method of using the electronic device as claimed in claim 1, wherein determining the power switch to transition from the pushed state to the released state in response to the sound transceiver being removed from the receiving space includes: The power switch generates the start signal when the electronic device is powered on but not logged into the operating system.

6. A method of using the electronic device as claimed in claim 1, wherein determining the power switch to transition from the pushed state to the released state in response to the sound transceiver being removed from the receiving space includes: When the electronic device is powered on and logged into the operating system, the power switch generates the start signal.

7. A method of using the electronic device as claimed in claim 1, wherein the first Bluetooth module is used to establish a Bluetooth connection with a second Bluetooth module of the voice transceiver, and in response to receiving a device use signal via the Bluetooth connection, further comprising: The voice assistant module generates a voice signal based on a greeting, and transmits the voice signal to the second Bluetooth module through the first Bluetooth module, so that the voice signal can be played through a sound output device of the sound transceiver.

8. A method of using the electronic device as described in claim 1, wherein the identity verification process includes a question-and-answer verification process, the question-and-answer verification process including: The voice assistant module generates a first voice signal based on an identity inquiry, and transmits the first voice signal via the Bluetooth connection. And in response to receiving a first human voice signal via the Bluetooth connection, the processor determines whether the response content of the first human voice signal matches a specified content corresponding to the first voice signal.

9. The method of using the electronic device as described in claim 8, wherein the question-and-answer identification process further includes: If the response content matches the specified content, the identity verification process is confirmed to be successful. And in response to the reply not conforming to the specified content, it is determined that the identity verification process has not been completed, and therefore the user is not logged into the operating system.

10. The method of using the electronic device as described in claim 8, wherein the identity verification process further includes a voiceprint verification process, the voiceprint verification process comprising: In response to the first Bluetooth module receiving a second human voice signal, a voiceprint is generated based on the second human voice signal; And determine whether the identified voiceprint matches the voiceprint of a registered user.

11. The method of using the electronic device as described in claim 10, wherein the voiceprint recognition process further includes: In response to the identified voiceprint matching the registered user's voiceprint, it is determined that the user has successfully logged into the operating system through the identity verification process. And in response to the identified voiceprint not matching the registered user's voiceprint, the question-and-answer identification process is executed.

12. The method of using the electronic device as described in claim 1, wherein the first Bluetooth module is used to establish a Bluetooth connection with a second Bluetooth module of the voice transceiver, and after logging into the operating system upon confirmation of passing the identity verification process, further includes: After the first Bluetooth module transmits a second voice signal based on a first task query to the second Bluetooth module, in response to the first Bluetooth module receiving a third voice signal based on a request from the second Bluetooth module, the first Bluetooth module analyzes the third voice signal through a speech recognition model to generate a first text; in response to determining that assistance is needed after analyzing the first text through a natural language model, the first text is analyzed through a text generation model to generate a first confirmation text; and a third voice signal based on the first confirmation text is generated through a speech synthesis model.

13. The method of using the electronic device as claimed in claim 12, further comprising, after generating the third voice signal based on the first confirmation text: After transmitting the third voice signal to the second Bluetooth module through the first Bluetooth module, in response to the first Bluetooth module receiving a fourth voice signal from the second Bluetooth module, the first Bluetooth module analyzes the fourth voice signal through the voice recognition model to generate a second text and executes the task corresponding to the first text or the second text.

14. An electronic device comprising: One power switch; Firmware upon startup; A storage space for accommodating a sound transceiver device; First Bluetooth module; The system also includes a processor coupled to the power switch, the power-on firmware, and the first Bluetooth module. The power switch is configured to: in response to the audio transceiver being removed from the receiving space, determine that the power switch has transitioned from a pushed state to a released state, and generate an enable signal. The pushed state is the state in which the power switch is pushed while the audio transceiver is housed in the receiving space. The power-on firmware is configured to: control the processor to generate a startup signal based on the enable signal. The processor is configured to: start the first Bluetooth module based on the startup signal to establish a Bluetooth connection through the first Bluetooth module; execute a voice assistant module according to the startup signal; and, in response to receiving a device usage signal via the Bluetooth connection, execute an identity verification process through the voice assistant module to log into an operating system upon successful identity verification.

15. The electronic device of claim 14, wherein the audio transceiver is pluggably disposed in the receiving space, the audio transceiver including a second Bluetooth module and a wear detection module, the second Bluetooth module being configured to establish a Bluetooth connection with the first Bluetooth module, and the wear detection module being configured to generate a device usage signal when the audio transceiver is detected to be worn.

16. The electronic device as claimed in claim 14, wherein, when the electronic device is powered on and logged into the operating system, the processor is configured to: generate the start signal via the power switch in response to the power switch changing from the pushed state to the released state.

17. The electronic device of claim 14, wherein the first Bluetooth module is configured to establish the Bluetooth connection with a second Bluetooth module of the voice transceiver, and the processor is configured to: generate a voice signal based on a greeting through the voice assistant module, and transmit the voice signal to the second Bluetooth module through the first Bluetooth module to play the voice signal through a sound output device of the voice transceiver.

18. The electronic device of claim 14, wherein the identity verification process includes a question-and-answer verification process, and the processor is configured to execute the question-and-answer verification process, including: The voice assistant module generates a first voice signal based on an identity inquiry, and transmits the first voice signal via the Bluetooth connection. And in response to receiving a first human voice signal via the Bluetooth connection, the processor determines whether the response content of the first human voice signal matches a specified content corresponding to the first voice signal.

19. The electronic device of claim 18, wherein the processor is configured to perform the question-and-answer identification process, comprising: If the response content matches the specified content, the identity verification process is confirmed to be successful. And in response to the reply not conforming to the specified content, it is determined that the identity verification process has not been completed.

20. The electronic device of claim 18, wherein the identification process further includes a voiceprint identification process, the processor being configured to execute the voiceprint identification process, including: In response to the first Bluetooth module receiving a second human voice signal, a voiceprint is generated based on the second human voice signal; And determine whether the identified voiceprint matches the voiceprint of a registered user.

21. The electronic device of claim 20, wherein the processor is configured to perform the voiceprint recognition process, comprising: In response to the voiceprint being identified as matching the registered user's voiceprint, the user is confirmed as a legitimate user and logged into the operating system; And in response to the identified voiceprint not matching the registered user's voiceprint, the question-and-answer identification process is executed.

22. The electronic device of claim 14, wherein the first Bluetooth module is configured to establish a Bluetooth connection with a second Bluetooth module of the voice transceiver, and the processor is configured to, upon determining that the identity verification process has been completed and the user has logged into the operating system, perform the following: after the first Bluetooth module transmits a second voice signal based on a first task query to the second Bluetooth module, in response to the first Bluetooth module receiving a third voice signal based on a request from the second Bluetooth module, analyze the third voice signal using a speech recognition model to generate a first text; in response to determining that assistance is needed after analyzing the first text using a natural language model, analyze the first text using a text generation model to generate a first confirmation text; and generate a third voice signal based on the first confirmation text using a speech synthesis model.

23. The electronic device of claim 22, wherein the processor is configured to, after generating the third voice signal based on the first confirmation text, perform the following: after transmitting the third voice signal to the second Bluetooth module via the first Bluetooth module, in response to the first Bluetooth module receiving a fourth voice signal from the second Bluetooth module, analyze the fourth voice signal through the voice recognition model to generate a second text, and perform a task corresponding to the first text or the second text.

Citation Information

Patent Citations

  • Voice control method and related device

    CN110362290A

  • Voice communication method and device based on TWS Bluetooth earphone

    CN113709737A

  • Speaker identification method and connected home appliance including the same

    TW202347165A

  • Mobile terminal, electronic device comprising mobile terminal, and method for controlling electronic device

    US20240031467A1