Human-computer interaction split type intelligent glasses

Abstract

The application discloses a split type intelligent glasses for human-computer interaction, wherein a bone conduction microphone and an air conduction earphone microphone for voice human-computer interaction are arranged on the intelligent glasses body; the bone conduction microphone only picks up the whispering sound information emitted by airflow friction of the respiratory tract when a user is in a state of no vibration of the laryngeal cartilage vocal cords; a glasses neck line connecting two glasses legs of the intelligent glasses body is arranged between the two glasses legs, and an upward transmission line is arranged in the glasses neck line; the upward transmission line is connected with an automatic magnetic attraction connecting device which is led out from the middle section of the glasses neck line; and a wearable part is connected with the automatic magnetic attraction connecting device through a downward transmission line. The split type intelligent glasses for human-computer interaction adopts a human-computer interaction mode of whispering into the intelligent glasses, and the earphone and the glasses body adopt an integrated structure, so as to avoid the troubles of frequent taking and wearing and charging of the independent earphone, and the troubles of poor secrecy and interference with others caused by using an integrated loudspeaker.

Description

Technical Field

[0001] This invention relates to the field of smart glasses technology, specifically to a split-type smart glasses for human-computer interaction. Background Technology

[0002] As is well known, the keyboard, mouse, and user interface of PCs and the touchscreen of smartphones are key technological bottlenecks hindering the innovation and upgrading of these two major computing platforms. Currently, both PCs and smartphones have reached their innovation ceiling, and a next-generation mobile wearable computing platform, stronger than either, is imminent. Similarly, smart glasses are another key technological bottleneck for the human-computer interaction output display of mobile wearable computing platforms. Existing technology can overlay the opaque back image display technology used in PC and smartphone mobile human-computer interaction onto the ambient field of view of smart glasses, but it still suffers from two drawbacks: short battery life and the lack of precise input compared to a mobile keyboard.

[0003] Disadvantage 1: Among the two main types of smart glasses currently on the market—all-in-one and separate models—the biggest problem with all-in-one models, which include both a battery and computing unit, is their excessive weight and short battery life. This makes them unsuitable for prolonged wear or use both indoors and outdoors. Separate models, by separating the battery and main unit from the glasses, reduce weight and increase battery life, but the approximately 6mm thick power and data transmission cable makes connecting and disconnecting the cable inconvenient and hinders head movements, making them difficult to wear and operate, thus discouraging their use. People yearn for smart glasses that are as simple to wear and use as all-in-one models, yet lighter, cable-free, and capable of long battery life for display output. However, this challenge of extending battery life for smart glasses' human-computer interaction remains largely unsolved until the advent of high-energy-density wearable batteries.

[0004] For example, in Chinese patent CN 216119548 U, the method of connecting smart glasses with a relatively thick data cable from a smartphone (5) to transmit audio and video data and power for battery life is cumbersome and its use is affected by interference from the data cable.

[0005] For example, in Chinese patent CN 209311821 U, the battery (22) is located on the temple of the smart glasses. In order to reduce the weight added to the ears and bridge of the nose, the battery capacity is limited, resulting in a short battery life.

[0006] Disadvantage Two: Furthermore, for smart glasses to become a mass-market consumer product with human-computer interaction output displays, they must have access to the information resources of commonly used PCs and smartphones. Since there is currently no compatible human-computer interaction input technology with a wearable keyboard that allows for precise control, natural voice input, which is more refined and convenient than gesture-based human-computer interaction, is considered a key technology for the future human-computer interaction of smart glasses. However, voice interaction technology still has significant drawbacks, particularly in noisy environments such as markets, parties, and large construction sites where clear input and reception of voice are difficult, and prolonged loud voice input is tiring. Normal voice input in public places such as offices, cinemas, and conference rooms can disturb others. In situations where private conversations are needed with others present, voice interaction is difficult to implement, necessitating alternative locations. Existing independent earbud and over-ear headsets have poor battery life, requiring frequent removal for charging and wearing, while those integrated with smart glasses often use a speaker and microphone, resulting in poor call privacy.

[0007] Existing technologies to address these issues use commercially available standalone headsets combined with bone conduction microphones for whispering, along with software on the terminal device capable of whispering for typing or voice changing. While some good software (such as that from iFlytek and Sogou) is available, standalone headsets capable of whispering for human-computer interaction input and output are scarce, and headsets that integrate whispering human-computer interaction input and output as part of a complete smart glasses system are even rarer. Various standalone headsets can address some of the aforementioned problems, but no single smart glasses system has yet emerged that can comprehensively adapt to various situations and offer full-featured headset-based human-computer interaction.

[0008] For example, Chinese patent application number CN2020107401291 discloses a smart glasses. The smart glasses are equipped with a bone conduction microphone and an air conduction microphone. The purpose is only to distinguish the different voices of each person in a multi-person conference to identify their respective identities. The bone conduction microphone is not used to receive whispers to solve the problems of voice human-computer interaction mentioned above.

[0009] For example, Chinese patent application number CN2019213544204 discloses a smart pair of glasses. The sensors in these glasses are used to collect vibration signals from the tapping and rubbing of teeth together via bone conduction, inputting commands to control a computer for human-computer interaction. This turns a device that could easily and accurately input human-computer interaction commands via whispered voice into a crude and difficult-to-learn input device.

[0010] For example, Chinese patent application number 202121616437X discloses a smart wearable device. This utility model only solves the problem of using bone conduction microphones to pick up sound, reduce noise, and improve sound quality in voice human-computer interaction. It does not consider using whispers to achieve the purpose of private interaction and not getting tired from talking for a long time.

[0011] Therefore, a split-type smart glasses for human-computer interaction has become an urgent problem to be solved. Summary of the Invention

[0012] The purpose of this invention is to provide a whisper input function for current split-type smart glasses, and to adopt a device for automatically connecting the battery and / or data cable in the air. This achieves the goal of making the power data transmission cable connected to the glasses thinner, eliminating the interference of the transmission cable dragging and restraining the user's head movements up, down, left, and right. It is also simpler and more convenient to wear and remove than integrated and split-type glasses, and the battery can meet the purpose of long-lasting operation for a whole day.

[0013] This invention also requires that when adding a whisper input method, a piston-type headset integrated with the main body of the glasses should be used to replace the speaker microphone or ear-hook wireless headset of the current integrated structure of smart glasses, so as to eliminate the trouble of frequently taking off and putting on and charging the independent headset, as well as the trouble of disturbing others with the poor privacy of the integrated speaker of the glasses.

[0014] To achieve the above objectives, the technical solution provided by the present invention is as follows: a split-type smart glasses for human-computer interaction, comprising a smart glasses body that can overlay human-computer interaction image display output in the real field of vision of the glasses, a wearable part containing a battery, and an automatic magnetic connection device that automatically connects the power supply and / or data transmission line of the wearable part to the smart glasses body and the wearable part.

[0015] The smart glasses are equipped with a bone conduction microphone and an air conduction earphone microphone for voice human-computer interaction. The bone conduction microphone only picks up whispered sound information produced by the airflow rubbing against the respiratory tract when the user is in a state where the vocal cords are not vibrating.

[0016] The smart glasses body has a neck strap connecting the two temples. An upper transmission line is hidden inside the neck strap and leads out from the middle of the neck strap to connect to an automatic magnetic connection device. The wearable part is connected to the automatic magnetic connection device through a lower transmission line.

[0017] Furthermore, the bone conduction microphone is fixed inside the nose pad of the smart glasses body, and the temple of the smart glasses body is also provided with an electronic control unit with a microprocessor. The bone conduction microphone collects the amplitude-modulated audio electrical signal generated by the sound vibration of the nasal bone, and then communicatively couples it to the microprocessor electronic control unit.

[0018] Furthermore, the air conduction headphone microphone is a piston type, located behind the two temples of the smart glasses body next to the user's ears, and suspended inside the ear facing the user's ear vortex. The air conduction headphone microphone is equipped with a two-way switch for bone conduction and air conduction microphone touch sensing. The stem of the air conduction headphone microphone is movably connected to the smart glasses body.

[0019] Furthermore, the automatic magnetic connection device includes an upper magnetic connector and a lower magnetic connector. The upper magnetic connector is connected to the eyeglasses neck strap via an upper transmission line, and the lower transmission line extends to the back of the user's neck and connects to the lower magnetic connector.

[0020] Furthermore, the lower magnetic connector is provided with a guide block, which ensures that the lower magnetic connector always faces upwards, while the upper magnetic head is automatically attracted and guided by the lower magnetic connector until they are correctly aligned and attracted to each other.

[0021] Furthermore, the lower magnetic connector is also provided with a fixing member, which fixes the lower magnetic connector to the collar or clothing at the back of the user's neck; the fixing member is an elastic clip or Velcro.

[0022] The advantages of this invention compared to the prior art are as follows: This invention designs a device for automatically connecting the battery and data cable in the air for a split-type smart glasses for mobile human-computer interaction display. At the same time, its power data transmission cable connecting the glasses is thinner, which can eliminate the interference of the transmission cable dragging and restraining the user's head movements up, down, left and right. It is also simpler and more convenient to wear and remove than integrated glasses, so as to enable its battery to meet the purpose of a full day of continuous operation.

[0023] The mobile human-computer interaction of the split smart glasses of this invention adopts the human-computer interaction method of whisper input. The headset and the main body of the glasses can be integrated into one structure to avoid the trouble of frequently taking off and putting on the headset and charging the battery life when using a separate headset, and the trouble of poor privacy and disturbing others when using an integrated speaker. Attached Figure Description

[0024] Figure 1 This is a schematic diagram of the structure of a split-type smart glasses for human-computer interaction according to the present invention.

[0025] Figure 2 This is a structural diagram of the lower magnetic connector, guide block, and fixing component.

[0026] Figure 3 This is a block diagram of the electronic control principle of an embodiment.

[0027] As shown in the figure: 1. Smart glasses body, 2. Wearable component, 3. Bone conduction microphone, 4. Air conduction headphone microphone, 5. Eyeglass temples, 6. Eyeglass neck strap cable, 7. Upper transmission cable, 8. Lower transmission cable, 9. Nose pad, 10. Electronic control unit, 11. Upper magnetic connector, 12. Lower magnetic connector, 13. Guide block, 14. Fixing component, 15. Magnetic charging transmitter coil, 16. Socket. Detailed Implementation

[0028] In the description of this invention, it should be understood that the terms "upper", "lower", "front", "rear", "left", "right", "inner", "outer", "vertical", "circumferential", etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing this invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this invention.

[0029] In this invention, unless otherwise explicitly specified and limited, the terms "installation," "connection," "linking," and "fixing," etc., should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in this invention according to the specific circumstances.

[0030] The following is a detailed description of a split-type smart glasses for human-computer interaction according to the present invention, with reference to the accompanying drawings.

[0031] The specific implementation process of the split-type smart glasses for human-computer interaction of the present invention is as follows:

[0032] A split-type smart glasses for human-computer interaction includes a smart glasses body 1 that can overlay human-computer interaction image display output from a PC or / and a smartphone onto the glasses' real field of vision, a wearable part 2 containing a battery, and an automatic magnetic connection device that automatically connects the power and / or data transmission lines of the smart glasses body 1 and the wearable part 2.

[0033] The automatic magnetic connection device includes an upper magnetic connector 11 and a lower magnetic connector 12. The upper magnetic connector 11 is connected to the glasses neckband 6 via an upper transmission line 7, and the lower transmission line 8 extends to the back of the user's neck and connects to the lower magnetic connector 12. A glasses neckband 6 is connected between the two temples 5 of the smart glasses body 1. An upper transmission line 7 for power and / or data connection to the smart glasses body 1 is hidden inside the glasses neckband 6. The upper transmission line 7 can be introduced into the glasses neckband 6 in a single bundle from one temple 5 or split into two thinner bundles from the two temples 5, and then led out from the middle of the glasses neckband 6 and connected to the upper magnetic connector 11. Splitting the upper transmission line 7 into two bundles from the two temples 5 into the glasses neckband 6 makes the glasses neckband 6 thinner and more flexible. The wearable part 2 is connected to the automatic magnetic connection device via the lower transmission line 8.

[0034] When the user hangs the smart glasses body 1, which is connected to the neck strap 6, over their ears and nose from head to toe, the upper magnetic connector 11 and the lower magnetic connector 12 on the wearable part 2 automatically engage and connect. Simultaneously, the upper and lower power and / or data transmission lines 7 and 8 of both are automatically connected, forming an automatic magnetic connection between the smart glasses body 1 and the wearable part 2. This automatic magnetic connection means that the smart glasses body 1 only has a thin, short neck strap 6 connecting the two temples 5 on its back, making it lighter than integrated smart glasses and more durable than current models. The integrated smart glasses require a simpler wearing action, namely, the automatic connection with the lower transmission line 8 of the wearable component 2. This is because the length of the neck strap 6, including the upper magnetic connector 11, is longer than the distance from the two temples 5 to the lower magnetic connector 12, leaving sufficient margin. After the connection is completed, most of the weight of the neck strap 6 is supported by the lower magnetic connector 12, and there is no pulling or restraining feeling when the head moves forward, backward, left, or right. This allows the wearable smart glasses to provide a better human-computer interaction experience and ensure battery life than existing integrated and separate models.

[0035] The smart glasses body 1 is equipped with a bone conduction microphone 3 for voice human-computer interaction and an air conduction headphone microphone 4. The bone conduction microphone 3 only picks up the whisper sound information produced by the airflow rubbing against the respiratory tract when the user is in a state where the vocal cords are not vibrating, so as to implement a special whisper voice human-computer interaction.

[0036] In one embodiment of this application, the lower magnetic connector 12 is provided with a guide block 13 so that the lower magnetic connector 12 always faces upward, and the upper magnetic connector 11 is in a position that can be automatically attracted and guided by the lower magnetic connector 12 until they are correctly aligned and attracted to each other; the lower magnetic connector 12 of the automatic magnetic connection device is also provided with a fixing member 14, which can be an elastic clip or Velcro, to fix the lower magnetic connector 12 to the collar or clothing at the back of the user's neck.

[0037] In one embodiment of this application, the bone conduction microphone 3 is fixedly disposed inside the nose pad 9 of the smart glasses body 1. The sensor disposed inside the bone conduction microphone 3 can be one of the piezoelectric ceramic vibration sensors and / or one of the gyroscope acceleration vibration sensors. The temple 5 of the glasses is also provided with an electronic control unit 10 with a microprocessor. When a person touches the two-way selector switch to the position of the bone conduction microphone 3, the bone conduction microphone 3 collects the amplitude-modulated audio electrical signal generated by the vibration of the nasal bone caused by whispering, and then communicatively couples it to the microprocessor on the electronic control unit 10.

[0038] Because sound travels faster in solids than in air and loses less sound, the vibrations of whispered sounds, produced solely by airflow friction against the respiratory tract without vocal cord vibration, can be efficiently conducted through the nasal bone to the bone conduction microphone 3 on the nose pads 9 of the glasses. The amplitude-modulated audio signal generated by this vibration is then communicatively coupled to the microprocessor on the electronic control unit 10, enabling clear transmission of whispered sounds in noisy environments, or control and communication human-computer interaction of wearable computer devices in quiet environments without affecting the privacy of others.

[0039] When a person touches the sensor's two-way selector switch to set it to the air conduction microphone position, speaking in a normal or louder voice using vocal cord vibration, the bone conduction microphone 3 will stop working, and the microprocessor will convert it into a pickup electrical signal that receives the normal or louder voice sent by the microphone in the headset.

[0040] In one embodiment of this application, each of the two temples 5 of the glasses is connected and fixed to a handle-mounted air conduction microphone 4 near the user's ear, allowing it to hang inside the ear facing the user's ear canal. The handle has a touch-sensitive switch that allows the user to choose between the air conduction microphone 4 and the bone conduction microphone 3. The handle of the air conduction microphone 4 is connected to the smart glasses body 1 via a movable connection; for example, a deformation displacement device made of plastic material, or a rotation displacement device using a rotary friction pair between the temple and the handle hole. When the user wants to isolate or listen to ambient sound, they can press or pull the air conduction microphone 4 with their finger to isolate or release ambient sound. For private conversations or whispering, the user can press the air conduction microphone 4 into the ear and simultaneously touch the touch-sensitive switch on the earpiece handle to turn off the air conduction microphone 4 and select the bone conduction microphone 3 to receive the user's whispered voice.

[0041] The nose pad 9 is equipped with one or more bone conduction microphones 3, which are used only to receive whispered voice data when the user speaks. When receiving whispered voice data, the user can press the handle of the air conduction headphone microphone 4 to plug the ear canal to avoid external sound interference, or pull out the air conduction headphone microphone 4 and move it to a suspended position slightly away from the ear canal and not in contact with the inner or outer surface of the ear. This allows the user to hear private information while also hearing external sounds, without the uncomfortable feeling of earphones plugged or hooked in the ear.

[0042] In one embodiment of this application, a commercially available MADE GAZE brand Glow Plus model AR augmented reality smart glasses that supports DP-based screen projection is selected. The glasses' temples are equipped with a speaker and a microphone, which are connected to the microprocessor control unit 10 on the temples. A standard piston-type earphone microphone that can be inserted into the ear is also integrated and connected to the temples of the glasses. A BM-06 model bone conduction microphone 3 with a diameter of 8 mm and a height of 3.5 mm from Ningbo Shuozheng Electronics Technology Co., Ltd. is also hidden inside the modified nose pad 9 of the glasses. The earphone part of the piston-type earphone microphone directly and simply replaces the speaker on the temples of the glasses and communicates with the microprocessor control unit 10. The microphone part of the piston-type earphone microphone component and the bone conduction microphone 3 component of the BM-06 model are selected by a touch-sensitive two-way switch to replace the microphone component on the temple 5 of the finished glasses, and are connected to the microprocessor electronic control unit 10. In addition, in this embodiment, a Samsung S20 model smartphone that supports DP connection and screen projection is selected as the wearable computer host of the wearable part 2, which is attached to the battery for charging and use. The male head of the commercially available DP standard magnetic adapter is selected as the lower magnetic connector 12 and connected to the S20 smartphone host via a data cable. The female head of the magnetic adapter is selected as the upper magnetic connector 11 and connected to the Glow Plus smartphone host via a data cable, forming the split smart glasses with automatic magnetic connection device and human-computer interaction of this application (see appendix). Figure 3 (Electrical control principle block diagram of an embodiment).

[0043] In one embodiment of this application, the wearable portion 2 may be disposed on the back and neck of the user, on both shoulders, in the pockets of clothing, on one of the following: a suspender, necklace, scarf, tie, belt, bra, shoulder bag, vest, clothes, or clothing item;

[0044] Specifically, the wearable portion 2 is a wearable computer host portion containing a battery or an external battery portion after the wearable computer host has been separated.

[0045] In one embodiment of this application, the outer surface of the wearable portion 2 is provided with a magnetic charging transmitting coil 15 for wireless charging of a wearable computer host or other devices, and a socket 16 for charging itself or other devices.

[0046] The present invention and its embodiments have been described above. This description is not restrictive, and the accompanying drawings are only one embodiment of the present invention; the actual structure is not limited thereto. In conclusion, if those skilled in the art are inspired by this description and design similar structures and embodiments without departing from the spirit of the invention, such designs should fall within the protection scope of the present invention.

Claims

1. A split-type smart glasses for human-computer interaction, characterized in that: The smart glasses body (1) includes a smart glasses body (1) that can overlay video image display output in the real field of vision of the glasses, a wearable part (2) containing a battery, and an automatic magnetic connection device that automatically connects the power supply and / or wearable computer host data transmission line of the smart glasses body (1) and the wearable part (2). The smart glasses body (1) is equipped with a bone conduction microphone (3) for voice human-computer interaction and an air conduction headphone microphone (4). The bone conduction microphone (3) only picks up whispered sound information produced by the airflow rubbing against the respiratory tract when the user is in a state where the vocal cords of the throat are not vibrating. The smart glasses body (1) has a neck strap (6) connecting the two temples (5). An upper transmission line (7) is hidden inside the neck strap (6). The upper transmission line (7) is led out from the middle section of the neck strap (6) and connected to an automatic magnetic connection device. The wearable part (2) is connected to the automatic magnetic connection device through a lower transmission line (8).

2. The split-type smart glasses for human-computer interaction according to claim 1, characterized in that: The bone conduction microphone (3) is fixed inside the nose pad (9) of the smart glasses body (1). The temple (5) of the smart glasses body (1) is also provided with an electronic control unit (10) with a microprocessor. The bone conduction microphone (3) collects the amplitude-modulated audio electrical signal generated by the sound vibration of the nasal bone and then communicatively couples it to the microprocessor electronic control unit (10).

3. The split-type smart glasses for human-computer interaction according to claim 2, characterized in that: The bone conduction microphone (3) is equipped with a piezoelectric ceramic vibration sensor and / or a gyroscope acceleration vibration sensor.

4. The split-type smart glasses for human-computer interaction according to claim 3, characterized in that: The air conduction headphone microphone (4) is piston-type and is located behind the two temples (5) of the smart glasses body (1) next to the user's ears, and is suspended in the ear directly in front of the user's ear vortex. The air conduction headphone microphone (4) is equipped with a two-way switch for bone conduction and air conduction microphone touch sensing, and its handle is movably connected to the smart glasses body (1).

5. The split-type smart glasses for human-computer interaction according to claim 4, characterized in that: The automatic magnetic connection device includes an upper magnetic connector (11) and a lower magnetic connector (12). The upper magnetic connector (11) is connected to the eyeglasses neck strap (6) via an upper transmission line (7), and the lower transmission line (8) extends to the back of the user's neck and connects to the lower magnetic connector (12).

6. The split-type smart glasses for human-computer interaction according to claim 5, characterized in that: The lower magnetic connector (12) is provided with a guide block (13). The guide block (13) keeps the lower magnetic connector (12) facing upwards and at the same time automatically attracts and guides the upper magnetic head to the lower magnetic connector (12) until they are correctly aligned and attracted to each other.

7. The split-type smart glasses for human-computer interaction according to claim 6, characterized in that: The lower magnetic connector (12) is also provided with a fixing member (14), which fixes the lower magnetic connector (12) to the collar or clothing at the back of the user's neck; the fixing member (14) is an elastic clip or Velcro.

8. A split-type smart glasses for human-computer interaction according to claim 7, characterized in that: The upper transmission line (7) is introduced into the neck hanging line from one side of the eyeglass temple (5) in a single bundle or into the neck hanging line from both eyeglass temples (5) in two bundles.

9. A split-type smart glasses for human-computer interaction according to claim 8, characterized in that: The wearable component (2) is either a wearable computer host component containing a battery or an external battery component after the wearable computer host has been separated.

10. A split-type smart glasses for human-computer interaction according to claim 9, characterized in that: The outer surface of the wearable portion (2) is provided with a magnetic charging transmitting coil (15) for wireless charging of the wearable computer host or other devices, and a socket (16) for charging itself or other devices.

Images