Separate smart glasses for man-machine interaction

Abstract

To provide separate type smart glasses for performing man-machine interaction.SOLUTION: A smart glass main body 1 comprises a bone conduction microphone 3 and an air conduction earphone microphone 4 for performing audio man-machine interaction. The bone conduction microphone picks up only information of a whispering voice generated by a user by rubbing the airway with a discharged air flow while the vocal band of the trachea is not vibrating. Between two temples 5 of the smart glass body, a string 6 for hanging the glasses on the neck is provided to interconnect both of the temples. The string for hanging the glass on the neck has an upper transmission cable 7 hidden and installed to be pulled out of the intermediate part of the string and connected to an automatic magnetic attraction connection device. A wearable separation part 2 is connected to the automatic magnetic attraction connection device including an upper magnetic connector 11 and a lower magnetic connector 12, via a lower transmission cable 8. The separate type smart glasses perform the man-machine interaction like this.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to the technical field of smart glasses, and more particularly to separate-type smart glasses that perform man-machine interaction. [Background technology]

[0002] As is well known, man-machine interaction through PC keyboards, mice, and windows, and smartphone touchscreens, are key technologies for overcoming the shortcomings of the two major computing platforms. Currently, the two major computing platforms, PCs and smartphones, are reaching their limits of innovation, and a new, next-generation mobile and wearable computing platform that surpasses both is on the horizon. Similarly, smart glasses are also a key technology for overcoming shortcomings in achieving the display of man-machine interaction output in the mobile and wearable computing stage. Previous technology enabled smart glasses to overlay a non-transparent image onto the surrounding field of view, similar to mobile man-machine interaction on PCs and smartphones. However, this technology had two drawbacks: a short duration for mobile man-machine interaction and the lack of a mobile keyboard for precise input.

[0003] Disadvantage 1: Currently available on the market are two types of smart glasses that display output for man-machine interaction: integrated and separate types. The biggest problem with the integrated type, which includes both a battery and a computing unit, is that the finished product is too heavy and has a short battery life, making it unsuitable for long-term wear or occasional indoor and outdoor use. Separate types reduce the weight of the glasses and increase battery life by separating the battery and host from the glasses themselves. However, the thick 6mm power and data transmission cable makes it cumbersome for users to connect and disconnect each time they use the glasses. Head movements up and down and side to side cause interference from the traction of the transmission cable, making it difficult to put on and take off, making them unpopular with the general public. Smart glasses that are as easy to wear and use as integrated smart glasses, but lighter, do not require a cable, and meet the demand for long battery life and output display are eagerly awaited. However, the challenge of powering such smart glasses' man-machine interaction cannot be fundamentally resolved until new wearable batteries with high specific energy are available.

[0004] For example, in Chinese Patent CN 216119548 U, a thick data cable of a smartphone 5 is connected to smart glasses to transmit audio-visual data and provide continuous power supply, but the connection is cumbersome and the data cable is a hindrance when used.

[0005] In addition, for example, in Chinese Patent CN 209311821 U, the battery 22 is installed in the temple of the smart glasses, and in order to reduce the load on the ears and nose bridge, the battery capacity is limited, resulting in a short battery life.

[0006] Disadvantage 2: Furthermore, smart glasses, which are mass-produced consumer products and can display the output of human-machine interaction, require the information resources of commonly used personal computers and smartphones. To date, there is no corresponding precision-controllable wearable keyboard for human-machine interaction input technology. Natural voice input, which is more precise and convenient than gesture-based human-machine interaction, is considered the key technology for future human-machine interaction in smart glasses. However, voice interaction technology still has a major disadvantage: it cannot be used properly in many situations. It is particularly difficult to clearly input and receive voice in noisy environments such as markets, gatherings, and large construction sites, and it can be tiring to input voice loudly for long periods of time. Using normal voice input in public places such as offices, movie theaters, and conference rooms can be a nuisance to others. When there are others around and a private call is required, normal voice interaction is difficult, and the only option is to choose another location. Conventional independent earphone-type headsets and supraaural-type headsets have short battery life and are inconvenient to remove, charge, and wear. Smart glasses often only have a speaker and microphone integrated into them, which means that calls are less private.

[0007] The conventional technology for solving these problems is based on whisper pickup technology, which uses a bone conduction microphone attached to a standalone headset, which is currently popular on the market, and software that can pick up whispers and type them on a terminal device, or pick up and change the voice. While such software (e.g., from iFly and Sogou) is currently on the market, there are few individual headset hardware devices that can implement the input and output of traditional whisper-based man-machine interaction, and overall, there are even fewer headset devices that can input and output whisper-based man-machine interaction among smart glasses hardware. While various individual headsets can solve some of the above problems, smart glasses that can be fully adapted to various situations and perform voice-based man-machine interaction with a full-function headset have not yet been released.

[0008] For example, a Chinese patent with application number CN2020107401291 discloses smart glasses, which are equipped with a bone conduction microphone and an air conduction microphone, and the only purpose of the smart glasses is to distinguish the different voices of people in a multi-person meeting and identify and distinguish their identities. The bone conduction microphone receives whispers, and the above-mentioned problems of voice-based man-machine interaction are not solved.

[0009] For example, a Chinese patent with application number CN2019213544204 discloses smart glasses, in which sensors in the glasses acquire vibration signals generated by teeth biting or rubbing against each other through bone conduction, and input commands to control a computer for man-machine interaction. A device that originally allowed for easy and accurate input of man-machine interaction commands through direct whispering is now a crude input device that is difficult to learn.

[0010] Furthermore, for example, a Chinese patent with application number 202121616437X discloses a smart wearable device, but this utility model is only used to solve the problem of using a bone conduction microphone to pick up voice and reduce noise and improve voice quality in voice-based man-machine interaction, and does not consider achieving the goals of whispering for private conversations and not tiring people to talk for long periods of time.

[0011] Therefore, separate smart glasses for man-machine interaction are a problem that needs to be solved. Summary of the Invention

[0012] The objective of the present invention is to provide the current separate type smart glasses with the function of inputting low voices and whispers, and further to use a device that automatically connects the separate type smart glasses wirelessly to a battery and / or a data cable. At the same time, the power and data transmission cable connected to the glasses is thinner, eliminating the interference caused by the transmission cable being pulled and restrained when the user moves their head up and down and left and right, and is easier and more convenient to put on and take off than integrated glasses and separate type glasses, and the battery can satisfy the objective of continuous operation for long periods of time throughout the day.

[0013] Even when whisper input is used more frequently, the present invention still requires the integration of a piston-type headset with the glasses body to replace the speaker microphone or supra-aural wireless headset in the current smart glasses integrated structure, thereby achieving the goal of eliminating the hassle of using a separate headset, which must be frequently put on and taken off, and the hassle of charging and powering it, as well as the inconvenience of using a speaker integrated into the glasses, which reduces privacy and causes inconvenience to others.

[0014] In order to achieve the above object, the present invention provides the following technical means: A separate type smart glass for man-machine interaction includes a smart glass main body capable of displaying and outputting a man-machine interaction image superimposed on the actual field of view of the glasses, a wearable separation part including a battery, and an automatic magnetic attraction connection device that automatically attracts and connects the smart glass main body to the power supply of the wearable separation part and / or a data transmission cable of a wearable host computer, The smart glasses body is provided with a bone conduction microphone and an air conduction earphone microphone for voice-based man-machine interaction, and the bone conduction microphone picks up only whispering information uttered by the user when the vocal cords of the trachea are not vibrating and the exhaled airflow rubs against the airway; A glasses neck strap is provided between the two temples of the smart glasses body to connect them, and an upper transmission cable is hidden in the glasses neck strap, which is pulled out from the middle of the glasses neck strap and connected to an automatic magnetic attraction connection device, and the wearable separation part is connected to the automatic magnetic attraction connection device by the lower transmission cable, resulting in separate smart glasses that perform man-machine interaction.

[0015] Furthermore, the bone conduction microphone is fixed to the nose pad of the smart glasses body, and an electrical control unit with a microprocessor is further provided on the temple of the smart glasses body, and the bone conduction microphone acquires the amplitude-modulated audio electrical signal generated by the vibration of the voice in the nasal bone and communicatively connects it to the microprocessor electrical control unit.

[0016] Furthermore, the air conduction earphone microphone is piston-type and is placed near the user's ears behind the two temples of the smart glasses body, and is hung in the user's ear facing the cochlea. The air conduction earphone microphone is equipped with a touch-sensitive binary conversion switch for switching between the bone conduction microphone and the air conduction microphone, and the handle part of the air conduction earphone microphone and the smart glasses body are movably connected.

[0017] Furthermore, the automatic magnetic attraction connection device includes an upper magnetic connector and a lower magnetic connector, the upper magnetic connector is connected to the eyeglasses neck strap by an upper transmission cable, and the lower transmission cable extends to the user's neck and back and is connected to the lower magnetic connector.

[0018] Furthermore, the lower magnetic connector is provided with a guide block, which keeps the lower magnetic connector facing upward at all times, and at the same time, the upper magnetic connector is automatically attracted and guided by the lower magnetic connector until they are accurately aligned and attracted to each other.

[0019] Furthermore, the lower magnetic connector is further provided with a fixing member for fixing the lower magnetic connector to the collar or kimono at the nape and back of the user, and the fixing member is an elastic clip or a Velcro.

[0020] The advantages of the present invention over the prior art are as follows: The present invention designs a device for separate smart glasses that displays mobile man-machine interaction, which automatically connects to a battery and data cable wirelessly, and at the same time, the power and data transmission cable connected to the glasses is thinner, which eliminates the interference caused by the transmission cable when the user moves their head up and down and left and right, and is easier and more convenient to put on and take off than integrated glasses, and the battery can satisfy the purpose of continuous work for a long time throughout the day.

[0021] The mobile man-machine interaction of the separate smart glasses of the present invention uses a man-machine interaction method in which whispers are input into the smart glasses, and the headset and the glasses body can be integrated into a single structure, eliminating the hassle of using a separate headset, which requires frequent putting on and taking off, charging, and powering, and the inconvenience of using an integrated speaker, which reduces privacy and causes inconvenience to others. [Brief explanation of the drawings]

[0022] [Figure 1]1 is a schematic diagram illustrating the configuration of separate-type smart glasses that perform man-machine interaction according to the present invention. FIG. [Figure 2] FIG. 2 is a schematic diagram of the lower magnetic connector, the guide block, and the fixing member. [Figure 3] FIG. 2 is a block diagram of the electrical control functions of the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0023] Hereinafter, the separate type smart glasses for man-machine interaction according to the present invention will be described in more detail with reference to the drawings.

[0024] The specific implementation process of the separate type smart glasses for man-machine interaction according to the present invention is as follows:

[0025] Separate smart glasses for man-machine interaction include a smart glasses main body 1 that can display and output man-machine interaction images from a personal computer and / or smartphone superimposed on the actual field of view of the glasses, a wearable separation part 2 that includes a battery, and an automatic magnetic attraction connection device that automatically attracts and connects the smart glasses main body 1 and a transmission cable that has a power supply function and / or a data transmission function of the wearable separation part 2.

[0026] The automatic magnetic suction connection device includes an upper magnetic connector 11 and a lower magnetic connector 12, the upper magnetic connector 11 being connected to the eyeglasses neck strap 6 via an upper transmission cable 7, and a lower transmission cable 8 extending along the user's neck and back and connected to the lower magnetic connector 12. The eyeglasses neck strap 6 is connected to and installed between two temples 5 of the smart glasses main body 1. The upper transmission cable 7, which is connected to the smart glasses main body 1 and has a power supply function and / or data transmission function, is hiddenly installed in the eyeglasses neck strap 6. The upper transmission cable 7 may be a single bundle extending from one temple 5, or may be divided into two thinner bundles leading from the two temples 5 to the eyeglasses neck strap 6 and pulled out from the middle of the eyeglasses neck strap 6 to be connected to the upper magnetic connector 11. When the upper transmission cable 7 is divided into two bundles leading from the two temples 5 to the eyeglasses neck strap 6, the eyeglasses neck strap 6 becomes thinner and more flexible. The wearable separation unit 2 is connected to the automatic magnetic suction connection device via the lower transmission cable 8.

[0027] When the user places the smart glasses main body 1, connected to the eyeglass neck strap 6, down their head and around their ears and nose, the upper magnetic connector 11 and the lower magnetic connector 12 on the wearable separation unit 2 are automatically attracted and connected, and at the same time, the upper transmission cable 7 and the lower transmission cable 8, which have power supply and / or data transmission functions, are automatically connected and conductive, forming an automatic magnetic attraction connection device between the smart glasses main body 1 and the wearable separation unit 2. The automatic magnetic attraction connection device only has a thin and short eyeglass neck strap 6 at the rear of the temples of the smart glasses main body 1, which connects the two temples 5. It is lighter than integrated smart glasses, and can automatically complete the automatic connection process with the lower transmission cable 8 on the wearable separation unit 2 using a simpler wearing action than is required with current integrated smart glasses. The length of the eyeglasses neck strap 6, including the upper magnetic connector 11, is longer than the distance from the two temples 5 to the lower magnetic connector 12, and a sufficient margin is left. Therefore, after the connection is completed, most of the weight of the eyeglasses neck strap 6 is supported by the lower magnetic connector 12, and there is no feeling of being pulled or restrained even when the head moves back and forth or side to side. Therefore, the wearable smart glasses can ensure continuity of man-machine interaction with a better feel than conventional integrated and separate models.

[0028] The smart glasses body 1 is equipped with a bone conduction microphone 3 and an air conduction earphone microphone 4 for voice-based man-machine interaction. The bone conduction microphone 3 picks up only information about whispering, which occurs when the user's vocal cords are not vibrating and the exhaled airflow rubs against the airway, and performs special man-machine interaction using whispering.

[0029] In one embodiment of the present application, the lower magnetic connector 12 is provided with a guide block 13, which keeps the lower magnetic connector 12 always facing upward, and the upper magnetic connector 11 is also automatically attracted and guided by the lower magnetic connector 12 until they are correctly aligned and attracted to each other. The lower magnetic connector 12 of the automatic magnetic attraction connection device is further provided with a fixing member 14, which may be an elastic clip or Velcro®, for fixing the lower magnetic connector 12 to the collar or kimono at the nape and back of the user.

[0030] In one embodiment of the present application, a bone conduction microphone 3 is fixed to the nose pad 9 of the smart glasses body 1, and the sensor provided in the bone conduction microphone 3 may be one selected from a piezoelectric ceramic vibration sensor and / or a gyro acceleration vibration sensor. An electric control unit 10 with a microprocessor is further provided in the temple 5, and when a two-way conversion switch that is touch-sensitive by people reaches the position of the bone conduction microphone 3, the bone conduction microphone 3 acquires an amplitude-modulated audio electrical signal generated by the vibration of the voice in the nasal bone due to whispering, and communicatively connects it to the microprocessor in the electric control unit 10.

[0031] Because the propagation speed of sound in solids is faster than that in air and sound loss is smaller, the vibrations of whispering, which is produced by air rubbing against the airway without vibrating the vocal cords, can be efficiently conducted by the nasal bone to the bone conduction microphone 3 in the nose pad 9 of the glasses. The amplitude-modulated audio electrical signal generated by this vibration is then communicatively connected to the microprocessor in the electrical control unit 10, completing the man-machine interaction for control and communication of the wearable computer device, allowing clear audio transmission by whispering in a noisy environment or maintaining confidentiality without disturbing others in a quiet environment.

[0032] When the two-way conversion switch that is touch-sensitive by people is set to the air conduction microphone position and the person speaks in a normal voice or louder than normal through the vibration of the vocal cords, the bone conduction microphone 3 stops working and the microprocessor receives the normal voice or louder voice sent by the headset microphone and converts it into a pickup electrical signal to speak.

[0033] In one embodiment of the present application, a handle-type air-conduction earphone microphone 4 is fixedly connected to the rear of each of the two temples 5 near the user's ears, and is placed in the user's ear facing the cochlea. The handle is provided with a touch-sensitive switch for selecting either the air-conduction earphone microphone 4 or the bone-conduction microphone 3. The handle of the air-conduction earphone microphone 4 and the smart glasses body 1 are connected in a movable manner. For example, a plastic deformation displacement device or a sub-rotation displacement device with rotational friction between the temple and the handle hole may be used. When the user wants to isolate or eavesdrop on environmental sounds, they can push or pull the air-conduction earphone microphone 4 with their fingers, and the piston of the piston-type air-conduction earphone microphone 4 can block or play the environmental sounds. When a user needs to have a private conversation or whisper while speaking a voice message or typing, they can press the air-conduction earphone microphone 4 into their ear with their fingers and simultaneously touch the sensitive switch on the handle of the touch headset to turn off the air-conduction earphone microphone 4 and select the bone-conduction microphone 3 to receive the user's whispers.

[0034] The nose pad 9 is provided with one or more bone conduction microphones 3, which are used only to receive whispered or low-pitched voice data when the user speaks. To receive whispered voices, the user can press the handle of the air conduction earphone microphone 4 to block the ear canal and avoid interference with external sounds, or pull out the air conduction earphone microphone 4 and move it slightly away from the ear canal, until it is suspended in mid-air and not in contact with the inside or outside of the ear. This allows the user to hear private messages while maintaining confidentiality, as well as external sounds, without the discomfort of the headset blocking or hanging over the ear.

[0035] In one embodiment of the present application, commercially available MADE GAZE brand Glow Plus type smart glasses, an AR (augmented reality) product that supports receiving, connecting, and projecting DP signals, are selected. A speaker and a microphone are integrated into the temples of the glasses, each connected to a microprocessor-based control unit 10 in the temples. At the same time, a conventional piston-type earphone / microphone that can be pressed into the ear is selected and integrated into the temples of the glasses. A BM-06 type bone conduction microphone 3, measuring 8 mm in diameter and 3.5 mm in height, from Ningbo Shuozheng Electronic Technology Co., Ltd. is also selected and hidden in the nose pads 9 of the modified glasses. The earphone portion of the piston-type earphone / microphone directly and simply replaces the speaker in the temple 5 of the product and is connected to and communicates with the microprocessor-based control unit 10. In particular, both the microphone part of the piston-type earphone microphone component and the BM-06 type bone conduction microphone component 3 are selected by a connected touch-sensitive binary switch, replacing the microphone component on the temple 5 of the product and connected to a microprocessor-based electrical control unit 10. In this embodiment, a Samsung S20 type smartphone supporting DP connection projection is selected as the wearable separate part 2, and the wearable host computer is used while adsorbing and charging the battery. The male connector of a commercially available DP magnetic attraction adapter from Yishi Technology Co., Ltd. is connected to the S20 smartphone host via a data cable as the lower magnetic connector 12, and the female connector of the magnetic attraction adapter is connected to the Glow Plus smartphone host via a data cable as the upper magnetic connector 11, thereby forming a separate type smart glasses with man-machine interaction and an automatic magnetic attraction connection device of the present application (see the block diagram of the electrical control function of the embodiment in FIG. 3).

[0036] In one embodiment of the present application, the wearable separation unit 2 may be attached to the user's back, shoulders and neck, or both shoulders, or a pocket on clothes or trousers, or a neck strap, necklace, scarf, or necktie, or a belt, or a bra, or a shoulder bag, or a vest, clothing, or accessory.

[0037] Specifically, the wearable detachable part 2 is a separate part of the wearable host computer including a battery, or a separate part of the extracorporeal battery after the wearable host computer is detached.

[0038] In one embodiment of the present application, the outer surface of the wearable separation part 2 is provided with a magnetic attraction charging transmission coil 15 for wirelessly charging a wearable host computer or other device, and a port 16 for charging itself or other devices.

[0039] Although the present invention and its embodiments have been described above, this description is not limiting, and the drawings are merely one embodiment of the present invention, and the actual structure is not limited to this. In other words, any structural aspects and embodiments similar to the technical means designed by a person skilled in the art based on the suggestion thereof, without departing from the spirit of the invention, and without originality, should all fall within the scope of protection of the present invention. [Explanation of symbols]

[0040] 1 Smart glasses body 2. Wearable separation unit 3. Bone conduction microphone 4. Air conduction earphone microphone 5 Temple 6 Eyeglasses neck strap 7 Upper transmitting cable 8 Lower transmission cable 9 Nose pads 10 Electrical Control Unit 11 Upper magnetic connector 12 Lower magnetic connector 13 Guide block 14 Fixing member 15 Magnetic attraction charging transmitting coil 16 ports

Claims

1. A separate type smart glass that performs man-machine interaction includes a smart glass main body 1 that can display and output a video image superimposed on the actual field of view of the glasses, a wearable separation unit 2 including a battery, and an automatic magnetic attraction connection device that automatically attracts and connects the smart glass main body 1 and the power supply of the wearable separation unit 2 and / or a data transmission cable of a wearable host computer, The smart glasses main body 1 is provided with a bone conduction microphone 3 and an air conduction earphone microphone 4 for voice-based man-machine interaction, and the bone conduction microphone 3 picks up only information about whispering voices uttered by the user when the vocal cords of the trachea are not vibrating and the exhaled airflow rubs against the airway; Separate-type smart glasses that perform man-machine interaction, characterized in that an eyeglasses neck strap 6 is provided between two temples 5 of the smart glasses main body 1 to connect them, an upper transmission cable 7 is hiddenly installed in the eyeglasses neck strap 6, the upper transmission cable 7 is pulled out from the middle part of the eyeglasses neck strap 6 and connected to an automatic magnetic attraction connection device, and the wearable separation part 2 is connected to the automatic magnetic attraction connection device by a lower transmission cable 8.

2. The separate type smart glasses for man-machine interaction according to claim 1, characterized in that the bone conduction microphone 3 is fixed to the nose pad 9 of the smart glasses main body 1, and an electrical control unit 10 with a microprocessor is further provided on the temple 5 of the smart glasses main body 1, and the bone conduction microphone 3 acquires amplitude-modulated audio electrical signals generated by vibration of voice in the nasal bone and communicatively connects to the microprocessor electrical control unit 10.

3. The separate type smart glasses for man-machine interaction according to claim 2, wherein the bone conduction microphone 3 is provided with a piezoelectric ceramic vibration sensor and / or a gyro acceleration vibration sensor.

4. The air conduction earphone microphone 4 is piston-type and is placed near the user's ears behind the two temples 5 of the smart glasses main body 1, and is hung in the user's ear facing the cochlea; the air conduction earphone microphone 4 is provided with a touch-sensitive binary conversion switch for functioning either the bone conduction microphone 3 or the air conduction microphone, and the handle part and the smart glasses main body 1 are movably connected, which is the separate type smart glasses for man-machine interaction described in claim 3.

5. The separate type smart glasses for man-machine interaction described in claim 4, characterized in that the automatic magnetic attraction connection device includes an upper magnetic connector 11 and a lower magnetic connector 12, the upper magnetic connector 11 is connected to the eyeglasses neck strap 6 by an upper transmission cable 7, and the lower transmission cable 8 extends to the user's neck and back and is connected to the lower magnetic connector 12.

6. The separate type smart glasses for man-machine interaction described in claim 5, characterized in that the lower magnetic connector (12) is provided with a guide block (13), and the guide block (13) keeps the lower magnetic connector (12) always facing upward, and the upper magnetic connector is automatically attracted and guided by the lower magnetic connector (12) until they are accurately aligned and attracted to each other.

7. The separate type smart glasses for man-machine interaction described in claim 6, characterized in that the lower magnetic connector 12 is further provided with a fixing member 14 for fixing the lower magnetic connector 12 to the collar or kimono at the user's neck and back, and the fixing member 14 is an elastic clip or Velcro.

8. The separate type smart glasses for man-machine interaction described in claim 7, characterized in that the upper transmission cable 7 is introduced in one bundle from one temple 5 to the neck strap, or divided into two bundles and introduced from the two temples 5 to the neck strap.

9. The separate type smart glasses for man-machine interaction described in claim 8, characterized in that the wearable separation part 2 is a separate part of the wearable host computer including a battery, or a separate part of an extracorporeal battery after the wearable host computer is separated.

10. The separate type smart glasses for man-machine interaction described in claim 9, characterized in that the outer surface of the wearable separate part 2 is provided with a magnetic attraction charging transmission coil 15 for wirelessly charging a wearable host computer or other devices, and a port 16 for charging itself or other devices.

Images