Separate type smart glasses for performing man-machine interaction

Abstract

To provide separate type smart glasses for performing man-machine interaction.SOLUTION: A smart glass main body 1 comprises a bone conduction microphone 3 and an air conduction earphone microphone 4 for performing audio man-machine interaction. The bone conduction microphone picks up only information of a whispering voice generated by a user by rubbing the airway with a discharged air flow while the vocal band of the trachea is not vibrating. Between two temples 5 of the smart glass body, a string 6 for hanging the glasses on the neck is provided to interconnect both of the temples. The string for hanging the glass on the neck has an upper transmission cable 7 hidden and installed to be pulled out of the intermediate part of the string and connected to an automatic magnetic attraction connection device. A wearable separation part 2 is connected to the automatic magnetic attraction connection device including an upper magnetic connector 11 and a lower magnetic connector 12, via a lower transmission cable 8. The separate type smart glasses perform the man-machine interaction like this.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to the technical field of smart glasses, and more particularly to a separate type of smart glasses for performing man-machine interaction.

Background Art

[0002] As is well known, the man-machine interaction of the keyboard, mouse, window of a personal computer, and the touch panel of a smartphone are important defect improvement technologies for the model change of two major computing platforms of a computer. At present, an innovation ceiling has appeared in the two major computing platforms of personal computers and smartphones, and a next-generation mobile wearable new computing platform stronger than both is about to emerge. Similarly, smart glasses are also important defect improvement technologies for achieving the output display of man-machine interaction in the mobile wearable computing stage. In the prior art, there was a technology that could display an image with an opaque background superimposed in the environmental view of smart glasses, similar to the mobile man-machine interaction of a personal computer and a smartphone. However, it has the following two defects: short duration in mobile man-machine interaction and the absence of a precise moving keyboard for input.

[0003] Defect 1: In smart glasses that currently display outputs of two types of man-machine interactions, integrated and separate types, the biggest problem with the integrated type that includes a battery and a computing unit is that the weight of the finished product is too heavy and the battery life is too short, making it unsuitable for wearing on the head for a long time and for using at any time indoors or outdoors. The separate type separates the battery and host parts from the glass body, reducing the weight of the glasses and increasing the battery life. However, due to the thick power data transmission cable about 6 mm thick, it is troublesome for the user to connect and disconnect each time they use it. When the head moves up, down, left, or right, the pulling restraint of the transmission cable interferes with the attachment and detachment operation, making it difficult for the general public to use. There is an expectation for the emergence of smart glasses that can be worn as easily as integrated smart glasses, are lighter, do not require connection to a cable, and can satisfy the requirement of long battery life for output display. However, the problem of powering such man-machine interactions of smart glasses cannot be basically solved until a new wearable battery with high specific energy appears.

[0004] For example, in Chinese Patent CN 216119548 U, in the method where a thick data cable of a smartphone 5 is connected to smart glasses to transmit audio-visual data and for continuous power supply, the connection is troublesome and it is restricted and interfered with by the data cable when in use.

[0005] Also, for example, in Chinese Patent CN 209311821 U, the battery 22 is provided in the temple of the smart glasses. In order to reduce the load on the ear and the bridge of the nose, the capacity of the battery is limited, and there are defects in the battery life.

[0006] Defect 2: In addition, to become a smart glass that outputs and displays human-machine interaction for mass consumer products, it is necessary to have information resources of personal computers and smartphones that are commonly used by the general public. So far, there has been no input technology for human-machine interaction of a corresponding precisely controllable wearable keyboard. Therefore, natural voice input, which is more precise and convenient than human-machine interaction by gestures, is regarded as a crucial technology for future human-machine interaction of smart glasses. However, voice interaction technology still has a major drawback that it cannot be used normally in many scenarios. In particular, in noisy environments such as markets, gatherings, and large construction sites, it is difficult to clearly input and receive voices. Moreover, it becomes tiring to input voices loudly for a long time. Using normal voice input in public places such as offices, movie theaters, and conference rooms will cause inconvenience to others. When there are other people around and private calls are necessary, it is difficult to implement normal voice human-machine interaction, and the only option is to choose another place separately. Conventional independent earphone-type headsets and supra-aural-type headsets have a short battery life, and it is often troublesome to remove them for charging and wearing. In many cases, only the speaker and microphone are integrated with the smart glasses, and the privacy of calls is also poor.

[0007] The prior art for solving such problems is completed by whispering pickup technology that attaches a bone conduction microphone to an independent headset popular in the market, and furthermore, software that can pick up whispering in a terminal device for typing or pick up and perform voice conversion. Currently, such good software (such as those made by iFlytek and Sogou) is on the market, but there is little individual headset hardware that can perform the input and output of the conventional man-machine interaction by whispering, and overall, there are even fewer headset devices that can perform the input and output of man-machine interaction by whispering in the hardware of smart glasses. Various individual headsets can each solve some of the above problems, but they cannot comprehensively suit various situations, and there is no smart glass that can perform voice-based man-machine interaction with a full-function headset on the market yet.

[0008] For example, in the Chinese patent with application number CN2020107401291, a smart glass is disclosed. However, a bone conduction microphone and an air conduction microphone are attached to the smart glass, and the purpose is only to distinguish different voices of each person in a meeting in a multi-person environment and identify and distinguish each person's identity. By receiving whispering with the bone conduction microphone, it does not solve the problems existing in the above-mentioned voice-based man-machine interaction.

[0009] Also, for example, in the Chinese patent with application number CN2019213544204, a smart glass is disclosed. However, the sensor in the glass acquires vibration signals generated when teeth bite or rub against each other through bone conduction, inputs commands for controlling a computer, and is used to perform man-machine interaction. A device that could originally easily and accurately input commands for man-machine interaction with a direct whispering voice has become a crude and difficult-to-learn input device.

[0010] Furthermore, for example, in the Chinese patent with application number 202121616437X, a smart wearable device is disclosed. This utility model is only used to solve the problem of improving the quality of voice by picking up voice through a bone conduction microphone in man-machine interaction by voice and reducing noise, and is not considered to achieve the purpose of having a private conversation by whispering and not getting tired even after a long conversation.

[0011] Therefore, the separate type of smart glasses for man-machine interaction is a problem to be solved.

Summary of the Invention

[0012] The object of the present invention is to provide a function of inputting low voices and whispers to current separate type smart glasses, and further by using a device that is wirelessly and automatically connected to a battery or / and a data cable to the separate type smart glasses, at the same time, the power data transmission cable connected to the glasses side becomes thinner, and when the user's head moves up, down, left, and right, the interference caused by being pulled and restricted by the transmission cable is removed, and it becomes simpler and more convenient than attaching and detaching an integrated type of glasses and a separate type of glasses, and the battery can achieve the purpose of satisfying continuous operation for a long time throughout the day.

[0013] When the present invention increases the method of inputting by whispering, due to the integrated structure of the piston type headset and the glass body, it is further required to replace the speaker microphone or supra-aural type wireless headset in the current integrated structure of smart glasses. Thereby, the trouble of frequently attaching and detaching and charging to supply power using an independent headset, and the problem that privacy is inferior and it causes trouble to others when using a speaker integrated with glasses are eliminated.

[0014] To achieve the above object, the present invention provides the following technical means. A smart glass body capable of superimposing and displaying an image of man-machine interaction on the actual visual field of glasses, a wearable separation part including a battery, and an automatic magnetic attraction connection device for automatically attracting and connecting the power supply of the smart glass body and the wearable separation part and / or the data transmission cable of the wearable host computer. A separate type smart glass for man-machine interaction, comprising: The smart glass body is provided with a bone conduction microphone and an air conduction earphone microphone for performing voice-based man-machine interaction. The bone conduction microphone picks up only the information of the whispering voice generated by the friction of the exhaled air flow in the airway when the user's vocal cords in the trachea are in a non-vibrating state. A glasses neck strap for connecting the two between the two temples of the smart glass body is provided. A transmission cable is hidden and installed on the glasses neck strap, which is drawn out from the middle part of the glasses neck strap and connected to the automatic magnetic attraction connection device. The wearable separation part is connected to the automatic magnetic attraction connection device by a lower transmission cable. A separate type smart glass for man-machine interaction.

[0015] Furthermore, the bone conduction microphone is fixed to the nose pad of the smart glass body, and an electric control unit with a microprocessor is further provided on the temple of the smart glass body. The bone conduction microphone acquires an amplitude-modulated audio electrical signal generated by the vibration of the voice on the nasal bone and is communicatively connected to the microprocessor electric control unit.

[0016] Furthermore, the air conduction earphone microphone is of a piston type and is provided at the user's ear side behind the two temples of the smart glass body and is placed in the ear facing the user's cochlea. An alternative conversion switch for touch sensing between the bone conduction microphone and the air conduction microphone is provided on the air conduction earphone microphone, and the handle part of the air conduction earphone microphone is movably connected to the smart glass body.

[0017] Furthermore, the automatic magnetic attraction connection device includes an upper magnetic connector and a lower magnetic connector. The upper magnetic connector is connected to the spectacle neck strap by an upper transmission cable, and the lower transmission cable extends along the user's neck and back and is connected to the lower magnetic connector.

[0018] Furthermore, a guide block is provided on the lower magnetic connector. The guide block always keeps the lower magnetic connector facing upward, and at the same time, until the upper and lower magnetic connectors are accurately aligned and attracted to each other, the upper magnetic connector is automatically attracted and guided by the lower magnetic connector.

[0019] Furthermore, a fixing member for fixing the lower magnetic connector to the collar or kimono at the position of the user's neck and back is further provided on the lower magnetic connector, and the fixing member is an elastic clip or a magic tape.

[0020] The advantages of the present invention compared with the prior art are as follows. For the separate type smart glasses for displaying mobile man-machine interaction, the present invention designs a device that is automatically connected to the battery and data cable wirelessly. At the same time, the power data transmission cable connected to the glasses side becomes thinner, and when the user's head moves up, down, left, or right, the interference caused by being pulled and restricted by the transmission cable can be removed. Moreover, it is simpler and more convenient than putting on and taking off the integrated glasses, and its battery can achieve the purpose of satisfying continuous operation for a long time throughout the day.

[0021] The mobile man-machine interaction of the separate type smart glasses according to the present invention uses a man-machine interaction method of whispering into the smart glasses, and the headset and the glass body can use an integrated structure, eliminating the trouble of frequently attaching and detaching and charging with a separate headset, the inferior privacy when using an integrated speaker, and the annoyance of disturbing others.

Brief Description of the Drawings

[0022]

Figure 1

Figure 2

Figure 3

Embodiment for Carrying out the Invention

[0023] Hereinafter, with reference to the drawings, a separate type of smart glasses for performing man-machine interaction according to the present invention will be described in more detail.

[0024] The specific implementation process of the separate type of smart glasses for performing man-machine interaction according to the present invention is as follows.

[0025] A separate type of smart glasses for performing man-machine interaction, including a smart glasses body 1 capable of superimposing and displaying an image of man-machine interaction of a personal computer or / and a smartphone on the actual visual field of the glasses, a wearable separation part 2 including a battery, and a transmission cable having a power supply function and / or a data transmission function between the smart glasses body 1 and the wearable separation part 2, and an automatic magnetic attraction connection device for automatically adsorbing and connecting them.

[0026] The automatic magnetic attraction connection device includes an upper magnetic connector 11 and a lower magnetic connector 12. The upper magnetic connector 11 is connected to the glasses neck strap 6 by the upper transmission cable 7. The lower transmission cable 8 extends along the user's neck and back and is connected to the lower magnetic connector 12. The glasses neck strap 6 is connected and installed between the two temples 5 of the smart glasses body 1. An upper transmission cable 7, which is connected to the smart glasses body 1 and has a power supply function and / or a data transmission function, is hidden and installed in the glasses neck strap 6. The upper transmission cable 7 may be introduced into the glasses neck strap 6 from a bunch, from one side of the temple 5, or divided into two thinner bunches and introduced into the glasses neck strap 6 from the two temples 5, and drawn out from the middle part of the glasses neck strap 6 and connected to the upper magnetic connector 11. When the upper transmission cable 7 is divided into two bunches and introduced into the glasses neck strap 6 from the two temples 5, the glasses neck strap 6 becomes thinner and more flexible. The wearable separation part 2 is connected to the automatic magnetic attraction connection device by the lower transmission cable 8.

[0027] When the user puts on the smart glass body 1 connected by the glasses neck strap 6 from the head down over both ears and the bridge of the nose, the upper magnetic connector 11 and the lower magnetic connector 12 in the wearable separation part 2 are automatically adsorbed and connected. At the same time, the upper transmission cable 7 and the lower transmission cable 8 with both power supply functions and / or data transmission functions are also automatically connected and conducted, forming an automatic magnetic attraction connection device between the smart glass body 1 and the wearable separation part 2. In the automatic magnetic attraction connection device, there is only a thin and short glasses neck strap 6 connecting the two temples 5 at the rear part of the temple of the smart glass body 1. And it is lighter than the integrated smart glasses. Moreover, by using a wearing operation that is simpler than the need to connect the current integrated smart glasses, the automatic connection operation with the lower transmission cable 8 of the wearable separation part 2 can be automatically completed. The length of the glasses neck strap 6 including the upper magnetic connector 11 is longer than the distance from the two temples 5 to the lower magnetic connector 12 and leaves a sufficient margin. So after the connection is completed, most of the weight of the glasses neck strap 6 is borne by the lower magnetic connector 12, and the head does not feel traction restraint even when moving back and forth, left and right. The wearable smart glasses can provide better assurance for the continuity of man-machine interaction than the conventional integrated and separate models.

[0028] A bone conduction microphone 3 and an air conduction earphone microphone 4 for voice man-machine interaction are provided on the smart glass body 1. The bone conduction microphone 3 picks up only the information of the whispering voice generated by the airflow rubbing against the airway when the user's vocal cords in the trachea are in a non-vibrating state and conducts special man-machine interaction by whispering.

[0029] In one embodiment of the present application, the lower magnetic connector 12 is provided with a guide block 13, so that the lower magnetic connector 12 is always facing upward, and the upper magnetic connector 11 is also automatically attracted and guided by the lower magnetic connector 12 until they are correctly aligned and attracted to each other. The lower magnetic connector 12 of the automatic magnetic attraction connection device is further provided with a fixing member 14, which may be an elastic clip or a Velcro tape (registered trademark) so as to fix the lower magnetic connector 12 to a collar or a kimono at the nape and back of the user.

[0030] In one embodiment of the present application, the bone conduction microphone 3 is fixed to the nose pad 9 of the smart glasses body 1, and the sensor provided on the bone conduction microphone 3 may be one selected from a piezoelectric ceramic vibration sensor and / or a gyro acceleration vibration sensor. An electric control unit 10 with a microprocessor is further provided on the temple 5, and when a binary conversion switch that is touch-sensitive by people reaches the position of the bone conduction microphone 3, the bone conduction microphone 3 obtains an amplitude-modulated audio electrical signal generated by the vibration of the voice on the nasal bone due to whispering, and communicatively connects it to the microprocessor in the electric control unit 10.

[0031] Because the propagation speed of sound in solids is faster than that in air and sound loss is smaller, the vibrations of a whisper, which is produced by air rubbing the airway without vibrating the vocal cords, can be efficiently conducted to the bone conduction microphone 3 in the nose pad 9 of the glasses via the nasal bone, and the amplitude-modulated audio electrical signal generated by this vibration is communicatively connected to the microprocessor in the electrical control unit 10, completing the man-machine interaction for control and communication of the wearable computer device, when a clear voice is transmitted by whispering in a noisy environment, or confidentiality is maintained in a quiet environment so as not to affect others.

[0032] An alternative conversion switch that can be touched and sensed by people is set at the position of the air conduction microphone. When speaking in a normal voice or a louder voice due to the vibration of the vocal cords, the bone conduction microphone 3 stops operating, and the microprocessor receives the normal voice or a louder voice sent by the headset microphone and converts it into a pickup electrical signal for speaking.

[0033] In one embodiment of the present application, at the rear part of the two temples 5, at the position near the user's ears, one air conduction earphone microphone 4 with a handle is respectively connected and fixed. It is placed in the ear facing the user's cochlea tube, and on the handle, an alternative touch sensing switch for the microphone of the air conduction earphone microphone 4 and the bone conduction microphone 3 is provided. A movable connection that can be moved is adopted between the handle part of the air conduction earphone microphone 4 and the smart glass body 1. For example, in a deformation displacement device made of plastic material or a sub-rotational displacement device with rotational friction between the hole of the temple and the handle part, when the user wants to isolate or intercept the ambient sound, the user can correspondingly press or pull the air conduction earphone microphone 4 with a finger, and the piston of the piston-type air conduction earphone microphone 4 can block or reproduce the ambient sound. When it is necessary to whisper or when using whispering for voice message typing while speaking, when pressing the air conduction earphone microphone 4 against the ear with a finger, at the same time, touching the sensing switch on the handle of the touch headset to turn off the air conduction earphone microphone 4 and select the bone conduction microphone 3 to receive the user's whispering voice.

[0034] The nose pad 9 is provided with one or more bone conduction microphones 3 that are only used to receive the whispering voice or low voice audio data when the user is speaking. When receiving a whispering voice, the user may press the handle part of the air conduction earphone microphone 4 to block the ear hole to avoid interference from external voices, or pull out the air conduction earphone microphone 4 and displace it to a position where it is suspended in the air without contacting the inner and outer surfaces of the ear, slightly away from the ear hole. Thereby, the user can not only hear the private message while keeping it secret, but also hear the external sound, and further, there is no discomfort caused by the headset blocking the ear or being worn on the ear.

[0035] In one embodiment of the present application, a smart glass, which is a product of AR (augmented reality) that supports receiving, connecting, and projecting DP signals of the commercially available Glow Plus type of the MADE GAZE brand, is selected. A speaker member and a microphone member are integrally provided on the temple of the glass body, and are respectively connected to the microprocessor electric control unit 10 in the temple. At the same time, a normal piston-type earphone microphone member that can be further pushed into the ear is selected and integrally mounted and connected to the temple of the glass body. A bone conduction microphone 3 member of the BM-06 type, with a diameter of 8×height of 3.5 mm from Ningbo Shuozheng Electronics Technology Co., Ltd., is also selected and hidden in the nose pad 9 of the modified glasses. Among them, the earphone part of the piston-type earphone microphone member directly and simply replaces the speaker member in the temple 5 of the product and is communicatively connected to the microprocessor electric control unit 10. Among them, both the microphone part of the piston-type earphone microphone member and the bone conduction microphone 3 member of the BM-06 type are selected by an alternative switch that senses touch and is connected, replacing the microphone member in the temple 5 of the product and connecting to the microprocessor electric control unit 10. Also, in this embodiment, a Samsung brand S20 type smart phone that supports dp method connection projection is selected as the wearable separation part 2, and the wearable host computer is used while being adsorbed to the battery for charging. The male connector of the commercially available dp method magnetic attraction adapter from Yishi Technology Co., Ltd. is used as the lower magnetic connector 12 and is connected to the host of the S20 smart phone by a data cable. The female connector of the magnetic attraction adapter is used as the upper magnetic connector 11 and is connected to the host of the Glow Plus smart phone by a data cable, thus constituting a separate type smart glass with a man-machine interaction device with an automatic magnetic attraction connection device of the present application (refer to the block diagram of the electric control function of the embodiment in FIG. 3).

[0036] In one embodiment of the present application, the wearable separation unit 2 may be provided on the user's back, shoulders and neck, or both shoulders, or in the pocket of clothes or trousers, or on a hanging strap, necklace, muffler, tie, or belt, or bra, or shoulder bag, or vest, clothes, or ornaments.

[0037] Specifically, the wearable separation unit 2 is a separate part of a wearable host computer including a battery, or a separate part of an external battery after the wearable host computer is separated.

[0038] In one embodiment of the present application, a magnetic attraction charging transmission coil 15 for wirelessly charging the wearable host computer or other devices and a port 16 for charging itself or other devices are provided on the outer surface of the wearable separation unit 2.

[0039] The present invention and its embodiments have been described above. However, such description is not restrictive. What is shown in the drawings is only one of the embodiments of the present invention, and the actual structure is not limited thereto. That is, those skilled in the art, under the inspiration thereof and without departing from the spirit of the creation of the present invention, all structural aspects and embodiments similar to the technical means designed without creativity should belong to the protection scope of the present invention.

Description of Reference Numerals

[0040] 1 Smart Glasses Body 2 Wearable Separation Unit 3 Bone Conduction Microphone 4 Air Conduction Earphone Microphone 5 Temple 6 Glasses Hanging Strap 7 Upper Transmission Cable 8 Lower Transmission Cable 9 Nose Pad 10 Electric Control Unit 11 Upper Magnetic Connector 12 Lower Magnetic Connector 13 Guide Block 14 Fixing Member 15 Magnetic Attraction Charging Transmission Coil 16 ports

Claims

1. A separate type smart glass that performs man-machine interaction includes a smart glass main body 1 that can display and output a video image by superimposing it on the actual field of view of the glasses, a wearable separation part 2 including a battery, and an automatic magnetic attraction connection device that automatically attracts and connects the power supply of the smart glass main body 1 and the wearable separation part 2 and / or a data transmission cable of a wearable host computer, The smart glass body 1 is provided with a bone conduction microphone 3 and an air conduction earphone microphone 4 for man-machine interaction by voice, and the bone conduction microphone 3 picks up only information of whispering voice uttered by the user when the vocal cords of the trachea are not vibrating and the exhaled airflow rubs the airway, A separate type smart glass that performs man-machine interaction, characterized in that a glasses neck strap 6 is provided between two temples 5 of the smart glass main body 1 to connect the two, an upper transmission cable 7 is hiddenly installed in the glasses neck strap 6, the upper transmission cable 7 is pulled out from the middle part of the glasses neck strap 6 and connected to an automatic magnetic attraction connection device, and the wearable separation part 2 is connected to the automatic magnetic attraction connection device by a lower transmission cable 8.

2. The separate type smart glasses performing man-machine interaction as described in claim 1, characterized in that the bone conduction microphone 3 is fixed to the nose pad 9 of the smart glasses main body 1, and an electrical control unit 10 with a microprocessor is further provided on the temple 5 of the smart glasses main body 1, and the bone conduction microphone 3 acquires an amplitude-modulated audio electrical signal generated by the vibration of the voice in the nasal bone and communicatively connects it to the microprocessor electrical control unit 10.

3. The separate type smart glasses for man-machine interaction according to claim 2, characterized in that the bone conduction microphone 3 is provided with a piezoelectric ceramic vibration sensor and / or a gyro acceleration vibration sensor.

4. The air conduction earphone microphone 4 is a piston type, and is installed at the user's ears behind the two temples 5 of the smart glass body 1, and is hung in the user's ear facing the cochlear tube, and the air conduction earphone microphone 4 is provided with a touch-sensitive binary conversion switch between the bone conduction microphone and the air conduction microphone, and the handle part and the smart glass body 1 are movably connected, characterized in that the separate type smart glass for man-machine interaction described in claim 3.

5. The automatic magnetic attraction connection device includes an upper magnetic connector 11 and a lower magnetic connector 12, the upper magnetic connector 11 is connected to the eyeglasses neck strap 6 via an upper transmission cable 7, and the lower transmission cable 8 extends to the user's neck and back and is connected to the lower magnetic connector 12.

6. The separate type smart glasses performing man-machine interaction as described in claim 5, characterized in that the lower magnetic connector 12 is provided with a guide block 13, and the guide block 13 always keeps the lower magnetic connector 12 facing upward, and at the same time, the upper magnetic connector is automatically attracted and guided by the lower magnetic connector 12 until they are accurately aligned and adsorbed to each other.

7. The separate type smart glasses for man-machine interaction as described in claim 6, characterized in that the lower magnetic connector 12 is further provided with a fixing member 14 for fixing the lower magnetic connector 12 to the collar or kimono at the user's neck and back, and the fixing member 14 is an elastic clip or a Velcro tape.

8. The separate type smart glasses for man-machine interaction as described in claim 7, characterized in that the upper transmission cable 7 is in one bundle and introduced from one temple 5 to the neck strap, or is divided into two bundles and introduced from the two temples 5 to the neck strap.

9. The separate type smart glasses for man-machine interaction described in claim 8, characterized in that the wearable separation part 2 is a separate part of the wearable host computer including a battery, or a separate part of an extracorporeal battery after the wearable host computer is separated.

10. The separate type smart glasses for man-machine interaction as described in claim 9, characterized in that the outer surface of the wearable separation part 2 is provided with a magnetic attraction charging transmission coil 15 for wirelessly charging a wearable host computer or other devices, and a port 16 for charging itself or other devices.

Images