Intelligent glasses system, intelligent glasses and instant messaging message playing method

Abstract

The invention discloses an intelligent glasses system, intelligent glasses and an instant messaging message playing method, the intelligent glasses system comprises the intelligent glasses, the intelligent glasses are connected with an intelligent terminal, the intelligent terminal is used for obtaining an instant messaging message and sending push information of the instant messaging message to the intelligent glasses, and the intelligent glasses are used for playing the instant messaging message according to the push information. And playing the instant messaging message in a voice form. According to the intelligent glasses system, the intelligent glasses and the instant messaging message playing method, the instant messaging message can be played in a voice form through the intelligent glasses.

Description

Technical Field

[0001] The embodiments of the present application relate to the technical field of smart wearable devices, and in particular to a smart glasses system, smart glasses, and an instant messaging message playing method. Background Art

[0002] Smart glasses system is a data interaction system including smart glasses, smart terminals and servers. Smart glasses, also known as smart mirrors, are like smart phones, with independent operating systems. Users can install software, games and other programs provided by software service providers. With the development of smart glasses technology, the functions related to the voice function of smart glasses are becoming more and more abundant.

[0003] In the prior art, smart glasses can be used to control music playback and volume when talking to other users. The voice playback function is relatively simple and the degree of intelligence is not high. Summary of the invention

[0004] The embodiments of the present application provide a smart glasses system, smart glasses and an instant messaging message playing method, which can solve the problem that the voice function of smart glasses is simple and the intelligence level is not high.

[0005] An embodiment of the present application provides a smart glasses system, including:

[0006] Smart glasses and a smart terminal connected to the smart glasses;

[0007] The smart terminal is used to obtain instant messaging messages and send push information of the instant messaging messages to the smart glasses;

[0008] The smart glasses are used to play the instant messaging message in voice form according to the push information.

[0009] On one hand, the embodiment of the present application further provides a pair of smart glasses connected to an instant communication server, wherein the smart glasses are used to obtain push information of instant communication messages sent by the instant communication server;

[0010] The smart glasses are further used to play the instant communication message in voice form according to the push information.

[0011] On the one hand, an embodiment of the present application further provides an instant messaging message playing method, which is applied to a smart glasses system, wherein the smart glasses system includes: smart glasses and a smart terminal connected to the smart glasses, and the method includes:

[0012] The smart terminal obtains the instant communication message, and sends push information of the instant communication message to the smart glasses;

[0013] The smart glasses play the instant messaging message in voice form according to the push information.

[0014] It can be seen from the above-mentioned embodiments of the present application that the smart glasses are connected to a smart terminal, the smart terminal is used to obtain instant messaging messages, and send push information of the instant messaging messages to the smart glasses, and the smart glasses are used to play the instant messaging messages in voice form according to the push information, thereby realizing the use of voice to play the instant messaging messages received by the smart terminal on the smart glasses, enriching the functions of the smart glasses, improving the intelligence of the smart glasses, and providing users with convenience in reading instant messaging messages. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention.

[0016] Figure 1 A schematic diagram of the structure of a smart glasses system provided in one embodiment of the present application;

[0017] Figure 2 A schematic diagram of the hardware structure of the smart glasses provided in one embodiment of the present application;

[0018] Figure 3 A schematic diagram of the module structure of the smart glasses provided in one embodiment of the present application;

[0019] Figure 4 A schematic diagram of a setting interface for setting an instant messaging function in a smart terminal in an embodiment of the present application;

[0020] Figure 5 A schematic diagram of a setting interface for setting a smart terminal to play instant messaging messages with smart glasses in an embodiment of the present application;

[0021] Figure 6 A schematic diagram of a setting interface for setting a favorites list played by smart glasses in a smart terminal according to an embodiment of the present application;

[0022] Figure 7 A schematic diagram for realizing the function of playing instant messaging messages through smart glasses in an embodiment of the present application;

[0023] Figure 8 A schematic diagram of an application environment of smart glasses provided in an embodiment of the present application;

[0024] Fig. 9 A schematic diagram of the implementation flow of the instant messaging message playing method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0025] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0026] See also Figure 1 , Figure 1 A schematic diagram of the structure of a smart glasses system provided in an embodiment of the present application, including smart glasses 100, a smart terminal 200 and an instant messaging server 300;

[0027] The smart glasses 100 are connected to the smart terminal 200 via a wireless network, which includes a mobile communication network such as Bluetooth, WIFI, and 4G or 5G, preferably Bluetooth; the smart terminal 200 is connected to the instant communication server 300 via a mobile communication network such as 4G or 5G or WIFI;

[0028] The smart terminal 200 is used to obtain the instant messaging message from the instant messaging server 300 through the instant messaging application, and send the push information of the instant messaging message to the smart glasses 100;

[0029] The smart glasses 100 are used to obtain push information of the instant communication message, and play the instant communication message in voice form according to the push information.

[0030] Specifically, the smart terminal 200 is provided with an instant messaging application, wherein the instant messaging application includes but is not limited to: WhatsApp, Messages, Teams, WeChat, LINES, Signal, Telegram and other IM apps, which are used to obtain instant messaging messages.

[0031] The smart terminal 100 may also have a built-in translation engine, which is used to translate instant messaging information messages in a non-native language into instant messaging messages in a local language. The smart terminal 100 may also call a third-party translation engine for translation, which may be set in the instant messaging server 300 or other devices that have a wireless or wired connection with the smart terminal 100.

[0032] The local language includes: the native language, the local domain dialect, or other local languages ​​set by the user.

[0033] The smart terminal 200 may also be provided with a text-to-speech engine for converting the instant messaging message from a text format into a voice format and then sending it to the smart glasses 100. The smart glasses 100 directly play the item of the instant messaging message in the voice format. The item to be played is pre-set by the smart terminal 200, thereby playing the instant messaging message in the form of voice.

[0034] A text-to-speech engine may also be provided in the smart glasses 100. The smart terminal 200 may send the acquired instant communication message to the smart glasses 100 in the form of a push message. The push message includes each item in the instant communication message. The smart glasses 100 converts the received push message from a text format to a voice format through the text-to-speech engine, and plays the items in the instant communication message in the voice format, thereby playing the instant communication message in the form of voice.

[0035] The items of the instant messaging message include, but are not limited to: the identity of the sender of the instant messaging message, the name of the instant messaging application program that obtains the instant messaging message, and the message content of the instant messaging message. The push information includes the above items.

[0036] The instant messaging server 300 is provided with a module corresponding to the instant messaging application, which is used to cooperate with the instant messaging application in the smart terminal 200 to realize the functions of each instant messaging application.

[0037] In an embodiment of the present application, the smart glasses system includes smart glasses and a smart terminal connected to the smart glasses. The smart terminal is used to obtain instant messaging messages and send push information of the instant messaging messages to the smart glasses. The smart glasses are used to play the instant messaging messages in the form of voice according to the push information, thereby realizing the playback of instant messaging messages received by the smart terminal on the smart glasses by voice, enriching the functions of the smart glasses, improving the intelligence of the smart glasses, and providing users with convenience in reading instant messaging messages.

[0038] Optionally, in another embodiment, the smart terminal 200 may be a smart mobile terminal such as a smart phone, or a smart wearable device such as a smart watch. The smart terminal 200 includes a processor and a memory, wherein a mobile application (Mobile app) and an instant messaging application (Instant Message app) are set in the memory, and the user can call the mobile application through the processor to control the wireless connection between the smart terminal and the smart glasses, such as connecting through Bluetooth or WIFI, mobile communication, etc.; call the mobile application to set the way in which the smart glasses play instant messaging messages, such as turning off or on the instant messaging function of the smart glasses, the way in which the smart glasses play instant messaging messages, etc.

[0039] See also Figure 2 and Figure 3 , Figure 2 This is a schematic diagram of the structure of smart glasses provided in one embodiment of the present application. Figure 3 This is a schematic diagram of the module structure of smart glasses. Figure 2 The schematic diagram of the structure of the smart glasses is only an example. The components such as the processor, memory, input device, playback device and microphone can be arranged as needed and are not limited by the positions shown in the figure. For the convenience of explanation, only the parts related to the embodiment of the present application are shown. The smart glasses 100 may include: a front frame 10 and temples 20 connected to the front frame 10, and the front frame 10 may be inlaid with lenses 30;

[0040] The front frame 10 and the temples 20 may be detachably connected or fixedly connected;

[0041] A processor 21, a communication module 22, a playback device 23 and a memory 24 are provided in the front frame 10 and / or the temple 20;

[0042] The communication module 22 is used to communicate with a smart terminal having a communication module with the same function, and the communication module 22 includes: a Bluetooth module;

[0043] The communication module 22 may also include a WIFI module and a mobile communication module.

[0044] The playback device 23 may be a speaker, and may be a single speaker or multiple speakers. The present application prefers a pair of speakers, which are respectively arranged on the left and right temples.

[0045] The processor 21 is connected to the communication module 22, the playback device 23 and the memory 24;

[0046] The processor 21 is further configured to convert the instant communication message from a text format into a voice format via a built-in text-to-speech engine, and control the playback device 23 to play the instant communication message in the voice format.

[0047] The processor 21 includes a CPU (Central Processing Unit), and may also include a CPU and a DSP (Digital Signal Processing). The DSP is used to process audio signals, and the DSP is connected to the CPU and controlled by the CPU.

[0048] The smart glasses 100 may also be provided with an input device 25 , a microphone 26 , and a battery 27 ;

[0049] The input device 25 may be a button or a touch sensor for obtaining an operation applied by a user;

[0050] The microphone 26 is used to collect sound;

[0051] The battery 27 provides power for the smart glasses.

[0052] In another embodiment, the smart terminal 200 is also used to set the playback mode of the smart glasses 100 for playing instant messaging messages, and the playback mode includes: one or any combination of playback content, playback duration, playback order, and playback language, that is, one of the playback modes can be set, or any two or more can be set.

[0053] In another embodiment, the smart terminal 200 can set the smart glasses 100 to turn on or off the function of playing instant messaging messages. Figure 4 , Figure 4 It is an interactive interface for running mobile applications on the smart terminal 200. A button Whisper Messages is set on the interactive interface to turn on or off the function of playing instant messaging messages. By clicking or sliding the button, the function of playing instant messaging messages can be turned on or off. When the function of playing instant messaging messages is turned off, the smart glasses 100 refuse to receive the push information of the instant messaging message sent by the smart terminal 200, or do not play the instant messaging message after receiving the push information of the instant voice message; when the function of playing instant messaging messages is turned on, the smart glasses 100 receive the push information and play the instant messaging message in voice form.

[0054] In another embodiment, the smart terminal 200 is used to configure the smart glasses 100 to play instant messaging messages of a designated instant messaging application and a designated sender.

[0055] Specifically, the user can define a favorites list through the mobile application of the smart terminal 200, set several instant messaging users in the favorites list, and enable the playback of received instant messaging messages through voice broadcasting of the smart glasses for the several instant messaging users.

[0056] For example, according to the user's setting instructions, the smart terminal 200 enables the voice instant messaging function for an instant messaging user named S in the A instant messaging application. The smart glasses 100 then play instant messaging messages received from S from the A instant messaging application, but will not play instant messaging messages sent by others except S from the A instant messaging application or from instant messaging applications other than A.

[0057] It can be set to correspond to different senders in different time periods. For example, the designated senders during working hours are company colleagues or company group messages, and the designated senders during non-working hours are family members.

[0058] You can also set the priority of the designated sender. The designated sender can send messages at any time without time restrictions.

[0059] In another embodiment, the smart terminal 200 is used to set the smart glasses 100 to play the instant messaging message.

[0060] Among them, the sender of the instant messaging message (ie, the instant messaging user); the identity identifier includes name, number, etc.

[0061] Specifically, the smart terminal 200 sets the smart glasses 100 to play the sender's name, or play the sender's name and the name of the application, or play the sender's name and the message content, or play the sender's name, the name of the application and the message content.

[0062] In another embodiment, the smart terminal 200 can also be used to set the correspondence between the time when the push information of the instant messaging message is received and the item of the instant messaging message played by the smart glasses 100, so that the smart glasses 200 play the item of the instant messaging message according to the time when the push information of the current instant messaging message is received.

[0063] Specifically, multiple time periods can be set, such as the working time period on weekdays (9 am to 6 pm), the leisure time period on weekdays (6 pm to 10 pm), and the whole day on holidays (9 am to 10 pm). For push messages of instant messaging messages received during the working time period, the sender name or message content of the instant messaging message will be played, for push messages of instant messaging messages received during the leisure time period, the sender name and message content of the instant messaging message will be played, and for push messages of instant messaging messages received during holidays, the sender name, the name of the application program, and the message content of the message will be played. The above are just examples, and users can set the content according to their own habits or needs without being limited by the above examples.

[0064] In another embodiment, the smart terminal 200 is further used to set multiple languages ​​for the smart glasses 100 to play instant messaging messages, so that the smart glasses 100 can play instant messaging message items in the set multiple languages ​​respectively.

[0065] The multiple languages ​​may be English, Chinese, French, etc. The sender's name, the application name and the message content in the instant messaging message may be played in different languages, for example, the sender's name may be played in Chinese, the message content may be played in English, etc.

[0066] You can also set the language for playing instant messaging messages to one.

[0067] In another embodiment, the smart terminal 200 is further used to set the time length or the number of characters for the smart glasses 100 to play the instant communication message, so that the smart glasses 100 play the instant communication message according to the time length or the number of characters, and stop playing the instant communication message when the playing of the instant communication message reaches the set time length or the number of characters.

[0068] In another embodiment, the smart terminal 200 is further used to, if the smart glasses 100 continuously obtain multiple instant messaging messages sent by the same instant messaging user within a preset time period, set the playback item of the first instant messaging message obtained to include the sender identity identifier, and set the playback items of each instant messaging message starting from the second instant messaging message not to include the sender identity identifier, that is, the playback item of the first instant messaging message obtained includes the sender identity identifier, and the playback items of each instant messaging message starting from the second instant messaging message do not include the sender identity identifier.

[0069] Specifically, the preset duration can be set to 60 seconds. If multiple instant messaging messages are received from the same instant messaging user within 60 seconds, the first instant messaging message can play the sender's name, application name and message content. Starting from the second instant messaging message, until the last instant messaging message received within 60 seconds, only the message content is played without playing the sender's name, which can save playback time and power.

[0070] In another embodiment, the smart terminal 200 can also be set to start from the second instant messaging message and only play the message content if the smart glasses 100 continuously receive instant messaging messages from the same instant messaging user within an interval time or a continuous time, that is, instant messaging messages from the same person that do not exceed the interval time or are within the continuous time.

[0071] In another embodiment, the smart terminal 200 is used to set the sender identity of the instant messaging message played by the smart glasses 100, obtain the name of the application and the message content. For example, the played voice is "You have a message from C: Do you have time to have dinner together tonight?

[0072] Further, in another embodiment, an input device 25 is provided in the front frame and / or the temples of the smart glasses;

[0073] The smart terminal 200 is also used to set the smart glasses 100 to stop playing or skip playing the instant messaging message in response to an action input through the input device 25 when playing the instant messaging message. Skipping the instant messaging message means stopping playing the current instant messaging message and starting playing the next instant messaging message.

[0074] See also Figure 5 , Figure 5 The setting interface for the smart terminal 200 to play instant messaging messages to the smart glasses 100, the switch buttons set on the setting interface include but are not limited to: setting the smart glasses 100 to play instant messaging messages corresponding to designated instant messaging applications, Figure 5 The switch buttons of LINE, Messages, Facebook Messenger, Signal, Microsoft Teams, Telegram, WeChat and WhatsApp are shown in the figure; the switch button Favorite List of the favorites list played by the smart glasses 100 is set, and several instant messaging users are set in the favorites list, and the voice broadcast mode of the smart glasses is enabled for the several instant messaging users to play the received instant messaging messages; the playback length button Message Length, the playback content button Read Content, and the switch button Tap on frames to stop reading for stopping the playback of instant messaging messages through the action input by the input device 25 are set for the smart glasses 100 to play instant voice messages. The switch buttons can also be set on the setting interface, Figure 5 The figure is only an example and does not limit the number and type of switch buttons.

[0075] See also Figure 6 , Figure 6 The specific interface for setting the favorites list played by the smart glasses 100 for the smart terminal 200 is the switch button Enable Favorite List. In this interface, the instant messaging users in the favorites list can also be set, such as Figure 6 Sam Yu shown in the figure, turns on the switch button, and the smart glasses 100 can play the instant messaging messages from the instant messaging users in the favorites list in voice form.

[0076] Furthermore, in another embodiment, the smart terminal 200 is further configured to configure the smart glasses 100 to disable or enable automatic adjustment of the volume of the instant messaging message according to the detected ambient noise result.

[0077] Enable automatic adjustment of the volume of the instant messaging message according to the detected environmental noise result. The smart terminal 200 obtains the sound of the surrounding environment, performs environmental noise detection according to the sound, and automatically adjusts the volume of the speaker playing the instant messaging message according to the detected environmental noise result.

[0078] Specifically, if the ambient noise is greater than a preset noise value, the smart glasses 100 increase the volume of the instant messaging message; if the ambient noise is less than the preset noise value, the smart glasses 100 reduce the volume of the instant messaging message.

[0079] Automatically adjusting the volume of the instant messaging message according to the detected environmental noise result is disabled, and the smart terminal 200 does not adjust the volume of the speaker playing the instant messaging message according to the detected environmental noise result.

[0080] Furthermore, in another embodiment, the smart terminal 200 is used to set the smart glasses 100 to disable or enable playing all or part of the instant messaging message by voice.

[0081] For example, the smart terminal 200 sets the smart glasses 100 to enable the function of playing instant messaging messages by voice of instant messaging application A and instant messaging application B, and disables the function of playing instant messaging messages by voice of instant messaging application C. Then, the smart glasses 100 can play the instant messaging messages from instant messaging application A and instant messaging application B sent by the smart terminal 200 in voice form, but will not play the instant messaging messages from instant messaging application C sent by the smart terminal 200.

[0082] Furthermore, in another embodiment, the smart glasses 100 have a light emitting device, such as an LED (light-emitting diode) lamp and its surrounding circuits. The light emitted by the light emitting device can be captured by the wearer's eyes. As an example, the light emitting device can be located at the connection between the frame and the temples of the smart glasses 100, such as at the hinge.

[0083] The smart terminal 200 is also used to set the smart glasses 100 to not play the instant communication message when receiving the push information of the instant communication message when in the do not disturb mode, but to emit a light signal through the light-emitting device to notify the user that the instant communication message has been received, and to automatically play the instant communication message when the smart glasses 100 cancel the do not disturb mode.

[0084] The do not disturb mode may include a meeting mode and a rest mode, etc. When the user is in the do not disturb mode, he does not want the smart glasses 100 to automatically play the instant messaging messages sent by the smart terminal 200.

[0085] The user can control the smart glasses to be in or release the do not disturb mode by setting the do not disturb time of the do not disturb mode on the smart terminal 200. The user can also set the entry gesture and release gesture of the do not disturb mode on the smart terminal 200, and the smart glasses 100 will enter the do not disturb mode when they detect the user's entry gesture, and release the do not disturb mode when they detect the user's release gesture.

[0086] The light signal may be a light flashing signal, and the flashing frequency may be set by the user through the smart terminal 200 .

[0087] Furthermore, in another embodiment, the smart terminal 200 is also used to translate the instant messaging message into a text format message in the local language through a built-in translation engine, and convert the text format message into a voice format message through the built-in text-to-speech engine, and send the push information of the voice format message to the smart glasses 100, so that the smart glasses 100 play the voice format message through the playback device 23.

[0088] Alternatively, the smart terminal 200 is further used to translate the instant messaging message into a voice format message in the local language through a third-party translation engine, and send push information of the voice format message to the smart glasses 100, so that the smart glasses 100 play the voice format message through the playback device 23.

[0089] Among them, the voice format messages may include messages in Mandarin voice, Cantonese voice, English voice and Japanese voice formats. The text format corresponding to the message converted into Mandarin voice format is simplified Chinese text, the text format corresponding to the message converted into Cantonese voice format is traditional Chinese text, the text format corresponding to the message converted into English voice format is English text, and the text format corresponding to the message converted into Japanese voice format is Japanese text.

[0090] The instant messaging message is translated into the text format of the local language through a built-in translation engine, and then the text format of the local language is translated into the voice format of the local language through a text-to-speech engine.

[0091] Alternatively, the instant messaging message is directly translated into the voice format of the local language through a third-party translation engine.

[0092] An example is given to illustrate the process of playing the instant messaging message received by the smart terminal 200 on the smart glasses 100, see Figure 7 When the IM APP receives an instant messaging message, the smart terminal 200 ( Figure 8In the example of a smart phone or smart watch, the push information of the received instant communication message is sent to the smart glasses 100 via Bluetooth. The push information includes items of sending the instant communication message, such as the name of the person who sent the instant communication message, the name of the IM application, and the content of the instant communication message. The smart glasses 100 receives the push information, converts the instant communication message in the push information from text format to voice format through the text-to-speech engine inside the smart glasses 100, and plays the name of the person, the name of the IM application, and the content of the message through the left and right stereo speakers.

[0093] See also Figure 8 The present application also provides a smart glasses which are connected to the instant messaging server and transmit data to each other. The smart glasses can be the above-mentioned Figures 1 to 3 The smart glasses 100 shown in FIG. 1 , the instant communication server may be the above-mentioned Figure 1 The instant communication server 300 shown in .

[0094] The smart glasses 100 are connected to the instant communication server 300 via a wireless network, and the wireless network includes Bluetooth, WIFI, and mobile communication networks such as 4G or 5G, preferably WIFI or mobile communication network.

[0095] Specifically, the smart glasses 100 are provided with the instant messaging application;

[0096] The instant messaging server 300 is provided with a module corresponding to the instant messaging application, which is used to obtain the instant messaging messages sent by the user and send them to the instant messaging application in the smart glasses 100 to implement the functions of each instant messaging application.

[0097] The smart glasses 100 are used to obtain push information of the instant communication message from the instant communication server 300 through the instant communication application, and play the instant communication message in voice form according to the push information, and the push information includes each item in the instant communication message.

[0098] The smart glasses 100 may also be provided with a translation engine, which is used to convert the instant communication message in the non-native language into an instant communication message in the local language.

[0099] The smart glasses 100 may also call a third-party translation engine to convert the instant messaging message in a non-native language into the instant messaging message in a local language. The third-party translation engine may be set on the smart terminal 200 or the instant messaging server 300 .

[0100] A text-to-speech engine may also be provided in the smart glasses 100, through which the smart glasses 100 convert the received push information from text format to voice format, and play the items of the instant communication message in the voice format. The items played are pre-set by the instant communication server 300, thereby playing the items in the instant communication message in the form of voice.

[0101] The items of the instant messaging message include, but are not limited to: the identity of the sender of the instant messaging message, the name of the instant messaging application program that obtains the instant messaging message, and the message content of the instant messaging message. The push information includes the above items.

[0102] The smart glasses 100 are used to obtain push information of the instant communication message sent by the instant communication server 300, and play the instant communication message in voice form according to the push information.

[0103] In an embodiment of the present application, the smart glasses are connected to an instant messaging server, the smart glasses obtain push information of instant messaging messages sent by the instant messaging server, and play the instant messaging messages in the form of voice based on the push information, thereby realizing voice playback of instant messaging messages on the smart glasses, enriching the functions of the smart glasses, improving the intelligence of the smart glasses, and providing users with convenience in reading instant messaging messages.

[0104] In another embodiment, the instant communication server 300 sets a playback mode for the smart glasses 100 to play the instant communication message, and the smart glasses 100 are used to play the instant communication message according to the playback mode set by the instant communication server 300, and the playback mode includes: one or any combination of playback content, playback duration, playback order and playback language.

[0105] The playing content refers to playing an item in the instant messaging message, which includes but is not limited to: the sender identity of the instant messaging message, the name of the instant messaging application that obtains the instant messaging message, and the message content of the instant messaging message. The smart glasses 100 can play one or any combination of the sender identity of the instant messaging message, the name of the instant messaging application corresponding to the instant messaging message, and the message content of the instant messaging message according to the settings of the instant messaging server 300.

[0106] The playing time refers to the playing time of the instant messaging message, for example, playing for 5 seconds, playing half of the instant messaging message time, or playing until 5 seconds before the end of the instant messaging message.

[0107] The play order refers to the play order when multiple instant messaging messages are received, for example, playing the instant messaging message received first, or giving priority to playing the latest received instant messaging message.

[0108] The play order refers to the language used when playing instant messaging messages, for example, Chinese, English or French.

[0109] In another embodiment, the instant communication server 300 configures the smart glasses 100 to play instant communication messages of a designated instant communication application and a designated sender, and the smart glasses 100 are used to play instant communication messages of the designated instant communication application and the designated sender through the playback device 23 according to the configuration of the instant communication server 300.

[0110] In another embodiment, the instant communication server 300 sets the smart glasses 100 to play the instant communication message in multiple languages, and the smart glasses 100 play the items of the instant communication message respectively according to the multiple languages ​​set by the instant communication server 300.

[0111] Specifically, the memory 24 stores translation engines of multiple languages, and the processor 21 can call these translation engines to translate the specified content into the corresponding language. The multiple languages ​​can be English, Chinese, French, etc. The processor 21 controls the playback device 23 to play the name of the sender of the instant messaging message, the name of the application, and the message content in the set language. That is, the sender's name, the name of the application, and the message content can be played in different languages. For example, the sender's name is played in Chinese, and the message content is played in English.

[0112] In another embodiment, the instant communication server 300 sets the time length or the number of characters for the smart glasses 100 to play the instant communication message, and the smart glasses 100 plays the instant communication message according to the time length or the number of characters according to the setting of the instant communication server 300. When the playing of the instant communication message reaches the set time length or the number of characters, the playing of the instant communication message is stopped.

[0113] In another embodiment, the instant messaging server 300 is used to set the playback item of the first instant messaging message obtained to include the sender identity identifier, and set the playback items of each instant messaging message starting from the second instant messaging message not to include the sender identity identifier, if the smart glasses 100 continuously obtain multiple instant messaging messages sent by the same instant messaging user within a preset time period. The smart glasses 100 are also used to play the message content in the item of the instant messaging message starting from the second instant messaging message according to the setting of the instant messaging server 300, if multiple instant messaging messages sent by the same instant messaging user are continuously obtained within a preset time period, that is, the playback item of the first instant messaging message obtained includes the sender identity identifier, and the playback items of each instant messaging message starting from the second instant messaging message do not include the sender identity identifier, and only the message content in the playback item is played.

[0114] Specifically, the input device 25 may be a button or a touch sensor;

[0115] The button or touch sensor can be set in the front frame and / or the temple. The instant communication server 300 configures the smart glasses 100 to stop playing or skip playing the instant communication message in response to an action input through the input device 25 of the smart glasses 100 when playing the instant communication message. The smart glasses 100 are used to control the speaker to stop playing or skip playing the instant communication message when the speaker plays the instant communication message in response to an input action sensed by the button.

[0116] The input action may be a click, a touch, or a slide.

[0117] The input device 25 can also be a touch sensor, which is arranged in the temple. The smart glasses 100 are also used to increase or decrease the volume when the speaker plays an instant messaging message by sensing a gesture of sliding on the temple toward the user's ear, or by sensing a gesture of sliding on the temple away from the user's ear, which is sensed by the touch sensor.

[0118] Further, in another embodiment, the smart glasses 100 further include a microphone 26 disposed in the front frame and / or the temples;

[0119] The instant messaging server 300 sets the smart glasses 100 to disable or enable automatic adjustment of the volume of playing the instant messaging message based on the detected environmental noise results. The smart glasses 100 are also used to obtain the sound of the surrounding environment through the microphone 26, and perform environmental noise detection based on the sound, and automatically adjust the volume of the speaker playing the instant messaging message based on the detected environmental noise results.

[0120] Specifically, if the ambient noise is greater than a preset noise value, the smart glasses 100 increase the volume of the instant messaging message; if the ambient noise is less than the preset noise value, the smart glasses 100 reduce the volume of the instant messaging message.

[0121] Furthermore, in another embodiment, the instant communication server 300 configures the smart glasses 100 to disable or enable the playback of all or part of the instant communication messages obtained by the instant communication application through voice, and the smart glasses 100 are also used to disable or enable the playback of all or part of the instant communication messages obtained by the instant communication application through voice according to the settings of the instant communication server 300.

[0122] Furthermore, in another embodiment, the smart glasses 100 are also used to, according to the settings of the instant communication server 300, when in the do not disturb mode, receive the push information of the instant communication message, do not play the instant communication message, but instead emit a light signal through the light-emitting device to notify the user that the instant communication message has been received, and automatically play the instant communication message when the smart glasses 100 cancel the do not disturb mode.

[0123] The user can control the smart glasses to be in or release the do not disturb mode by setting the do not disturb time of the do not disturb mode on the instant communication server 300. The user can also set the entry gesture and release gesture of the do not disturb mode on the instant communication server 300, and the smart glasses 100 enter the do not disturb mode when they detect the user's entry gesture, and release the do not disturb mode when they detect the user's release gesture.

[0124] The light signal may be a light flashing signal, and the flashing frequency may be set by the user through the instant communication server 300 .

[0125] Furthermore, in another embodiment, the smart glasses 100 are used to translate the instant messaging message into a text format message in the local language through a built-in translation engine, and convert the text format message into a voice format message through a built-in text-to-speech engine, and play the voice format message.

[0126] The smart glasses 100 are also used to translate the instant messaging message into a voice format message in the local language through a third-party translation engine, and obtain and play the voice format message.

[0127] In this embodiment, the smart glasses implement the setting of voice playback of instant messaging messages according to the setting of the instant messaging server, further enriching the functions, improving the intelligence, and providing convenience for users.

[0128] See also Fig. 9The embodiment of the present application also provides an instant messaging message playing method, which can be applied to the smart glasses system in the above embodiment. The smart terminal of the smart glasses system obtains the instant messaging message through the instant messaging application, and sends the push information of the instant messaging message to the smart glasses in the smart glasses system. The smart glasses play the instant messaging message in voice form according to the push information. The method includes the following steps:

[0129] S801, the intelligent terminal obtains an instant messaging message;

[0130] S802: The smart terminal sends push information of the instant messaging message to the smart glasses;

[0131] S803: The smart glasses play the instant messaging message in voice form according to the push information.

[0132] For specific contents in the embodiments of this application, please refer to the description of the aforementioned embodiments.

[0133] In the embodiment of the present application, the smart glasses are connected to the smart terminal, the smart terminal obtains the instant messaging message, and sends the push information of the instant messaging message to the smart glasses. The smart glasses play the instant messaging message in the form of voice based on the push information, thereby realizing the playback of the instant messaging message received by the smart terminal on the smart glasses by voice, enriching the functions of the smart glasses, improving the intelligence of the smart glasses, and providing users with the convenience of reading instant messaging messages.

[0134] Furthermore, in another embodiment, before step S803, the method further includes: the smart terminal setting a playback mode for the smart glasses to play the instant messaging message, the playback mode including: one or any combination of playback content, playback duration, playback order, and playback language.

[0135] Furthermore, in another embodiment, the smart terminal sets the smart glasses to play the instant messaging message in a manner that includes: the smart terminal sets the smart glasses to play the instant messaging message of a designated instant messaging application and a designated sender.

[0136] Furthermore, in another embodiment, the smart terminal sets the smart glasses to play the instant communication message, including: the smart terminal sets the smart glasses to play the item of the instant communication message.

[0137] Furthermore, in another embodiment, the smart terminal sets the smart glasses to play the instant communication message in multiple languages, so that the smart glasses play the items in the instant communication message in the set multiple languages ​​respectively.

[0138] Furthermore, in another embodiment, the smart terminal sets the way in which the smart glasses play the instant messaging message, including: the smart terminal sets the playback duration or number of characters for the smart glasses to play the instant messaging message, so that the smart glasses play the instant messaging message according to the playback duration or the number of characters.

[0139] Furthermore, in another embodiment, the smart terminal sets the smart glasses to play the instant messaging message in the following manner: if the smart glasses continuously obtain multiple instant messaging messages sent by the same instant messaging user within a preset time period, the smart terminal sets the playback item of the first instant messaging message obtained to include the sender's identity identifier, and sets the playback items of each instant messaging message starting from the second instant messaging message not to include the sender's identity identifier.

[0140] Further, in another embodiment, the smart terminal sets the smart glasses to play the instant messaging message in a manner that includes: an input device is provided in the front frame of the smart glasses and / or the temples;

[0141] The smart terminal configures the smart glasses to stop playing or skip playing the instant communication message in response to an action input through the input device of the smart glasses when playing the instant communication message.

[0142] Furthermore, in another embodiment, the smart terminal sets the smart glasses to play the instant communication message, including: the smart terminal sets the smart glasses to disable or enable automatic adjustment of the volume of playing the instant communication message according to the detected environmental noise result.

[0143] Furthermore, in another embodiment, the smart terminal sets the smart glasses to play the instant messaging message including: the smart terminal sets the smart glasses to disable or enable voice playback of all or part of the instant messaging message corresponding to the instant messaging application.

[0144] Furthermore, in another embodiment, the method also includes: the smart terminal is also used to set the smart glasses to be in the do not disturb mode and receive the push information of the instant communication message, then notify the user through a light signal, and play the instant communication message corresponding to the push message when exiting the do not disturb mode.

[0145] Furthermore, in another embodiment, the method also includes: the smart terminal translates the instant messaging message into a text format message in the local language through a built-in translation engine and converts the text format message into a voice format message through a built-in text-to-speech engine, and sends the voice format message to the smart glasses for playback.

[0146] Alternatively, the smart terminal translates the instant messaging message into a voice format message in a local language through a third-party translation engine, and the smart terminal obtains and plays the voice format message.

[0147] It should be noted that, for the convenience of description, the aforementioned method embodiments are all described as a series of action combinations, but those skilled in the art should be aware that the present invention is not limited by the described action sequence, because according to the present invention, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

[0148] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0149] The above is a description of the smart glasses system, smart glasses and instant messaging message playback method provided by the present invention. For technicians in this field, according to the ideas of the embodiments of the present application, there may be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as limiting the present invention.

Claims

1. A smart glasses system, characterized in that: The smart glasses system comprises: Smart glasses and a smart terminal connected to the smart glasses; The smart terminal is used to obtain instant messaging messages and send push information of the instant messaging messages to the smart glasses; The smart glasses are used to play the instant messaging message in voice form according to the push information.

2. The smart glasses system according to claim 1, characterized in that: The smart terminal is further used to set a playback mode for the smart glasses to play the instant messaging message, and the playback mode includes: one or any combination of playback content, playback duration, playback order, and playback language.

3. The smart glasses system according to claim 2, characterized in that: The smart terminal is also used to set the smart glasses to play instant messaging messages of a designated instant messaging application and a designated sender.

4. The smart glasses system according to claim 2, characterized in that: The smart terminal is also used to set the item for the smart glasses to play the instant messaging message.

5. The smart glasses system according to claim 2, characterized in that: The smart terminal is further used to set the smart glasses to play the instant communication message in multiple languages, so that the smart glasses can play the items in the instant communication message respectively in the set multiple languages.

6. The smart glasses system according to claim 2, characterized in that: The smart terminal is further used to set the playback time or the number of characters played by the smart glasses for the instant communication message, so that the smart glasses play the instant communication message according to the playback time or the number of characters.

7. The smart glasses system according to claim 2, characterized in that: The smart terminal is also used to set the playback item of the first instant messaging message obtained to include the sender's identity identifier, and set the playback items of each instant messaging message starting from the second instant messaging message not to include the sender's identity identifier, if the smart glasses continuously obtain multiple instant messaging messages sent by the same instant messaging user within a preset time period.

8. The smart glasses system according to claim 2, characterized in that: An input device is provided in the front frame and / or the temples of the smart glasses; The smart terminal is further used to set the smart glasses to stop playing or skip playing the instant communication message in response to an action input through the input device of the smart glasses when playing the instant communication message.

9. The smart glasses system according to claim 2, characterized in that: The smart terminal is further used to set the smart glasses to disable or enable automatic adjustment of the volume of playing the instant messaging message according to the detected environmental noise result.

10. The smart glasses system according to claim 2, characterized in that: The smart terminal is further used to set the smart glasses to disable or enable playing all or part of the instant messaging messages corresponding to the instant messaging application program through voice.

11. The smart glasses system according to claim 1, characterized in that: The smart terminal is also used to set the smart glasses to receive the push information when they are in the do not disturb mode, notify the user through a light signal, and play the instant communication message when exiting the do not disturb mode.

12. The smart glasses system according to claim 1, characterized in that: The smart terminal is also used to translate the instant messaging message into a text format message in the local language through a built-in translation engine, and convert the text format message into a voice format message through a built-in text-to-speech engine, and send push information of the voice format message to the smart glasses so that the smart glasses play the voice format message.

13. The smart glasses system according to claim 1, characterized in that: The smart terminal is also used to translate the instant messaging message into a voice format message in a local language through a third-party translation engine, and send push information of the voice format message to the smart glasses so that the smart glasses play the voice format message.

14. A pair of smart glasses connected to an instant messaging server, characterized in that: The smart glasses are used to obtain push information of instant messaging messages sent by the instant messaging server; The smart glasses are further used to play the instant communication message in voice form according to the push information.

15. The smart glasses according to claim 14, characterized in that: The smart glasses are further used to play the instant messaging message in a playing mode set by the instant messaging server, wherein the playing mode includes: one or any combination of playing content, playing duration, playing order and playing language.

16. The smart glasses according to claim 15, characterized in that: The smart glasses include: a front frame and temples connected to the front frame; An input device, a playback device and a microphone are arranged in the front frame and / or the temples.

17. The smart glasses according to claim 15, characterized in that: The smart glasses are used to play the instant messaging messages of the designated instant messaging application and the designated sender through the playing device according to the settings of the instant messaging server.

18. The smart glasses according to claim 15, characterized in that: The smart glasses are also used to play the items in the instant communication message respectively according to the multiple languages ​​set by the instant communication server.

19. The smart glasses according to claim 15, characterized in that: The smart glasses are further used to play the instant communication message according to the playing time or the number of characters set by the instant communication server.

20. The smart glasses according to claim 15, characterized in that: The smart glasses are also used to, in accordance with the settings of the instant messaging server, include the sender's identity identifier in the playback item of the first instant messaging message obtained if multiple instant messaging messages sent by the same instant messaging user are continuously obtained within a preset time period, and do not include the sender's identity identifier in the playback items of each instant messaging message starting from the second instant messaging message.

21. The smart glasses according to claim 16, characterized in that: The input device includes a button; The smart glasses are further used to control the speaker to stop playing or skip playing the instant communication message in response to an input action sensed on the button when playing the instant communication message.

22. The smart glasses according to claim 16, characterized in that: The input device includes a touch sensor disposed on the temple; The smart glasses are also used to increase or decrease the playback volume of the speaker when playing the instant messaging message through a gesture of sliding on the temple toward the user's ear sensed by the touch sensor, or to decrease or increase the playback volume of the speaker by a gesture of sliding on the temple away from the user's ear sensed by the touch sensor.

23. The smart glasses according to claim 16, characterized in that: The smart glasses are also used to obtain ambient sounds through the microphone according to the settings of the instant messaging server and perform environmental noise detection based on the sounds, and automatically adjust the volume of playing the instant messaging message according to the detected environmental noise results.

24. The smart glasses according to claim 15, characterized in that: The smart glasses are also used to disable or enable voice playback of all or part of the instant messaging messages obtained by the instant messaging application according to the settings of the instant messaging server.

25. The smart glasses system according to claim 14, characterized in that: The smart glasses are also used to notify the user through a light signal when receiving the push information when in the do not disturb mode according to the settings of the instant communication server, and play the instant communication message when exiting the do not disturb mode.

26. The smart glasses according to claim 14, characterized in that: The smart glasses are also used to translate the instant messaging message into a text format message in a local language through a built-in translation engine, and to convert the text format message into a voice format message through a built-in text-to-speech engine, and to play the voice format message.

27. The smart glasses according to claim 14, characterized in that: The smart glasses are also used to translate the instant messaging message into a voice format message in a local language through a third-party translation engine, and to obtain and play the voice format message.

28. An instant messaging message playing method, applied to a smart glasses system, characterized in that: The smart glasses system comprises: smart glasses and a smart terminal connected to the smart glasses, and the method comprises: The smart terminal obtains the instant communication message, and sends push information of the instant communication message to the smart glasses; The smart glasses play the instant messaging message in voice form according to the push information.

29. The method according to claim 28, characterized in that Before the smart glasses play the instant communication message in voice form according to the push information, the process includes: The smart terminal sets a playing mode for the smart glasses to play the instant messaging message, and the playing mode includes: one or any combination of playing content, playing duration, playing order, and playing language.

30. The method according to claim 29, characterized in that The smart terminal sets the smart glasses to play the instant messaging message in a manner that includes: The smart terminal configures the smart glasses to play instant messaging messages of a designated instant messaging application and a designated sender.

31. The method according to claim 29, characterized in that The smart terminal sets the smart glasses to play the instant messaging message in a manner that includes: If the smart glasses continuously obtain multiple instant messaging messages sent by the same instant messaging user within a preset time period, the smart terminal is set to include the sender's identity identifier in the playback item of the first instant messaging message obtained, and the sender's identity identifier is not included in the playback items of each instant messaging message starting from the second instant messaging message.

Images