Smart glass system, smart glasses, and instant messaging message playback method

Abstract

A smart glass system, smart glasses, and an instant messaging message playback method. The smart glass system comprises smart glasses which are connected to a smart terminal; and the smart terminal which is used for acquiring an instant messaging message and sending push information of the instant messaging message to the smart glasses; and the smart glasses are used for playing the instant messaging message by means of voice on the basis of the push information. According to the smart glass system, the smart glasses, and the instant messaging message playback method, the instant messaging message can be played by the smart glasses by means of voice.

Description

Smart glasses system, smart glasses, and instant messaging message playing method

[0001] This application claims priority to Chinese patent application number CN 2023111612388, entitled “Smart glasses system, smart glasses and instant messaging message playback method,” filed with the Patent Office of the State Intellectual Property Office of China on September 7, 2023, the entire contents of which are incorporated herein by reference. Technical Field

[0002] The embodiments of the present application relate to the technical field of smart wearable devices, and in particular to a smart glasses system, smart glasses, and an instant messaging message playing method. Background Art

[0003] A smart glasses system is a data interaction system that includes smart glasses, smart terminals, and servers. Smart glasses, also known as smart mirrors, are like smartphones, with independent operating systems. Users can install software, games, and other programs provided by software service providers. With the development of smart glasses technology, voice-related features are becoming increasingly richer.

[0004] In the existing technology, smart glasses can be used to control music playback and volume when talking to other users. The voice playback function is relatively simple and the degree of intelligence is not high. Technical issues

[0005] The embodiments of the present application provide a smart glasses system, smart glasses, and an instant messaging message playback method, which can solve the problem that the voice function of smart glasses is simple and the degree of intelligence is not high. Technical Solutions

[0006] An embodiment of the present application provides a smart glasses system, including:

[0007] Smart glasses and a smart terminal connected to the smart glasses;

[0008] The smart terminal is used to obtain instant messaging messages and send push information of the instant messaging messages to the smart glasses;

[0009] The smart glasses are used to play the instant messaging message in voice form according to the push information.

[0010] In one aspect, an embodiment of the present application further provides a pair of smart glasses connected to an instant messaging server, wherein the smart glasses are configured to obtain push information of instant messaging messages sent by the instant messaging server;

[0011] The smart glasses are further configured to play the instant messaging message in voice form according to the push information.

[0012] In one aspect, an embodiment of the present application further provides an instant messaging message playing method, which is applied to a smart glasses system, wherein the smart glasses system includes: smart glasses and a smart terminal connected to the smart glasses, and the method includes:

[0013] The smart terminal obtains the instant communication message and sends push information of the instant communication message to the smart glasses;

[0014] The smart glasses play the instant messaging message in voice form according to the push information. Beneficial effects

[0015] It can be seen from the above-mentioned embodiments of the present application that the smart glasses are connected to the smart terminal, the smart terminal is used to obtain instant messaging messages, and send push information of the instant messaging messages to the smart glasses, and the smart glasses are used to play the instant messaging messages in voice form according to the push information, thereby realizing the use of voice to play the instant messaging messages received by the smart terminal on the smart glasses, enriching the functions of the smart glasses, improving the intelligence of the smart glasses, and providing users with convenience in reading instant messaging messages. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present application.

[0017] FIG1 is a schematic structural diagram of a smart glasses system provided by an embodiment of the present application;

[0018] FIG2 is a schematic diagram of the hardware structure of smart glasses provided in one embodiment of the present application;

[0019] FIG3 is a schematic diagram of the module structure of smart glasses provided in one embodiment of the present application;

[0020] FIG4 is a schematic diagram of a setting interface for setting an instant messaging function of a smart terminal in an embodiment of the present application;

[0021] FIG5 is a schematic diagram of a setting interface for setting a smart terminal to play instant messaging messages on smart glasses according to an embodiment of the present application;

[0022] FIG6 is a schematic diagram of a setting interface for setting a favorites list played by smart glasses on a smart terminal in an embodiment of the present application;

[0023] FIG7 is a schematic diagram of implementing the function of playing instant messaging messages through smart glasses in an embodiment of the present application;

[0024] FIG8 is a schematic diagram of an application environment of smart glasses provided by an embodiment of the present application;

[0025] FIG9 is a schematic diagram of the implementation flow of the instant messaging message playing method provided in an embodiment of the present application. Modes for Carrying Out the Invention

[0026] To make the purpose, technical solutions, and advantages of the embodiments of the present application more clear, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without making creative efforts shall fall within the scope of protection of this application.

[0027] 1 , which is a schematic diagram of the structure of a smart glasses system according to an embodiment of the present application, including smart glasses 100 , a smart terminal 200 , and an instant messaging server 300 ;

[0028] The smart glasses 100 are connected to the smart terminal 200 via a wireless network, which includes Bluetooth, WIFI, and 4G or 5G mobile communication networks, preferably Bluetooth; the smart terminal 200 is connected to the instant messaging server 300 via a 4G or 5G mobile communication network or WIFI;

[0029] The smart terminal 200 is used to obtain instant messaging messages from the instant messaging server 300 through the instant messaging application, and send push information of the instant messaging messages to the smart glasses 100;

[0030] The smart glasses 100 are used to obtain push information of the instant messaging message, and play the instant messaging message in voice form according to the push information.

[0031] Specifically, the smart terminal 200 is provided with an instant messaging application, wherein the instant messaging application includes but is not limited to: WhatsApp, Messages, Teams, WeChat, LINES, Signal and Telegram and other IM apps, which are used to obtain instant messaging messages.

[0032] The smart terminal 100 can also have a built-in translation engine, which is used to translate instant messaging messages in non-native languages ​​into instant messaging messages in the local language. The smart terminal 100 can also call a third-party translation engine for translation, which can be set in the instant messaging server 300 or other devices that have a wireless or wired connection with the smart terminal 100.

[0033] The local language includes: the native language, the local dialect, or other local languages ​​set by the user.

[0034] The smart terminal 200 can also be provided with a text-to-speech engine for converting the instant messaging message from text format to voice format and sending it to the smart glasses 100. The smart glasses 100 directly play the item of the instant messaging message in the voice format. The item to be played is pre-set by the smart terminal 200, thereby playing the instant messaging message in the form of voice.

[0035] A text-to-speech engine can also be provided in the smart glasses 100. The smart terminal 200 can send the acquired instant messaging message to the smart glasses 100 in the form of push information. The push information includes each item in the instant messaging message. The smart glasses 100 converts the received push information from text format to voice format through the text-to-speech engine, and plays the items in the instant messaging message in the voice format, thereby playing the instant messaging message in the form of voice.

[0036] The items of the instant messaging message include, but are not limited to: the identity of the sender of the instant messaging message, the name of the instant messaging application that obtains the instant messaging message, and the message content of the instant messaging message. The push information includes the above items.

[0037] The instant messaging server 300 is provided with a module corresponding to the instant messaging application, which is used to cooperate with the instant messaging application in the smart terminal 200 to implement various functions of the instant messaging application.

[0038] In an embodiment of the present application, the smart glasses system includes smart glasses and a smart terminal connected to the smart glasses. The smart terminal is used to obtain instant messaging messages and send push information of the instant messaging messages to the smart glasses. The smart glasses are used to play the instant messaging messages in the form of voice based on the push information, thereby realizing the playback of instant messaging messages received by the smart terminal on the smart glasses in the form of voice, enriching the functions of the smart glasses, improving the intelligence of the smart glasses, and providing users with convenience in reading instant messaging messages.

[0039] Alternatively, in another embodiment, the smart terminal 200 may be a smart mobile terminal such as a smartphone, or a smart wearable device such as a smartwatch. The smart terminal 200 includes a processor and a memory, wherein the memory is provided with a mobile application (Mobile app) and an instant messaging application (Instant Message app). The user can use the processor to call the mobile application to control the wireless connection between the smart terminal and the smart glasses, such as connection via Bluetooth, Wi-Fi, mobile communication, etc.; call the mobile application to set the method for playing instant messaging messages on the smart glasses, such as turning on or off the instant messaging function of the smart glasses, and the method for playing instant messaging messages on the smart glasses.

[0040] Referring to Figures 2 and 3, Figure 2 is a schematic diagram of the structure of the smart glasses provided in one embodiment of the present application, and Figure 3 is a schematic diagram of the module structure of the smart glasses. It should be noted that the schematic diagram of the structure of the smart glasses in Figure 2 is only an example, and the various components such as the processor, memory, input device, playback device and microphone can be set as needed and are not limited by the positions shown in the figure. For ease of explanation, only the parts related to the embodiment of the present application are shown. The smart glasses 100 may include: a front frame 10 and temples 20 connected to the front frame 10, and the front frame 10 may be inlaid with lenses 30;

[0041] The front frame 10 and the temples 20 may be detachably connected or fixedly connected;

[0042] A processor 21, a communication module 22, a playback device 23 and a memory 24 are provided in the front frame 10 and / or the temple 20;

[0043] The communication module 22 is used to communicate with a smart terminal having a communication module with the same function. The communication module 22 includes: a Bluetooth module;

[0044] The communication module 22 may further include a WIFI module and a mobile communication module.

[0045] The playback device 23 may be a speaker, which may be a single speaker or multiple speakers. In the present application, a pair of speakers is preferably provided on the left and right temples respectively.

[0046] The processor 21 is connected to the communication module 22, the playback device 23 and the memory 24;

[0047] The processor 21 is further configured to convert the instant messaging message from text format to voice format via a built-in text-to-speech engine, and control the playback device 23 to play the instant messaging message in the voice format.

[0048] The processor 21 includes a CPU (Central Processing Unit), or may include a CPU and a DSP (Digital Signal Processing Unit). The DSP is used to process audio signals and is connected to and controlled by the CPU.

[0049] The smart glasses 100 may also be provided with an input device 25 , a microphone 26 , and a battery 27 ;

[0050] The input device 25 may be a button or a touch sensor for obtaining an operation applied by a user;

[0051] The microphone 26 is used to collect sound;

[0052] The battery 27 provides power for the smart glasses.

[0053] In another embodiment, the smart terminal 200 is also used to set the playback mode of the smart glasses 100 for playing instant messaging messages. The playback mode includes: one or any combination of playback content, playback duration, playback order, and playback language. That is, one of the playback modes can be set, or any two or more can be set.

[0054] In another embodiment, the smart terminal 200 can configure the smart glasses 100 to enable or disable the function of playing instant messaging messages. Referring to FIG4 , FIG4 shows an interactive interface for running a mobile application on the smart terminal 200. A button, Whisper Messages, is provided on the interactive interface for enabling or disabling the function of playing instant messaging messages. By clicking or sliding the button, the function of playing instant messaging messages can be enabled or disabled. When the function of playing instant messaging messages is disabled, the smart glasses 100 refuse to receive push information of the instant messaging message sent by the smart terminal 200, or do not play the instant messaging message after receiving the push information of the instant voice message. When the function of playing instant messaging messages is enabled, the smart glasses 100 receive the push information and play the instant messaging message in voice form.

[0055] In another embodiment, the smart terminal 200 is used to configure the smart glasses 100 to play instant messaging messages of a designated instant messaging application and a designated sender.

[0056] Specifically, the user can define a favorites list through the mobile application of the smart terminal 200, set several instant messaging users in the favorites list, and enable the playback of received instant messaging messages through voice broadcast of the smart glasses for these instant messaging users.

[0057] For example, according to the user's setting instructions, the smart terminal 200 enables the voice instant messaging function for an instant messaging user named S in the A instant messaging application. Then the smart glasses 100 play the instant messaging messages received from S from the A instant messaging application, but will not play the instant messaging messages sent by others except S from the A instant messaging application or other instant messaging applications except A.

[0058] It can be set to correspond to different senders in different time periods. For example, the designated senders during working hours are company colleagues or company group messages, and the designated senders during non-working hours are family messages.

[0059] You can also set the priority of the designated sender. The designated sender can send messages at any time without time restrictions.

[0060] In another embodiment, the smart terminal 200 is used to set the smart glasses 100 to play the instant messaging message.

[0061] Among them, the sender of the instant messaging message (that is, the instant messaging user); the identity identifier includes name, number, etc.

[0062] Specifically, the smart terminal 200 sets the smart glasses 100 to play the sender's name, or play the sender's name and the name of the application, or play the sender's name and the message content, or play the sender's name, the name of the application and the message content.

[0063] In another embodiment, the smart terminal 200 can also be used to set the correspondence between the time when the push information of the instant messaging message is received and the item of the instant messaging message played by the smart glasses 100, so that the smart glasses 200 play the item of the instant messaging message according to the time when the push information of the current instant messaging message is received.

[0064] Specifically, you can set multiple time periods, such as the working time period on weekdays (9:00 AM to 6:00 PM), the leisure time period on weekdays (6:00 PM to 10:00 PM), and the entire day during holidays (9:00 AM to 10:00 PM). For push notifications of instant messaging messages received during the working time period, the sender's name or message content will be played. For push notifications of instant messaging messages received during leisure time periods, the sender's name and message content will be played. For push notifications of instant messaging messages received on holidays, the sender's name, application name, and message content will be played. The above are just examples, and users can set content based on their own habits or needs without being limited to the above examples.

[0065] In another embodiment, the smart terminal 200 is further configured to set multiple languages ​​for the smart glasses 100 to play instant messaging messages, so that the smart glasses 100 can play instant messaging message items in the multiple languages ​​that are set.

[0066] The multiple languages ​​may be English, Chinese, French, etc. The sender's name, application name, and message content in the instant messaging message may be played in a mixed manner using different languages, for example, the sender's name may be played in Chinese, and the message content may be played in English.

[0067] You can also set the language for playing instant messaging messages to be unified into one.

[0068] In another embodiment, the smart terminal 200 is further used to set the time length or the number of characters for the smart glasses 100 to play the instant messaging message, so that the smart glasses 100 play the instant messaging message according to the time length or the number of characters, and stop playing the instant messaging message when the playing of the instant messaging message reaches the set time length or the number of characters.

[0069] In another embodiment, the smart terminal 200 is further used to, if the smart glasses 100 continuously obtain multiple instant messaging messages sent by the same instant messaging user within a preset time period, set the playback item of the first instant messaging message obtained to include the sender identity identifier, and set the playback items of each instant messaging message starting from the second instant messaging message to not include the sender identity identifier, that is, the playback item of the first instant messaging message obtained includes the sender identity identifier, and the playback items of each instant messaging message starting from the second instant messaging message do not include the sender identity identifier.

[0070] Specifically, the preset duration can be set to 60 seconds. If multiple instant messaging messages are received from the same instant messaging user within 60 seconds, the first instant messaging message can play the sender's name, application name and message content. Starting from the second instant messaging message, until the last instant messaging message received within 60 seconds, only the message content is played without playing the sender's name, which can save playback time and power.

[0071] In another embodiment, the smart terminal 200 can also be set to start from the second instant messaging message and only play the message content if the smart glasses 100 continuously receive instant messaging messages from the same instant messaging user within an interval or continuous time, that is, instant messaging messages from the same person that do not exceed the interval or are within the continuous time.

[0072] In another embodiment, the smart terminal 200 is used to set the sender identity of the instant messaging message played by the smart glasses 100, obtain the name of the application, and the message content. For example, the played voice is "You have X message from C: Are you free to have dinner together tonight?

[0073] Furthermore, in another embodiment, an input device 25 is provided in the front frame and / or the temples of the smart glasses;

[0074] The smart terminal 200 is also used to set the smart glasses 100 to stop playing or skip playing the instant messaging message in response to an action input through the input device 25 when playing the instant messaging message. Skipping the instant messaging message means stopping playing the current instant messaging message and starting playing the next instant messaging message.

[0075] Referring to FIG5 , FIG5 shows a setting interface for the smart terminal 200 to play instant messaging messages on the smart glasses 100. The switch buttons configured on this setting interface include, but are not limited to: buttons for configuring the smart glasses 100 to play instant messaging messages corresponding to designated instant messaging applications (see FIG5 for LINE, Messages, Facebook Messenger, Signal, Microsoft Teams, Telegram, WeChat, and WhatsApp); a switch button for configuring a Favorite List for the smart glasses 100 to play a favorites list, wherein a number of instant messaging users are configured in the Favorites List and the smart glasses are enabled to play received instant messaging messages via voice broadcast for these users; a button for configuring the length of instant voice messages played by the smart glasses 100, a button for configuring the content of the messages played, and a switch button for configuring the Tap on frames to stop reading, which is used to stop playing instant messaging messages via an input device 25. Other switch buttons may also be configured on this setting interface. FIG5 is merely an example and does not limit the number and type of switch buttons that can be configured.

[0076] Refer to Figure 6, which is a specific interface for the smart terminal 200 to set the favorites list played by the smart glasses 100. The switch button is Enable Favorite List. In this interface, you can also set the instant messaging users in the favorites list, such as Sam Yu as shown in Figure 6. When you turn on the switch button, the smart glasses 100 can play instant messaging messages from instant messaging users in the favorites list in voice form.

[0077] Furthermore, in another embodiment, the smart terminal 200 is further configured to configure the smart glasses 100 to disable or enable automatic adjustment of the volume of the instant messaging message according to the detected ambient noise result.

[0078] Enable automatic adjustment of the volume of the instant messaging message according to the detected environmental noise result. The smart terminal 200 obtains the sound of the surrounding environment and performs environmental noise detection based on the sound. The volume of the instant messaging message played by the speaker is automatically adjusted according to the detected environmental noise result.

[0079] Specifically, if the ambient noise is greater than a preset noise value, the smart glasses 100 increase the volume of the instant messaging message; if the ambient noise is less than the preset noise value, the smart glasses 100 reduce the volume of the instant messaging message.

[0080] Automatically adjusting the volume of the instant messaging message according to the detected environmental noise result is disabled, and the smart terminal 200 does not adjust the volume of the instant messaging message played by the speaker according to the detected environmental noise result.

[0081] Furthermore, in another embodiment, the smart terminal 200 is used to set the smart glasses 100 to disable or enable playing all or part of the instant messaging message by voice.

[0082] For example, the smart terminal 200 sets the smart glasses 100 to enable the voice playback function of instant messaging application A and instant messaging application B, and disables the voice playback function of instant messaging application C. Then, the smart glasses 100 can play the instant messaging messages from instant messaging application A and instant messaging application B sent by the smart terminal 200 in voice form, but not play the instant messaging messages from instant messaging application C sent by the smart terminal 200.

[0083] Furthermore, in another embodiment, the smart glasses 100 include a light-emitting device, such as an LED (light-emitting diode) and its surrounding circuitry. The light emitted by the light-emitting device can be captured by the wearer's eyes. For example, the light-emitting device can be located at the connection between the frame and temples of the smart glasses 100, such as at the hinge.

[0084] The smart terminal 200 is also used to set the smart glasses 100 to not play the instant messaging message when receiving the push information of the instant messaging message when it is in the do not disturb mode, but to emit a light signal through the light-emitting device to notify the user that the instant messaging message has been received, and to automatically play the instant messaging message when the smart glasses 100 release the do not disturb mode.

[0085] The do not disturb mode may include a meeting mode and a rest mode, etc. When the user is in the do not disturb mode, he does not want the smart glasses 100 to automatically play the instant messaging messages sent by the smart terminal 200.

[0086] The user can control the smart glasses to be in or release the do not disturb mode by setting the do not disturb time of the do not disturb mode on the smart terminal 200. The user can also set the entry gesture and release gesture of the do not disturb mode on the smart terminal 200, and enter the do not disturb mode when the smart glasses 100 detect the user's entry gesture, and release the do not disturb mode when the smart glasses 100 detect the user's release gesture.

[0087] The light signal may be a light flashing signal, and the flashing frequency may be set by the user through the smart terminal 200 .

[0088] Furthermore, in another embodiment, the smart terminal 200 is also used to translate the instant messaging message into a text format message in the local language through the built-in translation engine, and convert the text format message into a voice format message through the built-in text-to-speech engine, and send the push information of the voice format message to the smart glasses 100, so that the smart glasses 100 play the voice format message through the playback device 23.

[0089] Alternatively, the smart terminal 200 is further configured to translate the instant messaging message into a voice format message in the local language through a third-party translation engine, and send push information of the voice format message to the smart glasses 100, so that the smart glasses 100 play the voice format message through the playback device 23.

[0090] Voice-formatted messages may include messages in Mandarin, Cantonese, English, and Japanese. Messages converted to Mandarin voice format correspond to Simplified Chinese text, messages converted to Cantonese voice format correspond to Traditional Chinese text, messages converted to English voice format correspond to English text, and messages converted to Japanese voice format correspond to Japanese text.

[0091] The instant messaging message is translated into the text format of the local language through a built-in translation engine, and then the text format of the local language is translated into the voice format of the local language through a text-to-speech engine.

[0092] Alternatively, the instant messaging message is directly translated into the voice format of the local language through a third-party translation engine.

[0093] As an example, see Figure 7 , which illustrates the process of playing an instant messaging message received by a smart terminal 200 on smart glasses 100. When an IM app receives an instant messaging message, the smart terminal 200 (a smartphone or smartwatch is used as an example in Figure 8 ) sends a push notification of the received instant messaging message to the smart glasses 100 via Bluetooth. The push notification includes information about the instant messaging message, such as the name of the sender, the name of the IM app, and the message content. Upon receiving the push notification, the smart glasses 100 convert the text-to-speech (TTS) message into speech format using their internal text-to-speech engine. The name, IM app name, and message content are then played back via the left and right stereo speakers.

[0094] Referring to Figure 8, an embodiment of the present application also provides a pair of smart glasses that are connected to an instant messaging server and transmit data to each other. The smart glasses may be the smart glasses 100 shown in Figures 1 to 3 above, and the instant messaging server may be the instant messaging server 300 shown in Figure 1 above.

[0095] The smart glasses 100 are connected to the instant messaging server 300 via a wireless network, which includes Bluetooth, WIFI, and mobile communication networks such as 4G or 5G, preferably WIFI or mobile communication networks.

[0096] Specifically, the smart glasses 100 are provided with the instant messaging application;

[0097] The instant messaging server 300 is provided with a module corresponding to the instant messaging application, which is used to obtain instant messaging messages sent by users and send them to the instant messaging application in the smart glasses 100 to implement the functions of each instant messaging application.

[0098] The smart glasses 100 are used to obtain push information of the instant messaging message from the instant messaging server 300 through the instant messaging application, and play the instant messaging message in voice form according to the push information, and the push information includes each item in the instant messaging message.

[0099] The smart glasses 100 may also be provided with a translation engine, which is used to convert the instant communication message in the non-native language into an instant communication message in the local language.

[0100] The smart glasses 100 can also call a third-party translation engine to convert the instant messaging message in the non-native language into the instant messaging message in the local language. The third-party translation engine can be set on the smart terminal 200 or the instant messaging server 300.

[0101] The smart glasses 100 may also be provided with a text-to-speech engine, through which the smart glasses 100 convert the received push information from text format to voice format, and play the items of the instant messaging message in the voice format. The items played are pre-set by the instant messaging server 300, thereby playing the items in the instant messaging message in the form of voice.

[0102] The items of the instant messaging message include, but are not limited to: the identity of the sender of the instant messaging message, the name of the instant messaging application that obtains the instant messaging message, and the message content of the instant messaging message. The push information includes the above items.

[0103] The smart glasses 100 are used to obtain push information of the instant communication message sent by the instant communication server 300, and play the instant communication message in voice form according to the push information.

[0104] In an embodiment of the present application, the smart glasses are connected to an instant messaging server, and the smart glasses obtain push information of instant messaging messages sent by the instant messaging server, and play the instant messaging messages in the form of voice based on the push information, thereby realizing voice playback of instant messaging messages on the smart glasses, enriching the functions of the smart glasses, improving the intelligence of the smart glasses, and providing users with convenience in reading instant messaging messages.

[0105] In another embodiment, the instant communication server 300 sets the playback mode of the instant communication message on the smart glasses 100, and the smart glasses 100 are used to play the instant communication message according to the playback mode set by the instant communication server 300, and the playback mode includes: one or any combination of playback content, playback duration, playback order and playback language.

[0106] Playing content refers to playing items in the instant messaging message, including but not limited to: the sender's ID of the instant messaging message, the name of the instant messaging application that retrieved the instant messaging message, and the message content of the instant messaging message. Based on the settings of the instant messaging server 300, the smart glasses 100 can play one or any combination of the sender's ID of the instant messaging message, the name of the instant messaging application corresponding to the instant messaging message, and the message content of the instant messaging message.

[0107] The playing time refers to the playing time of the instant messaging message, for example, playing for 5 seconds, playing half of the instant messaging message, or playing until 5 seconds before the end of the instant messaging message.

[0108] The play order refers to the play order when multiple instant messaging messages are received, for example, playing the instant messaging message received first, or giving priority to playing the most recently received instant messaging message.

[0109] The playback order refers to the language used when playing instant messaging messages, for example, Chinese, English, or French.

[0110] In another embodiment, the instant messaging server 300 configures the smart glasses 100 to play instant messaging messages of a specified instant messaging application and a specified sender, and the smart glasses 100 are used to play instant messaging messages of the specified instant messaging application and the specified sender through the playback device 23 according to the settings of the instant messaging server 300.

[0111] In another embodiment, the instant communication server 300 sets the smart glasses 100 to play the instant communication message in multiple languages, and the smart glasses 100 play the items of the instant communication message respectively according to the multiple languages ​​set by the instant communication server 300.

[0112] Specifically, the memory 24 stores translation engines for multiple languages, and the processor 21 can call these translation engines to translate the specified content into the corresponding language. The multiple languages ​​can be English, Chinese, French, etc. The processor 21 controls the playback device 23 to play the sender's name, application name, and message content of the instant messaging message in the set language. That is, the sender's name, application name, and message content can be played in a mixture of different languages, for example, the sender's name can be played in Chinese and the message content can be played in English.

[0113] In another embodiment, the instant messaging server 300 sets a time length or a number of characters for the smart glasses 100 to play the instant messaging message. The smart glasses 100 plays the instant messaging message for the time length or the number of characters according to the setting of the instant messaging server 300. When the playing time length or the number of characters of the instant messaging message reaches the set time length or the number of characters, the smart glasses 100 stop playing the instant messaging message.

[0114] In another embodiment, the instant messaging server 300 is configured to include the sender's identity in the playback item of the first instant messaging message obtained, and to exclude the sender's identity from the playback items of each instant messaging message starting from the second instant messaging message, if the smart glasses 100 continuously obtain multiple instant messaging messages sent by the same instant messaging user within a preset time period. The smart glasses 100 are further configured to, in accordance with the settings of the instant messaging server 300, include the sender's identity in the playback item of the first instant messaging message obtained, and exclude the sender's identity from the playback items of each instant messaging message starting from the second instant messaging message, and only play the message content in the playback item.

[0115] Specifically, the input device 25 may be a button or a touch sensor;

[0116] The button or touch sensor can be set in the front frame and / or the temple. The instant communication server 300 sets the smart glasses 100 to stop playing or skip playing the instant communication message in response to an action input through the input device 25 of the smart glasses 100 when playing the instant communication message. The smart glasses 100 is used to control the speaker to stop playing or skip playing the instant communication message in response to the input action sensed by the button when the speaker plays the instant communication message.

[0117] The input action may be a click, a touch, or a slide.

[0118] The input device 25 can also be a touch sensor, which is arranged in the temple. The smart glasses 100 are also used to increase or decrease the volume when the speaker plays an instant messaging message by sensing a gesture of sliding on the temple toward the user's ear, or to decrease or increase the volume by sensing a gesture of sliding on the temple away from the user's ear.

[0119] Furthermore, in another embodiment, the smart glasses 100 further include a microphone 26 disposed in the front frame and / or the temples;

[0120] The instant messaging server 300 sets the smart glasses 100 to disable or enable automatic adjustment of the volume of the instant messaging message according to the detected environmental noise results. The smart glasses 100 are also used to obtain the sound of the surrounding environment through the microphone 26, and perform environmental noise detection based on the sound, and automatically adjust the volume of the speaker playing the instant messaging message according to the detected environmental noise results.

[0121] Specifically, if the ambient noise is greater than a preset noise value, the smart glasses 100 increase the volume of the instant messaging message; if the ambient noise is less than the preset noise value, the smart glasses 100 reduce the volume of the instant messaging message.

[0122] Furthermore, in another embodiment, the instant communication server 300 configures the smart glasses 100 to disable or enable the playback of all or part of the instant communication messages obtained by the instant communication application through voice, and the smart glasses 100 are also used to disable or enable the playback of all or part of the instant communication messages obtained by the instant communication application through voice according to the settings of the instant communication server 300.

[0123] Furthermore, in another embodiment, the smart glasses 100 are also used to, according to the settings of the instant messaging server 300, when in the do not disturb mode, receive the push information of the instant messaging message, not play the instant messaging message, but instead emit a light signal through the light-emitting device to notify the user that the instant messaging message has been received, and automatically play the instant messaging message when the smart glasses 100 release the do not disturb mode.

[0124] The user can control the smart glasses to be in or release the do not disturb mode by setting the do not disturb time of the do not disturb mode on the instant messaging server 300. The user can also set the entry gesture and release gesture of the do not disturb mode on the instant messaging server 300, and enter the do not disturb mode when the smart glasses 100 detects the user's entry gesture, and release the do not disturb mode when the smart glasses 100 detects the user's release gesture.

[0125] The light signal may be a light flashing signal, and the flashing frequency may be set by the user through the instant messaging server 300 .

[0126] Furthermore, in another embodiment, the smart glasses 100 are used to translate the instant messaging message into a text format message in the local language through a built-in translation engine, and convert the text format message into a voice format message through a built-in text-to-speech engine, and play the voice format message.

[0127] The smart glasses 100 are further configured to translate the instant messaging message into a voice format message in a local language through a third-party translation engine, and obtain and play the voice format message.

[0128] In this embodiment, the smart glasses implement the setting of voice playback of instant messaging messages according to the setting of the instant messaging server, further enriching the functions, improving the intelligence, and providing convenience for users.

[0129] 9 , an embodiment of the present application further provides an instant messaging message playback method, which can be applied to the smart glasses system in the above embodiment. The smart terminal of the smart glasses system obtains an instant messaging message through an instant messaging application, and sends a push message of the instant messaging message to the smart glasses in the smart glasses system. The smart glasses play the instant messaging message in voice form according to the push message. The method includes the following steps:

[0130] S801. The smart terminal obtains an instant messaging message;

[0131] S802: The smart terminal sends push information of the instant messaging message to the smart glasses;

[0132] S803: The smart glasses play the instant messaging message in voice form according to the push information.

[0133] For the specific contents of the embodiments of this application, please refer to the description of the aforementioned embodiments.

[0134] In an embodiment of the present application, the smart glasses are connected to a smart terminal, the smart terminal obtains instant messaging messages, and sends push information of the instant messaging messages to the smart glasses. The smart glasses play the instant messaging messages in voice form based on the push information, thereby realizing the use of voice to play the instant messaging messages received by the smart terminal on the smart glasses, enriching the functions of the smart glasses, improving the intelligence of the smart glasses, and providing users with convenience in reading instant messaging messages.

[0135] Furthermore, in another embodiment, before step S803, the method further includes: the smart terminal setting a playback mode for the smart glasses to play the instant messaging message, the playback mode including: one or any combination of playback content, playback duration, playback order, and playback language.

[0136] Furthermore, in another embodiment, the smart terminal sets the smart glasses to play the instant messaging message in a manner that includes: the smart terminal sets the smart glasses to play the instant messaging message of a designated instant messaging application and a designated sender.

[0137] Furthermore, in another embodiment, the smart terminal sets the smart glasses to play the instant messaging message in a manner that includes: the smart terminal sets the smart glasses to play the instant messaging message item.

[0138] Furthermore, in another embodiment, the smart terminal sets the smart glasses to play the instant messaging message in multiple languages, so that the smart glasses play the items in the instant messaging message respectively in the set multiple languages.

[0139] Furthermore, in another embodiment, the smart terminal sets the playback method of the smart glasses to play the instant messaging message, including: the smart terminal sets the playback time or number of characters for the smart glasses to play the instant messaging message, so that the smart glasses play the instant messaging message according to the playback time or the number of characters.

[0140] Furthermore, in another embodiment, the smart terminal sets the smart glasses to play the instant messaging message in a manner including: if the smart glasses continuously obtain multiple instant messaging messages sent by the same instant messaging user within a preset time period, the smart terminal sets the playback item of the first instant messaging message obtained to include the sender's identity identifier, and sets the playback items of each instant messaging message starting from the second instant messaging message not to include the sender's identity identifier.

[0141] Furthermore, in another embodiment, the smart terminal sets the smart glasses to play the instant messaging message in a manner that includes: an input device is provided in the front frame and / or the temple of the smart glasses;

[0142] The smart terminal configures the smart glasses to stop playing or skip playing the instant messaging message in response to an action input through the input device of the smart glasses when playing the instant messaging message.

[0143] Furthermore, in another embodiment, the smart terminal sets the smart glasses to play the instant messaging message in a manner that includes: the smart terminal sets the smart glasses to disable or enable automatic adjustment of the volume of the instant messaging message according to the detected ambient noise result.

[0144] Furthermore, in another embodiment, the smart terminal sets the smart glasses to play the instant messaging message in a manner including: the smart terminal sets the smart glasses to disable or enable voice playback of all or part of the instant messaging message corresponding to the instant messaging application.

[0145] Furthermore, in another embodiment, the method also includes: the smart terminal is also used to set the smart glasses to be in the do not disturb mode and receive the push information of the instant messaging message, then notify the user through a light signal, and play the instant messaging message corresponding to the push message when exiting the do not disturb mode.

[0146] Furthermore, in another embodiment, the method also includes: the smart terminal translates the instant messaging message into a text format message in the local language through a built-in translation engine, converts the text format message into a voice format message through a built-in text-to-speech engine, and sends the voice format message to the smart glasses for playback.

[0147] Alternatively, the smart terminal translates the instant messaging message into a voice format message in the local language through a third-party translation engine, and the smart terminal obtains and plays the voice format message.

[0148] It should be noted that for the aforementioned method embodiments, for ease of description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that this application is not limited by the order of the actions described, because according to this application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in this specification are all preferred embodiments, and the actions and modules involved are not necessarily required by this application.

[0149] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0150] The above is a description of the smart glasses system, smart glasses, and instant messaging message playback method provided by this application. For those skilled in the art, based on the ideas of the embodiments of this application, there may be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as limiting this application.

Claims

1. A smart glasses system, characterized in that: The smart glasses system comprises: Smart glasses and a smart terminal connected to the smart glasses; The smart terminal is used to obtain instant messaging messages and send push information of the instant messaging messages to the smart glasses; The smart glasses are used to play the instant messaging message in voice form according to the push information.

2. The smart glasses system according to claim 1, characterized in that: The smart terminal is further used to set a playback mode for the smart glasses to play the instant messaging message, and the playback mode includes: one or any combination of playback content, playback duration, playback order, and playback language.

3. The smart glasses system according to claim 2, characterized in that: The smart terminal is also used to set the smart glasses to play instant messaging messages of a designated instant messaging application and a designated sender.

4. The smart glasses system according to claim 2, characterized in that: The smart terminal is also used to set the item for the smart glasses to play the instant messaging message.

5. The smart glasses system according to claim 2, characterized in that: The smart terminal is further used to set the smart glasses to play the instant communication message in multiple languages, so that the smart glasses can play the items in the instant communication message respectively in the set multiple languages.

6. The smart glasses system according to claim 2, characterized in that: The smart terminal is further used to set the playback time or the number of characters played by the smart glasses for the instant communication message, so that the smart glasses play the instant communication message according to the playback time or the number of characters.

7. The smart glasses system according to claim 2, characterized in that: The smart terminal is also used to set the playback item of the first instant messaging message obtained to include the sender's identity identifier, and set the playback items of each instant messaging message starting from the second instant messaging message not to include the sender's identity identifier, if the smart glasses continuously obtain multiple instant messaging messages sent by the same instant messaging user within a preset time period.

8. The smart glasses system according to claim 2, characterized in that: An input device is provided in the front frame and / or the temples of the smart glasses; The smart terminal is further used to set the smart glasses to stop playing or skip playing the instant communication message in response to an action input through the input device of the smart glasses when playing the instant communication message.

9. The smart glasses system according to claim 2, characterized in that: The smart terminal is further used to set the smart glasses to disable or enable automatic adjustment of the volume of playing the instant messaging message according to the detected environmental noise result.

10. The smart glasses system according to claim 2, characterized in that: The smart terminal is further used to set the smart glasses to disable or enable playing all or part of the instant messaging messages corresponding to the instant messaging application program through voice.

11. The smart glasses system according to claim 1, characterized in that: The smart terminal is also used to set the smart glasses to receive the push information when they are in the do not disturb mode, notify the user through a light signal, and play the instant communication message when exiting the do not disturb mode.

12. The smart glasses system according to claim 1, characterized in that: The smart terminal is also used to translate the instant messaging message into a text format message in the local language through a built-in translation engine, and convert the text format message into a voice format message through a built-in text-to-speech engine, and send push information of the voice format message to the smart glasses so that the smart glasses play the voice format message.

13. The smart glasses system according to claim 1, characterized in that: The smart terminal is also used to translate the instant messaging message into a voice format message in a local language through a third-party translation engine, and send push information of the voice format message to the smart glasses so that the smart glasses play the voice format message.

14. A pair of smart glasses connected to an instant messaging server, characterized in that: The smart glasses are used to obtain push information of instant messaging messages sent by the instant messaging server; The smart glasses are further used to play the instant communication message in voice form according to the push information.

15. The smart glasses according to claim 14, characterized in that: The smart glasses are further used to play the instant messaging message in a playing mode set by the instant messaging server, wherein the playing mode includes: one or any combination of playing content, playing duration, playing order and playing language.

16. The smart glasses according to claim 15, characterized in that: The smart glasses include: a front frame and temples connected to the front frame; An input device, a playback device and a microphone are arranged in the front frame and / or the temples.

17. The smart glasses according to claim 15, characterized in that: The smart glasses are used to play the instant messaging messages of the designated instant messaging application and the designated sender through the playing device according to the settings of the instant messaging server.

18. The smart glasses according to claim 15, characterized in that: The smart glasses are also used to play the items in the instant communication message respectively according to the multiple languages ​​set by the instant communication server.

19. The smart glasses according to claim 15, characterized in that: The smart glasses are further used to play the instant communication message according to the playing time or the number of characters set by the instant communication server.

20. The smart glasses according to claim 15, characterized in that: The smart glasses are also used to, in accordance with the settings of the instant messaging server, include the sender's identity identifier in the playback item of the first instant messaging message obtained if multiple instant messaging messages sent by the same instant messaging user are continuously obtained within a preset time period, and do not include the sender's identity identifier in the playback items of each instant messaging message starting from the second instant messaging message.

21. The smart glasses according to claim 16, characterized in that: The input device includes a button; The smart glasses are further used to control the speaker to stop playing or skip playing the instant communication message in response to an input action sensed on the button when playing the instant communication message.

22. The smart glasses according to claim 16, characterized in that: The input device includes a touch sensor disposed on the temple; The smart glasses are also used to increase or decrease the playback volume of the speaker when playing the instant messaging message through a gesture of sliding on the temple toward the user's ear sensed by the touch sensor, or to decrease or increase the playback volume of the speaker by a gesture of sliding on the temple away from the user's ear sensed by the touch sensor.

23. The smart glasses according to claim 16, characterized in that: The smart glasses are also used to obtain ambient sounds through the microphone according to the settings of the instant messaging server and perform environmental noise detection based on the sounds, and automatically adjust the volume of playing the instant messaging message according to the detected environmental noise results.

24. The smart glasses according to claim 15, characterized in that: The smart glasses are also used to disable or enable voice playback of all or part of the instant messaging messages obtained by the instant messaging application according to the settings of the instant messaging server.

25. The smart glasses system according to claim 14, characterized in that: The smart glasses are also used to notify the user through a light signal when receiving the push information when in the do not disturb mode according to the settings of the instant communication server, and play the instant communication message when exiting the do not disturb mode.

26. The smart glasses according to claim 14, characterized in that: The smart glasses are also used to translate the instant messaging message into a text format message in a local language through a built-in translation engine, and to convert the text format message into a voice format message through a built-in text-to-speech engine, and to play the voice format message.

27. The smart glasses according to claim 14, characterized in that: The smart glasses are also used to translate the instant messaging message into a voice format message in a local language through a third-party translation engine, and to obtain and play the voice format message.

28. An instant messaging message playing method, applied to a smart glasses system, characterized in that: The smart glasses system comprises: smart glasses and a smart terminal connected to the smart glasses, and the method comprises: The smart terminal obtains the instant communication message, and sends push information of the instant communication message to the smart glasses; The smart glasses play the instant messaging message in voice form according to the push information.

29. The method according to claim 28, characterized in that Before the smart glasses play the instant communication message in voice form according to the push information, the process includes: The smart terminal sets a playing mode for the smart glasses to play the instant messaging message, and the playing mode includes: one or any combination of playing content, playing duration, playing order, and playing language.

30. The method according to claim 29, characterized in that The smart terminal sets the smart glasses to play the instant messaging message in a manner that includes: The smart terminal configures the smart glasses to play instant messaging messages of a designated instant messaging application and a designated sender.

31. The method according to claim 29, characterized in that The smart terminal sets the smart glasses to play the instant messaging message in a manner that includes: If the smart glasses continuously obtain multiple instant messaging messages sent by the same instant messaging user within a preset time period, the smart terminal is set to include the sender's identity identifier in the playback item of the first instant messaging message obtained, and the sender's identity identifier is not included in the playback items of each instant messaging message starting from the second instant messaging message.

Images