Instant messaging method, device and system, electronic equipment and storage medium

Abstract

The invention relates to an instant messaging method, device and system, electronic equipment and a storage medium. The instant messaging method is applied to a first device and comprises the steps that in a first communication mode, first instant messaging information is converted into second instant messaging information, the first instant messaging information is one of voice information and text information, and the second instant messaging information is the other one of the voice information and the text information; and performing instant voice communication with the second equipment based on the second instant communication information. The instant messaging method can realize barrier-free transmission of communication information between two communication parties, help barrier-free people to perform high-efficiency voice communication with ordinary people, and improve the use experience of the barrier-free people on electronic equipment.

Description

Technical Field

[0001] The present disclosure relates to the field of communication technology, and in particular to an instant communication method, device, system, electronic device and storage medium. Background Art

[0002] With the rapid development of mobile Internet technology, various electronic products are emerging, and Internet products such as operating systems and applications of electronic devices have also become more colorful. However, more and more product functions ignore the user experience of people with disabilities. For the basic instant messaging (IM) functions in electronic products, such as voice calls, video calls, online meetings, etc., people with disabilities cannot keep up with ordinary people. Therefore, how to enable people with disabilities to communicate with ordinary people in voice in IM calls is an urgent problem to be solved. Summary of the invention

[0003] In order to overcome the problems existing in the related art, the present disclosure provides an instant messaging method, device, system, electronic device and storage medium.

[0004] According to a first aspect of an embodiment of the present disclosure, there is provided an instant messaging method, which is applied to a first device, and the method includes:

[0005] In a first communication mode, converting a first instant communication message into a second instant communication message, wherein the first instant communication message is one of a voice message and a text message, and the second instant communication message is the other of the voice message and the text message;

[0006] Based on the second instant communication information, instant voice communication is performed with the second device.

[0007] In an exemplary embodiment, the first instant communication message is the voice message, and the second instant communication message is the text message;

[0008] The converting the first instant communication information into the second instant communication information includes:

[0009] receiving and recording the voice information sent by the second device;

[0010] The voice information is recognized as the text information through a preset voice recognition algorithm.

[0011] In an exemplary embodiment, performing instant voice communication with a second device based on the second instant communication information includes:

[0012] The text information is displayed on a preset interface.

[0013] In an exemplary embodiment, the preset interface is displayed in one of the following display modes:

[0014] Floating window display, small window display, full screen display.

[0015] In an exemplary embodiment, the first instant communication message is the text message, and the second instant communication message is the voice message;

[0016] The converting the first instant communication information into the second instant communication information includes:

[0017] Receiving the text information input by the user;

[0018] The text information is synthesized into the voice information by using a preset voice synthesis algorithm.

[0019] In an exemplary embodiment, performing instant voice communication with a second device based on the second instant communication information includes:

[0020] The voice information is sent to the second device.

[0021] In an exemplary embodiment, sending the voice information to the second device includes:

[0022] Acquire, through a preset interface, an input source of communication uplink data of the first device, wherein the input source is used to input the communication uplink data in a communication uplink;

[0023] Using the voice information as the communication uplink data, and inputting the voice information into the communication uplink through the input source;

[0024] The voice information is sent to the second device via the communication uplink.

[0025] In an exemplary embodiment, the method further comprises:

[0026] In the second communication mode, a communication mode switching instruction is received, and the second communication mode is switched to the first communication mode.

[0027] According to a second aspect of an embodiment of the present disclosure, there is provided an instant messaging system, which is applied to a first device, and the system includes:

[0028] The service module is configured to convert a first instant communication message into a second instant communication message in a first communication mode, wherein the first instant communication message is one of a voice message and a text message, and the second instant communication message is the other of the voice message and the text message; and perform instant voice communication with a second device based on the second instant communication message.

[0029] In an exemplary embodiment, the first instant communication message is the voice message, and the second instant communication message is the text message;

[0030] The instant messaging system also includes:

[0031] an audio module, configured to receive and record the voice information sent by the second device;

[0032] The engine module is configured to recognize the voice information as the text information through a preset voice recognition algorithm.

[0033] In an exemplary embodiment, the service module is further configured to:

[0034] Sending a recording instruction to the audio module;

[0035] Receiving voice information sent by the audio module;

[0036] Sending the voice information to the engine module;

[0037] Receive the text information sent by the engine module.

[0038] In an exemplary embodiment, the instant messaging system further includes:

[0039] The display module is configured to display the text information on a preset interface.

[0040] In an exemplary embodiment, the display module is further configured to:

[0041] The preset interface is displayed in one of the following ways:

[0042] Floating window display, small window display, full screen display.

[0043] In an exemplary embodiment, the service module is further configured to:

[0044] The text information is sent to the display module.

[0045] In an exemplary embodiment, the first instant communication message is the text message, and the second instant communication message is the voice message;

[0046] The instant messaging system also includes:

[0047] A display module, configured to receive the text information input by the user;

[0048] The engine module is configured to synthesize the text information into the voice information through a preset voice synthesis algorithm.

[0049] In an exemplary embodiment, the service module is further configured to:

[0050] Receiving the text information sent by the display module;

[0051] Sending the text information to the engine module;

[0052] Receive the voice information sent by the engine module.

[0053] In an exemplary embodiment, the instant messaging system further includes:

[0054] The audio module is configured to send the voice information to the second device.

[0055] In an exemplary embodiment, the audio module is further configured to:

[0056] Acquire, through a preset interface, an input source of communication uplink data of the first device, wherein the input source is used to input the communication uplink data in a communication uplink;

[0057] Using the voice information as the communication uplink data, and inputting the voice information into the communication uplink through the input source;

[0058] The voice information is sent to the second device via the communication uplink.

[0059] In an exemplary embodiment, the service module is further configured to:

[0060] The voice information is sent to the audio module.

[0061] In an exemplary embodiment, the service module is further configured to:

[0062] In the second communication mode, a communication mode switching instruction is received, and the second communication mode is switched to the first communication mode.

[0063] According to a third aspect of an embodiment of the present disclosure, there is provided an instant messaging apparatus, applied to a first device, the apparatus comprising:

[0064] A first processing unit is configured to convert a first instant communication message into a second instant communication message in a first communication mode, wherein the first instant communication message is one of a voice message and a text message, and the second instant communication message is the other of the voice message and the text message;

[0065] The second processing unit is configured to perform instant voice communication with the second device based on the second instant communication information.

[0066] According to a fourth aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0067] processor;

[0068] a memory for storing processor-executable instructions;

[0069] The processor is configured to execute the method as described in the first aspect of the embodiment of the present disclosure.

[0070] According to a fifth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method described in the first aspect of the embodiment of the present disclosure.

[0071] The above method disclosed in the present invention has the following beneficial effects: it can realize barrier-free transmission of communication information between the communicating parties, help barrier-free people to communicate with ordinary people in voice efficiently, and enhance the user experience of barrier-free people in using electronic devices.

[0072] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0073] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0074] Figure 1 is a flow chart of an instant messaging method according to an exemplary embodiment;

[0075] Figure 2 is a flow chart of an instant messaging method according to an exemplary embodiment;

[0076] Figure 3 is a flow chart of an instant messaging method according to an exemplary embodiment;

[0077] Figure 4 is an interactive flow chart of an instant messaging method according to an exemplary embodiment;

[0078] Figure 5A is a schematic diagram of an instant messaging system according to an exemplary embodiment;

[0079] Figure 5B is an architecture diagram of an instant messaging system according to an exemplary embodiment;

[0080] Figure 6 is a block diagram of an instant messaging device according to an exemplary embodiment;

[0081] Figure 7 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0082] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0083] In an exemplary embodiment of the present disclosure, in order to overcome the instant communication needs of barrier-free people in the related art, an instant communication method is provided, which is applied to a first device, including: in a first communication mode, converting a first instant communication message into a second instant communication message, wherein the first instant communication message is one of a voice message and a text message, and the second instant communication message is the other of the voice message and the text message; based on the second instant communication message, performing instant voice communication with a second device. The method can realize barrier-free transmission of communication information between the two communicating parties, help barrier-free people to conduct efficient voice communication with ordinary people, and enhance the barrier-free people's experience of using electronic devices.

[0084] In an exemplary embodiment of the present disclosure, an instant messaging method is provided, which is applied to a first device, wherein the first device includes an electronic device with an instant voice communication function, such as a smart phone, a tablet, a laptop computer, a desktop computer, a smart wearable device, and a smart car system. Figure 1 is a flow chart of an instant messaging method according to an exemplary embodiment. Figure 1 As shown, the following steps are included:

[0085] Step S101, in a first communication mode, converting a first instant communication message into a second instant communication message, wherein the first instant communication message is one of a voice message and a text message, and the second instant communication message is the other of the voice message and the text message;

[0086] Step S102: Performing instant voice communication with the second device based on the second instant messaging information.

[0087] In step S101, the first communication mode represents a communication mode designed for barrier-free people, and the communication mode can be turned on or off in the system settings of the first device. In some possible implementations, in the second communication mode, a communication mode switching instruction is received, and the second communication mode is switched to the first communication mode. The second communication mode is the default communication mode. In the second communication mode, the communicating parties use communication information of the same information type for instant voice communication, that is, both communicating parties use voice information to communicate. The communication mode switching instruction can be a click operation to turn on the first communication mode, or it can be a voice instruction to turn on the first communication mode.

[0088] The first communication mode can be applicable to any voice call scenario, and can be applicable to instant communication scenarios using the voice call function and video call function that come with the operating system of the first device, such as instant communication scenarios using the mobile phone call function provided by the supplier of the first device; it can also be applicable to instant communication scenarios using the voice call function and video call function provided by a third-party application in the first device, such as instant communication scenarios of making voice calls and video calls through third-party social, online conferencing and other applications.

[0089] When performing instant messaging, instant messaging is achieved by transmitting communication information between the sending device and the receiving device. When the first device is the sending device, the first instant messaging information is the type of information that the sending user can enter, and the second instant messaging information is the type of information to be sent to the receiving user. For an instant voice call of a barrier-free person, the first instant messaging information is a text message, and the second instant messaging information is a voice message. When the first device is the receiving device, the first instant messaging information is the type of information sent by the sending user, and the second instant messaging information is the type of information that the receiving user can perceive. For an instant voice call of a barrier-free person, the first instant messaging information is a voice message, and the second instant messaging information is a text message.

[0090] In step S102, the second device is also an electronic device with an instant messaging function, and the device type of the second device may be the same as that of the first device, or may be different from that of the first device. Since the second instant messaging information is the type of information to be sent to the receiving user or the type of information that the receiving user can perceive, the communication information transmission between the sending user and the receiving user can be completed based on the second instant messaging information, that is, barrier-free instant voice communication between the first device and the second device can be achieved.

[0091] In an exemplary embodiment of the present disclosure, in a first communication mode, through conversion between the first instant communication information and the second instant communication information, barrier-free transmission of communication information between the communicating parties can be achieved, helping people without disabilities to conduct efficient voice communication with ordinary people, and improving the user experience of electronic devices for people without disabilities.

[0092] In an exemplary embodiment of the present disclosure, an instant messaging method is provided, which is applied to a first device. Figure 2 is a flow chart of an instant messaging method according to an exemplary embodiment. Figure 2 As shown, the following steps are included:

[0093] Step S201, in the first communication mode, receiving and recording a voice message sent by the second device;

[0094] Step S202, recognizing the voice information as text information through a preset voice recognition algorithm;

[0095] Step S203: display text information on a preset interface.

[0096] In step S201, in the first communication mode, the voice information is a voice message sent by the other party during the call. While receiving the voice information, the sound data sent by the second device is collected by calling the audio collection interface, such as calling the AudioRecord interface, that is, the voice information is recorded. Since recording the call voice information involves the issue of privacy terms, it is necessary to prompt the user whether to enable the call recording permission when the first communication mode is turned on. When the user turns on the recording permission, the first communication mode is entered.

[0097] In step S202, the preset speech recognition algorithm may be any algorithm capable of recognizing speech information as text information, such as an algorithm based on dynamic time warping, an algorithm based on a hidden Markov model of a parameter model, an algorithm based on a vector quantization of a non-parametric model, etc. The preset speech recognition algorithm is pre-stored in the memory of the first device, and when the recorded speech information is acquired, the speech information is input into the preset speech recognition algorithm, and text information corresponding to the speech information is output.

[0098] In step S203, the preset interface is an interface that can interact with the user in the first call mode. The size of the preset interface can be set according to actual needs. In some possible implementations, the preset interface is displayed in one of the following display modes: floating window display, small window display, and full screen display.

[0099] When the display mode is a floating window display or a small window display, for example, when the display is in subtitle mode, in order to facilitate the user to view at any time, the floating window or small window can be displayed by default on the top of all interfaces; in order not to block the content of the lower interface, the preset interface can be set to a non-background interface by default, and the text information can be displayed as transparent text by default. In some possible implementations, a display setting entry related to text information is provided to the user, and the user can set the display mode and display effect of the preset interface by himself through the display setting.

[0100] In an exemplary embodiment of the present disclosure, when the first device is the receiving device of a call, by converting voice information into text information and displaying it to the user, barrier-free people can easily know the content of the information sent by the other party of the call.

[0101] In an exemplary embodiment of the present disclosure, an instant messaging method is provided, which is applied to a first device. Figure 3 is a flow chart of an instant messaging method according to an exemplary embodiment. Figure 3 As shown, the following steps are included:

[0102] Step S301, in the first communication mode, receiving text information input by a user;

[0103] Step S302, synthesizing the text information into voice information by using a preset voice synthesis algorithm;

[0104] Step S303: Send voice information to the second device.

[0105] In step S301, in the first communication mode, the text message is the information content that the user wants to send to the other party of the call. An input interface for inputting text is provided for the user. The display mode of the input interface refers to the display mode of the preset interface for displaying text messages in the above embodiment. The user inputs the message content to be transmitted in the input interface, that is, the first device receives the text message input by the user.

[0106] In step S302, the preset speech synthesis algorithm may be any algorithm capable of synthesizing the content of speech information into text information, such as a signal processing algorithm, an algorithm based on a neural network, etc. The preset speech synthesis algorithm is pre-stored in the memory of the first device, and when the text information input by the user is obtained, the text information is input into the preset speech synthesis algorithm, and the speech information corresponding to the text information is output.

[0107] Step S303, playing the synthesized voice information during the call through the player, and sending the voice information to the second device to implement a voice call with the second device.

[0108] In some possible implementations, sending the voice information to the second device includes the following steps:

[0109] S1, obtaining an input source of communication uplink data of a first device through a preset interface, where the input source is used to input communication uplink data in a communication uplink;

[0110] S2, using the voice information as communication uplink data, and inputting the voice information into the communication uplink through the input source;

[0111] S3, sending voice information to the second device through the communication uplink.

[0112] When performing instant messaging, for the first device, the first device sends data to the second device through the communication uplink, and the data sent by the first device is the communication uplink data. The input source of the communication uplink data is used to input the communication uplink data in the communication uplink, and the preset interface is an interface that can obtain the input source. For example, the input source of the voice communication uplink data is AudioTrack, and the preset interface is getCallUplinkInjectionAudioTrack. After obtaining the input source of the communication uplink data, the voice information is used as the communication uplink data, and the voice information can be input into the communication uplink through the input source, and then the voice information can be sent to the second device through the communication uplink.

[0113] In an exemplary embodiment of the present disclosure, when the first device is the sender device of a call, by receiving text information input by the user and converting the text information into voice information, a barrier-free person can send a voice message to the other party of the call and communicate with the other party by voice.

[0114] In an exemplary embodiment of the present disclosure, an instant messaging method is provided. Figure 4 is an interactive flow chart of an instant messaging method according to an exemplary embodiment. Figure 4 As shown, the following steps are included:

[0115] Step S401, in a first communication mode, the second device sends a first voice message to the first device;

[0116] Step S402, the first device records the first voice information;

[0117] Step S403, the first device recognizes the first voice information as first text information through a preset voice recognition algorithm;

[0118] Step S404, the first device displays the first text information on a preset interface;

[0119] Step S405, the first device receives the second text information input by the user;

[0120] Step S406, the first device synthesizes the second text information into second voice information by using a preset voice synthesis algorithm;

[0121] Step S407: The first device sends the second voice information to the second device.

[0122] In this embodiment, the specific implementation methods of each step refer to the above embodiments and will not be repeated here.

[0123] In an exemplary embodiment of the present disclosure, an instant messaging system is provided, which is applied to a first device. Figure 5A and Figure 5B This is a schematic diagram and an architecture diagram of an instant messaging system according to an exemplary embodiment. As shown in the figure, the instant messaging system includes:

[0124] The service module 501 is configured to convert the first instant communication message into the second instant communication message in the first communication mode, wherein the first instant communication message is one of the voice message and the text message, and the second instant communication message is the other of the voice message and the text message; and perform instant voice communication with the second device based on the second instant communication message.

[0125] The service module may also be referred to as a speech recognition core service (Service), which performs instant voice communication with the second device through Audio.

[0126] In an exemplary embodiment, the first instant messaging message is a voice message, and the second instant messaging message is a text message;

[0127] The instant messaging system also includes:

[0128] The audio module 502 is configured to receive and record the voice information sent by the second device;

[0129] The engine module 503 is configured to recognize the voice information as text information through a preset voice recognition algorithm.

[0130] In an exemplary embodiment, the service module 501 is further configured to:

[0131] Sending a recording instruction to the audio module 502;

[0132] Receive the voice information sent by the audio module 502;

[0133] Sending voice information to the engine module 503;

[0134] The text information sent by the receiving engine module 503 is received.

[0135] In an exemplary embodiment, the instant messaging system further includes:

[0136] The display module 504 is configured to display text information on a preset interface.

[0137] In an exemplary embodiment, the presentation module 504 is further configured to:

[0138] Display the preset interface in one of the following ways:

[0139] Floating window display, small window display, full screen display.

[0140] In an exemplary embodiment, the service module 501 is further configured to:

[0141] The text message is sent to the display module 504 .

[0142] like Figure 5A As shown, steps 1-6 represent the interaction process between various modules in the instant messaging system when the first instant messaging information is a voice message and the second instant messaging information is a text message.

[0143] In an exemplary embodiment, the first instant messaging message is a text message, and the second instant messaging message is a voice message;

[0144] The instant messaging system also includes:

[0145] The display module 504 is configured to receive text information input by the user;

[0146] The engine module 503 is configured to synthesize text information into voice information through a preset voice synthesis algorithm.

[0147] In an exemplary embodiment, the service module 501 is further configured to:

[0148] Receive text information sent by the display module 504;

[0149] Sending text information to the engine module 503;

[0150] The voice information sent by the receiving engine module 503 is received.

[0151] In an exemplary embodiment, the instant messaging system further includes:

[0152] The audio module 502 is configured to send voice information to the second device.

[0153] In an exemplary embodiment, the audio module 502 is further configured to:

[0154] Acquire, through a preset interface, an input source of communication uplink data of the first device, the input source being used to input the communication uplink data in the communication uplink;

[0155] Using voice information as communication uplink data, inputting the voice information into the communication uplink through an input source;

[0156] The voice information is sent to the second device via the communication uplink.

[0157] In an exemplary embodiment, the service module 501 is further configured to:

[0158] The voice information is sent to the audio module 502 .

[0159] like Figure 5A As shown, steps 7-11 represent the interaction process between various modules in the instant messaging system when the first instant messaging information is a voice message and the second instant messaging information is a text message.

[0160] In an exemplary embodiment, the service module 501 is further configured to:

[0161] In the second communication mode, a communication mode switching instruction is received, and the second communication mode is switched to the first communication mode.

[0162] like Figure 5B As shown, the engine module 503 implements the above functions by calling the voice engine interface; the audio module 502 includes a voice information recording management module, which is used to collect sound data in the IM call, that is, to record the voice information, and a voice information playback management module, which is used to inject the voice information as communication uplink data into the IM call; the service module 501 monitors the voice information conversion process, the text information conversion process, the voice information recording process, and the voice information playback process.

[0163] Regarding the system in this embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0164] In an exemplary embodiment of the present disclosure, an instant messaging device is provided, which is applied to a first device. Figure 6 is a block diagram of an instant messaging device according to an exemplary embodiment. Figure 6 As shown, the device comprises:

[0165] The first processing unit 601 is configured to convert the first instant communication message into the second instant communication message in the first communication mode, wherein the first instant communication message is one of the voice message and the text message, and the second instant communication message is the other of the voice message and the text message;

[0166] The second processing unit 602 is configured to perform instant voice communication with the second device based on the second instant communication information.

[0167] In an exemplary embodiment, the first instant messaging message is a voice message, and the second instant messaging message is a text message;

[0168] The first processing unit 601 is further configured to:

[0169] receiving and recording a voice message sent by a second device;

[0170] Through the preset voice recognition algorithm, the voice information is recognized as text information.

[0171] In an exemplary embodiment, the second processing unit 602 is further configured to:

[0172] Display text information on the default interface.

[0173] In an exemplary embodiment, the preset interface is displayed in one of the following display modes:

[0174] Floating window display, small window display, full screen display.

[0175] In an exemplary embodiment, the first instant messaging message is a text message, and the second instant messaging message is a voice message;

[0176] The first processing unit 601 is further configured to:

[0177] Receive text information input by the user;

[0178] The text information is synthesized into voice information through a preset speech synthesis algorithm.

[0179] In an exemplary embodiment, the second processing unit 602 is further configured to:

[0180] The voice message is sent to the second device.

[0181] In an exemplary embodiment, the second processing unit 602 is further configured to:

[0182] Acquire, through a preset interface, an input source of communication uplink data of the first device, the input source being used to input the communication uplink data in the communication uplink;

[0183] Using voice information as communication uplink data, inputting the voice information into the communication uplink through an input source;

[0184] The voice information is sent to the second device via the communication uplink.

[0185] In an exemplary embodiment, the first processing unit 601 is further configured to:

[0186] In the second communication mode, a communication mode switching instruction is received, and the second communication mode is switched to the first communication mode.

[0187] Regarding the device in the above embodiment, the specific manner in which each unit performs the operation has been described in detail in the embodiment of the method, and will not be elaborated here.

[0188] Figure 7 is a block diagram of an electronic device 700 according to an exemplary embodiment.

[0189] Reference Figure 7 , the electronic device 700 may include one or more of the following components: a processing component 702 , a memory 704 , a power component 706 , a multimedia component 708 , an audio component 710 , an input / output (I / O) interface 712 , a sensor component 714 , and a communication component 716 .

[0190] The processing component 702 generally controls the overall operation of the electronic device 700, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 702 may include one or more processors 720 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 702 may include one or more modules to facilitate the interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate the interaction between the multimedia component 708 and the processing component 702.

[0191] The memory 704 is configured to store various types of data to support operations on the electronic device 700. Examples of such data include instructions for any application or method operating on the electronic device 700, contact data, phone book data, messages, pictures, videos, etc. The memory 704 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0192] The power supply component 706 provides power to various components of the electronic device 700. The power supply component 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 700.

[0193] The multimedia component 708 includes a screen that provides an output interface between the electronic device 700 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front camera and / or a rear camera. When the electronic device 700 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0194] The audio component 710 is configured to output and / or input audio signals. For example, the audio component 710 includes a microphone (MIC), and when the electronic device 700 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 704 or sent via the communication component 716. In some embodiments, the audio component 710 also includes a speaker for outputting audio signals.

[0195] I / O interface 712 provides an interface between processing component 702 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0196] The sensor assembly 714 includes one or more sensors for providing various aspects of status assessment for the electronic device 700. For example, the sensor assembly 714 can detect the open / closed state of the electronic device 700, the relative positioning of components, such as the display and keypad of the electronic device 700, and the sensor assembly 714 can also detect the position change of the electronic device 700 or a component of the electronic device 700, the presence or absence of user contact with the electronic device 700, the orientation or acceleration / deceleration of the electronic device 700, and the temperature change of the electronic device 700. The sensor assembly 714 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 714 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0197] The communication component 716 is configured to facilitate wired or wireless communication between the electronic device 700 and other devices. The electronic device 700 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 716 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0198] In an exemplary embodiment, the electronic device 700 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0199] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 704 including instructions, and the instructions can be executed by a processor 720 of an electronic device 700 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0200] A non-temporary computer-readable storage medium, when the instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to execute an instant communication method, the method including any of the above methods.

[0201] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0202] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An instant messaging method, applied to a first device, characterized in that: The method comprises: In a first communication mode, converting a first instant communication message into a second instant communication message, wherein the first instant communication message is one of a voice message and a text message, and the second instant communication message is the other of the voice message and the text message; Based on the second instant communication information, instant voice communication is performed with the second device.

2. The instant messaging method according to claim 1, characterized in that: The first instant communication information is the voice information, and the second instant communication information is the text information; The converting the first instant communication information into the second instant communication information includes: receiving and recording the voice information sent by the second device; The voice information is recognized as the text information through a preset voice recognition algorithm.

3. The instant messaging method according to claim 2, characterized in that: The performing instant voice communication with the second device based on the second instant communication information includes: The text information is displayed on a preset interface.

4. The instant messaging method according to claim 3, characterized in that: The preset interface is displayed in one of the following ways: Floating window display, small window display, full screen display.

5. The instant messaging method according to claim 1, characterized in that: The first instant communication information is the text information, and the second instant communication information is the voice information; The converting the first instant communication information into the second instant communication information includes: Receiving the text information input by the user; The text information is synthesized into the voice information by using a preset voice synthesis algorithm.

6. The instant messaging method according to claim 5, characterized in that: The performing instant voice communication with the second device based on the second instant communication information includes: The voice information is sent to the second device.

7. The instant messaging method according to claim 6, characterized in that: The sending the voice information to the second device includes: Acquire, through a preset interface, an input source of communication uplink data of the first device, wherein the input source is used to input the communication uplink data in a communication uplink; Using the voice information as the communication uplink data, and inputting the voice information into the communication uplink through the input source; The voice information is sent to the second device via the communication uplink.

8. The instant messaging method according to claim 1, characterized in that: The method further comprises: In the second communication mode, a communication mode switching instruction is received, and the second communication mode is switched to the first communication mode.

9. An instant messaging system, applied to a first device, characterized in that: The system comprises: The service module is configured to convert a first instant communication message into a second instant communication message in a first communication mode, wherein the first instant communication message is one of a voice message and a text message, and the second instant communication message is the other of the voice message and the text message; and perform instant voice communication with a second device based on the second instant communication message.

10. The instant messaging system according to claim 9, characterized in that: The first instant communication information is the voice information, and the second instant communication information is the text information; The instant messaging system also includes: an audio module, configured to receive and record the voice information sent by the second device; The engine module is configured to recognize the voice information as the text information through a preset voice recognition algorithm.

11. The instant messaging system according to claim 10, characterized in that: The service module is further configured to: Sending a recording instruction to the audio module; Receiving voice information sent by the audio module; Sending the voice information to the engine module; Receive the text information sent by the engine module.

12. The instant messaging system according to claim 10, characterized in that: The instant messaging system also includes: The display module is configured to display the text information on a preset interface.

13. The instant messaging system according to claim 12, characterized in that: The display module is also configured as: The preset interface is displayed in one of the following ways: Floating window display, small window display, full screen display.

14. The instant messaging system according to claim 12, characterized in that: The service module is further configured to: The text information is sent to the display module.

15. The instant messaging system according to claim 9, characterized in that: The first instant communication information is the text information, and the second instant communication information is the voice information; The instant messaging system also includes: A display module, configured to receive the text information input by the user; The engine module is configured to synthesize the text information into the voice information through a preset voice synthesis algorithm.

16. The instant messaging system according to claim 15, characterized in that: The service module is further configured to: Receiving the text information sent by the display module; Sending the text information to the engine module; Receive the voice information sent by the engine module.

17. The instant messaging system according to claim 15, characterized in that: The instant messaging system also includes: The audio module is configured to send the voice information to the second device.

18. The instant messaging system according to claim 17, characterized in that: The audio module is further configured to: Acquire, through a preset interface, an input source of communication uplink data of the first device, wherein the input source is used to input the communication uplink data in a communication uplink; Using the voice information as the communication uplink data, and inputting the voice information into the communication uplink through the input source; The voice information is sent to the second device via the communication uplink.

19. The instant messaging system according to claim 17, characterized in that: The service module is further configured to: The voice information is sent to the audio module.

20. The instant messaging system according to claim 9, characterized in that: The service module is further configured to: In the second communication mode, a communication mode switching instruction is received, and the second communication mode is switched to the first communication mode.

21. An instant messaging device, applied to a first device, characterized in that: The device comprises: A first processing unit is configured to convert a first instant communication message into a second instant communication message in a first communication mode, wherein the first instant communication message is one of a voice message and a text message, and the second instant communication message is the other of the voice message and the text message; The second processing unit is configured to perform instant voice communication with the second device based on the second instant communication information.

22. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to execute the method as claimed in any one of claims 1 to 8.

23. A non-transitory computer-readable storage medium, characterized in that: When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method as claimed in any one of claims 1 to 8.

Images