A method, electronic device and system for editing text

Abstract

The application provides a method, an electronic device and a system for editing text, the method comprising: obtaining, by a device A, audio content; sending, by the device A, first information to a device B, the first information being the audio content or first text content corresponding to the audio content; displaying, by the device B, the first text content according to the first information; and displaying, by the device B, second text content in response to a user editing operation on the first text content, the second text content being text content edited from the first text content. The embodiments of the application help to improve the editing efficiency of the user on the text content.

Description

Technical Field

[0001] The present application relates to the field of terminals, and more particularly, to a method, electronic device, and system for editing text. Background Art

[0002] Automatic speech recognition (ASR) technology has been widely used, significantly improving the efficiency of note-taking. However, due to certain conditions, ASR technology cannot achieve 100% accuracy, requiring manual editing of ASR results before use. However, ASR modules are typically found on mobile devices like mobile phones, which lack user-friendly screen displays and input methods, making editing ASR results inefficient. Summary of the Invention

[0003] The present application provides a method, electronic device, and system for editing text, which help improve the user's editing efficiency in text editing.

[0004] In a first aspect, a system is provided, comprising a first electronic device and a second electronic device, wherein the first electronic device is used to obtain audio content; the first electronic device is also used to send first information to the second electronic device, where the first information is the audio content, or the first information is first text content corresponding to the audio content; the second electronic device is used to display the first text content based on the first information; and the second electronic device is also used to display a second text content in response to a user's editing operation on the first text content, where the second text content is the text content edited from the first text content.

[0005] In an embodiment of the present application, the first electronic device can send the text content corresponding to the acquired audio content to the second electronic device, so that the text content can be displayed on the second electronic device, thereby facilitating the user to edit the text content on the second electronic device, thereby helping to improve the user's efficiency in editing the text content.

[0006] In some possible implementations, the first electronic device may store information of one or more electronic devices. When the first electronic device obtains audio, the first electronic device may select a second electronic device suitable for text editing from the one or more electronic devices, thereby sending the first information to the second electronic device.

[0007] In some possible implementations, in response to receiving the first information, the second electronic device may open the first application and display the first text content in the first application; the second electronic device may edit the first text content through the input method of the second electronic device.

[0008] With reference to the first aspect, in some implementations of the first aspect, the second electronic device is further configured to send the second text content to the first electronic device.

[0009] In some possible implementations, the second electronic device is further configured to send the second text content to the first electronic device upon detecting the first operation of the user.

[0010] In some possible implementations, the first operation is an operation of the user clicking save.

[0011] In the embodiments of the present application, the second electronic device can send the edited text content to the first electronic device after obtaining the text content edited by the user, so that the first electronic device can save the edited text content. Without additional operation of the user, the first electronic device can also obtain the edited text content.

[0012] With reference to the first aspect, in some implementations of the first aspect, the editing operation includes a format modification operation on the first text content, and the second electronic device is further configured to send format information of the second text content to the first electronic device.

[0013] In the embodiments of the present application, when the user modifies the format of the text content, the second electronic device can also send the format information of the edited text content to the first electronic device, so that the first electronic device restores the text content edited by the user on the second electronic device according to the format information.

[0014] With reference to the first aspect, in some implementations of the first aspect, the format information of the second text content includes one or more of a font color, a font size, a font background color, a font slant, a font underline, and a carriage return operation in the second text content.

[0015] With reference to the first aspect, in some implementations of the first aspect, the first electronic device is further configured to: display the first text content according to the audio content before receiving the second text content sent by the second electronic device; and replace the first text content with the second text content after receiving the second text content sent by the second electronic device.

[0016] In the embodiments of the present application, the first electronic device can display the corresponding first text content when obtaining the audio content, and after the first electronic device receives the second text content edited by the user and sent by the second electronic device, the first electronic device can replace the previous first text content with the second text content, so as to facilitate the user to simultaneously view the edited text content on the first electronic device and the second electronic device, and help improve the user experience.

[0017] With reference to the first aspect, in some implementations of the first aspect, the first electronic device is further configured to send a query request, the query request being used to determine whether a device receiving the query request has a text editing function; and in response to receiving a response sent by the second electronic device, send the first information to the second electronic device, the response being used to indicate that the second electronic device has the text editing function.

[0018] In the embodiments of the present application, the first electronic device can query a device having a text editing function before sending the first information to the second electronic device. After determining that the second electronic device has the text editing function, the first electronic device can send the first information to the second electronic device, thereby facilitating the user to edit the text content on the second electronic device and helping to improve the user's efficiency when editing the text.

[0019] With reference to the first aspect, in some implementations of the first aspect, the second electronic device is specifically configured to: in response to receiving the first information, prompt the user whether to edit the text on the second electronic device; and in response to an operation of the user determining to edit the text on the second electronic device, display the first text content.

[0020] In the embodiments of the present application, when the second electronic device receives the first information, the second electronic device can first prompt the user whether to agree to edit the text on the second electronic device. If the second electronic device detects an operation of the user agreeing, the second electronic device can display the text content, which helps to avoid interfering with the user and allows the user to select a device that the user considers appropriate to edit the text, thereby helping to improve the user's experience.

[0021] In some possible implementations, the first electronic device can further send request information to the second electronic device, the request information being used to request the second electronic device to edit the first text content; the second electronic device can prompt the user whether to agree to edit the text content on the second electronic device in response to the request information; and if the second electronic device detects an operation of the user agreeing to edit the text content on the second electronic device, the second electronic device can display the first text content.

[0022] With reference to the first aspect, in some implementations of the first aspect, the first information is the first text content, and the first electronic device is specifically configured to: in response to obtaining the audio content, convert the audio content into the first text content; and send the first text content to the second electronic device.

[0023] In the embodiments of the present application, the first electronic device can convert the audio content into text content after obtaining the audio content, and then send the text content to the second electronic device, and the second electronic device can display the corresponding text content, thereby facilitating the user to edit the text content.

[0024] With reference to the first aspect, in some implementations of the first aspect, the first information is the audio content, and the second electronic device is specifically configured to: convert the audio content into the first text content in response to receiving the audio content; and display the first text content.

[0025] In the embodiments of the present application, the first electronic device can send the obtained audio content to the second electronic device, and the second electronic device can display the text content after converting the audio content into the text content, thereby facilitating the user to edit the text content.

[0026] With reference to the first aspect, in some implementations of the first aspect, the account of the first electronic device is associated with the account of the second electronic device.

[0027] In a second aspect, a method for text editing is provided, which is applied to a first electronic device, and the method comprises the following steps: the first electronic device obtains audio content; and the first electronic device sends first information to a second electronic device, wherein the first information is the audio content, or the first information is first text content corresponding to the audio content, so that the second electronic device displays the first text content according to the first information and detects an editing operation of the user on the first text content.

[0028] With reference to the second aspect, in some implementations of the second aspect, the method further comprises the following step: the first electronic device receives second text content sent by the second electronic device, wherein the second text content is text content edited by the user on the second electronic device on the first text content.

[0029] With reference to the second aspect, in some implementations of the second aspect, the method further comprises the following step: the first electronic device receives format information of the second text content sent by the second electronic device.

[0030] With reference to the second aspect, in some implementations of the second aspect, the format information of the second text content comprises one or more of the following: font color, font size, font background color, font slant, font underline, and carriage return operation in the second text content.

[0031] With reference to the second aspect, in some implementations of the second aspect, the method further includes: before receiving the second text content sent by the second electronic device, displaying, by the first electronic device, the first text content according to the audio content; after receiving the second text content sent by the second electronic device, replacing, by the first electronic device, the first text content with the second text content.

[0032] With reference to the second aspect, in some implementations of the second aspect, the method includes: before sending the first information to the second electronic device, sending, by the first electronic device, a query request, the query request being used to determine, by a device receiving the query request, whether the device has a text editing function; in response to receiving a response sent by the second electronic device, sending, by the first electronic device, the first information to the second electronic device, the response being used to indicate that the second electronic device has the text editing function.

[0033] With reference to the second aspect, in some implementations of the second aspect, the first information is the first text content, and the method further includes: in response to obtaining the audio content, converting, by the first electronic device, the audio content into the first text content; and sending, by the first electronic device, the first text content to the second electronic device.

[0034] With reference to the second aspect, in some implementations of the second aspect, the account of the first electronic device and the account of the second electronic device are associated.

[0035] A third aspect provides a method for text editing, the method being applied to a second electronic device, and the method includes: receiving, by the second electronic device, first information sent by a first electronic device, the first information being audio content obtained by the first electronic device, or the first information being first text content corresponding to the audio content; displaying, by the second electronic device, the first text content according to the first information; and in response to an editing operation of a user on the first text content, displaying, by the second electronic device, second text content, the second text content being text content edited from the first text content.

[0036] With reference to the third aspect, in some implementations of the third aspect, the method further includes: sending, by the second electronic device, the second text content to the first electronic device.

[0037] With reference to the third aspect, in some implementations of the third aspect, the editing operation includes a format modification operation on the first text content, and the method further includes: sending, by the second electronic device, format information of the second text content to the first electronic device.

[0038] In some implementations of the third aspect, in conjunction with the third aspect, the format information of the second text content includes one or more of a font color, a font size, a font background color, a font slant, a font underline, and a carriage return operation in the second text content.

[0039] In some implementations of the third aspect, in conjunction with the third aspect, before receiving the first information sent by the first electronic device, the second electronic device receives a query request sent by the first electronic device, the query request being used to determine whether the second electronic device has a text editing function; and the second electronic device sends a response to the first electronic device, the response being used to indicate that the second electronic device has the text editing function.

[0040] In some implementations of the third aspect, in conjunction with the third aspect, the second electronic device displays the first text content according to the first information includes: in response to receiving the first information, the second electronic device prompts a user whether to perform text editing on the second electronic device; and in response to an operation of the user determining to perform text editing on the second electronic device, the second electronic device displays the first text content.

[0041] In some implementations of the third aspect, in conjunction with the third aspect, the first information is the audio content, and before the second electronic device displays the first text content, the method further includes: in response to receiving the audio content, converting the audio content into the first text content.

[0042] In some implementations of the third aspect, in conjunction with the third aspect, the account of the first electronic device and the account of the second electronic device are associated.

[0043] A fourth aspect provides an apparatus, which includes: an obtaining unit configured to obtain audio content; and a sending unit configured to send first information to a second electronic device, the first information being the audio content, or the first information being first text content corresponding to the audio content, so that the second electronic device displays the first text content according to the first information and detects an editing operation of a user on the first text content.

[0044] A fifth aspect provides an apparatus, which includes: a receiving unit configured to receive first information sent by a first electronic device, the first information being audio content obtained by the first electronic device, or the first information being first text content corresponding to the audio content; a displaying unit configured to display the first text content according to the first information; a detecting unit configured to detect an editing operation of a user on the first text content; and the displaying unit is further configured to display second text content, the second text content being text content edited from the first text content.

[0045] In a sixth aspect, an electronic device is provided, comprising: one or more processors; a memory; and one or more computer programs. Wherein the one or more computer programs are stored in the memory, and the one or more computer programs comprise instructions. When the instructions are executed by the electronic device, the electronic device is caused to perform the method in any possible implementation of the second aspect.

[0046] In a seventh aspect, an electronic device is provided, comprising: one or more processors; a memory; and one or more computer programs. Wherein the one or more computer programs are stored in the memory, and the one or more computer programs comprise instructions. When the instructions are executed by the electronic device, the electronic device is caused to perform the method in any possible implementation of the third aspect.

[0047] In an eighth aspect, a computer program product is provided, comprising instructions, which, when the computer program product is run on a first electronic device, cause the electronic device to perform the method of the second aspect; or, when the computer program product is run on a second electronic device, cause the electronic device to perform the method of the third aspect.

[0048] In a ninth aspect, a computer readable storage medium is provided, comprising instructions, which, when run on a first electronic device, cause the electronic device to perform the method of the second aspect; or, when run on a second electronic device, cause the electronic device to perform the method of the third aspect.

[0049] In a tenth aspect, a chip is provided, which is used to execute instructions, when the chip is run, the chip performs the method of the second aspect; or, the chip performs the method of the third aspect. BRIEF DESCRIPTION OF DRAWINGS

[0050] Figure 1 is a hardware structure schematic diagram of an electronic device provided by an embodiment of the present application.

[0051] Figure 2 is a software structure block diagram provided by an embodiment of the present application.

[0052] Figure 3 is a set of graphical user interfaces provided by an embodiment of the present application.

[0053] Figure 4 is another set of graphical user interfaces provided by an embodiment of the present application.

[0054] Figure 5 is another set of graphical user interfaces provided by an embodiment of the present application.

[0055] Figure 6is another set of graphical user interfaces provided by the embodiments of the present application.

[0056] Figure 7 is another set of graphical user interfaces provided by the embodiments of the present application.

[0057] Figure 8 is another set of graphical user interfaces provided by the embodiments of the present application.

[0058] Figure 9 is another set of graphical user interfaces provided by the embodiments of the present application.

[0059] Figure 10 is another set of graphical user interfaces provided by the embodiments of the present application.

[0060] Figure 11 is a schematic diagram of a system architecture provided by the embodiments of the present application.

[0061] Figure 12 is a schematic flowchart of a method for editing text provided by the embodiments of the present application.

[0062] Figure 13 is a schematic diagram of another system architecture provided by the embodiments of the present application.

[0063] Figure 14 is a schematic structural diagram of an apparatus provided by the embodiments of the present application.

[0064] Figure 15 is another schematic structural diagram of an apparatus provided by the embodiments of the present application.

[0065] Figure 16 is another structural schematic diagram of an electronic device provided by the embodiments of the present application. DETAILED DESCRIPTION

[0066] The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " represents the meaning of or, for example, A / B can represent A or B; in this document, "and / or" is only a description of the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which can represent the three cases of A alone, A and B together, and B alone. In addition, in the description of the embodiments of the present application, "plural" or "multiple" means two or more than two.

[0067] The terms "first", "second", "third", etc. are used herein only to describe different instances, and cannot be construed to refer to a relative importance or to imply the number of the technical features indicated. Thus, the features defined with "first", "second" can explicitly or implicitly include one or more of the features. In the description of the embodiments, the meaning of "a plurality of" is two or more, unless otherwise specified.

[0068] The method provided by the embodiments of the present application can be applied to electronic devices such as mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, notebook computers, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), and the like. The embodiments of the present application do not make any limitation on the specific type of electronic device.

[0069] Exemplarily, Figure 1 A structural schematic diagram of the electronic device 100 is shown. The electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a loudspeaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0070] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than shown, or combine certain components, or split certain components, or different arrangement of components. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0071] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices, or can be integrated in one or more processors.

[0072] Among them, the controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching and executing instructions.

[0073] The memory can also be provided in the processor 110, for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can save instructions or data that have just been used or are recycled by the processor 110. If the processor 110 needs to use the instructions or data again, it can be directly called from the memory. This avoids repeated access and reduces the waiting time of the processor 110, thus improving the efficiency of the system.

[0074] In some embodiments, the processor 110 can include one or more interfaces. The interface can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0075] An I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 can contain multiple sets of I2C bus. The processor 110 can be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces respectively. For example, the processor 110 can be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface, and the touch function of the electronic device 100 is realized.

[0076] An I2S interface can be used for audio communication. In some embodiments, the processor 110 can contain multiple sets of I2S bus. The processor 110 can be coupled to the audio module 170 through the I2S bus, and communication between the processor 110 and the audio module 170 is realized. In some embodiments, the audio module 170 can deliver audio signals to the wireless communication module 160 through the I2S interface, and the function of answering a phone through a Bluetooth earphone is realized.

[0077] A PCM interface can also be used for audio communication, which samples, quantizes and encodes analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled through a PCM bus interface. In some embodiments, the audio module 170 can also deliver audio signals to the wireless communication module 160 through the PCM interface, and the function of answering a phone through a Bluetooth earphone is realized. Both the I2S interface and the PCM interface can be used for audio communication.

[0078] A UART interface is a universal serial data bus, which is used for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is usually used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface, and the Bluetooth function is realized. In some embodiments, the audio module 170 can deliver audio signals to the wireless communication module 160 through the UART interface, and the function of playing music through a Bluetooth earphone is realized.

[0079] The MIPI interface can be used to connect the processor 110 and the display screen 194, the camera 193 and other peripheral devices. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), and the like. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to implement the photographing function of the electronic device 100. The processor 110 and the display screen 194 communicate through the DSI interface to implement the display function of the electronic device 100.

[0080] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 and the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, and the like.

[0081] The USB interface 130 is an interface that conforms to the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transmit data between the electronic device 100 and a peripheral device. It can also be used to connect a headset to play audio through the headset. The interface can also be used to connect other electronic devices, such as AR devices and the like.

[0082] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a structural limitation of the electronic device 100. In some other embodiments of the present application, the electronic device 100 can also use different interface connection methods or combinations of multiple interface connection methods in the above embodiments.

[0083] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input through the wireless charging coil of the electronic device 100. The charging management module 140 can charge the battery 142 while also providing power to the electronic device through the power management module 141.

[0084] The power management module 141 is configured to connect the battery 142 and the charging management module 140 to the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 can also be configured to monitor parameters such as the battery capacity, the number of battery cycles, the battery health status (leakage, impedance), and the like. In some embodiments, the power management module 141 can also be disposed in the processor 110. In some other embodiments, the power management module 141 and the charging management module 140 can also be disposed in the same device.

[0085] The wireless communication function of the electronic device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, and the like.

[0086] The antenna 1 and the antenna 2 are configured to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be configured to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in combination with a tuning switch.

[0087] The mobile communication module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G and the like applied to the electronic device 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), and the like. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter, amplify, and the like the received electromagnetic waves, and transmit the processed signals to the modem processor for demodulation. The mobile communication module 150 can also amplify signals modulated by the modem processor and radiate the signals as electromagnetic waves through the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 150 can be disposed in the processor 110. In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 can be disposed in the same device.

[0088] The modem processor can include a modulator and a demodulator. The modulator is configured to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is configured to demodulate a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal processed by the baseband processor is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a microphone 170B, etc.), or displays an image or a video through the display 194. In some embodiments, the modem processor can be a separate device. In other embodiments, the modem processor can be independent of the processor 110 and disposed in the same device as the mobile communication module 150 or other functional modules.

[0089] The wireless communication module 160 can provide a wireless communication solution including a wireless local area network (WLAN) (e.g., a wireless fidelity (Wi-Fi) network), Bluetooth (BT), a global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, and the like, which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives an electromagnetic wave via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signal, and transmits the processed signal to the processor 110. The wireless communication module 160 can also receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification thereon, and radiate the signal as an electromagnetic wave via the antenna 2.

[0090] In some embodiments, the antenna 1 and the mobile communication module 150 of the electronic device 100 are coupled, and the antenna 2 and the wireless communication module 160 are coupled, so that the electronic device 100 can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include a global positioning system (GPS), a global navigation satellite system (GLONASS), a beidu navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and / or a satellite based augmentation systems (SBAS).

[0091] The electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs, which execute program instructions to generate or change display information.

[0092] The display screen 194 is configured to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diodes (QLED), or the like. In some embodiments, the electronic device 100 can include one or N display screens 194, where N is a positive integer greater than 1.

[0093] The electronic device 100 can implement the photographing function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor.

[0094] The ISP is configured to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing to convert it into an image visible to the naked eye. The ISP can also algorithmically optimize the noise and brightness of the image. The ISP can also optimize the exposure, color temperature, and other parameters of the shooting scene. In some embodiments, the ISP can be disposed in the camera 193.

[0095] The camera 193 is configured to capture still images or videos. An object generates an optical image through a lens and projects it onto a photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then transmitted to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, the electronic device 100 can include one or N cameras 193, where N is a positive integer greater than 1.

[0096] The digital signal processor is used to process digital signals, in addition to being able to process digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0097] The video codec is used to compress or decompress digital video. The electronic device 100 can support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0098] The NPU is a neural-network (NN) calculation processor, which can quickly process input information by drawing on the structure of a biological neural network, such as drawing on the transmission mode between human brain neurons, and can also constantly self-learn. Through the NPU, the electronic device 100 can realize intelligent cognition applications such as image recognition, face recognition, voice recognition, text understanding, etc.

[0099] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize data storage functions. For example, music, video, etc. Files are saved in the external memory card.

[0100] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various function applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0101] The electronic device 100 can realize audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor, etc. For example, music playing, recording, etc.

[0102] The audio module 170 is configured to convert digital audio information into an analog audio signal output, and to convert an analog audio input into a digital audio signal. The audio module 170 can also be configured to encode and decode audio signals. In some embodiments, the audio module 170 can be disposed in the processor 110, or some of the functional modules of the audio module 170 can be disposed in the processor 110.

[0103] The speaker 170A, also referred to as a "loudspeaker", is configured to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0104] The receiver 170B, also referred to as a "earpiece", is configured to convert an audio electrical signal into a sound signal. When the electronic device 100 receives a call or a voice message, the user can listen to the voice by holding the receiver 170B close to the ear.

[0105] The microphone 170C, also referred to as a "microphone", "transducer", is configured to convert a sound signal into an electrical signal. When making a call or sending a voice message, the user can speak into the microphone 170C by holding the mouth close to the microphone 170C, and input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, in addition to collecting sound signals, the noise reduction function can also be realized. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C, in addition to collecting sound signals, noise reduction, it can also identify the source of the sound, realize the function of directional recording, etc.

[0106] The earphone interface 170D is configured to connect a wired earphone. The earphone interface 170D can be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0107] The pressure sensor 180A is configured to sense a pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194. The pressure sensor 180A can be of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, etc. The capacitive pressure sensor can include at least two parallel plates of conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation is applied to the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity less than a first pressure threshold is applied to a short message application icon, an instruction to view short messages is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold is applied to the short message application icon, an instruction to create a new short message is executed.

[0108] The gyroscope sensor 180B can be configured to determine the motion attitude of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake photography. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of shaking of the electronic device 100, calculates the distance that the lens module needs to compensate according to the angle, and lets the lens offset the shaking of the electronic device 100 by reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and motion sensing game scenarios.

[0109] The barometric pressure sensor 180C is configured to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude, assists positioning and navigation by using the air pressure value measured by the barometric pressure sensor 180C.

[0110] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can detect the opening and closing of a flip cover by using the magnetic sensor 180D. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Further, according to the detected opening and closing state of the cover or the flip cover, the electronic device 100 can set a feature such as automatic unlocking of the flip cover.

[0111] The acceleration sensor 180E can detect the magnitude of acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the acceleration sensor 180E can detect the magnitude and direction of gravity. The acceleration sensor 180E can also be used to identify the attitude of the electronic device, and can be applied to landscape / portrait screen switching and pedometer applications.

[0112] Distance sensor 180F is configured to measure distance. Electronic device 100 can measure distance by infrared or laser. In some embodiments, electronic device 100 can utilize distance sensor 180F to measure distance for fast focusing when taking a picture.

[0113] Proximity light sensor 180G can include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode can be an infrared light emitting diode. Electronic device 100 emits infrared light outwardly through the light emitting diode. Electronic device 100 detects infrared reflected light from nearby objects using the photodiode. When sufficient reflected light is detected, electronic device 100 can determine that there is an object near electronic device 100. When insufficient reflected light is detected, electronic device 100 can determine that there is no object near electronic device 100. Electronic device 100 can utilize proximity light sensor 180G to detect that a user is holding electronic device 100 close to the ear for a phone call, so as to automatically turn off the screen to save power. Proximity light sensor 180G can also be used for automatic unlocking and locking of the screen in a holster mode or a pocket mode.

[0114] Ambient light sensor 180L is configured to sense ambient light brightness. Electronic device 100 can adaptively adjust the brightness of display 194 according to the sensed ambient light brightness. Ambient light sensor 180L can also be used to automatically adjust white balance when taking a picture. Ambient light sensor 180L can also cooperate with proximity light sensor 180G to detect whether electronic device 100 is in a pocket to prevent accidental touch.

[0115] Fingerprint sensor 180H is configured to collect a fingerprint. Electronic device 100 can utilize the collected fingerprint characteristics to implement fingerprint unlocking, access application lock, fingerprint picture taking, fingerprint call answering, and the like.

[0116] Temperature sensor 180J is configured to detect temperature. In some embodiments, electronic device 100 utilizes the temperature detected by temperature sensor 180J to implement temperature handling strategies. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, electronic device 100 implements performance reduction of a processor located near temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, electronic device 100 heats battery 142 to avoid abnormal shutdown of electronic device 100 caused by low temperature. In other embodiments, when the temperature is lower than yet another threshold, electronic device 100 implements voltage boosting of the output voltage of battery 142 to avoid abnormal shutdown caused by low temperature.

[0117] Touch sensor 180K, also referred to as "touch panel". Touch sensor 180K can be disposed on display screen 194, and touch sensor 180K and display screen 194 together form a touch screen, also referred to as "touch panel". Touch sensor 180K is configured to detect touch operations applied to or near the touch sensor 180K. The touch sensor 180K can transmit the detected touch operation to the application processor to determine the touch event type. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K can also be disposed on the surface of electronic device 100, which is different from the position of display screen 194.

[0118] Bone conduction sensor 180M can obtain vibration signals. In some embodiments, bone conduction sensor 180M can obtain vibration signals of the human body's vocal vibration bone block. Bone conduction sensor 180M can also contact the human body pulse to receive blood pressure pulsation signals. In some embodiments, bone conduction sensor 180M can also be disposed in a headset to form a bone conduction headset. Audio module 170 can analyze voice signals based on the vibration signals of the vocal vibration bone block obtained by the bone conduction sensor 180M to realize voice functions. The application processor can analyze heart rate information based on the blood pressure pulsation signals obtained by the bone conduction sensor 180M to realize heart rate detection functions.

[0119] Keys 190 include power on / off keys, volume keys, and the like. Keys 190 can be mechanical keys. They can also be touch keys. Electronic device 100 can receive key input and generate key signal input related to user settings and function control of electronic device 100.

[0120] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts and also for touch vibration feedback. For example, touch operations applied to different applications (such as taking pictures, playing audio, etc.) can correspond to different vibration feedback effects. Touch operations applied to different regions of display screen 194 can also correspond to different vibration feedback effects. Different application scenarios (such as time reminders, received messages, alarms, games, etc.) can also correspond to different vibration feedback effects. Touch vibration feedback effects can also be customizable.

[0121] Indicator 192 can be an indicator light, which can be used to indicate charging status, power changes, and also to indicate messages, missed calls, notifications, and the like.

[0122] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to or disconnected from the electronic device 100 by inserting it into or removing it from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an embedded SIM (eSIM) card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0123] It should be understood that the phone card in the embodiments of the present application includes but is not limited to a SIM card, an eSIM card, a universal subscriber identity module (USIM), a universal integrated circuit card (UICC), and the like.

[0124] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present application, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.

[0125] Figure 2 This is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present application. The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer. The application layer may include a series of application packages.

[0126] like Figure 2 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0127] The application framework layer provides an application programming interface (API) and programming framework for applications of the application layer. The application framework layer includes some pre-defined functions.

[0128] As shown in Figure 2 the application framework layer can include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc.

[0129] The window manager is used to manage window programs. The window manager can acquire the size of the display screen, determine whether there is a status bar, lock the screen, and intercept the screen, etc.

[0130] The content provider is used to store and acquire data, and make the data accessible to the application program. The data can include videos, images, audios, dialed and received calls, browsing history and bookmarks, phone books, etc.

[0131] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build an application program. A display interface can be composed of one or more views. For example, a display interface including a short message notification icon can include a view for displaying text and a view for displaying pictures.

[0132] The phone manager is used to provide the communication function of the electronic device 100. For example, the management of the call state (including call connection, call hang-up, etc.).

[0133] The resource manager provides various resources for the application program, such as localized strings, icons, pictures, layout files, video files, etc.

[0134] The notification manager enables the application program to display notification information in the status bar, which can be used to convey a type of message that can automatically disappear after a short stay without user interaction. For example, the notification manager is used to inform the completion of the download, message reminders, etc. The notification manager can also be a notification in the form of a chart or a scroll bar text appearing in the top status bar of the system, such as a notification of an application running in the background, or a notification in the form of a dialogue window appearing on the screen. For example, prompting text information in the status bar, issuing a prompt sound, the electronic device vibrating, the indicator light flashing, etc.

[0135] The Android runtime includes a core library and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

[0136] The core library includes two parts: one part is the function function required to be called by the java language, and the other part is the core library of Android.

[0137] The application program layer and the application framework layer run in a virtual machine. The virtual machine executes the java files of the application program layer and the application framework layer into binary files. The virtual machine is used to perform functions such as management of object life cycle, stack management, thread management, management of security and exceptions, and garbage collection.

[0138] The system library can include a plurality of functional modules. For example, a surface manager, media libraries, a three-dimensional graphics processing library (for example, OpenGL ES), a 2D graphics engine (for example, SGL), and the like.

[0139] The surface manager is used to manage a display subsystem and provides fusion of 2D and 3D layers for a plurality of application programs.

[0140] The media library supports playback and recording of a plurality of commonly used audio, video formats, and static image files. The media library can support a plurality of audio and video encoding formats, for example, MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, and the like.

[0141] The three-dimensional graphics processing library is used to implement three-dimensional graphics drawing, image rendering, synthesis, and layer processing, and the like.

[0142] The 2D graphics engine is a drawing engine for 2D drawing.

[0143] The kernel layer is a layer between hardware and software. The kernel layer at least includes display drivers, camera drivers, audio drivers, and sensor drivers.

[0144] It should be understood that the technical solutions in the embodiments of the present application can be used in Android, IOS, Harmony, and the like.

[0145] Figure 3 is a group of graphical user interfaces (GUIs) provided by the embodiments of the present application.

[0146] Referring to the GUI shown in (a) of Figure 3 , which is a desktop of a mobile phone. The desktop of the mobile phone includes icons of a plurality of application programs, including a clock, a calendar, a gallery, a memo, a file management, an email, music, a calculator, and the like. When the mobile phone detects an operation of a user clicking an icon of the memo, the GUI shown in (b) of Figure 3 may be displayed.

[0147] Referring to the GUI shown in (a) of Figure 3The GUI shown in (b) is the display interface of the memo application. The display interface shows a note recorded on September 1st, and the content of the note is "Mom's birthday (September 28th)". The display interface also includes a control 301 for creating a new note. When the mobile phone detects that the user clicks the control 301, the mobile phone can display the following Figure 3 The GUI shown in (c) in FIG.

[0148] See also Figure 3 The GUI shown in (c) of Figure 1 is another display interface of the memo application. Users can edit the title and body of the note on this interface. This display interface also includes checklists, text editing, image insertion, audio-to-text conversion, and handwriting controls.

[0149] See also Figure 3 As shown in (d) of FIG, when the mobile phone detects that the user clicks the audio-to-text control 302, the mobile phone can send a request to the laptop computer, requesting that the laptop computer edit the text content corresponding to the voice content obtained by the mobile phone. In response to receiving the request, the laptop computer can display a reminder box 303, where the reminder box 303 includes the prompt message "The mobile phone is detecting that the audio-to-text is being converted. Do you want to edit the text on the laptop computer?"

[0150] See also Figure 3 As shown in (e) of FIG, in response to a user clicking control 304, the laptop computer can launch App1. App1 is an application that can perform text editing. In response to a user clicking control 302, the mobile phone can detect voice content in the environment and convert the detected voice content into text content. After the mobile phone converts the voice content into text content, it can also send the converted text content to the laptop computer. As a result, the text content "Hotness changes again... social mentality" is displayed simultaneously on the display interface of the mobile phone's memo application and the display interface of App1 on the laptop computer.

[0151] In one embodiment, the mobile phone may include a microphone and an automatic speech recognition (ASR) module, wherein the microphone is used to collect voice content in the environment, and the ASR module is used to convert the received voice content into text content.

[0152] In one embodiment, the text content on the display interface of App1 of the laptop and the display interface of the memo application of the mobile phone can be synchronized in real time. For example, the mobile phone can convert the voice content into text content at a certain time interval (for example, 5 seconds). In 0-5 seconds, the mobile phone converts the collected voice content into text content "The people's livelihood demands are reflected in the changes and invariance of popularity", so that the mobile phone can display the text content on the display interface of the memo, and at the same time, the mobile phone can send the text content to the laptop, so that the laptop can display the text content on the display interface of App1; in 5-10 seconds, the mobile phone converts the collected voice content into text content "Guangzhi Think Tank We have just counted the eve of the 2020 National Conference", so that the mobile phone can display the text content on the display interface of the memo, and at the same time, the mobile phone can send the text content to the laptop, so that the laptop can display the text content on the display interface of App1.

[0153] In one embodiment, the laptop computer may display a cursor 306 after opening App1 , wherein after receiving text content sent by the mobile phone, the laptop computer may display the cursor 306 at the end of the text content.

[0154] See also Figure 3 In the GUI shown in (f), the mobile phone can continue to detect voice content and convert the voice content into text content. The mobile phone can synchronize the text content to App1 of the laptop in real time. At the same time, the laptop can edit the text content in App1 in response to the user's editing operation. For example, the user can add content to the text content sent by the mobile phone (add "1," before "hotness," and add "2," before "Guangzhi Think Tank"). For another example, the user can modify inaccurate text content (for example, change "name" to "public opinion," and change "breakthrough time" to "top10"). For another example, the user can also modify the format of the text content (for example, the laptop detects the user's enter operation after "people's livelihood demands").

[0155] like Figure 3 In (f), in response to the laptop detecting that the user clicks the save control 307, the laptop can send the edited text content to the mobile phone, so that the mobile phone displays the edited text content on the laptop on the memo display interface.

[0156] In one embodiment, after detecting voice content in the environment, the mobile phone converts the voice content into text content and sends the text content to the laptop computer, without displaying the text content on the mobile phone. After receiving the edited text content from the laptop computer, the mobile phone can display the edited text content on the display interface of the memo application.

[0157] In one embodiment, after detecting that the user has moved the cursor to a location that requires editing, the laptop can edit the text content near that location. For example, if the cursor 306 is currently after the word "social mentality," and the laptop detects that the user has added a "?" symbol after "social mentality," the cursor 306 can be moved to the back of "social mentality?". Furthermore, after the laptop receives other text content sent by the mobile phone, it can continue to display the received text content.

[0158] See also Figure 3 As shown in (g) in the figure, when the laptop computer continues to detect the user editing the text content, the text content received from the mobile phone can be edited. For example, the laptop computer can detect the user changing "正成功" to "郑成功"; for another example, the laptop computer can detect the user adding the symbol "." after "年特性"; for another example, the laptop computer can detect the user inserting the symbol "、" in "醫療教育房食食安全"; for another example, the laptop computer can detect the user pressing Enter after "社会精神?"

[0159] like Figure 3 As shown in (g), when the laptop detects that the user clicks the save control 307, the laptop can send the edited text content to the mobile phone, so that the mobile phone displays the edited text content on the laptop on the memo display interface.

[0160] See also Figure 3 The GUI shown in (h) is another display interface of the memo application. When the mobile phone detects that the user clicks the control 308 to stop recording, the mobile phone can display the following Figure 3 The GUI shown in (i) in FIG.

[0161] See also Figure 3 The GUI shown in (i) is another display interface of the memo application. The user can continue to edit the text content edited by the laptop on the mobile phone (for example, the user can insert a picture into the text content). When the mobile phone detects that the user clicks the control 309, the mobile phone can save the text content displayed on the current interface and display it as follows: Figure 3 The GUI shown in (j) in FIG.

[0162] See also Figure 3GUI shown in (j) of FIG. 13, which is another display interface of the memo application. In response to detecting the operation of the user clicking the control 309, the phone can update the title of the note to "1, Hotspot". When the phone detects the operation of the user clicking the control 310, the phone can display the GUI shown in (k) of FIG. 13. Figure 4

[0163] Referring to Figure 4 GUI shown in (k) of FIG. 13, which is another display interface of the memo application. The phone can display 2 notes in the current memo application, and the newly added note content can be displayed at the top.

[0164] In one embodiment, if the phone starts the voice-to-text operation and the notebook computer does not detect the operation of the user clicking the control 304, the phone can start the voice-to-text operation, and the notebook computer can continue to display the reminder box 303. During the voice-to-text operation of the phone, if the notebook computer detects the operation of the user clicking the control 304, the notebook computer can send a response to the phone, the response being used to indicate that the notebook computer can perform text editing. After receiving the response, the phone can send the text content 1 obtained before receiving the response to the notebook computer, and the notebook computer can open the App 1 and display the text content 1. If the phone continues to detect the voice content input by the user, the phone can continue to send the text content 2 corresponding to the voice content input by the user to the notebook computer. The notebook computer can append the text content 2 sent by the phone to the text content 1.

[0165] In the embodiment of the present application, when the phone performs the voice-to-text operation, the phone can notify the notebook computer that the voice-to-text function is being performed, so that the notebook computer can prompt the user whether to edit the text content on the notebook computer. When the user selects to edit on the notebook computer, the notebook computer can display the text content sent by the phone in real time, so as to facilitate the user to edit the text content and improve the user experience.

[0166] Figure 4 are another set of GUIs provided by the embodiment of the present application.

[0167] Referring to Figure 4 (a) of FIG. 14, when the phone detects the operation of the user clicking the voice-to-text control, the phone can display the interface shown in Figure 4 (b) of FIG. 14. At this time, the phone can send a request information to the notebook computer, the request information being used to request the notebook computer to edit the text content corresponding to the voice content obtained by the phone.

[0168] Referring to Figure 3 ​As shown in (b) of FIG. 4, in response to receiving the request information sent by the mobile phone, the notebook computer can start the App1. In response to the mobile phone receiving the response of the notebook computer to the request information, the mobile phone can display a prompt box 401, wherein the prompt box 401 includes prompt information “a notebook computer is detected in the surrounding, whether to send the text content to the notebook computer for editing”. When the mobile phone detects that the user clicks the control 402, the mobile phone starts to detect the voice content in the environment.

[0169] Referring to (a) of FIG. 5, the mobile phone displays a desktop. The desktop of the mobile phone includes icons of a plurality of application programs, which include a voice recorder application and the like. When the mobile phone detects that the user clicks the icon of the voice recorder application, the mobile phone displays a GUI as shown in (b) of FIG. 5. Figure 5 As shown in (c) of FIG. 4, after the mobile phone detects the voice content in the environment, the mobile phone can start to perform voice-to-text conversion. The mobile phone can collect the voice content and convert the voice content into text content “hotness changes again…social mentality”, and at the same time, the mobile phone can send the converted text content to the notebook computer, so that the notebook computer displays the text content through the App1.

[0170] In an embodiment, when the notebook computer detects that the user edits the text content on the notebook computer and detects that the user clicks the save operation, the notebook computer can send the edited text content to the mobile phone, so that the mobile phone displays the edited text content on the display interface of the memo. For details, refer to the processes of (f) to (g) of FIG. 4, which are not described herein again for brevity. Figure 5

[0171] In the embodiment of the present application, when the mobile phone performs the voice-to-text conversion operation, if it is determined that there is a device (for example, a notebook computer) around the user for facilitating text editing, the mobile phone can prompt the user whether to edit the text on the notebook computer. When the user selects to edit on the notebook computer, the notebook computer can display the text content sent by the mobile phone in real time, so as to facilitate the user to edit the text content and help to improve the user experience.

[0172] Figure 5 Another set of GUIs provided by the embodiment of the present application.

[0173] Referring to (a) of FIG. 5, the mobile phone displays a desktop. The desktop of the mobile phone includes icons of a plurality of application programs, which include a voice recorder application and the like. When the mobile phone detects that the user clicks the icon of the voice recorder application, the mobile phone displays a GUI as shown in (b) of FIG. 5. Figure 5 Figure 5

[0174] Referring to (a) of FIG. 5, the mobile phone displays a desktop. The desktop of the mobile phone includes icons of a plurality of application programs, which include a voice recorder application and the like. When the mobile phone detects that the user clicks the icon of the voice recorder application, the mobile phone displays a GUI as shown in (b) of FIG. 5. Figure 5 ​​​The GUI shown in (b) in FIG. 10 is a display interface of a recorder application. The display interface shows a recorded audio file recorded on October 3, and the recorded audio file is named as “20201003_100832”. The display interface also includes a control 501 for creating a new recorded audio file.

[0175] Referring to Figure 5 As shown in (c) in FIG. 10, when the mobile phone detects a user’s operation of clicking the control 501, the mobile phone can send an indication information to the notebook computer, where the indication information is used to indicate that the mobile phone is recording. In response to receiving the indication information, the notebook computer can display a prompt box 502, where the prompt box 502 includes prompt information “Detecting that the mobile phone is recording, do you want to record and convert to text on the notebook computer?”.

[0176] Referring to Figure 6 As shown in (d) in FIG. 10, in response to the notebook computer detecting a user’s operation of clicking the control 503, the notebook computer can start the App1. In response to the mobile phone detecting a user’s operation of clicking the control 501, the mobile phone can display a recording interface, where the recording interface shows that 25 seconds and 31 have been recorded, and the mobile phone is expected to be able to record for more than 10 hours.

[0177] The mobile phone can send the voice content to the notebook computer while collecting the voice content. The notebook computer can convert the voice content into text content “Heat changes…social mentality” after receiving the voice content, so that the notebook computer can display the text content in the App1.

[0178] In an embodiment, the notebook computer can include an ASR module, where the ASR module is used to convert the received voice content into text content.

[0179] Referring to Figure 6 As shown in (e) in FIG. 10, the notebook computer can edit the text content in the App1 in response to a user’s editing operation. For example, the user can add content (add “1,” before “Heat”, and add “2,” before “Guangzhi Think Tank”) to the text content sent by the mobile phone. For another example, the user can modify inaccurate content of the text content (for example, modify “nominal” to “public opinion”, and modify “breakthrough time” to “top 10”). For another example, the user can also modify the format of the text content (for example, the notebook computer detects a user’s operation of entering a carriage return after “livelihood demand”).

[0180] In an embodiment, when the notebook computer detects a user’s operation of clicking a save control, the notebook computer can send the edited text content to the mobile phone, so that the mobile phone can save the edited text content in an application (for example, a memo).

[0181] In the embodiment of the present application, when the mobile phone detects that the user starts recording, the mobile phone can send indication information to the surrounding notebook computer, so that the notebook computer prompts the user whether to record the call content on the notebook computer. In this way, the user can conveniently convert the voice content collected by the mobile phone into text content on the notebook computer, and the convenience of editing on the notebook computer is utilized, which helps to improve the user experience.

[0182] Figure 6 is another set of GUIs provided by the embodiment of the present application.

[0183] Referring to (a) in FIG. 6, Figure 6 The mobile phone displays a call display interface, which displays that a mobile phone number "XXX-XXXXXXXX" from Shenzhen, Guangdong is calling, in response to the mobile phone receiving the call. In response to receiving the indication information, the notebook computer can display a prompt box 601, wherein the prompt box 601 includes prompt information "The mobile phone receives a call. Do you want to convert the call content into text on the notebook computer?".

[0184] Referring to (b) in FIG. 6, Figure 3 In response to the notebook computer detecting that the user clicks the control 602, the notebook computer can start App1 and send a response to the mobile phone, which is used to indicate that the notebook computer can be used as a text content editing device. In response to the mobile phone detecting that the user accepts the call, the mobile phone can establish a call connection with the terminal device. The mobile phone can receive the voice content of another user sent by the terminal device. In response to receiving the voice content of another user, the mobile phone can send the voice content to the notebook computer.

[0185] In one embodiment, the mobile phone can also send indication information to the notebook computer when detecting that the user accepts the call, which is used to indicate that the mobile phone is in a call and requests the notebook computer to edit the text content corresponding to the call content. After receiving the indication information, the notebook computer can prompt the user "The mobile phone is in a call. Do you want to convert the call content into text on the notebook computer?". When the notebook computer detects that the user determines to use the notebook computer to convert the call content into text, the notebook computer can start App1 and receive the voice content of another user from the mobile phone. Thus, the notebook computer can convert the voice content into text content.

[0186] In one embodiment, after receiving the response, the mobile phone can convert the obtained voice content of another user into text content, so that the mobile phone can send the text content to the notebook computer.

[0187] See also Figure 7 As shown in (c) in FIG, in response to receiving the voice content from the mobile phone, the laptop computer can convert the voice content into text content "Hi, there is a meeting tomorrow morning... Please attend on time", and then display the text content through App1.

[0188] In one embodiment, when the laptop detects that the user edits the text content on the laptop and detects that the user clicks to save, the laptop can send the edited text content to the mobile phone, so that the mobile phone displays the edited text content on the memo display interface. The specific process can be referred to Figure 7 For the sake of brevity, the process from (f) to (g) will not be repeated here.

[0189] In an embodiment of the present application, when a mobile phone detects an incoming call and determines that there is a device nearby that facilitates text editing for the user (e.g., a laptop), the mobile phone can indicate to the laptop that the phone has detected an incoming call. When the user chooses to edit on the laptop, the laptop can convert the voice content received from the mobile phone into text content in real time and display it to the user, thereby facilitating the user's editing of the text content and helping to improve the user experience.

[0190] Figure 7 This is another set of GUIs provided in an embodiment of the present application.

[0191] See also Figure 7 As shown in (a) of FIG, a mobile phone displays a video call interface of a social application, in which another user is inviting the user to a video call. In response to the mobile phone receiving the video call, the mobile phone sends an indication message to a nearby laptop computer, indicating that the mobile phone has detected a video call request from another user. In response to receiving the indication message, the laptop computer may display a reminder box 701, wherein reminder box 701 includes the prompt message "The mobile phone has received a video call request. Do you want to convert the call content to text on the laptop computer?"

[0192] See also Figure 3 As shown in (b) of FIG, in response to the laptop detecting a user clicking control 702, the laptop can launch App 1 and send a response to the mobile phone, indicating that the laptop can be used as a text content editing device. In response to the mobile phone detecting the user accepting the video call request, the mobile phone can establish a video call connection with the other device. The mobile phone can receive the voice content of another user sent by the other device. In response to receiving the voice content of the other user, the mobile phone can send the voice content to the laptop.

[0193] In one embodiment, after receiving the response, the mobile phone can convert the acquired voice content of the other user into text content, so that the mobile phone can send the text content to the laptop computer.

[0194] See also Figure 6 As shown in (c) in FIG, in response to receiving the voice content from the mobile phone, the laptop computer can convert the voice content into text content "Hi, there is a meeting tomorrow morning... Please attend on time", and then display the text content through App1.

[0195] In one embodiment, when the laptop detects that the user edits the text content on the laptop and detects that the user clicks to save, the laptop can send the edited text content to the mobile phone, so that the mobile phone displays the edited text content on the memo display interface. The specific process can be referred to Figure 7 For the sake of brevity, the process from (f) to (g) will not be repeated here.

[0196] In an embodiment of the present application, when a mobile phone detects a video call and determines that there is a device nearby that facilitates text editing for the user (e.g., a laptop), the mobile phone can indicate to the laptop that the phone has detected an incoming call. When the user chooses to edit on the laptop, the laptop can convert the voice content received from the mobile phone into text content in real time and display it to the user, thereby facilitating the user's editing of the text content and helping to improve the user experience.

[0197] It should be understood that the above combination Figure 8 and Figure 8 This invention describes how, when a mobile phone receives an incoming call or video call request, it instructs nearby laptops, causing the laptops to prompt the user whether to transcribe the call content to text on the laptop. In an embodiment of the present application, the mobile phone can also instruct the laptop after receiving a voice call request from another user, causing the laptop to prompt the user whether to transcribe the call content to text on the laptop.

[0198] Figure 8 This is another set of GUIs provided in an embodiment of the present application.

[0199] See also Figure 8As shown in (a) of FIG, the mobile phone displays an incoming call display interface, which shows that the mobile phone number "XXX-XXXXXXXX" from Shenzhen, Guangdong is calling. In response to the mobile phone receiving the incoming call, the mobile phone sends an indication message to the surrounding laptop computer, which is used to indicate that the mobile phone has detected the user's incoming call. In response to receiving the indication message, the laptop computer can display a reminder box 801, where the reminder box 801 includes the prompt message "The mobile phone has received an incoming call. Do you want to convert the call content to text on the laptop computer?"

[0200] See also Figure 8 As shown in (b), when the laptop detects that the user has not clicked the cancel control or confirmed the operation of the control 802 within a preset time, the reminder box 801 can be hidden. In response to the mobile phone detecting that the user accepts the call, the mobile phone can establish a call connection with the other device.

[0201] See also Figure 8 As shown in (c), while the user is on a call with a mobile phone, if the user clicks the recording control 803, an instruction message can be sent to the laptop computer, indicating that the mobile phone is in the process of making a call and requesting the laptop computer to edit the text content corresponding to the call content. In response to receiving the instruction message, the laptop computer can once again display the reminder box 801. When the laptop computer detects the user clicking the control 802, the laptop computer can send a response to the mobile phone, indicating that the laptop computer can edit the text content corresponding to the call content. In response to receiving the response, the mobile phone can send the call content to the laptop computer.

[0202] See also Figure 9 As shown in (d) in FIG, in response to receiving the call content sent by the mobile phone, the ASR module of the laptop computer can convert the call content into text content "Hi, tomorrow morning...join", and display it in App1.

[0203] See also Figure 10 As shown in (e) in the figure, the laptop detects the user's editing operation, can edit the text content, and displays the edited text content in App1 ("XX: Hi, tomorrow morning...join").

[0204] In one embodiment of the present application, when a mobile phone detects that a user has clicked "record" during an incoming call, it sends an instruction to a laptop computer, instructing the laptop computer to edit the text content corresponding to the call. When the user chooses to edit the text content on the laptop computer, the laptop computer can convert the voice content received from the mobile phone into text content in real time and display it to the user, making it easier for the user to edit the text content and improving the user experience.

[0205] The following combination Figure 9 and Figure 9 Introducing two other display modes on laptops.

[0206] Figure 9 This is another set of GUIs provided in an embodiment of the present application.

[0207] like Figure 10 As shown in (a) in the figure, the mobile phone can display the recording-to-text interface in the memo. The mobile phone detects the voice content input by the user "The people's livelihood demands are reflected in the change and stability of the popularity", and the mobile phone can convert the voice content into text content, thereby sending the text content to the laptop. After receiving the text content, the laptop can display the text content to the user in the form of subtitles. For example, the laptop can display the text content "The people's livelihood demands are reflected in the change and stability of the popularity" in the subtitle display area 901.

[0208] like Figure 10 As shown in (b) of FIG, when the mobile phone detects the user's voice input of "Guangzhi Think Tank, we just got the statistics", the mobile phone can convert the voice content into text content and send the text content to the laptop. After receiving the text content, the laptop can display the text content to the user in the form of subtitles. For example, the laptop can display the text content "Guangzhi Think Tank, we just got the statistics" in the subtitle display area 901.

[0209] Figure 10 This is another set of GUIs provided in an embodiment of the present application.

[0210] like Figure 11 As shown in (a) in the figure, the mobile phone can display the audio-to-text interface in the memo. The mobile phone detects the voice content input by the user "The people's livelihood demands are reflected in the change and unchanged heat", and the mobile phone can convert the voice content into text content, thereby sending the text content to the laptop. After receiving the text content, the laptop can display the text content to the user in the form of subtitles. At the same time, the laptop can also open App1 and display the text content in App1. For example, the laptop can display the text content "The people's livelihood demands are reflected in the change and unchanged heat" in the subtitle display area 1001 and display the text content in App1. The user can edit the text content in App1.

[0211] like Figure 5When the mobile phone detects the voice content "Guozhi Wisdom Library we just counted" input by the user, the mobile phone can convert the voice content into text content, and send the text content to the notebook computer. After receiving the text content, the notebook computer can display the text content to the user in the form of subtitles, and the notebook computer can also display the text content after "hot change between change and invariance" in the App1. For example, the notebook computer can display the text content "Guozhi Wisdom Library we just counted" in the subtitle display area 1001, and display "hot change between change and invariance, Guozhi Wisdom Library we just counted" in the App1.

[0212] The following describes the system architecture provided by the embodiments of the present application. Figure 3 The system architecture includes a device A and a device B, where the device A can be a device with a sound pickup function (for example, a mobile phone), and the device B can be a device with an efficient editing function (for example, a notebook computer). The device A includes a sound pickup module 1110, an ASR module 1120, a transceiver control module 1130, and a replacement module 1140; and the device B includes a transceiver control module 1150, a display unit 1160, and an editing control module 1170.

[0213] The sound pickup module 1110 is configured to obtain voice content to be processed. The embodiments of the present application do not limit the manner in which the device A obtains the voice content, and the obtaining manner can be various. For example, the device A can record real-time voice from the surrounding environment of the device A; or the device A can play audio of a video on the mobile phone; or the device A can obtain audio (including far-end and near-end) when making a call through a mobile network; or the device A can obtain an audio file in the mobile phone. The sound pickup module is configured to convert the related audio into a specific audio format, such as a pulse code modulation (PCM) audio stream with a certain sampling rate, so as to serve as an input of the ASR module.

[0214] The ASR module 1120 can convert the voice content into text content. By inputting the specific PCM audio stream into the ASR module 1120, a deep neural network acoustic model trained can obtain a phoneme sequence with the highest probability, and a corresponding language model can obtain a text series with the highest probability, thereby completing the conversion from the voice content to the text content.

[0215] The transceiving control module 1130 is configured to control information synchronization between the device A and other devices. In the embodiments of the present application, the transceiving control module 1130 is responsible for the transparent transmission of information, and the transceiving control module 1130 does not involve the logical processing of the transmission content. The transmission of information can be through a local area network, such as Bluetooth, Wi-Fi or other transmission protocols (for example, internet). The device A establishes a connection network link with other devices (for example, the device B) through a network communication protocol, and then initiates the start of transmission.

[0216] It should be understood that the functions of the transceiving control module 1150 can be described with reference to the transceiving control module 1130 described above, and for the sake of brevity, will not be described here.

[0217] The display unit 1160 is configured to prompt the user whether to start text editing on the device B. After the transceiving control module 1150 receives the indication that the device A acquires the audio content (for example, voice content or an audio file) sent by the transceiving control module 1130, or the transceiving control module 1150 receives the indication that the text editing is performed on the device B sent by the transceiving control module 1130, the display unit 1160 can pop up a prompt in the form of a notification. If the device B detects that the user determines to perform text editing through the device B, the transceiving control module 1150 can send a response to the transceiving control module 1130, and the response can be used to indicate that the device B can serve as a device for text editing. When the transceiving control module 1130 of the device A receives the response, the device A starts real-time transmission of the ASR result to the device B.

[0218] In one embodiment, when the device A detects that the audio content (for example, voice content or an audio file) is acquired, the transceiving control module 1130 can send a query request for querying the devices around the device A that have text editing functions.

[0219] For example, the device A and the device B are devices under the same account, and the device A can save the device type, device name, MAC address and the like of the device B. When the device A detects that the voice content is acquired, the device A can send a BLE data packet to the device B according to the MAC address of the device B. The BLE data packet can include a PDU, and the query request can be carried in the service data field in the PDU or in the vendor-specific data field in the PDU. For example, the load of the service data field can include a plurality of bit positions, and the plurality of bit positions include an extensible bit position. The device A and the device B can agree on the content of the extensible bit position. When the extensible bit position is 1, the device B can acquire the query of the device A whether the device B has a text editing function.

[0220] For example, as shown in FIG. 6, the device A can send a BLE data packet to the device B, and the BLE data packet can include a PDU. The query request can be carried in the service data field in the PDU or in the vendor-specific data field in the PDU. Figure 12As shown in (c), when the mobile phone detects that the user clicks the control 501 (the control 501 is the control for starting recording), the mobile phone can send a BLE data packet, and the BLE data packet can carry the query request.

[0221] In one embodiment, when device A detects that a user performs a speech-to-text operation, device A may send a BLE data packet to device B based on the MAC address of device B.

[0222] For example, Figure 3 As shown in (d), when the mobile phone detects that the user clicks on the control 302 (the control 302 is a control for the mobile phone to convert speech to text), the mobile phone can send a BLE data packet, and the BLE data packet can carry the query request.

[0223] Device B's transceiver control module can call an interface for querying text editing capabilities (e.g., a contentprovider interface) to send a request to one or more applications at the application layer. This request is used to request that the application determine whether the text editing function is available. If an application has text editing capabilities, the application can send a response to the data synchronization module, indicating that app2 has logged into the account. Device B can thus determine that device B has installed and logged into app2.

[0224] After device B determines that it has text editing capabilities, it can send a response to device A, which can be carried in a BLE data packet. The BLE data packet can include a PDU, and the query request can be carried in the service data field of the PDU, or it can be carried in the vendor-specific data field of the PDU. For example, the payload of the service data field can include multiple bits, where the multiple bits include an expandable bit. Device A and device B can agree on the content of a certain expandable bit. When a certain expandable bit is 1, device A can determine that device B has text editing capabilities.

[0225] When device A determines that device B has a text editing function, device A can send the text content corresponding to the acquired audio content and instruction information to device B, where the instruction information is used to instruct device B to edit the text content.

[0226] For example, device A can send a BLE packet to device B according to the MAC address of device B. The BLE packet can include a PDU, and the text content and the indication information can be carried in the service data field of the PDU or in the vendor specific data field of the PDU. For example, the load of the service data field can include a plurality of bits, and the plurality of bits can include extensible bits. Device A and device B can agree on the content of the extensible bits. Device A can encode the text content output by the ASR module of device A by using GBK, ISO8859-1, Unicode (e.g., UTF-8, UTF-16), or the like, and carry the encoded information in one or more extensible bits. Device A can also set a certain extensible bit to 1. After receiving the BLE packet, device B can obtain the text content and the indication information by decoding, so that device B can display the text content according to the indication information.

[0227] Alternatively, when device A determines that device B has the text editing function, device A can send the text content corresponding to the acquired audio content to device B.

[0228] For example, device A can send a BLE packet to device B according to the MAC address of device B. The BLE packet can include a PDU, and the text content can be carried in the service data field of the PDU or in the vendor specific data field of the PDU. For example, the load of the service data field can include a plurality of bits, and the plurality of bits can include extensible bits. Device A and device B can agree on the content of the extensible bits. Device A can encode the text content output by the ASR module of device A by using GBK, ISO8859-1, Unicode (e.g., UTF-8, UTF-16), or the like, and carry the encoded information in one or more extensible bits. After receiving the BLE packet, device B can obtain the text content by decoding, so that device B can display the text content.

[0229] In one embodiment, device A and device B are devices under the same account, and device A can store information such as the device type, device name, MAC address, and whether device B has a text editing function of device B. When device A obtains audio content, device A can send the text content corresponding to the audio content and indication information to device B, where the indication information is used to instruct device B to edit the text content. In response to receiving the text content and the indication information, device B can prompt a user through display unit 1160 whether to edit the text content on device B. In response to detecting that the user edits the text content on device B, device B can open an application that can be used for text editing, so as to display the text content obtained from device A.

[0230] Alternatively, device A can send the text content corresponding to the audio content to device B. In response to receiving the text content, device B can edit the text content on device B, so that device B can prompt a user through display unit 1160 whether to edit the text content on device B. In response to detecting that the user edits the text content on device B, device B can open an application that can be used for text editing, so as to display the text content obtained from device A.

[0231] In the embodiments of the present application, display unit 1160 can also be used to display the text content (including intermediate results and finally determined results) output by ASR module; display unit 1160 can also be used to display the text content edited by the user on device B.

[0232] In one embodiment, after transceiver control module 1150 of device B receives the text content sent by transceiver control module 1130, the text content can be appended to the back of the previously displayed text content. For example, taking device B as a windows system, after transceiver control module 1150 of device B receives the text content, QT interface can be called to perform the following steps: (1) select all the text content displayed by App1; (2) move the cursor to the end of the text; (3) insert the new text content sent by device A; and (4) save all the text content in the current App1.

[0233] Editing control module 1170 is used for saving, editing, and displaying control of received information.

[0234] In the embodiments of the present application, the results sent to device B by ASR module 1120 can include two kinds:

[0235] The first kind is intermediate result, such as the text content determined by the ASR module 1120 before a sentence is not finished, which is not finally determined and can be used as an intermediate result. In order to reflect the real-time performance, the intermediate result is also displayed, but not saved as the final result.

[0236] For example, the ASR module of the device A detects that the user sends the corresponding word to the device B every time a word is spoken, so that the device A and the device B can display the text content synchronously. For example, the user says "I am XX", when the device A detects that the user says "I", the ASR module of the device A can send the text content ("I") to the device B after determining the corresponding word "I", so that the device B can display the text content "I". When the device A detects that the user says "is", the ASR module of the device A can send the text content ("is") to the device B after determining the corresponding word "is", so that the device B can display the text content "is" after the text content "I", until "I am XX" is displayed.

[0237] For example, the ASR module of the device A detects that the user sends the corresponding word group to the device B every time a word group is spoken, so that the device A and the device B can display the text content synchronously. For example, the user says "Any difficulties and hardships cannot hinder our steps forward", when the device A detects that the user says "any", the ASR module of the device A can send the text content ("any") to the device B after determining the corresponding word "any", so that the device B can display the text content "any". When the device A detects that the user says "difficult", the ASR module of the device A can send the text content ("difficult") to the device B after determining the corresponding word "difficult", so that the device B can display the text content "difficult" after the text content "any", until "Any difficulties and hardships cannot hinder our steps forward" is displayed.

[0238] In one embodiment, the content displayed by device A can be synchronized with the content displayed on device B, and device A can correct the text content converted by the ASR module when it determines that the user has finished speaking a sentence. For example, the user says "Today I want to eat noodles", and the ASR module of device A detects that the user has said each word or word group and sends the corresponding text content to device B. When device A detects that the user has said "want", the ASR module can determine that the corresponding text is "toward", and device A sends the corresponding text content ("toward") to device B, which can display the text content "toward". When device A determines that the user has finished speaking the sentence, it can determine that the conversion of "toward" in the previously converted text content "Today I toward eat noodles" is incorrect, and device A can automatically correct "toward" to "want", thereby updating the text content spoken by the user (from "Today I toward eat noodles" to "Today I want to eat noodles"). Device A can send the updated text content to device B, so that device B can also update "toward" to "want" in the previously displayed text content "Today I toward eat noodles", thereby displaying the updated text content "Today I want to eat noodles".

[0239] Second, after the user has finished speaking a sentence, the ASR module 1120 determines that the recognition result of the sentence will not change, and such a result replaces the previous intermediate result and is displayed as a saved result.

[0240] For example, the ASR module of device A can convert each word or word group spoken by the user into text content, but device A can not send the text content to device B until device A determines that the user has finished speaking a sentence. Instead, after device A determines that the user has finished speaking a sentence and corrects the previously converted text content, device A sends the text content corresponding to the sentence to device B.

[0241] In one embodiment, the ASR module of device A can convert each word or word group spoken by the user into text content and send it to device B, and device B can display the text content sent by device A in the form of subtitles, but device B can not display the text content in app1. When device A determines that the user has finished speaking a sentence (and corrects the previously converted text content), device A can send the text content corresponding to the sentence and indication information to device B, where the indication information indicates that device B displays the text content corresponding to the sentence in app1. After receiving the text content and indication information, device B can display the text content corresponding to the sentence in app1.

[0242] If device A is in the process of synchronizing the output result of the real-time ASR module, device B detects that the user edits the text content on device B, the editing control module 1170 also re-saves the edited result and displays it, and the subsequent ASR result is appended on this basis.

[0243] The editing control module 1170 is also configured to send the text content edited by the user to the transceiving control module 1150, so that the transceiving control module 1150 sends the edited text content to the transceiving control module 1130.

[0244] The replacing module 1140 is configured to replace the originally displayed text content with the edited text content received from the transceiving control module 1130.

[0245] In one embodiment, when the recording ends or the audio acquisition ends, device A can indicate to device B that the recording ends or the audio acquisition ends. After the user finishes editing on device B, the edited result can be synchronized to device A at one time, and the entire synchronization process is completed.

[0246] Figure 5 A schematic flowchart of a text editing method 1200 according to an embodiment of the present application is shown. The method 1200 can be implemented by the above-mentioned device A and device B, and the method 1200 comprises:

[0247] S1201, device A acquires audio content.

[0248] For example, as shown in (d) of FIG. 3, when the phone detects that the user clicks the control 302, the phone starts to collect the voice content in the environment. Figure 6

[0249] For example, as shown in (c) of FIG. 5, when the phone detects that the user clicks the control 501, the phone also collects the voice content in the environment. Figure 7

[0250] For example, as shown in (b) of FIG. 4, when the phone detects that the user accepts the call, the phone can acquire the voice content of the other user. Figure 3

[0251] For example, as shown in (b) of FIG. 6, when the phone detects that the user accepts the video call request, the phone can acquire the voice content of the other user. Figure 3

[0252] S1202, device A sends first information to device B according to the audio content.

[0253] In one embodiment, the first information is text content corresponding to the audio content.​​​​

[0254] It should be understood that in the embodiments of the present application, after obtaining the voice content, the device A can first convert the voice content into text content through the ASR module, and then send the text content to the device B. The process of converting the voice content into text content by the device A can refer to the description in the above embodiments, and will not be described here again for brevity.

[0255] In one embodiment, before sending the voice content to the device B, the method further comprises:

[0256] The device A sends a query request, and the query request is used to request the device receiving the query request to determine whether the device has a text editing function.

[0257] In response to receiving the request information sent by the device A, the device B sends a response to the device A, and the response is used to indicate that the device B has a text editing function.

[0258] In response to receiving the response, the device A sends the first information to the device B.

[0259] In the embodiments of the present application, the device A broadcasts the query request to the surrounding devices. Alternatively, the device A can save the device information of the device B (for example, the device A and the device B are devices under the same account, or the device A and the device B are devices under different accounts in the same family group).

[0260] It should be understood that the process of sending the query request by the device A can refer to the description in the above embodiments, and will not be described here again for brevity.

[0261] In one embodiment, in response to receiving the query request, the device B can prompt a user whether to perform text editing on the device B; and in response to an operation of the user determining to perform text editing on the device B, the device B sends the response to the device A.

[0262] For example, as shown in (d) of FIG. 3, when the notebook computer detects the query request sent by the mobile phone, the notebook computer can display a prompt box 303, and the prompt box 303 includes prompt information “detecting that the mobile phone is performing voice-to-text conversion, whether to perform text editing on the notebook computer”. In response to an operation of the user clicking a control 304, the notebook computer can send the response to the mobile phone. Figure 5

[0263] In one embodiment, after receiving the response sent by the device B, the device A can send request information to the device B, and the request information is used to request the device B to edit the text content output by the device A; or the request information is used to request the device B to edit the text content corresponding to the audio content.

[0264] For example, as shown in (d) of FIG. 3, when the notebook computer detects the query request sent by the mobile phone, the notebook computer can display a prompt box 303, and the prompt box 303 includes prompt information “detecting that the mobile phone is performing voice-to-text conversion, whether to perform text editing on the notebook computer”. In response to an operation of the user clicking a control 304, the notebook computer can send the response to the mobile phone.​Figure 3 As shown in (d) of the figure, when the mobile phone detects that the user has clicked control 302, the mobile phone can send a query request to surrounding devices to inquire whether the surrounding devices have text editing functions. In response to receiving the response sent by the laptop, the mobile phone can determine that the laptop has text editing functions. The mobile phone can continue to send request information to the laptop, which is used to edit the text content output by the mobile phone. In response to receiving the request information from the mobile phone, the laptop can display a reminder box 303. In response to the user clicking control 304, the laptop can send a response to the mobile phone, which is used to indicate that the laptop can edit the text content. In response to receiving the response, the mobile phone can send the text content to the laptop.

[0265] For example, Figure 3 As shown in (c), when the mobile phone detects that the user clicks on the control 501, it sends a query request to the surrounding devices; in response to receiving the response sent by the laptop, the mobile phone can determine that the laptop has a text editing function. The mobile phone can send a request message to the laptop, and the request message is used to request the laptop to edit the text content corresponding to the audio content obtained by the mobile phone. In response to receiving the request message, the laptop can display a reminder box 502, wherein the reminder box 502 includes a prompt message "It is detected that the mobile phone is recording, do you want to convert the recording to text on the laptop?" In response to the user clicking on the control 503, the laptop can send a response to the mobile phone, and the response is used to indicate that the laptop can edit the text content corresponding to the recording. In response to receiving the response, the mobile phone can send text content to the laptop.

[0266] It should also be understood that device B can send the response information to device A via a BLE data packet. The specific sending process can refer to the above-mentioned process of device A sending a BLE data packet to device B. For the sake of brevity, it will not be repeated here.

[0267] For example, the request information can be carried in a User Datagram Protocol (UDP) packet. A UDP packet includes the data portion of an IP datagram. The data portion of an IP datagram may include an expandable bit. Device A and device B can agree on the content of a certain expandable bit. When the certain expandable bit is 1, device B can be informed that device A requests to edit the text content.

[0268] The UDP packet may also carry the IP address and port number of device A (including the source port number and destination port number, where the source port number refers to the port number used by device A to send data, and the destination port number refers to the port used by device A to receive data). Device A's IP address and port number may be included in the UDP header of the data portion of the IP datagram. In response to receiving the UDP packet, device B may establish a Transmission Control Protocol (TCP) connection with device A.

[0269] It should be understood that after device B and device A establish a TCP connection, device B can send the response to device A through the TCP connection.

[0270] For example, if a UDP packet carries the IP address and destination port number of device A, device B can establish a TCP connection with device A using the IP address and destination port number. Device A can then send the text content input by device A's ASR module to device B via the TCP connection.

[0271] In one embodiment, the method 1200 further includes: when device A converts the voice content into text content, device A displays the text content.

[0272] For example, Figure 3 As shown in (e), after the mobile phone detects the voice content in the environment, it can convert the voice content into text content, and then display the text content through the display interface of the memo application.

[0273] S1203: Device B displays text content corresponding to the audio content according to the first information.

[0274] For example, Figure 3 As shown in (e) in FIG, after receiving the text content sent by the mobile phone, the laptop computer can display the text content through App1.

[0275] S1204: Upon detecting that the user has edited the text content, device B may display the edited text content.

[0276] For example, Figure 3 As shown in (f) and (g), after the laptop detects the user's operation of editing the text content, the laptop can display the edited text content.

[0277] In one embodiment, the method 1200 further includes: device B sending the edited text content to device A.

[0278] In one embodiment, device B detects the user's first operation and sends the edited text content to device A.

[0279] For example, Figure 3 As shown in (f) in FIG, when the laptop detects that the user clicks the control 307, the laptop can send the edited text content to the mobile phone.

[0280] For example, Figure 3 As shown in (g), when the laptop detects that the user clicks the control 307, the laptop can send the edited text content to the mobile phone.

[0281] In one embodiment, after receiving the edited text content, device A can use the edited text content to edit the previously displayed text content. Figure 3 As shown in (e) and (f) in FIG, when the laptop detects that the user clicks the save control 307, the laptop can send the edited text content to the mobile phone. The mobile phone can use the user edited text content to replace the previously displayed text content.

[0282] In the embodiment of the present application, when device B detects a user editing operation on the text content sent by device A, it can edit the text content accordingly. Figure 13 As shown in (g) in the figure, when the laptop detects a user editing text content, the text content received from the mobile phone can be edited. For example, the laptop can detect the user changing "正成功" to "郑成功"; for another example, the laptop can detect the user adding the symbol "." after "年特性"; for another example, the laptop can detect the user inserting the symbol "、" in "醫療教育房食食安全"; for another example, the laptop can detect the user pressing Enter after "社会精神?"

[0283] Device B can send the edited text content to device A via a BLE data packet or a TCP connection. The sending method can refer to the description in the above embodiment and will not be repeated here for the sake of brevity.

[0284] In one embodiment, if device B detects that the user has edited the format of the text content, then when device B sends the edited text content to device A, it can also indicate the format information of the text content to device A. For example, the format of the text content may include a line break (or carriage return) operation between two words in the text content; or a space between two words. For example, Figure 11 As shown in (g) in the figure, while the laptop computer sends the edited text content to the mobile phone, it can also indicate to the mobile phone that there is a line break between "求" and "2", and between "?" and "3".

[0285] In one embodiment, after detecting the operation of the user modifying the format of the text content, the device B can send the edited text content and the format information of the text content to the device A. The implementation of the device B sending the edited text content to the device A can refer to the description in the above embodiments, and is not described here for brevity. The following describes an implementation of the device B sending the format information of the edited text content to the device A. Exemplarily, the format of the text content includes font size, font color, font slant, font underline, background color of the font, and carriage return operation after a character in the text content.

[0286] Exemplarily, the device A can send the format information of the edited text content to the device B through a BLE data packet. The text content can be carried in a service data field or a vendor specific data field in the PDU. For example, the payload of the service data field can include a plurality of bits, wherein the plurality of bits include extensible bits. For a character (e.g., a word, a character, or a symbol) in the edited text content, the device A and the device B can agree on the content of certain extensible bits. Exemplarily, when a certain extensible bit is 000, the device A can know that the character is not slanted, not underlined, and no carriage return operation after the character. Exemplarily, when a certain extensible bit is 100, the device A can know that the character is slanted, not underlined, and no carriage return operation after the character. Exemplarily, when a certain extensible bit is 010, the device A can know that the character is not slanted, underlined, and no carriage return operation after the character. Exemplarily, when a certain extensible bit is 001, the device A can know that the character is not slanted, not underlined, and there is a carriage return operation after the character.

[0287] For a character (e.g., a word, a character, or a symbol) in the edited text content, the device A and the device B can agree on the content of certain extensible bits. Exemplarily, when a certain extensible bit is 000, the device A can know that the font color of the character is black. Exemplarily, when a certain extensible bit is 001, the device A can know that the font color of the character is gray. Exemplarily, when a certain extensible bit is 010, the device A can know that the color of the character is blue. Exemplarily, when a certain extensible bit is 100, the device A can know that the font color of the character is blue.

[0288] It should be understood that the process of the device B indicating the font background color of a character in the edited text content to the device A can also refer to the description in the above embodiments.

[0289] For a character (e.g., a word, a character or a symbol) in the edited text content, device A and device B can agree on the content of some extendable bits. For example, when the content of some extendable bits is 000, device A can know that the font size of the character is 10. For example, when the content of some extendable bits is 001, device A can know that the font size of the character is 12. For example, when the content of some extendable bits is 010, device A can know that the font size of the character is 14. For example, when the content of some extendable bits is 100, device A can know that the font size of the character is 18.

[0290] It should be understood that the format of the text content is not limited in the embodiments of the present application. After receiving the format information of the edited text content, device B can display the edited text content according to the edited text content and the format information of the edited text content. The text content displayed on device B corresponds to the text content displayed on device A.

[0291] In one embodiment, the method 1200 further includes: device A replacing the original text content with the edited text content received from device B; and device A displaying a second interface including the edited text content in response to receiving the edited text content from device B.

[0292] For example, as shown in (f) and (g) of FIG. 13, the notebook computer sends the edited text content to the mobile phone in response to the user clicking the save control 307. After receiving the edited text content, the mobile phone can replace the text content displayed on the original interface with the edited text content. Figure 14

[0293] In one embodiment, when device B sends the edited text content to device A, device B can also send the identification information of the edited text content to device A.

[0294] It should be understood that S1204 is an optional step. Device B can also not send the edited text content to device A. Instead, device B can save the edited text content locally.

[0295] Figure 12 Another system architecture provided by the embodiments of the present application is shown. The system architecture includes device A and device B, wherein device A can be a device with a sound pickup function (e.g., a mobile phone), and device B can be a device with an efficient editing function (e.g., a notebook computer). Device A includes a sound pickup module 1310 and a transceiving control module 1320; device B includes a receiving transceiving control module 1330, an ASR module 1340, a display module 1350 and an editing control module 1360. The sound pickup module 1310 of device A can receive the text content displayed on device B, and the transceiving control module 1320 of device A can send the received text content to device B. Figure 15 ​The difference between the illustrated system architecture is that the ASR module can be included in device B. Device A can be responsible for obtaining voice content or an audio file, and device A sends the obtained voice content or audio file to the transceiving control module 1330 of device B through the transceiving control module 1320, so that the voice content or audio file is converted into text content by the ASR module 1340 of device B, and thus device B can display the converted text content to the user. Device B can also display the edited text content through the display module 1340 after detecting the user's editing operation on the text content through the editing control module 1360.

[0296] Figure 12 A schematic block diagram of the apparatus 1400 provided by the embodiments of the present application is shown. The apparatus 1400 can be arranged in the device A in the above Figure 16 embodiments, and the apparatus 1400 includes: an obtaining unit 1410, configured to obtain audio content; and a sending unit 1420, configured to send first information to a second electronic device, the first information being the audio content, or the first information being first text content corresponding to the audio content, so that the second electronic device displays the first text content according to the first information and detects a user's editing operation on the first text content.

[0297] Figure 16 A schematic block diagram of the apparatus 1500 provided by the embodiments of the present application is shown. The apparatus 1500 can be arranged in the device B in the above ​ embodiments, and the apparatus 1500 includes: a receiving unit 1510, configured to receive first information sent by a first electronic device, the first information being audio content obtained by the first electronic device, or the first information being first text content corresponding to the audio content; a display unit 1520, configured to display the first text content according to the first information; and a detection unit 1530, configured to detect a user's editing operation on the first text content. The display unit 1520 is further configured to display second text content, the second text content being text content edited from the first text content.

[0298] ​ A schematic structural diagram of an electronic device 1600 provided by the embodiments of the present application is shown. As ​ shown, the electronic device includes one or more processors 1610 and one or more memories 1620, the one or more memories 1620 storing one or more computer programs including instructions. When the instructions are run by the one or more processors 1610, the first electronic device or the second electronic device performs the technical solutions in the above embodiments.

[0299] The embodiment of the present application provides a system, including device A and device B, which is used for executing the technical scheme in the above embodiment. The implementation principle and technical effect are similar to the above method-related embodiment, and details are not described herein again.

[0300] The embodiment of the present application provides a computer program product, which makes device A execute the technical scheme in the above embodiment when the computer program product is run in device A (or the mobile phone in the above embodiment). The implementation principle and technical effect are similar to the above method-related embodiment, and details are not described herein again.

[0301] The embodiment of the present application provides a computer program product, which makes device B execute the technical scheme in the above embodiment when the computer program product is run in device B (or the notebook computer in the above embodiment). The implementation principle and technical effect are similar to the above method-related embodiment, and details are not described herein again.

[0302] The embodiment of the present application provides a readable storage medium, which contains instructions, which makes device A execute the technical scheme in the above embodiment when the instructions are run in device A (or the mobile phone in the above embodiment). The implementation principle and technical effect are similar, and details are not described herein again.

[0303] The embodiment of the present application provides a readable storage medium, which contains instructions, which makes device B execute the technical scheme in the above embodiment when the instructions are run in device B (or the notebook computer in the above embodiment). The implementation principle and technical effect are similar, and details are not described herein again.

[0304] The embodiment of the present application provides a chip, which is used for executing instructions, and executes the technical scheme in the above embodiment when the chip is run. The implementation principle and technical effect are similar, and details are not described herein again.

[0305] Those skilled in the art can realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be realized in electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software mode depends on the specific application and design constraints of the technical scheme. The skilled person can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0306] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system, device and unit described above can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.

[0307] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be implemented in other manners. For example, the described device embodiments are merely schematic. The division of the units is merely logical function division. There can be other division manners in actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections can be indirect couplings or communication connections through some interfaces, devices or units, and can be in electrical, mechanical or other forms.

[0308] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, i.e., can be located in one place, or can be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0309] In addition, each functional unit in the various embodiments of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit.

[0310] If the functions are realized in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application can be embodied in the form of a software product, and the computer software product is stored in a storage medium, and includes a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various program code storage media.

[0311] The above is merely specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A text editing system, characterized in that: The system includes a first electronic device and a second electronic device, wherein: The first electronic device is configured to obtain audio content; The first electronic device is further configured to broadcast a query request to surrounding devices or to send a query request to the second electronic device according to the MAC address of the second electronic device, wherein the query request is used by the device receiving the query request to determine whether the device has a text editing function; The second electronic device is configured to send a response to the first electronic device after determining that the at least one application has a text editing function, wherein the response indicates that the second electronic device has a text editing function and that the at least one application is installed on the second electronic device; The first electronic device is further configured to, in response to receiving the response sent by the second electronic device, send first information to the second electronic device according to the MAC address of the second electronic device, where the first information is the audio content, or the first information is first text content corresponding to the audio content; the second electronic device being configured to display the first text content according to the first information; The second electronic device is further configured to display a second text content in response to a user editing operation on the first text content, where the second text content is text content after editing the first text content.

2. The system according to claim 1, wherein: The second electronic device is further configured to send the second text content to the first electronic device.

3. The system according to claim 2, characterized in that The editing operation includes a format modification operation on the first text content, wherein: The second electronic device is further configured to send format information of the second text content to the first electronic device.

4. The system according to claim 3, characterized in that The format information of the second text content includes one or more of the font color, font size, font background color, font italicization, font underline and the enter operation in the second text content.

5. The system according to any one of claims 2 to 4, characterized in that The first electronic device is further used for: Before receiving the second text content sent by the second electronic device, displaying the first text content according to the audio content; After receiving the second text content sent by the second electronic device, the first text content is replaced by the second text content.

6. The system according to any one of claims 1 to 4, characterized in that The second electronic device is specifically used for: In response to receiving the first information, prompting the user whether to edit the text on the second electronic device; In response to the user determining to perform a text editing operation on the second electronic device, the first text content is displayed.

7. The system according to any one of claims 1 to 4, characterized in that The first information is the first text content, and the first electronic device is specifically configured to: In response to acquiring the audio content, converting the audio content into the first text content; The first text content is sent to the second electronic device.

8. The system according to any one of claims 1 to 4, characterized in that The first information is the audio content, and the second electronic device is specifically configured to: In response to receiving the audio content, converting the audio content into the first text content; The first text content is displayed.

9. The system according to any one of claims 1 to 4, characterized in that The account of the first electronic device is associated with the account of the second electronic device.

10. A text editing method, characterized in that: The method is applied to a first electronic device, and includes: The first electronic device acquires audio content; The first electronic device broadcasts a query request to surrounding devices or sends a query request to the second electronic device according to the MAC address of the second electronic device, wherein the query request is used for the device receiving the query request to determine whether the device has a text editing function; In response to receiving a response sent by the second electronic device, the first electronic device sends first information to the second electronic device according to the MAC address of the second electronic device, where the response is used to indicate that the second electronic device has a text editing function. The response is sent by the second electronic device after determining that at least one installed application has a text editing function. The first information is the audio content, or the first information is the first text content corresponding to the audio content, so that the second electronic device displays the first text content according to the first information and detects the user's editing operation on the first text content.

11. The method according to claim 10, characterized in that The method further comprises: The first electronic device receives second text content sent by the second electronic device, where the second text content is text content edited by a user on the second electronic device on the first text content.

12. The method according to claim 11, characterized in that The method further comprises: The first electronic device receives format information of the second text content sent by the second electronic device.

13. The method according to claim 12, characterized in that The format information of the second text content includes one or more of the font color, font size, font background color, font italicization, font underline and the enter operation in the second text content.

14. The method according to any one of claims 11 to 13, characterized in that The method further comprises: Before receiving the second text content sent by the second electronic device, the first electronic device displays the first text content according to the audio content; After receiving the second text content sent by the second electronic device, the first electronic device replaces the first text content with the second text content.

15. The method according to any one of claims 10 to 13, characterized in that The first information is the first text content, and the method further includes: In response to acquiring the audio content, the first electronic device converts the audio content into the first text content; The first electronic device sends the first text content to the second electronic device.

16. The method according to any one of claims 10 to 13, characterized in that The account of the first electronic device is associated with the account of the second electronic device.

17. A text editing method, characterized in that: The method is applied to a second electronic device, and includes: The second electronic device receives a query request sent by the first electronic device, where the query request is used by the second electronic device to determine whether the second electronic device has a text editing function, and the query request is broadcasted by the first electronic device or sent according to the MAC address of the second electronic device; The second electronic device sends a response to the first electronic device after determining that the at least one application has a text editing function, wherein the response indicates that the second electronic device has a text editing function and that the at least one application is installed on the second electronic device; The second electronic device receives first information sent by the first electronic device, where the first information is audio content acquired by the first electronic device, or the first information is first text content corresponding to the audio content, and the first information is sent by the first electronic device based on the MAC address of the second electronic device; The second electronic device displays the first text content according to the first information; In response to the user's editing operation on the first text content, the second electronic device displays a second text content, where the second text content is the text content after editing the first text content.

18. The method according to claim 17, characterized in that The method further comprises: The second electronic device sends the second text content to the first electronic device.

19. The method according to claim 18, characterized in that The editing operation includes a format modification operation on the first text content, and the method further includes: The second electronic device sends format information of the second text content to the first electronic device.

20. The method according to claim 19, wherein The format information of the second text content includes one or more of the font color, font size, font background color, font italicization, font underline and the enter operation in the second text content.

21. The method according to any one of claims 17 to 20, characterized in that The second electronic device displays the first text content according to the first information, including: In response to receiving the first information, the second electronic device prompts the user whether to edit the text on the second electronic device; In response to the user determining to perform a text editing operation on the second electronic device, the second electronic device displays the first text content.

22. The method according to any one of claims 17 to 20, characterized in that The first information is the audio content, and before the second electronic device displays the first text content, the method further includes: In response to receiving the audio content, the audio content is converted into the first text content.

23. The method according to any one of claims 17 to 20, characterized in that The account of the first electronic device is associated with the account of the second electronic device.

24. An electronic device, characterized in that: include: one or more processors; one or more memories; The one or more memories store one or more computer programs, and the one or more computer programs include instructions, which, when executed by the one or more processors, enable the electronic device to perform the method according to any one of claims 10 to 16.

25. An electronic device, characterized in that: include: one or more processors; one or more memories; The one or more memories store one or more computer programs, and the one or more computer programs include instructions, which, when executed by the one or more processors, enable the electronic device to perform the method according to any one of claims 17 to 23.

26. A computer-readable storage medium, characterized in that comprising computer instructions, which, when executed on an electronic device, cause the electronic device to execute the method according to any one of claims 10 to 16; or When the computer instructions are executed on an electronic device, the electronic device is caused to perform the method according to any one of claims 17 to 23.

Images