Voice collaborative input method, electronic device, and computer-readable storage medium
By detecting preset operations on a first electronic device, acquiring voice content, converting it into text, and transmitting it to a second device for display, the problem of complex operation and low efficiency of existing voice input methods is solved, thereby improving user experience and input efficiency.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HUAWEI TECH CO LTD
- Filing Date
- 2021-12-30
- Publication Date
- 2026-04-10
AI Technical Summary
Existing voice input methods are complex to operate, inefficient, and provide a poor user experience.
By detecting preset operations (such as raising or flipping the wrist), the system acquires voice content on a first electronic device, converts it into text content, and then transmits the text content to a designated second electronic device for display, simplifying user operations and improving efficiency.
It simplifies voice input, improves user experience and input efficiency, and ensures privacy and accuracy.
Smart Images

Figure CN116416994B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application belongs to the technical field of terminal, and particularly relates to a voice cooperative input method, an electronic device and a computer readable storage medium. BACKGROUND
[0002] Electronic devices such as mobile phones and tablet computers generally have a voice-to-text function, so that users can quickly input text content through voice. At present, the implementation of voice-to-text can include: 1) long press a specific key first, then input a voice containing "voice-to-text", and then input the voice content to be converted; 2) input a preset wake-up phrase first, then input a voice containing "voice-to-text", and then input the voice content to be converted; 3) find and open a specific application, then click the "voice-to-text" button in the application, and then input the voice content to be converted. These methods all require the user to perform multiple operations, which are relatively complex and inefficient. SUMMARY
[0003] The embodiments of the present application provide a voice cooperative input method, an electronic device and a computer readable storage medium, which can solve the problems of complex operation and low efficiency of existing voice input.
[0004] In a first aspect, the embodiments of the present application provide a voice cooperative input method applied to a first electronic device, which can include:
[0005] The first electronic device detects a preset operation;
[0006] The first electronic device acquires voice content;
[0007] In response to the preset operation, the first electronic device converts the voice content into text content;
[0008] The first electronic device determines a second electronic device and sends the text content to the second electronic device, wherein after the second electronic device receives the text content, the text content is displayed on the display interface of the second electronic device.
[0009] By the voice cooperative input method, when the user wants to input text content by voice to a certain electronic device, the user can perform a preset operation on the first electronic device. When the first electronic device detects the preset operation, the first electronic device can convert the obtained voice content into text content. Meanwhile, the first electronic device can determine the second electronic device, i.e., determine the electronic device to which the user wants to input the text content by voice, and can transmit the text content to the second electronic device. In the embodiment of the application, the user only needs to perform a simple preset operation, i.e., the voice input of the text content to the second electronic device can be realized by the voice recognition function of the first electronic device, without the user performing multiple operations in the second electronic device. The operation is simple and convenient, the input efficiency is high, the user experience can be improved, and the method has strong usability and practicality.
[0010] For example, the preset operation includes a wrist lifting operation, or includes a wrist lifting operation and a wrist turning operation.
[0011] In the voice cooperative input method provided in the implementation mode, the first electronic device can input text content by voice to the second electronic device according to the wrist lifting operation or the wrist lifting operation and the wrist turning operation, so as to perform soft voice input by moving the first electronic device to the vicinity of the mouth by lifting the wrist, and at the same time, the mouth can be shielded by the wrist, so as to ensure that the voice input does not disturb people nearby and ensure the privacy of the voice input, and improve the user experience.
[0012] In a possible implementation mode, the first electronic device determining the second electronic device can include:
[0013] The first electronic device determines whether there is a target device located in the same hand as the first electronic device;
[0014] When there is a target device located in the same hand as the first electronic device, the first electronic device determines the target device as the second electronic device.
[0015] In the voice cooperative input method provided in the implementation mode, the first electronic device can determine the target device located in the same hand as the first electronic device as the second electronic device, so as to determine the target device to which the user is most likely to need to input text content by voice as the second electronic device, which can improve the accuracy and efficiency of the voice input of the text content, thereby improving the user experience.
[0016] In an example, the first electronic device determining whether there is a target device located in the same hand as the first electronic device can include:
[0017] The first electronic device obtains first acceleration data corresponding to the first electronic device and second acceleration data corresponding to at least one third electronic device.
[0018] The first electronic device determines whether there is a target device located in the same hand as the first electronic device according to the first acceleration data and the second acceleration data.
[0019] In the voice cooperative input method provided in this implementation, the first electronic device can accurately determine whether there is a target device located in the same hand as the first electronic device according to the acceleration data of the first electronic device and the acceleration data of each third electronic device.
[0020] For example, the first electronic device determines whether there is a target device located in the same hand as the first electronic device according to the first acceleration data and the second acceleration data, which can include:
[0021] When the first electronic device determines that there is a fourth electronic device according to the first acceleration data and the second acceleration data, the first electronic device determines that the fourth electronic device is the target device, wherein the change time of the acceleration of the fourth electronic device on each axis is substantially the same as the change time of the acceleration of the first electronic device on each axis, and the direction of the acceleration of the fourth electronic device on the z axis is opposite to the direction of the acceleration of the first electronic device on the z axis, but the size is substantially the same.
[0022] It should be understood that when the first electronic device and the target device are located in the same hand, and the orientation of the display interface of the first electronic device is different from the orientation of the display interface of the target device, if the first electronic device is moved, the target device will also move synchronously, that is, the change time corresponding to the acceleration of the first electronic device on each axis is substantially the same as the change time corresponding to the acceleration of the target device on each axis. At the same time, since the orientation of the display interface of the first electronic device is different from the orientation of the display interface of the target device, the direction of the acceleration of the first electronic device on the z axis is opposite to the direction of the acceleration of the target device on the z axis, but the size is substantially the same during the entire movement.
[0023] It should be noted that substantially the same means that the difference between the two is less than or equal to a first preset threshold. The first preset threshold can be set according to the actual scene, and the embodiments of the present application do not make specific limitations.
[0024] For example, the first electronic device determines whether there is a target device located in the same hand as the first electronic device according to the first acceleration data and the second acceleration data, which can include:
[0025] The first electronic device determines, according to the first acceleration data and each of the second acceleration data, that there is a fourth electronic device, and the first electronic device determines the fourth electronic device as the target device, wherein the change time of the acceleration of the fourth electronic device on each axis is substantially the same as the change time of the acceleration of the first electronic device on each axis, and the direction and size of the acceleration of the fourth electronic device on the z axis are substantially the same as the direction and size of the acceleration of the first electronic device on the z axis.
[0026] It should be understood that when the first electronic device and the target device are located in the same hand, and the orientation of the display interface of the first electronic device is the same as the orientation of the display interface of the target device, if the first electronic device is moved, the target device will also be moved synchronously, that is, the change time of the acceleration of the first electronic device on each axis is substantially the same as the change time of the acceleration of the target device on each axis. At the same time, since the orientation of the display interface of the first electronic device is the same as the orientation of the display interface of the target device, the direction and size of the acceleration of the first electronic device on the z axis are substantially the same as the direction and size of the acceleration of the target device on the z axis during the entire movement.
[0027] In another example, the first electronic device determining whether there is a target device located in the same hand as the first electronic device can include:
[0028] The first electronic device obtains first angular velocity data corresponding to the first electronic device and second angular velocity data corresponding to at least one third electronic device;
[0029] The first electronic device determines, according to the first angular velocity data and each of the second angular velocity data, whether there is a target device located in the same hand as the first electronic device.
[0030] In the voice cooperative input method provided by the implementation mode, the first electronic device can accurately determine whether there is a target device located in the same hand as the first electronic device according to the angular velocity data of the first electronic device and the angular velocity data of each third electronic device.
[0031] For example, the first electronic device determines, according to the first angular velocity data and each of the second angular velocity data, whether there is a target device located in the same hand as the first electronic device, which can include:
[0032] The first electronic device determines, according to the first angular velocity data and each of the second angular velocity data, that there is a fifth electronic device, and the first electronic device determines the fifth electronic device as the target device, wherein the change time of the angular velocity of the fifth electronic device around each axis is substantially the same as the change time of the acceleration of the first electronic device around each axis, and the change direction of the angular velocity of the fifth electronic device around the x-axis is substantially the same as the change direction of the angular velocity of the first electronic device around the x-axis, but the change amplitude is different.
[0033] For example, the first electronic device determines, according to the first angular velocity data and each of the second angular velocity data, whether there is a target device in the same hand as the first electronic device, which can include:
[0034] The first electronic device determines, according to the first angular velocity data and each of the second angular velocity data, that there is a fifth electronic device, and the first electronic device determines the fifth electronic device as the target device, wherein the change time of the angular velocity of the fifth electronic device around each axis is substantially the same as the change time of the angular velocity of the first electronic device around each axis, and the change direction of the angular velocity of the fifth electronic device around the z-axis is substantially the same as the change direction of the angular velocity of the first electronic device around the z-axis, but the change amplitude is different.
[0035] In another example, the first electronic device determines whether there is a target device in the same hand as the first electronic device, which can include:
[0036] The first electronic device obtains a first movement distance corresponding to the first electronic device and a second movement distance corresponding to at least one third electronic device.
[0037] When the difference between the third movement distance and the first movement distance is less than or equal to a preset threshold, the first electronic device determines the third electronic device corresponding to the third movement distance as a target device in the same hand as the first electronic device, and the third movement distance is one of the at least one second movement distance.
[0038] It should be understood that if the target device is in the same hand as the first electronic device, when the first electronic device is moved, the target device will also move synchronously, that is, the first movement distance corresponding to the first electronic device and the second movement distance corresponding to the target device will be substantially the same. Therefore, the first electronic device can determine whether there is a target device in the same hand as the first electronic device according to the movement distance.
[0039] It should be noted that the first electronic device can also determine whether there is a target device located in the same hand as the first electronic device according to the acceleration data and / or the angular velocity data and the movement distance. For example, the first electronic device can determine whether there is a target device located in the same hand as the first electronic device according to the acceleration data and the movement distance. For example, the first electronic device can also determine whether there is a target device located in the same hand as the first electronic device according to the angular velocity data and the movement distance. For example, the first electronic device can determine whether there is a target device located in the same hand as the first electronic device according to the acceleration data, the angular velocity data and the movement distance.
[0040] Optionally, the at least one third electronic device is an electronic device satisfying one or more of the following conditions:
[0041] The distance between the third electronic device and the first electronic device is less than or equal to a first distance threshold;
[0042] The third electronic device logs in the same user account as the first electronic device;
[0043] The device type of the third electronic device is a preset type.
[0044] It should be understood that the first distance threshold can be set by a technician according to an actual scene, or can be set by a user. For example, the technician can set the first distance threshold to 10 cm, 15 cm or 30 cm, etc. according to an actual scene. The preset type can be the type of an electronic device that can be held and operated by a user, such as a mobile phone or a tablet computer.
[0045] For example, the third electronic device can be an electronic device with a distance less than or equal to the first distance threshold from the first electronic device, so that the finally determined second electronic device is an electronic device close to the user and convenient for the user to operate. Alternatively, the third electronic device can be an electronic device logging in the same user account as the first electronic device or capable of controlling the first electronic device, so that the second electronic device finally obtaining the text content is an electronic device of the same user as the first electronic device or an electronic device authorized by the user of the first electronic device and capable of controlling the first electronic device, ensuring the privacy of the text content and protecting the privacy of the user.
[0046] In another possible implementation, after determining whether there is a target device located in the same hand as the first electronic device, the method can further include:
[0047] When there is no target device located in the same hand as the first electronic device, the first electronic device obtains a device state of at least one fourth electronic device;
[0048] The first electronic device determines the second electronic device from the at least one fourth electronic device according to the device state.
[0049] In one example, the first electronic device determines the second electronic device from the at least one fourth electronic device according to the device state, which can include:
[0050] The first electronic device determines an electronic device with a preset device state from the at least one fourth electronic device, and determines the second electronic device according to the electronic device with the preset device state.
[0051] The preset device state is any one of a first state, a second state and a third state, the first state is a state of existing a window or an input box for inputting content, the second state is a state of detecting a click operation or a touch operation within a first preset time length, and the third state is a state of detecting a mouse click event or a keyboard input event within a second preset time length.
[0052] In the voice collaborative input method provided in the implementation, a user can perform a specified operation (for example, opening a window or an input box, or clicking or touching a screen, etc.) in an electronic device in which text content needs to be input by voice, so that the device state of a second electronic device is a preset state, and the first electronic device can accurately determine the second electronic device in which the user wants to input text content by voice according to the device state, so as to accurately input text content corresponding to voice content to the second electronic device, simplify the operation of inputting text content by voice to the second electronic device, and improve user experience.
[0053] In another example, the first electronic device determines an electronic device with a preset device state from the at least one fourth electronic device, and determines the second electronic device according to the electronic device with the preset device state, which can include:
[0054] When it is determined that there is an electronic device with the first state in the at least one fourth electronic device, the first electronic device determines the electronic device with the first state as the second electronic device.
[0055] In another example, when the electronic devices with the first state in the at least one fourth electronic device include multiple electronic devices, the first electronic device determines the second electronic device, which can include:
[0056] The first electronic device determines a first active time corresponding to each electronic device with the first state, and determines an electronic device with a first active time closest to a current time as the second electronic device.
[0057] The first active time corresponding to the electronic device is a time when the electronic device last detects a click operation or a touch operation, or a time when the electronic device last detects a mouse click event or a keyboard input event.
[0058] In the voice cooperative input method provided in this implementation, when there are multiple electronic devices in the first state, the first electronic device can determine the electronic device most likely to need voice input text content as the second electronic device according to the active time corresponding to each electronic device, so as to accurately input the text content corresponding to the voice content to the electronic device intended by the user, and improve user experience.
[0059] In another example, when the electronic devices in the first state in the at least one fourth electronic device include multiple electronic devices, the first electronic device can determine the electronic devices in the first state as the second electronic device, which can include:
[0060] The first electronic device obtains the existing content in the window or input box of each electronic device in the first state.
[0061] The first electronic device determines the matching degree of the text content and each existing content, and determines the electronic device with the highest matching degree as the second electronic device.
[0062] In the voice cooperative input method provided in this implementation, when there are multiple electronic devices in the first state, the first electronic device can determine the second electronic device according to the matching degree of the existing content in the window or input box of each electronic device and the text content, so as to improve the accuracy of the determination of the second electronic device, thereby accurately inputting the text content to the electronic device intended by the user and improving user experience.
[0063] Optionally, the text content can be displayed in the window or the input box of the second electronic device.
[0064] In the voice cooperative input method provided in this implementation, when the device state of the second electronic device is in the first state, that is, when there is a window or an input box that can input content in the second electronic device, the text content can be directly displayed in the window or the input box displayed by the second electronic device, so as to facilitate the user to perform corresponding operations (for example, copying, sending, etc.) on the text content, and improve user experience.
[0065] In another example, the first electronic device determines the electronic device in the at least one fourth electronic device in the preset state, and determines the second electronic device according to the electronic device in the preset state, which can include:
[0066] When there is no electronic device in the at least one fourth electronic device in the first state, but there is an electronic device in the second state and / or the third state, the first electronic device acquires a second active time of each electronic device in the second state or the third state, and determines an electronic device with a second active time closest to a current time as the second electronic device;
[0067] The second active time corresponding to the electronic device is a time when the electronic device last detects a click operation or a touch operation, or a time when the electronic device last detects a mouse click event or a keyboard input event.
[0068] Optionally, the text content can be displayed on a display interface of the second electronic device through a card, a note or a target application.
[0069] In the voice cooperative input method provided in the implementation, when the device state of the second electronic device is not the first state, that is, when there is no window or input box that can input content in the second electronic device, a card or a note can be created to display the text content on the card or the note, and the card or the note can be displayed on a current interface of the second electronic device. Alternatively, a target application (for example, a memo application) can be automatically opened to display the text content on the second electronic device through the memo application.
[0070] In a possible implementation, the first electronic device determines the second electronic device from the at least one fourth electronic device according to the device state, which can include:
[0071] The first electronic device determines a user account logged in by the at least one fourth electronic device;
[0072] The first electronic device determines the second electronic device from the at least one fourth electronic device according to the device state and the user account.
[0073] In the voice cooperative input method provided in the implementation, to avoid sending the text content to other electronic devices of users, thereby causing leakage of user privacy, the first electronic device can determine the second electronic device from electronic devices logged in by the same user account as the first electronic device, or electronic devices that can control the first electronic device, so that the finally determined second electronic device belongs to the same user as the first electronic device, or is an electronic device authorized by the user to which the first electronic device belongs and can control the first electronic device, to ensure the privacy of the text content and protect user privacy.
[0074] In a possible implementation, when the first electronic device determines that the second electronic device is not the electronic device to which the user wants to input text content by voice, the user can perform a revocation and resend operation in the first electronic device, and can perform a corresponding operation (for example, by holding the first electronic device by hand, or clicking or touching the screen of the first electronic device, etc.) on the electronic device to which the user wants to input text content by voice. When detecting the revocation and resend operation, the first electronic device can revoke the sent text content. Meanwhile, the first electronic device can redetermine the second electronic device, and can send the text content to the redetermined second electronic device.
[0075] In a second aspect, the embodiments of the present application provide a voice cooperative input method, applied to a first electronic device, and the method can include:
[0076] The first electronic device detects a preset operation;
[0077] The first electronic device obtains voice content;
[0078] In response to the preset operation, the first electronic device determines a second electronic device, and sends the voice content to the second electronic device, wherein after the second electronic device receives the voice content, the voice content is converted into text content, and displayed on a display interface of the second electronic device.
[0079] Through the voice cooperative input method, when the user wants to input text content to a certain electronic device by voice, the user can perform a preset operation on the first electronic device. When the first electronic device detects the preset operation, the first electronic device can determine the second electronic device, that is, determine the electronic device to which the user wants to input text content by voice, and can transmit the voice content to the second electronic device, so that the second electronic device can convert the voice content into text content for display. In the embodiments of the present application, the user only needs to perform a simple preset operation, and the voice content obtained by the first electronic device can be transmitted to the second electronic device, so as to facilitate the second electronic device to display the text content corresponding to the voice content, without the user performing multiple operations in the second electronic device. The operation is simple and convenient, the input efficiency is high, the user experience can be improved, and the performance requirement of the first electronic device can be reduced.
[0080] It should be understood that when the first electronic device detects the wrist lifting operation, the first electronic device can start the voice recognition function, and obtain the voice content input by the user. Meanwhile, the first electronic device can determine the second electronic device, and can directly send the voice content to the second electronic device. After the second electronic device receives the voice content, the second electronic device can convert the voice content into text content, and display the text content on the display interface.
[0081] Alternatively, in a scenario where the voice recognition function of the first electronic device has been started, when the first electronic device detects the preset operation, the first electronic device can determine the second electronic device, and can send the acquired voice content to the second electronic device. After the second electronic device receives the voice content, the second electronic device can convert the voice content into text content, and display the text content on the display interface.
[0082] For example, the first electronic device determines the second electronic device in response to the preset operation, which can include:
[0083] The first electronic device determines the second electronic device in response to the preset operation and the first electronic device acquiring the voice content.
[0084] In the voice collaborative input method provided in this implementation, the first electronic device can determine the second electronic device and send the acquired voice content to the second electronic device only when the preset operation is detected and voice content input is recognized. After the second electronic device receives the voice content, the second electronic device can convert the voice content into text content and display the text content. That is, the first electronic device determines the second electronic device only when voice content input is recognized, which can effectively reduce the power consumption of the first electronic device.
[0085] For example, the preset operation includes a wrist lifting operation, or includes a wrist lifting operation and a wrist turning operation.
[0086] In a possible implementation, the first electronic device determines the second electronic device, which can include:
[0087] The first electronic device determines whether there is a target device located in the same hand as the first electronic device;
[0088] When there is a target device located in the same hand as the first electronic device, the first electronic device determines the target device as the second electronic device.
[0089] In one example, the first electronic device determines whether there is a target device located in the same hand as the first electronic device, which can include:
[0090] The first electronic device acquires first acceleration data corresponding to the first electronic device and second acceleration data corresponding to at least one third electronic device;
[0091] The first electronic device determines whether there is a target device located in the same hand as the first electronic device according to the first acceleration data and each second acceleration data.
[0092] Exemplarily, the first electronic device determining whether there is a target device located in the same hand as the first electronic device according to the first acceleration data and each of the second acceleration data can comprise:
[0093] When the first electronic device determines that there is a fourth electronic device according to the first acceleration data and each of the second acceleration data, the first electronic device determines the fourth electronic device as the target device, wherein the change time of the acceleration of the fourth electronic device on each axis is substantially the same as the change time of the acceleration of the first electronic device on each axis, and the direction of the acceleration of the fourth electronic device on the z-axis is opposite to the direction of the acceleration of the first electronic device on the z-axis, but the size is substantially the same.
[0094] Exemplarily, the first electronic device determining whether there is a target device located in the same hand as the first electronic device according to the first acceleration data and each of the second acceleration data can comprise:
[0095] When the first electronic device determines that there is a fourth electronic device according to the first acceleration data and each of the second acceleration data, the first electronic device determines the fourth electronic device as the target device, wherein the change time of the acceleration of the fourth electronic device on each axis is substantially the same as the change time of the acceleration of the first electronic device on each axis, and the direction of the acceleration of the fourth electronic device on the z-axis is opposite to the direction of the acceleration of the first electronic device on the z-axis, but the size is substantially the same.
[0096] In another example, the first electronic device determining whether there is a target device located in the same hand as the first electronic device can comprise:
[0097] The first electronic device obtains first angular velocity data corresponding to the first electronic device and second angular velocity data corresponding to at least one third electronic device;
[0098] The first electronic device determines whether there is a target device located in the same hand as the first electronic device according to the first angular velocity data and each of the second angular velocity data.
[0099] Exemplarily, the first electronic device determining whether there is a target device located in the same hand as the first electronic device according to the first angular velocity data and each of the second angular velocity data can comprise:
[0100] The first electronic device determines, according to the first angular velocity data and the second angular velocity data, that there is a fifth electronic device, and the first electronic device determines the fifth electronic device as the target device, wherein the change time of the angular velocity of the fifth electronic device around each axis is substantially the same as the change time of the angular velocity of the first electronic device around each axis, and the change direction of the angular velocity of the fifth electronic device around the x axis is substantially the same as the change direction of the angular velocity of the first electronic device around the x axis, but the change amplitude is different.
[0101] For example, the first electronic device determines, according to the first angular velocity data and the second angular velocity data, whether there is a target device in the same hand as the first electronic device, which can include:
[0102] The first electronic device determines, according to the first angular velocity data and the second angular velocity data, that there is a fifth electronic device, and the first electronic device determines the fifth electronic device as the target device, wherein the change time of the angular velocity of the fifth electronic device around each axis is substantially the same as the change time of the angular velocity of the first electronic device around each axis, and the change direction of the angular velocity of the fifth electronic device around the z axis is substantially the same as the change direction of the angular velocity of the first electronic device around the z axis, but the change amplitude is different.
[0103] In another example, the first electronic device determines whether there is a target device in the same hand as the first electronic device, which can include:
[0104] The first electronic device obtains a first movement distance corresponding to the first electronic device and a second movement distance corresponding to at least one third electronic device.
[0105] When the difference between the third movement distance and the first movement distance is less than or equal to a preset threshold, the first electronic device determines the third electronic device corresponding to the third movement distance as a target device in the same hand as the first electronic device, and the third movement distance is one of the at least one second movement distance.
[0106] Optionally, the at least one third electronic device is an electronic device that meets one or more of the following conditions:
[0107] The distance between the first electronic device and the third electronic device is less than or equal to a first distance threshold;
[0108] The first electronic device logs in the same user account as the third electronic device;
[0109] The device type is a preset type.
[0110] In another possible implementation, after determining whether there is a target device located in the same hand as the first electronic device, the method can further include:
[0111] When there is no target device located in the same hand as the first electronic device, the first electronic device acquires a device state of at least one fourth electronic device;
[0112] The first electronic device determines the second electronic device from the at least one fourth electronic device according to the device state.
[0113] In one example, the first electronic device determining the second electronic device from the at least one fourth electronic device according to the device state can include:
[0114] The first electronic device determines an electronic device with a preset state from the at least one fourth electronic device, and determines the second electronic device according to the electronic device with the preset state;
[0115] The preset state is any one of a first state, a second state and a third state, the first state is a state of existing a window or an input box that can input content, the second state is a state of detecting a click operation or a touch operation within a first preset time length, and the third state is a state of detecting a mouse click event or a keyboard input event within a second preset time length.
[0116] In another example, the first electronic device determining the second electronic device according to the electronic device with the preset state can include:
[0117] When it is determined that there is an electronic device with the first state from the at least one fourth electronic device, the first electronic device determines the electronic device with the first state as the second electronic device.
[0118] In another example, when the electronic devices with the first state from the at least one fourth electronic device include multiple electronic devices, the first electronic device determining the second electronic device can include:
[0119] The first electronic device determines a first active time corresponding to each of the electronic devices with the first state, and determines an electronic device with a first active time closest to a current time as the second electronic device;
[0120] The first active time of the electronic device corresponds to a time when the electronic device last detects a click operation or a touch operation, or a time when the electronic device last detects a mouse click event or a keyboard input event.
[0121] In another example, when the electronic devices in the at least one fourth electronic device in the first state include multiple electronic devices, the first electronic device determines the electronic devices in the first state as the second electronic device, which can include:
[0122] The first electronic device obtains existing content in a window or an input box of each electronic device in the first state.
[0123] The first electronic device determines a matching degree of the text content and each existing content, and determines an electronic device with the highest matching degree as the second electronic device.
[0124] Optionally, the text content can be displayed in the window or the input box of the second electronic device.
[0125] In another example, the first electronic device determines an electronic device in the at least one fourth electronic device in a preset state according to the device state, and determines the second electronic device according to the electronic device in the preset state, which can include:
[0126] When there is no electronic device in the at least one fourth electronic device in the first state, but there is an electronic device in the at least one fourth electronic device in the second state and / or the third state, the first electronic device obtains a second active time of each electronic device in the second state or the third state, and determines an electronic device with the closest second active time to the current time as the second electronic device.
[0127] The second active time of the electronic device corresponds to a time when the electronic device last detects a click operation or a touch operation, or a time when the electronic device last detects a mouse click event or a keyboard input event.
[0128] Optionally, the text content can be displayed on the display interface of the second electronic device through a card, a note or a target application.
[0129] In a possible implementation, the first electronic device determines the second electronic device from the at least one fourth electronic device according to the device state, which can include:
[0130] The first electronic device determines a user account logged in by the at least one fourth electronic device.
[0131] The first electronic device determines the second electronic device from the at least one fourth electronic device according to the device state and the user account.
[0132] In a third aspect, an embodiment of the present application provides a voice cooperative input apparatus applied to a first electronic device, the apparatus can include:
[0133] a preset operation detection module configured to detect a preset operation;
[0134] a voice content acquisition module configured to acquire voice content;
[0135] a voice content conversion module configured to convert the voice content into text content in response to the preset operation;
[0136] a text content sending module configured to determine a second electronic device and send the text content to the second electronic device, wherein the text content is displayed on a display interface of the second electronic device after the second electronic device receives the text content.
[0137] For example, the preset operation includes a wrist lifting operation or includes a wrist lifting operation and a wrist turning operation.
[0138] In a possible implementation, the text content sending module can include:
[0139] a target device determination unit configured to determine whether there is a target device located in the same hand as the first electronic device;
[0140] a second device determination unit configured to determine the target device as the second electronic device when there is a target device located in the same hand as the first electronic device.
[0141] In an example, the target device determination unit can include:
[0142] an acceleration acquisition subunit configured to acquire first acceleration data corresponding to the first electronic device and second acceleration data corresponding to at least one third electronic device;
[0143] a first determination subunit configured to determine whether there is a target device located in the same hand as the first electronic device according to the first acceleration data and each of the second acceleration data.
[0144] Exemplarily, the first determining sub-unit is specifically configured to determine, according to the first acceleration data and each second acceleration data, that a fourth electronic device exists as the target device, wherein the acceleration change time of the fourth electronic device on each axis is substantially the same as the acceleration change time of the first electronic device on each axis, and the direction of the acceleration of the fourth electronic device on the z axis is opposite to the direction of the acceleration of the first electronic device on the z axis, but the size is substantially the same.
[0145] Exemplarily, the first determining sub-unit is specifically configured to determine, according to the first acceleration data and each second acceleration data, that a fourth electronic device exists as the target device, wherein the acceleration change time of the fourth electronic device on each axis is substantially the same as the acceleration change time of the first electronic device on each axis, and the direction of the acceleration of the fourth electronic device on the z axis is opposite to the direction of the acceleration of the first electronic device on the z axis, but the size is substantially the same.
[0146] In another example, the target device determining unit can include:
[0147] An angular velocity obtaining sub-unit is configured to obtain first angular velocity data corresponding to the first electronic device and second angular velocity data corresponding to at least one third electronic device.
[0148] A second determining sub-unit is configured to determine, according to the first angular velocity data and each second angular velocity data, whether a target device exists in the same hand as the first electronic device.
[0149] Exemplarily, the second determining sub-unit is specifically configured to determine, according to the first angular velocity data and each second angular velocity data, that a fifth electronic device exists as the target device, wherein the angular velocity change time of the fifth electronic device around each axis is substantially the same as the acceleration change time of the first electronic device around each axis, and the direction of the angular velocity of the fifth electronic device around the x axis is substantially the same as the direction of the angular velocity of the first electronic device around the x axis, but the change amplitude is different.
[0150] For example, the second determining sub-unit can be further configured to determine, according to the first angular velocity data and the second angular velocity data, that the fifth electronic device exists, and determine the fifth electronic device as the target device, wherein the fifth electronic device has a change time of angular velocity around each axis that is substantially the same as the change time of angular velocity of the first electronic device around each axis, and the fifth electronic device has a change direction of angular velocity around the z-axis that is substantially the same as the change direction of angular velocity of the first electronic device around the z-axis, but has a different change amplitude.
[0151] In another example, the target device determining unit can further include:
[0152] a movement distance obtaining unit configured to obtain a first movement distance corresponding to the first electronic device and a second movement distance corresponding to at least one third electronic device;
[0153] a third determining sub-unit configured to determine, when a difference between the third movement distance and the first movement distance is less than or equal to a preset threshold, a third electronic device corresponding to the third movement distance as the target device located in the same hand as the first electronic device, the third movement distance being one of the at least one second movement distance.
[0154] Optionally, the at least one third electronic device is an electronic device satisfying one or more of the following conditions:
[0155] a distance between the first electronic device and the third electronic device is less than or equal to a first distance threshold;
[0156] the first electronic device logs in a same user account as the third electronic device;
[0157] a device type of the third electronic device is a preset type.
[0158] In another possible implementation, the text content sending module can further include:
[0159] a device state obtaining unit configured to obtain a device state of at least one fourth electronic device when there is no target device located in the same hand as the first electronic device;
[0160] a third device determining unit configured to determine the second electronic device from the at least one fourth electronic device according to the device state.
[0161] In one example, the third device determining unit is specifically configured to determine an electronic device having a preset state from the at least one fourth electronic device, and determine the second electronic device according to the electronic device having the preset state.
[0162] The preset state is any one of a first state, a second state and a third state, the first state is a state of existing a window or an input box capable of inputting content, the second state is a state of detecting a click operation or a touch operation within a first preset time length, and the third state is a state of detecting a mouse click event or a keyboard input event within a second preset time length.
[0163] In another example, the third device determining unit can also be configured to determine the electronic device in the first state as the second electronic device when determining that there is an electronic device in the first state in the at least one fourth electronic device.
[0164] In another example, the third device determining unit can also be configured to determine a first active time corresponding to each electronic device in the first state, and determine an electronic device with a first active time closest to a current time as the second electronic device.
[0165] The first active time corresponding to the electronic device is a time when the electronic device last detects a click operation or a touch operation, or a time when the electronic device last detects a mouse click event or a keyboard input event.
[0166] In another example, the third device determining unit can also be configured to obtain existing content in a window or an input box of each electronic device in the first state, determine a matching degree of the text content and each existing content, and determine an electronic device with a highest matching degree as the second electronic device.
[0167] Optionally, the text content can be displayed in the window or the input box of the second electronic device.
[0168] In another example, the third device determining unit can also be configured to obtain a second active time of each electronic device in the second state or the third state when there is no electronic device in the first state in the at least one fourth electronic device, but there is an electronic device in the second state and / or the third state, and determine an electronic device with a second active time closest to a current time as the second electronic device.
[0169] The second active time corresponding to the electronic device is a time when the electronic device last detects a click operation or a touch operation, or a time when the electronic device last detects a mouse click event or a keyboard input event.
[0170] Optionally, the text content can be displayed on a display interface of the second electronic device through a card, a note or a target application.
[0171] In a possible implementation, the third device determining unit can also be configured to determine a user account logged in by the at least one fourth electronic device; and determine the second electronic device from the at least one fourth electronic device according to the device state and the user account.
[0172] In a fourth aspect, an embodiment of the present application provides a voice cooperative input apparatus, applied to a first electronic device, and the apparatus can include:
[0173] a preset operation detecting module configured to detect a preset operation;
[0174] a voice content obtaining module configured to obtain voice content;
[0175] a voice content sending module configured to determine a second electronic device in response to the preset operation, and send the voice content to the second electronic device, wherein after the second electronic device receives the voice content, the voice content is converted into text content and displayed on a display interface of the second electronic device.
[0176] For example, the voice content sending module can also be configured to determine the second electronic device in response to the preset operation and the first electronic device obtaining voice content.
[0177] For example, the preset operation includes a wrist lifting operation, or includes a wrist lifting operation and a wrist turning operation.
[0178] In a possible implementation, the voice content sending module can include:
[0179] a target device determining unit configured to determine whether there is a target device located in the same hand as the first electronic device;
[0180] a second device determining unit configured to determine the target device as the second electronic device when there is a target device located in the same hand as the first electronic device.
[0181] In an example, the target device determining unit can include:
[0182] an acceleration obtaining subunit configured to obtain first acceleration data corresponding to the first electronic device and second acceleration data corresponding to at least one third electronic device;
[0183] a first determining subunit configured to determine whether there is a target device located in the same hand as the first electronic device according to the first acceleration data and each of the second acceleration data.
[0184] Exemplarily, the first determining sub-unit can be further configured to determine, according to the first acceleration data and each of the second acceleration data, that a fourth electronic device exists, and determine the fourth electronic device as the target device, wherein the acceleration change time of the fourth electronic device on each axis is substantially the same as the acceleration change time of the first electronic device on each axis, and the acceleration of the fourth electronic device on the z axis is substantially the same as the acceleration of the first electronic device on the z axis in direction but substantially the same in size.
[0185] Exemplarily, the first determining sub-unit can be further configured to determine, according to the first acceleration data and each of the second acceleration data, that a fourth electronic device exists, and determine the fourth electronic device as the target device, wherein the acceleration change time of the fourth electronic device on each axis is substantially the same as the acceleration change time of the first electronic device on each axis, and the acceleration of the fourth electronic device on the z axis is substantially the same as the acceleration of the first electronic device on the z axis in direction but substantially the same in size.
[0186] In another example, the target device determining unit can include:
[0187] an angular velocity obtaining sub-unit configured to obtain first angular velocity data corresponding to the first electronic device and second angular velocity data corresponding to at least one third electronic device;
[0188] a second determining sub-unit configured to determine, according to the first angular velocity data and each of the second angular velocity data, whether a target device exists in the same hand as the first electronic device.
[0189] Exemplarily, the second determining sub-unit can be further configured to determine, according to the first angular velocity data and each of the second angular velocity data, that a fifth electronic device exists, and determine the fifth electronic device as the target device, wherein the angular velocity change time of the fifth electronic device around each axis is substantially the same as the acceleration change time of the first electronic device around each axis, and the angular velocity change direction of the fifth electronic device around the x axis is substantially the same as the angular velocity change direction of the first electronic device around the x axis but different in change amplitude.
[0190] For example, the second determining sub-unit can be further configured to determine, according to the first angular velocity data and the second angular velocity data, that the fifth electronic device exists, and determine the fifth electronic device as the target device, wherein the fifth electronic device has a same change time of angular velocity around each axis as the first electronic device, and has a same change direction of angular velocity around the z axis as the first electronic device, but has a different change amplitude.
[0191] In another example, the target device determining unit can further include:
[0192] a movement distance obtaining unit configured to obtain a first movement distance corresponding to the first electronic device and a second movement distance corresponding to at least one third electronic device;
[0193] a third determining sub-unit configured to determine, when a difference between the third movement distance and the first movement distance is less than or equal to a preset threshold, that a third electronic device corresponding to the third movement distance is a target device located in a same hand as the first electronic device, the third movement distance being one of the at least one second movement distance.
[0194] Optionally, the at least one third electronic device is an electronic device satisfying one or more of the following conditions:
[0195] a distance between the first electronic device and the third electronic device is less than or equal to a first distance threshold;
[0196] the first electronic device logs in a same user account as the third electronic device;
[0197] a device type of the third electronic device is a preset type.
[0198] In another possible implementation, the voice content sending module can further include:
[0199] a device state obtaining unit configured to, when there is no target device located in a same hand as the first electronic device, obtain a device state of at least one fourth electronic device;
[0200] a third device determining unit configured to determine, according to the device state, the second electronic device from the at least one fourth electronic device.
[0201] In one example, the third device determining unit can be further configured to determine an electronic device having a preset state from the at least one fourth electronic device, and determine the second electronic device according to the electronic device having the preset state.
[0202] The preset state is any one of a first state, a second state and a third state, the first state is a state of existing a window or an input box capable of inputting content, the second state is a state of detecting a click operation or a touch operation within a first preset time length, and the third state is a state of detecting a mouse click event or a keyboard input event within a second preset time length.
[0203] In another example, the third device determining unit can be further configured to determine the electronic device in the first state as the second electronic device when determining that there is an electronic device in the first state in the at least one fourth electronic device.
[0204] In another example, the third device determining unit can be further configured to determine a first active time corresponding to each electronic device in the first state, and determine an electronic device with a first active time closest to a current time as the second electronic device.
[0205] The first active time corresponding to the electronic device is a time when the electronic device last detects a click operation or a touch operation, or a time when the electronic device last detects a mouse click event or a keyboard input event.
[0206] In another example, the third device determining unit can be further configured to obtain existing content in a window or an input box of each electronic device in the first state, determine a matching degree of the text content and each existing content, and determine an electronic device with a highest matching degree as the second electronic device.
[0207] Optionally, the text content can be displayed in the window or the input box of the second electronic device.
[0208] In another example, the third device determining unit can be further configured to obtain a second active time of each electronic device in the second state or the third state when there is no electronic device in the first state in the at least one fourth electronic device, but there is an electronic device in the second state and / or the third state, and determine an electronic device with a second active time closest to a current time as the second electronic device.
[0209] The second active time corresponding to the electronic device is a time when the electronic device last detects a click operation or a touch operation, or a time when the electronic device last detects a mouse click event or a keyboard input event.
[0210] Optionally, the text content can be displayed on a display interface of the second electronic device through a card, a note or a target application.
[0211] In a possible implementation, the third device determining unit can also be configured to determine a user account logged in by the at least one fourth electronic device; and determine the second electronic device from the at least one fourth electronic device according to the device state and the user account.
[0212] In a fifth aspect, an embodiment of the present application provides a voice cooperative input system, which can include a first electronic device and a second electronic device.
[0213] The first electronic device is configured to perform the method in any one of the first aspect or the second aspect.
[0214] The second electronic device is configured to receive the text content or the voice content sent by the first electronic device, and display the text content corresponding to the text content or the voice content on a display interface of the second electronic device.
[0215] It should be understood that, when the first electronic device detects the preset operation, the first electronic device can convert the obtained voice content into text content, and send the text content to the second electronic device. The second electronic device can directly display the text content on the display interface of the second electronic device.
[0216] Alternatively, when the first electronic device detects the preset operation, the first electronic device can directly send the obtained voice content to the second electronic device. After receiving the voice content, the second electronic device can convert the voice content into text content, and display the text content on the display interface of the second electronic device.
[0217] For example, when there is a window or an input box for inputting content in the display interface of the second electronic device, the second electronic device can directly display the text content in the window or the input box displayed by the second electronic device, so as to facilitate the user to perform corresponding operations (for example, editing or sending, etc.) on the text content, thereby improving the user experience.
[0218] When there are multiple windows and / or input boxes for inputting content in the display interface of the second electronic device, the second electronic device can determine the last active window or input box, and input the text content into the last active window or input box, so as to display the text content through the last active window or input box. That is, when the text content is input into the second electronic device through voice input of the first electronic device, the user can input the text content into different windows of the second electronic device by switching the windows.
[0219] For example, when there is no window or input box for inputting the content in the display interface of the second electronic device, the second electronic device can create a card or a note to display the text content on the card or the note, and the card or the note can be displayed in a floating manner on the current interface of the second electronic device.
[0220] Alternatively, the second electronic device can automatically open a target application (for example, a memo application) to display the text content on the second electronic device through the memo application.
[0221] In a possible implementation, the first electronic device is a wearable device, and the second electronic device is an electronic device with a display screen.
[0222] In another possible implementation, the user account logged in by the first electronic device is the same as the user account logged in by the second electronic device.
[0223] In another possible implementation, the distance between the second electronic device and the first electronic device is less than or equal to a first distance threshold.
[0224] In another possible implementation, the device type of the second electronic device is a preset type. The preset type can be a type of electronic device that can be held and operated by a user, such as a mobile phone or a tablet computer.
[0225] In another possible implementation, the device state of the second electronic device is a preset state, and the preset state is any one of a first state, a second state, and a third state. The first state is a state in which there is a window or an input box for inputting content. The second state is a state in which a click operation or a touch operation is detected within a first preset time period. The third state is a state in which a mouse click event or a keyboard input event is detected within a second preset time period.
[0226] In a sixth aspect, an embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the electronic device implements the voice cooperative input method in any one of the first aspect or the second aspect.
[0227] In a seventh aspect, an embodiment of the present application provides a computer readable storage medium, which stores a computer program. When the computer program is executed by a computer, the computer implements the voice cooperative input method in any one of the first aspect or the second aspect.
[0228] In an eighth aspect, an embodiment of the present application provides a computer program product, which, when running on an electronic device, causes the electronic device to perform the voice cooperative input method in any one of the first aspect.
[0229] It can be understood that the beneficial effects of the third aspect to the eighth aspect described above can be referred to the related description in the first aspect or the second aspect, which will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS
[0230] Figure 1 is a structural schematic diagram of an electronic device to which the voice cooperative input method provided by an embodiment of the present application is applicable;
[0231] Figure 2 is a software architecture schematic diagram to which the voice cooperative input method provided by an embodiment of the present application is applicable;
[0232] Figure 3 is a flowchart of the voice cooperative input method provided by an embodiment of the present application;
[0233] Figure 4 is an example diagram of acceleration change provided by an embodiment of the present application;
[0234] Figure 5 is an example diagram of angular velocity change provided by an embodiment of the present application;
[0235] Figure 6 is an application scenario schematic diagram provided by an embodiment of the present application Figure 1 ;
[0236] Figure 7 is an application scenario schematic diagram provided by an embodiment of the present application Figure 2 ;
[0237] Figure 8 is an application scenario schematic diagram provided by an embodiment of the present application Figure 3 ;
[0238] Figure 9 is an application scenario schematic diagram provided by an embodiment of the present application Figure 4 ;
[0239] Figure 10 is an application scenario schematic diagram provided by an embodiment of the present application Figure 5 ;
[0240] Figure 11 is an application scenario schematic diagram provided by an embodiment of the present application Figure 6 . DETAILED DESCRIPTION
[0241] It should be understood that the term "include" as used in the specification and in the following claims denotes the presence of the described features, integers, steps, operations, elements, and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.
[0242] It should also be understood that the term "and / or" as used in the specification and in the following claims indicates any combination of one or more of the associated listed items and all possible combinations thereof.
[0243] In addition, in the description of the specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish descriptions, and cannot be understood as indicating or implying relative importance.
[0244] In the present specification, the reference "one embodiment" or "some embodiments" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Thus, the appearance of the phrases "in one embodiment", "in some embodiments", "in other some embodiments", "in yet some embodiments", etc. in various places in the specification is not necessarily all referring to the same embodiment, but means "one or more but not all embodiments", unless otherwise specifically stated. The terms "include", "contain", "have" and their variants mean "include but not limited to", unless otherwise specifically stated.
[0245] In addition, "a plurality of" mentioned in the embodiments of the present application should be interpreted as two or more.
[0246] The steps involved in the voice cooperative input method provided in the embodiments of the present application are only examples, and not all steps are necessarily performed, or the content in each information or message is not necessarily optional. In use, it can be increased or reduced as needed. The same step or step or message with the same function in different embodiments can be mutually referenced.
[0247] The business scenarios described in the embodiments of the present application are to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided by the embodiments of the present application. Those skilled in the art can know that, with the evolution of network architecture and the appearance of new business scenarios, the technical solutions provided by the embodiments of the present application are also applicable to similar technical problems.
[0248] Electronic devices such as mobile phones, tablets, etc. generally have a voice-to-text function, so that users can input text content quickly through voice. The ways to start voice-to-text can include: 1) long press a specific button first, then input a voice containing "voice-to-text", and then input the voice content to be converted; 2) input a preset wake-up phrase containing a keyword first, then input a voice containing "voice-to-text", and then input the voice content to be converted; 3) find and open a specific application, then click the "voice-to-text" button in the application, and then input the voice content to be converted. These ways all need to perform multiple steps of operation, which is relatively complex and low in efficiency.
[0249] To solve the above problems, the embodiments of the present application provide a voice collaborative input method, an electronic device and a computer readable storage medium. In the method, when a user wants to input text content to a certain electronic device through voice, the user can perform a preset operation on a first electronic device. When the first electronic device detects the preset operation, it can convert the obtained voice content into text content. At the same time, the first electronic device can determine a second electronic device, i.e. determine the electronic device to which the user wants to input text content through voice, and can transmit the text content to the second electronic device. In the embodiments of the present application, the user only needs to perform a simple preset operation, i.e. can realize the purpose of inputting text content to the second electronic device through the voice recognition function of the first electronic device, without the user performing multiple steps of operation in the second electronic device, which is simple and convenient, high in efficiency, can improve user experience, and has strong usability and practicality.
[0250] In the embodiments of the present application, the first electronic device can be a wearable device such as a smart watch, a smart bracelet, etc., and the second electronic device can be an electronic device with a display screen such as a mobile phone, a tablet, a notebook computer, a desktop computer, a smart large screen, a smart refrigerator, a smart television, etc. The embodiments of the present application do not limit the specific types of electronic devices (which can include the first electronic device and the second electronic device).
[0251] First, the electronic device related to the embodiments of the present application is introduced. Please refer to Figure 1 , Figure 1 A structural schematic diagram of the electronic device 100 is shown.
[0252] The electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, and a display 194, etc. The sensor module 180 can include a pressure sensor 180A, a gyro sensor 180B, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a fingerprint sensor 180H, a touch sensor 180K, an ambient light sensor 180L, etc.
[0253] It can be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than illustrated, or combine certain components, or split certain components, or different arrangement of components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.
[0254] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices, or can be integrated in one or more processors.
[0255] The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching and executing instructions.
[0256] The processor 110 can also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can save instructions or data that the processor 110 has just used or repeatedly uses. If the processor 110 needs to use the instructions or data again, it can directly call from the memory. This avoids repeated access and reduces the waiting time of the processor 110, thereby improving the efficiency of the system.
[0257] In some embodiments, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0258] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 can include multiple sets of I2C buses. The processor 110 can be coupled to the touch sensor 180K, the flash, the camera 193, etc. through different I2C bus interfaces, respectively. For example, the processor 110 can be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface, realizing the touch function of the electronic device 100.
[0259] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple sets of I2S buses. The processor 110 can be coupled to the audio module 170 through the I2S bus, realizing the communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can deliver audio signals to the wireless communication module 160 through the I2S interface, realizing the function of answering the phone through the Bluetooth headset.
[0260] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled through the PCM bus interface. In some embodiments, the audio module 170 can also deliver audio signals to the wireless communication module 160 through the PCM interface, realizing the function of answering the phone through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0261] The UART interface is a universal serial bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is usually used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to realize the Bluetooth function. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface to realize the function of playing music through the Bluetooth headset.
[0262] The MIPI interface can be used to connect the processor 110 and peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to realize the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate through the DSI interface to realize the display function of the electronic device 100.
[0263] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 and the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0264] The USB interface 130 is an interface that meets the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to transmit data between the electronic device 100 and peripheral devices. It can also be used to connect earphones to play audio through the earphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.
[0265] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a structural limitation of the electronic device 100. In some other embodiments of the present application, the electronic device 100 can also use different interface connection methods or combinations of multiple interface connection methods in the above embodiments.
[0266] The wireless communication function of the electronic device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, etc.
[0267] The antenna 1 and the antenna 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In some other embodiments, the antennas can be used in combination with a tuning switch.
[0268] The mobile communication module 150 can provide a solution including 2G / 3G / 4G / 5G wireless communication applied to the electronic device 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert the signals into electromagnetic waves radiated by the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 150 can be arranged in the processor 110. In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 can be arranged in the same device.
[0269] The modem processor can include a modulator and a demodulator. The modulator is used to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal processed by the baseband processor is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the loudspeaker 170A, the microphone 170B, etc.), or displays an image or a video through the display screen 194. In some embodiments, the modem processor can be an independent device. In some other embodiments, the modem processor can be independent of the processor 110, and arranged in the same device as the mobile communication module 150 or other functional modules.
[0270] The wireless communication module 160 can provide a solution for wireless communication including wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives an electromagnetic wave via the antenna 2, frequency-modulates and filters the electromagnetic wave signal, and transmits the processed signal to the processor 110. The wireless communication module 160 can also receive a signal to be transmitted from the processor 110, frequency-modulate it, amplify it, and radiate it as an electromagnetic wave via the antenna 2.
[0271] In some embodiments, the antenna 1 and the mobile communication module 150 of the electronic device 100 are coupled, and the antenna 2 and the wireless communication module 160 are coupled, so that the electronic device 100 can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include a global positioning system (GPS), a global navigation satellite system (GLONASS), a beidu navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and / or a satellite based augmentation systems (SBAS).
[0272] The electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs, which execute program instructions to generate or change display information.
[0273] The display screen 194 is configured to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diodes (QLED), or the like. In some embodiments, the electronic device 100 can include one or N display screens 194, where N is a positive integer greater than 1.
[0274] The electronic device 100 can implement the photographing function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor.
[0275] The ISP is configured to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing to convert it into an image visible to the naked eye. The ISP can also optimize the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature, and other parameters of the shooting scene. In some embodiments, the ISP can be disposed in the camera 193.
[0276] The camera 193 is configured to capture still images or videos. An object generates an optical image through a lens and projects it onto a photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then transmitted to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, the electronic device 100 can include one or N cameras 193, where N is a positive integer greater than 1.
[0277] The digital signal processor is used to process digital signals, in addition to being able to process digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.
[0278] The video codec is used to compress or decompress digital video. The electronic device 100 can support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.
[0279] The NPU is a neural-network (NN) calculation processor, which can quickly process input information by drawing on the structure of a biological neural network, such as the transmission mode between human brain neurons, and can also continuously self-learn. Through the NPU, the electronic device 100 can realize intelligent cognition applications such as image recognition, face recognition, voice recognition, text understanding, etc.
[0280] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize data storage functions. For example, music, video, etc. Files are saved in the external memory card.
[0281] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application required by a function (such as a sound playing function, an image playing function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phonebook, etc.), etc. In addition, the internal memory 121 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various function applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in the memory disposed in the processor.
[0282] The electronic device 100 can realize audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor, etc. For example, music playing, recording, etc.
[0283] The audio module 170 is configured to convert digital audio information into an analog audio signal output, and to convert an analog audio input into a digital audio signal. The audio module 170 can also be configured to encode and decode audio signals. In some embodiments, the audio module 170 can be disposed in the processor 110, or some of the functions of the audio module 170 can be disposed in the processor 110.
[0284] The speaker 170A, also referred to as a "loudspeaker", is configured to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.
[0285] The receiver 170B, also referred to as a "earpiece", is configured to convert an audio electrical signal into a sound signal. When the electronic device 100 receives a call or a voice message, the user can listen to the voice by holding the receiver 170B close to the ear.
[0286] The microphone 170C, also referred to as a "microphone", "sound collector", is configured to convert a sound signal into an electrical signal. When making a call or sending a voice message, the user can speak into the microphone 170C by holding the mouth close to the microphone 170C, and input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, in addition to collecting sound signals, the noise reduction function can also be realized. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C, in addition to collecting sound signals, noise reduction, it can also identify the source of the sound, realize the function of directional recording, etc. Among them, the sound signal collected by the microphone 170C can include the volume size.
[0287] The earphone interface 170D is configured to connect a wired earphone. The earphone interface 170D can be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface.
[0288] The pressure sensor 180A is configured to sense a pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194. The pressure sensor 180A can be of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, etc. The capacitive pressure sensor can include at least two parallel plates of conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation is applied to the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity less than a first pressure threshold is applied to a short message application icon, an instruction to view a short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold is applied to the short message application icon, an instruction to create a new short message is executed.
[0289] The gyroscope sensor 180B can be configured to determine the motion attitude of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., the x-axis, the y-axis, and the z-axis) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake photography. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of shaking of the electronic device 100, calculates the distance that the lens module needs to compensate according to the angle, and lets the lens offset the shaking of the electronic device 100 by reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and motion sensing game scenarios.
[0290] In some embodiments, the electronic device 100 can also determine whether there is another electronic device in the same hand as the electronic device 100 according to the angular velocity determined by the gyroscope sensor 180B. Alternatively, the electronic device 100 can also determine whether there is another electronic device in the same hand as the electronic device 100 according to the angular velocity determined by the gyroscope sensor 180B and the sound signal collected by the microphone 170C.
[0291] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of a flip cover. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the cover or the opening and closing state of the flip cover, the electronic device 100 can set features such as automatic unlocking of the flip cover.
[0292] The acceleration sensor 180E can detect the magnitude of acceleration of the electronic device 100 in each direction (generally three axes, i.e., x-axis, y-axis, and z-axis). The magnitude and direction of gravity can be detected when the electronic device 100 is stationary. It can also be used to identify the electronic device posture, applied to landscape / portrait switching, pedometer, and the like.
[0293] In the embodiments of the present application, the electronic device 100 can also determine whether there is another electronic device located in the same hand as the electronic device 100 according to the acceleration determined by the acceleration sensor 180E.
[0294] Alternatively, the electronic device 100 can determine whether there is another electronic device located in the same hand as the electronic device 100 according to the angular velocity determined by the gyroscope sensor 180B and the acceleration determined by the acceleration sensor 180E.
[0295] Alternatively, the electronic device 100 can determine whether there is another electronic device located in the same hand as the electronic device 100 according to the magnetic field data collected by the magnetic sensor 180D, the angular velocity determined by the gyroscope sensor 180B, and the acceleration determined by the acceleration sensor 180E.
[0296] Alternatively, the electronic device 100 can determine whether there is another electronic device located in the same hand as the electronic device 100 according to the acceleration collected by the acceleration sensor 180E and the sound signal collected by the microphone 170C.
[0297] Alternatively, the electronic device 100 can determine whether there is another electronic device located in the same hand as the electronic device 100 according to the acceleration collected by the acceleration sensor 180E, the sound signal collected by the microphone 170C, and the angular velocity collected by the gyroscope sensor 180B, and the like.
[0298] In specific electronic devices, the gyroscope sensor 180B and the acceleration sensor 180E can be two independent sensors, or can be integrated into one sensor.
[0299] The distance sensor 180F is used to measure distance. The electronic device 100 can measure distance by infrared or laser. In some embodiments, the electronic device 100 can use the distance sensor 180F to measure distance to achieve fast focusing when shooting a scene.
[0300] In the embodiments of the present application, the distance sensor 180F can be based on ultra wide band (UWB) ranging, or can be based on ultrasonic ranging, or can be based on Bluetooth ranging, and the like. The electronic device 100 can measure the distance between the electronic device 100 and the surrounding electronic device through the distance sensor 180F.
[0301] The ambient light sensor 180L is used to sense ambient light brightness. The electronic device 100 can adaptively adjust the display screen 194 brightness according to the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust white balance when taking photos.
[0302] In the embodiments of the present application, the electronic device 100 can determine whether there is another electronic device located in the same hand as the electronic device 100 in combination with the ambient light brightness sensed by the ambient light sensor 180L.
[0303] For example, the electronic device 100 can determine whether there is another electronic device located in the same hand as the electronic device 100 according to the ambient light brightness sensed by the ambient light sensor 180L and the angular velocity determined by the gyroscope sensor 180B.
[0304] Alternatively, the electronic device 100 can determine whether there is another electronic device located in the same hand as the electronic device 100 according to the ambient light brightness sensed by the ambient light sensor 180L and the acceleration determined by the acceleration sensor 180E.
[0305] Alternatively, the electronic device 100 can determine whether there is another electronic device located in the same hand as the electronic device 100 according to the ambient light brightness sensed by the ambient light sensor 180L, the angular velocity determined by the gyroscope sensor 180B and the sound signal collected by the microphone 170C.
[0306] Alternatively, the electronic device 100 can determine whether there is another electronic device located in the same hand as the electronic device 100 according to the ambient light brightness sensed by the ambient light sensor 180L, the acceleration determined by the acceleration sensor 180E and the sound signal collected by the microphone 170C.
[0307] Alternatively, the electronic device 100 can determine whether there is another electronic device located in the same hand as the electronic device 100 according to the ambient light brightness sensed by the ambient light sensor 180L, the angular velocity determined by the gyroscope sensor 180B, the angular velocity determined by the acceleration sensor 180E and the sound signal collected by the microphone 170C, etc.
[0308] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, access application lock, fingerprint photo, fingerprint answer incoming call, etc.
[0309] Touch sensor 180K, also referred to as "touch device". Touch sensor 180K can be disposed on display screen 194, and touch sensor 180K and display screen 194 form a touch screen, also referred to as "touch panel". Touch sensor 180K is configured to detect touch operations applied to or near the touch sensor 180K. The touch sensor can transmit the detected touch operation to the application processor to determine the touch event type. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K can also be disposed on the surface of electronic device 100, which is different from the position where display screen 194 is located.
[0310] Keys 190 include power on key, volume key, and the like. Keys 190 can be mechanical keys. They can also be touch keys. Electronic device 100 can receive key input and generate key signal input related to user settings and function control of electronic device 100.
[0311] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations applied to different applications (such as taking pictures, playing audio, etc.) can correspond to different vibration feedback effects. Touch operations applied to different regions of display screen 194 can also correspond to different vibration feedback effects. Different application scenarios (such as time reminders, receiving messages, alarms, games, etc.) can also correspond to different vibration feedback effects. Touch vibration feedback effects can also be customizable.
[0312] Indicator 192 can be an indicator light, which can be used to indicate messages, missed calls, notifications, and the like.
[0313] The software system of electronic device 100 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. The embodiments of the present application take the Android system with a layered architecture as an example to exemplarily illustrate the software structure of electronic device 100.
[0314] Figure 2 is a software structure block diagram of electronic device 100 according to an embodiment of the present application.
[0315] The layered architecture divides software into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, application layer, application framework layer, Android runtime and system library, and kernel layer.
[0316] The application layer can include a series of application packages.
[0317] As Figure 2As shown, the application package can include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc. applications.
[0318] The application framework layer provides application programming interface (API) and programming framework for the applications of the application layer. The application framework layer includes some pre-defined functions.
[0319] As shown, the application framework layer can include window manager, content provider, view system, phone manager, resource manager, notification manager, etc. Figure 2
[0320] The window manager is used to manage window programs. The window manager can acquire display screen size, determine whether there is a status bar, lock the screen, and intercept the screen, etc.
[0321] The content provider is used to store and acquire data, and make the data accessible by the applications. The data can include video, image, audio, dialed and received calls, browsing history and bookmarks, phonebook, etc.
[0322] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a short message notification icon can include a view for displaying text and a view for displaying pictures.
[0323] The phone manager is used to provide communication functions of the electronic device 100. For example, management of call status (including call connection, call hang-up, etc.).
[0324] The resource manager provides various resources for the applications, such as localized strings, icons, pictures, layout files, video files, etc.
[0325] The notification manager makes the applications able to display notification information in the status bar, which can be used to convey messages of the notification type, which can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminder, etc. The notification manager can also be a notification in the form of a chart or a scroll bar text appearing in the top status bar of the system, such as a notification of an application running in the background, or a notification in the form of a dialogue window appearing on the screen. For example, prompting text information in the status bar, issuing a prompt sound, vibrating the electronic device, blinking the indicator light, etc.
[0326] The Android runtime includes core library and virtual machine. The Android runtime is responsible for scheduling and management of the Android system.
[0327] The core library includes two parts: one part is the function function called by the java language, and the other part is the core library of Android.
[0328] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java files of the application layer and the application framework layer into binary files. The virtual machine is used to perform the functions of object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0329] The system library can include multiple functional modules. For example: surface manager, media library, three-dimensional graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0330] The surface manager is used to manage the display subsystem, and provides 2D and 3D layer fusion for multiple applications.
[0331] The media library supports multiple commonly used audio, video format playback and recording, and static image files. The media library can support multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0332] The three-dimensional graphics processing library is used to realize three-dimensional graphics drawing, image rendering, synthesis, and layer processing.
[0333] The 2D graphics engine is a drawing engine for 2D drawing.
[0334] The kernel layer is the layer between hardware and software. The kernel layer at least includes display driver, camera driver, audio driver, sensor driver.
[0335] The voice cooperative input method provided by the embodiments of the application is described in detail in combination with the drawings and specific application scenarios.
[0336] Please refer to Figure 3 , Figure 3 The flowchart of the voice cooperative input method provided by the embodiments of the application is shown. As Figure 3 shown, the method can include:
[0337] S301, the first electronic device detects a preset operation.
[0338] S302, the first electronic device acquires the voice content input by the user.
[0339] S303, in response to the preset operation, the first electronic device converts the voice content into text content, and determines a second electronic device.
[0340] S304, the first electronic device transmits the text content to the second electronic device.
[0341] S305, the second electronic device displays the text content.
[0342] As can be seen from the above, when a user wants to input text content to a certain electronic device through voice, the user can perform a preset operation on the first electronic device. When the first electronic device detects the preset operation, the voice recognition function can be started to obtain the voice content input by the user, and the voice content can be converted into text content. For the first electronic device with the voice recognition function always turned on by default, when the first electronic device detects the preset operation, the voice content input by the user can be directly converted into text content. At the same time, the first electronic device can determine the second electronic device, i.e., determine the electronic device to which the user wants to input the text content through voice, and transmit the text content to the second electronic device.
[0343] After the second electronic device receives the text content, the second electronic device can display the text content, so that the user can perform editing, saving, or sending operations on the text content on the second electronic device. The purpose of inputting text content to the second electronic device through voice can be achieved by starting the voice recognition function of the first electronic device through the preset operation and using the voice recognition function of the first electronic device. The operation is simple and convenient, and the efficiency is high.
[0344] In a possible implementation, the first electronic device can determine the second electronic device when detecting the preset operation and recognizing that there is voice content input, so as to avoid false triggering of the text sending function of the first electronic device and reduce the power consumption of the first electronic device.
[0345] The first electronic device can be a smart watch, a smart bracelet, or other wearable device worn on the wrist of a user. The smart watch, the smart bracelet, or other wearable device is provided with a microphone, which can be used to collect voice content input by the user. The preset operation can include a wrist lifting operation, or can include a wrist turning operation and a wrist lifting operation. When the preset operation includes the wrist turning operation and the wrist lifting operation, the wrist turning operation can be performed first, and then the wrist lifting operation can be performed, or the wrist lifting operation can be performed first, and then the wrist turning operation can be performed. The wrist lifting operation can be an operation of moving the first electronic device upward (i.e., moving in the vertical direction) by a specified distance. The wrist turning operation can be an operation of turning the first electronic device by a preset angle. The specified distance and the preset angle can be determined according to actual conditions.
[0346] That is, the wearable device (e.g., smart watch, smart bracelet, etc.) can use its microphone as a voice input port of the second electronic device, so that when the user inputs text content to the second electronic device, the user can lift the wrist or turn the wrist and lift the wrist to move the microphone of the wearable device (e.g., smart watch, smart bracelet, etc.) close to the mouth, so that the user can input voice content softly, and the wrist can also shield the mouth to ensure that the voice input does not disturb people nearby and to ensure the privacy of the voice input, thereby improving the user experience.
[0347] It should be understood that the second electronic device can be an electronic device with a microphone or an electronic device without a microphone. That is, the wearable device (e.g., smart watch, smart bracelet, etc.) can use its microphone as a voice input port of the electronic device without a microphone, so that the user can conveniently input text content to the electronic device without a microphone, thereby improving the user experience.
[0348] The following describes in detail the determination process of the second electronic device, taking the first electronic device as a smart watch as an example.
[0349] In the embodiments of the present application, when the preset operation is detected, the smart watch can determine whether there is a target device. The target device can be an electronic device held by the hand wearing the smart watch. If there is a target device, the smart watch can determine the target device as the second electronic device.
[0350] In one possible implementation, the smart watch can determine whether there is a target device according to the first acceleration data corresponding to the smart watch and the second acceleration data corresponding to the electronic device A. Alternatively, the smart watch can determine whether there is a target device according to the first angular velocity data corresponding to the smart watch and the second angular velocity data corresponding to the electronic device A. In the embodiments of the present application, the acceleration can include linear acceleration or angular acceleration.
[0351] The first acceleration data can include the acceleration of the smart watch in each direction (generally x-axis, y-axis and z-axis) or the angular acceleration around the three axes. The first angular velocity data can include the angular velocity of the smart watch around the three axes (i.e., x-axis, y-axis and z-axis). The second acceleration data is similar to the first acceleration data, and the second angular velocity data is similar to the first angular velocity data.
[0352] It should be understood that the electronic device A can be an electronic device satisfying a first preset condition. The first preset condition can be one or more of the following conditions: (1) the distance between the smart watch and the electronic device is less than or equal to a first distance threshold; (2) the smart watch logs in the same user account or can control the smart watch; (3) the device type is a preset type. The first distance threshold can be set by the technician according to the actual scene, or can be set by the user. For example, the technician can set the first distance threshold to 10 cm, 15 cm or 30 cm, etc. according to the actual scene. The preset type can be the type of electronic device that can be operated by the user, such as a mobile phone, a tablet computer, etc.
[0353] That is, the electronic device A can be an electronic device whose distance to the smart watch is less than or equal to the first distance threshold. Alternatively, the electronic device A can be an electronic device that logs in the same user account as the smart watch or can control the smart watch, so that the second electronic device that ultimately acquires the text content belongs to the same user's electronic device as the smart watch, or is an electronic device that can control the smart watch and is authorized by the user to which the smart watch belongs, ensuring the privacy of the text content and protecting the user's privacy.
[0354] Alternatively, the electronic device A can be an electronic device whose distance to the smart watch is less than or equal to the first distance threshold, and the device type is a preset type. Alternatively, the electronic device A can be an electronic device that logs in the same user account as the smart watch or can control the smart watch, and the distance between the electronic device and the smart watch is less than or equal to the first distance threshold. Alternatively, the electronic device A can be an electronic device that logs in the same user account as the smart watch or can control the smart watch, and the device type is a preset type. Alternatively, the electronic device A can be an electronic device that logs in the same user account as the smart watch or can control the smart watch, and the distance between the electronic device and the smart watch is less than or equal to the first distance threshold, and the device type is a preset type.
[0355] It should be noted that the distance between the smart watch and other electronic devices can be measured by the distance sensor of the smart watch, or by the distance sensor of other electronic devices. That is, when the preset operation is detected, the smart watch can measure the distance between the smart watch and the surrounding electronic devices through the distance sensor of the smart watch. Alternatively, the smart watch can send a distance measurement request to the surrounding electronic devices, such as sending a bluetooth low energy (BLE) broadcast with a distance measurement identifier, to request the surrounding electronic devices to measure the distance between them and the smart watch, and send the measured distance to the smart watch.
[0356] The following are described respectively: 1. According to the first acceleration data corresponding to the smart watch and the second acceleration data corresponding to the electronic device A, it is determined whether there is a target device. 2. According to the first angular velocity data corresponding to the smart watch and the second angular velocity data corresponding to the electronic device A, it is determined whether there is a target device.
[0357] 1. According to the first acceleration data corresponding to the smart watch and the second acceleration data corresponding to the electronic device A, it is determined whether there is a target device
[0358] It should be understood that if the hand wearing the smart watch holds the target device at the same time, the smart watch and the target device will move synchronously. The sensor of the smart watch can obtain the acceleration data of the smart watch in real time. At the same time, the sensor of the target device can also obtain the acceleration data of the target device in real time.
[0359] The following describes the acceleration changes of the smart watch and the target device when the hand wearing the smart watch holds the target device at the same time.
[0360] Please refer to Figure 4 , Figure 4 An example of acceleration provided by the embodiments of the present application is shown. Among them, Figure 4 The acceleration of the smart watch and the target device on the x-axis, the acceleration on the y-axis, and the acceleration on the z-axis are shown during the process of moving the smart watch close to the user's mouth for voice input, and restoring the smart watch to the original state (i.e. the state when not moving) after the voice input is completed.
[0361] When the orientation of the display interface of the target device is different from the orientation of the display interface of the smart watch, for example, when the display interface of the target device is inward (i.e. towards the user), and the display interface of the smart watch is outward (i.e. away from the user), or when the display interface of the target device is upward, and the display interface of the smart watch is downward, when the user moves the smart watch close to the user's mouth, the user also needs to turn the wrist with a large amplitude (for example, the amplitude of the turn can be between 150 degrees and 180 degrees) to make the microphone of the smart watch close to the user's mouth when the smart watch is moved close to the user's mouth, so as to facilitate the user to input voice.
[0362] At this time, according to the acceleration data collected by the sensor of the smart watch, the acceleration of the smart watch on the x-axis, the acceleration on the y-axis, and the acceleration on the z-axis can be obtained as shown in (a) of Figure 4 At the same time, according to the acceleration data collected by the sensor of the target device, the acceleration of the target device on the x-axis, the acceleration on the y-axis, and the acceleration on the z-axis can be obtained as shown in (b) of Figure 4
[0363] From (a) in Figure 4 and (b) in Figure 4 , it can be seen that if the hand wearing the smart watch holds the target device at the same time, the change time corresponding to the acceleration of the smart watch on each axis is basically the same as the change time corresponding to the acceleration of the target device on each axis. At the same time, since the orientation of the display interface of the smart watch is different from (for example, opposite to) the orientation of the display interface of the target device, the direction of the acceleration of the smart watch on the z-axis is opposite to the direction of the acceleration of the target device on the z-axis, but the size is basically the same during the whole movement process.
[0364] It should be understood that basically the same means that the difference between the two is less than or equal to a first preset threshold. The first preset threshold can be set according to the actual scene, and the embodiments of the present application are not limited specifically.
[0365] When the orientation of the display interface of the target device is the same as the orientation of the display interface of the smart watch, for example, when the display interface of the smart watch and the display interface of the target device are both inward, or when the display interface of the smart watch and the display interface of the target device are both upward, during the process of moving the smart watch close to the user's mouth, the user only needs to rotate the wrist slightly (for example, the rotation range can be between 10 degrees and 30 degrees), so that when the smart watch is moved close to the user's mouth, the microphone of the smart watch can be close to the user's mouth.
[0366] At this time, according to the acceleration data collected by the sensor of the smart watch, the acceleration of the smart watch on the x-axis, the acceleration on the y-axis and the acceleration on the z-axis can be obtained as shown in (c) in Figure 4 . At the same time, according to the acceleration data collected by the sensor of the target device, the acceleration of the target device on the x-axis, the acceleration on the y-axis and the acceleration on the z-axis can be obtained as shown in (d) in Figure 4 .
[0367] From (c) in Figure 4 and (d) in Figure 5 , it can be seen that if the hand wearing the smart watch holds the target device at the same time, the change time corresponding to the acceleration of the smart watch on each axis is basically the same as the change time corresponding to the acceleration of the target device on each axis. At the same time, since the orientation of the display interface of the smart watch is the same as the orientation of the display interface of the target device, the direction of the acceleration of the smart watch on the z-axis is basically the same as the direction of the acceleration of the target device on the z-axis, and the size is also basically the same during the whole movement process.
[0368] In summary, when the preset operation is detected, the smart watch can acquire the first acceleration data of the smart watch in a preset time period, and the second acceleration data of the electronic device A in the preset time period. The preset time period can be a time period containing the execution time of the preset operation. The preset time period can be set according to an actual scenario, for example, the preset time period can be determined according to the execution time required by the preset operation, and the embodiments of the present application do not make specific limitations.
[0369] When the smart watch determines that the change time corresponding to the acceleration of a certain electronic device A on each axis is basically the same as the change time corresponding to the acceleration of the smart watch on each axis. At the same time, in the preset time period, the direction of the acceleration of the electronic device A on the z-axis is opposite to the direction of the acceleration of the smart watch on the z-axis, but the size is basically the same, the smart watch can determine that the electronic device A and the smart watch are located in the same hand, that is, determine that the electronic device A is the target device.
[0370] Or, when the smart watch determines that the change time corresponding to the acceleration of a certain electronic device A on each axis is basically the same as the change time corresponding to the acceleration of the smart watch on each axis. At the same time, in the preset time period, the direction of the acceleration of the electronic device A on the z-axis is basically the same as the direction of the acceleration of the smart watch on the z-axis, and the size is also basically the same, the smart watch can determine that the electronic device A and the smart watch are located in the same hand, that is, determine that the electronic device A is the target device.
[0371] II. According to the first angular velocity data corresponding to the smart watch and the second angular velocity data corresponding to the electronic device A, determine whether there is a target device
[0372] It should be understood that if the hand wearing the smart watch holds the target device at the same time, the smart watch and the target device will move synchronously. The sensor of the smart watch can acquire the angular velocity data of the smart watch in real time. At the same time, the sensor of the target device can also acquire the angular velocity data of the target device in real time.
[0373] The angular velocity change of the smart watch and the angular velocity change of the target device when the hand wearing the smart watch holds the target device at the same time are described below.
[0374] Please refer to Figure 5 , Figure 5 An example diagram of the angular velocity change provided by the embodiments of the present application is shown. Among them, Figure 5 The angular velocity of the smart watch and the target device around the x-axis, the angular velocity around the y-axis, and the angular velocity around the z-axis are shown during the process of moving the smart watch close to the user's mouth for voice input, and restoring the smart watch to the original state (i.e. the state when not moving) after the voice input is completed.
[0375] When the orientation of the display interface of the target device is different from the orientation of the display interface of the smart watch, for example, when the display interface of the target device faces inwards and the display interface of the smart watch faces outwards, or when the display interface of the target device faces upwards and the display interface of the smart watch faces downwards, when the user moves the smart watch close to the user's mouth, the user also needs to rotate the wrist by a large amplitude, so that when the smart watch is moved close to the user's mouth, the microphone of the smart watch can be close to the user's mouth to facilitate the user to make voice input.
[0376] At this time, the smart watch can obtain the angular velocity of the smart watch around the x-axis, the angular velocity of the smart watch around the y-axis, and the angular velocity of the smart watch around the z-axis according to the angular velocity data collected by the sensors of the smart watch, as shown in (a) of Figure 5 At the same time, the smart watch can obtain the angular velocity of the target device around the x-axis, the angular velocity of the target device around the y-axis, and the angular velocity of the target device around the z-axis according to the angular velocity data collected by the sensors of the target device, as shown in (b) of Figure 5
[0377] From (a) of Figure 5 and (b) of Figure 5 If the hand wearing the smart watch holds the target device at the same time, the change time corresponding to the angular velocity of the smart watch around each axis is basically the same as the change time corresponding to the angular velocity of the target device around each axis. At the same time, since the orientation of the display interface of the smart watch is different from the orientation of the display interface of the target device, for example, opposite, the change direction of the angular velocity of the smart watch around the x-axis is basically the same as the change direction of the angular velocity of the target device around the x-axis, only the amplitude of the change is different, that is, after the angular velocity changes, the size of the angular velocity of the smart watch around the x-axis is different from the size of the angular velocity of the target device around the x-axis, for example, at the moment when the angular velocity changes to the maximum, the angular velocity of the smart watch around the x-axis can be 4.2 rad / s, and the angular velocity of the target device around the x-axis can be 5.3 rad / s.
[0378] When the orientation of the display interface of the target device is the same as the orientation of the display interface of the smart watch, for example, when the display interface of the smart watch and the display interface of the target device both face inwards, or when the display interface of the smart watch and the display interface of the target device both face upwards, during the process that the user moves the smart watch close to the user's mouth, the user only needs to rotate the wrist by a small amplitude, so that when the smart watch is moved close to the user's mouth, the microphone of the smart watch can be close to the user's mouth.
[0379] At this time, the smart watch can obtain the angular velocity of the smart watch around the x-axis, the angular velocity of the smart watch around the y-axis, and the angular velocity of the smart watch around the z-axis according to the angular velocity data collected by the sensors of the smart watch, as shown in (a) of Figure 5 as shown in (c) of FIG. 6. Meanwhile, the smart watch can obtain the angular velocity of the target device around the x-axis, the angular acceleration of the target device around the y-axis, and the angular velocity of the target device around the z-axis according to the angular velocity data collected by the sensor of the target device, as shown in (d) of FIG. 6. Figure 5
[0380] From (c) of FIG. 6 and (d) of FIG. 6, it can be seen that if the hand wearing the smart watch holds the target device at the same time, the change time of the angular velocity of the smart watch around each axis corresponds to the change time of the angular velocity of the target device around each axis. Meanwhile, since the orientation of the display interface of the smart watch is the same as the orientation of the display interface of the target device, the change direction of the angular velocity of the smart watch around the z-axis is basically the same as the change direction of the angular velocity of the target device around the z-axis, and only the change amplitude is different, that is, after the angular velocity changes, the size of the angular velocity of the smart watch around the z-axis is different from the size of the angular velocity of the target device around the z-axis, for example, at the moment when the angular velocity changes to the maximum, the angular velocity of the smart watch around the z-axis can be -0.6 rad / s, and the angular velocity of the target device around the z-axis can be -1.4 rad / s. Figure 5 Figure 6
[0381] In summary, when the preset operation is detected, the smart watch can obtain the first angular velocity data of the smart watch in a preset time period, and the second acceleration data of the electronic device A in the preset time period. The preset time period can be a time period containing the execution time of the preset operation.
[0382] When the smart watch determines that the change time of the angular velocity of a certain electronic device A around each axis corresponds to the change time of the angular velocity of the smart watch around each axis. Meanwhile, in the preset time period, the change direction of the angular velocity of the electronic device A around the x-axis is basically the same as the change direction of the angular velocity of the smart watch around the x-axis, and only the change amplitude is different, the smart watch can determine that the electronic device A and the smart watch are located in the same hand, that is, determine that the electronic device A is the target device.
[0383] Or, when the smart watch determines that the change time of the angular velocity of a certain electronic device A around each axis corresponds to the change time of the angular velocity of the smart watch around each axis. Meanwhile, in the preset time period, the change direction of the angular velocity of the electronic device A around the z-axis is basically the same as the change direction of the angular velocity of the smart watch around the z-axis, and only the change amplitude is different, the smart watch can determine that the electronic device A and the smart watch are located in the same hand, that is, determine that the electronic device A is the target device.
[0384] In the embodiments of the present application, the smart watch can also combine the acceleration data and the angular velocity data to determine whether the target device exists. For example, when the smart watch determines that the change time corresponding to the acceleration of an electronic device A is substantially the same as the change time corresponding to the acceleration of the smart watch, and the change time corresponding to the angular velocity of the electronic device A is substantially the same as the change time corresponding to the angular velocity of the smart watch in a preset time period. Meanwhile, in the preset time period, the direction of the acceleration of the electronic device A on the z-axis is opposite to the direction of the acceleration of the smart watch on the z-axis, but the size is substantially the same, and the change direction of the angular velocity of the electronic device A around the x-axis is substantially the same as the change direction of the angular velocity of the smart watch around the x-axis, only the amplitude of the change is different, the smart watch can determine that the electronic device A and the smart watch are located in the same hand, that is, determine that the electronic device A is the target device.
[0385] For example, when the smart watch determines that the change time corresponding to the acceleration of an electronic device A is substantially the same as the change time corresponding to the acceleration of the smart watch, and the change time corresponding to the angular velocity of the electronic device A is substantially the same as the change time corresponding to the angular velocity of the smart watch in a preset time period. Meanwhile, in the preset time period, the direction of the acceleration of the electronic device A on the z-axis is substantially the same as the direction of the acceleration of the smart watch on the z-axis, and the size is also substantially the same, and the change direction of the angular velocity of the electronic device A around the z-axis is substantially the same as the change direction of the angular velocity of the smart watch around the z-axis, only the amplitude of the change is different, the smart watch can determine that the electronic device A and the smart watch are located in the same hand, that is, determine that the electronic device A is the target device.
[0386] For example, when the smart watch determines that the change time corresponding to the acceleration of an electronic device A is substantially the same as the change time corresponding to the acceleration of the smart watch, and the change time corresponding to the angular velocity of the electronic device A is substantially the same as the change time corresponding to the angular velocity of the smart watch in a preset time period. Meanwhile, in the preset time period, the direction of the acceleration of the electronic device A on the z-axis is substantially the same as the direction of the acceleration of the smart watch on the z-axis, and the size is also substantially the same, and the change direction of the angular velocity of the electronic device A around the z-axis is substantially the same as the change direction of the angular velocity of the smart watch around the z-axis, only the amplitude of the change is different, the smart watch can determine that the electronic device A and the smart watch are located in the same hand, that is, determine that the electronic device A is the target device.
[0387] Therefore, when the smart watch obtains the first acceleration data and the first angular velocity data of the smart watch, and the second acceleration data and the second angular velocity data of the electronic device A, the smart watch can fuse the first acceleration data and the first angular velocity data at the same time to obtain the fusion data corresponding to the smart watch, and can fuse the second acceleration data and the second angular velocity data at the same time to obtain the fusion data corresponding to the electronic device A. When the relationship between the fusion data corresponding to the electronic device A and the fusion data corresponding to the smart watch is the first preset relationship, the smart watch can determine that the electronic device A and the smart watch are located in the same hand, that is, the electronic device A can be determined as the target device.
[0388] In the embodiments of the present application, the smart watch can determine whether there is a target device in combination with the magnetic field data collected by the magnetic sensor. For example, the smart watch can determine whether there is a target device according to the first acceleration data, the first angular velocity data and the first magnetic field data of the smart watch, and the second acceleration data, the second angular velocity data and the second magnetic field data of the electronic device A.
[0389] Similarly, the smart watch can fuse the first acceleration data, the first angular velocity data and the first magnetic field data at the same time to obtain the fusion data corresponding to the smart watch, and can fuse the second acceleration data, the second angular velocity data and the second magnetic field data at the same time to obtain the fusion data corresponding to the electronic device A, so as to determine whether there is a target device according to whether the relationship between the fusion data corresponding to the smart watch and the fusion data corresponding to the electronic device A is the second preset relationship. The second preset relationship is the corresponding relationship between the fusion data corresponding to the acceleration data, the angular velocity data and the magnetic field data of the smart watch and the fusion data corresponding to the acceleration data, the angular velocity data and the magnetic field data of the target device when the hand wearing the smart watch holds the target device at the same time.
[0390] In another possible implementation, the smart watch can determine whether there is a target device according to the first moving distance corresponding to the smart watch and the second moving distance corresponding to the electronic device A.
[0391] It should be understood that if the hand wearing the smart watch holds the target device at the same time, the first moving distance corresponding to the smart watch is basically the same as the second moving distance corresponding to the target device when the smart watch is moved close to the user's mouth for voice input. That is, the difference between the first moving distance and the second moving distance is less than or equal to the second preset threshold. The first moving distance can be between 20 cm and 40 cm. The second preset threshold can be set according to the actual scene, and the embodiments of the present application do not make specific limitations.
[0392] Therefore, when the preset operation is detected, i.e., when the smart watch is detected to be moved close to the mouth of the user, the smart watch can acquire a first moving distance corresponding to the smart watch, and acquire a second moving distance corresponding to the electronic device A. When the smart watch determines that the difference between the first moving distance and the second moving distance corresponding to the electronic device A is less than or equal to a second preset threshold, the smart watch can determine that the electronic device A is in the same hand as the smart watch, i.e., can determine that the electronic device A is the target device.
[0393] In the embodiments of the present application, the smart watch can also determine whether the target device exists according to the acceleration data and / or the angular velocity data, and the moving distance. For example, the smart watch can determine whether the target device exists according to the acceleration data and the moving distance. For example, the smart watch can also determine whether the target device exists according to the angular velocity data and the moving distance. For example, the smart watch can determine whether the target device exists according to the acceleration data, the angular velocity data and the moving distance.
[0394] For example, when the smart watch determines that the change time corresponding to the acceleration of a certain electronic device A is substantially the same as the change time corresponding to the acceleration of the smart watch in a preset time period, and the difference between the second moving distance corresponding to the electronic device A and the first moving distance corresponding to the smart watch is less than or equal to a second preset threshold in the preset time period, the smart watch can determine that the electronic device A is in the same hand as the smart watch, i.e., can determine that the electronic device A is the target device.
[0395] In another possible implementation, on the basis of the above determination of the target device, the smart watch can determine whether the target device exists in combination with the ambient light brightness. For example, the smart watch can determine whether the target device exists according to the acceleration data and the ambient light brightness. Or, the smart watch can determine whether the target device exists according to the angular velocity data and the ambient light brightness. Or, the smart watch can determine whether the target device exists according to the moving distance and the ambient light brightness. Or, the smart watch can determine whether the target device exists according to the acceleration data, the moving distance and the ambient light brightness, and so on.
[0396] It should be understood that when the hand wearing the smart watch holds the target device at the same time, if the orientation of the display interface of the smart watch is different from the orientation of the display interface of the target device, for example, when the smart watch is outward and the target device is inward, the first ambient light brightness collected by the ambient light sensor of the smart watch is substantially the same as the third ambient light brightness collected by the ambient light sensor of the target device, or the first ambient light brightness collected by the ambient light sensor of the smart watch is lower than the third ambient light brightness collected by the ambient light sensor of the target device, when the smart watch is not moved close to the mouth of the user.
[0397] When a user moves the smartwatch close to their mouth for voice input, the smartwatch's display will face upwards, while the target device's display will face downwards. At this time, the second ambient light brightness detected by the smartwatch's ambient light sensor will be higher than the fourth ambient light brightness detected by the target device's ambient light sensor. Therefore, the smartwatch can determine the presence of the target device by combining the changes in ambient light brightness detected by its own ambient light sensor with that of the target device.
[0398] In another possible implementation, in addition to identifying the target device as described above, the smartwatch can also combine sound signals to determine the presence of the target device. For example, the smartwatch can determine the presence of the target device based on acceleration data and sound signals. Alternatively, it can determine the presence of the target device based on angular velocity data and sound signals. Or, it can determine the presence of the target device based on acceleration signals, ambient light levels, and sound signals, and so on. The sound signal can include volume level.
[0399] It should be understood that when the hand wearing the smartwatch is also holding the target device, and the smartwatch is moved close to the user's mouth, the distance between the smartwatch's microphone and the user's mouth is closer than the distance between the target device's microphone and the user's mouth. Therefore, the volume of the sound signal captured by the smartwatch's microphone will be greater than the volume of the sound signal captured by the target device's microphone. Thus, the smartwatch can determine the presence of the target device by combining the magnitude of the sound signal captured by the smartwatch with that captured by the third electronic device.
[0400] Please see Figure 6 , Figure 1 This application illustrates an application scenario provided by an embodiment of the present application. Figure 6 .
[0401] like Figure 6 As shown in (a), when a user wants to input text content to an electronic device (e.g., a mobile phone) via voice, the user can hold the mobile phone 601 while wearing a smartwatch 600. Subsequently, as... Figure 6 As shown in (b), users can flip and move their wrists to bring the smartwatch 600 closer to their mouths for whispered voice input. At the same time, the wrists can also cover the mouth to ensure that the voice input will not disturb people nearby and to ensure the privacy of the voice input, which can improve the user experience.
[0402] When the smart watch 600 detects the wrist-lifting operation, the smart watch 600 can start the voice recognition function of the smart watch 600, acquire voice content input by the user, and convert the voice content into text content. At this time, the smart watch 600 can determine, according to the determination manner described above, that the mobile phone 601 and the smart watch 600 are located in the same hand, and can determine the mobile phone 601 as the second electronic device. Subsequently, the smart watch 600 can send the text content to the mobile phone 601.
[0403] As shown in (c) of FIG. 6B, after the mobile phone 601 receives the text content, the mobile phone 601 can display the text content, for example, by creating a note 602. Figure 7
[0404] In the embodiment of the present application, when there is no target device, that is, when the hand wearing the smart watch does not hold an electronic device, the smart watch can send an acquisition request to the surrounding electronic device B to request the device state and / or the device type of the electronic device B. Subsequently, the smart watch can determine the second electronic device according to the device state and / or the device type of the electronic device B.
[0405] In one example, the smart watch can acquire, from one or more electronic devices B, an electronic device C with a preset state, and determine the second electronic device from the one or more electronic devices C.
[0406] It should be understood that the electronic device requiring voice collaborative input through the smart watch is generally an electronic device close to the smart watch, and therefore, the electronic device B can be an electronic device with a distance from the smart watch less than or equal to a second distance threshold. The second distance threshold can be set by a technician according to an actual scene, or can be set by a user. For example, the technician can set the second distance threshold to 20 cm or 25 cm according to an actual scene.
[0407] The electronic device B can include an electronic device that has been communicatively connected to the smart watch, or can include an electronic device that has not been communicatively connected to the smart watch.
[0408] The preset state can be a state in which a window or an input box in which content can be input exists, or can be a state in which a click operation or a touch operation is detected within a first preset time period, or can be a state in which a mouse click event or a keyboard input event is detected within a second preset time period.
[0409] It should be understood that the first preset time length and / or the second preset time length can be set by the technician according to the actual scene, or can be customized by the user. The first preset time length and the second preset time length can be the same or different. For example, the user can customize the first preset time length to be 4s and the second preset time length to be 5s. For example, the user can customize the first preset time length and the second preset time length to be 5s, and the like.
[0410] Optionally, when the electronic device C includes only one, the smart watch can determine the electronic device C as the second electronic device. When the electronic device C includes multiple, the smart watch can obtain the electronic device with the device state of "existence of window or input box capable of inputting content", and determine the electronic device as the second electronic device.
[0411] Among them, when the electronic device C with the device state of "existence of window or input box capable of inputting content" includes multiple, the smart watch can determine the last active electronic device as the second electronic device. Alternatively, the smart watch can determine the matching degree between the text content and the existing content in the window or input box, or can determine the matching degree between the text content and the application corresponding to the window or input box, and determine the electronic device with the highest matching degree as the second electronic device. It should be understood that the last active electronic device can be the electronic device that last detects the click operation or the touch operation, or can be the electronic device that last detects the mouse click event or the keyboard input event.
[0412] When the device state of the electronic device C is not "existence of window or input box capable of inputting content", that is, when there is no window or input box capable of inputting content in the electronic device C, the smart watch can determine the last active electronic device as the second electronic device. For example, the smart watch can determine the active time corresponding to each electronic device, and determine the electronic device with the closest active time to the current time as the second electronic device. Among them, the active time corresponding to the electronic device is the time when the electronic device last detects the click operation or the touch operation, or is the time when the electronic device last detects the mouse click event or the keyboard input event.
[0413] For example, when the electronic device C includes a mobile phone and a notebook computer, and the hand wearing the smart watch does not hold the mobile phone or the notebook computer, and there is no window or input box capable of inputting content in the mobile phone and the notebook computer, if the smart watch determines that the last time when the mobile phone detects the touch operation is 9:30:35, and the last time when the notebook computer detects the mouse click event is 9:30:37, the smart watch can determine the notebook computer as the second electronic device.
[0414] Optionally, to avoid sending the text content to other electronic devices of other users, thus causing the user privacy to be leaked, the electronic device C can be an electronic device logged in the same user account as the smart watch, or an electronic device capable of controlling the smart watch, so that the last determined second electronic device belongs to the same user as the smart watch, or an electronic device authorized by the user of the smart watch and capable of controlling the smart watch.
[0415] In another example, the smart watch can determine the matching degree between the text content and the device type, and obtain an electronic device D with a matching degree greater than a preset matching degree, to determine the second electronic device from one or more electronic devices D. The preset matching degree can be set according to the actual scene, and the embodiments of the present application do not make specific limitations.
[0416] In the embodiments of the present application, after the smart watch determines the second electronic device, the smart watch can send the text content to the second electronic device. After the second electronic device receives the text content, the second electronic device can display the text content, so that the user can edit, save, send, etc. the text content in the second electronic device. That is, in the embodiments of the present application, the smart watch can be moved to the mouth by lifting the wrist to input the voice softly, and the mouth can be blocked by the wrist to ensure that the voice input does not disturb the people nearby and to ensure the privacy of the voice input, thus improving the user experience.
[0417] For example, when there is a window for inputting content in the second electronic device, the second electronic device can display the text content in the window. For example, when there is an input box for inputting content in the second electronic device, the second electronic device can display the text content in the input box. For example, when there is no window for inputting content in the second electronic device, and there is no input box for inputting content, the second electronic device can create a card (or a note), and can input the text content into the card (or the note) to display the text content in the card (or the note); the card (or the note) can be displayed floating on the current interface of the second electronic device. Alternatively, the second electronic device can automatically open an application, and can input the text content into the application to display the text content through the application, for example, can open a memo application to display the text content through the memo application.
[0418] Please refer to Figure 7 , Figure 2 application scenarios provided by the embodiments of the present application are shown Figure 7This application scenario uses a laptop computer 700 as the second electronic device and the text content "Smile and embrace every day" as an example for illustration. After receiving the text content, the laptop computer 700 can determine whether there is a window or input box on its display interface where content can be entered. For example... Figure 7 (a) and Figure 7 As shown in (b), when a window 701 with input content exists in the display interface, the laptop computer 700 can input text content into the window 701 to display the text content in the window 701. Or, as... Figure 7 (c) and Figure 8 As shown in (d), when there is an input box 702 in the display interface where content can be entered, the laptop computer 700 can input text content into the input box 702 to display the text content in the input box 702.
[0419] Please see Figure 8 , Figure 3 This application illustrates an application scenario provided by an embodiment of the present application. Figure 8 This application scenario uses a mobile phone (800) as the second electronic device and the text content "Smile and embrace every day" as an example for illustration. Figure 8 (a) and Figure 9 As shown in (b), when there is no window or input box for inputting content on the mobile phone 800, for example, when the mobile phone 800 displays the main interface, the mobile phone 800 can create a card (or sticky note) 801 and input text content into the card (or sticky note) 801 to display the text content. Alternatively, the mobile phone 800 can automatically open an application and input text content into that application to display the text content through that application. For example, it can open the Notes application to display the text content through the Notes application. The main interface of the mobile phone 800 can display icons for applications such as clock, calendar, gallery, notes, file manager, music, email, health, camera, phone, and SMS.
[0420] In one possible implementation, when multiple input windows and / or input boxes exist simultaneously on the display interface of the second electronic device (the following example illustrates the situation with multiple input windows), the second electronic device can determine the last active window and input text content into it for display. In other words, when inputting text content via voice on the smartwatch to the second electronic device, the user can switch windows to input text content into different windows.
[0421] For example, the second electronic device can determine the active time corresponding to each window, and determine the window with the active time closest to the current time as the last active window. The active time corresponding to a window is the time when the second electronic device detects the last click or touch on the window, or the time when the second electronic device detects the last mouse click or keyboard input in the window.
[0422] Referring to Figure 9 , Figure 4 An application scenario provided by an embodiment of the present application is shown in Figure 9 . The application scenario is exemplarily described by taking a notebook computer 900 as the second electronic device. There are multiple windows capable of inputting content in the display interface of the notebook computer 900. When a user wants to input the text content "smile to face each day" to window 901 (i.e., notebook 1) by voice, as shown in (a) of Figure 9 , the user can click window 901 to move the cursor to window 901, and move the smart watch to the mouth to input the voice content "smile to face each day". After the smart watch receives the voice content, the smart watch can convert the voice content into text content, and send the text content to the notebook computer 900. As shown in (b) of Figure 9 , when the notebook computer 900 receives the text content, the notebook computer 900 can determine that window 901 is the last active window, and at this time, the notebook computer 900 can input the text content "smile to face each day" to window 901.
[0423] Subsequently, when the user wants to input the text content "today is a good day" to window 902 (i.e., notebook 2) by voice, as shown in (c) of Figure 9 , the user can click window 902 to move the cursor to window 902, and continue to input the voice content "today is a good day" to the smart watch. After the smart watch receives the voice content, the smart watch can convert the voice content into text content, and can send the text content to the notebook computer 900. As shown in (d) of Figure 9 , when the notebook computer 900 receives the text content, the notebook computer 900 can determine that window 902 is the last active window, and at this time, the notebook computer 900 can input the text content "today is a good day" to window 902.
[0424] Subsequently, when the user wants to input the text content "work together" to window 901 by voice again, as shown in (e) of Figure 9 , the user can click window 902 again to move the cursor to window 902, and continue to input the voice content "work together" to the smart watch. After the smart watch receives the voice content, the smart watch can convert the voice content into text content, and can send the text content to the notebook computer 900. As shown in (f) ofFigure 7 As shown in (f) of FIG. 9, when the notebook computer 900 receives the text content, the notebook computer 900 can determine that the window 902 is the last active window, and the notebook computer 900 can input the text content "Go together" into the window 902.
[0425] In another possible implementation, when there are multiple windows and / or input boxes in which the text content can be input in the display interface of the second electronic device, the second electronic device can determine the application corresponding to the window or the input box, and / or obtain the existing content in the window or the input box. Subsequently, the second electronic device can determine the matching degree between the text content and the application, and / or determine the matching degree between the text content and the existing content, and determine the window or the input box corresponding to the text content according to the matching degree, so as to accurately determine the position where the user wants to input the text content through the matching degree, facilitate subsequent operations of the user on the text content, and improve user experience.
[0426] For example, the second electronic device can determine the window or the input box with a matching degree greater than or equal to a preset matching degree, or determine the window or the input box with the maximum matching degree, and input the text content into the window or the input box. It can be understood that the preset matching degree can be set by a technician according to an actual scene, can be determined by the second electronic device by analyzing historical data of the application, or can be set by the user.
[0427] In the embodiment of the present application, the text content transmitted by the smart watch to the second electronic device can be input content of the second electronic device, and the user can also edit, save, send, and the like, the input content. For example, as shown in the application scenario of (a) of FIG. 9, the user can modify the text content in the window or the input box, or can copy the text content in the window or the input box to another application. Figure 7 For example, as shown in the application scenario of (a) of FIG. 9, the user can modify the text content in the window or the input box, or can copy the text content in the window or the input box to another application. Figure 10 For example, as shown in the application scenario of (c) of FIG. 9, the input box can be an input box of an instant messaging application, and the user can directly send the text content in the input box to an electronic device of another user.
[0428] It should be understood that when the smart watch does not determine a suitable second electronic device, the smart watch can display the text content by itself. For example, the text content is input into a window or an input box in the smart watch, or a card (or a note) is created in the smart watch to input the text content, and the like.
[0429] In a possible implementation, when the smart watch determines that the second electronic device is not the electronic device that the user wants to input text content by voice, the user can perform a revocation and resend operation in the smart watch, and can perform a corresponding operation on the electronic device that the user wants to input text content by voice (for example, by holding the electronic device with the hand wearing the smart watch, or clicking, touching the screen of the electronic device, and the like). When the revocation and resend operation is detected, the smart watch can revoke the sent text content. At the same time, the smart watch can redetermine the second electronic device, and can send the text content to the redetermined second electronic device.
[0430] It should be noted that the smart watch converts the voice content into text content, and then sends the text content to the second electronic device, which is only illustrative and should not be construed as a limitation of the embodiments of the present application. In the embodiments of the present application, the smart watch can also directly send the voice content to the second electronic device. After receiving the voice content, the second electronic device can convert the voice content into text content, and display the text content in a window or input box of the second electronic device, or in a created card or note, or in an opened application, so as to reduce the performance requirement of the smart watch.
[0431] That is, when the smart watch detects the wrist lifting operation, the voice recognition function can be started to obtain the voice content input by the user. At the same time, the smart watch can determine the second electronic device, and can directly send the voice content to the second electronic device. After receiving the voice content, the second electronic device can convert the voice content into text content, and display the text content.
[0432] Alternatively, in the scenario in which the voice recognition function of the smart watch has been started, when the smart watch detects the preset operation, the second electronic device can be determined, and the obtained voice content can be sent to the second electronic device. After receiving the voice content, the second electronic device can convert the voice content into text content, and display the text content. Alternatively, when the smart watch detects the preset operation and recognizes that there is voice content input, the second electronic device can be determined, and the obtained voice content can be sent to the second electronic device. After receiving the voice content, the second electronic device can convert the voice content into text content, and display the text content. That is, the smart watch determines the second electronic device again when the preset operation is detected and the voice content input is recognized, which can effectively reduce the power consumption of the smart watch.
[0433] It should be understood that a smartwatch can determine whether to directly send the voice content to a second electronic device or to convert the voice content into text before sending it, based on the actual scenario. For example, if the smartwatch determines that its performance is better, its conversion speed is faster, its performance is superior to that of the second electronic device, or its conversion speed is faster than that of the second electronic device, the smartwatch can convert the voice content into text before sending it to the second electronic device. Conversely, if the smartwatch determines that its performance is worse, its conversion speed is slower, its performance is superior to that of the second electronic device, or its conversion speed is faster than that of the smartwatch, the smartwatch can directly send the voice content to the second electronic device, which will then convert the voice content. Here, conversion speed refers to the speed at which the voice content is converted into text.
[0434] The voice collaborative input method provided in this application will be illustrated below with some other possible application scenarios.
[0435] Please see Figure 10 , Figure 5 This application illustrates an application scenario provided by an embodiment of the present application. Figure 10 When a user wants to input text via voice into a smart TV 1000 that lacks a microphone, the user can move their wrist, bringing the smartwatch closer to their mouth for voice input. Additionally, as... Figure 10 As shown in (a), a user can open a window or input box on the smart TV 1000, such as opening a video application and moving the input cursor to the content comment input box 1001. When the smartwatch detects a wrist raise, it can activate its voice recognition function to obtain the user's voice input (e.g., "Brave Heart") and convert it into text. At this time, the smartwatch can identify the smart TV 1000 as a second electronic device and can send the text content to the smart TV 1000. Figure 11 As shown in (b), after receiving the text content, the smart TV 1000 can display the text content in the content comment input box 1001.
[0436] Please see Figure 11 , Figure 6 This application illustrates an application scenario provided by an embodiment of the present application. Figure 11 When a user wants to input text via voice into a refrigerator 1100 with a screen 1101, such as... Figure 11As shown in (a) of FIG. 11, the user can click or touch the screen 1101 of the refrigerator 1100. Meanwhile, the user can move the wrist to move the smart watch close to the mouth to input the voice. When the smart watch detects the wrist-raising operation, the smart watch can start the voice recognition function of the smart watch to obtain the voice content input by the user (for example, "milk is about to expire, remember to drink in time") and convert the voice content into text content. At this time, the smart watch can determine the refrigerator 1100 as the second electronic device and can send the text content to the refrigerator 1100. As shown in (b) of FIG. 11, after the refrigerator 1100 receives the text content, the refrigerator 1100 can create a note 1102, input the text content into the note 1102, and display the note 1102 in the main interface of the screen 1101. Figure 1
[0437] In one example, when the user wants to input the text content to the electronic message board or the like display device by voice, the user can click or touch the screen of the electronic message board or the like display device. Meanwhile, the user can move the wrist to move the smart watch close to the mouth to input the voice. When the smart watch detects the wrist-raising operation, the smart watch can start the voice recognition function of the smart watch to obtain the voice content input by the user and convert the voice content into text content. At this time, the smart watch can determine the electronic message board or the like display device as the second electronic device and can send the text content to the electronic message board or the like display device. After the electronic message board or the like display device receives the text content, the electronic message board or the like display device can create a note, input the text content into the note, and display the note in the main interface of the screen.
[0438] It should be understood that the size of the serial number of each step in the above embodiment does not mean the order of execution, and the execution order of each process should be determined according to its function and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0439] Corresponding to the voice cooperative input method described in the above embodiment, the embodiments of the present application also provide a voice cooperative input device, and each module of the device can correspondingly implement each step of the voice cooperative input method.
[0440] It should be noted that the information interaction, execution process and the like between the above devices / units, since based on the same concept as the method embodiments of the present application, the specific functions and the technical effects brought by them can be referred to the method embodiments part, and will not be described here.
[0441] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above functional units and modules is exemplified, and in actual application, the above functions can be completed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to complete all or part of the above described functions. The functional units and modules in the embodiments can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit, and the integrated unit can be realized in the form of hardware or software. In addition, the specific names of the functional units and modules are only for easy distinction, and do not limit the protection scope of the present application. The specific working process of the units and modules in the system can refer to the corresponding process in the foregoing method embodiments, which will not be repeated here.
[0442] The embodiments of the present application also provide an electronic device, which includes at least one memory, at least one processor, and a computer program stored in the at least one memory and executable on the at least one processor, and the processor executes the computer program to enable the electronic device to implement the steps in any of the above method embodiments. For example, the structure of the electronic device can be as shown in the
[0443] The embodiments of the present application also provide a voice cooperative input system, which includes a first electronic device and a second electronic device; the first electronic device is configured to execute any of the above method embodiments; and the second electronic device is configured to receive text content or voice content sent by the first electronic device, and display text content corresponding to the text content or the voice content on a display interface of the second electronic device.
[0444] In one example, the first electronic device is a wearable device, and the second electronic device is an electronic device with a display screen.
[0445] In another example, the user account logged in by the first electronic device is the same as the user account logged in by the second electronic device.
[0446] In another example, the distance between the second electronic device and the first electronic device is less than or equal to a first distance threshold.
[0447] In another example, the device type of the second electronic device is a preset type.
[0448] In another example, the device state of the second electronic device is a preset state; the preset state is any one of a first state, a second state and a third state, the first state is a state in which there is a window or an input box in which input content exists, the second state is a state in which a click operation or a touch operation is detected within a first preset time length, and the third state is a state in which a mouse click event or a keyboard input event is detected within a second preset time length.
[0449] The embodiments of the present application further provide a computer readable storage medium, which stores a computer program. The computer program is executed by a computer, so that the computer implements the steps in any of the above method embodiments.
[0450] The embodiments of the present application provide a computer program product. When the computer program product is run on an electronic device, the electronic device implements the steps in any of the above method embodiments.
[0451] The integrated unit, if realized in the form of a software function unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on such understanding, the present application can implement all or part of the processes in the above embodiments by a computer program to instruct related hardware to complete, and the computer program can be stored in a computer readable storage medium. The computer program is executed by a processor, and the steps of each method embodiment described above can be implemented. The computer program includes computer program code, which can be in the form of source code, object code, executable file or some intermediate form. The computer readable storage medium at least includes any entity or device capable of carrying the computer program code to the device / electronic device, recording medium, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal and software distribution medium. For example, U disk, mobile hard disk, magnetic disk or optical disk, etc. In some jurisdictions, according to legislation and patent practice, the computer readable storage medium can not be electrical carrier signal and telecommunication signal.
[0452] In the above embodiments, the description of each embodiment has its own emphasis, and the parts not described or recorded in detail in a certain embodiment can be referred to the relevant description of other embodiments.
[0453] Those skilled in the art can understand that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized in electronic hardware or a combination of computer software and electronic hardware. Whether the functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.
[0454] In the embodiments provided by the present application, it should be understood that the disclosed apparatus / equipment and method can be implemented in other ways. For example, the apparatus / equipment embodiments described above are merely schematic. The division of the modules or units is merely a logical function division. There can be another division manner in actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections can be indirect couplings or communication connections through some interfaces, devices or units, and can be electrical, mechanical or in other forms.
[0455] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, i.e. can be located in one place, or can be distributed on a plurality of network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiments.
[0456] The above-described embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that the technical solutions recorded in the foregoing embodiments can be modified, or some technical features can be replaced by equivalent replacements; and these modifications or replacements do not make the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application.
Claims
1. A voice co-input method, characterized by, The method applied to a first electronic device comprises: The first electronic device detects a preset operation; The first electronic device acquires voice content; In response to the preset operation, the first electronic device converts the voice content into text content; The first electronic device determines whether there is a target device located in the same hand as the first electronic device; When there is a target device located in the same hand as the first electronic device, the first electronic device determines the target device as a second electronic device and sends the text content to the second electronic device, wherein after the second electronic device receives the text content, the text content is displayed on the display interface of the second electronic device; The first electronic device determines whether there is a target device located in the same hand as the first electronic device, comprising: The first electronic device acquires first angular velocity data corresponding to the first electronic device and second angular velocity data corresponding to at least one third electronic device; The first electronic device determines whether there is a target device located in the same hand as the first electronic device according to the first angular velocity data and each second angular velocity data.
2. A voice co-input method, characterized by, The method applied to a first electronic device comprises: The first electronic device detects a preset operation; The first electronic device acquires voice content; In response to the preset operation, the first electronic device determines whether there is a target device located in the same hand as the first electronic device; When there is a target device located in the same hand as the first electronic device, the first electronic device determines the target device as a second electronic device and sends the voice content to the second electronic device, wherein after the second electronic device receives the voice content, the voice content is converted into text content and displayed on the display interface of the second electronic device; The first electronic device determines whether there is a target device located in the same hand as the first electronic device, comprising: The first electronic device acquires first angular velocity data corresponding to the first electronic device and second angular velocity data corresponding to at least one third electronic device; The first electronic device determines whether there is a target device located in the same hand as the first electronic device according to the first angular velocity data and each second angular velocity data.
3. The method of claim 2, wherein, In response to the preset operation, the first electronic device determines a second electronic device, comprising: In response to the preset operation and the first electronic device acquiring voice content, the first electronic device determines a second electronic device.
4. The method according to any one of claims 1 to 3, characterized in that, The preset operation comprises a wrist lifting operation or a wrist lifting operation and a wrist turning operation.
5. The method according to claim 1 or 2, characterized in that, The first electronic device determines whether there is a target device located in the same hand as the first electronic device, comprising: The first electronic device acquires first acceleration data corresponding to the first electronic device and second acceleration data corresponding to at least one third electronic device; The first electronic device determines whether there is a target device located in the same hand as the first electronic device according to the first acceleration data and each second acceleration data.
6. The method of claim 5, wherein, The first electronic device determines whether there is a target device located in the same hand as the first electronic device according to the first acceleration data and each of the second acceleration data, comprising: When the first electronic device determines that there is a fourth electronic device according to the first acceleration data and each of the second acceleration data, the first electronic device determines the fourth electronic device as the target device, wherein the change time of the acceleration of the fourth electronic device on each axis is substantially the same as the change time of the acceleration of the first electronic device on each axis, and the direction of the acceleration of the fourth electronic device on the z-axis is opposite to the direction of the acceleration of the first electronic device on the z-axis, but the size is substantially the same.
7. The method of claim 5, wherein, The first electronic device determines whether there is a target device located in the same hand as the first electronic device according to the first acceleration data and each of the second acceleration data, comprising: When the first electronic device determines that there is a fourth electronic device according to the first acceleration data and each of the second acceleration data, the first electronic device determines the fourth electronic device as the target device, wherein the change time of the acceleration of the fourth electronic device on each axis is substantially the same as the change time of the acceleration of the first electronic device on each axis, and the direction of the acceleration of the fourth electronic device on the z-axis is opposite to the direction of the acceleration of the first electronic device on the z-axis, but the size is substantially the same.
8. The method of claim 1 or 2, wherein, The first electronic device determines whether there is a target device located in the same hand as the first electronic device according to the first angular velocity data and each of the second angular velocity data, comprising: When the first electronic device determines that there is a fifth electronic device according to the first angular velocity data and each of the second angular velocity data, the first electronic device determines the fifth electronic device as the target device, wherein the change time of the angular velocity of the fifth electronic device around each axis is substantially the same as the change time of the angular velocity of the first electronic device around each axis, and the change direction of the angular velocity of the fifth electronic device around the x-axis is substantially the same as the change direction of the angular velocity of the first electronic device around the x-axis, but the change amplitude is different.
9. The method of claim 1 or 2, wherein, The first electronic device determines whether there is a target device located in the same hand as the first electronic device according to the first angular velocity data and each of the second angular velocity data, comprising: When the first electronic device determines that there is a fifth electronic device according to the first angular velocity data and each of the second angular velocity data, the first electronic device determines the fifth electronic device as the target device, wherein the change time of the angular velocity of the fifth electronic device around each axis is substantially the same as the change time of the angular velocity of the first electronic device around each axis, and the change direction of the angular velocity of the fifth electronic device around the z-axis is substantially the same as the change direction of the angular velocity of the first electronic device around the z-axis, but the change amplitude is different.
10. The method of claim 1 or 2, wherein, The first electronic device determines whether there is a target device located in the same hand as the first electronic device, comprising: The first electronic device obtains a first movement distance corresponding to the first electronic device and a second movement distance corresponding to at least one third electronic device; When a difference between the third movement distance and the first movement distance is less than or equal to a preset threshold, the first electronic device determines the third electronic device corresponding to the third movement distance as a target device located in the same hand as the first electronic device, the third movement distance being one of the at least one second movement distance.
11. The method of claim 5, wherein, The at least one third electronic device is an electronic device satisfying one or more of the following conditions: A distance between the first electronic device and the third electronic device is less than or equal to a first distance threshold; The first electronic device and the third electronic device are logged into a same user account; A device type of the third electronic device is a preset type.
12. The method of claim 1 or 2, wherein, After determining whether there is a target device located in the same hand as the first electronic device, the method further includes: When there is no target device located in the same hand as the first electronic device, the first electronic device obtains a device state of at least one fourth electronic device; The first electronic device determines the second electronic device from the at least one fourth electronic device according to the device state.
13. The method of claim 12, wherein, The first electronic device determines the second electronic device from the at least one fourth electronic device according to the device state, including: The first electronic device determines an electronic device having a preset state from the at least one fourth electronic device, and determines the second electronic device according to the electronic device having the preset state; The preset state is any one of a first state, a second state, and a third state, the first state being a state in which there is a window or an input box in which content can be input, the second state being a state in which a click operation or a touch operation is detected within a first preset time period, and the third state being a state in which a mouse click event or a keyboard input event is detected within a second preset time period.
14. The method of claim 13, wherein, The first electronic device determines an electronic device having a preset state from the at least one fourth electronic device, and determines the second electronic device according to the electronic device having the preset state, including: When it is determined that there is an electronic device having the first state from the at least one fourth electronic device, the first electronic device determines the electronic device having the first state as the second electronic device.
15. The method of claim 14, wherein, When the electronic devices having the first state from the at least one fourth electronic device include a plurality of electronic devices, the first electronic device determines the electronic devices having the first state as the second electronic device, including: The first electronic device determines a first active time corresponding to each of the electronic devices having the first state, and determines an electronic device having a first active time closest to a current time as the second electronic device; The first active time corresponding to the electronic device is a time at which the electronic device last detects a click operation or a touch operation, or a time at which the electronic device last detects a mouse click event or a keyboard input event.
16. The method of claim 14, wherein, When the electronic devices in the at least one fourth electronic device in the first state include multiple electronic devices, the first electronic device determines the electronic device in the first state as the second electronic device, comprising: The first electronic device acquires the existing content in the window or the input box of each electronic device in the first state; The first electronic device determines the matching degree of the text content and each existing content, and determines the electronic device with the highest matching degree as the second electronic device.
17. The method of claim 14, wherein, The text content is displayed in the window or the input box of the second electronic device.
18. The method of claim 13, wherein, The first electronic device determines the electronic device in the at least one fourth electronic device in the preset state, and determines the second electronic device according to the electronic device in the preset state, comprising: When there is no electronic device in the at least one fourth electronic device in the first state, but there is an electronic device in the second state and / or the third state, the first electronic device acquires the second active time of each electronic device in the second state or the third state, and determines the electronic device with the closest second active time to the current time as the second electronic device; The second active time of the electronic device corresponds to the time when the electronic device last detects a click operation or a touch operation, or the time when the electronic device last detects a mouse click event or a keyboard input event.
19. The method of claim 18, wherein, The text content is displayed on the display interface of the second electronic device through a card, a note or a target application.
20. The method of any one of claims 13-19, wherein, The first electronic device determines the second electronic device from the at least one fourth electronic device according to the device state, comprising: The first electronic device determines the user account logged in by the at least one fourth electronic device; The first electronic device determines the second electronic device from the at least one fourth electronic device according to the device state and the user account.
21. A voice co-input system, comprising: The system comprises a first electronic device and a second electronic device; The first electronic device is configured to execute the method in any one of claims 1 to 20; The second electronic device is configured to receive the text content or the voice content sent by the first electronic device, and display the text content corresponding to the text content or the voice content on the display interface of the second electronic device.
22. The system of claim 21, wherein, The first electronic device is a wearable device, and the second electronic device is an electronic device with a display screen.
23. The system of claim 21, wherein, The user account logged in by the first electronic device is the same as the user account logged in by the second electronic device.
24. The system of claim 21, wherein, The distance between the second electronic device and the first electronic device is less than or equal to a first distance threshold.
25. The system of claim 21, wherein, The device type of the second electronic device is a preset type.
26. The system of any one of claims 21 to 25, wherein, The device state of the second electronic device is a preset state; the preset state is any one of a first state, a second state and a third state, the first state is a state of existing a window or an input box capable of inputting content, the second state is a state of detecting a click operation or a touch operation within a first preset time length, and the third state is a state of detecting a mouse click event or a keyboard input event within a second preset time length.
27. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein, The computer program is executed by the computer, and the computer program causes the computer to implement the voice cooperative input method in any one of claims 1 to 20.
28. A computer-readable storage medium, the computer-readable storage medium storing a computer program, characterized in that, The computer program is executed by the computer, and the computer program causes the computer to implement the voice cooperative input method in any one of claims 1 to 20.
Citation Information
Patent Citations
Communication method and terminal
CN106231109A
Voice interaction method, first electronic device and readable storage medium
CN111404998A
Method and apparatus for performing at least one operation based on devices context
US20180332164A1