Control method and device, and electronic units

[0049] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0050] In order to make the above objects, features and advantages of the present invention more comprehensible, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0051] refer to figure 1 , which is a flow chart of a control method provided in the embodiment of the present application, the method may include:

[0052] Step S11, detecting voice information;

[0053] In practical applications, when a sound source outputs voice information, usually, an electronic device that is located near the sound source and has a voice collection function will detect the voice information, analyze it, and perform corresponding operations. Of course, the voice information of the sound source may also be detected by an electronic device that meets other conditions, which will not be described in detail in this application.

[0054] Optionally, in this embodiment, the voice information can also be detected by an electronic device with a voice collection function, and the voice information can be sent to other electronic devices for execution in a wireless or wired manner, or after corresponding control instructions are generated, and then passed Wirelessly or wiredly sent to other electronic devices for execution and so on.

[0055] It can be seen that there are various ways for an electronic device to detect voice information, and are not limited to the ways listed above.

[0056] Step S12, when multiple electronic devices detect the voice information, it is determined that the electronic device that meets the preset requirements is the target electronic device;

[0057] In this embodiment, as analyzed above, multiple electronic devices with voice collection functions can detect the voice information output by the sound source. At this time, if multiple electronic devices detect the voice information, in order to save energy, you can choose A target electronic device that has an instruction to execute the voice message responds to the voice information, and the present application does not limit the specific manner of selecting the target electronic device.

[0058] Optionally, the present application may analyze the detected voice information, so as to obtain a response mode for the language information based on the analysis result of the voice information, and then determine at least one electronic device with configuration information matching the response mode. The device is the target electronic device.

[0059] For example, if the user says "start counting the number of steps", if the user carries multiple electronic devices such as mobile phone, smart watch, and smart bracelet, and there are multiple electronic devices with voice collection functions, the voice will be collected by multiple electronic devices. This sentence, by analyzing it, it is known that it needs to count steps, which can trigger the electronic device with step counting function to start counting steps. Among them, in order to save energy consumption, one of the electronic devices with step counting function can be selected to start, but it is not limited thereto.

[0060] Step S13, controlling the target electronic device to respond to the voice information;

[0061] After the target electronic device is determined, in this embodiment, the target electronic device can respond to the voice information. At this time, other electronic devices that obtain the voice information do not need to respond to the voice information, thereby avoiding multiple electronic devices responding to the same voice information, resulting in Waste of resources.

[0062] As another embodiment of the present application, in the case that multiple electronic devices detect voice information, the present application can also obtain the states of the multiple electronic devices, so as to determine that the current state can respond to the voice based on the states of the multiple electronic devices The electronic device corresponding to the instruction of the information is the target electronic device.

[0063] For example, in practical applications, after a certain electronic device detects the voice information of the sound source, it can send the voice information to other devices. Further obtain the state of the electronic device, such as standby state, sleep state, working state, etc. At this time, in order to quickly respond to the voice information, an electronic device that can quickly respond to the command of the voice information can be selected as the target electronic device.

[0064] Among them, the state analysis of multiple electronic devices can be realized through the selected main electronic device or preset central control device, that is, by establishing a communication connection between the main electronic device or preset central control device and multiple electronic devices, thereby The status information of multiple electronic devices is obtained, and the current status of the corresponding electronic devices is determined by analyzing the status information, but not limited thereto.

[0065] Optionally, in the case that voice information is detected by multiple electronic devices, the present application may also determine the target electronic device that meets the preset requirements by obtaining the location information of the multiple electronic devices. For example, the location of each electronic device can be determined according to the location information of multiple electronic devices, so that the electronic device at the preset position where the user needs to respond to the voice information is selected as the target electronic device.

[0066] Of course, the present application can also determine the distance between multiple electronic devices and the sound source of the voice information according to the obtained position information of multiple electronic devices, so as to select the electronic device corresponding to the distance that meets the requirements as the target electronic device, such as Selecting the electronic device corresponding to the distance smaller than the first threshold as the target electronic device can be said to select the electronic device closer to the sound source as the target electronic device.

[0067] Usually, in the same external environment, the closer the distance to the sound source is, the clearer the voice information is. Therefore, the present application may select the electronic device closest to the sound source as the target electronic device. Certainly, for electronic devices with different precisions, the target electronic device can be selected from multiple electronic devices in combination with the precision of the electronic device and its distance from the sound source, so as to ensure that the target electronic device can accurately analyze the instructions of the voice information.

[0068] Based on the above analysis, the process of determining the target electronic device will be described below in conjunction with specific application scenarios, but is not limited to the several application scenarios listed below.

[0069] refer to figure 2 , is a flow chart of another control method provided by the embodiment of the present application. This embodiment is mainly combined with electronic devices such as smart bracelets and smart watches worn by users, or other devices that can monitor the user's location to realize this method. Embodiment control method, then method may comprise the following steps:

[0070] Step S21, detecting voice information;

[0071] Today, voice assistants have become a very potential way of interaction and search. Major manufacturers and platforms usually set up voice assistants in electronic devices so that users can wake up electronic devices in real time through voice.

[0072] Step S22, when multiple electronic devices detect the voice information, establish a communication connection with the terminal device at the sound source of the voice information;

[0073] In practical applications, the electronic device and the terminal device may be connected through wireless means such as the Internet or Bluetooth, but it is not limited thereto.

[0074] Step S23, obtaining the signal strength of the communication connection between the plurality of electronic devices and the terminal device;

[0075] Step S24, using the signal strength of the communication connection to determine the distance ranking between the multiple electronic devices and the terminal device;

[0076] For electronic devices with voice recognition function, especially electronic devices produced by the same developer, the voice commands to realize a specific function are usually the same, which leads to multiple electronic devices wanting to respond to the same voice information after obtaining the same voice information. Voice information triggers each electronic device to realize the same function. However, in practical applications, users usually only need one electronic device to implement this function, and not all electronic devices that obtain voice information need to perform this function, resulting in a waste of resources.

[0077] In view of this situation, in combination with the analysis of the above embodiments, the present application provides that at least one electronic device selected from multiple electronic devices that have received voice information is used as a target electronic device to respond to the voice information.

[0078] In this embodiment, when the target electronic device is selected, this embodiment can use the terminal device carried by the user to indicate the user's location, so that after multiple electronic devices that have obtained voice information establish a communication connection with the terminal device, and , usually, for devices in the same environment, the signal strength of the communication connection is related to the distance between the two devices. Therefore, in this embodiment, the signal strength of the communication connection between the two devices can be used to represent the distance between the two devices.

[0079] Optionally, the present application can also use the terminal device to locate the user's current location, and send the location information to multiple electronic devices that obtain voice information, so as to determine the distance between the electronic device and the terminal device, that is, the distance between the electronic device and the terminal device. distance between users.

[0080] In addition, it should be noted that the manner of obtaining the position of the sound source of the voice information and the manner of obtaining the distance between multiple electronic devices and the sound source are not limited to the implementation methods listed in this embodiment, and may also be obtained by obtaining the voice information multiple electronic devices to locate the terminal equipment carried by the user to determine the distance to the sound source, or other central control devices to locate the position information of the sound source and multiple electronic devices to determine the distance between multiple electronic devices and the sound source The distance sorting, etc., will not be described in detail in this application.

[0081] Step S25, using the determined distance sorting result to select the electronic device that meets the required distance as the target electronic device;

[0082] In this embodiment, the electronic device corresponding to the distance within the preset range can be selected as the target electronic device. Specifically, in practical applications, the trigger distance of each electronic device for voice triggering can be preset according to actual needs (can be is a range value), in this way, after obtaining the distance between multiple electronic devices and the sound source, the target electronic device can be determined according to the verification result by verifying whether the distance satisfies the trigger distance of the corresponding electronic device.

[0083] Of course, in practical applications, when a user needs to trigger a certain electronic device, he usually walks to the vicinity of the electronic device, so that the electronic device corresponding to the minimum distance can be selected as the target electronic device. It should be noted that, the present application does not limit the requirement that the above-mentioned distance needs to meet, and it can be determined according to actual application requirements, and this embodiment will not describe them in detail here.

[0084] Step S26, based on the analysis result of the voice information detected by the target electronic device, determine the response mode for the voice information;

[0085] In practical applications, the types of applications used by electronic devices may be different when responding to voice information with different contents, and the configuration functions of multiple electronic devices are usually different. Therefore, in order to ensure that the target electronic device can successfully respond to voice information, It can be further verified whether the target electronic device can respond to the voice information.

[0086] For example, for the voice information of "play a certain video", to respond to the voice information, the electronic device needs to have the video playback function, that is, the response mode of the voice information is the video playback mode; when the voice information to be responded is "measure the current Heart rate", then the electronic device is usually required to have a heart rate measurement function. At this time, the response method of the voice information can be a heart rate measurement method, etc., which will not be described in detail in this application.

[0087] It should be noted that the selected target electronic device is an electronic device with configuration information capable of responding to voice information, that is, the determined target electronic device can

[0088] Step S27, verifying whether the target electronic device has configuration information matching the response method, if yes, proceed to step S28, if not, return to step S25;

[0089] In this embodiment, if the target electronic device selected this time cannot respond to the voice information, an electronic device that meets the distance requirement can be reselected as the target electronic device according to the above method, and then verified to ensure reliable response of the voice information .

[0090] Optionally, in this application, the state of the electronic device may also be obtained, and the electronic device whose current state can quickly respond to the voice information is selected as the target electronic device, so as to improve the response efficiency of the voice information.

[0091] In step S28, a control instruction of the voice information is obtained, and the target electronic device is controlled to execute the control instruction.

[0092] After the target electronic device is determined, the target electronic device can analyze the obtained voice information to determine the corresponding control instruction, such as the voice information of "play music", through the analysis, the control instruction of music playing instruction can be determined, so that Make the target electronic device recognize and execute the music playing instruction, that is, start the music player to play the music.

[0093] refer to image 3 , is a flowchart of another control method provided by the embodiment of the present application. This embodiment mainly determines the target electronic device among multiple electronic devices by combining the relative posture between the electronic device and the user. The specific implementation method may include The following steps:

[0094] Step S31, detecting voice information;

[0095] Step S32, when multiple electronic devices detect the voice information, obtain the image information of the sound source of the voice information;

[0096] In this embodiment, multiple electronic devices may have an image acquisition function. After receiving the voice information output by the sound source, the image information of the sound source can be collected, that is, the location of the sound source is determined as the shooting range, and image acquisition is performed. Make the obtained image information contain the sound source.

[0097] Optionally, the application may also obtain the image information of the sound source and multiple electronic devices through the central control device, so as to determine the relationship between the multiple electronic devices and the sound direction of the sound source based on the image information

[0098] Step S33, analyzing the image information to determine the positional relationship between the sounding direction of the sounding source and the plurality of electronic devices;

[0099] If the sound source is the user, then the sound direction of the sound source is the same as the face orientation. At this time, the positional relationship between the sound source direction and the plurality of electronic devices can represent the positional relationship between the user's face direction and the plurality of electronic devices.

[0100] Moreover, in practical applications, when a user needs to start a certain electronic device by voice, he usually faces the electronic device. Therefore, this application can know which direction the user is facing by detecting the positional relationship between the user's face orientation and multiple electronic devices. The electronic device outputs voice information.

[0101] In addition, since the electronic device needs to face the sound source when acquiring the image information of the sound source, the present application can determine the sound of the sound source by analyzing the posture presented by the sound source in the image information, such as front, side, or back. The orientation is related to the position of the electronic device.

[0102]Of course, if the above-mentioned image information is obtained by the central control device, then the central control device can make the image information include the sound source and at least one electronic device when acquiring the image information, so that according to the sound source presented in the image information and the The position and attitude relationship of the electronic equipment determines the positional relationship between the sound emission direction of the sound source and the plurality of electronic equipment.

[0103] It should be noted that the process of determining the relationship between the sound emitting manner of the sound emitting source and the positions of the plurality of electronic devices is not limited to the several manners listed above.

[0104] Step S34, selecting the electronic device pointed to by the sounding direction of the sounding source as the target electronic device;

[0105] In this embodiment, the central control device may determine the target electronic device, and inform the target electronic device of the selection result, and the target electronic device analyzes the voice information to determine its corresponding control instruction. Among them, the central control device can be an electronic device with powerful data processing capabilities that is different from multiple electronic devices, or it can be an electronic device selected from multiple electronic devices. At this time, other electronic devices can be used as slave electronic devices. equipment, but is not limited to this.

[0106] Step S35, controlling the target electronic device to respond to the voice information, and controlling other electronic devices except the target electronic device to sleep.

[0107] After the target electronic device is determined, the target electronic device can analyze the obtained voice information, obtain the corresponding control command and execute it, and realize the response to the voice information; of course, other electronic devices or central control devices can also obtain the control command The target electronic device is sent, and then the target electronic device executes the control instruction, etc. This application does not limit the implementation process of the target electronic device responding to the voice information.

[0108] Optionally, in addition to performing step S35, the present application can also verify whether the current state of the target electronic device is the expected state, that is, the state that can respond to the voice information in time, if yes, then perform step S35, if not, can follow the above-mentioned The method reselects a target electronic device to respond to the voice message.

[0109] To sum up, when the user outputs voice information and the voice information is obtained by multiple electronic devices, this embodiment can select the electronic device facing the user as the target electronic device to respond to the voice information sent by the user, and Control other electronic devices to go into sleep, thereby avoiding the waste of resources caused by multiple electronic devices responding to a voice message at the same time.

[0110] As another embodiment of the present application, since the sound signal emitted by the sound source is a spherical wave or a longitudinal wave, usually, the sound intensity is proportional to the sound pressure and amplitude, and the sound intensity is inversely proportional to the propagation distance, so the present application It is also possible to directly use the signal strength of the obtained voice information, that is, the sound intensity, to determine the target electronic device from multiple electronic devices that have detected the voice information, such as selecting an electronic device that is closer to the sound source as the target electronic device.

[0111] Specifically, in this embodiment, the terminal device carried by the user can be used to sort the signal strengths of voice information detected by multiple electronic devices, and after selecting a target electronic device accordingly, notify the target device to respond to the voice information. Or, it is also possible to determine the signal strength of the voice information detected by multiple electronic devices, and then send it to a certain electronic device or the above-mentioned terminal device or central control device, etc., to realize the sorting of signal strength, and determine the target electronic device. Equipment, etc., are not described in detail in this application.

[0112] Optionally, in addition to using sound intensity to determine the target electronic device according to the above embodiments, the present application may also use time differences between multiple electronic devices detecting voice information to determine the target electronic device. Specifically, multiple electronic devices in the same environment can establish a connection network with each other in order to realize information interaction. Since the current time of the electronic devices is the network time, which is basically the same, the multiple electronic devices in this embodiment detect When the voice information is received, the detection time of the voice information will be recorded at the same time, and then the target electronic device is selected by comparing the detection time of the voice information detected by multiple electronic devices.

[0113] In this embodiment, since the time for the user to send out the voice information is the same, the greater the detection time for the electronic device to detect the voice information, the more time it takes for the electronic device to detect the voice information, that is, the voice information The greater the time difference between the generation time and the detection time, it means that the electronic device has better performance such as detection accuracy and signal transmission speed. Usually, this type of electronic device can be selected as the target electronic device. For example, the minimum time difference corresponding to the calculation can be selected. Electronic devices are used as target electronic devices, but are not limited thereto.

[0114] Optionally, after the target electronic device is preliminarily determined through the above method, the state of the target electronic device can be further detected to determine whether its current state can respond to the instruction corresponding to the voice information, and if it can respond, the target device will directly respond Detected voice information; otherwise, the target electronic device can be reselected according to the above method, and the specific implementation process will not be described in detail in this embodiment, and the description of the corresponding part of the above embodiment can be referred to.

[0115] To sum up, for the situation where voice information is detected by multiple electronic devices, this application can use various methods such as the status of the electronic devices, the above-mentioned attribute information of the detected voice information, and the location information of multiple electronic devices. Select at least one electronic device that meets the corresponding requirements as the target electronic device from the plurality of electronic devices, thereby controlling the target electronic device to respond to the voice information, avoiding the confusion caused by all electronic devices that have detected the voice information responding to the voice information, and Waste of resources.

[0116] refer to Figure 4 , which is a structural block diagram of a control device provided in an embodiment of the present application, the device may include:

[0117] Detection module 41, for detecting voice information;

[0118] In this embodiment, after the sound source such as the user outputs the voice information, the voice information can be collected by an electronic device with a voice collection function, and sent to other electronic devices with a voice assistant; An electronic device collects the voice information, and this application does not limit the implementation method of the electronic device detecting the voice information.

[0119] A selection module 42, configured to determine that the electronic device that meets the preset requirements is the target electronic device when multiple electronic devices detect the voice information;

[0120] optional, see Figure 5 , the selection module 42 may include:

[0121] The first obtaining unit 4211 is configured to obtain a response method for the voice information based on the detected analysis result of the voice information;

[0122] The first determining unit 4212 determines at least one electronic device having configuration information matching the response mode as the target electronic device.

[0123] For the specific implementation process of determining the target electronic device using the response mode of the voice information, reference may be made to the description of the corresponding part of the above method embodiment, and this implementation will not be described in detail here.

[0124] As another embodiment of this application, such as Image 6 As shown, the selection module 42 may include:

[0125] The second obtaining unit 4221 is configured to obtain the location information of the plurality of electronic devices;

[0126] In combination with the descriptions of the corresponding parts of the above method embodiments, the location information can be obtained by the positioning device in the electronic device, so that each electronic device can obtain the location information of multiple electronic devices by using the established contact network; The positioning device of the control device obtains the location information of multiple electronic devices, and the present application does not limit the manner of obtaining the location information of multiple electronic devices.

[0127] The second determining unit 4222 is configured to determine a target electronic device that meets preset requirements according to the obtained pieces of location information.

[0128] In this embodiment, the obtained electronic device position information can be used to determine the positional relationship between multiple electronic devices, as well as the positional relationship between multiple electronic devices and the sound source of the voice information, so as to determine that the preset requirements are met The target electronic device, for example, the electronic device closest to the sound source is the target electronic device, etc., which is not limited in this application.

[0129] Relatedly, the selection module 42 of this application may also obtain the distances between multiple electronic devices and the sound source, so as to select the electronic device corresponding to the required distance as the target electronic device and so on.

[0130] As another embodiment of the present application, the target electronic device can also be determined in combination with the state of the electronic device, and the above selection module 42 can also be used to determine that the current state can respond to the voice information based on the states of the multiple electronic devices The electronic device corresponding to the instruction is the target electronic device. For a specific implementation process, reference may be made to the description of the corresponding part of the above method embodiment, and details will not be repeated in this embodiment.

[0131] In addition, the selection module 42 can also determine the target electronic device by obtaining the signal strength of the voice information detected by multiple electronic devices, the detection time difference, or the positional relationship with the sound direction of the sound source, etc. The process of each implementation can refer to The description of the corresponding part of the above method embodiment will not be described in detail in this embodiment.

[0132] A control module 43, configured to control the target electronic device to respond to the voice information.

[0133] Combined with the above analysis, the finally determined target electronic device has configuration information to respond to voice information, and its current state can quickly execute the response process, which greatly improves the efficiency and reliability of voice control.

[0134] In practical applications, after the target electronic device is determined, the target electronic device can analyze the voice information, determine the corresponding control command, and then execute the control command to realize the content of the voice information; of course, the control command can also be controlled by other electronic devices equipment or central control equipment, which is not limited in this application.

[0135] To sum up, in the case that multiple electronic devices detect voice information, this embodiment will determine the electronic device that meets the preset requirements as the target electronic device according to the above method, so as to control the target electronic device to respond to the voice information, The inconvenience caused by multiple electronic devices obtaining the voice information responding to the voice information at the same time is avoided, the voice control accuracy of the target electronic device desired by the user is improved, and resource waste is avoided.

[0136] refer to Figure 7 , which is a structural block diagram of an electronic device provided in an embodiment of the present application, the electronic device may include:

[0137] Sound collector 71, for detecting voice information;

[0138] The controller 72 is configured to, when multiple electronic devices detect the voice information, determine that the electronic device meeting the preset requirements is the target electronic device, and control the target electronic device to respond to the voice information.

[0139] optional, combined with Figure 8 As shown in the hardware structure diagram of the electronic device, the electronic device may also include a memory 73 for storing the detected voice information; a communication module 74 and a communication bus 75 and so on.

[0140] Wherein, the above-mentioned sound collector 71 , controller 72 , memory 73 and communication module 74 can all communicate with each other through the communication bus 75 .

[0141] Optionally, the communication module 74 can be a GSM module, a WIFI module or the like;

[0142] The controller 72 may be a single-chip microcomputer, a central processing unit CPU, or a specific integrated circuit ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement the embodiments of the present invention.

[0143] The memory 73 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one magnetic disk memory.

[0144] In this application, the above-mentioned communication module 74 can obtain the location information of other electronic devices, or the signal strength of the voice information, the detection time difference, and the positional relationship with the sounding direction of the sounding source, etc., then the controller 72 can specifically use the obtained Multiple pieces of location information or other information determine a target electronic device that meets corresponding preset requirements. For a specific implementation process, reference may be made to the description of the corresponding part of the above method embodiment.

[0145] As another embodiment of the present application, in order to determine the target electronic device, the above-mentioned controller 72 may also specifically obtain the response mode for the voice information based on the analysis result of the detected voice information, and determine that the response mode matches the response mode. At least one electronic device of the configuration information is the target electronic device.

[0146] It should be noted that, regarding the process of the controller realizing the selection of the target electronic device, reference may be made to the descriptions of the foregoing method embodiments, and this embodiment will not be described in detail here.

[0147] In summary, combined with Figure 9 As shown in the schematic diagram of the application scenario, for the voice information output by the user, when multiple electronic devices detect the voice information, the target electronic device that meets the preset requirements can be selected according to the above method, so as to control the target electronic device to respond to the voice information, it is not necessary to control all electronic devices that detect voice information to respond to voice information, which improves the accuracy of voice control of electronic devices and avoids waste of resources.

[0148] Finally, it should be noted that, with respect to the above-mentioned embodiments, relative terms such as first, second, etc. are only used to distinguish one operation, unit or module from another operation, unit or module, and not Any such actual relationship or order between these units, operations or modules is necessarily required or implied. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method or system comprising a set of elements includes not only those elements but also other elements not expressly listed elements, or elements inherent in such a process, method, or system. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method or system comprising said element.

[0149] Each embodiment in this specification is described in a progressive manner, each embodiment focuses on the difference from other embodiments, and the same and similar parts of each embodiment can be referred to each other. As for the devices and electronic devices disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple, and for related details, please refer to the description of the method part.

[0150] The above description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the present invention will not be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.