Remote control interaction method, electronic device and storage medium based on voice recognition
By analyzing voiceprints and language habits, and determining control priorities based on age and time, the method enhances the accuracy and personalization of remote control interactions in multi-user environments, addressing the challenge of command confusion.
Patent Information
- Application Number
- CN202410907437.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-08
- Publication Date
- 2024-12-13
- Estimated Expiration
- 2044-07-08
AI Technical Summary
Existing remote control technologies struggle to accurately distinguish voice commands from multiple users, leading to misoperations and conflicts in multi-user environments.
A method that analyzes voiceprints and language habits to identify users, determines control priorities based on age and time, and executes remote control operations accordingly, ensuring fair and efficient processing of multiple user commands.
Improves the accuracy, efficiency, and personalization of remote control interactions by considering user characteristics and time factors, reducing conflicts and enhancing user experience.
Smart Images

Figure CN118447849B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of electrical communication technology, and in particular to a remote control interaction method, electronic device and storage medium based on voice recognition. Background Art
[0002] With the rapid development of telecommunication technology, remote control technology has become increasingly important. In modern society, remote control technology has become an indispensable part of people's lives and is widely used in smart homes, industrial automation and other fields. Through remote control technology, people can achieve precise control of remote devices and improve the convenience of life and work.
[0003] In related technologies, the system usually receives surrounding voice signals. When receiving a voice command from the user, the voice recognition program is started to pre-process the received voice signal (for example, noise reduction, filtering, etc.) to improve the accuracy of voice recognition. The pre-processed voice signal is then analyzed and converted into a text command through a voice recognition algorithm, and the remote control operation and device corresponding to the text command are identified. Finally, the system will execute the remote control operation on the device according to the identified text command.
[0004] However, using the above method, when multiple users issue voice commands at the same time, the system may not be able to effectively distinguish the commands of different users, resulting in misoperation or command conflicts, which in turn leads to poor accuracy of remote control interaction in a multi-user environment in related technologies. Summary of the invention
[0005] The present application provides a remote control interaction method, electronic device and storage medium based on voice recognition, which are used to improve the accuracy of remote control interaction in a multi-user environment.
[0006] In a first aspect, the present application provides a remote control interaction method based on voice recognition, which is applied to the above-mentioned electronic device, the method comprising: when a first voice is received from a first object within a preset range, performing a first analysis on the first voice to obtain a first analysis result, wherein the first voice is an instruction issued by the first object to perform a remote control interaction operation on a target audio-visual device, and the first analysis is to analyze the voiceprint of the first voice; when it is determined according to the first analysis result that there are at least two first objects within the preset range, and at least two first objects are natural persons, performing a second analysis on the first voice to obtain a second analysis result, wherein the second analysis is to analyze the language habits of the first voice; when at least two ages of at least two first objects are determined according to the second analysis result, determining a target preset time range corresponding to a first time, wherein the first time is the moment when the first voice is received; determining the target control priority of at least two first objects according to the target preset time range and the at least two ages; and performing a remote control interaction operation on the target audio-visual device according to the target control priority.
[0007] In the above embodiment, when a first voice emitted by a first object is received within a preset range, the voiceprint of the first voice is analyzed (i.e., the first analysis) to obtain a first analysis result. By analyzing the voiceprint, the object (i.e., the first object) that emits the voice (i.e., the first voice) can be preliminarily identified. In addition, the voiceprint analysis (i.e., the first analysis) can also enhance the security and accuracy of remote control interaction and prevent unauthorized users from operating. When it is determined according to the first analysis result that there are at least two first objects within the preset range, and at least two first objects are natural persons, the language habits of the first voice will be further analyzed (i.e., the second analysis). The analysis of language habits helps to more accurately identify the identity, age, etc. of different objects, and provides a richer basis for subsequent control priority judgment. When at least two ages of at least two first objects are determined according to the second analysis result, the target preset time range corresponding to the moment (i.e., the first time) of receiving the first voice is determined. Objects of different age groups may have different needs and operating habits. The determination of age helps the system to understand the object more comprehensively. The target control priority of at least two first objects is determined according to a preset time range and at least two ages. By comprehensively considering the time and age factors, the control priority of different objects can be determined more reasonably, so as to ensure that when multiple objects issue instructions at the same time, these instructions can be responded to in an appropriate order and manner, thereby improving the user experience and the efficiency of operation. According to the target control priority, the target audio-visual device is subjected to remote control interaction operations. Through the control priority, it can be ensured that when multiple users (i.e., multiple first objects, it should also be noted that the subsequent users all refer to the first objects) operate at the same time, these operations are responded to and processed in a reasonable and fair manner to avoid conflicts and misunderstandings, thereby improving the stability of the system and user satisfaction. The method of the present application is adopted, through the analysis of voiceprints and language habits, the consideration of age and time, and the determination of control priority, to achieve accurate, efficient and fair processing of multiple user instructions. The technical problem of poor accuracy of remote control interaction in a multi-user environment in the related technology is solved, and the technical effect of improving the accuracy of remote control interaction in a multi-user environment is achieved.
[0008] In combination with some embodiments of the first aspect, in some embodiments, determining the target control priority of at least two first objects based on the target preset time range and at least two ages specifically includes: performing a third analysis on the target preset time range and at least two ages to obtain a third analysis result; when it is determined according to the third analysis result that the target preset time range is the first preset time range and at least two ages meet the first age condition, determining the first control priority of at least two first objects, wherein the target control priority includes the first control priority; or, when it is determined according to the third analysis result that the target preset time range is the second preset time range and at least two ages meet the second age condition, determining the second control priority of at least two first objects, wherein the second preset time range For a time period after a first preset time range, the target control priority includes a second control priority; or, when it is determined according to a third analysis result that the target preset time range is a third preset time range, and at least two ages meet the third age condition, the third control priority of at least two first objects is determined, wherein the third preset time range is a time period after the second preset time range, and the target control priority includes the third control priority; or, when it is determined according to a third analysis result that the target preset time range is a fourth preset time range, and at least two ages meet the fourth age condition, the fourth control priority of at least two first objects is determined, wherein the fourth preset time range is a time period after the third preset time range, and the target control priority includes the fourth control priority.
[0009] In the above embodiment, a third analysis is performed on the target preset time range and at least two ages to obtain a third analysis result, which involves the association or logical judgment between the time range and the age. Through the third analysis, the current time background and the age characteristics of the object (i.e., at least two first objects) can be more deeply understood, providing a more accurate basis for the subsequent determination of the control priority, and helping to improve the accuracy of the remote control interaction in the multi-object environment. When it is determined according to the third analysis result that the target preset time range is the first preset time range, and at least two ages meet the first age condition, the first control priority of at least two first objects is determined. The determination of the first control priority is based on a specific time range and age condition, so that the control strategy can be adjusted according to different scenarios and user characteristics. For example, in a specific time period, a higher priority may be given to users of a specific age group, thereby providing more personalized services. Or when it is determined according to the third analysis result that the target preset time range is the second preset time range (i.e., the time period after the first preset time range), and at least two ages meet the second age condition, the second control priority of at least two first objects is determined. By considering different time ranges and age conditions, the control priority can be flexibly adjusted to adapt to changes in user needs in different time periods, thereby improving user experience. Or, when the target preset time range is determined to be the third preset time range (i.e., the time period after the second preset time range) according to the third analysis result, and at least two ages meet the third age condition, the third control priority of at least two first objects is determined. By further subdividing the time range and age condition, it is possible to more accurately match user needs and provide customized services to enhance the flexibility and adaptability of remote control interaction in a multi-user environment. Or, when the target preset time range is determined to be the fourth preset time range (i.e., the time period after the third preset time range) according to the third analysis result, and at least two ages meet the fourth age condition, the fourth control priority of at least two first objects is determined. By considering multiple preset time ranges and age conditions, a comprehensive control priority system can be constructed to ensure that in various situations, the user's instructions can be responded to and processed in a reasonable and efficient manner, thereby improving the overall performance and user experience of remote control interaction. In summary, the process of determining multi-level control priorities based on time ranges and age conditions can provide personalized services according to different scenarios and user characteristics through refined analysis and judgment, thereby improving user satisfaction and the response efficiency of remote control interaction.
[0010] In combination with some embodiments of the first aspect, in some embodiments, when at least two ages of at least two first objects are determined according to the second analysis result, after determining the preset time range corresponding to the first time, the above method also includes: when it is determined that the first preset time range is morning, and at least two ages are greater than the first age and less than the second age, performing a first detection on the human body state of at least two first objects within the preset range to obtain a first detection result, wherein morning is the time period from getting up in the morning to starting to eat breakfast, and the first age is less than the second age; determining the first living habits, first interests and hobbies, and first learning habits of at least two first objects according to historical interactive operations; determining the first control priority of at least two first objects according to the first detection result, the first living habits, the first interests and hobbies, and the first learning habits; and performing remote control interactive operations on the target audio-visual device according to the first control priority.
[0011] In the above embodiment, when the first preset time is determined to be morning (i.e., the time period from getting up in the morning to starting to eat breakfast), and the age of at least two first subjects is greater than the first age and less than the second age, the first detection of the human state of at least two first subjects obtains the first detection result. Morning is the time period when many people start a new day's activities. By detecting the human state of the subject (e.g., activity, sobriety, etc.) in this specific time period, the current state of the user can be more accurately understood, providing a more accurate basis for subsequent operations. At the same time, combined with the consideration of the age range, the analysis of users of different age groups can be further refined, effectively improving the pertinence and effectiveness of the operation. The first living habits, first interests and hobbies, and first learning habits of at least two first subjects are determined based on the historical interactive operation data. By analyzing the historical interactive operation data, the daily living habits, interests and hobbies, and learning habits of the user can be deeply understood, providing a strong guarantee for the subsequent control priority determination and the execution of remote control interactive operations. By understanding the personalized characteristics of the user, the user can be provided with services that meet his needs and preferences in a more intelligent manner, thereby improving the user experience. By comprehensively considering the first detection result (i.e., the detection result of the human body state in the morning), the first living habit, the first hobby and the first learning habit, the first control priority of at least two first objects can be determined, so that the needs and states of different users can be evaluated more comprehensively, so as to more accurately determine the control priority, effectively improve the pertinence and effectiveness of the remote control interaction operation, and ensure that different instructions can be responded and processed in a reasonable order and manner when multiple users use it at the same time. Performing remote control interaction operations on the target audio-visual device according to the determined first control priority and performing remote control interaction operations based on precise control priorities can ensure that the system can respond to the user's instructions in a reasonable order and priority when multiple users use it at the same time, avoiding confusion and conflict, which can not only improve the response speed and efficiency of remote control interaction in the morning period, but also improve the user experience and satisfaction. In summary, the process of determining the control priority based on the comprehensive analysis of time, age, human body state, living habits, hobbies and learning habits, and performing remote control interaction operations accordingly, helps to improve the user experience and makes the remote control interaction more accurate, efficient and personalized.
[0012] In combination with some embodiments of the first aspect, in some embodiments, when at least two ages of at least two first objects are determined according to the second analysis result, after determining the preset time range corresponding to the first time, the above method also includes: when it is determined that the second preset time range is afternoon, and at least two ages are greater than the third age and less than the second age, performing a second detection on the human body state of at least two first objects within the preset range to obtain a second detection result, wherein the afternoon is the time period from after lunch to before dinner, and the third age is greater than the first age and less than the second age; determining the second living habits, second interests and hobbies, and second learning habits of at least two first objects according to historical interactive operations; determining the second control priority of at least two first objects according to the second detection result, the second living habits, the second interests and hobbies, and the second learning habits; and performing remote control interactive operations on the target audio-visual device according to the second control priority.
[0013] In the above embodiment, when it is determined that the second preset time is afternoon (i.e., the time period from after lunch to before dinner), and the age of at least two first subjects is greater than the third age and less than the second age, the second detection of the human body state of at least two first subjects is performed. Afternoon is an important time period for people to work or study in a day. The change of human body state will directly affect the activity efficiency and experience of individuals. By performing human body state detection on subjects of a specific age range (i.e., at least two first subjects) during this time period, the current state of the user (e.g., fatigue level, concentration, etc.) can be captured more accurately, providing a more accurate basis for subsequent operations, effectively improving the user's experience when using audio-visual equipment, and avoiding operations when tired or distracted. The second living habits, second interests and hobbies, and second learning habits of at least two first subjects are determined based on the historical interactive operation data. By analyzing the historical interactive operation data, the living habits, interests and hobbies, and learning habits of the user in the specific time period of the afternoon can be deeply understood, providing a strong guarantee for the subsequent determination of control priority and execution of remote control interactive operations. By understanding the specific needs and preferences of the user in the afternoon, the user can be provided with audio-visual content and services that are more in line with his needs, thereby improving the user's satisfaction. The second control priority of at least two first objects is determined by comprehensively considering the second detection result (i.e., the detection result of the human body state in the afternoon), the second living habits, the second hobbies and the second learning habits, so as to more comprehensively evaluate the needs and states of the user, thereby more accurately determining the control priority. This personalized control priority setting helps to ensure that the remote control interaction operation can be performed according to the actual needs and preferences of the user, thereby improving the pertinence and effectiveness of the operation. The remote control interaction operation is performed on the target audio-visual device according to the determined second control priority. The remote control interaction operation performed based on the second control priority can ensure that the user's personalized needs and preferences are responded and processed in the specific time period of the afternoon. This can not only improve the response speed and efficiency of the remote control interaction in the afternoon, but also improve the user's experience and satisfaction. At the same time, through the personalized control priority setting, the needs of different users can be better met, and the interactivity and stickiness with the user can be enhanced. In summary, the process of determining the control priority based on the comprehensive analysis of the specific time period, age range, human body state, living habits, hobbies and learning habits, and performing the remote control interaction operation accordingly, helps to improve the user experience and make the remote control interaction more accurate, efficient and personalized.
[0014] In combination with some embodiments of the first aspect, in some embodiments, when at least two ages of at least two first objects are determined according to the second analysis result, after determining the preset time range corresponding to the first time, the above method also includes: when it is determined that the third preset time range is evening, and at least two ages are greater than a fourth age and less than the second age, performing a third detection on the human state of at least two first objects within the preset range to obtain a third detection result, wherein evening is the time period from after dinner to bedtime, and the fourth age is less than the first age; determining the third living habits, third interests and hobbies, and third learning habits of at least two first objects according to historical interactive operations; determining the third control priority of at least two first objects according to the third detection result, the third living habits, the third interests and hobbies, and the third learning habits; and performing remote control interactive operations on the target audio-visual device according to the third control priority.
[0015] In the above embodiment, when it is determined that the third preset time is evening (i.e., the time period from after dinner to bedtime), and the age of at least two first subjects is greater than the fourth age and less than the second age, the third detection of the human body state of at least two subjects is performed. Evening is an important time for people to relax and rest, and the human body state is often different from that during the day (for example, they may be more tired or relaxed). By performing human body state detection on subjects within a specific age range during this time period, the current state of the user (for example, whether they are tired, whether they need to relax, etc.) can be more accurately understood, which provides strong data support for subsequent remote control interactive operations and helps to improve the user's experience at night. The third living habits, third hobbies and third learning habits of at least two first subjects are determined based on historical interactive operation data. Evening is a time period for many family entertainment and leisure activities. Understanding the user's living habits, hobbies and learning habits at night helps to more accurately provide users with content and services that meet their needs, which can not only improve user experience, but also increase stickiness with users. The third control priority of at least two first objects is determined by comprehensively considering the third detection result (i.e., the detection result of the human body state at night), the third living habits, the third hobbies and the third learning habits, so as to more comprehensively evaluate the needs and state of the user, thereby determining a more reasonable control priority. This personalized control priority setting can ensure that the system can perform remote control interaction operations according to the actual needs and preferences of the user at night, avoid unnecessary interference and conflicts, and improve the user's satisfaction. The remote control interaction operation is performed on the target audio-visual device according to the determined third control priority. The remote control interaction operation based on the third control priority can ensure that the user's personalized needs and preferences are responded and processed during the specific time period at night, which can not only improve the response speed and efficiency of the remote control interaction during the evening period, but also ensure that the user has a better user experience. At the same time, through the personalized control priority setting, the diverse needs of users can be met more accurately. In summary, the process of determining the control priority based on the comprehensive analysis of the specific time period at night, age range, human body state, living habits, hobbies and learning habits, and performing the remote control interaction operation accordingly, helps to improve the user experience and make the remote control interaction more accurate, efficient and personalized.
[0016] In combination with some embodiments of the first aspect, in some embodiments, when at least two ages of at least two first objects are determined according to the second analysis result, after determining the preset time range corresponding to the first time, the above method also includes: when it is determined that the fourth preset time range is late at night, and at least two ages are greater than the first age and younger than the third age, performing a fourth detection on the human state of at least two first objects within the preset range to obtain a fourth detection result, wherein late at night is the time period from going to bed at night to early morning; determining the fourth living habits, fourth interests and hobbies, and fourth learning habits of at least two first objects based on historical interactive operations; determining the fourth control priority of at least two first objects based on the fourth detection result, the fourth living habits, the fourth interests and hobbies, and the fourth learning habits; and performing remote control interactive operations on the target audio-visual device according to the fourth control priority.
[0017] In the above embodiment, when it is determined that the fourth preset time is late at night (i.e., the time period from going to bed at night to the early morning), and the age of at least two first subjects is greater than the first age and less than the third age, the human body state of at least two subjects is detected for the fourth time. Late at night is the time when most people rest and sleep, but some people may still be awake and have specific needs. By detecting the human body state during this period, the user's activity and physiological state in the late night can be accurately captured, providing strong data support for subsequent operations. This targeted detection helps to improve the response accuracy and user experience of the system in the late night period. The fourth living habits, fourth interests and hobbies, and fourth learning habits of at least two first subjects are determined based on the historical interactive operation data. In the late night period, the user's activity habits and interests may be different from those during the day. By analyzing the historical interactive operation data, the user's living habits, interests and hobbies and learning needs in the late night can be more deeply understood, thereby providing more personalized services for subsequent remote control interactive operations, so as to better meet the special needs of users in the late night period and improve user satisfaction. The fourth control priority of at least two first objects is determined by comprehensively considering the fourth detection result (i.e., the detection result of the human body state at night), the fourth living habits, the fourth hobbies and the fourth learning habits, so as to more comprehensively evaluate the needs and state of the user, thereby determining a more reasonable control priority. This personalized control priority setting helps to ensure that the system can perform remote control interaction operations according to the actual needs and preferences of the user during the late night period, thereby improving the pertinence and effectiveness of the operation. The remote control interaction operation is performed on the target audio-visual device according to the determined fourth control priority. The remote control interaction operation based on the fourth control priority can ensure that the response and processing are performed according to the personalized needs and preferences of the user during the late night period. This can not only improve the response speed and efficiency of the remote control interaction during the late night period, but also ensure that the user has a better user experience during the late night period. At the same time, through the personalized control priority setting, the diversified needs of the user during the late night period can be more accurately met. In summary, the process of determining the control priority based on the comprehensive analysis of the specific time period of late night, age range, human body state, living habits, hobbies and learning habits, and performing the remote control interaction operation accordingly, helps to improve the user experience and make the remote control interaction more accurate, efficient and personalized.
[0018] In combination with some embodiments of the first aspect, in some embodiments, the above method also includes: when it is determined according to the first analysis result that there are at least two first objects within the preset range, and there is a non-natural person among the at least two first objects, performing feature extraction on the first voice to obtain an extraction result; removing the second voice from the first voice according to the extraction result to obtain a third voice, wherein the second voice is a voice emitted by a non-natural person within the preset range, and the third voice is the first voice without the second voice; performing a fourth analysis on the third voice to obtain a fourth analysis result, wherein the fourth analysis is an analysis of the language habits of the third voice; when it is determined according to the fourth analysis result that at least one age of at least one first object that emits the third voice, determining a fifth preset time range corresponding to the second time, wherein the second time is the moment when the third voice is received; determining a fifth control priority of at least one first object according to the fifth preset time range and at least one age; and performing remote control interaction operations on the target audio-visual device according to the fifth control priority.
[0019] In the above embodiment, when it is determined according to the first analysis result that there are at least two first objects within the preset range, and there is a non-natural person among the at least two first objects, feature extraction is performed on the first voice to obtain an extraction result, and by capturing the key information in the voice, basic data is provided for subsequent voice processing. In particular, when there is a non-natural person, feature extraction helps to distinguish the voice features of natural persons and non-natural persons, and provides a basis for the subsequent removal of non-natural person voices. According to the extraction result, the second voice (i.e., the voice uttered by the non-natural person) is removed from the first voice to obtain a third voice (i.e., the first voice after removing the non-natural person voice). By removing the non-natural person voice, interference can be eliminated, ensuring that the voice information for subsequent processing and analysis is only related to natural persons, thereby avoiding the influence of non-natural person voices on the analysis results. At the same time, the third voice obtained is purer, providing a better data basis for subsequent voice analysis. The fourth analysis result is obtained by performing a fourth analysis on the third voice (i.e., analyzing the language habits of the third voice). By analyzing the language habits of the third voice, the user's language characteristics, expression methods, and communication habits can be deeply understood, which helps to more accurately determine the user's intentions and needs, and provides strong support for the subsequent control priority determination and remote control interaction operations. At the same time, the language habit analysis also helps to improve the intelligence level of remote control interaction, making it closer to the user's actual usage scenario. When at least one age of at least one first object that issued the third voice is determined according to the fourth analysis result, the corresponding fifth preset time range is determined according to the time (second time) when the third voice is received. In combination with the user's age information and the specific time range, the user's possible needs and status at the current time point can be more comprehensively understood, so that the control priority can be determined more accurately, ensuring that the remote control interaction operation meets the user's actual needs and expectations. At the same time, by considering the time factor, it can be more flexibly responded to possible changes of users in different time periods, thereby improving the user experience. According to the fifth preset time range and at least one age, the fifth control priority of at least one first object is determined, and the remote control interaction operation is performed on the target audio-visual device according to the fifth control priority. By comprehensively considering the time range, the user's age and the previous voice analysis results, a more accurate and personalized control priority can be determined to ensure that the remote control interaction operation is more in line with the user's actual needs and habits, thereby improving the pertinence and effectiveness of the operation. In summary, the control priority determination based on voice feature extraction, non-natural human voice removal, language habit analysis, time range and age comprehensive considerations, and the complete process of remote control interaction operation can help improve the user experience and make the remote control interaction more accurate, efficient and personalized.
[0020] In a second aspect, an embodiment of the present application provides an electronic device, comprising: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to perform the method described in the first aspect and any possible implementation method of the first aspect.
[0021] In a third aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on an electronic device, enables the electronic device to execute the method described in the first aspect and any possible implementation of the first aspect.
[0022] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, comprising instructions. When the instructions are executed on an electronic device, the electronic device executes the method described in the first aspect and any possible implementation manner of the first aspect.
[0023] It is understandable that the electronic device provided in the second aspect, the computer program product provided in the third aspect, and the computer storage medium provided in the fourth aspect are all used to execute the method provided in the embodiment of the present application. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method, which will not be repeated here.
[0024] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages:
[0025] 1. Through the analysis of voiceprints and language habits, the consideration of age and time, and the determination of control priority, accurate, efficient and fair processing of multiple user commands is achieved. The technical problem of poor accuracy of remote control interaction in a multi-user environment in related technologies is solved, and the technical effect of improving the accuracy of remote control interaction in a multi-user environment is achieved.
[0026] 2. The process of determining multi-level control priorities based on time range and age conditions can provide personalized services according to different scenarios and user characteristics through refined analysis and judgment, thereby improving user satisfaction and response efficiency of remote control interaction.
[0027] 3. The process of determining control priorities based on a comprehensive analysis of time, age, human condition, living habits, hobbies and learning habits, and executing remote control interaction operations accordingly, will help improve the user experience and make remote control interaction more accurate, efficient and personalized. BRIEF DESCRIPTION OF THE DRAWINGS
[0028] Figure 1It is a flow chart of a remote control interaction method based on voice recognition in an embodiment of the present application;
[0029] Figure 2 It is a schematic diagram of a physical device structure of an electronic device in an embodiment of the present application. DETAILED DESCRIPTION
[0030] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification and appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include plural expressions, unless there is a clear indication to the contrary in the context. It should also be understood that the term "and / or" used in the present application refers to any or all possible combinations comprising one or more listed items.
[0031] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.
[0032] This application provides a remote control interaction method based on voice recognition, referring to Figure 1 , Figure 1 This is a flow chart of a remote control interaction method based on voice recognition in an embodiment of the present application, which includes the following steps:
[0033] Step S101, when a first voice is received from a first object within a preset range, a first analysis is performed on the first voice to obtain a first analysis result, wherein the first voice is an instruction issued by the first object to perform a remote control interactive operation on a target audio-visual device, and the first analysis is an analysis of a voiceprint of the first voice;
[0034] In the above embodiment, the preset range can be pre-set, and can be set to 1 meter, 1.2 meters, 1.5 meters, etc. For example, when the preset range is 1 meter, when the first voice is received from the first object within 1 meter, the first analysis is performed on the first voice to obtain the first analysis result, and so on. The first object can be a person (for example, a child, a teenager, a young person, a middle-aged person, an elderly person, etc.), a device or a robot that can simulate a human voice, etc. It should be noted that the above preset range and the example of the above first object are only an exemplary embodiment, and the above preset range and the above first object are not limited to the above examples.
[0035] In the above embodiment, the first voice is an instruction issued by the first object to perform remote control interactive operations on the target audio-visual device. The first voice can be a sound signal containing specific information and commands, which is used to control or operate the target audio-visual device. The first voice can be any form of voice command, as long as these commands can be recognized and parsed into corresponding operation instructions. For example, the first voice can be a simple word or phrase, such as "turn on", "turn off", "increase volume", etc., or it can be a complex sentence or instruction sequence for performing more complex operations. Therefore, the first voice should be clear, accurate and easy to recognize, so that the system can correctly parse and perform the corresponding operation. It should be noted that the above-mentioned example of the first voice is only an exemplary embodiment, and the above-mentioned first voice is not limited to the above-mentioned example.
[0036] Step S102, when it is determined according to the first analysis result that there are at least two first objects within the preset range, and at least two first objects are natural persons, a second analysis is performed on the first speech to obtain a second analysis result, wherein the second analysis is an analysis of the language habits of the first speech;
[0037] In the above embodiments, language habits include but are not limited to intonation, timbre, speaking speed, accent and dialect, vocabulary selection, grammatical structure, catchphrases and idioms, expression and style, pauses and rhythm, emotional expression, etc. Among them, the high and low pitch and the rise and fall of intonation can convey the emotional state and attitude of the voice sender, which is the key to understanding the meaning and emotion of the speech. The timbre is the quality of the sound, which is related to the physiological structure of the voice sender. Everyone's timbre is unique, which helps to identify different voice senders. The speed of speech can reflect the personality characteristics, emotional state or expression needs of the voice sender, which is an important feature in speech analysis. People in different regions may have specific accents and use different dialects, which is a reflection of regional culture. The voice sender may use specific words or phrases to reflect his educational background, occupation, interests or social circle. The grammatical usage habits of the voice sender, including sentence structure, tense selection, etc., can reveal his language habits and thinking patterns. Some common catchphrases or idioms can reveal the personality and language characteristics of the voice sender, which is an important part of language habit analysis. The voice sender may use different expressions and styles such as direct, euphemistic, and implicit, which are related to their personality, cultural background, and social environment. The pauses and rhythm changes in the voice sender's expression can convey their thinking process, emotional changes, or emphasize key points. The emotional states of joy, anger, sadness, etc. conveyed by voice are the embodiment of the emotional level in language habits. The possibilities of these language habits are not isolated. They are usually intertwined and influence each other, and together constitute the unique language expression of the voice sender. Therefore, by analyzing the language habits of the first voice including all the above possibilities, the intentions, needs, and background of the voice sender can be more comprehensively understood, thereby providing a more personalized and accurate remote control interactive operation service. It should be noted that the above-mentioned example of language habits is only an exemplary embodiment, and the above-mentioned language habits are not limited to the above-mentioned examples.
[0038] Step S103, when at least two ages of at least two first objects are determined according to the second analysis result, determining a target preset time range corresponding to a first time, wherein the first time is a moment when the first voice is received;
[0039] In the above embodiment, at least two ages can be specific ages or age ranges, such as 5 years old, 20 years old, 50 years old, etc., or 5-10 years old, 15-20 years old, 35-60 years old, etc. The target preset time range can be preset, for example, it can be set to 5:00-7:00 in the morning, 15:00-17:00 in the afternoon, 19:00-21:00 in the evening, 23:00-24:00 in the middle of the night, etc. When the first time is 5:35, the target preset time range corresponding to the first time is 5:00-7:00 in the afternoon, when the first time is 16:45, the target preset time range corresponding to the first time is 15:00-17:00 in the afternoon, when the first time is 20:40, the target preset time range corresponding to the first time is 19:00-21:00 in the evening, and so on. It should be noted that the examples of the at least two ages, the target preset time range and the first time are merely exemplary embodiments, and the at least two ages, the target preset time range and the first time are not limited to the above examples.
[0040] Step S104, determining target control priorities of at least two first objects according to the target preset time range and at least two ages;
[0041] In the above embodiments, the target control priority can be determined or adjusted in multiple aspects. That is, users of different age groups may have different operation requirements and interaction habits. For example, children may need stricter monitoring and restrictions, while adults may enjoy higher operation freedom and control. The target preset time range may affect the setting of the control priority. For example, in a specific time period (for example, children's study time or adults' working time), certain users may be given a higher priority to ensure that they do not overuse or interfere with the operations of other users. In addition to age and time factors, the user's historical behavior, usage habits and personal preferences can also be considered to set the priority. For example, users who frequently use certain functions may have a higher control priority on these functions. In some cases, in order to ensure the safety of the user, the control priority may be adjusted according to security. For example, for functions involving sensitive information or high-risk operations, stricter permission management and priority control may be required. Combining the above factors, the target control priority can be determined for at least two first objects to ensure that in a multi-person use scenario, both the needs of the user are met and the security and stability of the remote control interaction are guaranteed, further improving the user experience and reducing potential conflicts and misunderstandings.
[0042] Step S105 , performing remote control interactive operations on the target audio-visual device according to the target control priority.
[0043] In the above embodiments, the target audio-visual device includes but is not limited to a television, audio equipment, a projector, a game console, a media player, and the like.
[0044] Through the above steps, when the first voice emitted by the first object is received within the preset range, the voiceprint of the first voice is analyzed (i.e., the first analysis) to obtain the first analysis result. Through the analysis of the voiceprint, the object (i.e., the first object) that emits the voice (i.e., the first voice) can be preliminarily identified. In addition, the voiceprint analysis (i.e., the first analysis) can also enhance the security and accuracy of remote control interaction and prevent unauthorized users from operating. When it is determined according to the first analysis result that there are at least two first objects within the preset range, and at least two first objects are natural persons, the language habits of the first voice will be further analyzed (i.e., the second analysis). The analysis of language habits helps to more accurately identify the identity, age, etc. of different objects, and provides a richer basis for subsequent control priority judgment. When at least two ages of at least two first objects are determined according to the second analysis result, the target preset time range corresponding to the moment (i.e., the first time) of receiving the first voice is determined. Objects of different age groups may have different needs and operating habits. The determination of age helps the system to understand the object more comprehensively. The target control priority of at least two first objects is determined according to a preset time range and at least two ages. By comprehensively considering the time and age factors, the control priority of different objects can be determined more reasonably, so as to ensure that when multiple objects issue instructions at the same time, these instructions can be responded to in an appropriate order and manner, thereby improving the user experience and the efficiency of operation. According to the target control priority, the target audio-visual device is subjected to remote control interaction operations. Through the control priority, it can be ensured that when multiple users (i.e., multiple first objects, it should also be noted that the subsequent users all refer to the first objects) operate at the same time, these operations are responded to and processed in a reasonable and fair manner to avoid conflicts and misunderstandings, thereby improving the stability of the system and user satisfaction. The method of the present application is adopted, through the analysis of voiceprints and language habits, the consideration of age and time, and the determination of control priority, to achieve accurate, efficient and fair processing of multiple user instructions. The technical problem of poor accuracy of remote control interaction in a multi-user environment in the related technology is solved, and the technical effect of improving the accuracy of remote control interaction in a multi-user environment is achieved.
[0045] Among them, the executor of the above steps can be a system with remote control interaction function, such as a smart home system, an automation control system, a customized remote control interaction system, etc., or a device with remote control interaction function, such as a smart remote control, a smart home device, etc., but not limited to this.
[0046] In an optional embodiment, determining the target control priorities of at least two first objects according to the target preset time range and at least two ages specifically includes: performing a third analysis on the target preset time range and the at least two ages to obtain a third analysis result; when it is determined according to the third analysis result that the target preset time range is the first preset time range and the at least two ages meet the first age condition, determining the first control priorities of the at least two first objects, wherein the target control priorities include the first control priority; or, when it is determined according to the third analysis result that the target preset time range is the second preset time range and the at least two ages meet the second age condition, determining the second control priorities of the at least two first objects, wherein the second preset time range is the time range within the first preset time range. The target control priority includes the second control priority for the time period after the preset time range; or, when it is determined according to the third analysis result that the target preset time range is the third preset time range, and at least two ages meet the third age condition, the third control priority of at least two first objects is determined, wherein the third preset time range is the time period after the second preset time range, and the target control priority includes the third control priority; or, when it is determined according to the third analysis result that the target preset time range is the fourth preset time range, and at least two ages meet the fourth age condition, the fourth control priority of at least two first objects is determined, wherein the fourth preset time range is the time period after the third preset time range, and the target control priority includes the fourth control priority.
[0047] In the above embodiment, in a smart home environment, the customized remote control interaction system receives remote control interaction requests from two users (i.e., Xiao Ming and Xiao Hong), and needs to determine their control priority. The customized remote control interaction system first obtains the current time and determines the target preset time range. At the same time, the customized remote control interaction system also obtains the age information of Xiao Ming and Xiao Hong. The customized remote control interaction system then performs a third analysis, using the target preset time range and at least two ages as analysis parameters. Assume that the current time is 3 pm, which belongs to family entertainment time (i.e., the first preset time range), and Xiao Ming is 10 years old (it can also be 8 years old, 11 years old, 13 years old, etc., not limited here), and Xiao Hong is 15 years old (it can also be 16 years old, 17 years old, 18 years old, etc., not limited here), and both meet the first age condition of "minors". According to the results of the third analysis, the customized remote control interaction system determines that the target preset time range is the first preset time range, and at least two ages meet the first age condition. Therefore, the customized remote control interaction system determines the first control priority of Xiao Ming and Xiao Hong according to the preset rules. Since they are all minors, the customized remote control interaction system may set lower control permissions and limit their access to certain functions (e.g., purchase functions, advanced settings, etc.) to ensure their safety and reasonable use.
[0048] In the above embodiment, if the current time is 7 o'clock in the evening (of course it can also be 6 o'clock, 8 o'clock, 9 o'clock, etc., which are not limited here), it belongs to the family study time (i.e., the second preset time range), and the ages of Xiao Ming and Xiao Hong still meet the second age condition (i.e., minors). Then, their second control priority is determined based on the third analysis result, and the use of certain entertainment functions may be further restricted to encourage them to focus on learning. Similarly, when the current time enters other preset time ranges (for example, the third preset time range, the fourth preset time range), and the ages of Xiao Ming and Xiao Hong meet the corresponding age conditions, their control priority can be dynamically adjusted to meet the family needs in different time periods. The above-mentioned dynamic priority setting can ensure that family members can obtain appropriate device usage rights in different scenarios.
[0049] In an optional embodiment, when at least two ages of at least two first objects are determined according to the second analysis result, after determining the preset time range corresponding to the first time, the above method also includes: when it is determined that the first preset time range is morning, and at least two ages are greater than the first age and less than the second age, performing a first detection on the human state of at least two first objects within the preset range to obtain a first detection result, wherein morning is the time period from getting up in the morning to starting to eat breakfast, and the first age is less than the second age; determining the first living habits, first interests and hobbies, and first learning habits of at least two first objects according to historical interactive operations; determining the first control priority of at least two first objects according to the first detection result, the first living habits, the first interests and hobbies, and the first learning habits; and performing remote control interactive operations on the target audio-visual device according to the first control priority.
[0050] In the above embodiment, at 7 o'clock in the morning (of course, it can also be 5 o'clock, 6 o'clock, 8 o'clock, etc., which is not limited here), after the family members Xiao Ming (assuming 12 years old, which is not limited here) and Xiao Hong (assuming 14 years old, which is not limited here) get up, the customized remote control interaction system detects their activities and determines that the current time is the morning time period. The customized remote control interaction system then performs a first detection on the human state of Xiao Ming and Xiao Hong, including detecting their activity level, whether they are dressed neatly, etc., and obtains a first detection result. Then, the customized remote control interaction system reviews the historical interactive operation data of Xiao Ming and Xiao Hong, and analyzes their living habits, hobbies and learning habits. For example, the customized remote control interaction system finds that Xiao Ming is used to listening to the news in the morning, while Xiao Hong likes to watch cartoons. In addition, the system also learns that Xiao Ming has a strong interest in scientific content, while Xiao Hong prefers artistic activities. According to the first detection result, the customized remote control interaction system finds that Xiao Ming and Xiao Hong are both dressed neatly and show high activity, which is suitable for interactive operation. Combined with their living habits (i.e., the first living habits), hobbies (i.e., the first hobbies) and learning habits (i.e., the first learning habits), the customized remote control interaction system determines their respective first control priorities. In this embodiment, the customized remote control interaction system may give Xiao Ming a higher priority so that he can use the audio-visual device to listen to the news first, while Xiao Hong uses the device to watch her favorite cartoons later. Finally, according to the determined first control priority, the customized remote control interaction system performs remote control interaction operations on the target audio-visual device. Xiao Ming first selects the news channel through voice commands or remote control, and the customized remote control interaction system automatically adjusts the channel and volume of the TV to a state suitable for him to watch. Subsequently, when Xiao Ming finishes watching the news, the customized remote control interaction system transfers control to Xiao Hong according to the preset rules, allowing her to watch her favorite cartoons. The whole process is smooth and meets the personalized needs of family members.
[0051] In an optional embodiment, when at least two ages of at least two first objects are determined according to the second analysis result, after determining the preset time range corresponding to the first time, the above method also includes: when it is determined that the second preset time range is afternoon, and at least two ages are greater than the third age and less than the second age, performing a second detection on the human body state of at least two first objects within the preset range to obtain a second detection result, wherein the afternoon is the time period from after lunch to before dinner, and the third age is greater than the first age and less than the second age; determining the second living habits, second interests and hobbies, and second learning habits of at least two first objects according to historical interactive operations; determining the second control priority of at least two first objects according to the second detection result, the second living habits, the second interests and hobbies, and the second learning habits; and performing remote control interactive operations on the target audio-visual device according to the second control priority.
[0052] In the above embodiment, at 3 pm, the customized remote control interactive system detects that the second preset time range is the afternoon time period. During this time period, family members Xiao Ming (assuming 16 years old, not limited here) and Xiao Hong (assuming 18 years old, not limited here) are both at home, and their ages are both greater than the third age (assuming 15 years old, not limited here) and less than the second age (assuming 20 years old, not limited here). The customized remote control interactive system then performs a second test on Xiao Ming and Xiao Hong, which includes detecting their current activity level, emotional state, and body posture, etc., to obtain the second test result. For example, the customized remote control interactive system may find that Xiao Ming is in a relaxed state, while Xiao Hong appears to be more active. Then, the customized remote control interactive system reviews the historical interactive operation data of Xiao Ming and Xiao Hong to analyze their living habits (i.e., the second living habits), hobbies (i.e., the second hobbies), and learning habits (i.e., the second learning habits). Through data analysis, the customized remote control interactive system learns that Xiao Ming is used to reading books in the afternoon, while Xiao Hong likes to watch movies or TV series. Based on the second detection result and their second living habits, second hobbies and second learning habits, the customized remote control interaction system determines the second control priority of Xiao Ming and Xiao Hong. In this embodiment, since Xiao Hong shows a high level of activity and interest in watching videos, the customized remote control interaction system may give her a higher control priority. Finally, according to the determined second control priority, the customized remote control interaction system performs remote control interaction operations on the smart TV at home. Xiao Hong selects her favorite movie through voice commands, and the customized remote control interaction system automatically adjusts the TV channel, volume and picture quality to meet her viewing needs. At the same time, the customized remote control interaction system also provides Xiao Ming with an environment that is convenient for him to read, such as adjusting the indoor light. Throughout the process, the customized remote control interaction system realizes intelligent and efficient remote control interaction operations according to the personalized needs and behavioral habits of family members.
[0053] In the above embodiment, the customized remote control interactive system provides Xiao Hong with a movie-watching service while providing Xiao Ming with an environment that is convenient for him to read. Among them, the customized remote control interactive system can automatically provide the following services to facilitate Xiao Ming's reading. The customized remote control interactive system can automatically adjust the brightness and color temperature of the lights in the room to meet Xiao Ming's reading needs. For example, when Xiao Ming is ready to start reading, the customized remote control interactive system can automatically adjust the lights to a soft warm tone to reduce eye fatigue. At the same time, the system can also gradually adjust the brightness of the lights according to the length of time Xiao Ming reads to ensure that the eyes will not feel uncomfortable during long-term reading. If Xiao Ming reads by the window, the customized remote control interactive system can automatically adjust the opening and closing of the curtains to control the light intensity in the room, which can avoid glare caused by direct sunlight and ensure that Xiao Ming reads in a comfortable reading environment. The customized remote control interactive system can provide a special reading mode, and Xiao Ming can enter this mode with just one click. In reading mode, the customized remote control interactive system can automatically adjust the brightness, contrast, and color temperature of the display screen of the reading device to simulate the reading effect of paper books and reduce the damage to the eyes caused by long-term use of electronic devices. The customized remote control interactive system can set a reading time limit. When Xiao Ming reads for too long, it will automatically remind him to take a break to avoid eye fatigue caused by long-term reading. If the customized remote control interactive system is connected to the smart bookshelf at home, Xiao Ming can search, select and manage books through voice or remote control. In this way, he can easily get the books he wants to read without getting up and walking around, etc.
[0054] In an optional embodiment, when at least two ages of at least two first objects are determined according to the second analysis result, after determining the preset time range corresponding to the first time, the above method also includes: when it is determined that the third preset time range is evening, and at least two ages are greater than a fourth age and less than the second age, performing a third detection on the human state of at least two first objects within the preset range to obtain a third detection result, wherein evening is the time period from after dinner to bedtime, and the fourth age is less than the first age; determining the third living habits, third interests and hobbies, and third learning habits of at least two first objects according to historical interactive operations; determining the third control priority of at least two first objects according to the third detection result, the third living habits, the third interests and hobbies, and the third learning habits; and performing remote control interactive operations on the target audio-visual device according to the third control priority.
[0055] In the above embodiment, at 8 o'clock in the evening, the customized remote control interactive system detects that the current time belongs to the third preset time range (i.e., the evening period). During this time period, family members Xiaohua (assuming 20 years old, not limited here) and Xiaomei (assuming 22 years old, not limited here) are both at home, and their ages are both greater than the fourth age (assuming 18 years old, not limited here) and less than the second age (assuming 40, not limited here). The customized remote control interactive system then performs a third detection on Xiaohua and Xiaomei, which includes detecting their current activity state, emotions, and body postures, etc., to obtain the third detection result. For example, the customized remote control interactive system may find that Xiaohua is sitting on the sofa, looking more relaxed, while Xiaomei is busy in the room. Next, the system reviews the historical interactive operation data of Xiaohua and Xiaomei to analyze their living habits (i.e., the third living habits), hobbies (i.e., the third hobbies), and learning habits (i.e., the third learning habits). Through data analysis, the customized remote control interactive system understands that Xiaohua is used to watching news or movies at night, while Xiaomei prefers to read books or do other quiet activities at night. Based on the third detection result and their third living habits, third hobbies and third learning habits, the customized remote control interaction system determines the third control priority of Xiaohua and Xiaomei. In this embodiment, since Xiaohua shows a high level of activity and interest in watching videos, the customized remote control interaction system may give him a higher control priority. Finally, according to the determined third control priority, the customized remote control interaction system performs remote control interaction operations on the smart TV (i.e., the target audio-visual device) at home. Xiaohua selects the news program he is interested in through voice commands, and the customized remote control interaction system automatically adjusts the channel and volume of the TV to meet his viewing needs. At the same time, the customized remote control interaction system also provides Xiaomei with an environment that is convenient for her to read, for example, adjusting the indoor light to a soft state. Throughout the process, the customized remote control interaction system realizes intelligent and efficient remote control interaction operations according to the personalized needs and behavioral habits of family members.
[0056] In an optional embodiment, when at least two ages of at least two first objects are determined according to the second analysis result, after determining the preset time range corresponding to the first time, the above method also includes: when it is determined that the fourth preset time range is late at night, and at least two ages are greater than the first age and less than the third age, performing a fourth detection on the human state of at least two first objects within the preset range to obtain a fourth detection result, wherein late at night is the time period from going to bed at night to early morning; determining the fourth living habits, fourth interests and hobbies, and fourth learning habits of at least two first objects according to historical interactive operations; determining the fourth control priority of at least two first objects according to the fourth detection result, the fourth living habits, the fourth interests and hobbies, and the fourth learning habits; and performing remote control interactive operations on the target audio-visual device according to the fourth control priority.
[0057] In the above embodiment, at 11 o'clock in the evening, the customized remote control interactive system detects that the current time belongs to the fourth preset time range (i.e., the late night period). Family members Xiaoli (assuming 28 years old, not limited here) and Xiaoqiang (assuming 30 years old, not limited here) are both at home at this time, and their ages are both greater than the first age (assuming 25 years old, not limited here) and less than the third age (assuming 35 years old, not limited here). The customized remote control interactive system then performs a fourth detection on the two people, focusing on their human body state, such as whether they are in a sleeping state, whether there are signs of activity, etc., to obtain the fourth detection result. Assume that the customized remote control interactive system detects that Xiaoli has gone to bed to rest, but Xiaoqiang is still active in the living room. Next, the system reviews the historical interactive operation data of the two people and analyzes their living habits (fourth living habits), hobbies (fourth hobbies) and learning habits (fourth learning habits). Through data analysis, the customized remote control interactive system finds that Xiaoli usually goes to bed early and gets up early, while Xiaoqiang prefers to watch movies or read late at night. Based on the fourth detection results and their fourth living habits, fourth hobbies and fourth learning habits, the customized remote control interaction system determines the fourth control priority of Xiaoli and Xiaoqiang. Since Xiaoli is ready to rest, the customized remote control interaction system may give her a lower control priority, while Xiaoqiang, as an object that is still active, may obtain a higher control priority. Finally, according to the determined fourth control priority, the customized remote control interaction system performs remote control interaction operations on the smart TV in the living room (i.e., the target audio-visual device). Xiaoqiang selects a movie through the remote control or voice command, and the customized remote control interaction system immediately adjusts the TV's playback content, volume and picture brightness to meet Xiaoqiang's needs for watching movies late at night, while ensuring that Xiaoli, who is already resting, will not be disturbed. Throughout the process, the customized remote control interaction system intelligently realizes remote control interaction operations during the late night period based on the personalized needs and behavioral habits of family members.
[0058] In an optional embodiment, the method further includes: when it is determined according to the first analysis result that there are at least two first objects within the preset range and there is a non-natural person among the at least two first objects, performing feature extraction on the first voice to obtain an extraction result; removing the second voice from the first voice according to the extraction result to obtain a third voice, wherein the second voice is a voice emitted by a non-natural person within the preset range, and the third voice is the first voice without the second voice; performing a fourth analysis on the third voice to obtain a fourth analysis result, wherein the fourth analysis is an analysis of the language habits of the third voice; when it is determined according to the fourth analysis result that at least one age of at least one first object that emits the third voice, determining a fifth preset time range corresponding to the second time, wherein the second time is the moment when the third voice is received; determining a fifth control priority of at least one first object according to the fifth preset time range and at least one age; and performing remote control interaction operations on the target audio-visual device according to the fifth control priority.
[0059] In the above embodiment, in the smart home environment, the customized remote control interaction system determines through the first analysis that there are three objects in the living room, namely Xiao Ming (assuming 10 years old, not limited here), Xiao Hong (assuming 12 years old, not limited here) and the pet dog at home. Since the pet dog is a non-natural person, the customized remote control interaction system then extracts features from the captured first voice. Through feature extraction, the customized remote control interaction system successfully distinguishes between human voice and the barking of the pet dog, i.e., the second voice. Then, the customized remote control interaction system removes the second voice from the first voice to obtain a third voice containing only the voices of Xiao Ming and Xiao Hong. Subsequently, the customized remote control interaction system performs a fourth analysis on the third voice, mainly focusing on language habits. Through analysis, the customized remote control interaction system identifies the language features of Xiao Ming and Xiao Hong, and determines their age range accordingly. At the moment of receiving the third voice, the customized remote control interaction system determines that it is currently 8 o'clock in the evening (i.e., corresponding to the fifth preset time range, which is also the time period from after dinner to before going to bed). Combined with the age information of Xiao Ming and Xiao Hong obtained by the previous analysis, the customized remote control interaction system further determines their fifth control priority in this time period. Considering that Xiao Ming is young, the customized remote control interaction system may give him a higher control priority so that he can use the audio-visual equipment more conveniently. Finally, according to the fifth control priority, the customized remote control interaction system performs the remote control interaction operation. Xiao Ming uses simple voice commands, such as "play cartoons", and the customized remote control interaction system automatically adjusts the smart TV to the channels and content suitable for him to watch. Throughout the process, the system intelligently eliminates interference from non-natural persons and provides a personalized remote control interaction experience based on the age and time characteristics of family members.
[0060] Through the embodiments of the present application, by comprehensively considering time and age factors, the control priority of different objects can be determined more reasonably, thereby ensuring that when multiple objects issue instructions at the same time, these instructions can be responded to in an appropriate order and manner, thereby improving user experience and operation efficiency. According to the target control priority, remote control interactive operations are performed on the target audio-visual equipment. Through the control priority, it can be ensured that when multiple users operate at the same time, these operations are responded to and processed in a reasonable and fair manner to avoid conflicts and misunderstandings, thereby improving system stability and user satisfaction.
[0061] The electronic device in the embodiment of the present invention is described below from the perspective of hardware processing. Figure 2 , Figure 2 It is a schematic diagram of a physical device structure of an electronic device in an embodiment of the present application.
[0062] It should be noted that Figure 2 The structure of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.
[0063] like Figure 2 As shown, the electronic device includes a central processing unit (CPU) 201, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 202 or the program loaded from the storage part 208 to the random access memory (RAM) 203, such as executing the method described in the above embodiment. In the RAM 203, various programs and data required for system operation are also stored. The CPU 201, the ROM 202 and the RAM 203 are connected to each other through the bus 204. The input / output (I / O) interface 205 is also connected to the bus 204.
[0064] The following components are connected to the I / O interface 205: an input section 206 including an audio input device, a button switch, etc.; an output section 207 including a liquid crystal display (LCD) and an audio output device, an indicator light, etc.; a storage section 208 including a hard disk, etc.; and a communication section 209 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 209 performs communication processing via a network such as the Internet. A drive 210 is also connected to the I / O interface 205 as needed. A removable medium 211, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 210 as needed so that a computer program read therefrom is installed into the storage section 208 as needed.
[0065] In particular, according to an embodiment of the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present invention includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication part 209, and / or installed from the removable medium 211. When the computer program is executed by the central processing unit (CPU) 201, various functions defined in the present invention are performed.
[0066] It should be noted that specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, apparatus, or device.
[0067] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present invention. Each box in the flowchart or block diagram may represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions marked in the box may also occur in an order different from that marked in the accompanying drawings.
[0068] Specifically, the electronic device of this embodiment includes a processor and a memory. The memory stores a computer program. When the computer program is executed by the processor, the remote control interaction method based on voice recognition provided by the above embodiment is implemented.
[0069] As another aspect, the present invention further provides a computer-readable storage medium, which may be included in the electronic device described in the above embodiment; or may exist independently without being assembled into the electronic device. The above storage medium carries one or more computer programs, and when the above one or more computer programs are executed by a processor of the electronic device, the electronic device implements the remote control interaction method based on voice recognition provided in the above embodiment.
[0070] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
[0071] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.
Claims
1. A remote control interaction method based on voice recognition, characterized in that: include: When a first voice is received from a first object within a preset range, a first analysis is performed on the first voice to obtain a first analysis result, wherein the first voice is an instruction issued by the first object to perform a remote control interactive operation on a target audio-visual device, and the first analysis is an analysis of a voiceprint of the first voice; When it is determined according to the first analysis result that there are at least two first objects within the preset range, and the at least two first objects are natural persons, performing a second analysis on the first speech to obtain a second analysis result, wherein the second analysis is an analysis of the language habits of the first speech; When at least two ages of the at least two first objects are determined according to the second analysis result, a target preset time range corresponding to a first time is determined, wherein the first time is a moment when the first voice is received; determining the target control priorities of the at least two first objects according to the target preset time range and the at least two ages; performing the remote control interaction operation on the target audio-visual device according to the target control priority; The step of determining the target control priorities of the at least two first objects according to the target preset time range and the at least two ages specifically includes: Performing a third analysis on the target preset time range and the at least two ages to obtain a third analysis result; When it is determined according to the third analysis result that the target preset time range is the first preset time range and the at least two ages meet the first age condition, determining the first control priority of the at least two first objects, wherein the target control priority includes the first control priority; When at least two ages of the at least two first objects are determined according to the second analysis result, after determining a preset time range corresponding to the first time, the method further includes: When it is determined that the first preset time range is morning, and the at least two ages are greater than the first age and less than the second age, a first detection is performed on the human body states of the at least two first subjects within the preset range to obtain a first detection result, wherein the morning is a time period from getting up in the morning to starting to eat breakfast, and the first age is less than the second age; Determine the first living habits, first hobbies and first learning habits of the at least two first objects according to the historical interaction operations; Determine the first control priority of the at least two first objects according to the first detection result, the first living habit, the first hobby, and the first learning habit; performing the remote control interaction operation on the target audio-visual device according to the first control priority; When it is determined according to the first analysis result that there are at least two first objects within the preset range, and a non-natural person is one of the at least two first objects, feature extraction is performed on the first speech to obtain an extraction result; Removing a second voice from the first voice according to the extraction result to obtain a third voice, wherein the second voice is a voice made by the non-natural person within the preset range, and the third voice is the first voice without the second voice; Performing a fourth analysis on the third speech to obtain a fourth analysis result, wherein the fourth analysis is analyzing the language habits of the third speech; When at least one age of at least one first object that emits the third voice is determined according to the fourth analysis result, a fifth preset time range corresponding to a second time is determined, wherein the second time is a moment when the third voice is received; determining a fifth control priority of the at least one first object according to a fifth preset time range and the at least one age; The remote control interactive operation is performed on the target audio-visual device according to the fifth control priority.
2. The method according to claim 1, characterized in that After performing a third analysis on the target preset time range and the at least two ages to obtain a third analysis result, the method further includes: When it is determined according to the third analysis result that the target preset time range is a second preset time range, and the at least two ages meet the second age condition, determining the second control priority of the at least two first objects, wherein the second preset time range is a time period after the first preset time range, and the target control priority includes the second control priority; or, When it is determined according to the third analysis result that the target preset time range is a third preset time range, and the at least two ages meet a third age condition, determining a third control priority of the at least two first objects, wherein the third preset time range is a time period after the second preset time range, and the target control priority includes the third control priority; or, When it is determined that the target preset time range is a fourth preset time range according to the third analysis result, and the at least two ages meet the fourth age condition, the fourth control priority of the at least two first objects is determined, wherein the fourth preset time range is a time period after the third preset time range, and the target control priority includes the fourth control priority.
3. The method according to claim 2, characterized in that After determining the preset time range corresponding to the first time when determining the at least two ages of the at least two first objects according to the second analysis result, the method further includes: When it is determined that the second preset time range is afternoon, and the at least two ages are greater than the third age and less than the second age, a second detection is performed on the human body states of the at least two first subjects within the preset range to obtain a second detection result, wherein the afternoon is a time period from after lunch to before dinner, and the third age is greater than the first age and less than the second age; Determining the second living habits, second interests and second learning habits of the at least two first objects according to the historical interaction operations; Determining the second control priority of the at least two first objects according to the second detection result, the second living habit, the second hobby and the second learning habit; The remote control interactive operation is performed on the target audio-visual device according to the second control priority.
4. The method according to claim 2, characterized in that: After determining the preset time range corresponding to the first time when determining the at least two ages of the at least two first objects according to the second analysis result, the method further includes: When it is determined that the third preset time range is evening, and the at least two ages are greater than a fourth age and less than the second age, a third detection is performed on the human body states of the at least two first subjects within the preset range to obtain a third detection result, wherein the evening is a time period from after dinner to bedtime, and the fourth age is less than the first age; Determine the third living habits, third hobbies and third learning habits of the at least two first objects according to the historical interaction operations; Determining the third control priority of the at least two first objects according to the third detection result, the third living habit, the third hobby and the third learning habit; The remote control interactive operation is performed on the target audio-visual device according to the third control priority.
5. The method according to claim 2, characterized in that: After determining the preset time range corresponding to the first time when determining the at least two ages of the at least two first objects according to the second analysis result, the method further includes: When it is determined that the fourth preset time range is late at night and the at least two ages are greater than the first age and less than the third age, a fourth detection is performed on the human body states of the at least two first subjects within the preset range to obtain a fourth detection result, wherein the late at night is a time period from going to bed at night to early morning; Determining the fourth living habits, fourth hobbies and fourth learning habits of the at least two first objects according to the historical interaction operations; Determining the fourth control priority of the at least two first objects according to the fourth detection result, the fourth living habit, the fourth hobby and the fourth learning habit; The remote control interactive operation is performed on the target audio-visual device according to the fourth control priority.
6. An electronic device, characterized in that: The electronic device comprises: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code comprises computer instructions, and the one or more processors call the computer instructions so that the electronic device executes the method as described in any one of claims 1-5.
7. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on an electronic device, the electronic device is caused to execute the method as claimed in any one of claims 1 to 5.
8. A computer program product, characterized in that When the computer program product is executed on an electronic device, the electronic device is enabled to execute the method according to any one of claims 1 to 5.
