Mode control method and device for remote controller and remote controller

Abstract

The invention relates to the technical field of remote controllers, and discloses a mode control method for a remote controller, the remote controller comprises a first millimeter-wave radar and a second millimeter-wave radar, and the mode control method comprises the following steps: monitoring an environment through the first millimeter-wave radar of the remote controller to obtain a monitoring result; controlling the remote controller to enter a wake-up mode when the monitoring result is that someone exists; when the remote controller enters the wake-up mode, identifying the user behavior through a second millimeter wave radar of the remote controller to obtain an identification result; wherein the frequency of the second millimeter-wave radar is greater than that of the first millimeter-wave radar; and controlling the remote controller to interact with the corresponding television according to the identification result. According to the method, the elderly user can control the television more simply and can control the television without complex operation. The invention further discloses a mode control device for the remote controller and the remote controller.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of remote controllers, for example to a mode control method and device for a remote controller, and a remote controller. BACKGROUND

[0002] At present, a smart television remote controller can greatly facilitate user operation of a television, and has convenience and ease of use for general users, but the use experience is poor for elderly users. Moreover, the operation logic of a smart television is relatively complex, for example, in addition to basic operations such as switching between television channels, adjusting the volume, and searching for programs, complex operations such as connecting to a network, installing applications, and setting up screen projection are also required. Elderly users may need to learn multiple times to master the operation process, and are prone to forgetting.

[0003] In order to facilitate the use of a smart television by elderly users, related technologies disclose a remote controller auxiliary use method, including: through a smart home system, complex settings and operations are completed through a mobile phone APP; when the remote controller is lost, the mobile phone is used to assist in finding the remote controller.

[0004] In the process of implementing the embodiments of the present disclosure, it is found that at least the following problems exist in the related technologies: Although the related technologies can help general users find a remote controller, the APP auxiliary method is complex in operation process, and it is difficult for elderly people who are not familiar with smart phone operations to master the operation process in actual application, and the use requirements of elderly users cannot be effectively met.

[0005] It should be noted that the information disclosed in the above background section is only used to strengthen the understanding of the background of the present application, and therefore can include information that does not constitute prior art known to those of ordinary skill in the art. SUMMARY

[0006] In order to have a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. The summary is not a general review, nor is it intended to determine key / important components or delineate the scope of protection of these embodiments, but is intended as a prelude to the detailed description below.

[0007] The embodiments of the present disclosure provide a mode control method and device for a remote controller, and a remote controller, to simplify the operation process of the remote controller.

[0008] In some embodiments, the mode control method for the remote controller, the remote controller comprising a first millimeter wave radar and a second millimeter wave radar, the mode control method comprising: monitoring an environment by the first millimeter wave radar of the remote controller to obtain a monitoring result; in a case where the monitoring result is that there is a person, controlling the remote controller to enter a wake-up mode; in a case where the remote controller enters the wake-up mode, identifying a user behavior by the second millimeter wave radar of the remote controller to obtain an identification result; wherein the frequency of the second millimeter wave radar is greater than the frequency of the first millimeter wave radar; and controlling the remote controller to interact with a corresponding television according to the identification result.

[0009] Optionally, the remote controller further comprises a communication module, and the controlling the remote controller to interact with the corresponding television according to the identification result comprises: in a case where the identification result is that the user uses the remote controller, starting the communication module of the remote controller to identify a gesture of the user; and controlling the television corresponding to the remote controller according to the gesture of the user.

[0010] Optionally, the second millimeter wave radar identifies the user behavior in the following manner: performing feature extraction and dimension lifting on spatial point cloud information collected by the second millimeter wave radar by an encoding network of an AI algorithm; performing screening and compression on the extracted features by a decoding network of the AI algorithm, and obtaining a decoding result output by the decoding network to represent the user behavior identified by the second millimeter wave radar.

[0011] Optionally, the mode control method for the remote controller further comprises: using a residual mechanism of the AI algorithm to perform residual connection between a serial output of spatial attention, convolution, normalization and activation and an original input, and repeatedly performing attention unit operation.

[0012] Optionally, the remote controller further comprises a voice module, and the mode control method further comprises: in a case where the remote controller enters the wake-up mode, obtaining a voice instruction of the user by the voice module, and controlling the television according to the voice instruction; or, performing voice interaction with the user by the voice module to guide the user to operate the remote controller.

[0013] Optionally, the mode control method for the remote controller further comprises: in a case where the remote controller enters the wake-up mode, the user is not identified to use the remote controller, and the remote controller can obtain the voice instruction of the user, controlling the remote controller to enter a loss alarm mode, and performing sound alarm to inform the user of the position of the remote controller; in a case where the remote controller enters the loss alarm mode and the duration of the sound alarm exceeds a time threshold, stopping the sound alarm.

[0014] Optionally, the mode control method for the remote controller further comprises: in a case where the remote controller enters the wake-up mode and the power is lower than a power threshold, reminding the user to charge by voice broadcast.

[0015] Optionally, the mode control method for the remote controller further comprises: in the case that the monitoring result is that there is no one, controlling the remote controller to enter a power saving mode.

[0016] In some embodiments, the mode control device for the remote controller comprises: a processor and a memory storing program instructions, the processor being configured to execute the mode control method for the remote controller as described above when running the program instructions.

[0017] In some embodiments, the remote controller comprises: a master control chip; a first millimeter wave radar configured to monitor an environment; a second millimeter wave radar configured to identify a user behavior; a communication module configured to identify a user gesture; a voice module configured to obtain a voice instruction of the user or to have a voice interaction with the user; and the mode control device for the remote controller as described above installed in the master control chip.

[0018] The mode control method and device for the remote controller, and the remote controller provided by the embodiments of the present disclosure can achieve the following technical effects: In the embodiments of the present disclosure, the intelligent wake-up and precise interaction are realized by the dual-band millimeter wave radar of the remote controller. First, the first millimeter wave radar obtains a monitoring result, and switches to a wake-up mode once it detects that there is someone. Then, the second millimeter wave radar is enabled to continuously emit, and the behavior of the user in different scenarios is finely identified to generate an identification result, which directly drives the remote controller to transmit a corresponding control instruction to the television to realize a key-free operation. Such an interaction mode replaces irrelevant keys, so that the elderly user can control the television more simply and without complex operations. Meanwhile, the user identification algorithm can accurately identify the user behavior, so as to ensure that different modes can be accurately started, and the use experience of the remote controller of the elderly user is significantly improved.

[0019] The foregoing general description and the following description are only exemplary and explanatory, and are not used to limit the present application. BRIEF DESCRIPTION OF DRAWINGS

[0020] One or more embodiments are exemplarily illustrated by corresponding drawings, which do not constitute a limitation on the embodiments, elements with the same reference numerals in the drawings are shown as similar elements, the drawings do not constitute a proportional limitation, and wherein: Figure 1 is an implementation environment schematic diagram of the mode control method for the remote controller of the embodiments of the present disclosure; Figure 2 is a schematic diagram of the mode control method for the remote controller provided by the embodiments of the present disclosure; Figure 3 is a schematic diagram of another mode control method for the remote controller provided by the embodiments of the present disclosure; Figure 4 FIG. 2 is a schematic diagram of another mode control method for a remote controller according to an embodiment of the present disclosure; Figure 5 FIG. 3 is a schematic diagram of a mode control device for a remote controller according to an embodiment of the present disclosure; Figure 6 FIG. 4 is a schematic diagram of a remote controller according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0021] In order to enable a person skilled in the art to more fully understand the features and technical contents of the embodiments of the present disclosure, the implementation of the embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings, which are used only for reference and are not intended to limit the embodiments of the present disclosure. In the following technical description, in order to facilitate explanation, a plurality of details are provided to provide a full understanding of the disclosed embodiments. However, one or more embodiments can still be implemented without these details. In other cases, well-known structures and devices can be simplified to facilitate the drawings.

[0022] The terms "first", "second", and the like in the specification and claims of the embodiments of the present disclosure and the above-described drawings are used to distinguish similar objects, and do not necessarily have to describe a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present disclosure described herein can be implemented. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion.

[0023] Unless otherwise specified, the term "a plurality of" means two or more.

[0024] In the embodiments of the present disclosure, the character " / " represents an "or" relationship between the objects before and after it. For example, A / B represents: A or B.

[0025] The term "and / or" is a description of the association relationship between objects, which means that there can be three relationships. For example, A and / or B means: A or B, or, A and B, the three relationships.

[0026] The term "corresponding" can refer to an association relationship or a binding relationship, A corresponding to B means that there is an association relationship or a binding relationship between A and B.

[0027] At present, the traditional remote controller has high threshold, is difficult to find after being lost, and the old users may need to learn multiple times to master the operation process when using the television remote controller, and is easy to forget.

[0028] And, with age, the memory of the elderly will gradually decline, often inadvertently placed in the remote control is not often placed in the location, and then forget where it is. Currently on the market home appliances usually only have a simple remote control loss reminder function, such as by pressing a specific key on the home appliance, let the remote control emit a weak beep. However, the amount of beep sound is limited, in a noisy environment, the remote control is placed in a remote location or is blocked by obstacles, the elderly are difficult to hear the sound. Secondly, if the remote control power is insufficient, the buzzer may not work properly, resulting in the failure of the search function.

[0029] In addition, although some smart home systems can help find the remote control, they mostly rely on mobile phone APP operation. The elderly are difficult to make a series of complex settings and operations on the mobile phone, and the help for the elderly in practical application is extremely limited.

[0030] Therefore, the embodiments of the present disclosure solve the problems of remote control not easy to operate faced by the elderly in the process of using the remote control by comprehensively using advanced technologies such as voice module and millimeter wave radar, and significantly improve the use experience and life convenience of the elderly.

[0031] In combination with Figure 1 , Figure 1 is an implementation environment schematic diagram of a mode control method for a remote control according to the embodiments of the present disclosure. As Figure 1 shown, the implementation environment can include a remote control 100, a television 200 and a user 300. Among them, the remote control 100 monitors and behaviorally identifies the user 300, according to the actual behavior of the user 300, can judge the actual demand of the user 300, controls the television 200 to meet the demand of the user 300, significantly improves the use experience of the remote control of the user 300.

[0032] In combination with Figure 2 shown, the embodiments of the present disclosure provide a mode control method for a remote control, comprising: S201, the processor monitors the environment through the first millimeter wave radar of the remote control, and obtains the monitoring result.

[0033] S202, the processor controls the remote control to enter the wake-up mode in the case that the monitoring result is that there is a person.

[0034] S203, the processor identifies the user behavior through the second millimeter wave radar of the remote control in the case that the remote control enters the wake-up mode, and obtains the identification result; wherein the frequency of the second millimeter wave radar is greater than the frequency of the first millimeter wave radar.

[0035] S204, the processor controls the remote control to interact with the corresponding television according to the identification result.

[0036] The mode control method for a remote controller provided by the embodiment of the present disclosure realizes intelligent wake-up and precise interaction through the millimeter wave radar of the remote controller. First, the first millimeter wave radar acquires a monitoring result. Once a person is detected, the remote controller is switched to a wake-up mode. Then, the second millimeter wave radar is enabled to continuously emit, fine identification is performed on the behavior of the user in different scenes, and an identification result is generated. The result directly drives the remote controller to transmit a corresponding control instruction to the television, thereby realizing a key-free operation. Such an interaction mode replaces irrelevant keys, so that the elderly user can control the television more simply and conveniently without complex operations. Meanwhile, the AI algorithm can accurately identify the user behavior, ensure that different modes can be accurately started, and significantly improve the remote controller use experience of the elderly user.

[0037] Specifically, the frequency of the first millimeter wave radar is 24 Hz, and the frequency of the second millimeter wave radar is 60 Hz. The 24 Hz millimeter wave radar is used to monitor the surrounding environment in real time. When no one is detected nearby, the remote controller automatically enters a power-saving mode. In this mode, to reduce energy consumption, the millimeter wave radar is temporarily closed, and only 10 seconds are started every hour to detect whether someone is approaching. Once it is detected that someone is nearby and stays for 3 seconds, the speaker is immediately controlled to issue a reminder, the 24 Hz millimeter wave radar is closed, the 60 Hz millimeter wave radar is started, and the voice module is simultaneously opened, and the remote controller is controlled to enter the wake-up mode.

[0038] Optionally, the remote controller further includes a communication module, and the remote controller is controlled to interact with the corresponding television according to the identification result, including: in the case that the identification result is that the user uses the remote controller, the communication module of the remote controller is opened to identify the posture of the user; and the television corresponding to the remote controller is controlled according to the posture of the user.

[0039] In the embodiment of the present disclosure, in the wake-up mode, the second millimeter wave radar continuously outputs point cloud and Doppler information, and the end-side AI first identifies the micro-motion feature by using a deep learning model. The second millimeter wave radar has high-precision human behavior recognition capability, and can identify the user behavior in real time. When it is identified that the user picks up the remote controller, a series of control operations on the television are completed by precisely identifying the posture of the user, thereby realizing a more natural and convenient interaction mode. When it is identified that the user puts down the remote controller, the power-saving mode is entered. In the whole process, the user only needs to naturally swing or tilt the remote controller, without any key, thereby significantly reducing the learning cost of the elderly.

[0040] Optionally, the second millimeter wave radar identifies the user behavior in the following manner: a coding network of an AI algorithm is used to extract features and improve dimensions of the spatial point cloud information collected by the second millimeter wave radar; a decoding network of the AI algorithm is used to screen and compress the extracted features, and a decoding result output by the decoding network is obtained to represent the user behavior identified by the second millimeter wave radar.

[0041] In the embodiments of the present disclosure, the millimeter wave radar collects point cloud information in the front space sector in real time, and key feature extraction is realized through an encoding-decoding network. The encoding network includes two combined convolution modules and up-sampling with a scale of 2, the decoding network includes two combined convolution modules and convolution and down-sampling with a size of 2x2, and the last 1x1 convolution controls the dimension of the output result. After the model is pre-trained, it is integrated into the processing operation unit. In this way, high-precision human behavior recognition is realized by using an AI algorithm, so that the judgment of user demand is more accurate, and the control of the television is more in line with the user's expectations.

[0042] Optionally, the mode control method for the remote controller further includes: using a residual mechanism of the AI algorithm to perform residual connection between the serial output of spatial attention, convolution, normalization and activation and the original input, and repeatedly performing attention unit operation.

[0043] In the embodiments of the present disclosure, the combined convolution module uses a residual mechanism to perform residual connection between the serial output of spatial attention, convolution, normalization and activation and the original input, and repeatedly performs attention unit operation, realizes combined doubling feature extraction, and ensures the accuracy of recognition. The spatial attention is to perform maximum value pooling and average value pooling on the input features respectively, cascade the results to perform convolution and activation, and perform product operation with the input features, so as to ensure the mining of deep spatial features.

[0044] Optionally, the remote controller further includes a voice module, and the mode control method further includes: in the case that the remote controller enters the wake-up mode, obtaining a voice instruction of a user through the voice module, and controlling the television according to the voice instruction; or, performing voice interaction with the user through the voice module, and guiding the user to operate the remote controller.

[0045] In the embodiments of the present disclosure, after the remote controller enters the wake-up mode, the voice module is started at the moment triggered by the radar, and after local noise reduction and echo cancellation, the microphone array directly sends the voice stream to the recognition engine to complete keyword recognition. For example, if the instruction of “power on” or “channel change” is recognized, the corresponding instruction is immediately sent to the television through the communication module. If a fuzzy request such as “I want to watch opera” is detected, a voice prompt such as “please say the channel number” or “shake the remote controller” is opened, and at the same time, the radar opens the recognition mode, the user only needs to move the remote controller left and right, the radar converts the displacement into channel options in real time, and then says “confirm” to complete the selection. The whole process does not need to press the key, the wake-up word or the mobile phone APP. When there is no valid instruction for 30 seconds and the radar judges that the user has left, the voice module is automatically powered off. In this way, the traditional multi-step key operation is compressed into a natural language or a light swing action, so that the old user can control the television more simply without complex operation.

[0046] Optionally, the mode control method for the remote controller further comprises: in a case where the remote controller enters the wake-up mode, no user using the remote controller is identified, and the remote controller can acquire the voice instruction of the user, the remote controller is controlled to enter a loss alarm mode, and a sound alarm is performed to inform the user of the location of the remote controller; in a case where the remote controller enters the loss alarm mode and the duration of the sound alarm exceeds a time threshold, the sound alarm is stopped.

[0047] In the embodiments of the present disclosure, after the remote controller is woken up by the radar, if no “holding” or “posture change” signal is detected within 20 seconds continuously and the voice module still continuously receives the voice instruction, the end-side AI determines that the user is speaking but cannot find the remote controller, and immediately triggers the loss alarm mode, and the radar is turned off first to save power, and a sound alarm is performed synchronously. When the duration of the sound alarm reaches a preset time threshold, the sound alarm is automatically turned off and the power saving mode is returned to, to prevent disturbing people at night and power depletion, and the entire process does not require a key, so that the remote controller actively makes a sound and is automatically stopped after timeout, thereby enabling the elderly user to control the television more simply and without complex operations.

[0048] Optionally, the mode control method for the remote controller further comprises: in a case where the remote controller enters the wake-up mode and the power is lower than a power threshold, reminding the user to charge through voice broadcast.

[0049] In combination Figure 3 The embodiments of the present disclosure provide another mode control method for a remote controller, which comprises: S301, a processor monitors an environment through a first millimeter wave radar of a remote controller, and obtains a monitoring result.

[0050] S302, the processor controls the remote controller to enter a wake-up mode in a case where the monitoring result is that there is a person.

[0051] S303, the processor identifies a user behavior through a second millimeter wave radar of the remote controller in a case where the remote controller enters the wake-up mode, and obtains an identification result; wherein the frequency of the second millimeter wave radar is greater than the frequency of the first millimeter wave radar.

[0052] S304, the processor controls the remote controller to interact with a corresponding television according to the identification result.

[0053] S305, the processor reminds the user to charge through voice broadcast in a case where the remote controller enters the wake-up mode and the power is lower than a power threshold.

[0054] In the embodiments of the present disclosure, when the power of the remote controller is less than 20% and the remote controller enters the wake-up mode, the user is reminded to charge in time through voice broadcast, so as to avoid affecting the use due to insufficient power.

[0055] Optionally, the mode control method for the remote controller further includes: in the case that the monitoring result is that there is no person, controlling the remote controller to enter a power saving mode.

[0056] In combination Figure 4 As shown in the accompanying drawings, the embodiments of the present disclosure provide another mode control method for a remote controller, which includes: S401, the processor monitors an environment through a first millimeter wave radar of the remote controller to obtain a monitoring result.

[0057] S402, in the case that the monitoring result is that there is no person, the processor controls the remote controller to enter a power saving mode.

[0058] S403, in the case that the monitoring result is that there is a person, the processor controls the remote controller to enter a wake-up mode.

[0059] S404, in the case that the remote controller enters the wake-up mode, the processor identifies a user behavior through a second millimeter wave radar of the remote controller to obtain an identification result; wherein the frequency of the second millimeter wave radar is greater than the frequency of the first millimeter wave radar.

[0060] S405, the processor controls the remote controller to interact with a corresponding television according to the identification result.

[0061] In the embodiments of the present disclosure, a 24Hz millimeter wave radar is used to monitor the surrounding environment in real time, and when it is detected that there is no person nearby, the remote controller automatically enters a power saving mode. In this mode, in order to reduce energy consumption, the millimeter wave radar is temporarily turned off, and only starts for 10 seconds every hour to detect whether a person is close.

[0062] In combination Figure 5 As shown in the accompanying drawings, the embodiments of the present disclosure provide a mode control device 50 for a remote controller, which includes a processor 500 and a memory 501. Optionally, the device 50 can further include a communication interface 502 and a bus 503. Wherein the processor 500, the communication interface 502, and the memory 501 can complete the communication among each other through the bus 503. The communication interface 502 can be used for information transmission. The processor 500 can invoke the logical instructions in the memory 501 to execute the mode control method for the remote controller of the above-mentioned embodiments.

[0063] In addition, the logical instructions in the memory 501 described above can be implemented in the form of a software functional unit and sold or used as an independent product, which can be stored in a computer readable storage medium.

[0064] The memory 501 can be used to store software programs, computer executable programs, such as program instructions / modules corresponding to the method in the embodiments of the present disclosure. The processor 500 executes the function application and data processing by running the program instructions / modules stored in the memory 501, that is, implements the mode control method for the remote controller in the above embodiments.

[0065] The memory 501 can include a program storage area and a data storage area, wherein the program storage area can store an operating system and application programs required by at least one function; the data storage area can store data created according to the use of the terminal device, etc. In addition, the memory 501 can include a high-speed random access memory, and can also include a non-volatile memory.

[0066] In combination with Figure 6 As shown in the above embodiments, the present disclosure provides a remote controller 100, comprising: a master control chip 101; a first millimeter wave radar 102 configured to monitor the environment; a second millimeter wave radar 103 configured to identify user behavior; a communication module 104 configured to identify the user's gesture; a voice module 105 configured to obtain the user's voice instruction, or to interact with the user in voice; and a mode control device 50 for the remote controller as described above, installed in the master control chip 101. The installation relationship described herein is not limited to placing in the internal of the master control chip 101, but also includes installation connection with other components of the master control chip 101, including but not limited to physical connection, electrical connection or signal transmission connection, etc. Those skilled in the art can understand that the mode control device 50 for the remote controller can be adapted to the feasible master control chip 101, and thus realize other feasible embodiments.

[0067] The technical solutions of the embodiments of the present disclosure can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes one or more instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in the embodiments of the present disclosure. The aforementioned storage medium can be a non-transitory storage medium, such as a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc. various media that can store program codes.

[0068] The foregoing description and accompanying drawings fully illustrate embodiments of this disclosure to enable those skilled in the art to practice them. Other embodiments may include structural, logical, electrical, procedural, and other changes. The embodiments represent only possible variations. Individual components and functions are optional unless explicitly required, and the order of operation may vary. Parts and features of some embodiments may be included in or replace parts and features of other embodiments. Moreover, the terminology used in this application is for describing embodiments only and is not intended to limit the claims. As used in the description of embodiments and claims, the singular forms “a,” “an,” and “the” are intended to equally include the plural forms unless the context clearly indicates otherwise. Similarly, the term “and / or” as used in this application means including one or more of the associated listed items and all possible combinations thereof. Additionally, when used in this application, the term "comprise" and its variations "comprises" and / or "comprising" refer to the presence of stated features, integrals, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components, and / or groups thereof. Without further limitations, an element defined by the phrase "comprises a..." does not exclude the presence of other identical elements in the process, method, or apparatus that includes said element. In this document, each embodiment may focus on the differences from other embodiments, and similar or identical parts between embodiments can be referred to mutually. For methods, products, etc., disclosed in the embodiments, if they correspond to the method section disclosed in the embodiments, the relevant parts can be referred to the description of the method section.

[0069] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of this disclosure. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0070] In the embodiments disclosed herein, the disclosed methods, products (including but not limited to apparatuses, devices, etc.), can be implemented in other manners. For example, the apparatus embodiments described above are merely schematic. For example, the division of the units is merely logical function division. There can be other division manners in actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections can be indirect couplings or communication connections through some interfaces, apparatuses, or units, and can be in electrical, mechanical, or other forms. The units described as separated components can or can not be physically separated, and components displayed as units can or can not be physical units. Some or all of the units can be selected according to actual needs to achieve the embodiments.

[0071] The flowcharts and block diagrams in the drawings show the possible implementation architectures, functions, and operations of the systems, methods, and computer program products according to the embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams can represent a module, a program segment, or a part of code that contains one or more executable instructions for implementing the specified logical functions. In some alternative implementations, the functions noted in the blocks can occur in different orders than those noted in the drawings. For example, two consecutive blocks can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. In the descriptions corresponding to the flowcharts and block diagrams in the drawings, the operations or steps corresponding to different blocks can also occur in different orders than those disclosed in the descriptions, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. Each block in the block diagrams and / or flowcharts, and the combination of blocks in the block diagrams and / or flowcharts, can be implemented by a dedicated hardware-based system that performs the specified functions or actions, or can be implemented by a combination of dedicated hardware and computer instructions.

Claims

1. A mode control method for a remote control, characterized in that, The remote controller includes a first millimeter-wave radar and a second millimeter-wave radar, and the mode control methods include: The environment is monitored using the first millimeter-wave radar of the remote control, and the monitoring results are obtained. If the monitoring result indicates that someone is present, control the remote control to enter wake-up mode; When the remote control enters wake-up mode, the user's behavior is identified by the second millimeter-wave radar of the remote control to obtain the identification result; wherein, the frequency of the second millimeter-wave radar is greater than the frequency of the first millimeter-wave radar; Based on the recognition results, the remote control is controlled to interact with the corresponding TV.

2. The mode control method according to claim 1, characterized in that, The remote control also includes a communication module, which controls the interaction between the remote control and the corresponding television based on the recognition results, including: If the recognition result indicates that the user is using the remote control, activate the remote control's communication module to recognize the user's posture; The user controls the TV corresponding to the remote control based on their gestures.

3. The mode control method according to claim 1, characterized in that, The second millimeter-wave radar identifies user behavior in the following way: The spatial point cloud information acquired by the second millimeter-wave radar is subjected to feature extraction and dimensionality enhancement through an AI algorithm-based coding network. The extracted features are filtered and compressed using an AI algorithm-based decoding network, and the decoding results output by the decoding network are obtained to characterize the user behavior identified by the second millimeter-wave radar.

4. The mode control method according to claim 3, characterized in that, Also includes: By utilizing the residual mechanism of AI algorithms, the serial outputs of spatial attention, convolution, normalization, and activation are residually concatenated with the original input, and attention unit operations are repeatedly performed.

5. The mode control method according to claim 1, characterized in that, The remote control also includes a voice module, and the mode control methods also include: When the remote control is in wake-up mode, the voice module receives the user's voice commands and controls the TV accordingly; or, The system uses a voice module to interact with the user and guide them in operating the remote control.

6. The mode control method according to claim 5, characterized in that, Also includes: If the remote control is not recognized as being used by the user and is able to receive the user's voice commands after entering wake-up mode, the remote control will be put into loss alarm mode and an audible alarm will be sounded to inform the user of the remote control's location. If the remote control enters the lost alarm mode and the duration of the audible alarm exceeds the time threshold, the audible alarm will be stopped.

7. The mode control method according to any one of claims 1 to 6, characterized in that, Also includes: When the remote control enters wake-up mode and the battery level is below the power threshold, the system will remind the user to charge the device via voice prompts.

8. The mode control method according to any one of claims 1 to 6, characterized in that, Also includes: If the monitoring result indicates that no one is present, control the remote control to enter power-saving mode.

9. A mode control device for a remote control, comprising a processor and a memory storing program instructions, characterized in that, The processor is configured to execute, when running the program instructions, the mode control method for a remote controller as described in any one of claims 1 to 8.

10. A remote control, characterized in that, include: Main control chip; The first millimeter-wave radar was configured to monitor the environment; The second millimeter-wave radar is configured to identify user behavior; The communication module is configured to recognize the user's gestures; The voice module is configured to receive user voice commands or to interact with the user via voice. The mode control device for a remote control as described in claim 9 is installed on the main control chip.

Images