Control Prompt Method, Device and Computer Readable Storage Medium for Terminal Device

Abstract

The present invention discloses a control prompting method, device and computer-readable storage medium for a terminal device. The control prompting method for the terminal device includes: a control prompting device of the terminal device obtains the current location information of the user in the room; obtains the control habit information corresponding to the location information; and outputs control prompting information according to the control prompting information corresponding to the control habit information. The present invention improves the intelligent level of the control prompting method for the terminal device.

Description

Technical Field

[0001] The present invention relates to the field of smart home, and particularly to a control prompt method, device and computer-readable storage medium for a terminal device. Background Art

[0002] With the development of smart home IOT technology, smart home has been able to achieve scene intelligence and provide various special scene services for users. For example, in the movie-watching mode, the smart TV automatically turns on, the ceiling light in the room automatically turns off, the smart panel light on the TV wall turns on, the air conditioner turns on the gentle wind mode, the light changes in the dinner mode, and the smart speaker plays light music, etc. However, traditionally, for users to achieve the above operations, they must do so through the mobile APP or the smart panel. Thus, it can be seen that the degree of intelligence of the existing technology for automatically controlling devices is low. Summary of the Invention

[0003] Embodiments of the present invention provide a control prompt method, device and computer-readable storage medium for a terminal device, aiming to solve the technical problem of low intelligence in automatically controlling devices in the existing technology.

[0004] In a first aspect of embodiments of the present invention, a control prompt method for a terminal device is provided. The method includes:

[0005] Obtain the position information of the user currently in the room;

[0006] Obtain the control habit information corresponding to the position information;

[0007] Output control prompt information according to the control prompt information corresponding to the control habit information.

[0008] In a second aspect of embodiments of the present invention, a display control device is provided. The display control device includes: a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, it implements each step of the above display control method.

[0009] In a third aspect of embodiments of the present invention, a computer-readable storage medium is provided. A computer program is stored on the computer-readable storage medium. When the computer program is executed by the processor, it implements each step of the above display control method.

[0010] The control prompt method, device and computer-readable storage medium for a terminal device provided by the present invention. In the technical solution provided in this embodiment, the control prompt device for the terminal device obtains the current position information of the user in the room; obtains the control habit information corresponding to the position information; and outputs the control prompt information according to the control prompt information corresponding to the control habit information. Since it is possible to automatically ask the user whether they need to perform a preset control operation on the terminal by detecting the position information of the user, the degree of intelligence of automatically controlling the terminal device is improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present invention, and those of ordinary skill in the art can obtain other drawings based on these drawings without creative efforts.

[0012] Figure 1 It is a schematic diagram of the hardware architecture of the control prompt device for the terminal device involved in the embodiment of the present invention;

[0013] Figure 2 It is a schematic flowchart of the first embodiment of the control prompt method for the terminal device of the present invention;

[0014] Figure 3 It is a schematic flowchart of the second embodiment of the control prompt method for the terminal device of the present invention;

[0015] Figure 4 It is a schematic flowchart of the third embodiment of the control prompt method for the terminal device of the present invention;

[0016] Figure 5 It is a schematic flowchart of the fourth embodiment of the control prompt method for the terminal device of the present invention;

[0017] Figure 6 It is a schematic flowchart of the fifth embodiment of the control prompt method for the terminal device of the present invention;

[0018] Figure 7 It is a schematic flowchart of the sixth embodiment of the control prompt method for the terminal device of the present invention;

[0019] Figure 8 It is a schematic flowchart of the seventh embodiment of the control prompt method for the terminal device of the present invention;

[0020] Figure 9 It is a schematic flowchart of the eighth embodiment of the control prompt method for the terminal device of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0021] To better understand the above technical solution, the exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided so that the present disclosure can be more thoroughly understood and the scope of the present disclosure can be fully conveyed to those skilled in the art.

[0022] The main solution of the present invention is: obtaining the current location information of the user indoors; obtaining the control habit information corresponding to the location information; and outputting control prompt information according to the control prompt information corresponding to the control habit information.

[0023] Since the location information of the user can be detected to automatically ask the customer whether to perform a preset control operation on the terminal, the degree of intelligence of the automatic control of the terminal device is improved.

[0024] As an implementation manner, the control prompt device of the terminal device may be as Figure 1 described.

[0025] The solution of the embodiment of the present invention relates to a control prompt device of a terminal device. The device includes: a processor 101, such as a CPU, a memory 102, and a communication bus 103. Among them, the communication bus 103 is used to realize the connection and communication between these components.

[0026] The memory 102 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. As Figure 1 described, the memory 103, as a computer storage medium, may include a detection program; and the processor 101 may be used to call the detection program stored in the memory 102 and perform the following operations:

[0027] Obtaining the current location information of the user indoors;

[0028] Obtaining the control habit information corresponding to the location information;

[0029] Outputting control prompt information according to the control prompt information corresponding to the control habit information.

[0030] In an embodiment, the processor 101 may be used to call the detection program stored in the memory 102 and perform the following operations:

[0031] After detecting an operation instruction for a terminal device within a local area network, obtaining a control parameter corresponding to the operation instruction;

[0032] Obtaining the current location information of the user indoors;

[0033] Associated location information and control parameters;

[0034] Update the control habit information corresponding to the location information according to the control parameters associated with the location information.

[0035] In one embodiment, the processor 101 can be used to call the detection program stored in the memory 102 and perform the following operations:

[0036] Obtain the number of associations of the control parameters associated with the location information within a preset time interval;

[0037] Use the control parameter with the largest number of associations as the control habit information corresponding to the location information.

[0038] In one embodiment, the processor 101 can be used to call the detection program stored in the memory 102 and perform the following operations:

[0039] Obtain the azimuth data detected by the radar sensor, where the azimuth data includes distance and direction;

[0040] Determine the user's current location information in the room according to the azimuth data and the preset indoor map.

[0041] In one embodiment, the processor 101 can be used to call the detection program stored in the memory 102 and perform the following operations:

[0042] Obtain the scanning and recognition result of the indoor area by the camera;

[0043] Generate an indoor map according to the scanning and recognition result.

[0044] In one embodiment, the processor 101 can be used to call the detection program stored in the memory 102 and perform the following operations:

[0045] When the control habit information is not obtained, obtain the recommended control parameters;

[0046] Output a prompt message for executing the recommended control parameters.

[0047] In one embodiment, the processor 101 can be used to call the detection program stored in the memory 102 and perform the following operations:

[0048] Obtain the current time point;

[0049] Obtain the control habit information corresponding to the location information and the time point.

[0050] In one embodiment, the processor 101 can be used to call the detection program stored in the memory 102 and perform the following operations:

[0051] Obtain the user's identity information;

[0052] Obtain the control habit information corresponding to the location information and identity information.

[0053] In the technical solution provided in this embodiment, by obtaining the current indoor location information of the user; obtaining the control habit information corresponding to the location information; and outputting the control prompt information according to the control prompt information corresponding to the control habit information. Since the position information of the user can be detected to automatically ask the customer whether to perform a preset control operation on the terminal, the degree of intelligence of the automatic control of the terminal device is improved.

[0054] To better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the specification drawings and specific implementation manners.

[0055] Refer to Figure 2 , Figure 2 This is the first embodiment of the control prompt method for the terminal device of the present invention. The control prompt method for the terminal device includes the following steps:

[0056] Step S10, the control prompt device of the terminal device obtains the current indoor location information of the user.

[0057] In this embodiment, the above-mentioned current indoor location information of the user is the location area of the user in the room. Optionally, the control prompt device of the above-mentioned terminal device controls the radar sensor to pre-obtain the map information of the room and divide the area, and then sends detection light to the room and detects the returned light. The current indoor location information of the user is determined according to the situation of the returned light and the area corresponding to the returned light. For the detection of the area where the human body is located, optionally, the radar sensor emits radar waves to a specified area multiple times per second and receives the returned waves. If the position of the returned waves has changed, it means that the object in front is a movable human body. If no change has occurred in the multiple returned waves, it means that the object in front is not a human body.

[0058] Step S20, the control prompt device of the terminal device obtains the control habit information corresponding to the location information.

[0059] In this embodiment, the control device for the device compares the location information with the pre-obtained control habit information data. For example: compare the above location information with the historical stay location in the pre-obtained control habit information data to determine and obtain the corresponding control habit information. The above control habit information may include the location information of the user and control parameters. For example: the control prompt device of the terminal device detects that the user stays at 7:00 pm and the stay duration is 2 minutes. During this period, operation information of at least one of the discovered smart TV, smart air conditioner, or smart panel light in this area is obtained by the user. Then, the control habit information is generated and stored according to the above situation.

[0060] Optionally, when the control prompt device of the terminal device does not detect the following two situations: (1) The user triggers the custom setting function; (2) The user is using the device for the first time and the user's location is not detected, the control prompt device of the terminal device starts the system default settings. When the number of times the user stays at this location per week and the repetition times of the terminal device operation records reach the threshold (the system defaults that the user stays in a certain area once at the same time or within ±30 minutes for three consecutive days, and the repetition rate of the terminal device operation reaches 66.66%. For example, the user appears in the front area of the smart TV at 7 pm (or between 6:30 and 7:30) for three consecutive days, and twice in this area and this time period, the user turns on the smart TV to search for and watch Youth With You, adjusts the air conditioner to 25 degrees, turns on the smart panel light and sets it to the warm light mode), a prompt can be given through the terminal device, such as through the smart large screen, the smart home APP pop-up window or the AI radar speaker voice question: Whether to generate control habit information according to this scenario (the smart TV automatically plays Youth With You at 7 pm, adjusts the air conditioner to 25 degrees, turns on the smart panel light and sets it to the warm light mode).

[0061] Step S30, the control prompt device of the terminal device outputs the control prompt information according to the control prompt information corresponding to the control habit information.

[0062] In this embodiment, based on the obtained control prompt information, it is determined whether to automatically control the terminal device for the user. Optionally, the user is asked by voice whether to turn on the terminal device and set it to the corresponding control parameters.

[0063] In the technical solution provided in this embodiment, the position information of the user currently in the room is obtained; the control habit information corresponding to the position information is obtained; and the control prompt information is output according to the control prompt information corresponding to the control habit information. Since the position information of the user can be detected to automatically ask the customer whether to perform the preset control operation on the terminal, the degree of intelligence of the automatic control of the terminal device is improved.

[0064] Refer to Figure 3 , Figure 3 This is the second embodiment of the control prompt method for the terminal device of the present invention. Based on the first embodiment, before the step S10, it further includes:

[0065] Step S40, after the control prompt device of the terminal device detects an operation instruction for the terminal device within the local area network, it obtains the control parameters corresponding to the operation instruction.

[0066] In this embodiment, when the control prompt device of the terminal device detects that the terminal device is operated, it will obtain the control parameters corresponding to this operation.

[0067] Step S50, the control prompt device of the terminal device obtains the current location information of the user indoors.

[0068] In this embodiment, after the terminal device is operated, the location information of the operating user is obtained. Specifically, the location information of the user is determined by a radar sensor.

[0069] Step S60, the control prompt device of the terminal device associates the location information and the control parameters.

[0070] In this embodiment, after the terminal device is operated, the operation parameters and the user location corresponding to this operation are associated with data.

[0071] Step S70, the control prompt device of the terminal device updates the control habit information corresponding to the location information according to the control parameters associated with the location information.

[0072] In this embodiment, when the associated information of the information is obtained, it is stored as the control habit information.

[0073] In the technical solution of this embodiment, the control habit information is generated after the device is operated, which can make the control habit information more and more abundant, and then can increase the frequency of the control prompt of the terminal device, indirectly improving the intelligent degree of the control prompt of the terminal device.

[0074] Refer to Figure 4 , Figure 4 This is the third embodiment of the control prompt method for the terminal device of the present invention. Based on the first or second embodiment, after the step S70, the following steps are further included:

[0075] Step S80, the control prompt device of the terminal device obtains the number of associations of the control parameters associated with the location information within a preset time interval.

[0076] Step S90, the control prompt device of the terminal device uses the control parameter with the largest number of associations as the control habit information corresponding to the location information.

[0077] In this embodiment, the above-mentioned number of associations is the number of times the control parameter corresponding to the location information is used. For example: within the A time interval, the number of times the user controls the control parameter D of the terminal C in the B area is 3 times, and within the A time interval, the number of times the user controls the control parameter E of the terminal C in the B area is 4 times. Then it is determined that the control parameter with the largest number of associations is E, and the control parameter E is used to determine the control habit information. Optionally, the above-mentioned A time interval can be a preset time period every day, for example: 6-7 am or 18-19 pm every day.

[0078] In the technical solution of this embodiment, since the control parameters within the same time interval may be different, the number of associations of the control parameters associated with the position information within the preset time interval can be further used to determine whether the control parameters are liked by the user. By providing control prompts based on the control parameters liked by the user, the user experience can be improved.

[0079] Referring to Figure 5 , Figure 5 This is the fourth embodiment of the control prompt method for the terminal device of the present invention. Based on any one of the first to third embodiments, the step S10 includes:

[0080] Step S11, the control prompt device of the terminal device obtains the azimuth data detected by the radar sensor, and the azimuth data includes the distance and the direction.

[0081] In this embodiment, after determining the area where the human body exists, for obtaining the azimuth data of the human body, specifically, the radar sensor determines the above azimuth data by sending detection light into the room and detecting the returned light.

[0082] Step S12, the control prompt device of the terminal device determines the current position information of the user in the room according to the azimuth data and the preset indoor map.

[0083] In this embodiment, by combining the above azimuth data with the preset indoor map, the current position information of the user in the room can be determined. For example: after combining the azimuth data with the indoor map, the corresponding area is the sofa position or the dining table position.

[0084] In the technical solution of this embodiment, by combining the azimuth data with the preset indoor map, when it is determined that there is a human body in the specified area, the position information of the user can be determined, thereby implementing the control prompt method for the terminal in this embodiment.

[0085] Referring to Figure 6 , Figure 6 This is the fifth embodiment of the control prompt method for the terminal device of the present invention. Based on any one of the first to fourth embodiments, before the step S11, it further includes:

[0086] Step S13, the control prompt device of the terminal device obtains the scanning and recognition result of the camera for the room.

[0087] Step S14, the control prompt device of the terminal device generates an indoor map according to the scanning and recognition result.

[0088] In this embodiment, for obtaining the indoor map, the control prompt device of the terminal device can control the camera to perform mirror scanning and recognition on the room, and then generate it according to the integration of the scanning and recognition results.

[0089] In the technical solution of this embodiment, for the acquisition of the indoor map, it can be generated through the scanning and recognition results of the camera, which improves the feasibility of implementation of the control prompt method of the terminal device in this embodiment.

[0090] Referring to Figure 7 , Figure 7 This is the sixth embodiment of the control prompt method of the terminal device of the present invention. Based on any one of the first to fifth embodiments, after the step S30, it further includes:

[0091] Step S100, when the control prompt device of the terminal device does not obtain the control habit information, obtain the recommended control parameters.

[0092] In this embodiment, when there is no corresponding control habit information for the obtained position information of the user indoors, obtain the recommended control parameters for the control prompt of the automatic device. Specifically, for example: the control prompt device of the terminal device queries that 80% of the users watch the CCTV1 News Broadcast at 7 pm, and 60% of the users in the same city set the air conditioner to 26 degrees at 7 pm. Then, it asks the user through voice "Do you want to set the movie-watching scene recommended by big data in the sofa area? Time: 7 pm, response position information: sofa, content of automatic control parameters: smart TV plays CCTV1 News Broadcast, smart air conditioner temperature 26 degrees, smart panel light warm light mode.

[0093] Optionally, if the user answers yes, set the associated scene here, and store the position information, time information, and instruction information as control habit information. When the user selects no, wake up the user-defined setting module. When the control prompt device of the terminal device monitors that the user triggers the "custom setting" module, generate a radar heat map to display the user's residence trajectory in the room every hour on the day. (The more times the user stays in a certain area, the darker the color of the heat map, and vice versa. When the user clicks on the area with the darkest color of the radar heat map, the actions performed at this position in the past time can be viewed.). When the radar heat map is displayed through the terminal device, in the display mode of the terminal device, monitor the user's click on the corresponding area of the radar map, obtain the user behavior-related information at this position, and present it in the form of a pop-up window. The user can select any area of the heat map and set the corresponding terminal device actions in the pop-up window. For example, if the user clicks on the position 0.5 meters at a 45-degree angle in front of the smart TV on the heat map and enters "11 pm, turn off the smart TV, turn off the smart air conditioner, turn off the smart panel light", the smart TV control system will save the above position information, time information, and instruction information as control habit information.

[0094] Step S110, the control prompt device of the terminal device outputs a prompt message for executing the recommended control parameters.

[0095] In the technical solution of this embodiment, when the position information of the user in the room is not obtained, the control prompt of the terminal device is recommended through big data, which improves the flexibility of the prompt.

[0096] Referring to Figure 8 , Figure 8 This is the seventh embodiment of the control prompt method for the terminal device of the present invention. Based on any one of the first to sixth embodiments, the step S20 includes:

[0097] Step S21, the control prompt device of the terminal device obtains the current time point.

[0098] Step S22, the control prompt device of the terminal device obtains the position information and the control habit information corresponding to the time point.

[0099] In this embodiment, when determining the corresponding control habit information according to the position information, the control habit information can be further screened according to the time point.

[0100] In the technical solution of this embodiment, when obtaining the control habit information according to the position information, further screening the control habit information according to the time point can improve the accuracy of the control prompt for the terminal device.

[0101] Referring to Figure 9 , Figure 9 This is the eighth embodiment of the control prompt method for the terminal device of the present invention. Based on any one of the first to seventh embodiments, the step S20 further includes:

[0102] Step S23, the control prompt device of the terminal device obtains the identity information of the user.

[0103] In this embodiment, the above identity information may be identification information for identifying different users. Optionally, the indoor image can be recognized through a camera to determine the target face feature value, and the above face feature value can be used as the above identification information.

[0104] Step S24, the control prompt device of the terminal device obtains the position information and the control habit information corresponding to the identity information.

[0105] In this embodiment, when determining the corresponding control habit information according to the position information, the control habit information can be further determined according to the identity information.

[0106] In the technical solution of this embodiment, when obtaining the control habit information according to the position information, further screening the control habit information according to the identity information of the user can improve the accuracy of the control prompt for the terminal device.

[0107] To achieve the above object, the present invention provides a control prompting device for a terminal device. The control prompting device for the terminal device includes: a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, each step of the control prompting method for the terminal device as described above is implemented.

[0108] To achieve the above object, the present invention provides a computer-readable storage medium. A computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, each step of the control prompting method for the terminal device as described above is implemented.

[0109] Those skilled in the art should understand that the embodiments of the present invention can be provided as a method, a system, or a computer program display device. Therefore, the present invention can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present invention can take the form of a computer program display device implemented on one or more computer-usable storage media (including but not limited to disk memories, CD-ROMs, optical memories, etc.) containing computer-usable program codes.

[0110] The present invention is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program display devices according to embodiments of the present invention. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and the combination of flows and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, such that the instructions executed by the processor of the computer or other programmable data processing devices generate a device for implementing the functions specified in Figure 1 one flow or multiple flows and / or blocks Figure 1 one block or multiple blocks.

[0111] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, such that the instructions stored in the computer-readable memory generate a manufactured article including an instruction device that implements the functions specified in Figure 1 one flow or multiple flows and / or blocks Figure 1 one block or multiple blocks.

[0112] These computer program instructions can also be loaded onto a computer or other programmable data processing device, such that a series of operation steps are executed on the computer or other programmable device to generate a computer-implemented process. Thus, the instructions executed on the computer or other programmable device provide for implementing in the processFigure 1 one process or multiple processes and / or blocks Figure 1 steps of functions specified in one block or multiple blocks.

[0113] It should be noted that in the claims, any reference signs placed between parentheses shall not be construed as limiting the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present invention can be implemented by means of hardware including several different elements and by means of a suitably programmed computer. In a unit claim listing several devices, several of these devices can be embodied by the same item of hardware. The use of the words first, second, and third, etc. does not denote any order. These words can be interpreted as names.

[0114] Although the preferred embodiments of the present invention have been described, additional changes and modifications can be made by those skilled in the art once they learn the basic inventive concept. Therefore, the appended claims are intended to be construed to include the preferred embodiments as well as all changes and modifications falling within the scope of the present invention.

[0115] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention is also intended to include these changes and modifications.

Claims

1. A control prompt method for a terminal device, characterized in that, the method includes: Controlling a radar sensor to pre-acquire map information of a room and divide regions; Emitting radar waves to a specified region multiple times per second and receiving the returned waves, and determining whether the object in front is a human body based on whether the position of the returned waves changes, and determining the region where the human body is located; After determining the region where a human body exists, sending detection light into the room and detecting the returned light to determine orientation data, where the orientation data includes distance and direction; Combining the orientation data with the indoor map to determine the current position information of the user in the room; Comparing the position information with the historical stay positions in the pre-acquired control habit information data, and filtering according to the current time point to obtain the control habit information corresponding to the position information and time point, where the control habit information includes the position information where the user is located and control parameters; According to the control habit information, outputting a voice prompt message including the control parameters to ask the user whether to turn on the terminal device and set it to the control parameters; When detecting the triggering of a custom setting module, generating and displaying a radar heat map, where the radar heat map shows the user's staying trajectory in the room every hour of the day; Monitoring the position clicked by the user on the radar heat map, obtaining information related to the user's behavior at the position, and displaying it in the form of a pop-up window; Obtaining the terminal device actions set by the user based on the pop-up window, and saving the terminal device actions as the control habit information.

2. The control prompt method for a terminal device according to claim 1, characterized in that, after the step of asking the user whether to turn on the terminal device and set it to the control parameters according to the control prompt information corresponding to the control habit information, the control prompt method for the terminal device further includes: When the control habit information is not obtained, obtaining recommended control parameters; Outputting a prompt message to execute the recommended control parameters.

3. The control prompt method for a terminal device according to claim 1, characterized in that, the step of comparing the position information with the historical stay positions in the pre-acquired control habit information data to determine and obtain the corresponding control habit information includes: Obtaining the user's identity information; Obtaining the control habit information corresponding to the position information and the identity information.

4. A control prompt device for a terminal device, characterized in that, the control prompt device for the terminal device includes: a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the computer program, the steps of the control prompt method for the terminal device according to any one of claims 1 to 3 are implemented.

5. A computer-readable storage medium, characterized in that, a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the control prompt method for the terminal device according to any one of claims 1 to 3 are implemented.

Images