Method for interacting with equipment, control terminal, service platform and intelligent equipment

Abstract

The invention discloses a terminal interaction method, a control terminal, a service platform and intelligent equipment, and the method comprises the steps that the control terminal obtains and displays three-dimensional scene information of a designated place area through the service platform, and the three-dimensional scene information of the designated place area comprises intelligent equipment related information existing in the designated place area; the control terminal receives a first input instruction in the displayed three-dimensional scene information to determine a specified intelligent device; and the control terminal receives a second input instruction for the specified intelligent equipment to determine an interaction instruction, and sends the interaction instruction to the specified intelligent equipment through the service platform, so that the specified intelligent equipment performs an operation corresponding to the interaction instruction. In this way, the control efficiency of the control terminal and the control compatibility of different intelligent devices can be improved.

Description

Technical Field

[0001] The present invention relates to the field of intelligent interaction technology, and in particular to a method for interacting with a device, a control terminal, a service platform and an intelligent device. Background Art

[0002] With the continuous development of technology, the control methods of equipment are becoming more and more intelligent, and how to control the equipment conveniently and efficiently has become a hot topic of research.

[0003] In the prior art, the terminal usually controls the device through a two-dimensional user interface. The device code responds to a series of instructions, and then the control terminal sends a series of instructions. This requires the terminal to obtain a lot of data from the device's sensor to determine the device's current location and working status. This manual method of determining the device's location and status is not only time-consuming and labor-intensive, but also has low control efficiency. In addition, the terminal or the program on the terminal and the device are usually controlled in a one-to-one correspondence manner, and the compatibility between terminals controlling different devices is poor, and the control process of multiple devices is relatively cumbersome.

[0004] During the long-term research and development process, the inventors of the present application discovered that the control efficiency of the devices by the limited terminals was low and the compatibility of the controlled devices was poor. Summary of the invention

[0005] The main technical problem solved by the present invention is to provide a method for interacting with a device, a control terminal, a service platform and an intelligent device, which can simplify the control process of the terminal to the device, improve the control efficiency and the compatibility of the control terminal.

[0006] In order to solve the above technical problem, a technical solution adopted by the present invention is: to provide a method for interacting with a device.

[0007] Among them, the method includes:

[0008] The control terminal obtains and displays the three-dimensional scene information of the designated location area through the service platform, and the three-dimensional scene information of the designated location area includes information related to the smart devices existing in the designated location area;

[0009] The control terminal receives a first input instruction in the displayed three-dimensional scene information and determines a designated smart device;

[0010] The control terminal receives the second input instruction for the designated smart device to determine the interaction instruction, and sends the interaction instruction to the designated smart device through the service platform, so that the designated smart device performs an operation corresponding to the interaction instruction.

[0011] In order to solve the above technical problem, another technical solution adopted by the present invention is: providing a method for interacting with a device.

[0012] Among them, the method includes:

[0013] The service platform sends the three-dimensional scene information of the designated location area to the control terminal so that the control terminal displays the three-dimensional scene information of the designated location area, wherein the three-dimensional scene information of the designated pointing area includes the relevant information of the smart device existing in the designated location area, and the relevant information of the smart device is the relevant information of the smart device existing in the designated location area sent to the service platform;

[0014] The service platform receives an interaction instruction sent by the control terminal to a designated smart device, the designated smart device is determined by the control terminal receiving a first input instruction in the displayed three-dimensional scene information, and the interaction instruction is determined by the control terminal receiving a second input instruction for the designated smart device;

[0015] The service platform forwards the interaction instruction to the designated smart device, so that the designated smart device performs an operation corresponding to the interaction instruction.

[0016] In order to solve the above technical problem, another technical solution adopted by the present invention is: providing a method for interacting with a device.

[0017] Among them, the method includes:

[0018] The smart device sends the three-dimensional scene information of the area around itself to the service platform, and the three-dimensional scene information of the area around itself includes the relevant information of the smart device itself, so that the service platform forwards the three-dimensional scene information of the area around the smart device itself to the control terminal, and then the control terminal displays the three-dimensional scene information of the area around the smart device itself;

[0019] The smart device receives the interaction instruction of the control terminal forwarded by the service platform, the smart device is a designated smart device determined by the control terminal receiving a first input instruction in the displayed three-dimensional scene information, and the interaction instruction is determined by the control terminal receiving a second input instruction for the designated smart device;

[0020] The smart device performs an operation corresponding to the interaction instruction.

[0021] In order to solve the above technical problem, another technical solution adopted by the present invention is: providing a control terminal.

[0022] Wherein, the control terminal comprises: a first processor and a first communication circuit, the first processor is coupled to the first communication circuit;

[0023] The first processor is used to obtain and display three-dimensional scene information of a designated location area through a service platform, wherein the three-dimensional scene information of the designated location area includes information related to smart devices existing in the designated location area; the first processor is used to receive a first input instruction in the displayed three-dimensional scene information to determine a designated smart device; the first processor is used to receive a second input instruction for the designated smart device to determine an interaction instruction, and send the interaction instruction to the designated smart device through the service platform, so that the designated smart device performs an operation corresponding to the interaction instruction.

[0024] In order to solve the above technical problem, another technical solution adopted by the present invention is: providing a service platform.

[0025] The service platform includes: a second processor and a second communication circuit, wherein the second processor is coupled to the second communication circuit;

[0026] The second processor is used to send three-dimensional scene information of a designated location area to the control terminal so that the control terminal displays the three-dimensional scene information of the designated location area, the three-dimensional scene information of the designated pointing area includes relevant information of a smart device existing in the designated location area, and the relevant information of the smart device is the relevant information of the smart device existing in the designated location area sent to the service platform; the second processor is used to receive an interaction instruction sent by the control terminal to a designated smart device, the designated smart device is determined by the control terminal receiving a first input instruction in the displayed three-dimensional scene information, and the interaction instruction is determined by the control terminal receiving a second input instruction for the designated smart device; the second processor is used to forward the interaction instruction to the designated smart device, so that the designated smart device performs an operation corresponding to the interaction instruction.

[0027] In order to solve the above technical problem, another technical solution adopted by the present invention is: to provide a smart device.

[0028] Wherein, the smart device comprises: a third processor and a third communication circuit, the third processor is coupled to the third communication circuit;

[0029] The third processor is used to send three-dimensional scene information of the area around itself to the service platform, and the three-dimensional scene information of the area around itself includes the relevant information of the smart device itself, so that the service platform forwards the three-dimensional scene information of the area around the smart device itself to the control terminal, and then the control terminal displays the three-dimensional scene information of the area around the smart device itself; the third processor is used to receive an interaction instruction of the control terminal forwarded by the service platform, and the smart device is a designated smart device determined by the control terminal when it receives a first input instruction in the displayed three-dimensional scene information, and the interaction instruction is determined by the control terminal when it receives a second input instruction for the designated smart device; the third processor is used to perform an operation corresponding to the interaction instruction.

[0030] The beneficial effects of the present invention are as follows: Different from the prior art, the present invention uses a three-dimensional scene to restore the designated location area, and by operating the smart device in the three-dimensional scene, the interaction instruction can be sent to the corresponding designated smart device in the designated location area through the service platform, so that the designated smart device performs the operation corresponding to the interaction instruction. This method of controlling smart devices in real space through a three-dimensional scene and receiving information related to the smart devices in the designated location area can simplify the control process of the smart devices and improve the control efficiency. At the same time, the smart devices in the designated location area can all perform the above control process through the control terminal, which improves the compatibility of the control terminal. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. Among them:

[0032] Figure 1 It is a flowchart of a first implementation method of a method for interacting with a device according to the present invention;

[0033] Figure 2 yes Figure 1 A schematic flow chart of an implementation method of step 300;

[0034] Figure 3 is a flow chart of a second embodiment of a method for interacting with a device according to the present invention;

[0035] Figure 4 yes Figure 3 A schematic flow chart of an implementation method of step 30;

[0036] Figure 5is a flow chart of a third embodiment of a method for interacting with a device according to the present invention;

[0037] Figure 6 yes Figure 5 A schematic flow chart of an implementation method of step 3 in the embodiment;

[0038] Figure 7 It is a structural schematic diagram of an implementation mode of a control terminal of the present invention;

[0039] Figure 8 It is a structural schematic diagram of an implementation method of a service platform of the present invention;

[0040] Fig. 9 It is a structural schematic diagram of an implementation method of an intelligent device of the present invention. DETAILED DESCRIPTION

[0041] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0042] See also Figure 1 , Figure 1 The present invention is a flowchart of a first embodiment of a method for interacting with a device, the method comprising:

[0043] Step S100: the control terminal obtains and displays three-dimensional scene information of a designated location area through a service platform, where the three-dimensional scene information of the designated location area includes information related to smart devices existing in the designated location area.

[0044] In step S100, the control terminal includes but is not limited to smart devices such as mobile phones and tablet computers. Furthermore, the control terminal is a three-dimensional image program on the control terminal, and the operator connects to the service platform by logging into the three-dimensional program. Furthermore, the operator will also enter the three-dimensional scene of the designated location area in the form of a three-dimensional image. The smart device related information is the self-related information sent by the smart device in the designated location area to the service platform. The self-related information is also the smart device related information. The service platform communicates with the smart device in the designated location area, and can use one or a combination of Bluetooth, WIFI or 4G network methods.

[0045] Step S200: the control terminal receives a first input instruction in the displayed three-dimensional scene information and determines a designated smart device.

[0046] In step S200, the smart device may be a smart device in the designated location area that is connected to the service platform, and has a corresponding three-dimensional model in the three-dimensional scene. When the control terminal needs to operate a smart device in the designated location area, the three-dimensional model corresponding to the smart device in the three-dimensional scene can become the operation object of the control terminal. Further, in the three-dimensional scene, the first input instruction is sent to a three-dimensional model, and the smart device corresponding to the three-dimensional model in the designated location area becomes the designated smart device. The first instruction may be a click instruction, and the first instruction is issued by clicking the three-dimensional model corresponding to the designated smart device in the three-dimensional scene. Furthermore, in the three-dimensional scene, the three-dimensional model of the operator issues the first instruction by clicking the three-dimensional model corresponding to the designated smart device.

[0047] Step S300: the control terminal receives the second input instruction for the designated smart device to determine the interaction instruction, and sends the interaction instruction to the designated smart device through the service platform, so that the designated smart device performs an operation corresponding to the interaction instruction.

[0048] In step S300, the control terminal may control a smart device in the designated location area by sending the interaction instruction to a three-dimensional model corresponding to the smart device in the three-dimensional scene.

[0049] In this real-time mode, a three-dimensional scene is used to restore the designated location area. By operating the smart device in the three-dimensional scene, the interaction instruction can be sent to the corresponding designated smart device in the designated location area through the service platform, so that the designated smart device performs the operation corresponding to the interaction instruction. This method of controlling smart devices in real space through a three-dimensional scene and receiving relevant information about smart devices in the designated location area can simplify the control process of smart devices and improve control efficiency. At the same time, all smart devices in the designated location area can perform the above control process through the control terminal, which improves the compatibility of the control terminal.

[0050] In one embodiment, the control terminal obtains and displays the three-dimensional scene information of the designated location area through the service platform, including: the control terminal obtains and displays the three-dimensional scene information of the designated location area changes in real time through the service platform. Through the three-dimensional scene information of the designated location area changes displayed by the control terminal in the three-dimensional scene, the real-time dynamics of the designated location area can be understood, and there is no need to analyze and judge, the control process is relatively simple, and the control efficiency is high. Further, the three-dimensional scene information includes but is not limited to the building information, object information and smart device information related information in the designated location area. The three-dimensional scene information can restore the scene of the designated location area, and the user does not need to enter the designated location area or interact directly with the designated smart device, and can grasp the state of the designated location area in real time and control the designated smart device. Further, the smart device related information includes the position change information of the smart device and / or the state change information of the smart device. In this way, the control terminal can present the state information of the designated smart device that changes during the execution of the interactive instruction in real time, intuitively grasp the status of the designated smart device in the designated location area, and improve the user experience of the interaction process with the designated smart device.

[0051] In another embodiment, please refer to Figure 2 , Figure 2 yes Figure 1 In the flowchart of an implementation method of step 300, the control terminal receives a second input instruction for the designated smart device and determines the interaction instruction includes:

[0052] Step S310: The control terminal sends an interactive option viewing instruction to the designated smart device through the service platform.

[0053] In step S310, the control terminal needs to determine the interactive instructions that the smart device can receive and execute through the three-dimensional scene. The control terminal sends the interactive option viewing instruction to the designated smart device through the service platform. In another embodiment, the interactive option viewing instruction is sent to the service platform by clicking on the three-dimensional model corresponding to the smart device in the three-dimensional scene, that is, the service platform stores the interactive instruction of the designated smart device.

[0054] Step S320: The control terminal receives the interaction option feedback information returned by the designated smart device through the service platform.

[0055] In step S320, the control terminal receives the interaction option feedback information returned by the designated smart device through the service platform, that is, the designated smart device provides real-time feedback after receiving the interaction option viewing instruction. In another embodiment, the service platform provides the interaction option instruction pre-provided by the designated smart device to the control terminal in the form of the interaction option feedback information, that is, after the service platform views the received interaction option, it queries the interaction instruction pre-stored in the service platform by the designated smart device. In this way, the control terminal only needs to interact with the service platform to obtain the interaction instruction, which is convenient to operate. Of course, the designated smart device can update its own interaction options at regular intervals based on factors such as performance improvement.

[0056] Step S330: The control terminal receives the second input instruction based on the interaction option feedback information and determines the interaction instruction.

[0057] In step S330, the operator selects one or more instructions that need to be executed by the designated smart device from the interactive options as the second instruction and sends the second instruction to the control terminal. Further, the service platform sends the received second instruction to the designated smart device, and the designated smart device executes the second instruction. Of course, when the designated smart device executes the second instruction, the real-time status of the designated smart device is sent to the control terminal through the service platform and displayed by the control terminal.

[0058] In an application scenario, a user operates a drone on a terrace in an office. At this time, the drone on the terrace becomes the designated smart device. The control terminal obtains the three-dimensional scene information of the terrace through the service platform. And in the three-dimensional scene of the terrace, the three-dimensional model of the drone is operated through a three-dimensional model of an operator. The three-dimensional model of the operator views the interactive options of the drone, selects the take-off option as the second instruction and sends the take-off instruction to the control terminal. The three-dimensional model of the operator determines the surrounding building information (such as location and height, etc.), object information (whether there are moving objects that are not suitable for executing the second instruction, etc.) and smart device related information (such as power consumption during take-off and other information related to the current operation of the smart device) through the building information, object information and smart device information related information in the three-dimensional scene. After that, the service platform sends the take-off instruction to the drone, and the drone starts the flight mode and performs the take-off operation. And the real-time position and status of the drone during take-off are sent to the control device through the service platform, and the control terminal displays the take-off process of the drone in real time in the three-dimensional scene. The user can intuitively grasp the status of the drone and operate it without directly interacting with the drone. Such a control process is not only simple and convenient, but also has high control efficiency. Of course, the user can also control other smart devices on the terrace through the control terminal, without having to design a control terminal for each smart device, which improves the compatibility of the smart device control process and is conducive to promotion and application.

[0059] To solve the above technical problems, another technical solution adopted by the present invention is to provide a method for interacting with a device. Figure 3 , Figure 3 1 is a flow chart of a second embodiment of a method for interacting with a device according to the present invention, wherein the method comprises:

[0060] Step S10: The service platform sends three-dimensional scene information of the designated location area to the control terminal so that the control terminal displays the three-dimensional scene information of the designated location area. The three-dimensional scene information of the designated pointing area includes relevant information of the smart device existing in the designated location area. The relevant information of the smart device is the relevant information of the smart device existing in the designated location area sent to the service platform.

[0061] In step S10, the service platform establishes a connection with the smart device in advance, and the service platform forms a corresponding three-dimensional model of the smart device connected thereto, and manages it according to the location area. After the user determines the designated location area, the service platform loads the three-dimensional scene information of the designated point area, and accordingly, the three-dimensional scene includes the smart device set in the designated location area. If the designated location area is the living room of the home, the three-dimensional scene includes the smart devices in the living room, such as a TV, a refrigerator, and an air conditioner. The self-related information is also the related information of the smart device. The service platform communicates with the smart devices in the designated location area, and can use one or a combination of Bluetooth, WIFI, or 4G network.

[0062] Step S20: The service platform receives an interaction instruction sent by the control terminal to a designated smart device, where the designated smart device is determined when the control terminal receives a first input instruction in the displayed three-dimensional scene information, and the interaction instruction is determined when the control terminal receives a second input instruction for the designated smart device.

[0063] In step S20, the service platform receives the interactive instruction sent by the control terminal to the designated smart device. The smart device can be a smart device in the designated location area that establishes a connection with the service platform, and has a corresponding three-dimensional model in the three-dimensional scene. When the control terminal needs to operate a smart device in the designated location area, the three-dimensional model corresponding to the smart device in the three-dimensional scene can become the operation object of the control terminal. The first instruction can be a click instruction, and the first instruction is issued by clicking the three-dimensional model corresponding to the designated smart device in the three-dimensional scene. Furthermore, in the three-dimensional scene, the three-dimensional model of the operator issues the first instruction by clicking the three-dimensional model corresponding to the designated smart device.

[0064] Furthermore, the service platform and the control terminal establish a connection through Bluetooth, infrared, wifi or 4G network. Of course, the communication mode between the service platform and the control terminal can be one of the above communication modes, and can also be switched according to the network conditions of the environment. For example, if the wifi strength of the environment is low, the 4G network is preferred for communication. Of course, when the control terminal accesses the service platform, the service platform sends a series of protocols to the control terminal to standardize and optimize the interaction process between the two. The protocols include: login protocol, displacement protocol, action switching protocol, state change protocol and control protocol, etc.

[0065] Step S30: the service platform forwards the interaction instruction to the designated smart device, so that the designated smart device performs an operation corresponding to the interaction instruction.

[0066] In step S30, the service platform forwards the interactive instruction sent by the control terminal to the designated smart device. Of course, the service platform also forwards the real-time status of the corresponding operation process of the smart device to the interactive instruction to the control terminal.

[0067] In one embodiment, the service platform sends the three-dimensional scene information of the designated location area to the control terminal, including: the control terminal obtains and displays the three-dimensional scene information of the changes in the designated location area in real time through the service platform. Through the three-dimensional scene information of the changes in the designated location area displayed by the control terminal in the three-dimensional scene, the real-time dynamics of the designated location area can be understood, and there is no need to analyze and judge, the control process is relatively simple, and the control efficiency is high. Further, the three-dimensional scene information includes but is not limited to the building information, object information and smart device information related information in the designated location area. The three-dimensional scene information can restore the scene of the designated location area, and the user does not need to enter the designated location area or interact directly with the designated smart device, and can grasp the state of the designated location area in real time and control the designated smart device. Further, the smart device related information includes the position change information of the smart device and / or the state change information of the smart device. In this way, the control terminal can present the state information of the designated smart device that changes during the execution of the interactive instruction in real time, intuitively grasp the status of the designated smart device in the designated location area, and improve the user experience of the interaction process with the designated smart device.

[0068] In another embodiment, please refer to Figure 4 , Figure 4 yes Figure 3 The flow chart of the implementation method of step 30 in the embodiment of FIG. 1 , wherein the service platform receives the interaction instruction sent by the control terminal to the designated smart device, including:

[0069] Step S31: the service platform receives an interactive option viewing instruction sent by the control terminal to the designated smart device.

[0070] In step S31, the control terminal sends the received interactive option viewing instruction of the designated smart device to the service platform.

[0071] Step S32: the service platform forwards the interaction option feedback information from the designated smart device to the control terminal, so that the operator inputs the second input instruction in the control terminal based on the interaction option feedback information, and then the control terminal determines the interaction instruction.

[0072] In step S32, the service platform sends the interaction option feedback information of the designated smart device to the control terminal. The interaction option feedback information is determined by the smart device when it is connected to the service platform. The operator selects one or more instructions that need to be executed by the designated smart device from the interaction options as the second instruction and sends the second instruction to the control terminal. The control terminal sends the interaction instruction contained in the second instruction to the service platform.

[0073] Step S33: The service platform receives the interaction instruction sent by the control terminal to the designated smart device.

[0074] In step S33, the service platform sends the received interaction instruction to the designated smart device, and the designated smart device executes the interaction instruction. Of course, during the execution of the interaction instruction by the designated smart device, the real-time status of the designated smart device is sent to the control terminal through the service platform and displayed by the control terminal.

[0075] To solve the above technical problems, another technical solution adopted by the present invention is to provide a method for interacting with a device. Figure 4 , Figure 4 : is a flow chart of a third embodiment of a method for interacting with a device according to the present invention, wherein the method comprises:

[0076] Step S1: The smart device sends three-dimensional scene information of the area around itself to the service platform, and the three-dimensional scene information of the area around itself includes the smart device's own relevant information, so that the service platform forwards the three-dimensional scene information of the area around the smart device itself to the control terminal, and then the control terminal displays the three-dimensional scene information of the area around the smart device itself.

[0077] In step S1, before the smart device establishes a connection with the service platform, it needs to register on the service platform by applying for an ID or other methods. The service platform establishes a connection with the verified smart device, and the service platform sends a series of protocols to the smart device to standardize and optimize the interaction process between the two. The protocols include: login protocol, displacement protocol, action switching protocol, state change protocol and control protocol. The content of the service platform's verification of the control device includes the status of the control device (whether it can operate normally) and whether there are safety hazards, etc. The safety hazards include the communication security between the smart device and the service platform. At the same time, the smart device provides real-time location information and interaction instructions to the service platform. The interaction instructions include the interaction instructions specified in the control protocol, and also include additional interaction instructions provided by the smart device to better realize its own functions. For example, when a drone is used as a smart device, the specified interaction instructions include take-off instructions and landing instructions; the additional interaction instructions include flight altitude instructions, flight direction instructions and obstacle sensing instructions.

[0078] Furthermore, the smart device sends three-dimensional scene information of the area around itself to the service platform, and the three-dimensional scene information of the area around itself includes the smart device's own relevant information. The smart device not only sends its own relevant information to the service platform, but also sends other three-dimensional scene information of its surrounding area to the service platform. The three-dimensional scene information of the area around itself sent to the service platform by at least one smart device in a certain location area (a smart device that establishes a connection with the service platform) together constitutes the three-dimensional scene information of the location area. When the user selects the smart device in the location area as the designated smart device, the location area becomes the designated location area. In this embodiment, the service platform serves as an information exchange platform between the control terminal and the smart device.

[0079] Step S2: The smart device receives the interaction instruction of the control terminal forwarded by the service platform. The smart device is a designated smart device determined by the control terminal when it receives a first input instruction in the displayed three-dimensional scene information. The interaction instruction is determined by the control terminal when it receives a second input instruction for the designated smart device.

[0080] In step S2, the smart device may be a smart device in the designated location area that is connected to the service platform, and has a corresponding three-dimensional model in the three-dimensional scene. When the control terminal needs to operate a smart device in the designated location area, the three-dimensional model corresponding to the smart device in the three-dimensional scene can become the operation object of the control terminal. Further, in the three-dimensional scene, the first input instruction is sent to a three-dimensional model, and the smart device corresponding to the three-dimensional model in the designated location area becomes the designated smart device. The first instruction may be a click instruction, and the first instruction is issued by clicking the three-dimensional model corresponding to the designated smart device in the three-dimensional scene. Furthermore, in the three-dimensional scene, the three-dimensional model of the operator issues the first instruction by clicking the three-dimensional model corresponding to the designated smart device.

[0081] The operator selects one or more instructions that need to be executed by the designated smart device from the interactive options as the second instruction and sends the second instruction to the control terminal. Further, the service platform sends the received second instruction to the designated smart device, and the designated smart device executes the second instruction.

[0082] Step S3: The smart device performs an operation corresponding to the interaction instruction.

[0083] The smart device receives and executes the interactive instruction, and performs operations corresponding to the interactive instruction during the execution of the interactive instruction. Of course, the smart device forwards the real-time status of the interactive instruction execution process to the controlled terminal through the service platform.

[0084] In one embodiment, the smart device sends the three-dimensional scene information of the area around itself to the service platform, including: the smart device sends the three-dimensional scene information of the area around itself to the service platform in real time. Through the three-dimensional scene information of the changes in the designated location area displayed by the control terminal in the three-dimensional scene, the real-time dynamics of the designated location area can be understood without analysis and judgment, and the control process is relatively simple and the control efficiency is high. Further, the three-dimensional scene information includes but is not limited to the building information, object information and smart device information related information in the designated location area. The three-dimensional scene information can restore the scene of the designated location area, and the user does not need to enter the designated location area or interact directly with the designated smart device, and can grasp the state of the designated location area in real time and control the designated smart device. Further, the smart device related information includes the position change information of the smart device and / or the state change information of the smart device. In this way, the control terminal can present the state information of the designated smart device changing in the process of executing the interactive instruction in real time, intuitively grasp the status of the designated smart device in the designated location area, and improve the user experience of the interaction process with the designated smart device.

[0085] In another embodiment, please refer to Figure 6 , Figure 6 yes Figure 5 The flowchart of the implementation method of step 3 in the embodiment of the present invention, wherein the smart device receives the interactive instruction of the control terminal forwarded by the service platform, including:

[0086] Step S301: The smart device receives the interactive option viewing instruction of the control terminal forwarded by the service platform.

[0087] Step S302: the smart device sends the interaction option feedback information to the control terminal through the service platform, so that the user inputs the second input instruction in the control terminal based on the interaction option feedback information, and then the control terminal determines the interaction instruction.

[0088] Step S303: The smart device receives the interactive instruction sent by the control terminal through the service platform.

[0089] In this embodiment, the interactive option feedback information is provided by the smart device in real time and forwarded to the control terminal through the service platform, which can reduce the data storage and search pressure of the service platform and improve the execution efficiency of the interactive option feedback information.

[0090] Of course, the designated smart device can also store the interaction instruction in the service platform in advance. In this way, the control terminal can obtain the interaction instruction only by interacting with the service platform, which is convenient for operation. The designated smart device can update its own interaction options at regular intervals according to factors such as performance improvement.

[0091] In order to solve the above technical problem, another technical solution adopted by the present invention is: providing a control terminal.

[0092] Please refer to Figure 7 , Figure 7 It is a structural diagram of an embodiment of a control terminal of the present invention, wherein the control terminal 100 comprises: a first processor 110 and a first communication circuit 120, wherein the first processor 110 is coupled to the first communication circuit 120;

[0093] The first processor 110 is used to obtain and display three-dimensional scene information of a designated location area through a service platform, wherein the three-dimensional scene information of the designated location area includes information related to smart devices existing in the designated location area; the first processor 110 is also used to receive a first input instruction in the displayed three-dimensional scene information to determine a designated smart device; the first processor 110 is also used to receive a second input instruction for the designated smart device to determine an interaction instruction, and send the interaction instruction to the designated smart device through the service platform, so that the designated smart device performs an operation corresponding to the interaction instruction.

[0094] In order to solve the above technical problem, another technical solution adopted by the present invention is: providing a service platform.

[0095] Please refer to Figure 8 , Figure 8 It is a structural diagram of an embodiment of a service platform of the present invention, wherein the service platform 200 comprises: a second processor 210 and a second communication circuit 220, wherein the second processor 210 is coupled to the second communication circuit 220;

[0096] The second processor 210 is used to send three-dimensional scene information of a designated location area to the control terminal so that the control terminal displays the three-dimensional scene information of the designated location area. The three-dimensional scene information of the designated pointing area includes information related to a smart device existing in the designated location area. The smart device related information is the smart device existing in the designated location area and sent to the service platform. The second processor 210 is also used to receive an interaction instruction sent by the control terminal to a designated smart device. The designated smart device is determined by the control terminal receiving a first input instruction in the displayed three-dimensional scene information. The interaction instruction is determined by the control terminal receiving a second input instruction for the designated smart device. The second processor 210 is also used to forward the interaction instruction to the designated smart device so that the designated smart device performs an operation corresponding to the interaction instruction.

[0097] In order to solve the above technical problem, another technical solution adopted by the present invention is: to provide a smart device.

[0098] Please refer to Fig. 9 , Fig. 9 It is a structural diagram of an embodiment of a smart device of the present invention, wherein the smart device 300 comprises: a third processor 310 and a third communication circuit 320, wherein the third processor 310 is coupled to the third communication circuit 320;

[0099] The third processor 310 is used to send three-dimensional scene information of the area around itself to the service platform, and the three-dimensional scene information of the area around itself includes the relevant information of the smart device itself, so that the service platform forwards the three-dimensional scene information of the area around the smart device itself to the control terminal, and then the control terminal displays the three-dimensional scene information of the area around the smart device itself; the third processor 310 is also used to receive an interaction instruction of the control terminal forwarded by the service platform, and the smart device is a designated smart device determined by the control terminal when it receives a first input instruction in the displayed three-dimensional scene information, and the interaction instruction is determined by the control terminal when it receives a second input instruction for the designated smart device; the third processor 310 is also used to perform an operation corresponding to the interaction instruction.

[0100] In summary, the present invention discloses a method for interacting with a terminal, a control terminal, a service platform, and an intelligent device, the method comprising: the control terminal obtains and displays three-dimensional scene information of a designated location area through a service platform, the three-dimensional scene information of the designated location area includes information related to intelligent devices existing in the designated location area; the control terminal receives a first input instruction in the displayed three-dimensional scene information to determine a designated intelligent device; the control terminal receives a second input instruction for the designated intelligent device to determine an interaction instruction, and sends the interaction instruction to the designated intelligent device through the service platform, so that the designated intelligent device performs an operation corresponding to the interaction instruction. In the above manner, the present invention can improve the control efficiency of the control terminal over the device and make the control process more convenient.

[0101] The above are only implementation modes of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A method for interacting with a device, characterized in that: The method comprises: The control terminal obtains and displays the three-dimensional scene information of the designated location area through the service platform, wherein the three-dimensional scene information of the designated location area includes information related to the smart devices existing in the designated location area; The control terminal receives a first input instruction in the displayed three-dimensional scene information to determine a designated smart device; The control terminal receives the second input instruction for the designated smart device to determine the interaction instruction, and sends the interaction instruction to the designated smart device through the service platform, so that the designated smart device performs an operation corresponding to the interaction instruction.

2. The method according to claim 1, characterized in that The control terminal obtains and displays the three-dimensional scene information of the designated location area through the service platform, including: The control terminal acquires and displays the three-dimensional scene information of the changes in the designated location area in real time through the service platform.

3. The method according to claim 2, characterized in that The smart device related information includes location change information of the smart device and / or state change information of the smart device.

4. The method according to claim 1, characterized in that: The control terminal receives a second input instruction for the designated smart device and determines an interaction instruction, including: The control terminal sends an interactive option viewing instruction to the designated smart device through the service platform; The control terminal receives the interaction option feedback information returned by the designated smart device through the service platform; The control terminal receives the second input instruction based on the interaction option feedback information and determines the interaction instruction.

5. A method for interacting with a device, characterized in that: The method comprises: The service platform sends the three-dimensional scene information of the designated location area to the control terminal, so that the control terminal displays the three-dimensional scene information of the designated location area, wherein the three-dimensional scene information of the designated pointing area includes the related information of the smart device existing in the designated location area, and the related information of the smart device is the related information of the smart device existing in the designated location area sent to the service platform; The service platform receives an interaction instruction sent by the control terminal to a designated smart device, wherein the designated smart device is determined by the control terminal receiving a first input instruction in the displayed three-dimensional scene information, and the interaction instruction is determined by the control terminal receiving a second input instruction for the designated smart device; The service platform forwards the interaction instruction to the designated smart device, so that the designated smart device performs an operation corresponding to the interaction instruction.

6. The method according to claim 5, characterized in that The service platform sends three-dimensional scene information of a designated location area to the control terminal, including: The service platform sends the three-dimensional scene information of the changes in the designated location area to the control terminal in real time.

7. The method according to claim 6, characterized in that The smart device related information includes location change information of the smart device and / or state change information of the smart device.

8. The method according to claim 5, characterized in that The service platform receives the interaction instruction sent by the control terminal to the designated smart device, including: The service platform receives an interactive option viewing instruction sent by the control terminal to the designated smart device; The service platform forwards the interaction option feedback information from the designated smart device to the control terminal, so that the operator inputs the second input instruction in the control terminal based on the interaction option feedback information, and then the control terminal determines the interaction instruction; The service platform receives the interaction instruction sent by the control terminal to the designated smart device.

9. A method for interacting with a device, characterized in that: The method comprises: The smart device sends three-dimensional scene information of the area around itself to the service platform, wherein the three-dimensional scene information of the area around itself includes the smart device's own related information, so that the service platform forwards the three-dimensional scene information of the area around the smart device to the control terminal, and then the control terminal displays the three-dimensional scene information of the area around the smart device; The smart device receives the interaction instruction of the control terminal forwarded by the service platform, the smart device is a designated smart device determined by the control terminal receiving a first input instruction in the displayed three-dimensional scene information, and the interaction instruction is determined by the control terminal receiving a second input instruction for the designated smart device; The smart device performs an operation corresponding to the interaction instruction.

10. The method according to claim 9, characterized in that The smart device sends the three-dimensional scene information of the area around itself to the service platform, including: The smart device sends the three-dimensional scene information of the area around itself to the service platform in real time.

11. The method according to claim 10, characterized in that The smart device's own related information includes the location change information of the smart device and / or the state change information of the smart device.

12. The method according to claim 9, characterized in that The smart device receives the interaction instruction of the control terminal forwarded by the service platform, including: The smart device receives the interactive option viewing instruction of the control terminal forwarded by the service platform; The smart device sends the interactive option feedback information to the control terminal through the service platform, so that the user inputs the second input instruction in the control terminal based on the interactive option feedback information, and then the control terminal determines the interactive instruction; The smart device receives the interaction instruction sent by the control terminal through the service platform.

13. A control terminal, characterized in that: The control terminal comprises: a first processor and a first communication circuit, wherein the first processor is coupled to the first communication circuit; The first processor is used to obtain and display three-dimensional scene information of a designated location area through a service platform, wherein the three-dimensional scene information of the designated location area includes information related to smart devices existing in the designated location area; the first processor is used to receive a first input instruction in the displayed three-dimensional scene information to determine a designated smart device; the first processor is used to receive a second input instruction for the designated smart device to determine an interaction instruction, and send the interaction instruction to the designated smart device through the service platform, so that the designated smart device performs an operation corresponding to the interaction instruction.

14. A service platform, characterized in that: The service platform includes: a second processor and a second communication circuit, wherein the second processor is coupled to the second communication circuit; The second processor is used to send three-dimensional scene information of a designated location area to the control terminal so that the control terminal displays the three-dimensional scene information of the designated location area, the three-dimensional scene information of the designated pointing area includes information related to smart devices existing in the designated location area, and the smart device related information is the smart devices existing in the designated location area and sent to the service platform. The second processor is used to receive an interaction instruction sent by the control terminal to a designated smart device, the designated smart device is determined by the control terminal receiving a first input instruction in the displayed three-dimensional scene information, and the interaction instruction is determined by the control terminal receiving a second input instruction for the designated smart device. The second processor is used to forward the interaction instruction to the designated smart device so that the designated smart device performs an operation corresponding to the interaction instruction.

15. A smart device, characterized in that: The smart device comprises: a third processor and a third communication circuit, wherein the third processor is coupled to the third communication circuit; The third processor is used to send three-dimensional scene information of the area around itself to the service platform, and the three-dimensional scene information of the area around itself includes the relevant information of the smart device itself, so that the service platform forwards the three-dimensional scene information of the area around the smart device itself to the control terminal, and then the control terminal displays the three-dimensional scene information of the area around the smart device itself; the third processor is used to receive interaction instructions of the control terminal forwarded by the service platform, the smart device is a designated smart device determined by the control terminal when it receives a first input instruction in the displayed three-dimensional scene information, and the interaction instruction is determined by the control terminal when it receives a second input instruction for the designated smart device; the third processor is used to perform an operation corresponding to the interaction instruction.

Images