Equipment control method, intelligent glasses and equipment control system

Abstract

The invention relates to the technical field of man-machine interaction, and discloses an equipment control method, intelligent glasses and an equipment control system.The method is applied to the intelligent glasses in the equipment control system.The equipment control system further comprises an interaction medium associated with to-be-controlled equipment, and the interaction medium is provided with a preset pattern; the preset pattern is used for representing the to-be-controlled equipment and the corresponding operation content; the method comprises the following steps: collecting a preset pattern, identifying a pattern collection result, and determining to-be-controlled equipment corresponding to the preset pattern and operation content; generating a corresponding control instruction according to the to-be-controlled equipment and the operation content; and transmitting the control instruction to the to-be-controlled equipment, so that the to-be-controlled equipment executes the operation content based on the control instruction. Compared with the prior art, the method has the advantages that the to-be-controlled equipment and the operation content can be represented through the preset pattern on the interaction medium, so that the intelligent glasses can collect the preset image to generate the corresponding control instruction, and related control over the to-be-controlled equipment is completed.

Description

Technical Field

[0001] This application relates to the field of human-computer interaction technology, and in particular to a device control method, smart glasses, and device control system. Background Technology

[0002] In recent years, smart home devices (such as smart air conditioners and smart curtains) have become increasingly popular, bringing many conveniences to people's lives.

[0003] Existing smart home devices generally have external interfaces that support control by external mobile devices (such as smartphones), thus eliminating the need for traditional remote controls. However, with the rapid development of smart glasses (such as Artificial Intelligence (AI) glasses), they are gradually entering everyday life. Therefore, how to enable smart glasses to control smart home devices is a pressing technical problem that needs to be solved. Summary of the Invention

[0004] The main objective of this application is to provide a device control method, smart glasses, and a device control system, aiming to solve the existing technical problems of how to enable smart glasses to control smart home devices.

[0005] To achieve the above objectives, this application provides a device control method, which is applied to smart glasses in a device control system. The device control system further includes an interactive medium associated with the device to be controlled. The interactive medium is provided with a preset pattern, which is used to represent the device to be controlled and the corresponding operation content. The method includes: The preset pattern is acquired, and the pattern acquisition result is identified to determine the device to be controlled and the operation content corresponding to the preset pattern. Generate corresponding control commands based on the device to be controlled and the operation content; The control command is transmitted to the device to be controlled, so that the device to be controlled executes the operation based on the control command.

[0006] In one embodiment, the step of identifying the pattern acquisition result and determining the device to be controlled corresponding to the preset pattern and the operation content includes: Feature extraction is performed on the pattern acquisition results to obtain the feature information corresponding to the preset pattern; The system traverses the preset feature information database based on the feature information, and determines the device to be controlled and the operation content corresponding to the preset pattern based on the traversal results.

[0007] In one embodiment, before the step of acquiring the preset pattern, the method further includes: Feature extraction is performed on the preset pattern to determine the feature information corresponding to the preset pattern; Obtain the device to be controlled selected by the user and the operation content, and associate the device to be controlled and the operation content with the feature information; The association results are stored in a preset feature information database.

[0008] In one embodiment, the step of acquiring the preset pattern, identifying the pattern acquisition result, and determining the device to be controlled corresponding to the preset pattern and the operation content includes: The preset pattern is captured to obtain the pattern capture result; Collect the user's current actions and determine whether there is a control requirement based on the current actions; When the control requirement exists, the pattern acquisition result is identified to determine the device to be controlled and the operation content corresponding to the preset pattern.

[0009] In one embodiment, at least two preset patterns are provided on one of the interactive media, and each preset interactive pattern is used to represent different devices to be controlled and the corresponding operation content; The step of identifying the pattern acquisition result and determining the device to be controlled and the operation content corresponding to the preset pattern when the control requirement exists includes: In the presence of the aforementioned control requirement, a corresponding target preset interaction pattern is determined based on the current action; The target preset interactive pattern in the pattern acquisition result is identified to determine the device to be controlled and the operation content corresponding to the target preset interactive pattern.

[0010] In one embodiment, the preset pattern is used to represent at least two of the devices to be controlled and the corresponding operation content; The step of identifying the pattern acquisition result and determining the device to be controlled and the operation content corresponding to the preset pattern when the control requirement exists includes: When the control requirement exists, the pattern acquisition result is identified to obtain each of the devices to be controlled corresponding to the preset pattern and the corresponding operation content; The device to be controlled and the operation content corresponding to the preset pattern are determined based on the number of times the current action is executed.

[0011] In one embodiment, the preset pattern is used to represent different devices to be controlled at different locations and the corresponding operation content; The steps of acquiring the preset pattern, identifying the pattern acquisition results, and determining the device to be controlled and the operation content corresponding to the preset pattern include: Get current location; The preset pattern is acquired, and the acquisition result is identified. Based on the current location, the recognition results are filtered to determine the device to be controlled and the operation content corresponding to the preset pattern at the current location.

[0012] In one embodiment, after the step of transmitting the control command to the device to be controlled, so that the device to be controlled performs the operation content based on the control command, the method further includes: If the preset pattern is captured again, the device to be controlled corresponding to the preset pattern is determined; Collect the user's current gesture and determine the corresponding adjustment content based on the current gesture; Generate corresponding adjustment instructions based on the device to be controlled and the adjustment content; The adjustment command is transmitted to the device to be controlled, so that the device to be controlled executes the adjustment content based on the adjustment command.

[0013] In addition, to achieve the above objectives, this application also proposes a smart glasses, which includes: a memory, a processor, and a device control program stored in the memory and executable on the processor, wherein the device control program, when executed by the processor, implements the steps of the device control method described above.

[0014] In addition, to achieve the above objectives, this application also proposes a device control system, which includes: an interactive medium and smart glasses as described above; The interactive medium is provided with a preset pattern, which is used to represent the device to be controlled and the corresponding operation content.

[0015] This application provides a device control method, smart glasses, and a device control system. The method is applied to smart glasses in a device control system. The device control system further includes an interactive medium associated with a device to be controlled. The interactive medium has a preset pattern, which represents the device to be controlled and the corresponding operation content. The method includes: acquiring the preset pattern and identifying the pattern acquisition result to determine the device to be controlled and the operation content corresponding to the preset pattern; generating a corresponding control command based on the device to be controlled and the operation content; and transmitting the control command to the device to be controlled so that the device to be controlled executes the operation content based on the control command.

[0016] This application includes an interactive medium for interacting with smart glasses. The interactive medium displays a preset pattern, which represents the device to be controlled and the corresponding operation. In practical use, the preset pattern is first captured and the captured result is identified to determine the device to be controlled and the operation corresponding to the preset pattern. Then, a corresponding control command is generated based on the device to be controlled and the operation, and this control command is sent to the device to be controlled. Upon receiving the control command, the device to be controlled can execute the corresponding operation, thereby completing the control of the device. Compared to existing methods, this application uses a preset pattern on the interactive medium to represent the device to be controlled and the operation, allowing the smart glasses to capture the preset image and generate corresponding control commands to complete the control of the device. Attached Figure Description

[0017] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0018] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 This is a schematic diagram of the smart glasses structure of the hardware operating environment involved in the embodiments of this application; Figure 2 This is a flowchart illustrating the first embodiment of the device control method of this application; Figure 3 This is a flowchart illustrating the second embodiment of the device control method of this application; Figure 4 This is a flowchart illustrating the third embodiment of the device control method of this application; Figure 5 This is a structural block diagram of the first embodiment of the device control apparatus of this application.

[0020] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0021] It should be understood that the specific embodiments described herein are merely illustrative of the technical solutions of this application and are not intended to limit this application.

[0022] Reference Figure 1 , Figure 1 This is a schematic diagram of the smart glasses structure of the hardware operating environment involved in the embodiments of this application.

[0023] like Figure 1 As shown, the smart glasses may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. The communication bus 1002 is used to enable communication between these components. The user interface 1003 may be connected to a display screen. Optionally, the user interface 1003 may include a standard wired interface or a wireless interface; in this application, the wired interface of the user interface 1003 may be a USB interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wireless-Fidelity (Wi-Fi) interface). The memory 1005 may be high-speed random access memory (RAM) or non-volatile memory (NVM), such as a disk storage device. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0024] Those skilled in the art will understand that Figure 1 The structure shown does not constitute a limitation on smart glasses and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0025] like Figure 1 As shown, the memory 1005, which is identified as a computer storage medium, may include an operating system, a network communication module, a user interface module, and a device control program.

[0026] exist Figure 1In the smart glasses shown, the network interface 1004 is mainly used to connect to the backend server and communicate data with the backend server; the user interface 1003 is mainly used to connect to the user device; the smart glasses call the device control program stored in the memory 1005 through the processor 1001 and execute the steps of the device control method provided in the embodiments of this application.

[0027] It should be noted that in recent years, smart home devices (such as smart air conditioners and smart curtains) have become increasingly popular, bringing many conveniences to people's lives.

[0028] Existing smart home devices generally have external interfaces that support control by external mobile devices (such as smartphones), thus eliminating the need for traditional remote controls. However, with the rapid development of smart glasses (such as Artificial Intelligence (AI) glasses), they are gradually entering everyday life. Therefore, how to enable smart glasses to control smart home devices is a pressing technical problem that needs to be solved.

[0029] Therefore, to address the aforementioned shortcomings, this embodiment provides a device control method. This embodiment includes an interactive medium for interacting with smart glasses. The interactive medium displays a preset pattern, which represents the device to be controlled and the corresponding operation content. In actual use, the preset pattern is first captured, and the captured pattern is identified to determine the device to be controlled and the operation content corresponding to the preset pattern. Then, a corresponding control command is generated based on the device to be controlled and the operation content, and this control command is sent to the device to be controlled. Upon receiving the control command, the device to be controlled can execute the corresponding operation content based on the control command, thereby completing the control of the device to be controlled. Compared to existing methods, this embodiment can represent the device to be controlled and the operation content through a preset pattern on the interactive medium. The smart glasses can then capture the preset image to generate the corresponding control command, thereby completing the relevant control of the device to be controlled.

[0030] For ease of understanding, the following is combined with Figures 2 to 5 The device control method provided in the embodiments of this application will be described in detail.

[0031] Reference Figure 2 , Figure 2 This is a flowchart illustrating the first embodiment of the device control method of this application. The first embodiment of the device control method of this application is presented as follows: Figure 2 As shown, in this embodiment, the specific method includes: Step S10: Collect the preset pattern, identify the pattern collection result, and determine the device to be controlled and the operation content corresponding to the preset pattern.

[0032] It should be noted that the method in this embodiment can be applied to smart glasses in a device control system. The device control system can be any system used to control the device to be controlled, which can be any electronic device, such as smart home devices (air conditioners, televisions, computers, etc.), or other devices. This embodiment does not limit this. For ease of understanding, this embodiment and subsequent embodiments will describe the control of smart home devices.

[0033] It should also be noted that the aforementioned smart glasses can be any glasses with data processing, program execution, and device control functions, such as AI glasses, augmented reality (AR) glasses, etc., and this embodiment does not impose any limitations on them. Of course, for ease of understanding, this embodiment and subsequent embodiments will all use AI glasses for illustration.

[0034] It is understood that, in order to achieve interaction, the device control system in this embodiment also includes an interaction medium associated with the device to be controlled. The interaction medium is provided with a preset pattern, which is used to represent the device to be controlled and the corresponding operation content.

[0035] It should be noted that this embodiment may include an interactive medium, which can be any medium carrying a preset pattern, such as a card, picture card, etc. Specifically, it can be a paper card with the aforementioned preset pattern set on it. The preset pattern can be any pattern with features used to represent the device to be controlled and the operation content, such as lines (circles, rectangles, etc.), colors, diagrams, text, QR codes, etc. This embodiment does not limit this, and different styles, such as anime style, can also be set to meet the needs of different users.

[0036] In one implementation, the interactive medium can be a card, and to hold the card, it can be magnetically attached to the surface of the device for easy user control. Alternatively, it can be adhesive, pasted onto a wall or other surface. Other placement methods are also possible, and this embodiment does not limit the scope of the application.

[0037] It should also be noted that the above-mentioned operation content can be any operation content that the device to be controlled can perform, such as turning on or off. Of course, it can include operation content unique to certain devices to be controlled. For example, for air conditioners, the operation content can also include setting the cooling temperature to 24 degrees and vertical air swing. The specific settings can be customized according to the user's actual situation. This embodiment does not impose any restrictions on this.

[0038] It should be understood that, in order to collect preset patterns on the interactive medium, the smart glasses described above in this embodiment may also be equipped with a collection device. The collection device can be any device that performs image collection, such as a camera, etc., and this embodiment does not limit it.

[0039] In actual use, when a user wears the smart glasses, if the user needs to control a certain device, the camera of the smart glasses can be pointed towards the interactive medium corresponding to the device to be controlled. The camera can capture the preset pattern on the interactive medium, obtain the pattern capture result, and perform image recognition on the pattern capture result. Thus, the device to be controlled and the corresponding operation content can be determined based on the recognition result.

[0040] Step S20: Generate corresponding control instructions based on the device to be controlled and the operation content.

[0041] It should be noted that the above control commands can be commands that control the device to be controlled to perform corresponding operations.

[0042] In this embodiment, once the smart glasses determine the device to be controlled and the corresponding operation content, they can generate corresponding control commands based on the device to be controlled and the operation content.

[0043] Step S30: Transmit the control command to the device to be controlled, so that the device to be controlled executes the operation content based on the control command.

[0044] It should also be noted that in this embodiment, the smart glasses can be connected to various devices to be controlled, such as via Bluetooth or Wi-Fi, and this embodiment does not impose any restrictions on this.

[0045] In practical use, once the smart glasses receive a control command, they can send the command to the device to be controlled. Upon receiving the command, the device can parse it, extract the operation content based on the parsing results, and then execute the operation.

[0046] For example, a card might have a preset image of a computer as its design. The device to be controlled represented by this image could be the user's computer, and the corresponding operation could be turning it on. When the user wears smart glasses, if they need to turn on their computer, they can point the camera at the card. The smart glasses can capture and recognize the preset image, thus identifying the device to be controlled as a computer and the operation as turning it on. The smart glasses can then generate a control command based on the device and the operation and transmit it to the computer. Upon receiving the control command, the computer will automatically turn on, thus realizing the control function between the smart glasses and the device.

[0047] Therefore, since this embodiment can represent the device to be controlled and the operation content through a preset pattern on the interactive medium, the smart glasses can collect the preset image to generate corresponding control commands and thus complete the relevant control of the device to be controlled.

[0048] Furthermore, since this embodiment controls the device to perform corresponding operations through the aforementioned interactive medium, users no longer need to search for a remote control, thus improving the user experience. Moreover, because the interactive medium in this embodiment can represent specific operation content, users no longer need to select the corresponding operation interface of the device to be controlled and then manually input the relevant control content; instead, control is completed in one step, simplifying the control process and further enhancing the user experience.

[0049] Secondly, since the interactive medium can be placed in any location in this embodiment, its position can be flexibly changed even after the layout of the house changes, thus improving flexibility.

[0050] Furthermore, considering that continuous image acquisition by the camera may lead to high power consumption, in this embodiment, the step of acquiring the preset pattern includes: If the system detects that the device is currently wearing the device, the preset pattern is captured.

[0051] It should be noted that the aforementioned current wearing state can refer to whether the smart glasses are currently being worn by the user. In this embodiment, the smart glasses may also be equipped with a detection device for collecting the current wearing state, such as a distance sensor. This detection device can then detect the current wearing state, and if the glasses are in the current wearing state, a camera can be used to capture images and obtain pattern acquisition results.

[0052] Furthermore, in order to determine the corresponding controllable device and operation content based on different preset patterns, in this embodiment, the step of identifying the pattern acquisition results and determining the controllable device and operation content corresponding to the preset pattern includes: Step S121: Extract features from the pattern acquisition results to obtain feature information corresponding to the preset pattern; Step S122: Traverse the preset feature information database according to the feature information, and determine the device to be controlled and the operation content corresponding to the preset pattern according to the traversal result.

[0053] Understandably, different preset patterns can carry different feature information, such as different feature information corresponding to different colors, different feature information corresponding to different lines, etc. Therefore, in this embodiment, after the preset pattern is acquired, feature extraction can be performed on the pattern acquisition result to obtain the feature information corresponding to the preset pattern.

[0054] It is also understood that the aforementioned preset feature information database can be a database storing the controllable devices and operation content corresponding to each feature information, which can be obtained in advance through input. In actual use, after the smart glasses obtain the aforementioned feature information, they can traverse the preset feature information database to query the controllable devices and operation content corresponding to the feature information, which are then used as the controllable devices and operation content corresponding to the collected preset pattern.

[0055] Furthermore, to support user-defined controllable devices and operation content, in this embodiment, before the step of acquiring the preset pattern, the following step is also included: Step S01: Extract features from the preset pattern to determine the feature information corresponding to the preset pattern; Step S02: Obtain the device to be controlled and the operation content selected by the user, and associate the device to be controlled and the operation content with the feature information; Step S03: Store the association results in a preset feature information database.

[0056] It should be understood that before using this function, users can wear the smart glasses and collect preset patterns in the interactive medium, thereby extracting features from the collected patterns and obtaining the feature information carried by the preset patterns.

[0057] Next, the smart glasses can receive the user's selected device to be controlled and the operation content. For example, the smart glasses can display a list of devices that support this function (e.g., a list of devices including air conditioners, televisions, computers, etc.), and then, based on the user's selection of the corresponding device to be controlled, can display the relevant operations available for that device (e.g., after the user selects an air conditioner, the relevant operations available for the air conditioner can be displayed). The user can then select the desired operation to be associated with the device.

[0058] After obtaining the user-selected device to be controlled and the operation content, the system can associate the device to be controlled and the operation content with the feature information of the preset pattern, and store the association result in the preset feature information database. Thus, in subsequent use, the corresponding operation content can be queried from the preset feature information database and executed, realizing user-customized control.

[0059] This embodiment includes an interactive medium for interacting with smart glasses. This medium displays a preset pattern, which represents the device to be controlled and the corresponding operation. In actual use, the preset pattern is first captured and the captured result is identified to determine the device to be controlled and the operation corresponding to the preset pattern. Then, a corresponding control command is generated based on the device to be controlled and the operation, and this control command is sent to the device to be controlled. Upon receiving the control command, the device to be controlled can execute the corresponding operation, thus completing the control of the device. Compared to existing methods, this embodiment uses a preset pattern on the interactive medium to represent the device to be controlled and the operation, allowing the smart glasses to capture the preset image and generate corresponding control commands to complete the control of the device.

[0060] Reference Figure 3 , Figure 3 This is a flowchart illustrating the second embodiment of the device control method of this application. Based on the first embodiment described above, a second embodiment of the device control method of this application is proposed.

[0061] Furthermore, considering that when a user wears smart glasses, if the user has no need for control but merely browses the interactive medium, or if the interactive medium happens to be within their field of vision, the smart glasses may misidentify the interface. Because in this embodiment, if... Figure 3 As shown, the steps of acquiring the preset pattern, identifying the pattern acquisition results, and determining the device to be controlled and the operation content corresponding to the preset pattern include: Step S11: Collect the preset pattern to obtain the pattern collection result; Step S12: Collect the user's current action and determine whether there is a control requirement based on the current action.

[0062] It should be noted that the aforementioned current action can be the action that the user is currently performing, which may include, but is not limited to, hand movements, head movements, eye movements, etc. This embodiment does not impose any restrictions on this.

[0063] It should also be noted that some actions can indicate a user's control needs. For example, a user pointing at the interactive medium, nodding, or looking at the interactive medium can all indicate a user's need for control. These user actions can be obtained by setting up relevant data acquisition components. For example, hand movements can be acquired using the aforementioned camera, or through a smart bracelet worn on the user's wrist or a smart ring on their finger; head movements can be acquired using an accelerometer sensor installed in the smart glasses; and eye movements can be acquired using a gaze acquisition device installed on the smart glasses. Of course, other acquisition methods can also be used, and this embodiment does not limit this.

[0064] Therefore, in this embodiment, after the smart glasses collect the preset pattern and obtain the pattern collection result, they can collect the user's current action and determine whether the user has a control need based on the current action. Specifically, it can determine whether the current action is a preset control action, which can be an action indicating that the user has a control need, such as touching the interactive medium with a finger, pointing at the interactive medium with a finger, nodding, or looking at the interactive medium with the eyes. This embodiment uses touching the interactive medium with a finger for illustration.

[0065] Step S13: If the control requirement exists, identify the pattern acquisition result to determine the device to be controlled and the operation content corresponding to the preset pattern.

[0066] After obtaining the pattern capture results, the camera can then capture images of the interactive medium to determine if a user's finger is present and whether that finger is touching the medium. If the finger is not touching the medium, it indicates that the user has no control needs, so the smart glasses will not recognize the pattern capture results and will not generate any subsequent control commands. If the finger touches the medium, it indicates that the user has control needs, so the smart glasses can recognize the pattern capture results and determine the corresponding device to be controlled and the operation content.

[0067] Furthermore, to improve the accuracy of control request identification, this embodiment can detect multiple current actions, and determine the existence of a control request only when at least two current actions are preset control actions. For example, a control request is determined only when the user's finger touches the interactive medium and the user looks at the interactive medium simultaneously. Of course, the specific number of current actions compared with preset control actions can be set according to the actual situation, and this embodiment does not impose any restrictions on this.

[0068] Furthermore, in order to improve the usability and convenience of the interactive medium, in this embodiment, at least two preset patterns are provided on one of the interactive mediums, and each preset interactive pattern is used to represent different devices to be controlled and the corresponding operation content.

[0069] It should be noted that in this embodiment, multiple preset patterns can be set on an interactive medium, and each preset interactive pattern can be used to represent different devices to be controlled and operation content. For example, a card can be set with cartoon patterns of a first lamp and a second lamp. The cartoon pattern of the first lamp can be set on the left side of the card, and the cartoon pattern of the second lamp can be set on the right side of the card.

[0070] The step of identifying the pattern acquisition result and determining the device to be controlled and the operation content corresponding to the preset pattern when the control requirement exists includes: Step S131: If the control requirement exists, determine the corresponding target preset interaction pattern based on the current action.

[0071] It should be noted that the aforementioned target preset interaction pattern can be the preset interaction pattern corresponding to the device to be controlled that the user expects to control.

[0072] In practical use, when the smart glasses determine that the user has a control need, the corresponding preset interaction pattern can be used as the target preset interaction pattern based on the user's current action.

[0073] For example, when the smart glasses determine that the user's finger touches the interactive medium, they can determine which preset pattern in the interactive medium the user's finger touches based on the user's current action, and use the touched preset pattern as the target preset interactive pattern. For example, when smart glasses determine that the user's eyes are focused on the interactive medium, they can determine which preset pattern in the interactive medium the user's eyes are focused on based on the user's current action, and use that preset pattern as the target preset interactive pattern.

[0074] Step S132: Identify the target preset interactive pattern in the pattern acquisition result, and determine the device to be controlled and the operation content corresponding to the target preset interactive pattern.

[0075] It should be noted that in this embodiment, the feature information of different preset interactive patterns can be set in advance to correspond to the devices to be controlled and the operation content, and then stored in the preset feature database after association.

[0076] In practical use, after determining the target preset interaction pattern, the smart glasses can identify the portion of the image acquisition result containing the target preset interaction pattern, extract the corresponding feature information, and traverse the preset feature database to obtain the device to be controlled corresponding to the target preset interaction pattern and the corresponding operation content. After generating the corresponding control command, the smart glasses can send the control command to the device to be controlled corresponding to the target preset interaction pattern, thereby enabling the device to perform the corresponding operation content.

[0077] Continuing with the example above, when a user's finger touches the cartoon image of the first lamp on the left side of the card, the smart glasses, after determining that the cartoon image of the first lamp on the left side is the target preset interaction pattern based on the current action, can recognize this target preset interaction pattern, obtain the corresponding device to be controlled as the first lamp, and the corresponding operation as turning on the light. Then, the corresponding control command can be generated and sent to the first lamp, which will then automatically turn on the light.

[0078] Furthermore, considering the limited number of interactive media, and the fact that some users generally follow certain patterns in controlling certain devices—for example, after get off work, users typically turn on the lights first, then close the curtains, and then turn on the air conditioner—all of these actions can be accomplished through a single interactive media. Specifically, in this embodiment, the preset pattern is used to represent at least two of the devices to be controlled and the corresponding operation content.

[0079] In this embodiment, a preset pattern can be set on the interactive medium. However, it should be noted that the preset pattern can represent at least two different devices to be controlled and the corresponding operation content.

[0080] The step of identifying the pattern acquisition result and determining the device to be controlled and the operation content corresponding to the preset pattern when the control requirement exists includes: Step S133: When the control requirement exists, the pattern acquisition result is identified to obtain each of the devices to be controlled corresponding to the preset pattern and the corresponding operation content; Step S134: Determine the device to be controlled and the operation content corresponding to the preset pattern based on the number of times the current action is executed.

[0081] It should be noted that the number of times the current action is executed can be the number of times the user has performed the current action. For example, the number of times the user touches the interactive medium, etc. This embodiment does not limit this.

[0082] It should also be noted that, before use, this embodiment can pre-associate multiple devices to be controlled and their corresponding operation content associated with the preset interactive pattern, and can customize the sorting of each device to be controlled and its corresponding operation content according to the number of executions.

[0083] In practical use, when the smart glasses determine that the user has a control need, they can first identify the pattern acquisition results. Since in this embodiment, a preset pattern can be associated with multiple different devices to be controlled and their corresponding operation content, the identification process can then obtain the devices to be controlled associated with the preset pattern and their corresponding operation content.

[0084] The smart glasses then continuously collect data to determine the number of times the user has performed the current action. Based on this number, they determine the corresponding device to be controlled and the operation content. After generating the corresponding control command, it is sent to the corresponding device to be controlled.

[0085] For example, when the smart glasses determine that the user has a control need, they can first identify the pattern captured results. After identification, they can obtain the devices to be controlled associated with the preset pattern and the corresponding operation content. For example, after identifying a cartoon pattern of a family, the associated devices to be controlled and the corresponding operation content can be: turn on the living room light, close the living room curtains, and turn on the air conditioner.

[0086] After obtaining the associated device to be controlled and the corresponding operation content, the smart glasses can continue to collect the number of times the user touches the interactive medium. For example, if the user touches it for the first time, the smart glasses will generate a control command to turn on the living room light and transmit it to the living room light, thereby controlling the living room light to turn on automatically. If the user touches it again, the smart glasses will generate a control command to close the living room curtains and transmit it to the living room curtains, thereby controlling the living room curtains to close automatically. If the user touches it again, the smart glasses will generate a control command to turn on the air conditioner and transmit it to the air conditioner, thereby controlling the air conditioner to turn on automatically.

[0087] Reference Figure 4 , Figure 4 This is a flowchart illustrating the third embodiment of the device control method of this application. Based on the above embodiments, the third embodiment of the device control method of this application is proposed.

[0088] Furthermore, considering the limited variety of preset patterns and to facilitate user understanding and memorization, the number of preset pattern types should generally not be too large. However, there may be devices of the same type in different locations that need to be controlled. Therefore, to facilitate user control, such as... Figure 4 As shown, in this embodiment, the preset pattern is used to represent different devices to be controlled at different locations and the corresponding operation content.

[0089] It should be noted that in this embodiment, the same preset pattern can be set for different interactive media. For example, different cards can be set with a cartoon image of a computer, which facilitates the subsequent control of the computer in different positions.

[0090] The steps of acquiring the preset pattern, identifying the pattern acquisition results, and determining the device to be controlled and the operation content corresponding to the preset pattern include: Step S14: Obtain the current location; Step S15: Collect the preset pattern and identify the pattern collection result; Step S16: Based on the current location, filter the recognition results to determine the device to be controlled and the operation content corresponding to the preset pattern at the current location.

[0091] It should be noted that the aforementioned current location can refer to the current location of the smart glasses, or it can be understood as the location of the user after wearing the smart glasses. In this embodiment, the smart glasses may also be equipped with a positioning component, such as a Global Positioning System (GPS) chip. This positioning component can be used to obtain the current location of the smart glasses.

[0092] Understandably, in this embodiment, the corresponding controllable devices and operation contents for different locations can be pre-set for the preset pattern. Then, in actual use, the smart glasses can obtain the current location, collect the preset pattern, and recognize the pattern collection results. This allows them to obtain the controllable devices and corresponding operation contents associated with the preset pattern at each location, as the recognition results. Next, the recognition results can be filtered according to the current location to obtain the controllable devices and operation contents corresponding to the preset pattern at the current location, and corresponding control commands can be generated and sent to the controllable devices.

[0093] For example, a card with a cartoon image of a computer can be set up. When the user is at home, the corresponding device to be controlled is the user's home computer, and the corresponding operation is to turn on the computer; when the user is at work, the corresponding device to be controlled is the user's work computer, and the corresponding operation is to turn on the computer.

[0094] In practical use, the smart glasses first acquire the user's current location and then identify the pattern corresponding to the cartoon image on the computer screen. This identification determines the device to be controlled and the operation to be performed, which could include turning on the home computer or the work computer. The identification results are then filtered based on the current location. If the user is at home, the identification indicates that the device to be controlled and the operation to be performed corresponds to turning on the home computer, and a corresponding control command is generated and sent to the home computer to power it on. If the user is at work, the identification indicates that the device to be controlled and the operation to be performed corresponds to turning on the work computer, and a corresponding control command is generated and sent to the work computer to power it on.

[0095] Furthermore, considering that a preset pattern only supports one operation on a specific device to be controlled, and the user may need to adjust the device later. For example, a card with a cartoon image of an air conditioner corresponds to an air conditioner as the device to be controlled, and the corresponding operation is to turn it on. After the smart glasses scan and send the control command, the air conditioner is turned on. However, when the user needs to adjust parameters such as the temperature of the air conditioner, they still need to enter the air conditioner's adjustment interface, making the operation cumbersome. Therefore, in this embodiment, after the step of transmitting the control command to the device to be controlled so that the device to be controlled can execute the operation based on the control command, the method further includes: Step S40: If the preset pattern is acquired again, determine the device to be controlled corresponding to the preset pattern; Step S50: Collect the user's current gesture and determine the corresponding adjustment content based on the current gesture; Step S60: Generate corresponding adjustment instructions based on the device to be controlled and the adjustment content; Step S70: Transmit the adjustment command to the device to be controlled, so that the device to be controlled executes the adjustment content based on the adjustment command.

[0096] It should be noted that the aforementioned current gesture can be the gesture currently being made by the user. The aforementioned adjustments can be those that the user needs to make after the controlled device has completed its operation.

[0097] Understandably, in this embodiment, different gestures can be set to correspond to different adjustment content. For example, a gesture of waving the palm upwards can be set to indicate that the air conditioner temperature is increased, and a gesture of waving the palm downwards can be set to indicate that the air conditioner temperature is decreased.

[0098] In actual use, when the smart glasses capture the preset pattern again, they can first determine the device to be controlled corresponding to the preset pattern, then capture the user's current gesture as the current gesture, and determine the corresponding adjustment content based on the current gesture. Based on the device to be controlled and the adjustment content, they can generate a corresponding adjustment command and send it to the device to be controlled, so that the device to be controlled can adjust according to the adjustment content.

[0099] For example, when a user turns on the air conditioner, if the user needs to lower the temperature, the smart glasses can collect the card with the cartoon image of the air conditioner again. After the smart glasses collect the cartoon image of the air conditioner again, they can determine that the corresponding device to be controlled is the air conditioner.

[0100] Next, the user can make a downward hand gesture. The smart glasses can capture this gesture and determine that the user needs to lower the temperature, thus adjusting the temperature accordingly. The smart glasses can then generate a corresponding adjustment command based on the device to be controlled and the desired adjustment, and send it to the device. Upon receiving the adjustment command, the air conditioner can then lower the temperature.

[0101] Furthermore, embodiments of this application also propose a storage medium storing a device control program, which, when executed by a processor, implements the steps of the device control method described above.

[0102] In addition, refer to Figure 5 , Figure 5 This is a structural block diagram of the first embodiment of the device control apparatus of this application; as shown below. Figure 5 As shown in the embodiments of this application, a device control apparatus is also proposed, which includes: The pattern acquisition module 501 is used to acquire the preset pattern, identify the pattern acquisition result, and determine the device to be controlled and the operation content corresponding to the preset pattern. The preset pattern is provided on the interactive medium, and the preset pattern is used to represent the device to be controlled and the corresponding operation content. Instruction generation module 502 is used to generate corresponding control instructions based on the device to be controlled and the operation content; The instruction sending module 503 is used to transmit the control instruction to the device to be controlled, so that the device to be controlled can execute the operation content based on the control instruction.

[0103] This embodiment includes an interactive medium for interacting with smart glasses. This medium displays a preset pattern, which represents the device to be controlled and the corresponding operation. In actual use, the preset pattern is first captured and the captured result is identified to determine the device to be controlled and the operation corresponding to the preset pattern. Then, a corresponding control command is generated based on the device to be controlled and the operation, and this control command is sent to the device to be controlled. Upon receiving the control command, the device to be controlled can execute the corresponding operation, thus completing the control of the device. Compared to existing methods, this embodiment uses a preset pattern on the interactive medium to represent the device to be controlled and the operation, allowing the smart glasses to capture the preset image and generate corresponding control commands to complete the control of the device.

[0104] As one implementation, the pattern acquisition module 501 is also used to extract features from the pattern acquisition results to obtain feature information corresponding to the preset pattern; to traverse the preset feature information database according to the feature information, and to determine the device to be controlled and the operation content corresponding to the preset pattern according to the traversal results.

[0105] In one implementation, the pattern acquisition module 501 is further configured to extract features from the preset pattern, determine the feature information corresponding to the preset pattern; acquire the device to be controlled and the operation content selected by the user, and associate the device to be controlled and the operation content with the feature information; and store the association result in a preset feature information database.

[0106] Based on the first embodiment of the device control apparatus described in this application, a second embodiment of the device control apparatus of this application is proposed.

[0107] In this embodiment, the pattern acquisition module 501 is further configured to acquire the preset pattern and obtain the pattern acquisition result; acquire the user's current action and determine whether there is a control requirement based on the current action; if there is a control requirement, identify the pattern acquisition result and determine the device to be controlled and the operation content corresponding to the preset pattern.

[0108] As one implementation, at least two preset patterns are provided on one of the interactive media, and each preset interactive pattern is used to represent different devices to be controlled and the corresponding operation content; The pattern acquisition module 501 is further configured to, when the control requirement exists, determine the corresponding target preset interaction pattern based on the current action; identify the target preset interaction pattern in the pattern acquisition result, and determine the device to be controlled and the operation content corresponding to the target preset interaction pattern.

[0109] In one implementation, the preset pattern is used to represent at least two of the devices to be controlled and the corresponding operation content; The pattern acquisition module 501 is further configured to, when the control requirement exists, identify the pattern acquisition result to obtain each of the devices to be controlled corresponding to the preset pattern and the corresponding operation content; and determine the devices to be controlled and the operation content corresponding to the preset pattern based on the number of times the current action is executed.

[0110] Based on the above embodiments of the device control apparatus of this application, a third embodiment of the device control apparatus of this application is proposed.

[0111] In this embodiment, the preset pattern is used to represent different devices to be controlled at different locations and the corresponding operation content; The pattern acquisition module 501 is also used to obtain the current location; acquire the preset pattern and identify the pattern acquisition result; filter the identification result based on the current location to determine the device to be controlled and the operation content corresponding to the preset pattern at the current location.

[0112] In one implementation, the instruction sending module 503 is further configured to: determine the device to be controlled corresponding to the preset pattern when the preset pattern is acquired again; acquire the user's current gesture and determine the corresponding adjustment content based on the current gesture; generate a corresponding adjustment instruction based on the device to be controlled and the adjustment content; and transmit the adjustment instruction to the device to be controlled so that the device to be controlled executes the adjustment content based on the adjustment instruction.

[0113] Other embodiments or specific implementations of the device control apparatus described in this application can be found in the above-described method embodiments, and will not be repeated here. Furthermore, it possesses all the beneficial effects brought about in the above-described method embodiments, which will not be elaborated upon in this embodiment.

[0114] In addition, to achieve the above objectives, embodiments of this application also provide a device control system, which includes an interactive medium and smart glasses as described above; The interactive medium is provided with a preset pattern, which is used to represent the device to be controlled and the corresponding operation content.

[0115] Other embodiments or specific implementations of the equipment control system described in this application can be found in the above-described method embodiments, and will not be repeated here. Furthermore, it possesses all the beneficial effects brought about in the above-described method embodiments, which will not be elaborated upon in this embodiment.

[0116] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0117] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0118] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as a read-only memory image (ROM) / random access memory (RAM), magnetic disk, optical disk), and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0119] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

Claims

1. A device control method, characterized in that, The method is applied to smart glasses in a device control system. The device control system also includes an interactive medium associated with the device to be controlled. The interactive medium has a preset pattern, which is used to represent the device to be controlled and the corresponding operation content. The method includes: The preset pattern is acquired, and the pattern acquisition result is identified to determine the device to be controlled and the operation content corresponding to the preset pattern. Generate corresponding control commands based on the device to be controlled and the operation content; The control command is transmitted to the device to be controlled, so that the device to be controlled executes the operation based on the control command.

2. The equipment control method as described in claim 1, characterized in that, The step of identifying the pattern acquisition results and determining the device to be controlled and the operation content corresponding to the preset pattern includes: Feature extraction is performed on the pattern acquisition results to obtain the feature information corresponding to the preset pattern; The system traverses the preset feature information database based on the feature information, and determines the device to be controlled and the operation content corresponding to the preset pattern based on the traversal results.

3. The equipment control method as described in claim 2, characterized in that, Before the step of acquiring the preset pattern, the method further includes: Feature extraction is performed on the preset pattern to determine the feature information corresponding to the preset pattern; Obtain the device to be controlled selected by the user and the operation content, and associate the device to be controlled and the operation content with the feature information; The association results are stored in a preset feature information database.

4. The equipment control method as described in claim 1, characterized in that, The steps of acquiring the preset pattern, identifying the pattern acquisition results, and determining the device to be controlled and the operation content corresponding to the preset pattern include: The preset pattern is captured to obtain the pattern capture result; Collect the user's current actions and determine whether there is a control requirement based on the current actions; When the control requirement exists, the pattern acquisition result is identified to determine the device to be controlled and the operation content corresponding to the preset pattern.

5. The equipment control method as described in claim 4, characterized in that, At least two preset patterns are provided on one of the interactive media, and each preset interactive pattern is used to represent different devices to be controlled and the corresponding operation content; The step of identifying the pattern acquisition result and determining the device to be controlled and the operation content corresponding to the preset pattern when the control requirement exists includes: In the presence of the aforementioned control requirement, a corresponding target preset interaction pattern is determined based on the current action; The target preset interactive pattern in the pattern acquisition result is identified to determine the device to be controlled and the operation content corresponding to the target preset interactive pattern.

6. The equipment control method as described in claim 4, characterized in that, The preset pattern is used to represent at least two of the devices to be controlled and the corresponding operation content; The step of identifying the pattern acquisition result and determining the device to be controlled and the operation content corresponding to the preset pattern when the control requirement exists includes: When the control requirement exists, the pattern acquisition result is identified to obtain each of the devices to be controlled corresponding to the preset pattern and the corresponding operation content; The device to be controlled and the operation content corresponding to the preset pattern are determined based on the number of times the current action is executed.

7. The equipment control method as described in claim 1, characterized in that, The preset pattern is used to represent the different devices to be controlled in different locations and the corresponding operation content; The steps of acquiring the preset pattern, identifying the pattern acquisition results, and determining the device to be controlled and the operation content corresponding to the preset pattern include: Get current location; The preset pattern is acquired, and the acquisition result is identified. Based on the current location, the recognition results are filtered to determine the device to be controlled and the operation content corresponding to the preset pattern at the current location.

8. The equipment control method as described in claim 1, characterized in that, After the step of transmitting the control command to the device to be controlled, so that the device to be controlled executes the operation content based on the control command, the method further includes: If the preset pattern is captured again, the device to be controlled corresponding to the preset pattern is determined; Collect the user's current gesture and determine the corresponding adjustment content based on the current gesture; Generate corresponding adjustment instructions based on the device to be controlled and the adjustment content; The adjustment command is transmitted to the device to be controlled, so that the device to be controlled executes the adjustment content based on the adjustment command.

9. A type of smart glasses, characterized in that, The smart glasses include: a memory, a processor, and a device control program stored in the memory and executable on the processor, wherein the device control program, when executed by the processor, implements the steps of the device control method as described in any one of claims 1 to 8.

10. A device control system, characterized in that, The device control system includes: an interactive medium and the smart glasses as described in claim 9; The interactive medium is provided with a preset pattern, which is used to represent the device to be controlled and the corresponding operation content.

Images