Smart home control method and device, control equipment and storage medium

Abstract

The embodiment of the invention relates to a smart home control method and device, control equipment and a storage medium. The method comprises the following steps: acquiring scene image data corresponding to a smart home control scene; constructing a first virtual light field according to the scene image data, and controlling a projection device to perform projection according to the first virtual light field so as to display a 3D interaction interface corresponding to the smart home control scene in the target space area; controlling a camera to collect a gesture image, and recognizing a target gesture action according to the gesture image; and in response to a control operation corresponding to the target gesture action, generating a control signal corresponding to the target smart home, and sending the corresponding control signal to the target smart home to control the working state of the target smart home. According to the control method and device of the smart home, the control equipment and the storage medium, control operation of the smart home can be realized without physically contacting a control panel or additional remote control equipment, and more visual and immersive control experience is provided for a user.

Description

Technical Field

[0001] The present application relates to the field of smart home technology, and in particular to a smart home control method, device, control equipment and storage medium. Background Art

[0002] With the development of technology, smart homes are increasingly being used in homes, gradually covering most of a family's devices. At present, each smart home in the same home has its own independent control panel or remote control, which makes it inconvenient for users to operate. Especially for children or the elderly, they may not be able to clearly and intuitively select the smart home they want to control, which affects the user's experience of using smart homes. Summary of the invention

[0003] The embodiments of the present application disclose a smart home control method, apparatus, control device and storage medium, which can realize the control operation of the smart home without physical contact with the control panel or additional remote control device, providing users with a more intuitive and immersive control experience.

[0004] The embodiment of the present application discloses a smart home control method, which is applied to a control device, wherein the control device includes a projection device and a camera; the method includes:

[0005] Acquire scene image data corresponding to a smart home control scene, wherein the scene image data includes 3D image data corresponding to one or more smart homes;

[0006] Constructing a first virtual light field according to the scene image data, and controlling the projection device to perform projection according to the first virtual light field, so as to display a 3D interactive interface corresponding to the smart home control scene in a target space area;

[0007] Controlling the camera to collect gesture images, and identifying target gesture actions according to the gesture images;

[0008] In response to the control operation corresponding to the target gesture action, a control signal corresponding to the target smart home is generated, and the corresponding control signal is sent to the target smart home to control the working state of the target smart home.

[0009] The embodiment of the present application discloses a control device for a smart home, which is applied to a control device, wherein the control device includes a projection device and a camera; the device includes:

[0010] A data acquisition module, used to acquire scene image data corresponding to a smart home control scene, wherein the scene image data includes 3D image data corresponding to one or more smart homes;

[0011] A scene projection module, configured to construct a first virtual light field according to the scene image data, and control the projection device to perform projection according to the first virtual light field, so as to display a 3D interactive interface corresponding to the smart home control scene in a target space area;

[0012] A gesture recognition module, used to control the camera to collect gesture images and recognize target gesture actions according to the gesture images;

[0013] The control module is used to generate a control signal corresponding to the target smart home in response to the control operation corresponding to the target gesture action, and send the corresponding control signal to the target smart home to control the working state of the target smart home.

[0014] An embodiment of the present application discloses a control device, including a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor implements the method described in any of the above embodiments.

[0015] An embodiment of the present application discloses a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described in any of the above embodiments is implemented.

[0016] An embodiment of the present application discloses a computer program product, including a computer program, and when the computer program is executed by a processor, the method described in any of the above embodiments is implemented.

[0017] The control method, device, control device and storage medium of the smart home disclosed in the embodiment of the present application obtain scene image data corresponding to the smart home control scene; construct a first virtual light field according to the scene image data, and control the projection device to project according to the first virtual light field to display the 3D interactive interface corresponding to the smart home control scene in the target space area; control the camera to collect gesture images, and recognize the target gesture action according to the gesture image; in response to the control operation corresponding to the target gesture action, generate a control signal corresponding to the target smart home, and send the corresponding control signal to the target smart home to control the working state of the target smart home. In the embodiment of the present application, the control device obtains the 3D scene image data of the smart home control scene and constructs the first virtual light field, so as to display the corresponding 3D interactive interface in the target space area, so that the user can intuitively see the position and state of each smart home in the smart home control scene, and the control device responds to the control operation by recognizing the user's gesture action, which further simplifies the control process, so that the user can interact with the 3D interactive interface without physical contact, and the control of the smart home can be realized in the target space area, which improves the convenience of user operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0019] Figure 1a A scene diagram of a smart home control scene in one embodiment;

[0020] Figure 1b A structural block diagram of a smart home control device in an embodiment;

[0021] Figure 2 is a flow chart of a smart home control method in one embodiment;

[0022] Figure 3 A flowchart of obtaining scene image data corresponding to a smart home control scene in one embodiment;

[0023] Figure 4 is a flow chart of a smart home control method in one embodiment;

[0024] Figure 5 is a flow chart of a smart home control method in one embodiment;

[0025] Figure 6 is a flow chart of controlling a projection device to perform projection according to a first virtual light field in one embodiment;

[0026] Figure 7 is a flow chart of a smart home control method in one embodiment;

[0027] Figure 8 A block diagram of a control device for a smart home in one embodiment;

[0028] Fig. 9 FIG. 4 is a structural block diagram of a control device in an embodiment. DETAILED DESCRIPTION

[0029] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0030] It should be noted that the terms "including" and "having" and any variations thereof in the embodiments of the present application and the accompanying drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device including a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.

[0031] It is understood that the terms "first", "second", etc. used in this application may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish a first element from another element. For example, without departing from the scope of this application, a first relative direction may be referred to as a second relative direction, and similarly, a second relative direction may be referred to as a first relative direction. Both the first relative direction and the second relative direction are relative directions of different objects.

[0032] In the related technologies, there are still certain limitations in applying 3D (Three-dimensional) technology or VR (Virtual Reality) technology to the control field. Specifically, the 3D technology currently used in the control panel actually forms a three-dimensional sense through the different visions of the left and right eyes of a person. The image is still two-dimensional in nature and cannot provide a true three-dimensional control experience. The 3D stereoscopic sense achieved with the help of VR auxiliary equipment (such as head-mounted wearable devices) is closer to the real three-dimensional experience, but users need to wear additional equipment, which is not convenient enough.

[0033] The embodiments of the present application disclose a smart home control method, apparatus, control device and storage medium, which can realize the control operation of the smart home without physical contact with the control panel or additional remote control device, providing users with a more intuitive and immersive control experience.

[0034] Figure 1a FIG. 1 is a smart home control scene 100 in an embodiment. Figure 1a As shown, the smart home control scene 100 includes multiple smart homes 110 and control devices 120, wherein each smart home 110 can be controlled by the control device 120. The smart home control scene 100 refers to a scene equipped with smart home devices, including but not limited to user homes, schools, museums, exhibition rooms, etc. Smart homes 110 refer to home appliances that can be automatically controlled and remotely managed through intelligent technology, including but not limited to smart refrigerators, smart air conditioners, smart water heaters, smart televisions, smart explanation equipment, smart multimedia, smart speakers or smart home theaters, etc.

[0035] The control device 120 is used to send control instructions to each smart home 110 to control the working state of each smart home 110. Optionally, the control device 120 can be set at any position in the smart home control scene 110, such as a corner of a room, a wall mount or a desktop, etc. The control device 120 can also be a portable device, such as a smart watch, a smart phone, a computer, etc. with projection and camera functions. The working state may include starting or shutting down the smart home, switching various functions of the smart home, adjusting the working parameters of the smart home, etc.

[0036] In some embodiments, Figure 1b As shown, the control device 120 may include a projection device 130 and a camera 140, and the projection device 130 is used to display the corresponding 3D interactive interface in the target space area. Among them, the target space area refers to the actual spatial position of the 3D interactive interface projected by the projection device 130. The projection device 130 may include but is not limited to a 3D holographic projector, a light field projector, a laser projector, an LCoS (Liquid Crystal On Silicon) projector, etc. The projection device 130 provides an intuitive operating platform for users through a 3D interactive interface, allowing them to intuitively browse, select and adjust the various function settings of each smart home 110.

[0037] Optionally, the projection device 130 may include multiple light emitters, each of which can be set at any position in the smart home control scene, and each light emitter can independently project an image or light, which can be superimposed and interacted with each other in the target space area, thereby constructing a complex three-dimensional stereoscopic graphic to form a 3D interactive interface.

[0038] The camera 140 is used to collect the smart home control scene 100, including the user image and the user's gesture image in the smart home control scene 100; the camera 140 can be any device with image acquisition function, including but not limited to a high-definition camera, an infrared camera, etc. Through the camera 140, the control device 120 can determine the current position of the user in the smart home control scene 100, and adjust the angle and focal length of the projection device 130 accordingly to ensure that the 3D interactive interface is always clearly presented within the user's field of view.

[0039] Exemplarily, when the projection device 130 is located in any area of ​​the smart home control scene 100, the control device 120 can determine the current position of the user in the smart home control scene 100 through the camera 140. When the user needs to control the target smart home, the control device 120 can obtain the scene image data corresponding to the smart home control scene 100; and construct a first virtual light field according to the scene image data, and control the projection device 130 to project according to the first virtual light field to display the 3D interactive interface corresponding to the smart home control scene 100 in the target space area. The control device 120 controls the camera 140 to collect gesture images, and recognizes the target gesture action according to the gesture image. In response to the control operation corresponding to the target gesture action, the control device 120 generates a control signal corresponding to the target smart home, and sends the corresponding control signal to the target smart home to control the working state of the target smart home.

[0040] like Figure 2 As shown, in one embodiment, a smart home control method is provided, which can be applied to the above control device 120. The method may include the following steps 210 to 240.

[0041] Step 210, obtaining scene image data corresponding to the smart home control scene.

[0042] In some embodiments, the control device can detect users in the smart home control scene through a camera. When the user is detected in a preset area, it can be confirmed that the user needs to control the smart home, and scene image data corresponding to the smart home control scene is obtained.

[0043] Optionally, after receiving an interface display instruction from the user, the control device may also obtain scene image data corresponding to the smart home control scene, so as to display a 3D interactive interface when the user needs it.

[0044] Scene image data refers to a series of images or video data in the smart home control scene, which can reflect the overall layout of the smart home control scene. Scene image data may include 3D image data corresponding to one or more smart homes, for example, image data of each smart home's own impact data and surrounding environment, and image data of the working status of the smart home itself.

[0045] 3D image data refers to image data of three-dimensional space information. 3D image data not only contains all the information of traditional image data (such as environment layout, active objects, etc.), but also contains three-dimensional space information: depth information (distance information of each object in the scene), surface texture (surface material and texture information of the object), lighting and shadow, etc., so that 3D image data can present a more vivid and realistic scene effect when displayed in the corresponding smart home.

[0046] In some embodiments, in order to maintain the accuracy and real-time nature of the scene image data, the control device may control the camera to capture images of the entire smart home control scene at preset intervals to update the scene image data corresponding to the current smart home control scene.

[0047] Step 220 , constructing a first virtual light field according to the scene image data, and controlling the projection device to perform projection according to the first virtual light field, so as to display a 3D interactive interface corresponding to the smart home control scene in the target space area.

[0048] The first virtual light field refers to a three-dimensional light field generated by simulating a smart home control scene through scene image data, which can be used to simulate the propagation and interaction of light in three-dimensional space, thereby creating an image similar to an actual smart home control scene.

[0049] In some embodiments, the control device can process the field image data to generate a complete three-dimensional light field model (including steps such as removing noise, filling holes, and adjusting brightness), and then use computer graphics technology to simulate the propagation and interaction of light in three-dimensional space, thereby generating a realistic virtual light field.

[0050] A 3D interactive interface refers to a user interface with a three-dimensional sense of space and interactivity. Optionally, the 3D interactive interface may include the overall scene of the smart home control scene, icons, buttons, sliders and other controls of each smart home, and interface elements that display information such as the working status of each smart home. Users can also interact with the three-dimensional surface of the 3D interactive interface through touch, gesture recognition, etc., thereby realizing the control of each smart home through air contact.

[0051] It should be noted that the target space area refers to the actual space position of the 3D interactive interface projected by the projection device. The target space area can be any set area, and its position, number, area, etc. can be set according to actual conditions. For example, the target space area can be two space areas, and the user can see the 3D interactive interface corresponding to the smart home control scene in both target space areas, and can also control the smart home synchronously.

[0052] Optionally, the target space area can be any area in a pre-set smart home control scene. For example, if the entrance area or the central area of ​​the living room in the user's house is relatively spacious and is an area where the user's family members frequently move around, the area can be used as the target space area of ​​the 3D interactive interface.

[0053] Exemplarily, the target space area may also be the area where the user is currently located. For example, 1 meter in front of the user, the control device may rotate the projection angle of the projection device, or set multiple projection devices in the smart home control scene to ensure that the user can see and operate the 3D interactive interface no matter where in the home, thereby improving the convenience and flexibility of use.

[0054] For example, when the control device is a portable device, the target space area may also be near the portable device. For example, when the control device is a portable device (such as a smart phone or a tablet), the projection device may be designed to project directly above, so that the user only needs to lift the control device or place it in a suitable position to see a clear 3D interactive interface in front of him and perform fast and accurate operations.

[0055] Optionally, the 3D interactive interface may display the entire smart home control scene in a scaled-down display image, so that the user can intuitively see the layout and relative position of each smart home. The 3D interactive interface may also display control buttons, so that the user can perform corresponding operations, such as turning on or off a device, by clicking or touching the control buttons in the air.

[0056] In some embodiments, the control device can control the projection device, and use the interference principle to convert the phase and amplitude of each point on each light wave contained in the first virtual light field into a spatially varying intensity, thereby using the contrast and interval between the interference fringes to record all the information of the light waves contained in the first virtual light field; then use the diffraction principle to give the original image and conjugate image of the first virtual light field through the diffracted light waves, forming a 3D interactive interface with a strong sense of three-dimensionality corresponding to the smart home control scene.

[0057] Step 230: Control the camera to collect gesture images, and recognize the target gesture action according to the gesture images.

[0058] Gesture images refer to images of user gestures within the camera's field of view.

[0059] When the user needs to control a smart home, he can make a preset gesture action and control the corresponding smart home through the control device. Therefore, the control device can control the camera to collect gesture images containing the user's hands, and analyze the user's target gesture actions through gesture image recognition, so that the control device can control the corresponding smart home according to the control operation corresponding to the user's target gesture action.

[0060] In some embodiments, the control device may pre-process multiple frames of gesture images continuously captured by the camera to obtain processed multiple frames of gesture images; then use a deep learning model (such as the OpenPose human pose estimation library, MediaPipeHands finger tracking solution, etc.) to detect key points in each frame of gesture images (key points may include finger joints, fingertips, palms, etc.); track each key point in the multiple frames of gesture images to obtain dynamic information of the gesture, such as the degree of bending of the user's fingers, the direction of the palm, the relative position between the fingers, etc. The control device determines the corresponding target gesture action based on the dynamic information of the gesture.

[0061] In some embodiments, the gesture action may be a factory preset or user-defined action of the control device that is expected to be recognized and executed. Optionally, the recognizable target gesture actions may include but are not limited to the following actions:

[0062] 1. Click action: the user clicks a virtual button or area with his finger to simulate the click operation on a mouse or touch screen.

[0063] 2. Sliding action: the user's finger slides parallel to the camera to simulate the operation of a sliding bar or scroll bar, which can be used to adjust parameters, etc.

[0064] 3. Waving gesture: users wave their arms or fingers back and forth to trigger certain operations, such as turning pages, returning, etc.

[0065] 4. Complex gestures can be composed of multiple simple gestures mentioned above, which are used to perform higher-level operations or commands.

[0066] 5. Custom gestures: Gesture actions defined by users according to their own needs. These actions may not be preset in the control device at the factory, but the user needs to record them in the control device in advance.

[0067] Step 240, in response to the control operation corresponding to the target gesture action, generate a control signal corresponding to the target smart home, and send the corresponding control signal to the target smart home to control the working state of the target smart home.

[0068] In the following embodiments, the control device may pre-set or learn a mapping relationship between gesture actions and smart home control operations. The mapping relationship may be defined based on user preferences, smart home control scenarios, or specific functions of smart homes. For example, if a user prefers to use a waving palm action to indicate turning on a light and a clenched fist action to indicate turning off a light, the control device may record the preference, and correspond the gesture action "waving palm" to "turning on a light" and the gesture action "clenching fist" to "turning off a light."

[0069] In some embodiments, the control device may map the identified target gesture action to the corresponding smart home control operation according to the mapping relationship. For example, assuming that the identified target gesture action is "waving", and the mapping relationship defines that "waving" corresponds to "turning on the light", the control device may determine that the corresponding control operation is "turning on the light". The control device generates a control signal corresponding to the target smart home according to the control operation. The control signal may be a specific instruction code, a communication protocol message, or a digital signal, etc., which is specifically determined by the communication protocol and device type between the target smart home and the control device.

[0070] In some embodiments, the control device can send a control signal to the target smart home through a home network (such as Wi-Fi wireless communication technology, Bluetooth, Zigbee, etc.) so that the target smart home performs a corresponding task after receiving the control instruction. For example, assuming that the control signal is "turn on the light", the smart home will perform the operation of turning on the light and adjusting the lighting status in the room.

[0071] For example, the user can adjust the volume of the smart home system through a specific gesture action. For example, the user can increase the volume by sliding the finger upward, and reduce the volume by sliding the finger downward. The control device will generate a corresponding volume control signal according to the gesture action of "slide the finger upward" or "slide the finger downward", and send it to the target smart home (smart speaker or smart home theater) to increase or decrease the volume of the target smart home.

[0072] In an embodiment of the present application, the control device obtains 3D scene image data of the smart home control scene and constructs a first virtual light field, thereby displaying the corresponding 3D interactive interface in the target space area, so that the user can intuitively see the position and status of each smart home in the smart home control scene. Moreover, the control device responds to the control operation by recognizing the user's gestures, further simplifying the control process, allowing the user to interact with the 3D interactive interface without physical contact, and control of the smart home can be achieved in the target space area, thereby improving the convenience of user operation.

[0073] In some embodiments, Figure 3 As shown, the step of obtaining scene image data corresponding to the smart home control scene may include the following steps 302 to 308.

[0074] Step 302, obtaining location information and physical specification information corresponding to multiple smart homes in a smart home control scenario.

[0075] Location information refers to the specific spatial location or relative area where the smart home is located in the smart home control scenario. The location information corresponding to the smart home may include but is not limited to room information (the room where the smart home device is located, such as the living room, bedroom, kitchen, bathroom, etc.), area division (in a larger room or space, such as the lounge area and entertainment area in the living room), spatial layout (the specific location of the smart home in the room or area, such as near the window, door, corner, etc.), and adjacent device relationship (the relative position relationship between the smart home and other devices, such as distance, direction, etc.). Accurate location information allows users and control devices to more accurately identify and control the smart home.

[0076] Physical specification information refers to the physical properties of the smart home itself, such as size, weight, power, and other physical properties, as well as the interface type, communication protocol, and other technical parameters between the smart home and the control device. This allows the control device to better restore each smart home in the 3D interactive interface, allowing users to more intuitively determine the smart home they want to control.

[0077] In some embodiments, the control device may use positioning technology to measure corresponding parameters such as signal strength or distance, and compare the corresponding relationship between the parameters and the position stored in the database, so as to determine the corresponding position information of each smart home in the smart home control scenario. Optionally, the positioning technology that the control device may use includes but is not limited to WiFi positioning technology, video recognition (RFID, Radio Frequency Identification) technology, ZigBee positioning technology, infrared positioning technology, ultrasonic positioning technology, etc.

[0078] Step 304, generating 3D image data corresponding to each smart home according to the physical specification information corresponding to each smart home.

[0079] 3D image data refers to the data that converts the physical specifications of a smart home into a three-dimensional image or model. 3D image data can accurately reflect the physical characteristics of a smart home, such as its appearance, size, and shape.

[0080] In some embodiments, the control device may use a 3D modeling tool to create a 3D model of each smart home according to the physical specification information of each smart home, and obtain 3D image data of each smart home. Optionally, the 3D modeling tool may include but is not limited to AutoCAD (Autodesk Computer Aided Design), 3Ds Max (3D Studio Max), Maya, etc.

[0081] Step 306: Generate 3D layout image data corresponding to the smart home control scene based on the scene layout information corresponding to the smart home control scene.

[0082] Scene layout information refers to the detailed layout description of the space where the smart home control scene is located. It may include but is not limited to the spatial scope, size, dimensions, shape, etc. of the smart home control scene. For example, when the smart home control scene is a user's home, the scene layout information may include the specifications, arrangement, dimensions (such as length, width, height, etc.) and room types (such as bedroom, kitchen, etc.) of each room contained in the home.

[0083] For the description of generating 3D layout image data according to the scene layout information in step 306 , reference may be made to the description of step 304 in the above embodiment, which will not be repeated here.

[0084] Step 308 , based on the location information corresponding to each smart home in the smart home control scenario, the 3D image data corresponding to each smart home is merged with the 3D layout image data to obtain the scene image data corresponding to the smart home control scenario.

[0085] In some embodiments, the control device can use 3D modeling software or scene editing tools to place the model corresponding to the 3D image data of each smart home in the corresponding position of the model corresponding to the 3D layout image data according to its position information in the smart home control scene, and obtain the placed model; the control device can generate scene image data corresponding to the smart home control scene based on the placed model. It is necessary to ensure that the size, proportion and orientation of the model are consistent with the actual situation.

[0086] Optionally, the control device can also adjust the lighting and shadow effects of each smart home in the smart home control scene according to the material and surrounding environment (such as light, color, etc.) of each smart home to ensure that the smart home looks natural and real in the scene.

[0087] In the embodiment of the present application, the control device fuses the 3D image data of each smart home with the 3D layout image data of the smart home control scene, so that the obtained scene image data can better reflect the layout and configuration of the smart home in the actual environment. It not only provides the accurate location and physical characteristics of the smart home, but also displays the spatial relationship of each smart home, making the 3D interactive interface generated by highly realistic scene image data more realistic, so that users can intuitively understand and control the smart home.

[0088] like Figure 4 As shown, in another embodiment, a smart home control method is provided, which can be applied to the above control device. The method may include the following steps 402 to 414.

[0089] Step 402: Acquire scene image data corresponding to a smart home control scene, where the scene image data includes 3D image data corresponding to one or more smart homes.

[0090] Step 404 , constructing a first virtual light field according to the scene image data, and controlling the projection device to perform projection according to the first virtual light field, so as to display a 3D interactive interface corresponding to the smart home control scene in the target space area.

[0091] Step 406: Control the camera to collect gesture images, and recognize the target gesture action according to the gesture images.

[0092] For the description of steps 402 to 406 , reference may be made to the description of steps 210 to 230 in the above embodiment, which will not be repeated here.

[0093] Step 408 , when a target gesture action corresponding to the selection operation of selecting a target smart home is detected, functional image data corresponding to the target smart home is acquired.

[0094] Optionally, making a gesture of "pointing the index finger forward and the other four fingers bent downward" on the image corresponding to the target smart home in the 3D interactive interface can be used as a target gesture action corresponding to the selection operation of selecting the target smart home. When the control device detects that the gesture of "pointing the index finger forward and the other four fingers bent downward" lasts for longer than a preset time, it confirms that the target gesture action is a gesture action for the selection operation of selecting the target smart home.

[0095] Since each smart home has multiple functions, and different smart homes have different functions, for example, when the smart home is a smart refrigerator, its functions may include refrigeration, ice making, ice crushing, freezing, etc. Therefore, when the control device detects that the user's target gesture action is a selection operation indicating that the user is currently selecting a target smart home, it can obtain the functional image data corresponding to the target smart home to control various functions of the target smart home.

[0096] Functional image data refers to a series of image information used to describe and display the functions of smart homes. Functional image data may include but is not limited to text descriptions, pictures, animations, videos and other forms, and is intended to help users intuitively understand and operate the various functions of smart homes, especially when the users are elderly or children, so that they can better understand and adjust the corresponding functions.

[0097] Optionally, the functional image data includes functional element data corresponding to multiple functions of the target smart home. Functional element data refers to specific image elements directly related to each function of the smart home, which can be static (such as a picture) or dynamic (such as an animation or video clip).

[0098] In some embodiments, the control device may generate images corresponding to each function according to the functional description of each function by using technical means such as image processing, animation production or video editing, and then determine the corresponding functional element data based on the image for easy display. For example, for the cooling mode of the air conditioner, assuming that its functional description is to lower the indoor temperature and provide a cool environment, the corresponding functional element data may be an icon or animation with a snowflake pattern, and an arrow or digital change indicating a temperature drop. For the sound amplification function of the speaker, assuming that its functional description is to increase the volume of the speaker to make the sound louder, the corresponding functional element data may be an icon or animation with a plus sign pattern, and a waveform or digital change indicating an increase in volume.

[0099] Step 410: construct a second virtual light field according to the functional image data, and control the projection device to perform projection according to the second virtual light field to display a functional operation interface corresponding to the target smart home in the target space area.

[0100] In some embodiments, in order to enable various users (especially users with less technical skills, such as children and / or the elderly) to better control or adjust various functions of the target smart home and to easily identify and confirm the smart home or function they want to control, the control device can construct a second virtual light field according to the functional element data corresponding to the multiple functions of the target smart home, and control the projection device to project according to the second virtual light field, so as to display the functional operation interface corresponding to the target smart home in the target space area.

[0101] The second virtual light field refers to a three-dimensional light field generated by simulating the various functional images of the target smart home through functional element data, which can be used to simulate the propagation and interaction of light in three-dimensional space, thereby creating images similar to the various functional images of the target smart home.

[0102] Optionally, the function operation interface includes 3D function elements corresponding to one or more functions. The 3D function elements are images generated based on function element data corresponding to the functions of the target smart home.

[0103] Exemplarily, the 3D functional elements corresponding to the cooling function of the smart air conditioner may be one or more realistic three-dimensional snowflake patterns. The snowflakes may be static or may be dynamically falling or rotating to simulate the cooling effect.

[0104] Exemplarily, the 3D functional elements corresponding to the sound adjustment function of the smart speaker may be one or more stereoscopic plus icons, and the plus sign may be dynamic, such as gradually getting bigger or flashing, to indicate that the sound is being adjusted.

[0105] In some embodiments, the function operation interface may only display a 3D function element corresponding to one function. When the control device detects a target gesture action corresponding to a switching operation on the function operation interface, the function operation interface may display a 3D function element corresponding to another function. Optionally, the gesture action corresponding to the switching operation may be sliding a finger, waving a palm, clicking a preset switching button displayed on the function operation interface, etc., so that the user can browse different functions of the target smart home.

[0106] Step 412, when a target gesture action corresponding to a control operation on the functional operation interface is detected, a target function corresponding to the control operation is determined, and a control signal corresponding to the target function of the target smart home is generated.

[0107] Optionally, when the user touches a 3D function element on the function operation interface with a finger, the user can choose to turn on or off or adjust the function. For example, the user can click on the snowflake icon corresponding to the cooling function of the smart air conditioner to turn on the cooling mode of the smart air conditioner. When the control device detects that the user can click on the snowflake icon corresponding to the cooling function of the smart air conditioner, it confirms that the target function corresponding to the control operation is the cooling function of the smart air conditioner, and generates a control signal corresponding to starting the cooling function of the smart air conditioner.

[0108] In some embodiments, after determining the target function corresponding to the control operation, the control device may determine the target adjustment parameter corresponding to the target function; and adjust the 3D function element corresponding to the target function projected by the projection device according to the target adjustment parameter and the function element data corresponding to the target function.

[0109] The target adjustment parameter refers to the specific value or range that needs to be adjusted when the control device adjusts the target function through control operations in the smart home control scenario. For example, the control device can control the smart water heater to increase the temperature by 3 degrees.

[0110] In some embodiments, while generating a control signal corresponding to the target function of the target smart home to control the target function, the control device can visually adjust the 3D functional elements corresponding to the target function projected by the projection device according to the target adjustment parameters and the functional element data corresponding to the target function.

[0111] Optionally, the control device may change the size of the 3D functional element according to the size of the target adjustment parameter. For example, when the target function is the cooling function of the smart air conditioner, as the temperature decreases (i.e., the cooling intensity increases), the projected 3D functional element (snowflake icon) may gradually become larger to intuitively indicate the enhancement of the cooling effect.

[0112] Optionally, the control device may increase or decrease the number of 3D functional elements according to the numerical change of the target adjustment parameter. For example, when the target function is the volume adjustment function of the smart speaker, as the volume increases, the control device may control the projection device to display more plus icons or sound wave patterns to indicate the increase in volume.

[0113] Optionally, the control device can also reflect the change of the target adjustment parameter by changing the animation effect (such as rotation speed, flashing frequency, etc.) of the 3D functional element corresponding to the target function. After detecting the control operation on the functional operation interface, the control device can determine the target function and generate the corresponding control signal, while adjusting the visual effect of the 3D functional element according to the target adjustment parameter, such as size, quantity and animation effect, so as to intuitively and in real time feedback the change of the target function state, thereby enhancing the interactivity and responsiveness between the user and the control device of the smart home.

[0114] Step 414: Send a corresponding control signal to the target smart home to control the working state of the target smart home.

[0115] For the description of step 414, reference may be made to the description of step 240 in the above embodiment, which will not be repeated here.

[0116] In some specific embodiments, assuming that the user needs to control the temperature of the refrigeration of the smart refrigerator to decrease, and performs corresponding target gesture actions in sequence, the control device can obtain scene image data corresponding to the user's house, construct a first virtual light field according to the scene image data, and control the projection device to project according to the first virtual light field, so as to display the 3D interactive interface corresponding to the user's house in the target space area.

[0117] The user makes a gesture to select the image of the smart refrigerator in the 3D interactive interface. The control device controls the camera to collect gesture images, and recognizes the target gesture based on the gesture images; when the target gesture corresponding to the selection operation of the smart refrigerator is detected, the functional image data corresponding to the smart refrigerator is obtained; a second virtual light field is constructed according to the functional image data, and the projection device is controlled to project according to the second virtual light field to display the functional operation interface corresponding to the smart refrigerator in the target space area. When the control device detects the target gesture corresponding to the control operation of the functional operation interface, it determines the refrigeration function corresponding to the control operation, generates a control signal corresponding to the refrigeration function, and sends the corresponding control signal to the smart refrigerator to control the temperature of the refrigeration area of ​​the smart refrigerator to drop.

[0118] In addition, the control device can also determine the temperature drop parameters corresponding to the refrigeration function; according to the temperature drop parameters and the functional element data corresponding to the refrigeration function, adjust the 3D functional elements (snowflakes) corresponding to the refrigeration function projected by the projection device, increase the number of 3D functional elements, and adjust three snowflakes to multiple falling snowflakes.

[0119] In an embodiment of the present application, the control device obtains functional image data corresponding to the target smart home and constructs a second virtual light field for projection, and displays various functions of the target smart home in a variety of forms (such as text, pictures, animations, videos, etc.) on the functional operation interface, so that users can easily identify and understand various functions, especially for user groups such as the elderly and children, so as to better control the target smart home and provide users with a more intuitive and immersive control experience.

[0120] like Figure 5 As shown, in another embodiment, a smart home control method is provided, which can be applied to the above control device. The method may include the following steps 502 to 506.

[0121] Step 502 : when a target gesture action corresponding to a rotation operation of rotating the 3D interactive interface is detected, a rotation direction corresponding to the rotation operation is obtained.

[0122] In some embodiments, the control device can analyze the movement trajectory of the user's fingers, the direction of the palm, and the speed and direction of the gesture in the gesture image captured by the camera, so as to determine the rotation direction of the target gesture action relative to the 3D interactive interface when the target gesture action is a gesture action corresponding to the rotation operation. For example, clockwise rotation in the horizontal direction. This allows the user to achieve rotation control of the 3D interactive interface by simply making a rotation gesture in the air without touching any physical interface, which increases the fun and interactivity of the user's operation.

[0123] Step 504 , determining the scene image data corresponding to the rotated 3D interactive interface according to the rotation direction and the scene image data.

[0124] In some embodiments, the control device may first determine the rotation axis point according to the rotation direction and the scene image data; the rotation axis point refers to the reference point for the rotation of the 3D interactive interface, which may be located at the center of the 3D interactive interface or at the position specified by the user's finger. After determining the rotation axis point, the control device may construct a rotation matrix according to the rotation direction; the rotation matrix is ​​used to describe the rotation transformation of the 3D interactive interface. The control device rotates each point on the 3D interactive interface to a new position according to the rotation matrix, that is, multiplies each point on the 3D interactive interface by the rotation matrix to obtain the scene image data corresponding to the rotated 3D interactive interface.

[0125] It should be noted that the control device can process the gesture data collected by the camera in real time through efficient rendering algorithms and hardware acceleration technology to identify and analyze the user's rotation operation, thereby displaying the rotated 3D interactive interface in the target space area, so that the displayed 3D interactive interface and the user's rotation operation can be synchronized in real time to enhance the user's immersion and interactive experience.

[0126] Step 506 , constructing a third virtual light field according to the scene image data corresponding to the rotated 3D interactive interface, and controlling the projection device to perform projection according to the third virtual light field to display the rotated 3D interactive interface in the target space area.

[0127] In step 506, the specific description of constructing the third virtual light field and controlling the projection device to perform projection can refer to the specific description of constructing the first virtual light field and controlling the projection device to perform projection in step 204 of the above embodiment, which will not be repeated here.

[0128] In some embodiments, the control device may also, upon detecting a target gesture action (such as clenching or opening fists) corresponding to the scaling operation of scaling the 3D interactive interface, obtain a scaling ratio corresponding to the scaling operation; determine the scene image data corresponding to the scaled 3D interactive interface according to the scaling ratio and the scene image data; construct a fourth virtual light field according to the scene image data corresponding to the scaled 3D interactive interface, and control the projection device to perform projection according to the fourth virtual light field to display the scaled 3D interactive interface in the target space area. By adjusting the display ratio of the 3D interactive interface, the user can more intuitively and clearly see the details or overall layout of the 3D interactive interface.

[0129] In the embodiment of the present application, the control device allows the user to view the 3D interactive interface from multiple angles by recognizing the rotation operation and projecting the rotated 3D interactive interface, providing a richer visual experience. The user can adjust the display angle of the 3D interactive interface according to their needs, so as to operate the smart home more comfortably.

[0130] In some embodiments, Figure 6 As shown, the step of controlling the projection device to perform projection according to the first virtual light field may include the following steps 602 to 604.

[0131] Step 602, determining light information corresponding to a plurality of light rays included in the first virtual light field according to the scene image data; the plurality of light rays correspond to a plurality of light emitters one by one.

[0132] Since the light field is the sum of information about the intensity and direction of light in all directions in space, the control device can control multiple light emitters to simultaneously emit corresponding light, so that each light beam overlaps and interacts with each other in the target space area, thereby constructing a complex three-dimensional stereoscopic graphic to form a 3D interactive interface.

[0133] The light information includes detailed parameters and characteristics of the light, such as light direction, light intensity, light color, etc. Specifically, the control device can control the light and dark contrast and overall brightness of the scene by adjusting the light intensity of each light.

[0134] In some embodiments, the control device can calculate the light information of the light corresponding to each light emitter based on the position, shape, color of each smart home in the scene image data, and the position of each light emitter in the smart home control scene.

[0135] Step 604: Control the light emitters corresponding to the respective light rays to emit light signals according to the light information corresponding to the respective light rays.

[0136] In some embodiments, the control device may determine the first emission parameter of the light emitter corresponding to the first light according to the light information of the first light; generate an emission signal corresponding to the light emitter corresponding to the first light according to the first emission parameter, and send the emission signal to the corresponding light emitter, so that the light emitter corresponding to the first light emits the light signal according to the first emission parameter; wherein the first light is any light in the first virtual light field; the emission parameter may include the brightness, color, pulse width, etc. of the light emitter. It can ensure that the light signal emitted by each light emitter can achieve the display effect of the corresponding light.

[0137] In an embodiment of the present application, the control device constructs a complex and high-precision three-dimensional graphic (3D interactive interface) by precisely controlling multiple light emitters to emit corresponding light, and causing them to overlap and interact with each other in the target space area, thereby providing users with a more realistic and immersive experience.

[0138] like Figure 7 As shown, in another embodiment, a smart home control method is provided, which can be applied to the above control device. The method may include the following steps 702 to 706.

[0139] Step 702: Control the camera to collect a user image, and perform eye recognition on the user image to determine the user's viewing angle.

[0140] In order to present a better 3D stereoscopic visual effect, the control device needs to know the user's viewing angle relative to the target space area in order to adjust the display parameters of the projection device for projection, ensuring that the user can see a clear 3D interactive interface or functional operation interface in the target space area at different angles, thereby providing a more natural and realistic interactive experience.

[0141] The viewing angle refers to the relative position relationship between the user's eyes and the target space area. Therefore, the control device can use the image processing technology to perform eye recognition on the user image through multiple frames of user images continuously captured by the camera, and track the position information and movement trajectory of the user's eyes; based on the position information and movement trajectory of the eyes, the viewing angle of the user's eyes relative to the target space area is calculated.

[0142] Specifically, the control device can establish a three-dimensional space coordinate system, and the origin of the coordinate system can be set to the position of the projection device or the camera. According to the user image captured by the camera, combined with the camera's internal parameters (such as focal length, optical center position, etc.) and external parameters (such as the position and posture of the camera relative to the target space area), the position of the eye in the user image can be converted to a three-dimensional space coordinate system; and by using methods such as vector operations or trigonometric functions, the angle between the eye position vector and the target space area (such as the center of the projection screen) is calculated to obtain the user's viewing angle.

[0143] Step 704: Calculate the projection angle of the projection device according to the viewing angle.

[0144] The projection angle of the projection device refers to the angle between the projection light emitted by the projection device and the projection plane (or screen), which affects the position and size of the projected image in the target space area.

[0145] In some embodiments, it can be assumed that the relative position between the projection device and the target space area is fixed, and the optical axis of the projection device is perpendicular to the projection plane. The control device can calculate the projection angle that should be adjusted in the horizontal and vertical directions of the projection device based on the geometric relationship between the viewing angle, projection distance and projection height; wherein the projection distance refers to the vertical distance from the projection device to the projection plane; and the projection height refers to the vertical distance between the optical axis of the projection device and the projection plane.

[0146] Step 706 , controlling the projection device to perform projection according to the projection angle and the first virtual light field.

[0147] Optionally, the control device can adjust the position, angle, focal length and other parameters of the projection device according to the projection angle and the first virtual light field; after the adjustment is completed, the control device controls the projection device to project, ensuring that the projection device can accurately display a 3D interactive interface that meets the requirements in the target space area, so that the user can better view the 3D interactive interface displayed in the target space area.

[0148] In an embodiment of the present application, the control device dynamically adjusts the projection parameters of the projection device by calculating the viewing angle and the projection angle of the projection device, so that the user can obtain clear 3D visual effects in the target space area at different positions and angles, thereby improving the user's viewing experience and enhancing the naturalness and authenticity of the 3D interaction, providing the user with a more immersive smart home control experience.

[0149] like Figure 8 As shown, in one embodiment, a smart home control device 800 is provided, which can be applied to the above control device. The smart home control device 800 may include a data acquisition module 810, a scene projection module 820, a gesture recognition module 830 and a control module 840.

[0150] The data acquisition module 810 is used to acquire scene image data corresponding to the smart home control scene, and the scene image data includes 3D image data corresponding to one or more smart homes.

[0151] The scene projection module 820 is used to construct a first virtual light field according to the scene image data, and control the projection device to project according to the first virtual light field to display a 3D interactive interface corresponding to the smart home control scene in the target space area.

[0152] The gesture recognition module 830 is used to control the camera to collect gesture images and recognize target gesture actions according to the gesture images.

[0153] The control module 840 is used to generate a control signal corresponding to the target smart home in response to the control operation corresponding to the target gesture action, and send the corresponding control signal to the target smart home to control the working state of the target smart home.

[0154] In some embodiments, the data acquisition module 810 is also used to obtain the location information and physical specification information corresponding to multiple smart homes in the smart home control scenario; generate 3D image data corresponding to each smart home according to the physical specification information corresponding to each smart home; generate 3D layout image data corresponding to the smart home control scene based on the scene layout information corresponding to the smart home control scene; according to the location information corresponding to each smart home in the smart home control scenario, the 3D image data corresponding to each smart home is merged with the 3D layout image data to obtain the scene image data corresponding to the smart home control scene.

[0155] In some embodiments, the control device 800 may further include a function projection module and an element adjustment module.

[0156] The function projection module is used to obtain function image data corresponding to the target smart home when a target gesture action corresponding to the selection operation of selecting the target smart home is detected; construct a second virtual light field according to the function image data, and control the projection device to project according to the second virtual light field to display the function operation interface corresponding to the target smart home in the target space area.

[0157] Optionally, the control module 840 is also used to determine the target function corresponding to the control operation when a target gesture action corresponding to the control operation on the functional operation interface is detected, and generate a control signal corresponding to the target function of the target smart home.

[0158] Optionally, the functional image data includes functional element data corresponding to multiple functions of the target smart home; the functional operation interface includes 3D functional elements corresponding to one or more functions.

[0159] The element adjustment module is used to determine the target adjustment parameters corresponding to the target function; and adjust the 3D functional elements corresponding to the target function projected by the projection device according to the target adjustment parameters and the functional element data corresponding to the target function.

[0160] In some embodiments, the control device 800 may further include a rotating projection module.

[0161] A rotation projection module is used to obtain a rotation direction corresponding to a rotation operation when a target gesture action corresponding to a rotation operation of rotating a 3D interactive interface is detected; determine scene image data corresponding to the rotated 3D interactive interface according to the rotation direction and the scene image data; construct a third virtual light field according to the scene image data corresponding to the rotated 3D interactive interface, and control a projection device to perform projection according to the third virtual light field so as to display the rotated 3D interactive interface in a target space area.

[0162] Optionally, the projection device comprises a plurality of light emitters.

[0163] In some embodiments, the scene projection module 820 is further used to determine the light information corresponding to the multiple light rays contained in the first virtual light field according to the scene image data; the multiple light rays correspond one-to-one to the multiple light emitters; and according to the light information corresponding to each light ray, control the light emitter corresponding to each light ray to emit a light signal.

[0164] In some embodiments, the control device 800 may further include an angle calculation module.

[0165] The angle calculation module is used to control the camera to collect user images, perform eye recognition on the user images, determine the user's viewing angle; and calculate the projection angle of the projection device based on the viewing angle.

[0166] Optionally, the scene projection module 820 is further configured to control the projection device to perform projection according to the projection angle and the first virtual light field.

[0167] In an embodiment of the present application, the control device obtains 3D scene image data of the smart home control scene and constructs a first virtual light field, thereby displaying the corresponding 3D interactive interface in the target space area, so that the user can intuitively see the position and status of each smart home in the smart home control scene. Moreover, the control device responds to the control operation by recognizing the user's gestures, further simplifying the control process, allowing the user to interact with the 3D interactive interface without physical contact, and control of the smart home can be achieved in the target space area, thereby improving the convenience of user operation.

[0168] Fig. 9 FIG. 1 is a structural block diagram of a control device in an embodiment. Fig. 9 As shown, the control device 900 may include one or more of the following components: a processor 910, and a memory 920 coupled to the processor 910, wherein the memory 920 may store one or more computer programs, and the one or more computer programs may be configured to implement the methods described in the above embodiments when executed by one or more processors 910.

[0169] The processor 910 may include one or more processing cores. The processor 910 uses various interfaces and lines to connect the various parts of the entire control device 900, and executes various functions and processes data of the control device 900 by running or executing instructions, programs, code sets or instruction sets stored in the memory 920, and calling data stored in the memory 920. Optionally, the processor 910 can be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 910 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 910, but may be implemented separately through a communication chip.

[0170] The memory 920 may include a random access memory (RAM) or a read-only memory (ROM). The memory 920 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 920 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc. The data storage area may also store data created by the control device 900 during use, etc.

[0171] It can be understood that the control device 900 may include more or fewer structural elements than those in the above structural block diagram, for example, including a power supply, input buttons, cameras, speakers, screens, RF (Radio Frequency) circuits, Wi-Fi (Wireless Fidelity) modules, Bluetooth modules, sensors, etc., and no limitation is made here.

[0172] An embodiment of the present application discloses a computer-readable storage medium storing a computer program, wherein the computer program implements the methods described in the above embodiments when executed by a processor.

[0173] The embodiments of the present application disclose a computer program product, including a computer program, and the computer program can be executed by a processor to implement the methods described in the above embodiments.

[0174] A person skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The storage medium can be a disk, an optical disk, a read-only memory (ROM), etc.

[0175] As used herein, any reference to memory, storage, database, or other medium may include nonvolatile and / or volatile memory. Suitable nonvolatile memory may include ROM, Programmable ROM (PROM), Erasable PROM (EPROM), Electrically Erasable PROM (EEPROM), or Flash memory. Volatile memory may include random access memory (RAM), which is used as an external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), memory bus direct RAM (RDRAM), and direct memory bus dynamic RAM (DRDRAM).

[0176] It should be understood that the "one embodiment" or "an embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. Those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required for the present application.

[0177] In the various embodiments of the present application, it should be understood that the size of the serial numbers of the above-mentioned processes does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0178] The technical features of the above embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0179] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0180] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0181] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-accessible memory. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a memory and includes several requests for a computer device (which can be a personal computer, a server or a network device, etc., specifically a processor in a computer device) to perform some or all of the steps of the above-mentioned methods of various embodiments of the present application.

[0182] The above is a detailed introduction to a smart home control method, device, control equipment and storage medium disclosed in the embodiment of the present application. The principle and implementation method of the present application are described in detail using specific examples. The description of the above embodiments is only used to help understand the method and core idea of ​​the present application. At the same time, for those of ordinary skill in the art, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A control method for a smart home, characterized in that: Applied to a control device, the control device includes a projection device and a camera; the method includes: Acquire scene image data corresponding to a smart home control scene, wherein the scene image data includes 3D image data corresponding to one or more smart homes; Constructing a first virtual light field according to the scene image data, and controlling the projection device to perform projection according to the first virtual light field, so as to display a 3D interactive interface corresponding to the smart home control scene in a target space area; Controlling the camera to collect gesture images, and identifying target gesture actions according to the gesture images; In response to the control operation corresponding to the target gesture action, a control signal corresponding to the target smart home is generated, and the corresponding control signal is sent to the target smart home to control the working state of the target smart home.

2. The method according to claim 1, characterized in that The step of obtaining scene image data corresponding to the smart home control scene includes: Obtain location information and physical specification information corresponding to multiple smart homes in a smart home control scenario; Generating 3D image data corresponding to each of the smart homes according to the physical specification information corresponding to each of the smart homes; Based on the scene layout information corresponding to the smart home control scene, generating 3D layout image data corresponding to the smart home control scene; According to the position information corresponding to each of the smart homes in the smart home control scenario, the 3D image data corresponding to each of the smart homes is fused with the 3D layout image data to obtain the scene image data corresponding to the smart home control scenario.

3. The method according to claim 1, characterized in that After identifying the target gesture action according to the gesture image, the method further includes: When a target gesture action corresponding to a selection operation of selecting a target smart home is detected, functional image data corresponding to the target smart home is acquired; constructing a second virtual light field according to the functional image data, and controlling the projection device to perform projection according to the second virtual light field, so as to display a functional operation interface corresponding to the target smart home in the target space area; The generating a control signal corresponding to the target smart home in response to the control operation corresponding to the target gesture action includes: When a target gesture action corresponding to a control operation on the functional operation interface is detected, a target function corresponding to the control operation is determined, and a control signal corresponding to the target function of the target smart home is generated.

4. The method according to claim 3, characterized in that The functional image data includes functional element data corresponding to multiple functions of the target smart home; the functional operation interface includes 3D functional elements corresponding to one or more functions; After determining the target function corresponding to the control operation, the method further includes: Determining a target adjustment parameter corresponding to the target function; According to the target adjustment parameter and the functional element data corresponding to the target function, the 3D functional element corresponding to the target function projected by the projection device is adjusted.

5. The method according to claim 1, characterized in that After identifying the target gesture action according to the gesture image, the method further includes: When a target gesture action corresponding to a rotation operation of rotating the 3D interactive interface is detected, obtaining a rotation direction corresponding to the rotation operation; Determining the scene image data corresponding to the rotated 3D interactive interface according to the rotation direction and the scene image data; A third virtual light field is constructed according to the scene image data corresponding to the rotated 3D interactive interface, and the projection device is controlled to perform projection according to the third virtual light field to display the rotated 3D interactive interface in the target space area.

6. The method according to claim 1, characterized in that The projection device includes a plurality of light emitters; and controlling the projection device to perform projection according to the first virtual light field includes: Determine, according to the scene image data, light information corresponding to a plurality of light rays included in the first virtual light field; the plurality of light rays correspond one-to-one to the plurality of light emitters; According to the light information corresponding to each of the light rays, the light emitters corresponding to each of the light rays are controlled to emit light signals.

7. The method according to claim 1, characterized in that The method further comprises: Controlling the camera to collect a user image, and performing eye recognition on the user image to determine the viewing angle of the user; Calculating the projection angle of the projection device according to the viewing angle; The controlling the projection device to perform projection according to the first virtual light field includes: The projection device is controlled to perform projection according to the projection angle and the first virtual light field.

8. A control device for a smart home, characterized in that: A control device applied to a smart home, the control device comprising a projection device and a camera; the device comprising: A data acquisition module, used to acquire scene image data corresponding to a smart home control scene, wherein the scene image data includes 3D image data corresponding to one or more smart homes; A scene projection module, configured to construct a first virtual light field according to the scene image data, and control the projection device to perform projection according to the first virtual light field, so as to display a 3D interactive interface corresponding to the smart home control scene in a target space area; A gesture recognition module, used to control the camera to collect gesture images and recognize target gesture actions according to the gesture images; The control module is used to generate a control signal corresponding to the target smart home in response to the control operation corresponding to the target gesture action, and send the corresponding control signal to the target smart home to control the working state of the target smart home.

9. A control device, characterized in that: The method comprises a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor implements the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images