Virtual control method and device of smart home equipment, sofa and storage medium

Abstract

The invention discloses a virtual control method and device for smart home equipment, a sofa and a storage medium. The method is applied to the sofa, a projector is arranged in the sofa, and the method comprises the following steps: in response to projection operation, determining a projection position, and controlling the projector to project an equipment layout map at the projection position; in response to a selection operation on a first smart home device in the device layout map, controlling a projector to project a virtual control panel corresponding to the first smart home device at a projection position; and in response to a control operation on the virtual control panel, sending a control instruction corresponding to the control operation to the first smart home device so as to control the first smart home device to execute the first function. Through the virtual control method and device of the smart home device, the sofa and the storage medium, a user can remotely control the smart home device on the sofa, the control modes of the smart home device are enriched, the control operation is simpler and more convenient, and the use experience of the user is improved.

Description

Technical Field

[0001] The present application relates to the field of smart home technology, and in particular to a virtual control method, device, sofa and storage medium for smart home equipment. Background Art

[0002] With the rapid development of Internet technology, the deep integration of Internet of Things technology and smart home devices can bring users a more comfortable experience. At present, users generally control smart home devices through physical controllers such as mechanical switches and touch screens. Users need to use remote controls or physical control panels on smart home devices to control smart home devices. The control method is single and the control operation process is relatively cumbersome, which brings inconvenience to users. Summary of the invention

[0003] The embodiments of the present application disclose a virtual control method, device, sofa and storage medium for smart home devices, which can enable users to remotely control smart home devices on the sofa, enrich the control methods of smart home devices, make control operations simpler, and improve the user experience.

[0004] A first aspect of an embodiment of the present application discloses a virtual control method for a smart home device, which is applied to a sofa, wherein a projector is provided in the sofa, and the method comprises:

[0005] In response to the projection operation, a projection position is determined, and the projector is controlled to project a device layout diagram at the projection position; the device layout diagram includes one or more smart home devices;

[0006] In response to a selection operation of a first smart home device in the device layout diagram, controlling the projector to project a virtual control panel corresponding to the first smart home device at the projection position, the first smart home device being any of the smart home devices;

[0007] In response to a control operation on the virtual control panel, a control instruction corresponding to the control operation is sent to the first smart home device to control the first smart home device to perform a first function.

[0008] In some possible embodiments, the method further includes:

[0009] Receiving a control request sent by a second smart home device; the second smart home device is any of the smart home devices;

[0010] According to the control request, controlling the projector to project a virtual control panel corresponding to the second smart home device at the projection position;

[0011] Control inquiry information corresponding to the control request is displayed in the virtual control panel, where the control inquiry information is used to instruct a user to determine whether to control the second smart home device to perform a second function corresponding to the control request.

[0012] In some possible embodiments, before determining the projection position in response to the projection operation, the method further includes:

[0013] Scanning one or more smart home devices within a preset range of the sofa, and establishing a communication connection with each scanned smart home device;

[0014] Receiving device information and location information sent by each smart home device that establishes a communication connection with the sofa;

[0015] A device layout diagram is generated according to the device information and location information corresponding to each smart home device and the layout information of the indoor space where the sofa is located.

[0016] In some possible embodiments, after receiving the device information and location information sent by each smart home device that establishes a communication connection with the sofa, the method further includes:

[0017] According to the device information corresponding to the third smart home device, searching in the database whether there is a virtual control panel corresponding to the third smart home device; the third smart home device is any smart home device that establishes a communication connection with the sofa;

[0018] If not, sending a control information acquisition request to the third smart home device, wherein the control information acquisition request is used to instruct the third smart home device to send a control instruction set and physical control information to the sofa;

[0019] Receiving a control instruction set and physical control information sent by the third smart home device;

[0020] A virtual control panel corresponding to the third smart home device is generated according to the control instruction set and the physical control information, and the virtual control panel corresponding to the third smart home device is saved.

[0021] In some possible embodiments, the control instruction set includes one or more control instructions; the physical control information includes physical parameters corresponding to one or more physical control parts included in the third smart home device; and generating a virtual control panel corresponding to the third smart home device according to the control instruction set and the physical control information includes:

[0022] Generate virtual control parts corresponding to each of the physical control parts according to the physical parameters corresponding to the one or more physical control parts;

[0023] According to each control instruction included in the control instruction set, a mapping relationship between each virtual control unit and each control instruction is established;

[0024] A virtual control panel corresponding to the third smart home device is generated according to each of the virtual control parts and the mapping relationship between each of the virtual control parts and the control instructions.

[0025] In some possible embodiments, the method further includes:

[0026] Receiving location information sent by a fourth smart home device, where the fourth smart home device is any of the smart home devices;

[0027] According to the location information corresponding to the fourth smart home device, a display mark of the fourth smart home device is updated on the device layout diagram, and the display mark is used to indicate the real-time location of the fourth smart home device on the device layout diagram.

[0028] In some possible embodiments, the sofa further includes one or more pressure sensors; and determining the projection position in response to the projection operation includes:

[0029] In response to the projection operation, obtaining pressure signals respectively collected by the one or more pressure sensors within a target time period;

[0030] Determine, according to the pressure signals collected by each of the pressure sensors, the pressure change information corresponding to each of the pressure sensors within the target time period;

[0031] Determine the position and / or posture of the user on the sofa according to the pressure change information corresponding to each of the pressure sensors within the target time period;

[0032] The projection position is determined according to the position and / or posture of the user on the sofa.

[0033] A second aspect of an embodiment of the present application discloses a virtual control device for a smart home device, which is applied to a sofa, wherein a projector is provided in the sofa, and the device comprises:

[0034] A first projection module, configured to determine a projection position in response to a projection operation, and control the projector to project a device layout diagram at the projection position; the device layout diagram includes one or more smart home devices;

[0035] a second projection module, configured to control the projector to project a virtual control panel corresponding to the first smart home device at the projection position in response to a selection operation on the first smart home device in the device layout diagram, wherein the first smart home device is any of the smart home devices;

[0036] The control module is used to send a control instruction corresponding to the control operation to the first smart home device in response to the control operation on the virtual control panel, so as to control the first smart home device to perform a first function.

[0037] A third aspect of an embodiment of the present application discloses a sofa, comprising a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor implements the virtual control method of the smart home device as described in any of the above embodiments.

[0038] A fourth aspect of an embodiment of the present application discloses a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the processor implements the virtual control method for a smart home device as described in any of the above embodiments.

[0039] The present application provides a virtual control method, device, sofa and storage medium for smart home devices. The sofa determines the projection position by responding to the projection operation triggered by the user, and controls the sofa's projector to project the device layout diagram at the projection position; the sofa controls the projector to project the virtual control panel corresponding to the first smart home device at the projection position by responding to the user's selection operation of the first smart home device in the device layout diagram; the sofa responds to the user's control operation of the virtual control panel and sends a control instruction corresponding to the control operation to the first smart home device to control the first smart home device to perform a first function. In an embodiment of the present application, the sofa can control the projector to project the device layout diagram at the projection position in response to the projection operation triggered by the user, and control the projector to project the virtual control panel of the first smart home device in response to the user's selection operation of the first smart home device in the device layout diagram, so as to facilitate the user to control the first smart home device through the virtual control panel, so that the user can remotely control the smart home device through the virtual control panel on the sofa, enriching the control method of the smart home device, and making the control operation more convenient, thereby improving the user's experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0041] Figure 1 An application scenario diagram of a virtual control method for smart home devices provided in an embodiment of the present application;

[0042] Figure 2 A flowchart of a virtual control method for a smart home device provided in an embodiment of the present application;

[0043] Figure 3 A schematic diagram of a device layout diagram provided in an embodiment of the present application;

[0044] Figure 4 A schematic diagram of a virtual control panel provided in an embodiment of the present application;

[0045] Figure 5 A flow chart for determining a projection position by a pressure signal provided in an embodiment of the present application;

[0046] Figure 6 A flow chart for generating a device layout diagram provided in an embodiment of the present application;

[0047] Figure 7 A schematic diagram of a generation device layout diagram provided in an embodiment of the present application;

[0048] Figure 8 A flowchart for generating a virtual control panel provided in an embodiment of the present application;

[0049] Fig. 9 Another flowchart for generating a virtual control panel provided in an embodiment of the present application;

[0050] Fig.10 A schematic diagram of generating a virtual control unit provided in an embodiment of the present application;

[0051] Fig.11 A flowchart of another virtual control method for smart home devices provided in an embodiment of the present application;

[0052] Fig.12 A flowchart of another virtual control method for smart home devices provided in an embodiment of the present application;

[0053] Fig.13 A structural block diagram of a virtual control device for a smart home device provided in an embodiment of the present application;

[0054] Fig.14 This is a structural block diagram of a sofa provided in an embodiment of the present application. DETAILED DESCRIPTION

[0055] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0056] It should be noted that the terms "including" and "having" and any variations thereof in the embodiments of the present application and the accompanying drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device including a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.

[0057] In addition, "at least one" means one or more, and "plurality" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can mean: a, or b, or c, or a and b, or a and c, or b and c, or a, b and c, where a, b, c can be single or multiple.

[0058] Figure 1 This is an application scenario diagram of a virtual control method for smart home devices provided in an embodiment of the present application. Figure 1 As shown, the virtual control method of the smart home device can be applied to the sofa 100. The sofa 100 can establish a communication connection with one or more smart home devices 110. A projector 120 can be provided on the sofa 100. When the user 130 is on the sofa 100, the virtual control panel of the smart home device 110 projected by the projector 120 can be operated to realize remote control of the smart home device 110.

[0059] The sofa 100 can be a fabric sofa, a leather sofa, a solid wood sofa, etc., which are classified by material; it can also be an ordinary sofa, a multifunctional sofa (such as a sofa that can be converted into a bed, etc.), a massage sofa, etc., which are classified by function; it can also be a straight sofa, a corner sofa, a U-shaped sofa, etc., which are classified by shape, and no specific limitation is made here.

[0060] Smart home devices 110 may refer to home devices that are interconnected with other smart devices through the Internet of Things technology. Smart home devices 110 may include, but are not limited to, one or more of smart refrigerators, smart TVs, smart washing machines, smart speakers, smart phones, smart bracelets, etc. The communication connection established between the sofa 100 and each smart home device 110 may be a wireless communication connection, which may include, but is not limited to, a Wi-Fi communication connection, a cellular network connection, a Bluetooth communication connection, etc. By establishing a communication connection between the sofa 100 and the smart home devices 110, information exchange can be performed between the sofa 100 and the smart home devices 110.

[0061] The projector 120 may refer to a projection device used by the sofa 100 to project a virtual control panel. The projector 120 may be a 2D projector, a 3D projector, or other types of projectors, etc., which are not specifically limited here. It should be noted that the sofa 100 and / or the projector 120 are also provided with a recognition device, which can be used to recognize the specific operation of the user 130 on the projection content of the projector 120, and the recognition device may include but is not limited to a voice recognition device and a gesture recognition device, etc.

[0062] When the user needs to control any smart home device 110, the sofa 100 can perform a projection operation. The sofa 100 can determine the projection position and control the projector 120 to project the device layout diagram at the projection position in response to the projection operation triggered by the user 130. The device layout diagram may include one or more smart home devices 110, and the user can select the smart home device 110 to be controlled in the device layout diagram. The sofa 100 can control the projector 120 to project the virtual control panel corresponding to the smart home device 110 selected by the user at the projection position in response to the user 130's selection operation on the smart home device 110 in the device layout diagram. The virtual control panel may include one or more virtual control parts corresponding to the smart home device 110 selected by the user, which are used to realize the control function of the smart home device 110 selected by the user. The user can interact with the virtual control parts in the virtual control panel to realize remote control of the smart home device 110. The sofa 100 can send a control instruction corresponding to the control operation to the smart home device 110 in response to the user 130's control operation on the virtual control panel, so as to control the smart home device 110 to execute the first function corresponding to the control instruction.

[0063] like Figure 2 As shown, in one embodiment, a virtual control method for a smart home device is provided, which can be applied to a sofa in which a projector is arranged. The method may include the following steps:

[0064] Step 202, in response to the projection operation, determine a projection position, and control the projector to project the device layout diagram at the projection position.

[0065] When the user needs to control any smart home device, the user can perform a projection operation on the sofa. The projection operation may refer to an operation triggered by the user to control the projector to start projection. The triggering of the projection operation may include but is not limited to physical button control triggering, voice control triggering, posture detection triggering or gesture control triggering, etc.

[0066] The sofa can determine the projection position in response to the projection operation triggered by the user. The projection position may refer to the specific spatial position where the projector projects the projection content. For example, the projection position may include but is not limited to the sofa cushion surface, the sofa backrest surface, the floor plane in front of the sofa, or the wall behind the sofa, and any other surface around the sofa that is convenient for browsing and operation.

[0067] Optionally, the projection position may be a preset fixed position or a dynamically changing position.

[0068] In some embodiments, the sofa can obtain user location information in response to a projection operation triggered by the user, determine a projection location based on the user location information, and control the projector to project a device layout diagram corresponding to the indoor space where the sofa is located at the projection location. The user location information may include the relative position relationship between the user and the sofa, and / or the user's posture information on the sofa, etc.

[0069] For example, when the sofa detects that the user is sitting on the sofa, the sofa can detect the user's posture on the sofa and determine the projection position according to the posture. For example, the sofa can obtain pressure change information through a pressure sensor to determine that the user's posture on the sofa is a sitting posture and the position is the leftmost area of ​​the sofa. Therefore, the sofa can determine the projection position as the sofa armrest according to the above posture and position. Optionally, the sofa can also collect images through a camera, analyze the images to obtain the relative position of the user and the sofa, and thus determine the projection position.

[0070] After determining the projection position, the sofa can control the projector to project a device layout diagram at the projection position, and the device layout diagram may refer to an interface diagram of the layout of various smart home devices in the indoor space where the sofa is located. Optionally, the device layout diagram may include but is not limited to any one of a plan view, a stereo view, and a cross-sectional view.

[0071] The device layout diagram may include one or more smart home devices, which may be represented in the device layout diagram by one or more of a device icon, a device model, a device name, etc. Further, the device layout diagram may also include the spatial structure of the indoor space where the sofa is located, and display the position of each smart home device in the indoor space where the sofa is located, so as to reflect the specific layout of each smart home device in the indoor space where the sofa is located.

[0072] For example, Figure 3 A schematic diagram of a device layout diagram provided in an embodiment of the present application. Figure 3 As shown, in the device layout diagram 300 projected by the sofa control projector, a sofa icon 310 corresponding to the sofa can be displayed, and device icons 320 of one or more smart home devices can also be displayed. The display position of each device icon 320 in the device layout diagram 300 matches the position of the corresponding smart home device in the actual space. The user can remotely control each smart home device displayed on the projected device layout diagram 300.

[0073] Step 204 , in response to a selection operation on a first smart home device in the device layout diagram, controlling a projector to project a virtual control panel corresponding to the first smart home device at a projection position.

[0074] After the sofa controls the projector to project the device layout diagram at the projection position, the user can select any smart home in the device layout diagram for control. Taking the user selecting the first smart home device as an example, the first smart home device can be any smart home device. After the sofa recognizes the user's selection operation of selecting the first smart home device, the sofa responds to the selection operation and controls the projector to project the virtual control panel corresponding to the first smart home device at the projection position.

[0075] The selection operation may refer to an operation behavior of a user interacting with a device layout diagram, and the selection operation may include but is not limited to a voice selection operation or a gesture selection operation.

[0076] Exemplarily, when the projector is a 2D plane projection, after the sofa controls the projector to project a device layout diagram on the sofa, the user can click on the device icon of the first smart home device on the projected device layout diagram, and the sofa can respond to the user's gesture selection operation on the device icon of the first smart home device in the projected device layout diagram, and control the projector to project a virtual control panel corresponding to the first smart home device at the projection position.

[0077] The virtual control panel may include one or more virtual control parts, which correspond one to one with the physical control parts on the physical control panel of the smart home device, and each virtual control part may have the same control instructions as the corresponding physical control part. The virtual control part may refer to the virtual component on the virtual control panel that the user can interact with, and the virtual control part may include but is not limited to virtual buttons for control and virtual display screens for browsing, etc., to reflect the digitization of the physical control part.

[0078] For example, Figure 4 A schematic diagram of a virtual control panel provided in an embodiment of the present application. Figure 4 As shown, on the virtual control panel 400 projected by the projector, one or more virtual control unit icons 410 may be displayed, including virtual buttons 411 and a virtual display screen 412 , and the user may interact with the icons 410 of each virtual control unit displayed on the virtual control panel 400 .

[0079] Step 206: In response to the control operation on the virtual control panel, a control instruction corresponding to the control operation is sent to the first smart home device to control the first smart home device to perform the first function.

[0080] When the user determines that he wants to remotely control the first smart home device, he can perform control operations on the virtual control panel corresponding to the first smart home device. The sofa can recognize and respond to the user's control operation on the virtual control panel, and send a control instruction corresponding to the control operation to the first smart home device to control the first smart home device to perform the first function corresponding to the control instruction.

[0081] The control operation may refer to the operation behavior of the user interacting with the virtual control panel, and the control operation may include but is not limited to voice control operation or gesture control operation. The control instruction may refer to the corresponding instruction generated by the sofa according to the user's control operation on the virtual control panel, or may refer to the instruction corresponding to the virtual control part on the virtual control panel triggered by the user through the control operation. The first function may refer to the function corresponding to the control instruction currently executed or to be executed by the first smart home device. It can be understood that each smart home device may have multiple first functions, and different smart home devices may have different functions.

[0082] Exemplarily, the sofa can control the projector to display the virtual control panel of the smart speaker. In response to the user's swiping gesture operation on the virtual control panel, the sofa can send a volume reduction instruction corresponding to the swiping gesture operation to the smart speaker to control the smart speaker to lower the volume. When one or more virtual control parts are provided on the virtual control panel, the sofa can also respond to the user's click gesture operation on the virtual control part A on the virtual control panel, and send a switching instruction corresponding to the virtual control part A to the smart speaker to control the smart speaker to switch the audio content played.

[0083] In an embodiment of the present application, the sofa can project a device layout diagram and a virtual control panel of a first smart home device at a projection position in response to various operations triggered by the user, and control the first smart home device to execute a first function corresponding to the control instruction by sending a control instruction, so that the user can remotely control the smart home device intuitively through the virtual control panel on the sofa, thereby improving the user's smart home experience.

[0084] like Figure 5 As shown, in one embodiment, the sofa may include one or more pressure sensors. In response to the projection operation, determining the projection position may include the following steps:

[0085] Step 501 : in response to a projection operation, obtaining pressure signals respectively collected by one or more pressure sensors within a target time period.

[0086] The sofa may be provided with one or more pressure sensors, which may include but are not limited to piezoresistive sensors, piezoelectric sensors or capacitive sensors. In the case where the sofa is provided with multiple pressure sensors, the multiple pressure sensors may be respectively provided in different areas of the sofa, for example, the multiple pressure sensors may be evenly distributed on the seat cushion area and the backrest area of ​​the sofa. When a user is on the sofa, the pressure sensor in the sofa area corresponding to the user may collect the corresponding pressure signal.

[0087] When the sofa detects the projection operation triggered by the user, the sofa can obtain pressure signals collected in a target time period through one or more pressure sensors of the sofa. The length of the target time period can be set according to actual needs, or the target time period can also refer to the time period from when the user sits on the sofa to when the user triggers the projection operation.

[0088] The sofa can obtain the pressure changes of the sofa within the target time period by collecting the pressure signal within the target time period, thereby avoiding the misjudgment caused by the single sampling error of the pressure sensor or other factors, which helps to improve the accuracy of the pressure signal collected by the sofa, so that the projection position can be determined more accurately.

[0089] Step 503: Determine the pressure change information corresponding to each pressure sensor within the target time period according to the pressure signal collected by each pressure sensor.

[0090] The sofa can perform data preprocessing on the pressure signals collected by each pressure sensor to extract the pressure data corresponding to each pressure sensor within the target time period, obtain the pressure change curve corresponding to each pressure sensor within the target time period, and thus determine the pressure change information corresponding to each pressure sensor.

[0091] Data preprocessing may include but is not limited to removing outliers and filtering, etc. Pressure change information may refer to the change trend of the pressure value reflected by each pressure sensor over time.

[0092] Step 505: Determine the position and / or posture of the user on the sofa according to the corresponding pressure change information of each pressure sensor within the target time period.

[0093] Since the pressure change information corresponding to the pressure sensors at different positions on the sofa within the target time period is different, the sofa can determine the specific position and / or posture of the user on the sofa by processing and analyzing the pressure change information of each pressure sensor within the target time period.

[0094] For example, pressure sensor A, pressure sensor B, and pressure sensor C are evenly distributed on the cushion area of ​​the sofa, and the pressure data of pressure sensor A in the target time period increases from 0 to a fixed value and remains unchanged, and the pressure data of pressure sensor B and pressure sensor C are still 0, the sofa can determine that the user is sitting on the cushion area of ​​the sofa corresponding to pressure sensor A, and the user's posture on the sofa is sitting. When the pressure data of pressure sensor A gradually decreases to 0, the pressure data of the adjacent pressure sensor B begins to increase to a fixed value, and the pressure data of pressure sensor C is still 0, the sofa can determine that the user adjusts his sitting posture, and the user's position is adjusted from the cushion area corresponding to pressure sensor A to the cushion area corresponding to pressure sensor B.

[0095] Step 507: determine the projection position according to the position and / or posture of the user on the sofa.

[0096] The sofa can determine the position around the user that is suitable for projection and convenient for user operation as the projection position based on the user's position and / or posture on the sofa through statistical analysis methods, machine learning algorithms or preset projection positions.

[0097] The location suitable for projection around the user may refer to a sofa area or the surrounding area of ​​the sofa that is close to the user and has no obstacles or items stored; the location convenient for user operation may refer to a location that is within the user's reach.

[0098] Exemplarily, the sofa may be provided with a projection position mapping table, in which each combination of each position and / or posture on the sofa may correspond to a fixed projection position respectively. After the sofa detects the position and / or posture of the user on the sofa, the projection position may be directly determined according to the projection position mapping table. For example, when the user sits on the leftmost side of the sofa, the fixed projection position of the sofa is the left armrest of the sofa. When the user sits in the middle of the sofa, the fixed projection position of the sofa is the front area in the middle of the sofa.

[0099] In an embodiment of the present application, the sofa can process and analyze the pressure signals collected by one or more pressure sensors within a target time period, and determine the projection position by determining the position and / or posture of the user on the sofa. This can not only improve the accuracy of the projection position, but also facilitate the user to interact with the projection content, thereby improving the user's smart home experience.

[0100] like Figure 6 As shown, in one embodiment, before the step of determining the projection position in response to the projection operation, the above method may further include the following steps:

[0101] Step 602: scan one or more smart home devices within a preset range of the sofa, and establish a communication connection with each scanned smart home device.

[0102] The sofa can scan one or more smart home devices within a preset range and establish communication connections with each scanned smart home device that has never established a communication connection with the sofa. The preset range can refer to the indoor space range where the sofa is located or the space range defined by the user. The user can manually establish a communication connection between the sofa and each scanned smart home device that has never established a communication connection with the sofa; if the smart home device has a historical communication connection record with the sofa, the sofa can automatically establish a communication connection with the smart home device without scanning.

[0103] Exemplarily, smart home device A has established a communication connection with the sofa, but smart home device B has not established a communication connection with the sofa. Therefore, the sofa can automatically establish a communication connection with smart home device A. The sofa scans the smart home device B within a preset range, and the user manually establishes a communication connection between the sofa and smart home device B.

[0104] Step 604: receiving device information and location information sent by each smart home device that has established a communication connection with the sofa.

[0105] After establishing a communication connection with the sofa, each smart home device can send corresponding device information and location information to the sofa, and the sofa can receive the device information and location information sent by each smart home device with which the communication connection has been established.

[0106] Device information may refer to various data and characteristics of the smart home device itself. Device information may include but is not limited to device identification code, device model and device working status.

[0107] The location information may refer to the location of the smart home device in the indoor space where the sofa is located. The location information may include but is not limited to the coordinates of the smart home device and the distance between the smart home device and the sofa.

[0108] Step 606, generating a device layout diagram according to the device information and location information corresponding to each smart home device and the layout information of the indoor space where the sofa is located.

[0109] The sofa can generate an interface diagram according to the layout information of the indoor space where the sofa is located, and then mark the device icon, device model, device name and other information of each smart home device on the interface diagram according to the device information and location information corresponding to each smart home device to form a device layout diagram.

[0110] The layout information of the indoor space where the sofa is located may include but is not limited to structural parameters of the indoor space such as wall and door and window distribution, and the interface diagram may refer to a two-dimensional or three-dimensional visual diagram generated according to the layout information of the indoor space where the sofa is located. Optionally, the sofa may transmit a radio frequency signal to the indoor space where the sofa is located through a signal transceiver, and receive reflected signals from each reflection point in the indoor space, thereby determining the layout information of the indoor space where the sofa is located. The layout information of the indoor space where the sofa is located may also be imported by a user, but is not limited thereto.

[0111] For example, Figure 7 This is a schematic diagram of a layout diagram of a generating device provided in an embodiment of the present application. Figure 7 As shown, the sofa can first generate an interface diagram 700 according to the layout information of the indoor space where the sofa is located imported by the user, and then mark the device icon 750 of the sofa and the device icon 770 of the smart home device A in the living room area 720 on the interface diagram 700, mark the device icon 780 of the smart home device B in the kitchen area 710, and mark the device icon 760 of the smart home device C in the bedroom area 730 according to the device information and location information sent by each smart home device that establishes a communication connection with the sofa, thereby forming a device layout diagram 740.

[0112] In an embodiment of the present application, the sofa can generate a device layout map by using the device information and location information of each smart home device that establishes a communication connection with the sofa within a preset range, as well as the layout information of the indoor space where the sofa is located. This can intuitively display to the user the distribution and configuration of each smart home device connected to the sofa, thereby improving the user's ability to manage and control each smart home device and enhancing the user's smart home experience.

[0113] like Figure 8 As shown, in one embodiment, after the step of receiving the device information and location information sent by each smart home device that establishes a communication connection with the sofa, the following steps may also be included:

[0114] Step 802, according to the device information corresponding to the third smart home device, search in the database whether there is a virtual control panel corresponding to the third smart home device, if not, execute step 804, if yes, execute step 810.

[0115] In the process of generating the device layout diagram, the sofa can search in the database whether there is a virtual control panel corresponding to the third smart home device according to the device identification code in the device information corresponding to the third smart home device. If so, when the sofa responds to the user's selection operation of the third smart home device on the device layout diagram, the sofa can directly call the virtual control panel corresponding to the third smart home device stored in the database and control the projector to project the virtual control panel; if not, subsequent steps are required to generate a virtual control panel corresponding to the third smart home device. The third smart home device can refer to any smart home device that establishes a communication connection with the sofa.

[0116] Step 804: Send a control information acquisition request to the third smart home device.

[0117] The sofa can send a control information acquisition request to the third smart home device to control the third smart home device to send control information corresponding to the third smart home device to the sofa.

[0118] The control information acquisition request may be used to instruct the third smart home device to send control information corresponding to the third smart home device to the sofa, where the control information may include a control instruction set and physical control information.

[0119] The control instruction set may refer to a set of control instructions used by the third smart home device to implement various functions.

[0120] The physical control information may refer to information related to the physical control panel on the third smart home device, and the physical control information may include layout information of the physical control panel of the third smart home device. Further, the physical control information may include physical parameters corresponding to one or more physical control parts of the third smart home device, wherein the physical control part may refer to a physical part on the physical control panel of the third smart home device that a user can interact with, and the physical control part may include but is not limited to buttons, knobs, and display screens on the physical control panel. The physical parameters may include but are not limited to the size of the physical control part and the operation mode of the physical control part.

[0121] Optionally, when the sofa sends a control information acquisition request to the third smart home device, the sofa can also control the projector to project a control information import request, and the control information import request can be used to instruct the user to import the control information corresponding to the third smart home device to the sofa.

[0122] Step 806: Receive a control instruction set and physical control information sent by a third smart home device.

[0123] The third smart home device can send a control instruction set and physical control information to the sofa according to the control information acquisition request, and the sofa can receive the control instruction set and physical control information.

[0124] Optionally, the sofa can receive a control instruction set sent by a third smart home device, and the physical control information of the third smart home device can be manually imported into the sofa by the user, or both the control instruction set and the physical control information of the third smart home device can be manually imported into the sofa by the user, but is not limited to this.

[0125] Step 808: Generate a virtual control panel corresponding to the third smart home device according to the control instruction set and the physical control information, and save the virtual control panel corresponding to the third smart home device.

[0126] The sofa can generate a virtual layout panel corresponding to the third smart home device according to the physical parameters corresponding to one or more physical control parts included in the physical control information.

[0127] The virtual layout panel may refer to a digital panel generated according to various physical parameters of the physical control panel, and the virtual layout panel may include display icons of one or more virtual control parts.

[0128] According to the control instruction set, the sofa can establish a mapping relationship between the control instruction set and the virtual layout panel to form a virtual control panel corresponding to the third smart home device, and can save the virtual control panel in the sofa's database.

[0129] In some embodiments, Fig. 9 As shown, step 808 may include steps 901 to 905:

[0130] Step 901: Generate a virtual control unit corresponding to each physical control unit according to physical parameters corresponding to one or more physical control units.

[0131] The sofa can generate virtual control parts corresponding to each physical control part on the virtual layout panel according to the physical parameters corresponding to each physical control part on the physical control panel. Furthermore, the virtual control part can be generated only according to some physical parameters of the physical control part, for example, the virtual control part can be generated only according to the size of the corresponding physical control part.

[0132] For example, Fig.10 A schematic diagram of generating a virtual control unit provided in an embodiment of the present application. Fig.10 As shown, in the case where the third smart home device is a smart washing machine, the physical control panel 1000 of the smart washing machine may include three physical control parts, namely an on / off button 1010, a mode selection knob 1020 and a time display screen 1030. The sofa can generate a virtual button 1050 and a virtual display screen 1070 with the same size and operation mode on the virtual layout panel 1040 according to the corresponding sizes and operation modes of the on / off button 1010 and the time display screen 1030. The sofa can generate a virtual knob 1060 with the same size as the knob 1020 but a different operation mode on the virtual layout panel 1040 according to the size of the mode selection knob 1020 and a preset new operation mode.

[0133] Step 903: Establish a mapping relationship between each virtual control unit and each control instruction according to each control instruction included in the control instruction set.

[0134] Sofa can establish a mapping relationship between each virtual control unit and each control instruction based on the one-to-one correspondence between the physical control unit and the virtual control unit, and the mapping relationship between each physical control unit and each control instruction included in the control instruction set, so that the virtual control unit has the same function as the corresponding physical control unit.

[0135] The mapping relationship may refer to the corresponding relationship between each physical control unit or virtual control unit and each control instruction. One physical control unit or virtual control unit may have a mapping relationship with one or more control instructions.

[0136] Exemplarily, after the sofa generates a virtual on / off key according to the physical parameters of the physical on / off key of the smart washing machine, it can establish a mapping relationship between the virtual on / off key and the on / off control instruction according to the mapping relationship between the physical on / off key and the on / off control instruction, so that the sofa can respond to the user's control operation on the virtual on / off key to control the smart washing machine to turn on or off.

[0137] Furthermore, after establishing the mapping relationship between each virtual control unit and each control instruction, the sofa can also establish the mapping relationship between each control operation of the user on the virtual control unit and each control instruction according to each control operation of the user on each virtual control unit. It should be noted that different types of virtual control units can be pre-configured with corresponding types of gesture control operations. For example, the control operation corresponding to the virtual button can be a click gesture operation, and the control operation corresponding to the virtual knob can be a slide gesture operation, but it is not limited thereto.

[0138] Exemplarily, the physical mode selection knob of the smart washing machine has two functional gears: strong wash and standard wash. Therefore, after establishing a mapping relationship between the mode selection virtual knob of the smart washing machine and the strong wash control instructions and the standard wash control instructions, the sofa can establish a mapping relationship between the user's left swipe gesture operation on the mode selection virtual knob and the strong wash control instructions, and a mapping relationship between the user's right swipe gesture operation on the mode selection virtual knob and the standard wash control instructions according to the user's left swipe gesture operation and right swipe gesture operation on the mode selection virtual knob, so that the sofa can control the smart washing machine to perform strong wash or standard wash in response to the user's left swipe or right swipe gesture operation on the mode selection virtual knob.

[0139] Step 905: Generate a virtual control panel corresponding to the third smart home device according to each virtual control unit and the mapping relationship between each virtual control unit and each control instruction.

[0140] Sofa can generate a virtual control panel corresponding to the third smart home device according to the one-to-one correspondence between each physical control unit and each virtual control unit on the virtual layout panel, the mapping relationship between each physical control unit and each control instruction, and the mapping relationship between each virtual control unit and each control instruction.

[0141] Through the above steps of generating a virtual control panel, not only can the user directly and efficiently control the smart home devices through the various virtual control parts of the virtual control panel, but also due to the similarity between the virtual control panel and the physical control panel, the user's learning cost and difficulty of using the virtual control panel of the sofa can be reduced, thereby improving the user's smart home experience.

[0142] Step 810: confirm the virtual control panel corresponding to the third smart home device.

[0143] The sofa can search the virtual control panel corresponding to the third smart home device in the database according to the device identification code in the device information corresponding to the third smart home device.

[0144] If there is a virtual control panel corresponding to the third smart home device in the database, the sofa can directly call the virtual control panel corresponding to the third smart home device stored in the database in response to the user's selection operation on the third smart home device on the device layout diagram, and control the projector to project the virtual control panel.

[0145] In an embodiment of the present application, when the sofa cannot find the virtual control panel corresponding to the third smart home device in the database, it can generate a virtual control panel corresponding to the third smart home device according to the control instruction set and physical control information of the third smart home device, so that the sofa can remotely control each smart home device that has established a communication connection with the sofa, thereby expanding the number of smart home devices that can be virtually controlled by the sofa, achieving wide compatibility with various categories of smart home devices, further simplifying the user's control process of smart home devices, and improving the user's smart home experience.

[0146] like Fig.11 As shown, in one embodiment, another virtual control method of smart home devices is provided, which can be applied to a sofa. The method may include the following steps:

[0147] Step 1101, in response to a projection operation, determining a projection position, and controlling a projector to project a device layout diagram at the projection position.

[0148] Step 1103: In response to a selection operation on a fourth smart home device in the device layout diagram, control the projector to project a virtual control panel corresponding to the fourth smart home device at a projection position.

[0149] The fourth smart home device is any smart home device.

[0150] Step 1105: In response to the control operation on the virtual control panel, a control instruction corresponding to the control operation is sent to the fourth smart home device to control the fourth smart home device to perform the first function.

[0151] Step 1107: Receive location information sent by the fourth smart home device.

[0152] The sofa can send a location update instruction to the fourth smart home device, and the fourth smart home device can send location information corresponding to the fourth smart home device to the sofa according to the location update instruction.

[0153] Optionally, the fourth smart home device may also actively send location information to the sofa when detecting that its own location has changed; the fourth smart home device may also periodically send location information to the sofa, but is not limited thereto.

[0154] Optionally, the fourth smart home device may send the location information during the execution of the first function, or may send the location information after the first function is executed, but is not limited thereto.

[0155] Step 1109: Update the display mark of the fourth smart home device on the device layout diagram according to the location information corresponding to the fourth smart home device.

[0156] The sofa can update the display mark of the fourth smart home device on the device layout diagram according to the received location information sent by the fourth smart home device and the historical location information corresponding to the fourth smart home device.

[0157] The historical location information may refer to location information previously sent by the fourth smart home device. The display mark may be used to indicate the fourth smart home device on the device layout diagram, and the display mark may include but is not limited to information such as the device icon, device model, device name, and device location of the fourth smart home device.

[0158] Optionally, the display mark also includes a first display mark and a second display mark, the first display mark may be a display mark updated by the fourth smart home device on the device layout diagram, and the second display mark may be a historical display mark of the fourth smart home device on the device layout diagram. When the location information and the historical location information of the fourth smart home device are different, Sofa may display the first display mark and the second display mark of the fourth smart home device on the device layout diagram, and the first display mark and the second display mark may be different from the display marks of other smart home devices on the device layout diagram.

[0159] Exemplarily, each smart home device can be marked with a rectangular display mark on the device layout diagram to indicate the location information corresponding to each smart home device. When the sofa receives the location information sent by the fourth smart home device, and the current location information and the historical location information are different, the sofa can display the location information of the fourth smart home device on the device layout diagram with a triangular display mark, and display the location information of the fourth smart home device on the device layout diagram with a circular display mark.

[0160] Furthermore, the sofa can also receive status information sent by the fourth smart home device, where the status information is used to indicate the operating status of the fourth smart home device. When the sofa updates the display mark of the fourth smart home device on the device layout diagram, the display mark can also display the operating status of the fourth smart home device.

[0161] In an embodiment of the present application, during the virtual control process of the smart home devices, the sofa can receive the location information sent by the fourth smart home device, so that the sofa can timely update the location of the fourth smart home device on the device layout diagram, so that when the user views the device layout diagram, the real-time distribution of each smart home device can be more intuitively grasped without personally confirming each smart home device, so that the user can remotely control each smart home device more efficiently, thereby improving the user's smart home experience.

[0162] like Fig.12 As shown, in one embodiment, another virtual control method of a smart home device is provided, which can be applied to a sofa. The method may include the following steps:

[0163] Step 1202, in response to the projection operation, determine a projection position, and control the projector to project the device layout diagram at the projection position.

[0164] Step 1204: In response to a selection operation on a second smart home device in the device layout diagram, control the projector to project a virtual control panel corresponding to the second smart home device at a projection position.

[0165] The second smart home device is any smart home device.

[0166] Step 1206: In response to the control operation on the virtual control panel, a control instruction corresponding to the control operation is sent to the second smart home device to control the second smart home device to perform the first function.

[0167] Step 1208: Receive a control request sent by the second smart home device.

[0168] The control request may refer to a request instruction from the second smart home device requesting the sofa to perform subsequent control.

[0169] The second smart home device may send a control request to the sofa after completing the execution of the first function; the second smart home device may also send a control request to the sofa when the execution of the first function is frustrated, such as when the execution of the first function is interrupted.

[0170] Step 1210: According to the control request, control the projector to project a virtual control panel corresponding to the second smart home device at the projection position.

[0171] When the sofa receives a control request corresponding to the second smart home device, the sofa can skip the step of responding to the projection operation or selection operation triggered by the user, and directly control the projector to project the virtual control panel corresponding to the second smart home device at the projection position.

[0172] Furthermore, after receiving the control request corresponding to the second smart home device, the sofa can also redetermine the projection position according to the user's current position and / or posture on the sofa, and control the projector to project the virtual control panel corresponding to the second smart home device at the new projection position.

[0173] Step 1212: Display control inquiry information corresponding to the control request in the virtual control panel.

[0174] After projecting the virtual control panel, the sofa can display the control inquiry information of the second smart home device in the virtual control panel.

[0175] The control inquiry information may be used to instruct the user to determine whether to control the second smart home device to execute the second function corresponding to the control request. The second function may refer to the next function executed by the second smart home device after executing the first function, the second function may be the next function preset by the second smart home device for the first function, or the next function selected by the user after selecting the first function on the virtual control panel.

[0176] Optionally, when the sofa displays and controls the query information in the virtual control panel, the execution result of the second smart home device executing the first function can also be displayed, and the execution result may include but is not limited to the execution time and execution process data.

[0177] Optionally, when the sofa displays the control inquiry information in the virtual control panel, it can also play a reminder voice corresponding to the control inquiry information through an audio playback device such as a microphone to remind the user to promptly determine whether to control the second smart home device to execute the second function corresponding to the control request.

[0178] Exemplarily, after completing the powerful wash function, the smart washing machine sends a control request to the sofa. After receiving the control request of the smart washing machine, the sofa controls the projector to project the virtual control panel corresponding to the smart washing machine. The start time and end time of the powerful wash function of the smart washing machine, as well as the control inquiry information of the dehydration function or the drying function are displayed on the virtual control panel, and a reminder voice is issued to ask the user whether to execute the dehydration function or the drying function after the powerful wash function.

[0179] In an embodiment of the present application, the sofa can, in the virtual control of the smart home device, after controlling the second smart home device to execute the first function, directly control the projector to project the virtual control panel corresponding to the second smart home device according to the control request sent by the second smart home device, and display the control query information corresponding to the control request in the virtual control panel, so as to realize the instant feedback of the control result of the second smart home device by the sofa, so that the user can perform subsequent control of the second smart home device on the sofa, thereby reducing the user's operation steps and time cost, and improving the user's smart home experience.

[0180] Based on the virtual control method of smart home devices provided in the above embodiment, Fig.13 This is a block diagram of a virtual control device for a smart home device provided in an embodiment of the present application. Fig.13 As shown, in one embodiment, a virtual control device 1300 of a smart home device is provided. The virtual control device 1300 of the smart home device is applied to a sofa in which a projector is arranged. The virtual control device 1300 of the smart home device includes a first projection module 1301, a second projection module 1302 and a control module 1303.

[0181] Among them, the first projection module 1301 is used to determine the projection position in response to the projection operation, and control the projector to project the device layout diagram at the projection position; the device layout diagram includes one or more smart home devices.

[0182] The second projection module 1302 is used to control the projector to project a virtual control panel corresponding to the first smart home device at a projection position in response to a selection operation on the first smart home device in the device layout diagram, where the first smart home device is any smart home device.

[0183] The control module 1303 is used to send a control instruction corresponding to the control operation to the first smart home device in response to the control operation on the virtual control panel, so as to control the first smart home device to perform the first function.

[0184] In some embodiments, the virtual control device 1300 of the smart home device also includes an information receiving module and a control inquiry module.

[0185] The information receiving module is used to receive a control request sent by a second smart home device; the second smart home device is any smart home device.

[0186] The second projection module 1302 is further used to control the projector to project a virtual control panel corresponding to the second smart home device at the projection position according to the control request.

[0187] The control inquiry module is used to display control inquiry information corresponding to the control request in the virtual control panel, and the control inquiry information is used to instruct the user to determine whether to control the second smart home device to execute the second function corresponding to the control request.

[0188] In some embodiments, the virtual control device 1300 of the smart home device also includes a communication connection module and a layout generation module.

[0189] The communication connection module is used to scan one or more smart home devices within a preset range of the sofa and establish a communication connection with each scanned smart home device.

[0190] The information receiving module is also used to receive device information and location information sent by various smart home devices that establish communication connection with the sofa.

[0191] The layout generation module is used to generate a device layout diagram according to the device information and location information corresponding to each smart home device and the layout information of the indoor space where the sofa is located.

[0192] In some embodiments, the virtual control device 1300 of the smart home device also includes a device search module, an information sending module and a panel generation module.

[0193] The device search module is used to search in the database whether there is a virtual control panel corresponding to the third smart home device according to the device information corresponding to the third smart home device; the third smart home device is any smart home device that establishes a communication connection with the sofa.

[0194] The information sending module is used to send a control information acquisition request to the third smart home device when there is no virtual control panel corresponding to the third smart home device in the database. The control information acquisition request is used to instruct the third smart home device to send a control instruction set and physical control information to the sofa.

[0195] The information receiving module is also used to receive a control instruction set and physical control information sent by a third smart home device.

[0196] The panel generation module is used to generate a virtual control panel corresponding to the third smart home device according to the control instruction set and the physical control information, and save the virtual control panel corresponding to the third smart home device.

[0197] In some embodiments, the virtual control device 1300 of the smart home device also includes a virtual control unit generation module and a mapping establishment module.

[0198] The virtual control unit generation module is used to generate a virtual control unit corresponding to each physical control unit according to physical parameters corresponding to one or more physical control units.

[0199] The mapping establishment module is used to establish a mapping relationship between each virtual control unit and each control instruction according to each control instruction included in the control instruction set.

[0200] The panel generation module is also used to generate a virtual control panel corresponding to the third smart home device according to each virtual control unit and the mapping relationship between each virtual control unit and each control instruction.

[0201] In some embodiments, the virtual control device 1300 of the smart home device also includes a layout update module.

[0202] The information receiving module is also used to receive location information sent by a fourth smart home device, where the fourth smart home device is any smart home device.

[0203] The layout update module is also used to update the display mark of the fourth smart home device on the device layout diagram according to the location information corresponding to the fourth smart home device, and the display mark is used to indicate the real-time location of the fourth smart home device on the device layout diagram.

[0204] In some embodiments, the virtual control device 1300 of the smart home device further includes a pressure signal acquisition module, a pressure information determination module, a position posture determination module and a projection position determination module.

[0205] The pressure signal acquisition module is used to obtain pressure signals respectively acquired by one or more pressure sensors within a target time period in response to the projection operation.

[0206] The pressure information determination module is used to determine the pressure change information corresponding to each pressure sensor within a target time period according to the pressure signal collected by each pressure sensor.

[0207] The position and posture determination module is used to determine the position and / or posture of the user on the sofa according to the corresponding pressure change information of each pressure sensor within the target time period.

[0208] The projection position determination module is used to determine the projection position according to the position and / or posture of the user on the sofa.

[0209] Fig.14 This is a structural block diagram of a sofa provided in an embodiment of the present application. Fig.14 As shown, the sofa 1400 may include a memory 1402 and a processor 1401. The memory 1402 stores a computer program. When the computer program is executed by the processor 1401, the sofa 1400 implements the virtual control method of the smart home device described in the above embodiments.

[0210] Processor 1401 may include one or more processing cores. Processor 1401 uses various interfaces and lines to connect various parts of the entire sofa, and executes various functions of the sofa and processes data by running or executing instructions, programs, code sets or instruction sets stored in the memory, and calling data stored in the memory. Optionally, processor 1401 can be implemented in at least one hardware form of digital signal processing, field programmable gate array, and programmable logic array. Processor 1401 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 1401, and may be implemented separately through a communication chip.

[0211] The memory 1402 may include a random access memory or a read-only memory. The memory may be used to store instructions, programs, codes, code sets or instruction sets. The memory may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function, instructions for implementing the above-mentioned various method embodiments, etc. The data storage area may also store data created by the sofa during use, etc.

[0212] An embodiment of the present application discloses a computer-readable storage medium storing a computer program, wherein when the computer program is executed by a processor, the processor implements the virtual control method of the smart home device as described in the above embodiments.

[0213] An embodiment of the present application discloses a computer program product, which includes a computer program. When the computer program can be executed by a processor, the processor implements the virtual control method of the smart home device described in the above embodiments.

[0214] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The storage medium can be a disk, an optical disk, a ROM, etc.

[0215] The above description is only a specific example of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. A virtual control method for smart home devices, characterized in that: Applied to a sofa, wherein a projector is provided in the sofa, the method comprises: In response to the projection operation, a projection position is determined, and the projector is controlled to project a device layout diagram at the projection position; the device layout diagram includes one or more smart home devices; In response to a selection operation of a first smart home device in the device layout diagram, controlling the projector to project a virtual control panel corresponding to the first smart home device at the projection position, the first smart home device being any of the smart home devices; In response to a control operation on the virtual control panel, a control instruction corresponding to the control operation is sent to the first smart home device to control the first smart home device to perform a first function.

2. The method according to claim 1, characterized in that The method further comprises: Receiving a control request sent by a second smart home device; the second smart home device is any of the smart home devices; According to the control request, controlling the projector to project a virtual control panel corresponding to the second smart home device at the projection position; Control inquiry information corresponding to the control request is displayed in the virtual control panel, where the control inquiry information is used to instruct a user to determine whether to control the second smart home device to perform a second function corresponding to the control request.

3. The method according to claim 1, characterized in that Before determining the projection position in response to the projection operation, the method further includes: Scanning one or more smart home devices within a preset range of the sofa, and establishing a communication connection with each scanned smart home device; Receiving device information and location information sent by each smart home device that establishes a communication connection with the sofa; A device layout diagram is generated according to the device information and location information corresponding to each smart home device and the layout information of the indoor space where the sofa is located.

4. The method according to claim 3, characterized in that After receiving the device information and location information sent by each smart home device that establishes a communication connection with the sofa, the method further includes: According to the device information corresponding to the third smart home device, searching in the database whether there is a virtual control panel corresponding to the third smart home device; the third smart home device is any smart home device that establishes a communication connection with the sofa; If not, sending a control information acquisition request to the third smart home device, wherein the control information acquisition request is used to instruct the third smart home device to send a control instruction set and physical control information to the sofa; Receiving a control instruction set and physical control information sent by the third smart home device; A virtual control panel corresponding to the third smart home device is generated according to the control instruction set and the physical control information, and the virtual control panel corresponding to the third smart home device is saved.

5. The method according to claim 4, characterized in that The control instruction set includes one or more control instructions; the physical control information includes physical parameters corresponding to one or more physical control parts included in the third smart home device; and generating a virtual control panel corresponding to the third smart home device according to the control instruction set and the physical control information includes: Generate virtual control parts corresponding to each of the physical control parts according to the physical parameters corresponding to the one or more physical control parts; According to each control instruction included in the control instruction set, a mapping relationship between each virtual control unit and each control instruction is established; A virtual control panel corresponding to the third smart home device is generated according to each of the virtual control parts and the mapping relationship between each of the virtual control parts and the control instructions.

6. The method according to claim 1, characterized in that The method further comprises: Receiving location information sent by a fourth smart home device, where the fourth smart home device is any of the smart home devices; According to the location information corresponding to the fourth smart home device, a display mark of the fourth smart home device is updated on the device layout diagram, and the display mark is used to indicate the real-time location of the fourth smart home device on the device layout diagram.

7. The method according to claim 1, characterized in that The sofa further includes one or more pressure sensors; and in response to the projection operation, determining the projection position includes: In response to the projection operation, obtaining pressure signals respectively collected by the one or more pressure sensors within a target time period; Determine, according to the pressure signals collected by each of the pressure sensors, the pressure change information corresponding to each of the pressure sensors within the target time period; Determine the position and / or posture of the user on the sofa according to the pressure change information corresponding to each of the pressure sensors within the target time period; The projection position is determined according to the position and / or posture of the user on the sofa.

8. A virtual control device for smart home equipment, characterized in that: Applied to a sofa, wherein a projector is arranged in the sofa, the device comprises: A first projection module, configured to determine a projection position in response to a projection operation, and control the projector to project a device layout diagram at the projection position; the device layout diagram includes one or more smart home devices; a second projection module, configured to control the projector to project a virtual control panel corresponding to the first smart home device at the projection position in response to a selection operation on the first smart home device in the device layout diagram, wherein the first smart home device is any of the smart home devices; The control module is used to send a control instruction corresponding to the control operation to the first smart home device in response to the control operation on the virtual control panel, so as to control the first smart home device to perform a first function.

9. A sofa, characterized in that: It includes a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor implements the virtual control method of the smart home device according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the processor implements the virtual control method for a smart home device as described in any one of claims 1 to 7.

Images