Composite sensing device, home system and method for detecting object

By combining directed ultrasonic sensors and infrared sensors in the composite sensing device, the problem of fixing and single function of traditional sensor detection areas is solved, efficient perception of multiple areas and object counting is achieved, cost reduction and smart home improvement System application complexity.

CN118962835APending Publication Date: 2024-11-15HUOSHENG IND TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310526137.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-10
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

Traditional ultrasonic sensors have fixed and independent detection areas, and are costly; infrared sensors cannot prevent pets and have a single function, and cannot effectively cover multiple areas. The sensors in the human body are costly and have a single application.

Method used

A composite sensing device is designed, including a first ultrasonic sensor, a second ultrasonic sensor and an infrared sensor in the housing, which respectively detect different regions in a directional manner, and generate and send existing information through processing modules and communication modules to realize perception of multiple regions. and object count.

Benefits of technology

It improves the sensor perception ability, reduces costs, enhances the coverage of multiple areas, avoids accidental triggering of pets, and realizes more complex smart home system applications.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118962835A_ABST
    Figure CN118962835A_ABST
Patent Text Reader

Abstract

The invention relates to a composite sensing device, a home system and a method for detecting an object, the device comprises a shell and a processing module arranged in the shell, and the device is characterized by further comprising a first ultrasonic sensor, a second ultrasonic sensor and an infrared sensor which are arranged in the shell, the processing module is connected with the first ultrasonic sensor, the second ultrasonic sensor and the infrared sensor. The first ultrasonic sensor is oriented to send and sense ultrasonic signals towards a first area. The second ultrasonic sensor is oriented to send and sense ultrasonic signals towards a second area which is not overlapped with the first area; and the infrared sensor is oriented to sense an infrared radiation signal in a third region, and the third region has overlapping portions with the first region and the second region, respectively.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of sensors, and in particular, to a composite sensing device, a home system, and a method for detecting an object by using the composite sensing device. Background Art

[0002] Traditional sensors include (passive) infrared sensors and ultrasonic sensors. However, the detection area of ​​ultrasonic sensors is generally fixed, and each ultrasonic sensor works independently. There is a lack of connection between many ultrasonic waves, and one sensor can generally only serve the current detection area. Therefore, a smart home system requires many ultrasonic sensors to ensure coverage, and the cost is also rising. On the other hand, traditional infrared sensors cannot prevent pets, and these infrared sensors are only for a single space and a single control function.

[0003] There are also some sensors using millimeter wave radar technology in the prior art, but the cost of using this technology to realize a full-fledged human presence sensor is usually high, and the application method is relatively single.

[0004] In view of this, an improved sensing device is needed. Summary of the invention

[0005] The embodiments of the present application provide a composite sensing device, a home system, and a method for detecting an object through the composite sensing device, which are used to improve the perception capability of the sensor.

[0006] According to one aspect of the present application, a composite sensing device is provided, the device comprising a housing and a processing module disposed in the housing. The device further comprises a first ultrasonic sensor, a second ultrasonic sensor and an infrared sensor disposed in the housing, and the processing module is connected to the first ultrasonic sensor, the second ultrasonic sensor and the infrared sensor respectively, wherein: the first ultrasonic sensor is oriented to send and sense ultrasonic signals toward a first area; the second ultrasonic sensor is oriented to send and sense ultrasonic signals toward a second area that does not overlap with the first area; and the infrared sensor is oriented to sense infrared radiation signals in a third area, wherein the third area has overlapping portions with the first area and the second area respectively.

[0007] In some embodiments of the present application, optionally, the device further includes: an infrared mask, which is arranged around the infrared sensor and forms a transmission area that can transmit the infrared radiation signal.

[0008] In some embodiments of the present application, optionally, the shell has a circular outline, and the infrared sensor is arranged at the center of the shell.

[0009] In some embodiments of the present application, optionally, the first ultrasonic sensor and the second ultrasonic sensor are arranged symmetrically along the radial direction of the shell and relative to the infrared sensor.

[0010] In some embodiments of the present application, optionally, the shell includes a first chamber and a second chamber, and the first ultrasonic sensor is disposed in the first chamber, and the second ultrasonic sensor is disposed in the second chamber.

[0011] In some embodiments of the present application, optionally, the processing module receives sensing signals about an object from the first ultrasonic sensor, the second ultrasonic sensor and the infrared sensor to generate presence information about the object from the first ultrasonic sensor, the second ultrasonic sensor and the infrared sensor respectively.

[0012] In some embodiments of the present application, optionally, the device further comprises a communication module disposed in the housing, and the communication module is connected to the processing module to send the presence information.

[0013] In some embodiments of the present application, optionally, the communication module is configured to send the presence information at a predetermined time interval.

[0014] In some embodiments of the present application, optionally, the communication module is also configured to receive presence information from other composite sensing devices, and the processing module is configured to generate control commands and / or counts about the object based on the presence information and / or presence information from other composite sensing devices; and the communication module is also configured to send the control commands and / or the counts.

[0015] According to another aspect of the present application, a home system is provided, which includes a sensor gateway and any composite sensing device described above, wherein the composite sensing device can be connected to the sensor gateway.

[0016] In some embodiments of the present application, optionally, the system also includes: a door lock that can be connected to the sensor gateway, which is arranged at the boundary of the defense zone and configured to perform identity verification for the object; and an arming unit that is configured to cancel security when the object passes the identity verification.

[0017] In some embodiments of the present application, optionally, the arming unit is further configured to receive presence information from the composite sensing device via the sensor gateway, and determine a movement trajectory of the object based on the presence information.

[0018] In some embodiments of the present application, optionally, the defense unit is configured to determine the movement trajectory according to a sequence of existence information of the first ultrasonic sensor and the second ultrasonic sensor.

[0019] In some embodiments of the present application, optionally, the arming unit enables security when the movement trajectory points outside the defense zone and no presence information is received from the composite sensing device for more than a predetermined time.

[0020] In some embodiments of the present application, optionally, the system further comprises: a server that can be connected to the sensor gateway and is configured to receive and store the presence information from the composite sensing device via the sensor gateway.

[0021] In some embodiments of the present application, optionally, the system further includes: a mobile terminal configured to receive the presence information from the server and determine a movement trajectory of the object according to the presence information.

[0022] According to another aspect of the present application, a method for detecting an object by a composite sensing device is provided. The device includes a first ultrasonic sensor, a second ultrasonic sensor, and an infrared sensor, and the method includes the following steps: directing the first ultrasonic sensor to send and sense ultrasonic signals toward a first area; directing the second ultrasonic sensor to send and sense ultrasonic signals toward a second area that does not overlap with the first area; and directing the infrared sensor to sense infrared radiation signals in a third area, wherein the third area has overlapping portions with the first area and the second area, respectively.

[0023] In some embodiments of the present application, optionally, the method further includes: generating presence information about the object from the first ultrasonic sensor, the second ultrasonic sensor and the infrared sensor respectively according to sensing signals about the object from the first ultrasonic sensor, the second ultrasonic sensor and the infrared sensor.

[0024] In some embodiments of the present application, optionally, the method further includes: sending the presence information at predetermined time intervals.

[0025] In some embodiments of the present application, optionally, the method further includes: receiving presence information from other composite sensing devices; generating a control command and / or a count regarding the object based on the presence information and / or presence information from other composite sensing devices.

[0026] In some embodiments of the present application, optionally, the method further includes: determining a movement trajectory of the object according to the existence information.

[0027] In some embodiments of the present application, optionally, the movement trajectory is determined according to a sequence of existence information of the first ultrasonic sensor and the second ultrasonic sensor.

[0028] In some embodiments of the present application, optionally, the method further includes: enabling security when the movement trajectory points to outside the defense zone and no presence information is received from the composite sensing device for more than a predetermined time.

[0029] According to another aspect of the present application, a computer-readable storage medium is provided, wherein instructions are stored in the computer-readable storage medium, and wherein when the instructions are executed by a processor, the processor is caused to execute any one of the methods described above. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The above and other objects and advantages of the present application will become more fully apparent from the following detailed description in conjunction with the accompanying drawings, wherein the same or similar elements are represented by the same reference numerals.

[0031] Figure 1 A composite sensing device according to an embodiment of the present application is shown;

[0032] Figure 2 A composite sensing device according to an embodiment of the present application is shown;

[0033] Figure 3 The detection area of ​​the composite sensing device according to one embodiment of the present application is shown;

[0034] Figure 4-6 The application scenario of the composite sensing device according to the embodiment of the present application is shown;

[0035] Figure 7 A home system according to an embodiment of the present application is shown;

[0036] Figure 8 A home environment in which a home system according to an embodiment of the present application is deployed is shown;

[0037] Fig. 9 A method for detecting an object by using a composite sensor device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0038] For the purpose of brevity and illustration, the principles of the present application are described herein mainly with reference to its exemplary embodiments. However, those skilled in the art will readily recognize that the same principles are equally applicable to all types of composite sensing devices, home systems, and methods of detecting objects through composite sensing devices, and that these same or similar principles can be implemented therein, and any such changes do not depart from the true spirit and scope of the present application.

[0039] One aspect of the present application provides a composite sensing device, such as Figure 1 and 2 As shown, the composite sensing device 100 (hereinafter referred to as the device 100) includes a housing 101 and a processing module 1081 disposed in the housing 101. Similar to the prior art, the processing module 1081 can be disposed on a circuit board 108 disposed in the housing 101, and the circuit board 108 can also include other circuit modules for realizing the functions of the device 100. For example, the circuit board 108 can be a single-layer printed circuit board and include matching circuit modules such as a power supply and an I / O. The housing 101 of the device 100 can be made of materials such as polyvinyl chloride plastic.

[0040] Figure 1 The outline of the device 100 is shown. Figure 2 The internal structure of the device 100 is shown. Figure 1 In addition to the circular outline shown, the device 100 can also have a shape such as a square, an oval, etc. See further Figure 1 and Figure 2 The device 100 includes a first ultrasonic sensor 102, a second ultrasonic sensor 103 and an infrared sensor 104 disposed in a housing 101. As the main sensing modules of the device 100, the first ultrasonic sensor 102, the second ultrasonic sensor 103 and the infrared sensor 104 can be connected to the processing module 1081 through cables, respectively, to send data and receive instructions to the processing module 1081. It should be noted that the "first" and "second" here are only used to distinguish the two ultrasonic sensors, and do not mean that there must be differences in the working principles and specifications of the two.

[0041] In some examples of the present application, in order to improve the sensing ability of the sensing device, especially to improve the sensing ability of the sensing device to different areas, the sensing directions of the first ultrasonic sensor 102, the second ultrasonic sensor 103 and the infrared sensor 104 are designed specifically. Specifically, the first ultrasonic sensor 102 is directed to send and sense ultrasonic signals toward a first area, and the second ultrasonic sensor 103 is directed to send and sense ultrasonic signals toward a second area that does not overlap with the first area. For example, Figure 3As shown, the first ultrasonic sensor 102 is oriented to detect an object (e.g., a human body) within a range of 60 degrees to the left directly below the first ultrasonic sensor 102 (area 301), and the second ultrasonic sensor 103 is oriented to detect an object within a range of 60 degrees to the right directly below the second ultrasonic sensor 103 (area 302), and the sensing areas of the first ultrasonic sensor 102 and the second ultrasonic sensor 103 do not overlap. In other words, the first ultrasonic sensor 102 and the second ultrasonic sensor 103 will only be sensitive to the areas to which they respond, which will be helpful in determining whether the detected object is in the left half or the right half of the device 100 as shown in the figure.

[0042] As will be appreciated, the detection range of an ultrasonic sensor is generally fixed, for example, objects within a 60-degree cone around the ultrasonic sensor can be detected, and thus different areas can be sensed by adjusting the orientation of the ultrasonic sensor relative to the central axis of the device 100. More specifically, Figure 3 The detection center axis of the left ultrasonic sensor shown in the figure is set to the left (for example, 30 degrees to the left relative to the vertical direction in the figure), and the detection center axis of the right ultrasonic sensor is set to the right (for example, 30 degrees to the right relative to the vertical direction in the figure).

[0043] Continue to refer Figure 1 and Figure 3 , the infrared sensor 104 of the device 100 is oriented to sense infrared radiation signals in the third area, and the third area has overlapping parts with the first area and the second area. The infrared sensor 104 can determine the existence of the object through the infrared rays emitted by the object, so the infrared sensor 104 can detect the transition zone between the first area and the second area and serve as a supplement to the detection range on the one hand; on the other hand, the infrared sensor 104 can also serve as a supplementary detection means of the ultrasonic sensor to combine with the ultrasonic detection result to determine the existence of the object and / or the movement of the object. For example, the processing module 1081 determines that there is an object in the area 301 only when the first ultrasonic sensor 102 detects an object in the area 301 and the infrared sensor 104 also detects an object in the area 301. Of course, in some other examples, when the first ultrasonic sensor 102 detects an object in the area 301 or the infrared sensor 104 detects an object in the area 301, the processing module 1081 can determine that there is an object in the area 301.

[0044] It should be noted that the positional relationship between the first area, the second area and the third area is directly determined by the installation direction of the first ultrasonic sensor 102, the second ultrasonic sensor 103 and the infrared sensor 104, and may not be affected by the installation position of the device 100. That is, the overlapping relationship between the first area, the second area and the third area described in this article can be achieved for any space to be detected by installing the device 100. As an example, when the device 100 is installed in a place such as Figure 3 When the device 100 is located at a position such as the ceiling shown in the figure, the detection area of ​​the first ultrasonic sensor 102 is area 301, the detection area of ​​the second ultrasonic sensor 103 is area 302, and the detection area of ​​the infrared sensor 104 is area 303. As shown in the figure, there is no intersection between area 301 and area 302, so the position of the object relative to the device 100 can be identified through the sensing results of the first ultrasonic sensor 102 and the second ultrasonic sensor 103. On the other hand, area 303 intersects with area 301 and area 302 respectively, so objects in area 301 (or part thereof) and area 302 (or part thereof) can be detected by composite means (ultrasound and infrared).

[0045] The detection area 303 of the infrared sensor 104 may be factory preset or may be adjusted later. Figure 2 As shown, the device 100 further includes an infrared mask 107. The infrared mask 107 is arranged around the infrared sensor 104 and forms a transmission area that can transmit infrared radiation signals. The shape of the infrared mask 107 can be adjusted to adjust the area of ​​the transmission area. For example, when the area of ​​the infrared sensor 104 blocked by the infrared mask 107 is small, the detection range (third area) of the infrared sensor 104 will be large. Conversely, when the area of ​​the infrared sensor 104 blocked by the infrared mask 107 is large, the detection range (third area) of the infrared sensor 104 will be small. Other aspects of the infrared mask 107 can be configured according to existing masking technology, which will not be described in detail herein.

[0046] In some embodiments of the present application, as mentioned above, the housing 101 may have a circular profile, and the infrared sensor 104 may be arranged at the center of the housing 101. On the other hand, the first ultrasonic sensor 102 and the second ultrasonic sensor 103 may be arranged symmetrically along the radial direction of the housing 101 and relative to the infrared sensor 104. In this layout, the sensing areas of the first ultrasonic sensor 102 and the second ultrasonic sensor 103 will be substantially symmetrical relative to the central axis of the housing 101, and the sensing area of ​​the infrared sensor 104 will also be symmetrical relative to the central axis of the housing 101.

[0047] In some embodiments of the present application, the housing 101 includes a first chamber and a second chamber (not shown in the figure), in which case the first ultrasonic sensor 102 can be disposed in the first chamber, and the second ultrasonic sensor 103 can be disposed in the second chamber. The first chamber and the second chamber can be made of or applied with a material (such as a sound-absorbing material) that can block ultrasonic penetration, thereby ensuring the directivity of the first ultrasonic sensor 102 and the second ultrasonic sensor 103, so that the detection processes of the two do not interfere with each other.

[0048] The processing module 1081 of the device 100 can receive sensing signals about the object from the first ultrasonic sensor 102, the second ultrasonic sensor 103 and the infrared sensor 104 via the communication link to respectively generate presence information about the object from the first ultrasonic sensor 102, the second ultrasonic sensor 103 and the infrared sensor 104. The presence information herein includes various information generated by the first ultrasonic sensor 102, the second ultrasonic sensor 103 and the infrared sensor 104 sensing the object, such as whether the object exists and the movement of the object.

[0049] In some embodiments of the present application, the device 100 also includes a communication module 1082 disposed in the shell 101, and the communication module 1082 is also disposed on a circuit board 108 arranged in the shell 101, and there is also a communication connection between the communication module 1082 and the processing module 1081, so that the communication module 1082 can send the presence information generated by the processing module 1081.

[0050] The communication module 1082 sending all the presence information generated by the processing module 1081 in real time will cause the amount of data to be processed by the subsequent process to be too large, especially when the object exists in the detection range of the device 100 for a long time. To this end, in some embodiments of the present application, the communication module 1082 can be configured to send the presence information at a predetermined time interval. For example, the communication module 1082 can send the presence information every 3 seconds. In other words, the communication module 1082 sends the latest presence information (if any) generated by the processing module 1081 every 3 seconds, and discards each presence information generated by the processing module 1081 during the interval between two transmissions.

[0051] In some embodiments of the present application, Figure 1-3 The devices 100 shown are interconnected, so that the communication module 1082 of the device 100 can receive presence information from other composite sensing devices 100, and the processing module 1081 can generate control commands and / or counts about objects based on the locally generated presence information and / or the presence information from other composite sensing devices 100. Subsequently, the communication module 1082 can send the control commands and / or counts to an external device.

[0052] Transfer back Figure 1 The device 100 may further include a reset button 105 and a working indicator light 106 disposed on the housing 101. The reset button 105 may be used to reset the device 100 after it triggers certain operations (e.g., an intrusion alarm) to eliminate the effects of the operation. The working indicator light 106 may be used to indicate the working state of the device 100 to the user. For example, the working indicator light 106 may be composed of indicator lights of multiple colors. When the working indicator light 106 is in a green slow flashing state, it indicates that the device 100 is in a normal detection working state.

[0053] The composite sensor device can be linked with an external device to realize a specific application. For example, the communication module of the composite sensor device can send a control command and / or count to the external device to realize an application scenario. Figure 4-7 The following diagram shows the application scenarios of the composite sensing device according to some embodiments of the present application. Figure 4 As shown, the composite sensing device can be used as a condition for turning on a single device / scene. For example, when the composite sensing device senses that a person has entered area 303, the composite sensing device can trigger the lighting device in the area. In addition, in order to prevent pets from accidentally triggering the lights, the ultrasonic sensing signals of the composite sensing device in areas 301 and 302 can be combined for judgment. For example, the lights will only be turned on when any one of the ultrasonic sensors and infrared sensors of the composite sensing device is triggered at the same time.

[0054] Composite sensors can also be used as the start-up conditions for multiple devices / scenes and can be used to count objects across zones. Figure 5 As shown in the figure, the dotted line divides the sensible area of ​​the composite sensing device into an upper half (hereinafter referred to as the "upper area") and a lower half (hereinafter referred to as the "lower area"). When the infrared sensor of the composite sensing device detects the existence of an object in area 303 and the ultrasonic sensor detects the existence of an object in area 302, the lights in the lower area will be turned on. When the infrared sensor of the composite sensing device detects the existence of an object in area 303 and the ultrasonic sensor detects the existence of an object in area 301 in the next stage, it indicates that the object has entered the upper area from the lower area. At this time, the lights in the lower area can be turned off and the lights in the upper area can be turned on. At the same time, the count of objects entering the upper area from the lower area can be increased by 1.

[0055] The composite sensor device can also be used as a channel-type virtual switch. Figure 6As shown in the figure, the dotted line divides the sensible area of ​​the composite sensing device into a left half (hereinafter referred to as the "left zone") and a right half (hereinafter referred to as the "right zone"). When the infrared sensor of the composite sensing device detects the existence of an object in area 303 and the ultrasonic sensor detects the existence of an object in area 302, the lights in the right zone will be turned on. When the object passes through the channel from left to right and appears in the left zone in the next stage, the infrared sensor of the composite sensing device detects the existence of an object in area 303 and the ultrasonic sensor detects the existence of an object in area 301. At this time, the lights in the right zone can be turned off and the lights in the left zone can be turned on. The lights in the channel (in area 303) can be turned off after a delay, and at the same time, the count of objects entering the left zone from the right zone can be increased by 1.

[0056] Although the composite sensor device 100 described above can work independently and can trigger various external devices connected to it, such as intrusion alarms, lighting systems, object counters, etc., the composite sensor device 100 can also be networked to form a more functionally complex smart home network.

[0057] Another aspect of the present application provides a home system. Figure 7 As shown, the home system 40 (hereinafter referred to as system 40) includes a sensor gateway 401 and one or more composite sensor devices 100-1, 100-2, 100-3, wherein the composite sensor devices 100-1, 100-2, 100-3 can be connected to the sensor gateway 401. The sensor gateway 401 can be adapted to the working network of the composite sensor devices 100-1, 100-2, 100-3 (specifically, the network supported by the communication module 1082), and can be based on networks such as ZigBee, Bluetooth, WiFi, etc., or can be a composite sensor gateway that can support multiple networks.

[0058] In some embodiments of the present application, the system 40 further includes a door lock 402 and an arming unit (not shown in the figure) that can be connected to the sensor gateway 401. In addition, the system 40 shown in the figure also includes functional devices such as an air humidifier 403 and a water heater 404 connected to the sensor gateway 401.

[0059] The door lock 402 is arranged at the boundary of the defense zone, and can perform identity verification for the object. Specifically, the interior of the house can exist as a defense zone, and the door lock 402 can be arranged at the entrance (door) of the defense zone. The door lock 402 can use passwords, fingerprints, faces and other means to determine the object trying to open the door lock 402, thereby preventing unwanted objects from bypassing identity verification and entering the house. In addition, the defense unit can be set in the sensor gateway 401 and integrated with it. In other examples, the defense unit can also be set on a cloud server. The defense unit can determine whether to cancel the security for the house based on the verification result of the door lock 402. For example, the defense unit can cancel the security if the object passes the identity verification, thereby preventing the homeowner or other allowed objects from mistakenly triggering the security alarm.

[0060] In some embodiments of the present application, the defense unit is further configured to receive presence information from the composite sensing devices 100-1, 100-2, and 100-3 via the sensor gateway 401, and determine the movement trajectory of the object based on the presence information. As described above, the presence information includes various information generated by the object being sensed by the first ultrasonic sensor 102, the second ultrasonic sensor 103, and the infrared sensor 104, such as whether the object exists and the movement of the object.

[0061] In some embodiments of the present application, the defense unit can determine the movement trajectory according to the order of the presence information of the first ultrasonic sensor and the second ultrasonic sensor in the composite sensing device 100-1, 100-2, and 100-3. Figure 4-Figure 6 Describes how to determine the moving direction of an object using a single composite sensor device. Figure 8 A home environment in which a home system according to an embodiment of the present application is deployed is shown. Figure 8 It is described how to determine the moving trajectory of an object based on the presence information detected by multiple composite sensing devices. It should be noted that although the following examples are not described in conjunction with infrared sensors, the sensing signals of infrared sensors can be used as a basis for judgment in the process of determining the trajectory. For example, only when both the ultrasonic sensor and the infrared sensor are triggered in the area can the object be determined as a valid object (for example, a human body), and objects that only trigger the infrared sensor (for example, a pet) can be discarded.

[0062] like Figure 8 As shown, a door lock 402 may be arranged at the entrance door to perform identity verification for the object. Figure 8Composite sensing devices are arranged in each room shown. Specifically, a bathroom composite sensing device is arranged in the bathroom, a dining room composite sensing device is arranged in the dining room, a living room composite sensing device is arranged in the living room, a guest room composite sensing device is arranged in the guest room, a master bedroom composite sensing device is arranged in the master bedroom, and a children's room composite sensing device is arranged in the children's room. No additional composite sensing devices are deployed in the balcony connected to the living room and the kitchen connected to the dining room. In addition, since the passage formed by the entrance hall and the walkway is long, two composite sensing devices are arranged, namely, entrance hall composite sensing device 1 and entrance hall composite sensing device 2. Each of the above composite sensing devices has the structure of the composite sensing device described above, which will not be repeated here.

[0063] When the subject opens the door lock 402 and enters the entrance, the ultrasonic sensor B and the ultrasonic sensor A of the entrance composite sensing device 1 (shown as "Entrance 1") will be triggered in sequence. For the convenience of description, the above process is abbreviated as:

[0064] Action / Trajectory: The form of sensor triggering. For example, the action / trajectory of "entering the house" above will cause the following sensor triggering record:

[0065] Entry: The ultrasonic sensors BA of the entrance composite sensing device 1 are triggered in sequence.

[0066] Similarly, the following describes a series of actions of the object in the house and the corresponding sensor triggers:

[0067] (1) Entering the restaurant from the entrance to eat: The ultrasonic sensor A of the restaurant's composite sensor device is triggered;

[0068] (2) From the restaurant to the kitchen to wash dishes: Ultrasonic sensors in the restaurant's composite sensor device

[0069] AB are triggered in sequence;

[0070] (3) Entering the living room to rest: The ultrasonic sensors BA of the living room composite sensor device are triggered in sequence;

[0071] (4) Enter the children’s room to clean up:

[0072] The ultrasonic sensors BA of the entrance composite sensing device 2 (shown as "Entrance 2") are triggered in sequence;

[0073] The ultrasonic sensors BA of the composite sensing device in the children's room are triggered in sequence;

[0074] (5) Entering the bathroom from the children's room to wash:

[0075] Ultrasonic sensors AB of the entrance composite sensing device 2 are triggered in sequence;

[0076] The ultrasonic sensors AB of the entrance composite sensing device 1 are triggered in sequence;

[0077] Ultrasonic sensors AB of the bathroom composite sensing device are triggered in sequence;

[0078] (6) Enter the guest room to rest:

[0079] Ultrasonic sensors AB of the guest room composite sensing device are triggered in sequence;

[0080] Other composite sensor devices are no longer triggered for a period of time.

[0081] In this way, the movement trajectory of the object can be matched with the triggering sequence of the sensors, thereby accurately characterizing the behavior and activities of the object.

[0082] In some embodiments of the present application, the arming unit activates security when the movement trajectory points to outside the defense zone and does not receive presence information from the composite sensing devices 100-1, 100-2, 100-3 for more than a predetermined time. In this way, the security system can be automatically activated when the resident leaves the house.

[0083] Transfer back Figure 7 In some embodiments of the present application, the sensing data generated by the home system 40 can also be uploaded to the cloud for further processing. The system 40 also includes a server 405 that can be connected to the sensor gateway 401. The server 405 can receive and store presence information from the composite sensing devices 100-1, 100-2, 100-3, etc. via the sensor gateway 401.

[0084] In some embodiments of the present application, the system 40 further includes a mobile terminal 406. The mobile terminal 406 can receive the presence information from the server 405, and determine the movement trajectory of the object according to the presence information. The process of the mobile terminal 406 determining the movement trajectory of the object is similar to the process of the deployment unit determining the movement trajectory of the object in the above text, and will not be repeated here due to space limitations.

[0085] Another aspect of the present application provides a method for detecting an object by using a composite sensing device. As described above, the composite sensing device includes a first ultrasonic sensor, a second ultrasonic sensor, and an infrared sensor. Fig. 9As shown, a method 90 for detecting an object by a composite sensor device (hereinafter referred to as method 90) includes the following steps: in step S902, the first ultrasonic sensor is oriented to send and sense ultrasonic signals toward a first area; in step S904, the second ultrasonic sensor is oriented to send and sense ultrasonic signals toward a second area that does not overlap with the first area; and in step S906, the infrared sensor is oriented to sense infrared radiation signals in a third area, wherein the third area overlaps with the first area and the second area, respectively. Method 90 can significantly improve the sensor's perception capability, especially the ability to perceive the specific position of an object in space, through the above steps.

[0086] In some embodiments of the present application, the method 90 further includes: generating presence information about the object from the first ultrasonic sensor, the second ultrasonic sensor and the infrared sensor respectively according to sensing signals about the object from the first ultrasonic sensor, the second ultrasonic sensor and the infrared sensor.

[0087] In some embodiments of the present application, the method 90 further includes: sending presence information at predetermined time intervals.

[0088] In some embodiments of the present application, the method 90 further includes: receiving presence information from other composite sensing devices; and generating a control command and / or a count of the object based on the presence information and / or the presence information from other composite sensing devices.

[0089] In some embodiments of the present application, method 90 further includes: determining a movement trajectory of the object according to the presence information.

[0090] In some embodiments of the present application, the movement trajectory is determined according to the sequence of existence information of the first ultrasonic sensor and the second ultrasonic sensor.

[0091] In some embodiments of the present application, the method 90 further includes: enabling security when the movement trajectory points to outside the defense zone and no presence information is received from the composite sensing device for more than a predetermined time.

[0092] The various steps of method 90 and other aspects of method 90 may be carried out according to the embodiments of the composite sensing device described above, and the relevant contents are all cited here and will not be elaborated in detail in this article due to space limitations.

[0093] According to another aspect of the present application, a computer-readable storage medium is provided, in which instructions are stored. When the instructions are executed by a processor, the processor executes any one of the methods for detecting an object by a composite sensing device as described above. The computer-readable medium referred to in the present application includes various types of computer storage media, which can be any available medium that can be accessed by a general or special computer. For example, the computer-readable medium can include RAM, ROM, EPROM, EEPROM, etc. 2 PROM, register, hard disk, removable disk, CD-ROM or other optical disk storage, disk storage or other magnetic storage device, or can be used to carry or store the desired program code unit in the form of instruction or data structure and can be accessed by general or special computer, or general or special processor. As used herein, the disk usually copies data magnetically, while the dish uses laser to optically copy data. The above combination should also be included in the protection scope of computer-readable medium. Exemplary storage medium is coupled to the processor so that the processor can read and write information from / to the storage medium. In an alternative solution, the storage medium can be integrated into the processor. The processor and the storage medium can reside in the ASIC. The ASIC can reside in the user terminal. In an alternative solution, the processor and the storage medium can reside in the user terminal as discrete components.

[0094] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Those skilled in the art can think of other feasible changes or substitutions based on the technical scope disclosed in the present application, and such changes or substitutions are all included in the protection scope of the present application. In the absence of conflict, the implementation modes of the present application and the features in the implementation modes can also be combined with each other. The protection scope of the present application shall be subject to the description of the claims.

Claims

1. A composite sensor device, comprising a housing and a processing module disposed in the housing, characterized in that: The device further comprises a first ultrasonic sensor, a second ultrasonic sensor and an infrared sensor arranged in the housing, and the processing module is connected to the first ultrasonic sensor, the second ultrasonic sensor and the infrared sensor respectively, wherein: The first ultrasonic sensor is oriented to transmit and sense ultrasonic signals toward a first area; The second ultrasonic sensor is oriented to transmit and sense ultrasonic signals toward a second area that does not overlap the first area; and The infrared sensor is oriented to sense infrared radiation signals in a third area, wherein the third area has overlapping portions with the first area and the second area, respectively.

2. The apparatus according to claim 1, further comprising: An infrared mask is arranged around the infrared sensor and forms a transmission area capable of transmitting the infrared radiation signal.

3. The device according to claim 1, wherein: The housing has a circular outline, and the infrared sensor is arranged at the center of the housing.

4. The device according to claim 3, wherein: The first ultrasonic sensor and the second ultrasonic sensor are arranged along a radial direction of the housing and symmetrically relative to the infrared sensor.

5. The device according to claim 1, wherein: The housing includes a first chamber and a second chamber, and the first ultrasonic sensor is disposed in the first chamber, and the second ultrasonic sensor is disposed in the second chamber.

6. The device according to any one of claims 1 to 5, wherein: The processing module receives sensing signals about an object from the first ultrasonic sensor, the second ultrasonic sensor, and the infrared sensor to generate existence information about the object from the first ultrasonic sensor, the second ultrasonic sensor, and the infrared sensor, respectively. 7 . The device according to claim 6 , further comprising a communication module disposed within the housing, and the communication module is connected to the processing module to transmit the presence information.

8. The device according to claim 7, wherein: The communication module is configured to transmit the presence information at predetermined time intervals.

9. The device according to claim 7, wherein: The communication module is further configured to receive presence information from other composite sensing devices, and The processing module is configured to generate control commands and / or counts regarding the object based on the presence information and / or presence information from other composite sensing devices; as well as The communication module is further configured to send the control command and / or the count.

10. A home system, characterized in that: The home system comprises a sensor gateway and a composite sensing device according to any one of claims 7 to 9, wherein the composite sensing device is connectable to the sensor gateway.

11. The system according to claim 10, further comprising: a door lock disposed at a perimeter of the zone and configured to perform identity verification for the subject; and An arming unit is configured to disarm security when the object passes identity verification.

12. The system according to claim 11, wherein: The arming unit is further configured to receive presence information from the composite sensing device via the sensor gateway, and determine a movement trajectory of the object based on the presence information.

13. The system according to claim 12, wherein: The defense unit is configured to determine the movement trajectory according to a sequence of existence information of the first ultrasonic sensor and the second ultrasonic sensor.

14. The system according to claim 12, wherein: The arming unit enables security when the movement trajectory points to outside the defense zone and no presence information is received from the composite sensor device for more than a predetermined time.

15. The system according to claim 10, further comprising: A server is configured to receive and store presence information from the composite sensing device via the sensor gateway.

16. The system of claim 15, further comprising: The mobile terminal is configured to receive the presence information from the server and determine a movement trajectory of the object according to the presence information.

17. A method for detecting an object by a composite sensing device, characterized in that: The apparatus comprises a first ultrasonic sensor, a second ultrasonic sensor and an infrared sensor, and the method comprises: orienting the first ultrasonic sensor to transmit and sense ultrasonic signals toward a first area; orienting the second ultrasonic sensor to transmit and sense ultrasonic signals toward a second area that does not overlap the first area; and The infrared sensor is oriented to sense infrared radiation signals in a third area, wherein the third area has overlapping portions with the first area and the second area respectively.

18. The method according to claim 17, further comprising: The presence information about the object is generated by the first ultrasonic sensor, the second ultrasonic sensor and the infrared sensor according to the sensing signals about the object from the first ultrasonic sensor, the second ultrasonic sensor and the infrared sensor respectively.

19. The method according to claim 18, further comprising: The presence information is sent at predetermined time intervals.

20. The method of claim 18, further comprising: receiving presence information from other composite sensing devices; Control commands and / or counts regarding the object are generated based on the presence information and / or presence information from other composite sensing devices.

21. The method of claim 18, further comprising: A moving trajectory of the object is determined according to the existence information.

22. The method according to claim 21, wherein: The movement trajectory is determined according to a sequence of existence information of the first ultrasonic sensor and the second ultrasonic sensor.

23. The method according to claim 21, further comprising: Security is enabled when the movement trajectory points to outside the defense zone and no presence information is received from the composite sensor device for more than a predetermined time.

24. A computer-readable storage medium having instructions stored therein, characterized in that: When the instructions are executed by a processor, the processor is caused to perform the method according to any one of claims 17 to 23.