Method for determining equipment to be controlled by a control object combined with a reference system, and corresponding control device
Patent Information
- Application Number
- DE602015092271
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2014-07-25
- Filing Date
- 2015-07-23
- Publication Date
- 2025-08-27
- Estimated Expiration
- 2035-07-23
AI Technical Summary
Existing home automation systems are complex to configure and require mapping of equipment locations, making them difficult for the general public to use and limiting their applicability to single devices, while existing remote controls need to learn and update maps of environments, complicating deployment.
A method using transportable control objects with positioning units that determine relative positions, allowing equipment control without environmental mapping, using UWB technology and methods like lateration, trilateration, and virtual envelopes to identify and orient equipment.
Enables easy and intuitive control of multiple home automation devices without complex configuration, allowing seamless addition or removal of units without retraining, and providing accurate equipment identification through sound or vibration feedback.
Description
Technical field
[0001] The invention relates to the field of remote controls. More specifically, the invention relates to methods for determining and controlling equipment to be controlled. The invention also relates to a use, a device and a system implementing these methods. State of the prior art
[0002] It is known from the state of the art of remote controls to determine and control equipment to be controlled from a determination of the position of the remote control on a map and its orientation.
[0003] For example, we know the document "Home Appliance Control System based on Robust Indoor User Localization using Wifi" by authors Dhao et al., published by the journal "International Journal on Human Machine Interaction" in 2013. This document describes a system comprising a remote control which in an automatic mode is pointed by a user towards a piece of equipment. In this automatic mode, the user controls the pointed equipment associated with the geographical area in which he is physically present. The document describes a system determining the equipment from the location of the user and the orientation of the remote control.
[0004] This known solution, however, has several limitations. On the one hand, the system needs to learn the position of the equipment before using the remote control.
[0005] On the other hand, a server must store a map of the environment that contains information about floors, zone boundaries, walls, the location of each piece of equipment, and the mapping of the zone-to-equipment association. This map is created prior to using the remote control. In addition, adding, removing, or moving equipment requires updating the map.
[0006] Finally, the remote control is localized by learning all the zones (learning called "fingerprinting"). This learning must be carried out before using the remote control and must be carried out regularly. For example, adding or moving a WiFi station in the environment requires carrying out new learning according to the teachings in this document. This method cannot therefore be used for easy deployment in private homes.
[0007] For reference, indoor location technologies are known as UWB or EMF.
[0008] UWB (Ultra Wide Band) technology is a technology that allows the geolocation of objects indoors with an accuracy of a few centimeters to a few tens of centimeters. To determine orientation, another technology is required.
[0009] Another technology that can determine position and orientation is EMF (Electromagnetic Field). The range of such technology is in the order of 2.5 to 5 meters. This technology is well described in document US6073043.
[0010] See also publication FR2985584. Statement of the invention
[0011] Home automation has been around for decades. The convenience provided by home automation products is significant: control of lights, shutters, gates, heating, connected objects, etc. However, home automation has never managed to reach beyond the microcosm of techies to the general public. This is mainly due to the complexity of configuring and using all these products. A few initiatives, such as Philips' Hue bulbs or Somfy's iPhone app for controlling electric shutters, have had some success with the public. However, these initiatives are still limited to a single application: each remote control only works with the equipment with which it was supplied, and does not work to control other products.
[0012] Some companies offer multi-purpose home automation remote controls so you can control multiple devices at once, but these products are very complicated to configure. You have to assign buttons on the remote control to specific actions: button 1 to turn the living room lamp on / off, button 2 to turn the heating down, button 3 to turn the heating up, etc. It quickly becomes difficult to remember which function each button is assigned.
[0013] There is also the rise of home automation applications for smartphones or tablets. These allow the user to navigate through menus and access the equipment they wish to control. This solution is more ergonomic for the user, but remains restrictive. For example, to turn on the light in the living room, the user must turn on their smartphone or tablet, select the home automation application, go to the light control menu or the "living room" menu, select the bulb they wish to control, and press the "on" button. The number of steps to turn on a bulb remains too high, and the user must remember the location of the equipment to be controlled within the application's menus and submenus.
[0014] One aim of the invention is to make it possible to control everything that can be controlled in a house without any complicated configuration and without having to go through a large number of steps.
[0015] One aim of the invention is in particular to overcome all or part of the aforementioned drawbacks by proposing a method for determining equipment to be controlled by a transportable control object arranged in a space comprising positioning units. To this end, the invention is based on the implementation of location units capable of determining their relative positions with respect to each other.
[0016] These tracking units can, for example, implement closed-environment tracking chips based on ultra-wideband (UWB) technology.
[0017] The localization of these localization units can also be carried out using lateration, trilateration or multilateration processes.
[0018] One idea underlying the invention is to combine these location units with a transportable control object. According to the invention, the transportable control object can advantageously be capable of determining its relative position with respect to the various location units.
[0019] The same well-known methods that allow positioning units to determine their relative positions relative to each other allow the remote control or a third-party device to know the relative position of the remote control relative to the various location units.
[0020] Throughout the remainder of the document, it is understood that the concept of controlling equipment can be summed up as obtaining by the remote control a control interface relating to this equipment.
[0021] The concept of controlling equipment can also be summed up as a simple command for information about the latter. Thus, controlling an oven by remote control means the ability to point this remote control at the oven in order to obtain the remaining cooking time even if it is not possible to physically control the oven. This is an oven interrogation command.
[0022] The concept of controlling equipment can also include the actual, physical control of that equipment.
[0023] More generally, any interaction with the equipment will be understood as a command from the latter.
[0024] Thus, according to a first aspect of the invention, there is proposed a method for determining equipment to be controlled by a transportable control object according to claim 1.
[0025] According to a feature of the invention, the step of determining equipment to be controlled comprises a notification of this determination to a user of the control method. Preferably, this notification is carried out by an emission of a sound or a vibration by the control object. Advantageously, the emission of a sound or a vibration by the control object allows a user of the method of determining equipment to be controlled to locate the objects in space without looking at the control object.
[0026] Advantageously, said control object can be a remote control.
[0027] Advantageously, the space may comprise a plurality of positioning units capable of determining their relative positions with respect to each other.
[0028] The determination by a positioning unit of its position relative to another positioning unit may generate a notification of information relating to this determination intended for a user of the determination method. This information may for example be displayed on a display of the control object. This information may alert the user to incorrect positioning of one or more of the positioning units. This may for example be the case when an obstacle or a wall is located between two positioning units. This may be the case (also or alternatively) when three positioning units are aligned: the alignment of three positioning units reduces the accuracy of the determination of the position and / or the orientation of the control object.
[0029] Thus, the implementation of location units capable of determining their relative positions to each other makes it possible to determine equipment without having to first create a map of the environment which contains information on floors, zone boundaries, walls, the location of each piece of equipment, and the mapping of the association of zone to equipment.
[0030] However, this type of information can advantageously be used to effectively discriminate the equipment to be controlled based on the position / orientation pair of the control object.
[0031] Equipment can be an electrical outlet, a roller shutter, audiovisual or computer equipment, an intrusion alarm, a smoke detector, a CO detector, a smoke detector, a thermostat, a gate, a lock, a toy such as an electric car, equipment such as a coffee machine, an alarm clock, a clock, kitchen equipment such as an oven, a hood, a refrigerator, a dishwasher, etc.
[0032] Furthermore, changing the positioning of a localization unit or adding a new localization unit does not require performing new training to determine the position of the control object in space relative to the localization units.
[0033] Advantageously, the step of determining the position and / or the step of determining the orientation of the control object in space may comprise a step of evaluating the travel time of a radio signal between the control object and a positioning unit, or between several positioning units.
[0034] Advantageously, the step of determining the position and / or the step of determining the orientation of the control object in said space may comprise a step of evaluating the reception power of a radio signal by the control object or by the at least one positioning unit.
[0035] Advantageously, the step of determining the position and / or the step of determining the orientation of the control object in space may comprise a step of determining the angles of reception of a radio signal by the control object or by the at least one positioning unit.
[0036] Advantageously, the step of determining the position and / or the step of determining the orientation of the control object in said space can implement the use and measurement of electromagnetic fields.
[0037] Advantageously, the step of determining the position of the object of the control object and / or the step of determining the orientation in this relative space can implement a lateration, trilateration or multilateration step.
[0038] Preferably, the step of determining the position of the control object in said space may implement a step using a technique implementing arrival times such as the TOA technique and / or differences in arrival times such as the TDOA technique and / or angles of arrival such as the AOA technique, of radio signal.
[0039] Advantageously, the step of determining the position and / or the step of determining the orientation of the control object in this relative space can implement a triangulation step.
[0040] Preferably, the step of determining the position and orientation of the control object in this space may implement a step using a measurement of an electromagnetic field.
[0041] The distances between the control object and the positioning units can be determined using several methods. A first family of such methods implements a calculation of the travel time of a radio signal between the control object and the positioning units. A second family implements a calculation of the power of a radio signal received on the side of the positioning units or the control object. A combination of these methods can advantageously be used to improve the accuracy of the location of the control object in the space comprising the positioning units.
[0042] Advantageously, the method according to the invention may comprise a step implementing a determination of the reception angle of a radio signal received by the control object or by the at least one positioning unit. The reception angle of the radio signal may advantageously improve the accuracy of the position and orientation of the transportable control object for a given number of positioning units. The reception angle of the radio signal may advantageously make it possible to implement triangulation using fewer positioning units.
[0043] Advantageously, the method according to the invention can comprise a step implementing a capture by the control object of physical quantities in space.
[0044] A capture of physical quantities in space by the control object can advantageously improve the accuracy of the orientation of the control object. The physical quantities can, for example, be captured by an accelerometer, a gyroscope, or a terrestrial magnetic field sensor. Several physical quantities can be captured to further improve the accuracy of the determination of the location and / or orientation of the control object. A pressure or altitude sensor could further improve these determinations.
[0045] Advantageously, the method according to the invention may comprise a step implementing a capture by the control object of the distance between the latter and an obstacle located in the direction pointed by the control object.
[0046] A capture by the control object of the distance between the latter and an obstacle located in the direction pointed by the control object can advantageously improve precision.
[0047] Advantageously, the method according to the invention comprises a step for associating a reference frame linked to the control object with a reference frame linked to the at least one positioning unit. Preferably, the step of associating the reference frame linked to the control object with the reference frame linked to the at least one positioning unit comprises, for each of the positioning units, a step comprising a pointing by the user of this control object towards a positioning unit and a pressing by the user on the control object. Thus, when the step of positioning the positioning units is not carried out in the same reference frame as the step of orienting the remote control, the two reference frames are linked. In this case, the user may be asked to point at certain positioning units and to press a button and to capture the orientation for each positioning unit.It is thus possible to link the orientation of the remote control with the space of the positioning units. Preferably, in this case, each equipment to be controlled can be activated so that the user knows which equipment to control he must point. Activation can be perceived by the implementation of a flashing of a bulb, the raising and / or lowering of shutters, etc.
[0048] Advantageously, the method according to the invention may comprise a step for defining a virtual envelope of at least one piece of equipment to be controlled. The step of determining a piece of equipment to be controlled may in this case use the virtual envelope defined for the at least one piece of equipment to be controlled. Advantageously, the definition of the virtual envelope allows the implementation of a tolerance margin so that the equipment to be controlled can be determined even if its virtual envelope is not perfectly pointed by the control object.
[0049] Advantageously, the virtual envelope can be defined from a plurality of determinations of position and orientation of the control object in space. For example, the virtual envelope can be defined by determining the convex envelope of the projection of the directions pointed onto a particular volume. The control object can implement a method for learning the location of the equipment to be controlled by pointing its virtual envelope. The user can be asked to point to the same equipment or the same virtual envelope in space from several different positions in order to be able to determine the relative position of the equipment or the virtual envelope in space.
[0050] Advantageously, the step of determining the virtual envelope may comprise a step of activating at least one of the equipment to be controlled in order to make it visually identifiable by the user and a step comprising a pointing by the user of the control object towards this at least one equipment and a pressing by the user on the control object. For example, to control shutters, it is possible to ask the user to point to two corners of the window, for example top left and bottom right. The virtual envelope delimits the area of the equipment to be controlled in space. When the user points anywhere on the window, the system recognizes that the area pointed at corresponds to the control of the shutters.
[0051] Advantageously, the virtual envelope of the at least one piece of equipment to be controlled may comprise at least part of the physical envelope of the equipment to be controlled, preferably the entire physical envelope. For example, the virtual envelope of a television may then comprise at least the physical envelope of the television.
[0052] Alternatively and advantageously, the virtual envelope of the at least one piece of equipment to be controlled may not include any point of the physical envelope of the equipment to be controlled. It is thus possible to define that the equipment to be controlled, when the control object points to the heart of a chimney of an apartment, is the hot / cold air conditioning system of the apartment possibly located in a room other than that of the chimney and not the chimney pointed at. The user can for example point to the window to have the outside weather displayed on the remote control. He can also control objects not directly visible.
[0053] Advantageously, the method according to the invention may comprise a step of moving a piece of equipment to be controlled and an action by a user on the control object, the action of the user on the control object being followed by a new implementation of a method according to the invention in order to determine the new virtual envelope of said moved piece of equipment. This new implementation is preferably carried out automatically as soon as a test is verified. The test may for example comprise a comparison of the distances previously determined between all the pieces of equipment and a new determination of the distances between all the pieces of equipment. Thus, when the user moves a light bulb, its new location is automatically taken into account when pressing a command on the remote control.
[0054] Alternatively, the step of determining a piece of equipment to be controlled may comprise a step of determining a probability that a piece of equipment is the piece of equipment to be controlled. The piece of equipment to be controlled may then be determined from this probability. This determination of a probability may advantageously be implemented to determine the piece of equipment to be controlled when the direction pointed at does not correspond to any virtual envelope or corresponds to more than one virtual envelope. Thus, when the control object is pointed in one direction and if the direction pointed at does not correspond to any piece of equipment, then an algorithm identifies the piece of equipment to be controlled which is closest to it in space or most likely based on the position of the control object and the direction pointed at.
[0055] Advantageously, the method according to the invention may comprise a step of contextual enrichment of equipment to be controlled by enrichment data and in that the step of determining equipment to be controlled implements this contextual enrichment. This enrichment may preferably implement physical quantity data, the time, the date, the position of the control object, the user's responses to questions, or the repetitiveness of commands carried out by the user. For example, the contextual enrichment may be implemented by a step of requesting information from the user related to the equipment to be controlled. This request may be made via a mobile application or configuration software on a computer. The information may be to determine whether the bulb is a ceiling light or a floor lamp, or to know the floor on which each object is located.Thus, this information makes it possible to determine the relative height of the positioning units in relation to each other.
[0056] Preferably, the step of determining a piece of equipment to be controlled may comprise a step of determining a probability. The piece of equipment to be controlled may then be determined from this probability. For example, when a determined direction and sense point to at least two virtual envelopes, the determined piece of equipment may be the one whose virtual envelope is closest to the control object. For example, when a determined direction and sense do not point to any virtual envelope, the probability of each piece of equipment is determined from the distance between its virtual envelope and the half-line defined by the direction. The notion of distance and proximity depends on the metric used. A metric such as the smallest Euclidean distance between the line defined by the determined direction and a point of a virtual envelope may be used.Thus, an automatic correction step is proposed: the process cancels the previously issued command and applies the command to the most likely equipment to be controlled.
[0057] The invention also relates to a method for controlling equipment to be controlled from among at least one equipment to be controlled from a control object, according to claim 11.
[0058] This control method according to the invention comprises a step of determining equipment to be controlled implementing a method according to the invention.
[0059] Advantageously, the control method according to the invention may comprise a step of transmission by the control object of control data to the equipment to be controlled.
[0060] Preferably, the step of determining the position and orientation of the control object and the step of transmitting control data by the control object to the equipment to be controlled can implement the same radio technology.
[0061] Advantageously, the control method according to the invention can automatically issue commands to a piece of equipment depending on its position and orientation in space.
[0062] Advantageously, the step of determining equipment to be ordered may be followed by a step of confirming and / or a step of denying the equipment to be ordered thus determined.
[0063] Preferably, the confirmation step and / or the invalidation step can be implemented by a predefined interaction of the user with the control object. When the user points at a piece of equipment to be controlled and activates a command, but the command is sent to another object, the remote control allows the user to indicate that the wrong piece of equipment to be controlled was controlled via a "correction" or "help" button. The user presses this button and manually indicates which piece of equipment to be controlled he or she wanted to control. In this case, the various methods can take this information into account in order to always control the piece of equipment to be controlled desired by the user when he or she points in this direction.
[0064] Advantageously and after a step of invalidating the equipment to be controlled, a new step of determining equipment to be controlled can be automatically implemented by the control method according to the invention. The method can further comprise a step of canceling the first transmission emitted by the object to be controlled.
[0065] Advantageously, the confirmation step and / or the invalidation step can implement a capture of a physical quantity. The predefined interaction is preferably a predefined movement of the equipment to be controlled carried out by the user. For example, the user can make a specific gesture with the control object which indicates to the different processes that the command executed is not the one desired by the user. This gesture can be captured by an accelerometer integrated into the remote control, and can for example be shaking the remote control.
[0066] Advantageously, the control method according to the invention can comprise an automatic discovery step to discover each of the equipment to be controlled.
[0067] Advantageously, the control method according to the invention can comprise an adaptation of a control interface of the control object as a function of the equipment to be controlled.
[0068] Advantageously, the control method according to the invention may comprise an interpretation by a touch surface of at least one movement of at least one finger of a user on said surface. Preferably, the control data are generated from this interpretation.
[0069] Advantageously, the control method according to the invention may comprise a display by the control interface of information depending on the equipment determined. When the equipment to be controlled is a thermostat or radiator, the current temperature and / or the set temperature is displayed. When the equipment to be controlled is a lamp or bulb, the ON or OFF state - off or on - of the bulb is displayed. When the equipment to be controlled is a colored bulb, the current color is displayed. When the equipment to be controlled is a shutter, the state of the shutters is displayed: open or closed. When the equipment to be controlled is a gate, the open or closed state or a video of a person who rang the gate is displayed. When the equipment to be controlled is an oven, a remaining cooking time and / or the oven temperature is displayed.
[0070] When the control object includes a display and when it includes a detection step, the learning step is performed by a network gateway. Thus, a hub acting as a gateway can automatically detect all controllable objects connected to the same computer network as the hub.
[0071] When the control object includes a screen, learning can be performed directly on the control object screen.
[0072] When it includes a display and when it includes a detection step, the learning step is carried out via an application located on a device connected to a network. This can be an application implemented on a computer or an application implemented on a smartphone or tablet. In the latter two cases, the control unit, which can be the computer, the tablet or the smartphone, is connected wired, by a USB cable or wireless connection, not a WiFi or Bluetooth connection, in order to be able to interact during the learning phase.
[0073] A topology is a maximal subset of the set of positioning units such that whatever a positioning unit of said topology, its position can be determined, directly or indirectly, by any other positioning unit of said topology.
[0074] We can thus define two topologies as being independent when there exists a positioning unit of the first topology whose position cannot be known, directly or indirectly, by any of the positioning units of the second topology.
[0075] According to a particularity of the use of the control method, the set of positioning units comprises only one topology.
[0076] According to another feature of the use of the control method, the set of positioning units comprises at least two topologies.
[0077] Preferably, the use according to the invention may comprise detection of a predefined action by the user. Preferably, this detection is automatically implemented. This action may be the user picking up the remote control. The display of the remote control adapts dynamically in real time as soon as the remote control is picked up and its display shows the information related to everything that is pointed at.
[0078] Preferably, the use according to the invention may comprise a step of detecting a physical quantity such as the acceleration of the control object. Preferably, this detection is automatically implemented. An accelerometer can thus detect the movements of the remote control and turn on the display and / or conversely when the remote control is placed down and no longer moves, then the display turns off automatically.
[0079] Advantageously, the use according to the invention may comprise management of a display of the control device based on this detection. This management may be carried out automatically. Thus, when the user grasps the control object, the display management may power the display. When the user places the control object, the display management may turn off the display.
[0080] Advantageously, the use according to the invention may comprise a plurality of automatic implementations of the control method according to the invention. Thus, the control object is capable of controlling the equipment continuously according to its position and its orientation. In the case where the control object has a display, the display displayed by the display is adapted automatically and / or dynamically according to the equipment determined by the control object. The movement of the control object between two distant rooms associated with an automatic implementation of the control method according to the invention also has the advantage of allowing control of two distant equipments with the same control object when the latter is moved from one of the two rooms to the other, without said two equipments necessarily belonging to the same topology.
[0081] Advantageously, the use according to the invention may comprise a step of defining habit data. The use according to the invention may comprise a plurality of implementations of the control method according to said habit data. The habit data may be associated with a gesture of a user or a press on the control object. For example, when the user activates a key or points towards an area of the room, all the commands are chained. It is thus possible to imagine that a user wishes to control all of his lamps at once, but by pointing at a specific area of the room. This advantageously avoids him having to point at each lamp in the room to control them individually.
[0082] Advantageously, the use according to the invention may comprise a step of learning command habits executed by the user to define the habit data. The user may create macros, using the habit learning method. Macros are sequences of commands launched after a single action by the user. For example, the habit learning method may ask the user to point and perform all the commands that he wishes to associate with this macro and associates this sequence of commands with a key or an area of the room.
[0083] Advantageously, the step of learning the habits of commands executed by the user can comprise a step of contextual enrichment by enrichment data. This contextual enrichment preferably implementing data of physical quantities, the time, the date, the position of the command object, the user's responses to questions, or the repetitiveness of commands carried out by the user. The contextual elements can be for example the time or the day of the year or the position of the remote control. Taking these elements into account is used to improve the relevance of the macros or commands and thus predict the user's wishes. An example is the opening of shutters while a user points at the shutters and presses a command while it is morning.Another example is the detection by a step of the method of use of a successive actuation of a plurality of equipment to be controlled several times by the user within the same time slot. The habit learning method can then use the results of this detection step to decide on the actuation of this plurality of objects and this only when the time slot contextual element is the same.
[0084] The invention also aims to propose a device for controlling at least one piece of equipment to be controlled in a space by at least one transportable control object according to claim 16.
[0085] Preferably, the control device according to the invention further comprises a touch-sensitive surface and interpretation means for interpreting at least one movement of at least one finger of a user on this touch-sensitive surface, the transmission means being further configured to generate the command from data coming from the interpretation means.
[0086] Advantageously, the device according to the invention can further comprise a display configured to display information relating to the equipment to be controlled thus determined.
[0087] Advantageously, the device according to the invention may comprise a sound sensor and analysis means configured to determine a result based on the sound captured by the sound sensor and display this result on the display. For example, when the control object points to a music source, the device automatically launches a Shazam ®< type search of the current music and displays a result such as the title of the song, the name of the album, or the artist on the display.
[0088] The invention also aims to propose a system comprising: at least one transportable control object arranged in a space, at least one positioning unit in this space, the at least one positioning unit being capable of determining the position of the control object and / or its relative position with respect to other positioning units, a device for controlling at least one piece of equipment to be controlled according to the invention.
[0089] Advantageously, the at least one positioning unit can be integrated into equipment to be controlled. The equipment to be controlled can be a connected light bulb, a lamp, a lamp socket, a wall outlet, a wall switch, a thermostat, a roller shutter mechanism or switch, etc.
[0090] Advantageously, communication means included in the control object and / or the at least one positioning unit and / or the control device are configured to implement the same radio technology. In this case, the communication of the command for controlling can also use the same radio technology as that used for localization, for example UWB technology.
[0091] Advantageously, the at least one control device can be integrated into the at least one control object.
[0092] Advantageously, the control device can be integrated into at least one positioning unit.
[0093] Advantageously, the control device can be integrated into the equipment to be controlled.
[0094] Advantageously, the system according to the invention can further comprise a network gateway.
[0095] Preferably, a network gateway may be configured to automatically detect each of the at least one equipment to be controlled.
[0096] Preferably, a network gateway may comprise the control device, the control device being connected via this network gateway by a wired or wireless link to the control object and / or to the at least one positioning unit.
[0097] Preferably, a network gateway may be configured to sequentially control at least some of the equipment to be controlled. Thus, the network gateway may operate each equipment to be controlled individually so that the user can visually identify it. This may, for example, be the flashing of a light bulb, the raising and / or lowering of shutters, etc.
[0098] Advantageously, the control object may be provided with rechargeable energy storage means and the system may further comprise a base capable of recharging the energy storage means.
[0099] Advantageously, the control object is a telephone comprising the transmission means of the control device.
[0100] Alternatively, the control object may comprise a telephone equipped with an accessory, the control object comprising the transmission means of the control device. This is the case when an additional accessory is added to the smartphone: this accessory may include the technology necessary for indoor localization. The physical connection to the smartphone is made either by a jack, USB, lightning type socket, or wirelessly via a technology such as Bluetooth, BLE, Wifi, etc. This accessory is integral with the Smartphone so the position of the Smartphone can be determined. Description of figures
[0101] Other advantages and particularities of the invention will appear on reading the detailed description of implementations and embodiments which are in no way limiting, with regard to the appended drawings in which: there figure 1schematically represents a general embodiment of a method for determining equipment to be controlled according to the invention; the figure 2 schematically represents a first embodiment of a method for determining equipment to be controlled according to the invention; the figure 3 schematically represents a second embodiment of a method for determining equipment to be controlled according to the invention; figure 4 schematically represents a control system according to the invention of the “automatic” type; the Figure 5 schematically represents a control system according to the invention of the “manual” type. Description of embodiments
[0102] The embodiments described below being in no way limiting, it will be possible in particular to consider variants of the invention comprising only a selection of the characteristics described, subsequently isolated from the other characteristics described (even if this selection is isolated within a sentence comprising these other characteristics), if this selection of characteristics is sufficient to confer a technical advantage or to differentiate the invention compared to the state of the prior art. This selection comprises at least one characteristic, preferably functional without structural details, or with only a part of the structural details if this part only is sufficient to confer a technical advantage or to differentiate the invention compared to the state of the prior art.
[0103] There figure 1schematically represents a general embodiment of a method 100 for determining equipment to be controlled by a control object arranged in a space comprising positioning units capable of determining their relative positions with respect to each other.
[0104] Step 102 is a step of randomly deploying several nodes in a given space. These nodes are controllable equipment, information equipment or positioning units.
[0105] Step 104 is a step of implementing localization techniques. These techniques are trilateration or triangulation from data relating to a received signal such as the angle of arrival (AOA), the time of arrival (TOA), the time difference of arrival (TDOA), the received power (RSSI), the quality of the received signal (LQ), or the technique of measuring the electromagnetic field. These techniques can be used alone or in combination with data from an accelerometer, a magnetometer or a pressure detection unit.
[0106] Step 106 is a step of implementing techniques for determining orientation relative to the nodes. The method implements one or more techniques from data relating to a received signal such as EMF, EMF, AOA, a transmission with a directional antenna or the implementation of one or more sensors such as an accelerometer, a magnetometer or a gyroscope.
[0107] In step 108, which is an optional step, a virtual envelope is determined by the user for a piece of equipment to be controlled and the user determines its location relative to the nodes.
[0108] In step 110, the method determines a virtual area pointed to by the control object.
[0109] In step 112, the method implements an automatic adaptation of the control interface of the control object (its display, its touch display and / or its buttons) to the equipment to be controlled selected in the prior step: information associated with the equipment to be controlled is displayed on the control object, buttons of the control object are available to the user who can also, alternatively or in combination, perform actions.
[0110] In step 114, a command associated with the action performed by the user is sent to the equipment to be controlled associated with the virtual zone pointed to by the command object.
[0111] The determination of the position of the location units in space is now described. This determination is relative or absolute: the position is said to be relative when the positioning units are positioned relative to each other; the position is said to be absolute when the positioning units are positioned relative to a known reference frame, for example using knowledge of a GPS position. Several location techniques are possible: a first technique implements a calculation of distances using one of the following methods or a combination of both: ∘ a first method implements a calculation of the travel time of a radio signal between the control object and a positioning unit and between the positioning units, ∘ a second method implements a calculation of the power of the radio signal in reception. The reception is carried out either on the side of the control object or on the side of the positioning unit, a second technique implements a calculation of the reception angles AOA and triangulation, a third technique implements a use of electromagnetic fields to determine position and orientation in space, of course, it is possible to combine several techniques and to use a plurality of sensors in order to improve the accuracy of the location.It is also possible to add sensors to facilitate the location of the different positioning units in space.
[0112] For example, it is possible to add a pressure sensor to each positioning unit. This has the advantage of obtaining the altitude of each positioning unit and thus determining the spatial orientation of the positioning units relative to the terrestrial reference frame.
[0113] In the first case, some positioning units have known positions ("with anchors") relative to a reference frame (terrestrial with GPS or other). Several localization techniques are then possible. This makes it possible to obtain an absolute localization of the positioning units relative to the reference frame.
[0114] In a second case, no positioning unit has a known position ("anchor free") relative to a reference frame (terrestrial with GPS or other). Several localization techniques are then possible. This makes it possible to obtain a relative location of the positioning units between them.
[0115] The determination of the position of the control object is now described. The positioning units are used to calculate the position coordinates of the control object in space. The distances between the control object and the positioning units are calculated and are used to determine the location of the control object in space. It is possible to use the same positioning techniques as those used for determining the positions of the positioning units. Since the portable control object is mobile, its location is determined in real time, and all its movements are calculated (tracking).
[0116] The determination of the orientation of the control object relative to the positioning units is now described.
[0117] In the first branch, the orientation is determined relative to the Earth's reference frame. Sensors, such as accelerometers and magnetometers, are used to determine the angle and orientation of the control object relative to the Earth's reference frame.
[0118] In a second branch, the orientation is determined relative to a known frame of reference: for example, we can use electromagnetic fields to determine position and orientation in space.
[0119] When the positioning of the localization units is not done relative to the same reference frame as the orientation of the control object, it is appropriate to link the two. In this case, the user can be asked to point at certain positioning units and press a button on the control object to capture the orientation of each positioning unit. It is thus possible to link the orientation of the control object with the space of the positioning units. Each controllable equipment can be activated so that the user knows which equipment to control the user must point at. Activation is made visible by the flashing of a light bulb, the lowering or raising of shutters, etc.
[0120] Using the orientation and location of the object in the control space, it is possible to determine the direction pointed by the control object and thus identify the equipment to be controlled.
[0121] Now the improvement of the accuracy of the position of the control object is described.
[0122] In a first branch, the precision is improved by using the angle of reception of the signal from the control object by the positioning units. Advantageously, for an equivalent number of positioning units, this makes it possible to obtain greater precision in the location of the control object. In addition, this makes it possible to triangularize the position of the control object using fewer positioning units: one instead of two, two instead of three, etc.
[0123] In a second branch, the accuracy is improved by adding additional sensors in the command object to improve the accuracy of the angle calculation: gyroscope, Earth's magnetic field sensor, etc.
[0124] In a third branch, the precision is improved by adding additional sensors in the control object allowing to provide movement and displacement information improving the calculation of the geolocation of the control object in space: accelerometer, gyroscope, terrestrial magnetic field sensor, etc.
[0125] In a fourth branch, the precision is improved by adding a pressure or altitude sensor to determine, for example, the altitude and / or the floor where the control object is located in a multi-story building.
[0126] The possibility of improving the accuracy of identifying the equipment to be controlled pointed to by the control object is now described.
[0127] This is made possible by adding a distance sensor on the command object: the distance between the command object and the equipment to be controlled pointed at is calculated by the distance sensor. This information makes it possible to better determine the equipment to be controlled pointed at or the area pointed at by the command object and to avoid controlling an equipment to be controlled which is in the extension of the direction pointed in the same room, or even in another room.
[0128] The possibility of improving the accuracy of the system by using a contextual method is now described. This is made possible by asking the user to provide, via a mobile application or computer configuration software, a contextual indication relating to an object to be controlled. For example, a contextual indication relating to a light bulb may be to qualify the bulb as a ceiling light or a floor lamp, and / or to indicate the floor on which it is located. This information can be used to determine the relative height of the positioning units with respect to each other.
[0129] A set of controllable equipment is now described which can be controlled: lamp or sockets; roller shutters; music device; thermostat; gate or lock; toy such as an electric car; coffee machine, gas fireplace; audiovisual equipment such as television, DVD or BluRay player, camera; computer equipment; equipment from third-party companies such as Somfy ®< shutters, Philips Hue ®<, Nest thermostat ®<; burglar alarm, smoke detector, CO detector; alarm clock and clock; kitchen equipment such as oven, hood, refrigerator, dishwasher.
[0130] The discovery of the equipment to be controlled can be carried out either by a gateway which automatically detects all the equipment to be controlled connected to the same network; or by a user who manually enters the equipment to be controlled which must be controlled by the system.
[0131] The discovery of the equipment to be controlled can be done directly on the screen of the control object if the control object has a screen. The discovery can also be done on a computer or via an application on a Smartphone or tablet. In this case, the remote control and the computer, tablet or Smartphone are connected with (USB cable) or wirelessly (Wi-Fi or Bluetooth) in order to be able to interact during the discovery phase.
[0132] In a first discovery mode, called plug & play, the equipment to be controlled has a geolocation chip. Thus, their location relative to the control object is known: no learning is necessary. From the first use, the system automatically determines the equipment to be controlled as soon as the user points at it. It is also possible for the user to modify: control a certain function or equipment to be controlled, but by pointing elsewhere. The system automatically generates a map of all the equipment to be controlled. There is no need to enter a map or do any "training". The system automatically recalculates the coordinates of the equipment to be controlled each time the user presses a command: no map needs to be stored.Thus, if the user moves a light bulb, its new location is automatically taken into account when pressing a command on the control object. Alternatively, it is also possible to store a map of the equipment to be controlled permanently, for example when there is a lot of equipment to control and the system must be very responsive when the user presses a command.
[0133] In a second discovery mode, called automatic, the equipment to be controlled does not have a geolocation chip. The user enters the automatic learning mode. The gateway individually activates each equipment to be controlled so that the user can visually identify it. The user is then asked to point at the activated equipment to be controlled and press a button on the control object or on the touch screen. When the control object does not have a distance sensor, the user may be asked to point at the same equipment to be controlled several times from several different positions so that the system can geolocate the target in space. The gateway thus automatically makes the link between the equipment to be controlled that it has activated and its coordinates thanks to the user's pointing action. The gateway then activates the next equipment to be controlled.The same process is implemented until all identified objects in the house have been located by the system. The system automatically generates a map when the user points at the equipment to be controlled. A single point is sufficient when the control object has a distance sensor.
[0134] In a third discovery mode, called manual, there is an association of virtual envelope with physical objects. In this case, the virtual envelope does not include the physical equipment to be controlled. This can be the case when a user wants to point the fireplace to control the thermostat or point the window to know the outside weather and the result is displayed on the control object. This mode is also implemented when the user wants to control a new function that has not been automatically detected by the system, or when the user wants to modify the settings for a piece of equipment to be controlled. The user can then control a connected piece of equipment to be controlled or a function by pointing to another zone or another piece of equipment to be controlled.In this case, the user enters the manual learning mode and points to the desired zone and tells the system which equipment to control each time they point to that zone. For example, the user may want to control the temperature in the room by pointing to the fireplace or a radiator instead of pointing to the thermostat that is located in another room. The system generates a map automatically. A single pointing is sufficient when the control object has a distance sensor.
[0135] In a fourth learning mode, called macro learning, the user can create macros. A macro is a sequence of commands executed after a single user action. The user enters the macro learning mode: they point and perform all the commands they wish to associate with this macro and associate this sequence of commands with a key or an area of the room. Thus, all commands are executed by the gateway when the user activates the macro. The macro is activated either by pressing a macro key or by pointing to the area associated with this macro. For example, the user may wish to control all their lamps at once by pointing to a specific area of the room to avoid having to point to each lamp in the room to control them individually.
[0136] Calibration and error management procedures are now described.
[0137] According to a first branch, a learning algorithm is proposed. A learning algorithm makes it possible to improve the reliability of the system each time a pointed equipment to be controlled is controlled. The system then records the coordinates of the equipment to be controlled and adds its new coordinates to a database. For example, a window has a fairly large surface area and a user can point the window without it always being in the same place. It is then possible to ask the user to point one or more times the equipment to be controlled at different points of the equipment in order to calibrate the system using the learning algorithm. For example, to control shutters, it is possible to ask the user to point several corners of the window at the top left, bottom right. The system thus learns to delimit the area of the equipment to be controlled in space.When the user points to any point in the window, the system recognizes that the pointed area corresponds to the shutter control.
[0138] According to a second branch, a tolerance algorithm is proposed. A certain tolerance margin is inserted into the system so that the system identifies the equipment to be controlled that the user wishes to order even if the user does not perfectly point the equipment to be controlled. Thus, if the result of the location of the pointed equipment to be controlled does not exactly correspond to the coordinates recorded in the database, but is close to it, the system still validates the order for this equipment to be controlled.
[0139] According to a third branch, a probability algorithm is proposed. This algorithm makes it possible to determine the most probable equipment to be controlled among several possibilities. When the user points in a direction to control a piece of equipment to be controlled and the pointed direction does not correspond to any coordinate or to several coordinates in the database, the algorithm identifies the most probable equipment to be controlled based on different data, for example as being the one closest to the user and the control object.
[0140] According to a fourth branch, an error management algorithm is proposed. When the user points at a piece of equipment to be controlled and activates a command, but the command is sent to another piece of equipment to be controlled, the command object includes a "correction" or "help" button that allows the user to indicate that the wrong piece of equipment to be controlled was commanded. The user presses this button and manually indicates the piece of equipment to be controlled that he wishes to control. In this case, the different algorithms take this information into account in order to always control the piece of equipment to be controlled desired by the user when he points in this direction. Instead of the "correction" or "help" button, the user can make a specific gesture with the command object that indicates to the system that the command executed is not the one desired by the user. This gesture is captured by an accelerometer integrated into the command object.This gesture can be, for example, shaking the command object. In this case, the system cancels the command and applies the command to the second most likely device to be controlled.
[0141] According to a fifth branch, a macro or habit learning algorithm is proposed. This algorithm makes it possible to detect recurring user command patterns. Once a recurring pattern is detected, the gateway can decide to automatically chain the commands in the form of a macro without the user having to do so. For example, a recurring pattern could be the consecutive switching on of two lamps and the closing of a living room shutter at the same time. After several recurrences, the algorithm learns that the user always wants to switch on these two lamps and close the shutter at the same time. The gateway can then decide to always switch on the second lamp and close the shutter as soon as the user switches on the first lamp.
[0142] According to a sub-branch of this fifth branch, certain contextual elements such as the time, the day or even the position of the command object can be taken into account to improve the relevance of macros or commands and thus predict the user's wishes. For example, when the user points at the shutters and presses a command and it is morning, the algorithm determines that the user wishes to open the shutters. If, on several occasions, the user activates three pieces of equipment to be controlled successively always in the same time slot, then the algorithm can decide to create an automatic macro which activates the three pieces of equipment to be controlled at the same time, but only in this same time slot.
[0143] A system breakdown is now described.
[0144] The system optionally includes a gateway. The gateway is an element that centralizes the relative position of the positioning units and the control object, and receives commands from the user and includes a device for determining what is to be controlled based on the relative position of all elements and the pointing parameters. This determination device can be located either directly in the control object or in one of the positioning units, or in a separate gateway.
[0145] Positioning units can be powered by mains or battery. In this case, they only have this role and no other function. Alternatively, positioning units can be integrated into controllable equipment. In this case, command-to-control communication can use the same technology as that used for localization (UWB or other). Learning is not essential in this case, because the system knows the relative position of the controllable equipment to be controlled in relation to the control object.
[0146] The control object can be either a remote control, a tag or a smartphone.
[0147] A remote control may include: indoor geolocation electronics; an angle sensor such as a gyroscope, a motion sensor such as an accelerometer. The accelerometer also allows the remote control to be put into sleep mode when no movement is detected in order to save battery power; a magnetic field sensor; a pressure sensor to determine the height in a house or multi-story building, a distance sensor to calculate the distance between the remote control and the equipment to be controlled pointed at; a display configured to automatically display data depending on the equipment to be controlled or the area pointed at.The data can be: ∘ the current or set temperature for a thermostat or a radiator; ∘ the state of a lamp or a bulb, off or on; ∘ the current color of an RGB lamp; ∘ the state of shutters, open or closed; ∘ the volume, the title of songs, playlist, or even the name of the radio in the case of a musical source; ∘ the open or closed state or even a video of the person who rang the gate in the case of a gate, the display can show; ∘ the remaining cooking time or the current temperature of the oven when a user points to an oven.
[0148] When a music source is pointed at, a Shazam-like search of the current music is automatically generated and the result is displayed on the display. The result can be the song title, the album name, or even the artist. In this case, the remote control integrates a sound sensor.
[0149] The remote control can be without display.
[0150] The remote control is configured so that its display adapts dynamically in real time as soon as the remote control is picked up. It displays information related to whatever is pointed at. An accelerometer detects the movements of the remote control and turns on its display, and conversely, turns off its display when the remote control is placed down and no longer moves.
[0151] The remote control can be powered by batteries that the user changes or by rechargeable batteries. In the latter case, the user places the remote control on a base to recharge the remote control batteries.
[0152] The command object can be a tag. In the case of a tag, only the sensors used for location are present. The user keeps the tag on them when they move around a house, for example, so that light and music follow them. In this case, the user does not point to any equipment to control; it is a passive command.
[0153] The command object can be a smartphone: either the smartphone integrates indoor geolocation technology and the other sensors necessary for calculating angle and distance; or an additional accessory is added to the smartphone: this accessory includes the technology necessary for indoor geolocation, and connects either physically to the Smartphone (jack, USB, Lightning, etc.), or wirelessly via Bluetooth, BLE, Wifi, etc. This accessory is attached to the smartphone so that the position of the smartphone can be determined.
[0154] Now the commands are described.
[0155] Commands can be made with a touch screen according to the command matrices described below.
[0156] Alternatively or in combination with the touchscreen, controls can be implemented in the form of buttons such as + and - buttons, ON / OFF buttons, Change colors buttons, 1, 2, 3, A, B, C buttons, etc. These buttons can be used to activate: ∘ macros; ∘ or pre-recorded moods. A mood can be warm and subdued lights, cool and strong lights, closing the shutters and lowering the intensity of the lights to watch a film, turning off all the lights and lowering all the shutters, etc.
[0157] Commands are either active or passive.
[0158] In the case of active control, the user points to a piece of equipment to control directly visible equipment or to control equipment not directly visible. An example of controlling non-visible equipment is controlling a living room lamp from the kitchen or controlling all the roller shutters in the house.
[0159] In the case of passive control, the user moves around with the remote control or a tag in their pocket. The equipment to be controlled is automatically activated based on the location of the remote control or tag. The lights and music turn on automatically based on the position of the remote control or tag and thus follow the user from room to room based on their location. For example, the lights and music in the rooms where the user is not located turn off, and conversely, they turn on in the room where they are. In another example, the garage gate opens when the user approaches the gate with the tag on their key ring. In yet another example, the shutters close, the lights turn off, and the gate closes when the user moves away from the house.
[0160] There figure 2schematically represents a first embodiment of a method 200 for determining equipment to be controlled by a control object arranged in a space comprising positioning units capable of determining their relative positions with respect to each other.
[0161] Step 202 is a step of random deployment of positioning units. Some of these positioning units are able to know their absolute positions relative to the earth and are then called anchoring units.
[0162] Step 204 is a step of implementing location techniques. These techniques are trilateration or triangulation from data relating to a received signal such as the angle of arrival (AOA), the time of arrival (TOA), the time difference of arrival (TDOA), the received power (RSSI), the quality of the received signal (LQ), or the technique of measuring the electromagnetic field (EMF).
[0163] At the intermediate result step 206, the positions of all the location units are known relative to the anchor units. The absolute positions of all the location units are therefore known relative to the earth.
[0164] Subsequent to step 206, the method selectively implements one or the other of the two steps: in step 208a, the method implements orientation sensors relative to the space formed by the positioning units. These sensors can implement techniques such as EMF, AOA, directive transmission; in step 208b, the method implements absolute orientation sensors relative to the earth. These sensors are for example accelerometers or magnetometers.
[0165] Subsequent to steps 208a and 208b, the method implements the intermediate result step 210.
[0166] At step 210, the orientation of the control object relative to the earth is known. The orientation of the control object relative to the nodes is therefore easily deduced from this.
[0167] Thus, the process according to the figure 2implements a step of determining the position and orientation of the control object in space from the positions of the positioning units.
[0168] A step of determining a direction pointed by the control object from the position and orientation of the control object thus determined is then implemented. For example, it is sufficient to know the position of two points of the control object relative to the position of the control object to determine the direction pointed by the control object.
[0169] The method then implements a step of determining equipment to be controlled from the direction thus determined. Different possibilities for determining the equipment to be controlled from the direction thus determined will be described below.
[0170] There figure 3schematically represents a second embodiment of a method 300 for determining equipment to be controlled by a control object arranged in a space comprising positioning units capable of determining their relative positions with respect to each other.
[0171] Step 302 is a step of random deployment of positioning units. None of these positioning units knows its absolute position relative to the Earth.
[0172] Step 304 is a step of implementing selected anchor-free localization techniques such as trilateration or triangulation from data relating to a received signal such as the angle of arrival (AOA), the time of arrival (TOA), the time difference of arrival (TDAO), the received power (RSSI), LQ, EMF, etc.
[0173] In step 306, the positions of all the location units are determined relative to each other in the relative space of the location units.
[0174] In step 308, the user points the control object toward each of the location units, one after the other.
[0175] Subsequent to step 308, the method selectively implements two steps: in step 308a, the method implements orientation sensors relative to the space formed by the positioning units. These sensors can implement techniques such as EMF, AOA, directive transmission; in step 308b, the method implements absolute orientation sensors relative to the earth. These sensors are for example accelerometers or magnetometers.
[0176] Subsequent to steps 308a and 308b, the method implements step 310.
[0177] In step 310, the orientation of the control object relative to the space of the location units is deduced.
[0178] Thus, the process according to the figure 3 implements a step of determining the position and orientation of the control object in space from the positions of the positioning units.
[0179] A step of determining a direction pointed by the control object from the position and orientation of the control object thus determined is then implemented. For example, it is sufficient to know the position of two points of the control object relative to the position of the control object to determine the direction pointed by the control object.
[0180] The method then implements a step of determining equipment to be controlled from the direction thus determined. Different possibilities for determining the equipment to be controlled from the direction thus determined are described below.
[0181] There figure 4 illustrates an embodiment of a control system 400 according to the invention.
[0182] The 400 control system includes: a control object 402 arranged in a space, three positioning units 4041, 4042, 4043 in this space.
[0183] The three positioning units 4041, 4042, 4043 are capable of determining their relative positions to each other. In addition, each of the positioning units is a piece of equipment to be controlled.
[0184] The 4042 positioning unit includes: a processor 40421, communication means 40422 connected to the processor 40421, and positioning means 40423 connected to the processor 4021.
[0185] Each of the positioning units comprises equipment similar to the equipment of the positioning unit 4042. The respective communication means of the positioning units are configured to exchange information data with each other. These communication means are further each configured to exchange information data with the control object.
[0186] The control object 402 comprises a control device 406 for at least one piece of equipment to be controlled according to the invention and a communication means. The control object 402 also comprises a touch display screen and / or buttons of the control object. The device 406 comprises means arranged to determine relative positions in space of the three positioning units, means for determining the position and orientation of the control object 402 in space from the positions of the determined positioning units, means for determining a direction S pointed by the control object 402 from the position and orientation of this control object thus determined.
[0187] Thus, the control device 406 is configured to implement the methods of determining equipment to be controlled and of controlling equipment according to the invention.
[0188] Two embodiments have been described above with reference to the first two figures for: determining the position and orientation of the control object 402 in space from the positions of the positioning units, and determining a direction S pointed by the control object 402 from the position and orientation of the control object thus determined. Different exchanges are carried out between the control device and the positioning units, which is illustrated by the arrows CT1, CT2 and CT3 on the figure 4 .
[0189] In this "plug and play" embodiment, the equipment to be controlled includes the positioning units. Thus, no learning of the position of the equipment to be controlled is necessary. The location relative to the control object is known. From the first use, the system automatically knows which equipment is to be controlled as soon as the direction S pointed by the control object points to it.
[0190] The system automatically generates a map of all controllable equipment. The system automatically recalculates the virtual envelopes of the equipment to be controlled each time the user implements a function of the control object and no map needs to be stored. For example, if the user moves a light bulb, its new location is automatically taken into account when pressing the button of the control object.
[0191] Alternatively, it is also possible to store a map of the equipment to be controlled at all times. This can be advantageous when a large number of equipment to be controlled is present and a high responsiveness of the system is expected.
[0192] There Figure 5 illustrates a second embodiment of a control system 500 according to the invention.
[0193] The 500 control system includes: a control object 502 arranged in a space, two positioning units 5041, 5042 in this space; and three equipment to be controlled 5081, 5082, 5083.
[0194] The two positioning units 5041 and 5042 are capable of determining their relative positions to each other. Neither of these positioning units is a controllable device.
[0195] The 5042 positioning unit includes: a processor 50421, communication means 50422 connected to the processor 50421, and positioning means 50423 connected to the processor 5021.
[0196] Each of the positioning units comprises equipment similar to the equipment of the positioning unit 5042. The respective communication means of the positioning units 5041 and 5042 are configured to exchange information data with each other.
[0197] The control object 502 comprises a control device 506 for at least one piece of equipment to be controlled according to the invention. The device 506 comprises means arranged to determine relative positions in space of the three positioning units, means for determining the position and orientation of the control object 502 in space from the positions of the positioning units 5041 and 5042 determined, means for determining a direction S pointed by the control object 502 from the position and orientation of this control object thus determined.
[0198] Thus, the control device 506 is configured to implement the methods of determining equipment to be controlled and of controlling equipment according to the invention.
[0199] Two embodiments have been described above with reference to the first two figures for: determining the position and orientation of the control object 402 in space from the positions of the positioning units, and determining a direction S pointed by the control object 502 from the position and orientation of the control object thus determined.
[0200] Different exchanges are carried out between the control device and the positioning units, which is illustrated by the arrows CT1, CT2 and CT3 on the Figure 5 .
[0201] In this automatic type embodiment, the equipment to be controlled 5081, 5082, 5083 does not include a geolocation unit. A user of the control device 406 is asked to implement an automatic learning mode. In this learning mode, the system according to the invention sequentially actuates each of the equipment to be controlled 4081, 4082, 4083 individually so that the user can visually identify this equipment.
[0202] For each piece of equipment to be controlled operated by the system, the user must point several times from different position / direction pairs, using the control object 502, the virtual envelope of this piece of equipment to be controlled 5081, 5082, 5083 and execute a particular action on the control object, for example press a button on the control object or on a touch screen of the latter.
[0203] When the control object has a distance sensor, the system only needs to know one position / direction pair.
[0204] The system thus learns to make a link between the equipment to be controlled and a part of the virtual envelope associated with the equipment to be controlled thus defined by the use.
[0205] The system then activates the next equipment to be controlled and so on until all the equipment to be controlled identified in the house is located by the system.
[0206] The system automatically generates a map when the user points to equipment to be controlled. The map must be kept to avoid losing the learning of the location of the virtual envelopes.
[0207] Thus, the virtual envelope of at least one piece of equipment to be controlled is defined from a plurality of determinations of position and orientation of the control object in space from the positions of the positioning units, and from a plurality of determinations of directions pointed by the control object from a plurality of positions and orientations of the control object thus determined.
[0208] As understood in light of the description of the Figure 5 , the positioning units then only play the role of positioning units.
[0209] In reference to the figure 4, the positioning units are integrated into the equipment to be controlled. In this case, the control of the equipment to be controlled can advantageously implement the same technology for communication as that used for localization. It will be possible to advantageously use a technology such as UWB (for the English "Ultra Wide Band").
[0210] A step of determining equipment to be controlled from the direction thus determined by a control device according to the invention is now described in more detail.
[0211] The equipment to be controlled is that which is associated with the virtual envelope closest to the axis pointed by the direction S of the control object determined by the control device.
[0212] When the direction pointed to by the command object corresponds to several possibilities of virtual envelope of equipment to be controlled, the most probable virtual envelope is chosen: The most probably pointed virtual envelope is the virtual envelope closest in space to the command object (therefore to the user).
[0213] Furthermore, when the equipment to be controlled determined by the system from the direction of the control object is considered incorrect by the user, the user can indicate that the wrong equipment to be controlled has been determined. In this case, algorithms for managing the virtual envelope associated with this equipment take this information into account in order to always control this equipment when the user points in this direction. In this case, the system can automatically cancel the first command that the user considers to be incorrect and applies the same command to the second most probable virtual envelope after the first.
[0214] To indicate that the command is incorrect, the user can either press a button (physical or touch zone), or make a specific gesture with the command object which will be captured by an accelerometer-type sensor and interpreted by the command object.
[0215] The equipment to be controlled can also be associated with one or more other virtual envelopes. To do this, the system implements a routine learning mode. Thus, the system can detect that a user has the habit of turning on two lamps and closing a living room shutter within a short period of time. The system then controls the turning on of the other lamp and the closing of the shutter as soon as it has determined from the direction pointed by the control object that the equipment to be controlled is one of the two lamps.
[0216] A virtual envelope is defined as an area of the positioning unit space associated with a piece of equipment to be controlled. Different possibilities for determining a virtual envelope are now described.
[0217] The virtual envelope is defined in part by implementing a learning algorithm. A learning algorithm improves the reliability of the system each time a piece of equipment is controlled. The system records information relating to the determined direction of the control object and increases the virtual envelope of the equipment to be controlled with this information. A definition of a virtual envelope of an equipment to be controlled is possible by interaction with a user. For example, to control shutters, it is possible to ask the user to point at several corners of the window at the top left and bottom right. The system thus learns to delimit the virtual envelope of the window in space. When the user points anywhere on the window, i.e. inside the virtual envelope relating to the shutters, the system recognizes that the pointed area corresponds to a shutter control.
[0218] The virtual envelope is also defined by implementing a tolerance algorithm. The tolerance algorithm increases the volume of the previously defined virtual envelope.
[0219] In one embodiment of the control object, it comprises buttons and a display screen. The control interface of the control object adapts according to the equipment to be controlled. The control object comprises: + and - buttons to respectively increase or reduce an intensity relative to the equipment to be controlled, for example the sound volume or the light intensity, ON, OFF buttons to respectively turn on or off the equipment to be controlled, color change buttons, for example to change the color of a lamp, buttons to control macros, for example to control a plurality of equipment or to control pre-recorded atmospheres such as warm and subdued lights, cold and strong lights, closing shutters and lowering the light intensity to watch a film, a sequence of turning off all the lights and closing all the shutters, etc.
[0220] Of course, other embodiments of the control object are imagined such as the implementation of a touch surface. The control interface of the control object and the control itself adapt according to the equipment to be controlled. The control also adapts according to the number of fingers used (1 finger, 2 fingers, 3 fingers, etc.) and the movement made with these fingers on the touch surface (from bottom to top, from left to right, etc.). Thus, the command communicated to control the controlled equipment(s) adapts according to the combination of the area pointed to by the control object and the movements of the fingers made on the touch surface.
[0221] Of course, the user can configure the control object as desired to control all the functions of the equipment to be controlled.
[0222] Of course, the invention is not limited to the examples just described and many adjustments can be made to these examples without departing from the scope of the invention. In addition, the various features, forms, variants and embodiments of the invention can be combined with each other in various combinations to the extent that they are not incompatible or mutually exclusive.
[0223] The control device can, for example, be an accessory added to the control object. The control object can be made in the form of a smartphone.
Claims
1. Method for determining a piece of equipment to be controlled by a portable control object disposed in a space comprising at least one positioning unit capable of determining the relative position of said control object in relation to this positioning unit, the method comprising: - a step of associating a reference frame related to the control object with a reference frame related to the at least one positioning unit, - a step of determining the position and orientation of said control object in said space on the basis of said position of said at least one positioning unit, - a step of determining a direction and line in / on which said control object is pointing on the basis of said thus determined position and orientation of said control object, - a step of determining a piece of equipment to be controlled in the space on the basis of the thus determined directions and lines, characterized in that the step of associating the reference frame related to the control object with the reference frame related to the at least one positioning unit comprises, for each of the positioning units, a step comprising the user pointing this control object at a positioning unit and the user pressing the control object.
2. Method according to Claim 1, wherein the space comprises a plurality of positioning units capable of determining their relative positions in relation to one another.
3. Method according to Claim 1 or 2, wherein the step of determining the position and / or the step of determining the orientation of the control object in said space comprises a step of evaluating the time of flight of a radio signal between the control object and a positioning unit, or between multiple positioning units.
4. Method according to any one of the preceding claims, wherein the step of determining the position and / or the step of determining the orientation of the control object in said space comprises a step of the control object or the at least one positioning unit evaluating the received power of a radio signal.
5. Method according to any one of the preceding claims, wherein the step of determining the position and / or the step of determining the orientation of the control object in said space comprises a step of the control object or the at least one positioning unit determining the angles of reception of a radio signal.
6. Method according to any one of the preceding claims, wherein the step of determining the position and / or the step of determining the orientation of the control object in said space uses and measures electromagnetic fields.
7. Method according to any one of the preceding claims, characterized in that it comprises a step to define a virtual envelope of at least one piece of equipment to be controlled and in that the step of determining a piece of equipment to be controlled uses the virtual envelope defined for the at least one piece of equipment to be controllede.
8. Method according to Claim 7, wherein the virtual envelope of the at least one piece of equipment to be controlled comprises no point on the physical envelope of the equipment to be controlled.
9. Method according to Claim 7 or 8, characterized in that it comprises a step of moving a piece of equipment to be controlled and an action by a user on the control object, the action by the user on the control object being followed by renewed performance of a method according to any one of the preceding claims in order to determine the new virtual envelope of said moved equipment.
10. Method according to any one of the preceding claims, characterized in that it comprises a step of contextually enhancing a piece of equipment to be controlled by way of enhancement data and in that the step of determining a piece of equipment to be controlled performs this contextual enhancement, said enhancement preferably implementing physical quantity data, the time, the date, the position of the control object, responses from the user to questions, or the repetitiveness of controls carried out by the user.
11. Method for controlling a piece of equipment to be controlled among at least one piece of equipment to be controlled from a control object, comprising a step of determining a piece of equipment to be controlled using a method according to any one of Claims 1 to 10 and a step of the control object transmitting control data to the equipment to be controlled.
12. Control method according to Claim 11, characterized in that it comprises a step of automatic discovery to discover each of the pieces of equipment to be controlled.
13. Control method according to Claim 11 or 12, characterized in that it comprises adapting a control interface of the control object according to the equipment to be controlled.
14. Control method according to any one of Claims 11 to 13, characterized in that it comprises a touch-sensitive surface interpreting at least one movement by at least one finger of a user on said surface and in that the control data are generated on the basis of this interpretation.
15. Control method according to any one of Claims 11 to 14, characterized in that it comprises the control interface displaying information according to the determined equipment.
16. Device for controlling at least one piece of equipment to be controlled in a space by at least one portable control object, said device being characterized in that it comprises: - means for associating a reference frame related to the control object with a reference frame related to the at least one positioning unit, - means for determining the position and orientation of said at least one portable control object in said space in relation to at least one positioning unit, - means for determining a direction and line in / on which said at least one control object is pointing on the basis of the thus determined position and orientation of this control object, - means for determining a piece of equipment to be controlled on the basis of the thus determined direction and line, characterized in that the means for associating a reference frame related to the control object with a reference frame related to the at least one positioning unit comprise, for each of the positioning units, receiving the user's pointing of this control object at a positioning unit and the user's pressing of the control object.