A remote control system and method

Abstract

The present invention relates to a system comprising a receiver, a transmitter and a system for wirelessly controlling an electronic control device and a target device, and to a method arranged for said system.

Description

[0001] DESCRIPTION

[0002] A REMOTE CONTROL SYSTEM AND METHOD

[0003] Technical Field of the Invention

[0004] The present invention relates to a system comprising a receiver, a transmitter and a system for wirelessly controlling an electronic controller and a target device, and to a method arranged for said system.

[0005] State of the art regarding the invention

[0006] External transmission systems arranged to enable users to control various smart devices and remotely controlled drones and similar unmanned vehicles with their personal electronic devices are known in the art. These systems comprise a transmitter connected to the user's personal device and a receiver connected to the target device to be controlled, which receives control commands from the transmitter.

[0007] In systems for controlling unmanned vehicles, a physical RC controller is usually used as a transmitter. These remotes usually operate in the 2.4ghz radio band. In these systems, additional devices are needed for telemetry and control and are sold separately in the market as telemetry modules. An example of these devices is the Radiolink AT10II® system. This system also requires a telemetry module. Telemetry modules are generally offered for sale to operate in the 433 / 867 / 915 Mhz radio band. For this reason, not every telemetry device can be used in every country. Because some tapes cannot be used without permission.

[0008] Moreover, the control schemes of these systems are extremely limited and their adaptation to different devices and scenarios is extremely challenging or impossible.

[0009] In addition, Wi-Fi based systems are used to control some smart systems. Although Wi-Fi based systems are easy to use, they are highly susceptible to interference, which poses a major problem in systems where commands need to be received and executed quickly.

[0010] It is also known that various control operations can be performed with IR transmitters attached to cell phones, but the control range of these systems is extremely limited. Another known problem is the need for controller such as controls (remote control, touch screen, joystick, etc.) in existing systems. Using these controls for simple commands is inconvenient for the user.

[0011] As a result, all abovementioned problems have made it necessary to make an improvement in the relevant technical field.

[0012] Objects of the Invention

[0013] The main object of the present invention is to provide the structure of an RF-based system for wireless control of a target device by an electronic controller.

[0014] The object of the present invention is to eliminate the need for an external telemetry module in wireless control systems.

[0015] The object of the present invention is to provide the structure of a system that can be easily customized for different target devices.

[0016] The object of the present invention is to provide the structure of a system that can be easily arranged to operate in different frequency band ranges.

[0017] Definitions of the Figures Describing the Invention

[0018] The figures and related explanations used so as to better explain the device developed with the present invention are given below.

[0019] Figure 1. A schematic representation of the inventive system.

[0020] Figure la. A schematic representation of the transmitter.

[0021] Figure lb. A schematic representation of the receiver.

[0022] Figure 2a. Isometric view of the transmitter

[0023] Figure 2b. Isometric view of the receiver

[0024] Figure 3. Isometric view of the sensor unit

[0025] Figure 4. Isometric view of the serial converter

[0026] Figure 5. A schematic representation for the connection of the inventive system.

[0027] Figure 5a: Flow diagram for programming the inventive system.

[0028] Figure 6. Control algorithm of the inventive system based on artificial intelligence. Definitions of Elements / Sections / Parts that Constitute the Invention

[0029] The parts and parts in the figures are enumerated and the corresponding of each number is given below in order to better explain the device developed with this invention:

[0030] 1. Controller

[0031] 2. Target device

[0032] 10. Transmitter

[0033] 11. Transmitter RF card

[0034] 12. Transmitter antenna

[0035] 13. Transmitter antenna connection

[0036] 14. Data connector

[0037] 20. Receiver

[0038] 21. Receiver RF card

[0039] 22. Receiver antenna

[0040] 23. Receiver antenna connection

[0041] 24. Serial connector

[0042] 25. Pins

[0043] 26. Sensor unit

[0044] 27. Sensors

[0045] 28. Sensor card

[0046] 30. Serial converter

[0047] 31. Serial converter connection

[0048] S.C. Inverter chip

[0049] RFC. RF chip

[0050] A. Amplifier

[0051] P. Processing unit

[0052] Detailed Description of the Invention The present invention relates to a system comprising a receiver, a transmitter and a system for wirelessly controlling an electronic controller and a target device, and to a method arranged for said system.

[0053] Referring to Figure 1, the current system comprises a transmitter (10) and receiver (20). Said receiver (20) and transmitter (10) are respectively connected to an electronic controller (1) and an electronic target device (2) to be controlled by said electronic controller (1). The transmitter (10) and receiver (20) mentioned here can perform bidirectional communication, that is, they can both send data to each other and receive data from the other side.

[0054] The controller (1) referred to may be a computer, a mobile device such as a tablet or smartphone, an electronic device such as an RC controller. Said controllers (1) may also comprise elements such as a touch screen, keyboard, and mouse or game controller for input of control commands. In one embodiment of the invention, the user is able to give commands by voice via the controller (1). Accordingly, the controller (1) may comprise an internal or external microphone. It is also possible to provide a microphone on the transmitter (10).

[0055] Said target device can be unmanned vehicles such as RC cars, airplanes, boats or boats, GPS navigation systems, systems based on influence recognition and logging, devices for smart home and industrial applications, security and positioning systems, systems for automotive industry applications, RF remote controls for consumer electronics, intelligent robotic systems, systems with motion-activated functions.

[0056] With reference to Figures 1 and 2a; said transmitter (10) comprises a transmitter connector (14) for connecting to the controller (1). Said transmitter connector (14) is a serial type connector. As a serial connector, USB type connectors, especially type A, type B, type C or micro connectors are preferred.

[0057] In addition, the existing transmitter (10) comprises a transmitter RF card (11) for transmitting control commands via RF communication and receiving data from the receiver. The commands are sent to the receiver (20) via the transmitter RF card (11) via the transmitter antenna (12) using RF waves. Although communication is preferably carried out over the 2.4 GHz band, as will be explained later, the present invention also comprises configurations in which band ranges can be regulated.

[0058] Said transmitter antenna (12) is preferably arranged to be detachable, preferably with a transmitter antenna connection (13). Although the transmitter antenna (12) is not required for minimum communication, the use of the transmitter antenna (12) increases both the communication quality and the communication range. However, removing the transmitter antenna (12) is also advantageous as it reduces the total volume of the transmitter (10).

[0059] The present transmitter (10) may comprise its own power supply (not shown in the figures) or it may receive power from the control device to which it is connected via the data connector (14).

[0060] Referring to Figure la, the present transmitter (10) comprises a serial converter chip (SC), for example an R232 converter, for converting what it receives via a serial transmitter connector (14) as previously described. Said converted data and the data received by the receiver (20) are processed by a processing unit (P). Since the structure, packet shape and reading methods of these data are different; they need to be processed to be sent via RF card. The processing unit (P) makes the commands from the controller (1) available for RF communication and also processes the data received by the receiver (20) and controls the transmission between the controller (1) and the receiver (20). Furthermore, the processing unit (P) is preferably configured to ensure that transactions and data transfer are performed in the correct sequence, thus avoiding data confusion. In addition, the processing unit (P) can also control the transmitter RF card (11) so that the transmitter RF card (11) operates as required in the desired frequency band. Here the processing unit (P) can be a microprocessor or microcontroller.

[0061] Here, the processing unit (P) makes the data suitable for RF communication and the data is transmitted from the RF chip (RFC) to the transmitter antenna (12) via the RF card (11), preferably by using an amplifier (A), and from there to the receiver. Here the amplifier (A) increases the communication range.

[0062] With reference to Figures 1 and 2b; said receiver (20) comprises a serial connector (24) to connect to the target device (2). Said serial connector comprises multiple input and output pins (25). Said input and output pins (25) are wired to the target device (2) to control the appropriate functions of the target device (2), e.g. motor, processor, GPS or sensor, and to receive data.

[0063] The present receiver (20) comprises a sensor unit (26) for providing data relating to the target device (2). Said sensor unit (26) comprises multiple sensors (27). Preferably one of the sensors is an inertial measurement unit, preferably an inertial measurement unit with 10 degrees of freedom. The inertial measurement unit with 10 degrees of freedom measures acceleration on 3 axes, gyroscope on 3 axes, magnetic field and pressure on 3 axes. In addition, devices such as temperature, pressure, altitude, GPS-like position sensors (27) can also be found in the receiver (20). Said sensors (27) are connected to the receiver (20) via said input and output pins (25). While the sensor unit (26) is a necessity for the control of unmanned vehicles, it is not essential for systems such as smart home applications that do not need measurement and data monitoring.

[0064] Preferably the invention uses Neo 6, 7 or 8 as GPS.

[0065] Furthermore, the present receiver (20) comprises a receiver RF card (21) for transmitting various data from the target device (2) via RF communication and receiving commands and data from the transmitter (10). The data is sent from the receiver RF card (21) to the transmitter (10) via the receiver antenna (22) using RF waves. Although communication is preferably carried out over the 2.4 GHz band, as will be explained later, the present invention also comprises configurations in which band ranges can be regulated.

[0066] Said receiver antenna (22) is preferably arranged to be detachable, preferably with a receiver antenna connection (23). Although the receiver antenna (22) is not required for minimum communication, the use of the receiver antenna (22) increases both the communication quality and the communication range. However, removing the receiver antenna (22) is also advantageous as it reduces the total volume of the receiver (20).

[0067] By using antennas at both the transmitter (10) and receiver (20), a communication range of up to 5 km is possible. Depending on the appropriate component selection and environment, this range can be increased.

[0068] The present receiver (20) may comprise its own power supply (not shown in the figures) or it may receive power from the control device to which it is connected via the serial connector (24). Preferably there are power input and ground pins next to the input and output pins (25) provided on the serial connector (24). Device supply is also possible via this power input and ground pins.

[0069] With reference to Figure lb, the present receiver (20) can be connected to the target device (2) via pins (25) of a serial connector (24) to the target device (2), and more precisely to the motor, processor or sensor and GPS-like elements of the target device (2), as previously described. In addition, the sensor unit (26) is also connected to the existing serial connector (24) to sensors (27) that are externally connected to the receiver (20). A serial converter (30) can also be used between the target device (2) and the receiver (20). Both the data from the transmitter (10) and the data from the target device (2) and sensors (27) are processed by a processing unit (P). Since the structure, packet shape and reading methods of these data are different; they need to be processed to be sent via RF card. Here, the processing unit (P) makes the data suitable for RF communication and transmits it to the receiver antenna (22) by using the RF card (11) and then to the transmitter (10). Here the processing unit (P) can be a microprocessor or microcontroller. Furthermore, the processing unit (P) is also preferably configured to ensure that processes and data transfer are performed in the correct order, thus avoiding data confusion. In addition, the processing unit (P) can also control the transmitter RF card (11) so that the transmitter RF card (11) operates as required in the desired frequency band.

[0070] Here, the processing unit (P) and the sensor unit (26) act together as telemetry. In other words, after the sensor unit (26) is connected to the processing unit (P) via input-output pins (25), the surveillance function as well as control between the controller (1) and the target device (2) is provided without the need for a separate telemetry device.

[0071] Figure 3 shows the sensor unit and Figure 4 shows the serial converter (30).

[0072] The sensor unit (26) comprises the sensors (27) as described earlier. The sensor unit (26) comprises cables (not shown in the figures) to connect to the input and output pins (25) of said receiver (20).

[0073] Similarly, the serial converter (30) comprises wires (not shown in the figures) to connect to said input and output pins (25), and the serial converter (30) also has a serial converter connection (31). Preferably the serial converter connector (31) is a serial type connector. As a serial connector, USB type connectors, especially type A, type B, type C or micro connectors are preferred.

[0074] Referring to Figures 5 and 6; the serial converter (30) enables the receiver (20) to be connected to the controller (1), thus enabling tasks to be assigned to the input and output pins

[0075] (25) of the receiver (20). The communication frequency and / or ESC and Servo PPM signal resolutions can also be selected for the receiver (20), preferably with the serial converter (30). For example, here it is possible to use bands other than 2.4GHz, such as 2400-2483MHz, 433,867, 915 Mhz. In addition, these assignments and choices ensure that the transceiver system is fully customizable. This also determines which keys (or, in the case of a touchscreen, which areas of the interface) of the controller (1) or controllers connected to the controller (1), such as a display, keyboard, mouse or game controller, are assigned the functions.

[0076] After these assignments, when the input and output pins (25) are connected to the appropriate parts of the target device (2), the assigned functions can be performed according to the commands provided from the controller (1).

[0077] For these assignments to take place, the serial converter connection (31) of the serial converter (30) is connected to the controller (1) or another device that can transfer data to this controller (1), and the cables of the serial converter (30) are connected to the input and output pins (25) of the receiver (20). The assignment is carried out by means of a program on the controller (1). After the assignments have been made, the transmitter (10) is connected to the control device (1) via the data connector (14) and an embedded software (firmware) obtained according to the assignments of the receiver (20) is assigned to the transmitter (10), making it possible for the receiver (20) and transmitter (20) to work in harmony. Here the embedded software is generated by the aforementioned program installed in the controller (1).

[0078] In short, the input and output pins (25) are programmable by a program on the controller (1).

[0079] After the assignment of tasks / functions to the input / output pins (25) by the serial converter (30) and after an embedded software obtained according to the receiver (20) assignments is loaded / assigned to the transmitter (10), the transmitter (10) is connected to the controller (1) via the serial port via the data connector (14) and the receiver (20) is connected to the target device via the serial connector (24). At this point, the serial converter (30) has no function in the communication between the target device (2) and the controller (1).

[0080] Here, the transmitter (10) receives and processes the data required to be transmitted from the controller (1) to the receiver (20) via the serial port and then transmits the required signals to the receiver (20) as RF communication. The receiver (20) generates the necessary signals from the input and output pins (25) or reads the necessary sensor (27) data in line with the RF signal it receives. The transmitter (10) transmits wireless data from the receiver (20) via RF communication to the controller (1) via the serial connector (14) and thus performs telemetry. The receiver (20) provides readings from the sensors (27) connected to the input and output pins (20) on these data and processes the data obtained as a result of the reading, generates the required RF signal and transmits it to the transmitter controller (1).

[0081] For example, in a drone control, as a result of a command to turn in a certain direction on the controller (1), the command is sent via the transmitter (10) to the appropriate pins (25) of the receiver (20), that is, to the pins (25) connected to the required motors or when a command to increase the brightness of a lamp is given by the controller (1), it is transmitted to the pins (25) of the receiver (20) connected to the lamp and the power is increased at the pins.

[0082] In one embodiment of the invention, artificial intelligence is also used. The content of a voice command is detected by artificial intelligence and the appropriate input and output pin (25) for the realization of the command is detected by artificial intelligence and the appropriate command is generated and transmitted to the receiver (20) via the transmitter (10). For example, when the user gives the command "reduce the brightness of the kitchen lamp", the input output pin (25) to which the kitchen lamp is connected is found and the command to reduce the power supplied to this pin (25) is generated. These operations for artificial intelligence are carried out by software organized on the controller (1).

[0083] Referring to Figure 6; the commands that the user wants to send for use are received into the system. It can issue these commands via a game controller, touch screen, voice command, text message, keyboard, mouse and many other input devices.

[0084] A filter algorithm is then used to determine the type of incoming commands. This algorithm is based on artificial intelligence and is filtered according to whether the command received in the artificial intelligence algorithm will be used in voice command (VOICE COMMAND), text command (TEXT COMMAND) or manual mode (MANUAL MODE).

[0085] To detect the voice, the microphone of the device to which the transmitter (10) is connected or a device that provides audio input and the code block to receive the voice command are used. Interference, noise and irregularities in the received voice command are filtered with a filtering code block.

[0086] A separate code block is used to determine the language of the voice command, but if the user has selected a language before giving the voice command, the voice is processed in that language. If no selection is made or automatic language selection is active, the language is detected automatically. Language selection is important to ensure high accuracy. The received audio is then converted into a text. Here, algorithms known in the art such as Google® Speech Recognition can be used. In addition, as mentioned above, the command can be received directly from the text. In both cases, the written command is fed to the generative Al.

[0087] In addition, manual mode is available to allow the user to perform manual control. It makes the user's inputs such as game controller, keyboard, mouse or touch screen etc. available for manual control.

[0088] Preferably an input filter can also be used here. This filter is the filter block that prevents conflicting control commands from the user. This prevents different types of user commands (voice, text, manual) from conflicting with each other.

[0089] In the case of using manual mode, a filter block is used to ensure that the commands generated for this mode are in a format that can be transmitted from the serial interface to the transmitter (10). This filter determines which input will affect which input-output pin (25).

[0090] For the Al to work, a generative Al table and data on pre-definitions and user choices are used. Here, the generative Al table comprises instructions for the operation of the receiver (20) and transmitter (10), the predefinitions include examples such as the form of address between the user and the Al, the form of response back and so on, and the user choices include the user's selections from the control interface, such as the device type, device name, device range, selected language of operation and so on.

[0091] Here, a license key for the use of artificial intelligence is preferably provided for each user.

[0092] Preferably, the generative Al is executed in a processing unit (P). Preferably the processing unit (P) is located on the local server or on a cloud-based server. It is the central processing unit of generative Al. It can reside on a local server or on a cloud-based server. Third party artificial intelligence can be preferred on a user basis. Examples of these AIs are ChatGPT® and Google Bard ®. Written commands are transmitted to the generative Al, which interprets them, generates responses and transmits them to the broadcast block. The responses generated for high accuracy are transmitted back to the artificial intelligence from the broadcast block, if there is telemetry data during this process or if there is data coming from the transmitter (10) over the serial interface, these data are also transmitted to the artificial intelligence via the "FEEDBACK REQUEST" block. If there is no incoming feedback or command message, the Al puts itself on hold. Preferably, a separate block of code is used to combine the answers from the Al into a meaningful text. In special cases, when the messages need to be processed together with telemetry data or data from the transmitter (10) on the serial interface and given back to the Al, feedback is fed back to the feedback request block. For the accuracy of the messages generated by artificial intelligence, feedback is also provided to artificial intelligence.

[0093] The feedback request block mentioned here is the code block that feeds back to the Al in cases where telemetry data or data from the transmitter (10) on the serial interface and comments from the Al should be used together.

[0094] After the Al interprets the user commands, a code block is used to collect the final version of the message it generates in this context. This block transmits the message to the user interface and informs the user. In addition, this block transmits the prepared message to the artificial intelligence control command filter block to generate the necessary control commands.

[0095] The Al control command filter block mentioned here is the filter block that examines the message generated by artificial intelligence and ensures that the commands in the message generated for the situations that are desired to be controlled by artificial intelligence are in a format that can be transmitted to the transmitter (10) from the serial interface. This filter determines which input will affect which input-output pin (25).

[0096] Here, through the serial interface communication block, the necessary commands are transmitted to the selected serial interface in line with the selections made by the user and the control commands created.

[0097] Here, with transmitter read and write communication, the transmitter (10) device reads the commands coming from the serial interface and transmits them wirelessly to the receiver (20) via RF communication. It also receives the data from the receiver (20) wirelessly via RF communication and writes it to the serial interface.

[0098] The telemetry data coming from the transmitter (10) and the additional information written to the serial interface are read and transmitted to the artificial intelligence with the telemetry value and serial feedback code block. It is also the code block that informs the user by writing this data to the user interface.

[0099] The receiver read and write RF communication block receives control commands from the transmitter (10) via RF communication and transmits telemetry, error codes, battery etc. data to the transmitter (10) via RF communication. Another block is used to regulate the input and output pins (24) in accordance with the control commands coming from the transmitter (10) and the necessary signal generation, data reading and fault checking operations are performed here.

[0100] If there is a command to generate a signal, or if the value of an existing signal has changed, or if there are situations such as a motor starting or changing speed, the output signals on the IO pins are regulated with the output signal generation block in accordance with the commands coming from the receiver (20) programmed in this context. The process results are fed back to the transmitter (10) via RF communication via the receiver (20).

[0101] If the receiver (20) is programmed to activate the telemetry feature or if data is to be read via the input and output pins (24), the data is read and transmitted back to the transmitter (20) via RF communication via the receiver (20). If necessary, the read data can also be used in the control algorithms of the receiver (20). "DRONE CONTROL MODE" flight control application is an example of these algorithms. In this algorithm, PID- supported flight control is realized with battery and IMU sensor data, and motor speeds are adjusted according to battery charge rate and drone acceleration etc. Motor speed signals are transmitted to the motors via the output signal generation block code block.

[0102] An fault check block is used on the receiver (20) to generate error messages in unexpected situations. Error messages are reported back to the transmitter (10) via RF communication via the receiver (20).

Claims

CLAIMS1. A remote transmission system for the transmission of a command from a controller (1) for the control of an electronic target device (2), characterized in that, it comprises the following;- a transmitter (10) having a serial data connector (14) for connection to the controller (1) via serial ports, a transmitter RF card (11) for transmitting data received from the controller (1) and receiving data from the target device (2) in accordance with RF communication, and a processing unit (P) to make the commands from the serial data connector (14) suitable for RF communication- a receiver (20) having a serial connector (24) with multiple input and output pins (25) for connection to elements controlling the functions of the target device (2), a receiver RF board (21) for receiving data transmitted from the control device (1) and transmitting data provided from the target device (2) to the control device (1) in accordance with RF communication; and a processing unit (P) to make the data received from the mentioned multiple inputoutput pins (25) suitable for RF communication.

2. A system according to claim 1, characterized in that, it comprises a sensor unit (26) comprising at least one sensor (27) connected to at least one of said input-output pins (25)3. A system according to claim 2, characterized in that, said sensor unit (26) is provided externally.

4. A system according to claim 2 or 3, characterized in that, said sensor (27) is an inertial measurement unit.

5. A system according to claim 4, characterized in that, said inertial measurement unit has 10 degrees of freedom.

6. A system according to any of the preceding claims, characterized in that, it comprises cables for the connection of said sensor (27) to at least one of the input-output pins (25).

7. A system according to claim 1, characterized in that; said serial data connector (14) is a USB.

8. A system according to claim 1 or 7, characterized in that; the transmitter (10) is configured to receive power supply from the controller (1) via the serial data connector (14).

9. A system according to claim 1, characterized in that; said receiver (20) is configured to receive power supply from the target device (2) via the serial connector (24).

10. A system according to any of the preceding claims, characterized in that; it comprises a serial converter (30) which also allows the receiver (20) to be programmed by the controller (1) has at least one serial converter connection (31) to connect to the controller (1) via serial ports and cables to be connected to the receiver (20) via input output pins (25).

11. A system according to claim 1, characterized in that; said serial converter connection (31) is USB.

12. A connection method for a remote transmission system according to claim 8, which enables transmission of a command provided from a controller (1) for control of an electronic target device (2), characterized by; connecting said serial converter (30) to the controller (1) via the serial converter connection (31) and to the input output pins (25) of the receiver (20) via cables, performing the assignment step involving the assignment of functions to at least said input-output pins (25) via the controller (1) according to the elements to be controlled in the target device (2) by means of a software executed on the controller (1), said controller (1) generating an embedded software according to the functions selected in the assignment step and then the transmitter (10) being connected to the controller (1) viaserial ports via the data connector (14), and the embedded software being pushed to the transmitter (10).

13. A method according to claim 10, characterized by; the assignment of the operating frequency of the RF communication with a software executed on the controller (1) in said assignment step.

14. A method according to claim 10, characterized by the assignment of the ESC and Servo PPM signal resolutions by a software executed on the controller (1) in said assignment step.

15. A method according to claim 10, characterized by the assignment of the functions of the control elements to which the user inputs control commands by means of software executed on the controller (1) in said assignment step.

Images