Method for detecting an environmental environment using a side lobe of a directional beam

Abstract

The invention relates to a method (100) for detecting an ambient environment (1) using a side lobe (91a, 91b, 91c, 91d, 92a, 92b, 92c, 93a, 93b) of a directional beam (4, 5, 6), comprising the following steps: - Providing (101) one or more devices (21, 22, 23) capable of emitting the directional beam (4, 5, 6) at a target (30) located in the surrounding environment (1), - Initiating (102) a detection of the surrounding environment (1) with regard to the target (30) using at least one side lobe (91a, 91b, 91c, 91d, 92a, 92b, 92c, 93a, 93b) extending from the directional beam (4, 5, 6) emitted by the one or more devices (21, 22, 23), - Detecting (103) at least one object (41, 42) based on the detection taken by the at least one side lobe (91a, 91b, 91c, 91d, 92a, 92b, 92c, 93a, 93b).

Description

[0001] The invention relates to a method for detecting a surrounding environment using a side lobe of a directional beam. Furthermore, the invention relates to a computer program, a device, a system, and a storage medium for this purpose. State of the art

[0002] In today's industrial environments, communication technologies are crucial for synchronizing complex machine operations. Beamforming, a signal processing technique used by multiple base stations, such as those found in factory environments, directs data flow via beams of concentrated energy to a specific user device. This technique increases signal strength and minimizes interference, which is critical in densely populated industrial zones with numerous machines and communication channels. Historically, beamforming has primarily been used to improve communication efficiency and network capacity.

[0003] The disadvantage of known solutions in the aforementioned technical field is that conventional beamforming techniques still have limitations for industrial environments or applications. Conventional beamforming discards side lobes, treating them as mere byproducts rather than as a useful technology. Although beamforming focuses on enhancing communication links by directing main lobes to intended receivers, it ignores their side lobes, which can cause unwanted artifacts.

[0004] Furthermore, existing solutions often lack the ability to detect non-communication events, such as the presence of unexpected obstacles or people within the operating area of ​​an industrial machine. These limitations frequently lead to safety hazards when people unintentionally enter the paths of high-energy beams. In addition, safety mechanisms in many industrial environments are often reactive rather than proactive. Systems typically only halt operation after an obstacle has been encountered, not before. This can lead to delays and potential accidents, impacting both safety and productivity.

[0005] One object of the present invention is therefore to overcome at least some of the disadvantages described above. In particular, one object of the present invention is to provide additional detection capabilities using beam shaping technology. Disclosure of the invention

[0006] According to aspects of the invention, a method with the features of claim 1, a computer program with the features of claim 8, a system with the features of claim 9, a data processing device with the features of claim 10, and a computer-readable storage medium with the features of claim 11 are provided. Further features and details of the invention are disclosed in the respective dependent claims, the description, and the drawings. Features and details described in the context of the method according to the invention also correspond in each case to the computer program, the system, the data processing device, and the computer-readable storage medium according to the invention, and vice versa.

[0007] According to one aspect of the invention, a method for detecting a surrounding environment or surrounding area using a side lobe of a directional beam is provided. The method comprises the following steps: - Providing one or more devices capable of emitting the directional beam at a target located in the surrounding environment, - Initiating a survey of the surrounding environment with respect to the target using at least one side lobe extending from the directional beam emitted by the one or more devices, - Detecting at least one object based on the detection taken by the at least one side lobe.

[0008] This method may provide a novel approach to environmental monitoring and object detection. By utilizing one or more side lobes of directional beams emitted by devices, the invention enables real-time detection and analysis of objects in the surrounding environment, including, for example, living beings such as humans or non-living entities such as robots. The use of side lobes for detection advantageously reduces the need for additional sensors or hardware, thereby lowering costs and simplifying the technological ecosystem within factories. This further has the advantage that the method according to the invention improves safety and efficiency, for example, in industries such as manufacturing and logistics. Moreover, it allows for the real-time detection of and response to human presence, which significantly reduces the risk of accidents.Since it is designed to integrate with existing beam shaping infrastructure, the invention minimizes disruption during implementation and facilitates a simple upgrade path from current systems.

[0009] It is also possible that the procedure includes the following additional step: - Identifying the at least one object using object discrimination based on the respective electromagnetic properties of the at least one object, as recorded by the detection.

[0010] This feature enables sophisticated algorithms to analyze the electromagnetic properties captured by the side lobes, thereby allowing differentiation between various types of objects, such as humans and robots. This object-type differentiation allows the system to adapt its responses based on specific situations, thus increasing operational flexibility and intelligence. Furthermore, the enhanced detection capabilities based on the side lobes, facilitated by the evaluation of distinct electromagnetic properties, also enable the system to differentiate between various types of objects, such as distinguishing between human beings and non-living entities.This identification is crucial for dynamically adapting operating protocols based on the type of obstacle detected, thereby improving both safety and efficiency.

[0011] It is also possible that the identification process includes the following additional step: - Assigning an object type to the at least one (detected and) identified object based on the object distinction used to differentiate between different object types.

[0012] This advanced object discrimination enables the system to accurately detect and identify a wide variety of objects within its range, allowing for proactive security measures and efficient operational control.

[0013] It is possible for the object type to be assigned as a living being or a non-living entity, the procedure, in the case that the object type has been assigned as a living being, shall include at least one of the following further steps: - Initiating an emergency stop for the target upon identifying the living being in the path of the directional beam, - Initiating an emergency stop if a living being is identified near the target, especially machinery in an industrial environment, - Initiating a beam adjustment of the directional beam upon identifying the organism in the path of the directional beam.

[0014] This has the advantage that these features increase safety by providing real-time detection of and response to human presence near a target, such as machinery. The method according to the invention can initiate an emergency stop if a living being is identified near the target, ensuring that proactive safety measures are taken to prevent accidents or injuries. This feature integrates well with the object discrimination capabilities of the overall system, allowing for more accurate assessments of the surrounding environment. Furthermore, it enables continuous environmental monitoring, for example, detecting any disruptions, such as human interference in the beam path.

[0015] It is also possible that the procedure includes at least one of the following further steps: - Initiating a specific activity for the at least one object that is detected, - Initiating communication towards the goal in parallel with the initiated data collection, - Initiating communication towards the goal, in the event that the specific activity has been initiated.

[0016] This allows for real-time responses to at least one detected object, potentially triggering an emergency stop or modification of the beamforming pattern to avoid potential hazards. Furthermore, initiating communication with the target via the main lobe of the directional beam advantageously implements a secondary use of side lobes, enabling simultaneous communication and detection, thus optimizing the use of electromagnetic waves.

[0017] It is possible that the procedure includes at least one of the following further steps: - Processing data regarding object detection, beam shaping adjustments, and emergency protocols on a device and / or entity to ensure effective operation, - Monitoring the performance and effectiveness of the beam shaping and detection functionalities with regard to one or more devices.

[0018] This allows for rapid decision-making, advantageously at the local and / or central level, and enables the maintenance of robust communication with minimal downtime. Furthermore, this feature offers the advantage of efficient data processing with regard to object detection, beam shaping adjustments, and emergency protocols. It also provides the benefit of effective system operation, ensuring timely responses to environmental changes and potential hazards. Additionally, monitoring the performance and effectiveness of beam shaping and detection functionalities for one or more devices can facilitate continuous improvement and optimization of the system's capabilities. Moreover, continuous monitoring of the performance and effectiveness of the beam shaping and detection functionalities is advantageously enabled.Updates and adjustments are advantageously implemented to optimize both security and communication efficiency.

[0019] It is further possible that one or more devices are also capable of performing bistatic and / or multistatic acquisition and / or are part of a distributed integrated acquisition and communication system; and wherein the method comprises the following further steps: - Receiving one or more results of the bistatic and / or multistatic acquisition from the one or more devices for further information processing, each device utilizing the at least one side lobe extending from the emitted directional beam.

[0020] It is possible that the method of capturing an environment using a side lobe of a directional beam enables real-time detection and monitoring of objects within its range. This allows for sophisticated object discrimination, which utilizes advanced algorithms to analyze electromagnetic properties picked up by the side lobes, thereby enabling differentiation between different types of objects, such as living beings like humans or animals, or non-living entities like robots or other objects.

[0021] In another aspect of the invention, a system for sensing an environment using a side lobe of a directional beam can be provided, in particular a distributed integrated sensing and communication system (ISAC system), comprising an entity for coordinating one or more devices for sensing an environment, and one or more devices capable of emitting the directional beam at a target located in the environment, wherein the system is configured to perform the method according to the invention. Thus, the system according to the invention can have the same advantages that have been described in detail with reference to a method according to the invention.

[0022] In another aspect of the invention, a computer program, in particular a computer program product, may be provided, comprising instructions which, when the computer program is executed by a computer, cause the computer to execute the method according to the invention. Thus, the computer program according to the invention may have the same advantages that have been described in detail with reference to a method according to the invention.

[0023] In a further aspect of the invention, a data processing device may be provided that is designed to carry out the method according to the invention. This device may, for example, be a computer that executes the computer program according to the invention. The computer may include at least one processor that can be used to execute the computer program. A non-volatile data storage device may also be provided in which the computer program can be stored and from which the computer program can be read by the processor for execution.

[0024] According to another aspect of the invention, a computer-readable storage medium can be provided, comprising the computer program according to the invention and / or instructions which, when executed by a computer, cause the computer to perform the steps of the method according to the invention. The storage medium can be a data storage device, such as a hard drive, and / or non-volatile memory, and / or a memory card, and / or a solid-state drive. The storage medium can, for example, be integrated into the computer.

[0025] Furthermore, the method according to the invention can be implemented as a computer-implemented method. Alternatively or additionally, at least one of the disclosed method steps can be computer-implemented and / or automated.

[0026] Further advantages, features, and details of the invention will become apparent from the following description, in which exemplary embodiments of the invention are described in detail with reference to the drawings. In this context, the features mentioned in the claims and in the description can be essential to the invention, either individually or in any combination. The drawings show: Fig. 1: A method, computer program, storage medium and device according to embodiments of the invention, Fig. 2: A schematic diagram of a system according to embodiments of the invention.

[0027] In the following figures, the same reference numerals are used for the same technical features, even in different embodiments.

[0028] The core of the invention lies in its transformative approach to integrating advanced sensing capabilities into conventional beamforming techniques used in industrial communication. By innovatively utilizing the side lobes of beamformed signals, this system not only maintains high-quality communication between base stations and user devices, but also significantly enhances environmental sensing within the operating area.

[0029] Fig. Figure 1 shows a method 100, a computer program 50, a computer-readable storage medium 15 and a data processing device 10 according to embodiments of the invention.

[0030] Fig. Figure 1 shows in particular an embodiment of a method 100 for detecting an environment 1 using a side lobe of a directional beam, comprising the following steps. In a first step 101, one or more devices 21, 22, 23 are provided which are capable of emitting the directional beam at a target 30 located in the environment 1. In a next step 102, detection of the environment 1 with respect to the target 30 is initiated using at least one side lobe extending from the directional beam emitted by the one or more devices 21, 22, 23. Step 102 can be initiated by an entity 10. In step 103, at least one object 41, 42 is detected based on the detection acquired by the at least one side lobe.Object detection in step 103 can also be performed by entity 10 based on the detection of one or more devices 21, 22, 23. Unlike prior art systems that attempt to minimize or ignore the use of side lobes, the system in [reference] utilizes [reference]. Fig. Figure 1 illustrates an embodiment of the invention in which one or more side lobes serve as a critical sensor tool. This secondary use of one or more side lobes allows for simultaneous communication and detection, thus optimizing the use of electromagnetic waves.

[0031] Fig. Figure 2 illustrates a schematic diagram of a system according to the invention in embodiments of the invention. In particular, the system in Figure 2 comprises Fig. 2. The illustrated embodiment is a highly developed beam shaping system designed as an example for industrial environments, thus integrating communication and environmental sensing into a single coherent structure.

[0032] Furthermore, it shows Fig. Figure 2 shows an example of an operating sequence of the method according to the invention in accordance with embodiments of the invention and also schematically shows the functional components of the system according to the invention. Fig. Figure 2 shows, as an example, a system 60 comprising an entity 10 for controlling a device 21, 22, 23 and three devices 21, 22, 23, such as base stations (BS), located in an environmental setting 1, such as a factory as an example of an industrial environment. The entity 10 is a central function for initiating, for example, an activity by one or more devices 21, 22, 23, such as initiating a detection procedure by one or more devices 21, 22, 23 for the factory environment 1. Each of the three base stations 21, 22, 23 is capable of emitting and / or receiving signals and has a beamforming capability. As shown in Fig.As shown in Figure 2, each of the three base stations 21, 22, 23 emits a directional beam 4, 5, 6 to a target object 30 or a user device 30 (UE). In this embodiment, the target object 30 comprises machinery 30 and / or a mobile robot 30 within the factory 1. Each directional beam 4, 5, 6 is formed to maximize communication efficiency and coverage.

[0033] Entity 10 initiates a scan of the factory environment 1 with respect to machinery 30 as target 30 using at least one side lobe 91a, 91b, 91c, 91d, 92a, 92b, 92c, 93a, 93b extending from the respective main beam 4, 5, 6 emitted by one or more base stations 21, 22, 23. The side lobes 91a, 91b, 91c, 91d, 92a, 92b, 92c, 93a, 93b extend from the respective main lobe 91, 92, 93 of the respective main beam 4, 5, 6 emitted by the base stations 21, 22, 23. While the main lobes 91, 92, 93 perform their primary communication function, the side lobes 91a, 91b, 91c, 91d, 92a, 92b, 92c, 93a, 93b are actively scanned and analyzed by the system 60, in particular with detection algorithms used by the system 60, to detect at least one object 41, 42 in the factory environment 1 203.The system 60 is furthermore capable of monitoring the detected object 41, 42 or the detected objects 41, 42 to initiate certain activities in relation to the machinery 30 and the detected object 41, 42, if necessary.

[0034] Base stations 21, 22, 23 are distributed throughout the factory environment 1 to enable them to cover or detect the factory environment 1 as a single operating area. This means that base stations 21, 22, 23 can detect one or more objects 41, 42 between their location in the factory and the machinery 30. System 60 can use the electromagnetic properties of the one or more detected objects 41, 42, as recorded by side lobes 91a, 91b, 91c, 91d, 92a, 92b, 92c, 93a, 93b, to identify objects within its range. The entity 10 of the system 60 can distinguish between object types or types of objects of the one or the multiple detected objects 41, 42 205, with the support of sophisticated algorithms used by the entity 10.This object discrimination can lead to a distinction 206 between an object type, such as a living being, for example a human being, and a non-living entity, such as a robot or a machine. The distinction 206 can be based on their unique electromagnetic properties or unique electromagnetic signatures.

[0035] Entity 10, comprising a (centralized) control function, and base stations 21, 22, 23 are interconnected. Upon detecting 203 a living being 41, 42, such as a human being, in the path of any high-energy beam 4, 5, 6, entity 10 instantly triggers an emergency stop for the involved machinery 30 or initiates 207 such a stop as a proactive safety response. This activity or action is initiated by a fast communication link from base station 21, 22, 23 to machinery 30 or user device 30 208.

[0036] This can also apply in the case where the human being 41, 42 approaches the immediate vicinity of the machinery 30 and potential human entry points.

[0037] Entity 10, which encompasses its centralized control function, and each local processing unit of base stations 21, 22, and 23 can process data related to object detection, beamforming adjustments, and emergency protocols at both the local and central levels 209 to ensure rapid and accurate responses. This dual-layer processing facilitates fast decision-making and the maintenance of robust communication with minimal downtime.

[0038] Entity 10, which further includes a monitoring function, can continuously monitor the system's performance and the effectiveness of the beam shaping and detection functionalities. Updates and adjustments can be made as needed to optimize both safety and communication efficiency.

[0039] In another embodiment, the presented system is included in a distributed ISAC system (DISAC system), wherein individual base stations capable of acquisition are coordinated to perform multistatic acquisition, but also to send the results of the acquisition to a central entity that fuses the information, thereby providing redundancy for the security system on the one hand, and, on the other hand, an extension of the field of view due to the spatial distribution of the base stations.

[0040] The above explanation of the embodiments describes the present invention in the context of examples. Of course, individual features of the embodiments can be freely combined with one another, provided that this is technically reasonable and does not depart from the scope of protection of the present invention.

Claims

[1] Method (100) for detecting an ambient environment (1) using a side lobe (91a, 91b, 91c, 91d, 92a, 92b, 92c, 93a, 93b) of a directional beam (4, 5, 6) comprising the following steps: - Providing (101) one or more devices (21, 22, 23) capable of emitting the directional beam (4, 5, 6) at a target (30) located in the surrounding environment (1), - Initiating (102) a detection of the surrounding environment (1) with regard to the target (30) using at least one side lobe (91a, 91b, 91c, 91d, 92a, 92b, 92c, 93a, 93b) extending from the directional beam (4, 5, 6) emitted by the one or more devices (21, 22, 23), - Detecting (103) at least one object (41, 42) based on the detection taken by the at least one side lobe (91a, 91b, 91c, 91d, 92a, 92b, 92c, 93a, 93b). [2] Method (100) according to claim 1, characterized by, that the procedure (100) includes the further following step: - Identifying the at least one object (41, 42) using object discrimination based on the respective electromagnetic properties of the at least one object (41, 42) captured by the detection. [3] Method (100) according to claim 2, characterized by , that the procedure (100) during identification includes the following further step: - Assigning an object type to the at least one identified object (41, 42) based on the object distinction used to differentiate between different object types. [4] Method (100) according to claim 3, characterized by , that the object type is assigned as a living being or a non-living entity, wherein the procedure (100), in the case that the object type has been assigned as the living being, comprises at least one of the following further steps: - Initiating an emergency stop for the target (30) upon identifying the living being in the path of the directional beam (4, 5, 6), - Initiating an emergency stop if a living being is identified near the target (30), in particular machinery in an industrial environment, - Initiating a beam adjustment of the directional beam (4, 5, 6) upon identification of the organism in the path of the directional beam (4, 5, 6). [5] Method (100) according to any one of the preceding claims, characterized by , that the procedure (100) includes at least one of the following further steps: - Initiating a specific activity for the at least one object (41, 42) that is detected (103), - Initiating communication towards the goal (30) in parallel with the initiated (102) collection, - Initiating communication to the target (30), if the specific activity has been initiated. [6] Method (100) according to any one of the preceding claims, characterized by , that the procedure (100) includes at least one of the following further steps: - Processing data with regard to object detection, beam shaping adjustments and emergency protocols on a device (21, 22, 23) and / or entity to ensure effective operation, - Monitoring the performance and effectiveness of the beam shaping and detection functionalities with regard to the one or more devices (21, 22, 23). [7] Method (100) according to any one of the preceding claims, characterized by , that the one or more devices (21, 22, 23) are further capable of performing bistastatic and / or multistatic acquisition and / or are part of a distributed integrated acquisition and communication system; and wherein the method (100) further comprises the following step: - Receiving one or more results of the bistatic and / or multistatic acquisition from the one or more devices (21, 22, 23) for further information processing, wherein each device (21, 22, 23) uses the at least one side lobe (91a, 91d, 92a, 92c, 93a, 93b) extending from the emitted directional beam (4, 5, 6). [8] Computer program (50) comprising instructions which, when the computer program (50) is executed by a computer (10), cause the computer (10) to execute the method (100) according to any of the preceding claims. [9] System (60) for detecting an ambient environment (1) using a side lobe (91a, 91b, 91c, 91d, 92a, 92b, 92c, 93a, 93b) of a directional beam (4, 5, 6), wherein the system (60) comprises: - an entity (10) for coordinating one or more devices (21, 22, 23) for sensing an environmental environment (1), and - one or more devices (21, 22, 23) capable of emitting the directional beam (4, 5, 6) at a target (30) located in the surrounding environment (1), wherein the system (60) is configured to perform the steps of the method (100) according to any one of claims 1 to 7. [10] Data processing device (10) comprising means for carrying out the method (100) according to any one of claims 1 to 7. [11] Computer-readable storage medium (15) comprising instructions which, when executed by a computer (10), cause the computer (10) to perform the steps of the method (100) according to any one of claims 1 to 7.

Images