Electronic apparatus, control method for electronic apparatus, and program

The electronic device enhances millimeter wave radar systems by using multiple antennas and advanced signal processing to accurately estimate object direction and distance, addressing multipath interference and improving detection precision.

JP2024159296APending Publication Date: 2024-11-08KYOCERA CORP
View PDF 15 Cites 0 Cited by

Patent Information

Application Number
JP2023075189
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-04-28
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

Existing millimeter wave radar systems face challenges in accurately estimating the direction of objects due to insufficient signal quality and estimation errors from multipath interference, particularly when using two to four receiving antennas.

Method used

An electronic device equipped with multiple transmitting and receiving antennas, utilizing frequency modulated continuous wave radar (FMCW) and advanced signal processing techniques like OS-CFAR and beamforming, generates environmental information associating object distance and direction, enhancing accuracy through averaging and updating of detected data.

Benefits of technology

The system improves object detection accuracy by estimating the direction of objects with high precision, even in complex environments, and provides automatic calibration and malfunction notification.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024159296000001_ABST
    Figure 2024159296000001_ABST
Patent Text Reader

Abstract

To provide an electronic apparatus, a control method for the electronic apparatus, and a program that can improve the accuracy of detecting an object.SOLUTION: An electronic apparatus detects an object based on a transmission signal transmitted as a transmission wave and a reception signal received as a reflected wave of the transmission wave reflected by the object. The electronic apparatus includes a control unit that generates environmental information that associates a distance from the electronic apparatus to an object determined to be moving at a predetermined speed or faster with a direction of the object relative to the electronic apparatus.SELECTED DRAWING: Figure 6
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an electronic device, a control method for an electronic device, and a program. [Background technology]

[0002] For example, in the field of the automobile industry, a technology for measuring the distance between a vehicle and a specified object is considered important. In particular, in recent years, various RADAR (Radio Detecting and Ranging) technologies have been researched, which measure the distance between an object and the vehicle by transmitting radio waves such as millimeter waves and receiving the waves reflected by the object such as an obstacle (millimeter wave radar). The importance of such technology for measuring distance is expected to increase in the future with the development of technologies for assisting the driver in driving and technologies related to autonomous driving that automates part or all of driving.

[0003] In addition, various proposals have been made regarding technologies for detecting the presence of a specific object by receiving a reflected wave of a transmitted radio wave reflected by the object. For example, Patent Document 1 proposes an estimation device that estimates the direction of a moving object such as a person by using radio signals received by multiple receiving antennas. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2019-132850 A Summary of the Invention [Problem to be solved by the invention]

[0005] In various applications in which technology such as the above-mentioned millimeter wave radar is used, there is a demand for improved accuracy in detecting objects.

[0006] An object of the present disclosure is to provide an electronic device, a control method for an electronic device, and a program that can improve the accuracy of object detection. [Means for solving the problem]

[0007] The electronic device according to an embodiment includes: The object is detected based on a transmission signal that is transmitted as a transmission wave and a reception signal that is received as a reflected wave of the transmission wave reflected by the object. The electronic device includes a control unit that generates environmental information that associates a distance from the electronic device to an object determined to be moving at or above a predetermined speed with a direction of the object relative to the electronic device.

[0008] A method for controlling an electronic device according to an embodiment includes: detecting the object based on a transmission signal transmitted as a transmission wave and a reception signal received as a reflected wave of the transmission wave reflected by the object; generating environmental information in which a distance from the electronic device to an object determined to be moving at a speed equal to or greater than a predetermined speed is associated with a direction of the object relative to the electronic device; Includes.

[0009] A program according to an embodiment includes: For electronic devices, detecting the object based on a transmission signal transmitted as a transmission wave and a reception signal received as a reflected wave of the transmission wave reflected by the object; generating environmental information in which a distance from the electronic device to an object determined to be moving at a speed equal to or greater than a predetermined speed is associated with a direction of the object relative to the electronic device; Execute the command. Effect of the Invention

[0010] According to one embodiment, it is possible to provide an electronic device, a control method for an electronic device, and a program that can improve the accuracy of detecting an object. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram illustrating a usage mode of an electronic device according to an embodiment. [Diagram 2] 1 is a functional block diagram illustrating a schematic configuration of an electronic device according to an embodiment. [Diagram 3] FIG. 2 is a functional block diagram showing a part of the configuration of an electronic device according to an embodiment. [Figure 4] FIG. 2 is a diagram illustrating a configuration of a transmission signal according to an embodiment. [Diagram 5] 10 is a flowchart illustrating an operation of an electronic device according to an embodiment. [Figure 6] 10 is a flowchart illustrating an operation of an electronic device according to an embodiment. [Figure 7] 10 is a flowchart illustrating an operation of an electronic device according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, one embodiment will be described in detail with reference to the drawings.

[0013] In the present disclosure, an "electronic device" may be an electric device that is driven by electricity. Furthermore, a "user" may be a person (typically a human) who uses an electronic device according to an embodiment. By using an electronic device according to an embodiment, a user can detect an object present around the electronic device. Furthermore, by using an electronic device according to an embodiment, a user can detect the direction of an object present around the electronic device relative to the electronic device. Here, the object detected by the electronic device may include the user.

[0014] The electronic device according to an embodiment is attached to, for example, a stationary structure (stationary object) and can detect a predetermined object present around the stationary object. Here, the stationary object may be, for example, any device such as a traffic light or roadside device installed at an intersection, or any location such as an indoor floor, wall, or ceiling. For this purpose, the electronic device according to an embodiment can transmit a transmission wave to the surroundings of the stationary object from a plurality of transmission antennas installed on the stationary object. In addition, the electronic device according to an embodiment can receive a reflected wave of the transmission wave from a plurality of receiving antennas installed on the stationary object. At least one of the transmission antenna and the receiving antenna may be provided in, for example, a radar sensor installed on the stationary object.

[0015] Hereinafter, as a typical example, a configuration in which an electronic device according to an embodiment is attached to a stationary structure will be described. Here, the electronic device according to an embodiment may detect, for example, an automobile or the like present around the electronic device attached to the stationary object. The electronic device according to an embodiment may detect various objects such as an automatically driven automobile, a bus, a truck, a motorcycle, a bicycle, a ship, an aircraft, an agricultural machine such as a tractor, a snowplow, a cleaning vehicle, a police car, an ambulance, a fire engine, a helicopter, and a drone. The electronic device according to an embodiment can measure the distance between the electronic device and an object in a situation in which the object around the electronic device attached to the stationary object may move. In addition, the electronic device according to an embodiment can measure the distance between the electronic device and an object even if both the electronic device and the object are stationary.

[0016] In an electronic device such as the above-mentioned millimeter wave radar, a transmission wave is transmitted from a plurality of transmission antennas, and a reflected wave reflected by the object is received from a plurality of reception antennas, thereby making it possible to detect the object. According to such a technique, it is possible to detect the distance to the object detected by the electronic device, the relative speed of the object with respect to the electronic device, and the direction (angle) of the object with respect to the electronic device. However, when the reflected wave is received by about two to four reception antennas, it may not be possible to estimate the direction (angle) of the object with respect to the electronic device well. According to an electronic device according to an embodiment, even when the reflected wave is received by about two to four reception antennas, it is possible to estimate the direction (angle) of the object with respect to the electronic device well. Hereinafter, such an electronic device will be described.

[0017] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An electronic device according to an embodiment will be described in detail below with reference to the drawings. First, an example of object detection by the electronic device according to an embodiment will be described.

[0018] Fig. 1 is a diagram for explaining an example of a usage mode of an electronic device according to an embodiment. Fig. 1 shows an example of an electronic device having a function of a sensor and including a transmitting antenna and a receiving antenna according to an embodiment.

[0019] As shown in FIG. 1, the electronic device 1 according to an embodiment may include a transmitting unit 20 and a receiving unit 30, which will be described later. As described later, the transmitting unit 20 may include a transmitting antenna. Furthermore, the receiving unit 30 may include a receiving antenna. Specific configurations of the electronic device 1, the transmitting unit 20, and the receiving unit 30 will be described later. Furthermore, the electronic device 1 may include at least one of the other functional units, such as at least a part of the control unit 10 (FIG. 2) included in the electronic device 1, as appropriate. Furthermore, the electronic device 1 may include at least one of the other functional units, such as at least a part of the control unit 10 (FIG. 2) included in the electronic device 1, outside the electronic device 1. In FIG. 1, the electronic device 1 may be stationary and not moving.

[0020] In the example shown in FIG. 1, the electronic device 1 is shown to include one transmitting unit 20 having a transmitting antenna and one receiving unit 30 having a receiving antenna. However, the electronic device 1 may include, for example, a plurality of transmitting units 20 and / or a plurality of receiving units 30. Furthermore, as described later, the transmitting unit 20 may include a plurality of transmitting antennas. Furthermore, the receiving unit 30 may include a plurality of receiving antennas. Here, the position where the transmitting unit 20 and / or the receiving unit 30 are installed in the electronic device 1 is not limited to the position shown in FIG. 1, and may be other positions as appropriate. Furthermore, the number of transmitting units 20 and / or receiving units 30 may be any number of one or more depending on various conditions (or requirements) such as the detection range and / or detection accuracy of an object by the electronic device 1.

[0021] As described below, the electronic device 1 transmits electromagnetic waves as transmission waves from a transmission antenna. For example, if a specific object (e.g., object 200 shown in FIG. 1) is present around the electronic device 1, at least a part of the transmission wave transmitted from the electronic device 1 is reflected by the object and becomes a reflected wave. Then, by receiving such a reflected wave, for example, with a receiving antenna of the electronic device 1, the electronic device 1 can detect the object as a target.

[0022] The electronic device 1 equipped with a transmitting antenna may typically be a radar (Radio Detecting and Ranging (RADAR)) sensor that transmits and receives radio waves. However, the electronic device 1 is not limited to a radar sensor. The electronic device 1 according to an embodiment may be a sensor based on, for example, a light wave LIDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging) technology. Such sensors may include, for example, a patch antenna. Technologies such as RADAR and LIDAR are already known, so detailed descriptions may be appropriately simplified or omitted.

[0023] The electronic device 1 shown in FIG. 1 receives, from a receiving antenna, a reflected wave of a transmission wave transmitted from a transmitting antenna. In this way, the electronic device 1 can detect a predetermined object 200 existing within a predetermined distance from the electronic device 1 as a target. For example, as shown in FIG. 1, the electronic device 1 can measure a distance L between the electronic device 1 and the predetermined object 200. The electronic device 1 can also measure the relative speed between the electronic device 1 and the predetermined object 200. Furthermore, the electronic device 1 can also measure the direction (arrival angle θ) in which the reflected wave from the predetermined object 200 arrives at the electronic device 1.

[0024] In Fig. 1, the XY plane may be, for example, a plane that is approximately parallel to the ground surface. In this case, the positive direction of the Z axis shown in Fig. 1 indicates a vertically upward direction. In Fig. 1, the electronic device 1 may be disposed on a plane that is parallel to the XY plane. Also, in Fig. 1, the object 200 may be, for example, present on the ground surface that is approximately parallel to the XY plane.

[0025] Here, the object 200 may be, for example, a car, a motorcycle, a bicycle, a pedestrian, etc. present around the electronic device 1. The object 200 may also be, for example, a living thing other than a human being, such as an animal present around the electronic device 1. As described above, the object 200 may be moving, stopped, or stationary. In the present disclosure, the object detected by the electronic device 1 includes inanimate objects such as any object, as well as living things such as people, dogs, cats, horses, and other animals. The object detected by the electronic device 1 of the present disclosure includes targets including people, objects, and animals detected by radar technology.

[0026] 1, the ratio between the size of the electronic device 1 and the size of the object 200 does not necessarily indicate the actual ratio. Also, in FIG. 1, the transmitting unit 20 and the receiving unit 30 are shown installed outside the electronic device 1. However, in one embodiment, the transmitting unit 20 and / or the receiving unit 30 may be installed at various positions on the electronic device 1. For example, in one embodiment, the transmitting unit 20 and / or the receiving unit 30 may be installed inside the electronic device 1 so as not to be visible on the outside of the electronic device 1.

[0027] In the following, as a typical example, the transmitting antenna of the electronic device 1 will be described as transmitting radio waves in a frequency band such as millimeter waves (30 GHz or higher) or quasi-millimeter waves (for example, around 20 GHz to 30 GHz). For example, the transmitting antenna of the electronic device 1 may transmit radio waves having a frequency bandwidth of 4 GHz, such as 77 GHz to 81 GHz.

[0028] In this way, the electronic device 1 according to an embodiment can transmit a transmission wave to the surroundings of the electronic device 1 from a plurality of transmission antennas. Also, the electronic device 1 according to an embodiment can receive a reflected wave of the transmission wave from a plurality of reception antennas. At least one of the transmission antenna and the reception antenna may be provided in the electronic device 1, or may be provided in, for example, a radar sensor. The electronic device 1 according to an embodiment can measure the distance between the electronic device 1 and an object in a situation where the object may move around the electronic device 1, similar to a normal radar sensor. Also, the electronic device 1 according to an embodiment can measure the distance between the electronic device and an object even if both the electronic device and the object are stationary.

[0029] Fig. 2 is a functional block diagram illustrating an example of the configuration of the electronic device 1 according to an embodiment. Fig. 3 is a functional block diagram illustrating in more detail the control unit 10 of the electronic device 1 illustrated in Fig. 2. An example of the configuration of the electronic device 1 according to an embodiment will be described below.

[0030] When measuring distances and the like using a millimeter-wave radar, a frequency modulated continuous wave radar (referred to as FMCW radar in this disclosure) is often used. In the FMCW radar, a transmission signal is generated by sweeping the frequency of radio waves to be transmitted. Therefore, in a millimeter-wave FMCW radar using radio waves in a frequency band of 79 GHz, for example, the frequency of the radio waves used has a frequency bandwidth of 4 GHz, such as 77 GHz to 81 GHz. A radar in the 79 GHz frequency band has a feature that the available frequency bandwidth is wider than other millimeter-wave / quasi-millimeter-wave radars in frequency bands of, for example, 24 GHz, 60 GHz, and 76 GHz. Hereinafter, such an embodiment will be described as an example. The FMCW radar system used in this disclosure may include a FCM (Fast-Chirp Modulation) system that transmits a chirp signal at a shorter period than normal. The signal generated by the signal generating unit 21 is not limited to a signal in the FMCW system. The signal generated by the signal generating unit 21 may be a signal of various types other than the FMCW type. The transmission signal sequence stored in any storage unit may differ depending on these various types. For example, in the case of a radar signal of the above-mentioned FMCW type, a signal whose frequency increases and decreases for each time sample may be used. Since the above-mentioned various types of types can be appropriately applied using known techniques, a detailed description will be omitted.

[0031] As shown in FIG. 2, the electronic device 1 according to an embodiment includes a control unit 10. The electronic device 1 according to an embodiment may also include other functional units, such as a transmission unit 20 and / or reception units 30A-30D, as appropriate. As shown in FIG. 2, the electronic device 1 may include a plurality of reception units, such as reception units 30A-30D. In the present disclosure, when there is no need to distinguish between reception units 30A, 30B, 30C, and 30D, they will simply be referred to as "reception unit 30."

[0032] 3, the control unit 10 may include a distance FFT processing unit 11, a speed FFT processing unit 12, a determination unit 13, an arrival angle estimation unit 14, an object detection unit 15, an object tracking unit 16, and a memory 17. These functional units included in the control unit 10 will be described in further detail below.

[0033] As shown in FIG. 2, the transmitting unit 20 may include a signal generating unit 21, a synthesizer 22, phase control units 23A and 23B, amplifiers 24A and 24B, and transmitting antennas 25A and 25B. In this disclosure, when there is no distinction between the phase control unit 23A and the phase control unit 23B, they will be simply referred to as "phase control unit 23." In addition, in this disclosure, when there is no distinction between the amplifier 24A and the amplifier 24B, they will be simply referred to as "amplifier 24." In addition, in this disclosure, when there is no distinction between the transmitting antenna 25A and the transmitting antenna 25B, they will be simply referred to as "transmitting antenna 25."

[0034] The receiving unit 30 may include corresponding receiving antennas 31A to 31D, as shown in Fig. 2. In the present disclosure, when there is no need to distinguish between the receiving antenna 31A, the receiving antenna 31B, the receiving antenna 31C, and the receiving antenna 31D, they will be simply referred to as "receiving antenna 31". Also, as shown in Fig. 2, each of the multiple receiving units 30 may include an LNA 32, a mixer 33, an IF unit 34, and an AD conversion unit 35. The receiving units 30A to 30D may each have the same configuration. In Fig. 2, as a representative example, the configuration of only the receiving unit 30A is shown in outline.

[0035] The electronic device 1 described above may include, for example, a transmitting antenna 25 and a receiving antenna 31. Furthermore, the electronic device 1 may also include at least one of other functional units such as a control unit 10 as appropriate.

[0036] The control unit 10 included in the electronic device 1 according to an embodiment can control the operation of the entire electronic device 1, including the control of each functional unit constituting the electronic device 1. In an embodiment, the control unit 10 may have a function of performing various signal processing on the reception signal received by the reception unit 30 as a reflected wave. The control unit 10 may include at least one processor, such as a CPU (Central Processing Unit) or a DSP (Digital Signal Processor), to provide control and processing capabilities for performing various functions. The control unit 10 may be realized as one processor collectively, may be realized as several processors, or may be realized as individual processors. The processor may be realized as a single integrated circuit. The integrated circuit is also called an IC (Integrated Circuit). The processor may be realized as a plurality of integrated circuits and discrete circuits connected to each other so as to be able to communicate with each other. The processor may be realized based on various other known technologies. In an embodiment, the control unit 10 may be configured as, for example, a CPU or a DSP and a program executed by the CPU or DSP. The control unit 10 may include a memory (any storage unit) necessary for the operation of the control unit 10 as appropriate.

[0037] Here, the optional storage unit (memory necessary for the operation of the control unit 10) may store the programs executed in the control unit 10 and the results of the processing executed in the control unit 10. The optional storage unit may also function as a work memory for the control unit 10. The optional storage unit may be configured, for example, by a semiconductor memory or a magnetic disk, but is not limited to these and may be any storage device. For example, the optional storage unit may be a storage medium such as a memory card inserted into the electronic device 1 according to this embodiment. The optional storage unit may also be an internal memory of the CPU or DSP used as the control unit 10, as described above.

[0038] In one embodiment, the optional storage unit may store various parameters for setting a range in which an object can be detected by the transmission wave T transmitted from the transmission antenna 25 and the reflected wave R received from the reception antenna 31.

[0039] In the electronic device 1 according to an embodiment, the control unit 10 can control at least one of the transmitting unit 20 and the receiving unit 30. In this case, the control unit 10 may control at least one of the transmitting unit 20 and the receiving unit 30 based on various information stored in an arbitrary storage unit. In addition, in the electronic device 1 according to an embodiment, the control unit 10 may instruct the signal generating unit 21 to generate a signal, or control the signal generating unit 21 to generate a signal. In addition, in an embodiment, the control unit 10 may have a function of controlling the phase of the transmission wave transmitted from the transmitting antenna 25 by controlling the phase control unit 23.

[0040] In one embodiment, the control unit 10 may perform various signal processing on the reflected wave R received from the receiving antenna 31. In one embodiment, the control unit 10 may perform various signal processing on the transmission wave T transmitted from the transmitting antenna 25 and / or the reflected wave R received from the receiving antenna 31. In one embodiment, the control unit 10 may implement at least a part of the functions of at least one of the transmitting unit 20 and the receiving unit 30.

[0041] The signal generating unit 21 generates a signal (transmission signal) to be transmitted as a transmission wave T from the transmission antenna 25 under the control of the control unit 10. When generating the transmission signal, the signal generating unit 21 may allocate a frequency of the transmission signal based on the control of the control unit 10, for example. Specifically, the signal generating unit 21 may allocate a frequency of the transmission signal according to a parameter set by the control unit 10, for example. For example, the signal generating unit 21 receives frequency information from the control unit 10 or an arbitrary storage unit, and generates a signal of a predetermined frequency in a frequency band such as 77 to 81 GHz. The signal generating unit 21 may be configured to include a functional unit such as a voltage controlled oscillator (VCO).

[0042] The signal generating unit 21 may be configured as hardware having the function, or may be configured as a microcomputer, or may be configured as a processor such as a CPU or DSP and a program executed by the processor, etc. Each functional unit described below may also be configured as hardware having the function, or may be configured as a microcomputer, or may be configured as a processor such as a CPU or DSP and a program executed by the processor, etc., if possible.

[0043] In the electronic device 1 according to an embodiment, the signal generating unit 21 may generate a transmission signal (transmission chirp signal) such as a chirp signal. In particular, the signal generating unit 21 may generate a signal (linear chirp signal) whose frequency changes periodically and linearly. For example, the signal generating unit 21 may generate a chirp signal whose frequency increases periodically and linearly from 77 GHz to 81 GHz over time. Also, for example, the signal generating unit 21 may generate a signal whose frequency periodically repeats a linear increase (up chirp) and decrease (down chirp) from 77 GHz to 81 GHz over time. The signal generated by the signal generating unit 21 may be set in advance in, for example, the control unit 10. Also, the signal generated by the signal generating unit 21 may be stored in advance in, for example, an arbitrary storage unit. Since chirp signals used in technical fields such as radar are known, a more detailed description will be appropriately simplified or omitted. The signal generated by the signal generating unit 21 is supplied to the synthesizer 22.

[0044] FIG. 4 is a diagram illustrating an example of a chirp signal generated by the signal generating unit 21. As shown in FIG.

[0045] In Fig. 4, the horizontal axis represents the elapsed time, and the vertical axis represents the frequency. In the example shown in Fig. 4, the signal generating unit 21 generates a linear chirp signal whose frequency changes periodically and linearly. In Fig. 4, each chirp signal is shown as c1, c2, ..., c8. As shown in Fig. 4, in each chirp signal, the frequency increases linearly with the passage of time.

[0046] In the example shown in FIG. 4, eight chirp signals such as c1, c2, ..., c8 are included in one subframe. That is, subframe 1 and subframe 2 shown in FIG. 4 are each configured to include eight chirp signals such as c1, c2, ..., c8. Also, in the example shown in FIG. 4, 16 subframes such as subframe 1 to subframe 16 are included in one frame. That is, frame 1 and frame 2 shown in FIG. 4 are each configured to include 16 subframes. Also, as shown in FIG. 4, a frame interval of a predetermined length may be included between frames. One frame shown in FIG. 4 may have a length of, for example, about 30 milliseconds to 50 milliseconds.

[0047] In Fig. 4, frames 2 and onward may have the same configuration. Also, in Fig. 4, frames 3 and onward may have the same configuration. In the electronic device 1 according to an embodiment, the signal generating unit 21 may generate a transmission signal as an arbitrary number of frames. Also, in Fig. 4, some chirp signals are omitted. In this manner, the relationship between time and frequency of the transmission signal generated by the signal generating unit 21 may be stored in, for example, an arbitrary storage unit.

[0048] In this way, the electronic device 1 according to an embodiment may transmit a transmission signal composed of subframes including a plurality of chirp signals. Also, the electronic device 1 according to an embodiment may transmit a transmission signal composed of a frame including a predetermined number of subframes.

[0049] Hereinafter, the electronic device 1 will be described as transmitting a transmission signal having a frame structure as shown in FIG. 4. However, the frame structure as shown in FIG. 4 is an example, and the number of chirp signals included in one subframe is not limited to eight. In one embodiment, the signal generating unit 21 may generate a subframe including any number of chirp signals (for example, any multiple). The subframe structure as shown in FIG. 4 is also an example, and the number of subframes included in one frame is not limited to 16. In one embodiment, the signal generating unit 21 may generate a frame including any number of subframes (for example, any multiple). The signal generating unit 21 may generate signals of different frequencies. The signal generating unit 21 may generate a plurality of discrete signals having different bandwidths, each having a frequency f.

[0050] Returning to FIG. 2, the synthesizer 22 increases the frequency of the signal generated by the signal generating unit 21 to a frequency in a predetermined frequency band. The synthesizer 22 may increase the frequency of the signal generated by the signal generating unit 21 to a frequency selected as the frequency of the transmission wave T to be transmitted from the transmitting antenna 25. The frequency selected as the frequency of the transmission wave T to be transmitted from the transmitting antenna 25 may be set by, for example, the control unit 10. Also, the frequency selected as the frequency of the transmission wave T to be transmitted from the transmitting antenna 25 may be stored in, for example, an arbitrary storage unit. The signal whose frequency has been increased by the synthesizer 22 is supplied to the phase control unit 23 and the mixer 33. When there are multiple phase control units 23, the signal whose frequency has been increased by the synthesizer 22 may be supplied to each of the multiple phase control units 23. Also, when there are multiple receiving units 30, the signal whose frequency has been increased by the synthesizer 22 may be supplied to each of the mixers 33 in the multiple receiving units 30.

[0051] The phase control unit 23 controls the phase of the transmission signal supplied from the synthesizer 22. Specifically, the phase control unit 23 may adjust the phase of the transmission signal by appropriately advancing or delaying the phase of the signal supplied from the synthesizer 22 based on the control by the control unit 10, for example. In this case, the phase control unit 23 may adjust the phase of each transmission signal based on the path difference of each transmission wave T transmitted from the multiple transmission antennas 25. By the phase control unit 23 appropriately adjusting the phase of each transmission signal, the transmission waves T transmitted from the multiple transmission antennas 25 reinforce each other in a predetermined direction to form a beam (beamforming). In this case, the correlation between the direction of beamforming and the phase amount to be controlled of the transmission signal transmitted by each of the multiple transmission antennas 25 may be stored in, for example, an arbitrary storage unit. The transmission signal phase-controlled by the phase control unit 23 is supplied to the amplifier 24.

[0052] The amplifier 24 amplifies the power of the transmission signal supplied from the phase control section 23, for example, based on the control by the control section 10. When the electronic device 1 includes a plurality of transmission antennas 25, the plurality of amplifiers 24 may respectively amplify the power of the transmission signal supplied from each of the plurality of phase control sections 23 corresponding thereto, for example, based on the control by the control section 10. The technology itself for amplifying the power of the transmission signal is already known, so a detailed description will be omitted. The amplifier 24 is connected to the transmission antenna 25.

[0053] The transmitting antenna 25 outputs (transmits) the transmission signal amplified by the amplifier 24 as a transmission wave T. When the electronic device 1 includes a plurality of transmitting antennas 25, the plurality of transmitting antennas 25 may output (transmit) the transmission signals amplified by corresponding ones of the plurality of amplifiers 24 as transmission waves T. The transmitting antenna 25 can be configured in the same manner as a transmitting antenna used in known radar technology, and therefore a detailed description thereof will be omitted.

[0054] In this manner, the electronic device 1 according to an embodiment includes the transmitting antenna 25, and can transmit a transmission signal (for example, a transmission chirp signal) as a transmission wave T from the transmitting antenna 25. Here, at least one of the functional units constituting the electronic device 1 may be housed in one housing. In addition, in this case, the one housing may have a structure that cannot be easily opened. For example, the transmitting antenna 25, the receiving antenna 31, and the amplifier 24 may be housed in one housing, and this housing may have a structure that cannot be easily opened. Furthermore, here, when the electronic device 1 is installed on a stationary object, the transmitting antenna 25 may transmit the transmission wave T to the outside of the stationary object through a cover member such as a radar cover. In this case, the radar cover may be made of a material that allows electromagnetic waves to pass through, such as synthetic resin or rubber. This radar cover may be, for example, a housing for the electronic device 1. By covering the transmitting antenna 25 with a member such as a radar cover, the risk of the transmitting antenna 25 being damaged or malfunctioning due to contact with the outside can be reduced. The above-mentioned radar cover and housing may also be called a radome.

[0055] The electronic device 1 shown in FIG. 2 shows an example having two transmitting antennas 25. However, in one embodiment, the electronic device 1 may have any number of transmitting antennas 25. On the other hand, in one embodiment, the electronic device 1 may have multiple transmitting antennas 25 when the transmitting wave T transmitted from the transmitting antenna 25 forms a beam in a predetermined direction. In one embodiment, the electronic device 1 may have any multiple transmitting antennas 25. In this case, the electronic device 1 may also have multiple phase control units 23 and amplifiers 24 corresponding to the multiple transmitting antennas 25. The multiple phase control units 23 may each control the phase of the multiple transmitting waves supplied from the synthesizer 22 and transmitted from the multiple transmitting antennas 25. The multiple amplifiers 24 may each amplify the power of the multiple transmitting signals transmitted from the multiple transmitting antennas 25. In this case, the electronic device 1 may be configured to include multiple transmitting antennas. In this way, when the electronic device 1 shown in FIG. 2 has multiple transmitting antennas 25, it may also be configured to include multiple functional units required to transmit the transmitting wave T from the multiple transmitting antennas 25.

[0056] The receiving antenna 31 receives a reflected wave R. The reflected wave R may be a transmission wave T reflected by a predetermined object 200. The receiving antenna 31 may be configured to include a plurality of antennas, for example, receiving antennas 31A to 31D. The receiving antenna 31 may be configured in the same manner as a receiving antenna used in known radar technology, and therefore a detailed description will be omitted. The receiving antenna 31 is connected to the LNA 32. A reception signal based on the reflected wave R received by the receiving antenna 31 is supplied to the LNA 32.

[0057] The electronic device 1 according to an embodiment can receive a reflected wave R that is a result of a transmission wave T transmitted as a transmission signal (transmission chirp signal) such as a chirp signal from a plurality of receiving antennas 31 and reflected by a predetermined object 200. In this way, when a transmission chirp signal is transmitted as a transmission wave T, a reception signal based on the received reflection wave R is referred to as a reception chirp signal. That is, the electronic device 1 receives a reception signal (e.g., a reception chirp signal) as a reflection wave R from the receiving antenna 31. Here, when the electronic device 1 is installed on a stationary object, the receiving antenna 31 may receive a reflected wave R from the outside of the stationary object through a cover member such as a radar cover. In this case, the radar cover may be made of a material that allows electromagnetic waves to pass through, such as synthetic resin or rubber. This radar cover may be, for example, a housing for the electronic device 1. By covering the receiving antenna 31 with a member such as a radar cover, the risk of the receiving antenna 31 being damaged or defective due to contact with the outside can be reduced. The above-mentioned radar cover and housing may also be called a radome.

[0058] Furthermore, when the receiving antenna 31 is installed near the transmitting antenna 25, these may be configured together as one electronic device 1. That is, one electronic device 1 may include, for example, at least one transmitting antenna 25 and at least one receiving antenna 31. For example, one electronic device 1 may include a plurality of transmitting antennas 25 and a plurality of receiving antennas 31. In such a case, one radar sensor may be covered with a cover member such as, for example, a radar cover.

[0059] The LNA 32 amplifies, with low noise, a reception signal based on the reflected wave R received by the receiving antenna 31. The LNA 32 may be a low noise amplifier, and amplifies, with low noise, the reception signal supplied from the receiving antenna 31. The reception signal amplified by the LNA 32 is supplied to the mixer 33.

[0060] The mixer 33 generates a beat signal by mixing (multiplying) the RF frequency reception signal supplied from the LNA 32 with the transmission signal supplied from the synthesizer 22. The beat signal mixed by the mixer 33 is supplied to the IF unit .

[0061] The IF unit 34 reduces the frequency of the beat signal supplied from the mixer 33 to an intermediate frequency (IF frequency). The beat signal whose frequency has been reduced by the IF unit 34 is supplied to an AD conversion unit 35.

[0062] The AD conversion unit 35 digitizes the analog beat signal supplied from the IF unit 34. The AD conversion unit 35 may be configured with any analog-to-digital conversion circuit (Analog to Digital Converter (ADC)). The beat signal digitized by the AD conversion unit 35 is supplied to the distance FFT processing unit 11 of the control unit 10. When there are multiple receiving units 30, each of the beat signals digitized by the multiple AD conversion units 35 may be supplied to the distance FFT processing unit 11.

[0063] The distance FFT processing unit 11 of the control unit 10 shown in Fig. 3 performs processing for estimating the distance between the electronic device 1 and the object 200 based on the beat signal supplied from the AD conversion unit 35 of the receiving unit 30. The distance FFT processing unit 11 may include, for example, a processing unit that performs a fast Fourier transform. In this case, the distance FFT processing unit 11 may be configured with any circuit or chip that performs a fast Fourier transform (FFT) process. Furthermore, the distance FFT processing unit 11 may perform a Fourier transform other than the fast Fourier transform.

[0064] The distance FFT processing unit 11 performs FFT processing on the beat signal digitized by the AD conversion unit 35 (in this disclosure, this will be referred to as "distance FFT processing" as appropriate). For example, the distance FFT processing unit 11 may perform FFT processing on the complex signal supplied from the AD conversion unit 35. The beat signal digitized by the AD conversion unit 35 can be expressed as a time change in signal strength (power). The distance FFT processing unit 11 performs FFT processing on such a beat signal, thereby enabling it to be expressed as a signal strength (power) corresponding to each frequency. By performing distance FFT processing in the distance FFT processing unit 11, a complex signal corresponding to distance can be obtained based on the beat signal digitized by the AD conversion unit 35.

[0065] When a peak is equal to or greater than a predetermined threshold in the result obtained by the distance FFT processing, the distance FFT processing unit 11 may determine that a predetermined object 200 is present at the distance corresponding to the peak. For example, a method is known in which, when a peak value equal to or greater than a threshold is detected from the average power or amplitude of a disturbance signal, such as detection processing based on a constant false alarm rate (CFAR), an object that reflects a transmission wave (a reflecting object) is present.

[0066] In this way, the electronic device 1 according to one embodiment can detect the object 200 reflecting the transmission wave T as a target based on the transmission signal transmitted as the transmission wave T and the reception signal received as the reflected wave R. In one embodiment, the above-mentioned operation may be performed by, for example, the control unit 10 of the electronic device 1.

[0067] The distance FFT processing unit 11 can estimate the distance to a predetermined object based on one chirp signal (e.g., c1 shown in FIG. 4). That is, the electronic device 1 can measure (estimate) the distance L shown in FIG. 1 by performing distance FFT processing. Since the technology for measuring (estimating) the distance to a predetermined object by performing FFT processing on a beat signal is well known, a more detailed description will be appropriately simplified or omitted. The result of the distance FFT processing performed by the distance FFT processing unit 11 (e.g., distance information) may be supplied to the velocity FFT processing unit 12. In addition, the result of the distance FFT processing performed by the distance FFT processing unit 11 may also be supplied to the downstream determination unit 13, the arrival angle estimation unit 14, and / or the object detection unit 15.

[0068] The velocity FFT processing unit 12 performs processing for estimating the relative velocity between the electronic device 1 and the object 200, based on the beat signal on which the distance FFT processing has been performed by the distance FFT processing unit 11. The velocity FFT processing unit 12 may include, for example, a processing unit that performs a fast Fourier transform. In this case, the velocity FFT processing unit 12 may be configured with any circuit or chip that performs a fast Fourier transform (FFT) processing. The velocity FFT processing unit 12 may perform a Fourier transform other than the fast Fourier transform.

[0069] The velocity FFT processing unit 12 further performs FFT processing on the beat signal that has been subjected to distance FFT processing by the distance FFT processing unit 11 (in this disclosure, this is referred to as "velocity FFT processing" as appropriate). For example, the velocity FFT processing unit 12 may perform FFT processing on the complex signal supplied from the distance FFT processing unit 11. The velocity FFT processing unit 12 can estimate the relative velocity with respect to a predetermined object based on a subframe of the chirp signal (for example, subframe 1 shown in FIG. 3). By performing velocity FFT processing on multiple chirp signals in the velocity FFT processing unit 12, a complex signal corresponding to the relative velocity is obtained based on the complex signal corresponding to the distance obtained by the distance FFT processing unit 11.

[0070] As described above, when the beat signal is subjected to distance FFT processing, a plurality of vectors can be generated. The relative velocity with respect to a predetermined object can be estimated by obtaining the phase of the peak in the result of performing velocity FFT processing on these plurality of vectors. That is, the electronic device 1 can measure (estimate) the relative velocity between the electronic device 1 shown in FIG. 1 and the predetermined object 200 by performing velocity FFT processing. Since the technology itself for measuring (estimating) the relative velocity with respect to a predetermined object by performing velocity FFT processing on the result of distance FFT processing is well known, a more detailed description will be appropriately simplified or omitted. The result of the velocity FFT processing performed by the velocity FFT processing unit 12 (for example, velocity information) may be supplied to the determination unit 13. In addition, the result of the velocity FFT processing performed by the velocity FFT processing unit 12 may also be supplied to the arrival angle estimation unit 14 and / or the object detection unit 15 at the subsequent stage.

[0071] Furthermore, when the velocity FFT processor 12 performs velocity FFT processing, window control may be applied to prevent discontinuities from occurring. In this case, the velocity FFT processor 12 does not need to output the relative velocity adjacent to the relative velocity of a stationary object.

[0072] The determination unit 13 performs a determination process for the distance and / or the relative speed based on the result of the distance FFT processing performed by the distance FFT processing unit 11 and / or the result of the speed FFT processing performed by the speed FFT processing unit 12. The determination unit 13 determines whether or not an object has been detected at a predetermined distance and / or a predetermined relative speed. The determination by the determination unit 13 will be further described below.

[0073] In general FMCW radar technology, it is possible to determine whether or not a target is present based on the results of performing fast Fourier transform processing on beat frequencies extracted from a received signal. Here, the results of performing fast Fourier transform processing on beat frequencies extracted from a received signal also contain noise components due to clutter (unwanted reflected components). Therefore, a process may be performed to remove noise components from the results of processing the received signal and extract only the target signal.

[0074] One method for determining whether a target is present is to set a threshold for the output of the received signal, and assume that a target is present if the strength of the reflected signal exceeds the threshold (threshold detection method). If this method is adopted, even if the signal strength of clutter exceeds the threshold, it will be determined to be a target, resulting in a so-called "false alarm." Whether or not the signal strength of this clutter exceeds the threshold is a matter of probability and statistics. The probability that the signal strength of this clutter exceeds the threshold is called the "false alarm probability." A constant false alarm rate can be used as a method for keeping this false alarm probability constant.

[0075] In this disclosure, the constant false alarm rate is also referred to simply as CFAR. In CFAR, the assumption is made that the signal strength (amplitude) of noise follows a Rayleigh distribution. Based on this assumption, if the weights for calculating the threshold used to determine whether a target is detected are fixed, the error rate of target detection will theoretically be constant regardless of the amplitude of the noise.

[0076] As a CFAR in general radar technology, a method called Cell Averaging CFAR (also referred to as CA-CFAR in this disclosure) is known. In CA-CFAR, the signal strength values ​​(e.g., amplitude values) of a received signal that has been subjected to a predetermined process may be input to a shift register sequentially at a certain sampling period. This shift register has a test cell (cell under test) in the center, and has a plurality of reference cells (reference cells) on both sides of the test cell. Every time a signal strength value is input to the shift register, the previously input signal strength value is moved one by one from one end side (e.g., the left end side) of the shift register to the other end side (e.g., the right end side). In addition, each value of the reference cell is averaged in synchronization with the input timing. The average value thus obtained is multiplied by a specified weight and calculated as a threshold value. If the value of the test cell is greater than the threshold value thus calculated, the value of the test cell is output as it is. On the other hand, if the value of the test cell is not greater than the calculated threshold value, a value of 0 (zero) is output. In this way, in CA-CFAR, a detection result can be obtained by calculating a threshold value from the average value of the reference cells and determining whether or not a target is present.

[0077] In CA-CFAR, for example, when multiple targets exist close to each other, the calculated threshold value is large near the target due to the nature of the algorithm. As a result, some targets may not be detected even if they have sufficient signal strength. Similarly, when there is a clutter step, the calculated threshold value is also large near the clutter step. In this case, a small target near the clutter step may not be detected.

[0078] In contrast to the above-mentioned CA-CFAR, there is a method called Order Statistic CFAR (also referred to as OS-CFAR in the present disclosure) as a method for obtaining a threshold value from the median (center value) of values ​​in reference cells or a specified value when values ​​in reference cells are sorted in ascending order. OS-CFAR is a method for setting a threshold value based on ordered statistics and determining that a target exists when the threshold value is exceeded. This OS-CFAR can address the problems with CA-CFAR as described above. OS-CFAR can be realized by performing a process that is partially different from CA-CFAR. Hereinafter, a description will be given of an electronic device 1 according to an embodiment in which the OS-CFAR process is performed.

[0079] The determination unit 13 may determine object detection by OS-CFAR. In this case, the determination unit 13 may perform the determination using different thresholds in the region of a stationary object and the region of a non-stationary object. In addition, when the above-mentioned window control is performed, the determination unit 13 may not detect the region of the relative speed adjacent to the stationary object. The determination unit 13 may use a region of different distances at the same relative speed as the noise region used in OS-CFAR. In one embodiment, the determination unit 13 may determine that an object has been detected when, for example, the result of the speed FFT processing by the speed FFT processing unit 12 exceeds the threshold of CFER. The result of object detection determined by the determination unit 13 may be supplied to, for example, the arrival angle estimation unit 14.

[0080] The arrival angle estimation unit 14 estimates the direction (arrival angle) in which the reflected wave R arrives from the predetermined object 200 based on the result of the determination by the determination unit 13. The arrival angle estimation unit 14 may estimate the arrival angle for the point determined by the determination unit 13 to satisfy the threshold. The electronic device 1 can estimate the direction in which the reflected wave R arrives by receiving the reflected wave R from the multiple receiving antennas 31. For example, it is assumed that the multiple receiving antennas 31 are arranged at a predetermined interval. In this case, the transmission wave T transmitted from the transmission antenna 25 is reflected by the predetermined object 200 to become the reflected wave R, and the multiple receiving antennas 31 arranged at a predetermined interval each receive the reflected wave R. Then, the arrival angle estimation unit 14 can estimate the direction in which the reflected wave R arrives at the receiving antenna 31 based on the phase of the reflected wave R received by each of the multiple receiving antennas 31 and the path difference of each reflected wave R. That is, the electronic device 1 can measure (estimate) the arrival angle θ shown in FIG. 1 based on the result of the speed FFT processing. Hereinafter, the direction in which a radio wave transmitted from the electronic device 1 is reflected by an object and arrives at the electronic device 1 is also referred to simply as the "arrival direction" or "arrival angle." Also, the direction of an object detected by the electronic device 1 relative to the electronic device 1 may be simply referred to as the "arrival direction" or "arrival angle."

[0081] Various techniques have been proposed for estimating the direction from which the reflected wave R arrives based on the results of the velocity FFT processing. For example, known algorithms for estimating the direction of arrival include MUSIC (MUltiple SIgnal Classification) and ESPRIT (Estimation of Signal Parameters via Rotational Invariance Technique). Therefore, a more detailed description of the known techniques will be simplified or omitted as appropriate. Information (angle information) of the arrival angle θ estimated by the arrival angle estimation unit 14 may be appropriately supplied to the object detection unit 15 or the like in the control unit 10. In addition, information (angle information) of the arrival angle θ estimated by the arrival angle estimation unit 14 may be stored in the memory 17 or the like. In one embodiment, the control unit 10 may store the angle information of the object estimated by the arrival angle estimation unit 14 in the memory 17 in association with the detected distance of the object. In this way, information obtained as a result of the electronic device 1 detecting an object present in the surrounding environment, in which the distance to the detected object and the direction of the object relative to the electronic device 1 are associated, will be referred to as "environmental information" hereinafter. In one embodiment, the angle of arrival estimator 14 may store the environmental information in memory 17 .

[0082] The object detection unit 15 detects an object present in a range where the transmission wave T is transmitted based on information supplied from at least one of the distance FFT processing unit 11, the speed FFT processing unit 12, and the arrival angle estimation unit 14. The object detection unit 15 may perform object detection by, for example, clustering processing based on the supplied distance information, speed information, and angle information. For example, DBSCAN (Density-based spatial clustering of applications with noise) is known as an algorithm used for clustering data. In the clustering processing, for example, the average power of points constituting the detected object may be calculated. Information on the object detected by the object detection unit 15 may be supplied to, for example, the object tracking unit 16. Information on the distance, speed, angle, and power of the object detected in the control unit 10 may be supplied to, for example, other devices.

[0083] The object tracking unit 16 performs processing to track (predict) the target position in the next frame of the object that has been clustered by the object detection unit 15. The object tracking unit 16 may predict the position in the next frame of the object that has been clustered by using, for example, a Kalman filter. The object tracking unit 16 may store the predicted position of the object in the next frame in, for example, the memory 17. The object tracking unit 16 may also output the tracked (predicted) position as the target position in the next frame as the detection result of the object. The object tracking unit 16 may output various information processed in the control unit 10. The object tracking unit 16 may also store various information processed in the control unit 10 in the memory 17.

[0084] The memory 17 may be configured, for example, by a semiconductor memory or a magnetic disk, but is not limited thereto, and may be any storage device. For example, the memory 17 may be a storage medium such as a memory card inserted into the electronic device 1 according to the present embodiment. The memory 17 may be an internal memory of the CPU or DSP used as the control unit 10, as described above. The memory 17 may store a program executed in the control unit 10, and a result of a process executed in the control unit 10. The memory 17 may function as a work memory for the control unit 10. In one embodiment, the memory 17 may be any storage unit (memory) described above.

[0085] As described above, the memory 17 may store environmental information obtained as a result of the electronic device 1 detecting an object in the surrounding environment, in which the distance from the electronic device 1 to the object is associated with the direction of the object relative to the electronic device 1. Here, the electronic device 1 may detect various objects, including stationary objects and moving objects, present in the surroundings. Therefore, the control unit 10 of the electronic device 1 may associate the distance from the electronic device 1 to an object determined to be moving at a speed equal to or faster than a predetermined speed with the direction of the object relative to the electronic device 1 as environmental information. For example, the control unit 10 may repeatedly perform an operation of associating the distance to an object moving at a speed equal to or faster than a predetermined speed with the direction of the object as environmental information for various objects, and store the results in, for example, the memory 17. That is, the control unit 10 may generate environmental information multiple times at different times and store it in the memory 17.

[0086] The control unit 10 may also perform a process of averaging the environmental information stored in the memory 17 as described above. For example, the control unit 10 may average the directions of objects at the same distance from the electronic device 1 with respect to the electronic device 1. This process is expected to improve the accuracy of the distance of an object from the electronic device 1 and the direction of the object, which are associated and stored as environmental information. The control unit 10 may also update the environmental information stored in the memory 17 as described above based on a moving average. This process is expected to improve the accuracy of the distance of an object from the electronic device 1 and the direction of the object, which are associated and stored as environmental information.

[0087] In this way, the electronic device 1 according to an embodiment may calculate a moving average of a direction corresponding to the distance of an object and store it in the memory 17 when generating the environmental information. The electronic device 1 according to an embodiment may use the environmental information stored in the memory 17 when detecting an object. That is, the electronic device 1 according to an embodiment may estimate the direction of the detected object relative to the electronic device 1 based on information read from the environmental information. For example, the electronic device 1 according to an embodiment may output information read from the environmental information as the direction of the detected object relative to the electronic device 1. For example, the electronic device 1 may estimate, at the time of object detection, a direction associated in the environmental information with the distance of the detected object as the direction of the detected object relative to the electronic device 1. Also, for example, the electronic device 1 may output the estimated direction when the direction estimated as described above is within a predetermined angle difference (for example, ±5°) from the direction of the detected object. That is, in this case, the electronic device 1 may not output the estimated direction when the direction estimated as described above is relatively significantly different from the direction of the detected object.

[0088] Furthermore, the electronic device 1 may perform beamforming of at least one of the transmitted wave and the reflected wave based on the environmental information stored in the memory 17 when detecting an object. For example, the control unit 10 may perform control so as to perform beamforming of the transmission wave based on a direction associated with a distance in the environmental information.

[0089] Next, the operation of the electronic device 1 according to the embodiment will be described.

[0090] Before performing an operation of detecting an object and estimating the direction of the object, the electronic device 1 according to an embodiment may perform an operation of generating, storing, and / or updating environmental information to be used for detecting the object. These operations will be described separately below.

[0091] Fig. 5 is a flowchart showing an example of an operation (hereinafter also referred to as "operation A") in which the electronic device 1 according to an embodiment generates, accumulates, and / or updates environmental information. Fig. 6 is a flowchart showing an example of an operation (hereinafter also referred to as "operation B") in which the electronic device 1 according to an embodiment detects an object and estimates the direction of the object.

[0092] First, an operation (operation A) in which the electronic device 1 according to an embodiment generates, accumulates, and / or updates environmental information will be described with reference to Fig. 5. As described above, operation A may be an operation performed for a predetermined period of time after the electronic device 1 is installed on a roadside device or a traffic light, for example, as a preparation for performing operation B. Here, the predetermined period of time may be, for example, several hours, several days, or several months, as a period of time until appropriate environmental information is generated.

[0093] 5 starts, the control unit 10 controls the electronic device 1 to transmit transmission waves from the multiple transmission antennas 25 (step S11). In step S11, the control unit 10 may control the electronic device 1 to transmit, for example, one frame of transmission waves shown in FIG.

[0094] When the transmission wave is transmitted in step S11, the control unit 10 controls the electronic device 1 so that the reflected wave, which is the transmission wave reflected by an object, is received by the multiple receiving antennas 31 (step S12).

[0095] When the reflected wave is received in step S12, the control unit 10 detects an object existing around the electronic device 1 based on the transmitted wave and the reflected wave (step S13). In step S13, the control unit 10 may perform distance FFT processing and velocity FFT processing (2D-FFT processing) on ​​the multiple beat signals based on the transmitted wave and the reflected wave. In this case, the distance FFT processing unit 11 may perform the distance FFT processing, and the velocity FFT processing unit 12 may perform the velocity FFT processing (2D-FFT processing).

[0096] After the 2D-FFT process is performed in step S13, the control unit 10 determines whether the result of the 2D-FFT process is equal to or greater than the CFAR threshold (step S14). In this case, the determination unit 13 may determine whether the result of the 2D-FFT process is equal to or greater than the CFAR threshold. If the result is not equal to or greater than the CFAR threshold in step S14, the control unit 10 may skip steps S15 to S17 and proceed to step S18.

[0097] If the CFAR is equal to or greater than the threshold value in step S14, the control unit 10 determines whether the speed (absolute value) of the detected object is equal to or greater than a predetermined speed (step S15). In this case, the determination unit 13 may determine whether the speed of the detected object is equal to or greater than a predetermined speed. In step S15, in order to obtain information on a moving object, the determination unit 13 may determine whether the speed of the detected object is equal to or greater than a predetermined speed. Therefore, in order to determine whether the speed of the detected object is moving, the determination unit 13 may determine, for example, whether the speed of the detected object is greater than zero. If the speed of the object is not equal to or greater than the predetermined speed in step S15, the control unit 10 may skip the operations of steps S16 and S17 and proceed to the operation of step S18.

[0098] If the speed of the object is equal to or greater than a predetermined speed in step S15, the control unit 10 estimates the direction (arrival direction) of the detected object relative to the electronic device 1 (step S16). In this case, the direction of the detected object relative to the electronic device 1 may be estimated by the arrival angle estimation unit 14. The control unit 10 may store the direction of the object estimated in step S16 in the memory 17. In this case, the control unit 10 may also store in the memory 17 the distance of the object from the electronic device 1 estimated in step S16.

[0099] When the direction of the object is estimated in step S16, the control unit 10 updates the environmental information (step S17). Here, the control unit 10 may first generate information that associates the direction of the object with a speed equal to or greater than a predetermined value estimated in step S16 with the distance of the object from the electronic device 1 as environmental information, and store the information in the memory 17. The control unit 10 may generate environmental information multiple times at different times and store the information in the memory 17, for example, by executing step S17 for each frame of the transmission wave. Also, in step S17, the control unit 10 may average the information stored in the memory 17, for example, averaging the directions of objects at the same distance from the electronic device 1 to the electronic device 1, among the environmental information stored in the memory 17. Furthermore, the control unit 10 may update the environmental information stored in the memory 17 based on a moving average.

[0100] After updating the environmental information in step S17, the control unit 10 may repeat the operations of steps S11 to S17 shown in Fig. 5 a predetermined number of frames as shown in step S18, and then end the operations shown in Fig. 5. The predetermined number of frames in step S18 may be any number of frames equal to or greater than one, as necessary.

[0101] The operation shown in Fig. 5 may be repeatedly executed, for example, periodically or irregularly at a predetermined timing. For example, the operation shown in Fig. 5 may be repeatedly executed in units of a predetermined number of frames of a transmission wave.

[0102] Thus, in the electronic device 1 according to one embodiment, the control unit 10 detects an object reflecting a transmission wave based on a transmission signal transmitted as a transmission wave from the multiple transmission antennas 25 and a reception signal received as a reflected wave of the transmission wave from the multiple reception antennas 31. The control unit 10 may generate environmental information that associates a distance from the electronic device 1 to an object determined to be moving at a predetermined speed or faster with a direction of the object relative to the electronic device 1.

[0103] Next, an operation (operation B) in which the electronic device 1 according to an embodiment detects an object and estimates the direction of the object will be described with reference to Fig. 6. As described above, operation B may be an operation executed after operation A shown in Fig. 5 is performed. Operation B may be an operation in which the electronic device 1 detects an object (target) that is a specific target and estimates the direction of the object.

[0104] When the operation shown in Fig. 6 starts, the control unit 10 performs beamforming of at least one of the transmission wave and the reception wave based on the environmental information stored in the memory 17 (step S21). In step S21, the control unit 10 may perform beamforming of at least one of the transmission wave and the reception wave in a direction of the object stored in association with the distance of the object to be detected from the environmental information stored in the memory 17, relative to the electronic device 1. In this case, the control unit 10 may control the phase control unit 23 so that beamforming of at least one of the transmission wave and the reception wave is performed. In this way, by performing beamforming in a direction of the object stored in association with the distance of the object to be detected relative to the electronic device 1, the strength (power) of the reflected wave reflected by the object to be detected can be increased.

[0105] Next, the control unit 10 may transmit a transmission wave (step S11), receive a reflected wave (step S12), and perform 2D-FFT processing or the like on the multiple beat signals (step S13). The processing of steps S11 to S13 may be performed in the same manner as steps S11 to S13 described in FIG.

[0106] After the 2D-FFT process is performed in step S13, the control unit 10 determines whether the result of the 2D-FFT process is equal to or greater than the CFAR threshold (step S14). The process in step S14 may be performed similarly to step S14 described in Fig. 5. If the result in step S14 is not equal to or greater than the CFAR threshold, the control unit 10 may skip steps S22 to S26 and proceed to step S18.

[0107] If the result of the 2D-FFT processing in step S14 is equal to or greater than the CFAR threshold, the control unit 10 estimates (step S22) the direction of the detected object relative to the electronic device 1. The direction estimation in step S22 may be performed in the same manner as in step S16 described with reference to FIG.

[0108] When the direction of the object is estimated in step S22, the control unit 10 performs the operation of the next step S23. In step S23, the control unit 10 first reads out the direction associated with the distance of the detected object from the environmental information stored in the memory 17. Then, the control unit 10 determines whether the read out direction is within a predetermined angle difference from the direction estimated in step S22. Here, the predetermined angle may be any relatively small angle, such as ±5°. If the direction read out in step S23 is not within the predetermined angle difference from the estimated direction, the control unit 10 may skip the operations of steps S24 to S26 and proceed to the operation of step S18.

[0109] If the direction read in step S23 is within a predetermined angle difference from the estimated direction, the control unit 10 may output the direction read from the environmental information as the estimated direction (step S24). That is, in step S24, the control unit 10 may estimate the direction of the object relative to the electronic device 1 based on the environmental information. By making the determination in step S23, if the direction read from the environmental information is significantly different from the estimated direction due to some reason, it is possible to prevent the direction of the object from being estimated based on the environmental information. Also, as a simplified embodiment, for example, the determination process in step S23 may be omitted.

[0110] When the direction read from the environmental information is output as the estimated direction in step S24, the control unit 10 may detect the object by taking into account the direction information (step S25). In this case, the object may be detected by the object detection unit 15. In step S25, the control unit 10 may output information on the distance of the detected object from the electronic device 1, information on the speed of the detected object relative to the electronic device 1, and / or information on the direction (angle) of the detected object relative to the electronic device 1.

[0111] Next, the control unit 10 may perform a tracking process of the object based on the information of the object detected in step S25 (step S26). In this case, the object tracking unit 16 may perform the tracking process of the object.

[0112] After the object tracking process in step S26, the control unit 10 may repeat the operations of steps S21 to S26 shown in Fig. 6 a predetermined number of frames as shown in step S18, and then end the operation shown in Fig. 6. The predetermined number of frames in step S18 may be any number of frames equal to or greater than one, as necessary.

[0113] The operation shown in Fig. 7 may be repeatedly executed, for example, periodically or irregularly at a predetermined timing. For example, the operation shown in Fig. 6 may be repeatedly executed in units of a predetermined number of frames of a transmission wave.

[0114] In this manner, the control unit 10 of the electronic device 1 according to an embodiment may estimate the direction of the second object reflecting the transmission wave with respect to the electronic device 1 based on environmental information in which the distance to the first object determined to be moving at a speed equal to or greater than a predetermined speed and the direction of the first object with respect to the electronic device 1 are associated. Here, the first object may be an object detected by the action A described in FIG. 5. Also, the second object may be an object detected by the action B described in FIG. 6. Typically, the second object is not limited to the same object as the first object, and may be an object different from the first object. Also, in an embodiment, the control unit 10 may perform the process of estimating the direction of the second object with respect to the electronic device 1 based on the environmental information only in a predetermined case. For example, the predetermined case may be a case in which the direction of the second object with respect to the electronic device 1 estimated based on the environmental information is within a predetermined angle difference from the direction detected as the direction of the second object with respect to the electronic device 1. Also, the control unit 10 may control to perform beamforming of at least one of the transmission wave and the reflected wave based on the direction of the second object with respect to the electronic device.

[0115] Next, an operation of detecting and notifying a malfunction by the electronic device 1 according to an embodiment will be described.

[0116] For example, when a problem such as a breakdown or malfunction occurs in the electronic device 1 according to an embodiment, it is desirable to notify a predetermined target (e.g., a manager) or people nearby. Also, when an unusual situation occurs in the surrounding environment of the electronic device 1 according to an embodiment, it is desirable to notify a predetermined target (e.g., a manager) or people nearby. Here, an unusual situation in the surrounding environment may be, for example, a situation in which roads are impassable due to a natural disaster or accident, buildings or trees have collapsed, traffic is impeded by a relatively large obstacle, and the like.

[0117] Fig. 7 is a flowchart showing an example of an operation of detecting and notifying a malfunction by the electronic device 1 according to an embodiment. Fig. 7 may be an operation executed immediately before step S18 in the operation described with reference to Fig. 5 or Fig. 6, for example.

[0118] 7 starts, the control unit 10 determines whether the maximum distance at which an object can be detected by the electronic device 1 is equal to or greater than a predetermined threshold (step S31). Here, the predetermined threshold may be an arbitrary value (distance) that is set based on the distance at which an object can be detected if the electronic device 1 is operating normally.

[0119] If the maximum detection distance is equal to or greater than the predetermined threshold in step S31, it can be determined that the electronic device 1 is operating normally. Therefore, in this case, the control unit 10 resets the timer (step S32). Here, the timer may be any timer that counts the time during which the electronic device 1 is malfunctioning. For example, the control unit 10 may have a function of counting time as the timer. Moreover, resetting the timer may mean setting the time counted up by the timer to zero. For example, this timer may start counting up when the electronic device 1 is started up.

[0120] If the maximum detection distance is not equal to or greater than the predetermined threshold in step S31, it can be determined that the electronic device 1 is not operating normally. Therefore, in this case, the control unit 10 may skip the operation of step S32. This causes the timer described above to count up.

[0121] Next, the control unit 10 determines whether the time measured (counted up) by the timer has passed a predetermined time (step S33). Here, the predetermined time may be any time that is set based on the timing of notifying that the electronic device 1 is not operating normally.

[0122] If the predetermined time has elapsed in step S33, the control unit 10 notifies the electronic device 1 of a malfunction (step S34). The predetermined destination to which the malfunction is notified in step S34 may be set in advance, or, for example, an indicator indicating a malfunction may be turned on. If the predetermined time has not elapsed in step S33, the control unit 10 may skip the operation of step S34.

[0123] In this way, in one embodiment, the control unit 10 may perform control so as to issue a predetermined notification when the time during which the maximum distance at which an object can be detected is less than a predetermined distance continues for a predetermined period of time.

[0124] Conventionally, in a technology such as a millimeter wave radar, the direction of arrival of a reflected wave from an object can be estimated after performing FFT processing (2D-FFT processing) of distance and speed. According to such a technology, the speed and distance of an object can be detected with a practically usable accuracy by 2D-FFT processing. However, according to the conventional technology, even if the direction of arrival of a reflected wave from an object is estimated, sufficient signal quality may not be obtained, or the estimation error may become large due to the influence of multipath. According to the electronic device 1 according to the above-mentioned embodiment, the direction of arrival of a reflected wave from an object is stored as an average value detected for a plurality of objects. Therefore, according to the electronic device 1, the direction of arrival of a reflected wave from an object can be estimated with high accuracy. Furthermore, according to the electronic device 1, after being installed on a stationary object such as a roadside unit, a street lamp, or a traffic light, automatic calibration is possible by detecting surrounding objects. Furthermore, according to the electronic device 1, when a malfunction occurs in the surrounding environment and / or the electronic device 1, it is also possible to notify a predetermined target.

[0125] Although the present disclosure has been described based on the drawings and examples, it should be noted that a person skilled in the art can easily make various modifications or corrections based on the present disclosure. Therefore, it should be noted that these modifications or corrections are included in the scope of the present disclosure. For example, the functions included in each functional unit can be rearranged so as not to be logically inconsistent. Multiple functional units, etc. may be combined into one or divided. Each embodiment of the present disclosure described above is not limited to being implemented faithfully to each of the embodiments described, and may be implemented by combining each feature as appropriate or omitting a part. In other words, the contents of the present disclosure can be modified and corrected in various ways by a person skilled in the art based on the present disclosure. Therefore, these modifications and corrections are included in the scope of the present disclosure. For example, in each embodiment, each functional unit, each means, each step, etc. can be added to other embodiments so as not to be logically inconsistent, or replaced with each functional unit, each means, each step, etc. of other embodiments. In addition, in each embodiment, multiple functional units, each means, each step, etc. can be combined into one or divided. Furthermore, each of the above-described embodiments of the present disclosure is not limited to being implemented faithfully according to each of the described embodiments, but may be implemented by combining each feature or omitting some features as appropriate.

[0126] The above-described embodiment is not limited to being implemented only as the electronic device 1. For example, the above-described embodiment may be implemented as a control method for an apparatus such as the electronic device 1. Also, for example, the above-described embodiment may be implemented as a program executed by an apparatus such as the electronic device 1. Furthermore, the above-described embodiment may be implemented as a recording medium or storage medium on which a program executed by an apparatus such as the electronic device 1 is recorded, that is, a computer-readable recording medium or storage medium. [Explanation of symbols]

[0127] 1 Electronic equipment 10 Control section 11 Distance FFT processing section 12 Speed ​​FFT processing section 13 Judgment section 14 Arrival angle estimator 15 Object detection unit 16 Object Tracking Unit 17 Memory 20 Transmitter 21 Signal Generation Unit 22 Synthesizer 23 Phase control section 24 Amplifier 25 Transmitting Antenna 30 Receiving section 31 Receiving antenna 32 LNA 33 Mixer 34 IF Section 35 AD conversion section

Claims

1. 1. An electronic device that detects an object based on a transmission signal transmitted as a transmission wave and a reception signal received as a reflected wave of the transmission wave reflected by the object, An electronic device comprising: a control unit that generates environmental information that associates a distance from the electronic device to an object determined to be moving at or above a predetermined speed with a direction of the object relative to the electronic device.

2. The electronic device according to claim 1 , wherein the control unit estimates a direction of another object reflecting the transmission wave relative to the electronic device based on the environmental information.

3. 3. The electronic device of claim 2, wherein the control unit estimates the direction of the other object relative to the electronic device based on the environmental information when the direction of the other object relative to the electronic device estimated based on the environmental information is within a predetermined angle difference from the direction detected as the direction of the other object relative to the electronic device.

4. Further comprising a plurality of transmitting antennas for transmitting the transmission wave and a plurality of receiving antennas for receiving the reflected wave, The electronic device according to claim 2 , wherein the control unit performs beamforming of at least one of the transmitted wave and the reflected wave based on a direction of the other object with respect to the electronic device.

5. The electronic device according to claim 1 , wherein the control unit generates the environmental information a plurality of times at different times and stores the environmental information in a memory.

6. The electronic device according to claim 5 , wherein the control unit averages the environmental information stored in the memory.

7. The electronic device according to claim 6 , wherein the control unit averages directions of objects at the same distance from the electronic device with respect to the electronic device, among the environmental information stored in the memory.

8. The electronic device according to claim 5 , wherein the control unit updates the environmental information stored in the memory based on a moving average.

9. The electronic device according to claim 1 , wherein the control unit performs control so as to issue a predetermined notification when a time period during which the maximum distance at which the object can be detected is less than a predetermined distance continues for a predetermined period of time.

10. A method for controlling an electronic device, comprising: detecting the object based on a transmission signal transmitted as a transmission wave and a reception signal received as a reflected wave of the transmission wave reflected by the object; generating environmental information in which a distance from the electronic device to an object determined to be moving at a speed equal to or greater than a predetermined speed is associated with a direction of the object relative to the electronic device; A control method comprising:

11. For electronic devices, detecting the object based on a transmission signal transmitted as a transmission wave and a reception signal received as a reflected wave of the transmission wave reflected by the object; generating environmental information in which a distance from the electronic device to an object determined to be moving at a speed equal to or greater than a predetermined speed is associated with a direction of the object relative to the electronic device; A program to execute.

Citation Information

Patent Citations

  • Object detector utilizing repetitively pulsed light

    JP1999153664A

  • Fm-cw radar device for road monitoring

    JP2000111640A

  • Vehicle controller

    JP2003030798A

  • System and method for detecting moving object

    JP2003202373A

  • Road traffic monitoring device by means of millimeter-wave radar

    JP2007257536A