Electromagnetic wave visualization device

Abstract

To provide an electromagnetic wave visualization device capable of improving user convenience by efficiently displaying the measurement results of the electromagnetic wave strength of the target unit in the areas that the user needs.SOLUTION: The electromagnetic wave visualization device includes: an image acquisition unit that picks up images of the target unit; a measuring unit that measures the electromagnetic wave strength of a target unit; a control unit that generates a composite image in which the measurement results of the electromagnetic wave strength measured by the measuring unit are superimposed on the image of the target unit captured by the image acquisition unit; and an output unit that outputs the composite image generated by the control unit. The control unit is configured to set the measurement range for measuring the electromagnetic wave strength of the target unit in the image captured by the camera and generates a composite image including the measurement range of the measuring unit to output the same to the output unit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an electromagnetic wave visualization device. [Background technology]

[0002] Patent Document 1 discloses an electromagnetic wave visualization device that includes an emission direction separation unit that changes the emission direction of electromagnetic waves depending on the incident direction of the electromagnetic waves, a plurality of sensors that sense the energy of the electromagnetic waves emitted from the emission direction separation unit and each output a detection signal of a strength depending on the magnitude of the sensed energy, a processing unit that is capable of receiving a detection signal from each of the plurality of sensors and, upon receiving a detection signal from a sensor, outputs a display signal including information on the arrival direction of the electromagnetic waves associated with the sensor that sent the detection signal, and a display unit that is capable of displaying each of the arrival directions of the plurality of electromagnetic waves and, upon receiving a display signal, displays the arrival direction of the electromagnetic waves. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-130466 Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure has been devised in consideration of the above-mentioned conventional circumstances, and aims to provide an electromagnetic wave visualization device that efficiently displays measurement results regarding the electromagnetic wave intensity of a target device in the area that the user requires, thereby improving user convenience. [Means for solving the problem]

[0005] The present disclosure provides an electromagnetic wave visualization device comprising an image acquisition unit that captures an image of a target device, a measurement unit that measures the electromagnetic wave intensity of the target device, a control unit that generates a composite image in which the measurement result of the electromagnetic wave intensity measured by the measurement unit is superimposed on an image of the target device captured by the image acquisition unit, and an output unit that outputs the composite image generated by the control unit, wherein the composite image includes the measurement range of the measurement unit and is output to the output unit. [Effects of the Invention]

[0006] According to the present disclosure, it is possible to efficiently display the measurement results of the electromagnetic wave intensity of the target device in the area that is required by the user, thereby improving user convenience. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is an external view showing an example of an electromagnetic wave visualization device according to a first embodiment. [Figure 2] FIG. 1 is a diagram showing an example of the internal configuration of an electromagnetic wave visualization device according to a first embodiment; [Figure 3] FIG. 1 is a diagram showing an example of a use case of the electromagnetic wave visualization device according to the first embodiment. [Figure 4A] 1 is a top view of an example of a use case of the electromagnetic wave visualization device according to the first embodiment; [Figure 4B] FIG. 1 is a diagram showing a display example in a use case (position A) of the electromagnetic wave visualization device according to the first embodiment. [Figure 4C] FIG. 10 is a diagram showing a display example in a use case (position B) of the electromagnetic wave visualization device according to the first embodiment. [Figure 5] A diagram illustrating an example of a display range for each measurement distance. [Figure 6] 1 is a flowchart showing an example of an operation procedure of the electromagnetic wave visualization device according to the first embodiment; [Figure 7] 1 is a flowchart showing an example of an operation procedure of the electromagnetic wave visualization device according to the first embodiment; [Figure 8A] A diagram showing an example of a case where the measurement range is included in the specified range. [Figure 8B]A diagram showing an example of the measurement results displayed when the measurement range is included in the specified range. [Figure 9A] A diagram showing an example of a case where the specified range is included in the measurement range. [Figure 9B] A diagram showing an example of the measurement result display when the specified range is included in the measurement range. [Figure 10A] A diagram showing an example of a case where part of the specified range is included in the measurement range. [Figure 10B] A diagram showing an example of the display of measurement results when part of the specified range is included in the measurement range. [Figure 11A] A diagram showing an example of a case where the display range needs to be adjusted [Figure 11B] Figure showing an example of measurement results when the display range is adjusted [Figure 12A] A diagram showing an example of a case where the specified range is not included in the angle of view. [Figure 12B] A diagram showing an example of the measurement results displayed when the specified range is not included in the angle of view. DETAILED DESCRIPTION OF THE INVENTION

[0008] (Background to the content of the embodiment) Patent Document 1 discloses an electromagnetic wave visualization device that can visualize electromagnetic wave sources in real time. This electromagnetic wave visualization device includes an emission direction separation unit that emits electromagnetic waves in emission directions corresponding to the incident direction of the electromagnetic waves, multiple sensors that each output detection signals with intensities corresponding to the energy magnitude of the electromagnetic waves emitted from the emission direction separation unit, a processing unit that outputs a display signal containing information on the arrival direction of the electromagnetic waves associated with the sensor that transmitted the detection signal, and a display unit that can display each of the arrival directions of the multiple electromagnetic waves and displays the arrival directions of the electromagnetic waves upon receiving the display signal. This electromagnetic wave visualization device displays the arrival directions of the incident electromagnetic waves and outputs detection results of the electromagnetic wave intensity, thereby visualizing electromagnetic wave sources in real time.

[0009] However, conventional electromagnetic wave visualization devices display results that include areas outside the measurement range, and therefore do not display only the range of measurement results that the user requires. Therefore, in the following first embodiment, an example of an electromagnetic wave visualization device will be described that efficiently displays measurement results for the range that the user requires, among measurement results related to the electromagnetic wave intensity of a target device, thereby improving user convenience.

[0010] Hereinafter, with reference to the drawings as appropriate, a detailed description of a first embodiment, which specifically discloses the configuration and operation of an electromagnetic wave visualization device according to the present disclosure, will be provided. However, more detailed description than necessary may be omitted. For example, detailed descriptions of well-known matters or redundant descriptions of substantially identical configurations may be omitted. This is to avoid unnecessary redundancy in the following description and to facilitate understanding by those skilled in the art. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter recited in the claims. (Embodiment 1) First, an electromagnetic wave visualization device 100 according to a first embodiment will be described with reference to Fig. 1 and Fig. 2. Fig. 1 is an external view showing an example of the electromagnetic wave visualization device 100 according to the first embodiment. Fig. 2 is a diagram showing an example of the internal configuration of the electromagnetic wave visualization device 100 according to the first embodiment. The electromagnetic wave visualization device 100 according to the first embodiment is a portable device that is held by, for example, a user and that measures the electromagnetic wave intensity of a target device Tg1 that is an electromagnetic wave measurement target. The electromagnetic wave visualization device 100 includes a terminal device 1 and a measurement unit 2.

[0011] The terminal device 1 is a portable device such as a tablet or a smartphone. The terminal device 1 generates a heat map based on the electromagnetic wave intensity of the target device Tg1 received by a measuring unit 2 (to be described later). The terminal device 1 generates an image, and further generates a composite image by superimposing the heat map image on an image of the target device Tg1 captured by the camera 13, and displays the composite image on the monitor 14. The terminal device 1 includes a communication unit 10, a processor 11, a memory 12, a camera 13, and a monitor 14. Note that the camera 13 and the monitor 14 are not essential components and may be omitted.

[0012] Here, the target device Tg1 is an electric / electronic device that is the target of measuring the electromagnetic wave intensity (in other words, the intensity of the noise signal generated by the target device Tg1). The target device Tg1 is a device that includes one or more conductors that serve as a source of electromagnetic waves, and may be the conductor itself that serves as the source of electromagnetic waves. Furthermore, the target device Tg1 selected by the user and whose electromagnetic wave intensity is to be measured may be one or more.

[0013] The communication unit 10 is connected to the signal processing unit 20 of the measurement unit 2 so as to be able to communicate by wire. Specifically, the communication unit 10 of the terminal device 1 and the signal processing unit 20 of the measurement unit 2 each have a USB (Universal Serial Bus) connector (not shown) and are connected by wire via a USB cable (not shown). The communication unit 10 outputs the measurement result of the electromagnetic wave intensity of the target device Tg1 received from the signal processing unit 20 to the processor 11.

[0014] The communication unit 10 may be connected to the signal processing unit 20 so as to be able to communicate wirelessly with the signal processing unit 20. The wireless communication here may be, for example, a short-distance wireless communication such as Bluetooth (registered trademark) or NFC (registered trademark), or a wireless LAN (Local Area Network) such as Wifi (registered trademark). This is communication via a network.

[0015] The processor 11, which is an example of a control unit, is configured using, for example, a CPU (Central Processing Unit), a DSP (Digital Signal Processor), or an FPGA (Field Programmable Gate Array), and controls the operation of each unit of the terminal device 1. The processor 11 functions as a control unit of the terminal device 1, and performs control processing for overall supervision of the operation of each unit of the terminal device 1, data input / output processing between the units of the terminal device 1, data arithmetic (calculation) processing, and data storage processing. The processor 11 operates in accordance with programs and data stored in the memory 12. The processor 11 also starts measuring the electromagnetic wave intensity of the target device Tg1, triggered by setting a measurement range for the electromagnetic wave intensity of the target device Tg1 (described later) or by input of a trigger signal from the camera 13.

[0016] When the processor 11 detects that the measurement unit 2 has been attached to the terminal device 1, it detects a signal transmitted from the measurement unit 2. Here, the method for detecting that the measurement unit 2 has been attached to the terminal device 1 is well-known and will not be described in detail here; however, for example, the contact may be detected mechanically or via an electrical circuit. Based on the detected signal, the processor 11 detects (identifies) ID (identification) information for each measurement unit 2 that has been set in advance and stored in the memory 12. For example, the processor 11 may compare the ID for each measurement unit 2 included in the signal transmitted from the measurement unit 2 with a list of IDs for each measurement unit 2 (not shown) stored in the memory 12, and detect (identify) the ID of the measurement unit 2 if a match is determined. The processor 11 reads various information stored in association with the detected (identified) ID information from the memory 12. The various information referred to here includes information on the frequency band that can be measured by an antenna (not shown) of the measurement unit 2, the wave impedance characteristics (not shown) of the antenna, a correction coefficient table (not shown) for correcting the signal received by the antenna based on the wave impedance characteristics, and information on the sensor 30 that can receive electromagnetic waves. The ID information of the measurement unit 2 may be automatically detected (identified) by the processor 11, or the ID information of the measurement unit 2 attached by the user may be input.

[0017] The processor 11 detects the ID information of the measurement unit 2 and then detects the sensor included in the measurement unit 2. The processor 11 reads and acquires information about the sensor 30 (e.g., a receiving area capable of receiving electromagnetic waves, a central position, a shape, etc.) from the memory 12. Based on the acquired information about the sensor 30, the processor 11 calculates the coordinates (X2, Y2, Z2) of a reference point Pt2 of the attached sensor 30. The processor 11 sets a vertical vector VT3 that passes through the reference point Pt2 on the sensor 30 and is perpendicular to the plane of the sensor 30 (the plane where electromagnetic waves are received). The processor 11 also sets a horizontal vector VT4 that passes through the reference point Pt2, is parallel to the plane of the sensor 30 (the plane where electromagnetic waves are received), and is perpendicular to the vertical vector VT3.

[0018] Similarly, processor 11 reads and acquires information about camera 13 (e.g., the angle of view, the installation angle of camera 13, etc.) from memory 12. Based on the acquired information about camera 13, processor 11 calculates the coordinates (X1, Y1, Z1) of a reference point Pt1, which is based on the center of a lens (not shown) of camera 13. Furthermore, based on the installation angle of camera 13, processor 11 sets a central axis vector VT1 that passes through reference point Pt1, which is the center of the lens of camera 13, and that is oriented in the same direction as the central axis of the lens. Processor 11 also sets a vertical vector VT2 that passes through reference point Pt1 and is perpendicular to central axis vector VT1 that is oriented in the same direction as the central axis of the lens.

[0019] The processor 11 calculates the distance between the reference point Pt1 and the reference point Pt2, the angle between the central axis vector VT1 and the vertical vector VT3, and the angle between the vertical vector VT2 and the horizontal vector VT4. Specifically, the processor 11 calculates the angle between the central axis vector VT1 indicating the central axis of the lens of the camera 13 and the vertical vector VT3 indicating the vertical direction with respect to the plane where the electromagnetic waves are received by the sensor 30, and the angle between the vertical vector VT2 indicating the vertical direction with respect to the central axis vector VT1 of the camera 13 and the horizontal vector VT4 indicating the horizontal direction with respect to the plane where the electromagnetic waves are received by the sensor 30. Based on these calculation results, the processor 11 calculates an offset amount for converting a signal received at a predetermined position (coordinate) on the sensor 30 to a predetermined position (coordinate) corresponding to the angle of view of the camera 13. The processor 11 stores information about the calculated offset amount in the memory 12.

[0020] The processor 11 starts measuring the electromagnetic wave intensity emitted from the operating target device Tg1, triggered by the start of imaging by the camera 13 or by the user's selection of one or more target devices Tg1 from among one or more target devices captured in the imaging area. The processor 11 generates a heat map image based on the measurement results of the electromagnetic wave intensity. The heat map image is generated according to the range in which the sensor 30 can measure the electromagnetic wave intensity (hereinafter referred to as the measurement range).

[0021] The processor 11 aligns the positions (coordinates) between the captured image and the heat map image based on the calculated offset amount (for example, aligns the positions between the reference point Pt1 and the reference point Pt2), and generates a composite image by superimposing the heat map image on the captured image. The processor 11 cuts out the measurement range from the generated composite image and outputs it to the monitor 14. At this time, the processor 11 maintains the aspect ratio of the cut-out composite image, enlarges or reduces it so that the composite image is displayed at its largest size on the monitor 14, and outputs the generated composite image to the monitor 14.

[0022] It should be noted that the cutout range of the composite image (i.e., the range of the generated composite image that is output to the monitor 14) is not limited to the example described above. In the following description, the cutout range of the generated composite image that is to be displayed on the monitor 14 will be referred to as the display range.

[0023] For example, the processor 11 may receive from the camera 13 an image processing result capturing the contour of the target device Tg1, and based on this image processing result, may set the measurement range to a range obtained by expanding the range of the calculated offset amount in all directions outside the contour of the target device Tg1 for measuring the electromagnetic wave intensity. In such a case, the processor 11 may set the measurement range including the offset amount as the display range.

[0024] Furthermore, the display range may be set based on a user's input operation. Hereinafter, the range set based on a user's input operation is referred to as a specified range. In such a case, the processor 11 sets the range including the specified range and the measurement range as the display range. Furthermore, if the positional relationship between the electromagnetic wave visualization device 100 and the target device Tg1 changes after the specified range is set (for example, if either the electromagnetic wave visualization device 100 or the target device Tg1 moves) and the set specified range moves outside the current angle of view, the processor 11 may set the angle of view as the display range.

[0025] Furthermore, based on the captured image received from the camera 13 and the image processing results, the processor 11 may set the display range to the angle of view when the target device Tg1 is located outside the angle of view.

[0026] As a result, the electromagnetic wave visualization device 100 according to the first embodiment can efficiently display the measurement results of the electromagnetic wave intensity of the target device in the area that is required by the user, thereby improving user convenience.

[0027] The memory 12 includes, for example, a RAM (Random Access Memory) as a work memory used when executing each process of the processor 11, and a ROM (Read Only Memory) that stores programs and data that define the operation of the processor 11. The RAM temporarily stores data or information generated or acquired by the processor 11. The ROM stores programs that define the operation of the processor 11. The memory 12 stores ID (Identification) information that is preset for each of the multiple measuring units 2 that are detachable from the terminal device 1, information about the camera 13, coordinate information about each of the reference points Pt1 and Pt2, information about the central axis vector VT1, vertical vector VT2, perpendicular vector VT3, and horizontal vector VT4, information about the offset amount, information about the specified range, and the like.

[0028] Camera 13, which is an example of an image acquisition unit and a distance measurement unit, is configured to have at least a lens (not shown) and an image sensor (not shown). The image sensor is, for example, a solid-state image sensor such as a CCD (Charged-Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), and converts an optical image formed on the imaging surface into an electrical signal. When a user selects one or more target devices Tg1 from among one or more target devices captured within the imaging area, camera 13 sets a measurement range that includes the target devices Tg1 captured in the captured image. Camera 13 generates a trigger signal that starts measuring the intensity of electromagnetic waves generated during operation of the target devices Tg1, and outputs the trigger signal to processor 11.

[0029] The camera 13 is provided in the terminal device 1, captures an image of the target device Tg1, and outputs the captured image to the processor 11.

[0030] It goes without saying that the installation location of the camera 13 is not limited to the example shown in Fig. 1. For example, the camera 13 may be located on the surface opposite to the surface on which the monitor 14 is provided, and in the center of the terminal device 1. Furthermore, a plurality of cameras 13 may be provided, and the measured distance and direction to the target device Tg1 may be measured using each of a plurality of captured images.

[0031] The monitor 14, which is an example of an output unit, is configured using, for example, an LCD (Liquid Crystal Display) or an organic EL (Electroluminescence) display, and displays an image captured by the camera 13 or a heat map image (i.e., , the measurement results of the electromagnetic wave intensity) are superimposed on the captured image to display a composite image.

[0032] The monitor 14 may be realized by, for example, a head mounted display (HMD) connected to the terminal device 1 via wired or wireless communication. The monitor 14 displays a composite image (i.e., measurement results) externally output from the processor 11 in the terminal device 1.

[0033] The monitor 14 may be a touch interface configured by a touch panel provided in the terminal device 1. The monitor 14 receives an input operation from the user and outputs to the processor 11 the result of the input operation by the user.

[0034] The measuring unit 2 receives electromagnetic waves generated from the target device during operation and measures the electromagnetic wave intensity. The measuring unit 2 is configured to be able to receive electromagnetic waves in different frequency bands, and is detachably attached to the surface on which the camera 13 is provided. Note that the measuring unit 2 shown in FIG. 2 shows a state in which one of a plurality of antenna devices corresponding to the electromagnetic wave intensity in a predetermined frequency band is attached, and the structure for detachment is not shown.

[0035] The measuring unit 2 is attached to the terminal device 1 by the user in accordance with the frequency band generated by the target device to be measured. Note that the frequency band that can be measured using the multiple antenna devices according to the first embodiment is a frequency band of 9 kHz to 6 GHz that complies with the EMC (Electro Magnetic Compatibility) standard. Note that this frequency band is not limited to this, and may be 6 GHz or higher.

[0036] 1 has substantially the same size (area) as the terminal device 1 except for the area around the camera 13, but it goes without saying that the size and shape of the measurement unit 2 are not limited to the example shown in FIG. 1. The size of the measurement unit 2 may be larger or smaller than the monitor 14, for example. The shape of the measurement unit 2 may be rectangular, for example. The measurement unit 2 is configured to include a signal processing unit 20, a sensor 30, and an ID holding unit 40.

[0037] The signal processing unit 20 converts the received signal strength received by the sensor 30 into a signal indicating the intensity of the electromagnetic waves emitted from the target device. The signal processing unit 20 has a USB connector, associates the converted signal with coordinate information on the sensor 30, and transmits the measurement result of the electromagnetic wave strength of the target device Tg1 via a USB cable connected to the communication unit 10 in the terminal device 1. The signal processing unit 20 may transmit the measurement result to the terminal device 1 using short-range wireless communication or wireless LAN communication such as Wifi (registered trademark). The short-range wireless communication referred to here is, for example, Bluetooth (registered trademark) or NFC (registered trademark).

[0038] The sensor 30 has, for example, a dipole antenna or one or more loop antennas and is configured to be able to receive electromagnetic waves in a predetermined frequency band. The sensor 30 may be formed as a planar antenna. The sensor 30 receives electromagnetic waves generated from the target device Tg1 and outputs a reception signal to the signal processing unit 20.

[0039] The ID holding unit 40 is configured, for example, by a ROM, and stores ID information of the measurement unit 2. Note that the ID holding unit 40 is not limited to ID information, and may hold any information that can identify the attached measurement unit 2, such as a serial number.

[0040] 3 is a diagram showing an example of a use case of the electromagnetic wave visualization device 100 according to Embodiment 1. The electromagnetic wave visualization device 100 is held by a user or placed on a desk or the like, and measures the intensity of electromagnetic waves generated from a target device Tg1.

[0041] The electromagnetic wave visualization device 100 captures an image of the target device Tg1 using a camera 13 provided on the surface opposite the monitor 14, and measures the intensity of electromagnetic waves emitted from the operating target device Tg1 using a measurement unit 2 also attached to the surface opposite the monitor 14. The processor 11 generates a heat map image based on the measurement results of the electromagnetic wave intensity, and generates a composite image by superimposing the heat map image on the captured image, and displays the composite image on the monitor 14. Note that while the measurement results of the electromagnetic wave intensity of the target device Tg1 are displayed as a heat map image in FIG. 3, the method of displaying the measurement results is not limited to this and may be, for example, numerical values.

[0042] As a result, the electromagnetic wave visualization device 100 according to embodiment 1 can efficiently display the intensity of the electromagnetic waves generated during operation in the operating environment of the target device Tg1 without extracting the specific conductor that is the source of the electromagnetic waves, thereby improving user convenience.

[0043] 4A to 4C, use case examples of the electromagnetic wave visualization device 100 and display examples thereof will be described. FIG. 4A is a top view of the use case example of the electromagnetic wave visualization device 100 according to embodiment 1. FIG. 4B is a display example in a use case (position A) of the electromagnetic wave visualization device 100 according to embodiment 1. FIG. 4C is a display example in a use case (position B) of the electromagnetic wave visualization device 100 according to embodiment 1.

[0044] FIG. 4A shows how the electromagnetic wave visualization device 100 is used to measure the electromagnetic wave intensity of a target device Tg1. The camera 13 has an angle of view MM1 and captures an image of the target device Tg1. The sensor 30 has a measurement range DD1 and measures the electromagnetic wave intensity generated from the target device Tg1 in operation. The electromagnetic wave visualization device 100 shown in FIG. 4A measures the electromagnetic wave intensity generated from the target device Tg1 in operation at positions A and B. Note that the electromagnetic wave visualization device 100 shown in FIG. 4A is composed of a terminal device 1 and a measurement unit 2, but this is just an example and use cases are not limited to this.

[0045] When the target device Tg1 is located at position A, the monitor 14 displays the measurement results (screen ScA) with the display range including the angle of view MM1 and the measurement range DD1. Note that the measurement range MMA on the screen ScA is part of the measurement range DD1, and a frame line acting as a boundary is displayed. This allows the user to distinguish between the inside and outside of the measurement range. On the other hand, the area BB1 outside the angle of view MM1 and the measurement range DD1 is outside the angle of view, so the captured image is not displayed. Note that although the area BB1 is solid in FIG. 4B, a heat map image may also be displayed.

[0046] When the target device Tg1 is located at position B, the monitor 14 displays the measurement results (screen ScB) with the display range including the angle of view MM1 and the measurement range DD1. Note that the measurement range MMB on screen ScA is part of the measurement range DD1, and a frame line that acts as a boundary line is displayed. This allows the user to distinguish between the inside and outside of the measurement range.

[0047] As described above, the electromagnetic wave visualization device 100 can efficiently display the measurement results of the electromagnetic wave intensity of the target device Tg1 in the area required by the user, thereby improving user convenience.

[0048] With reference to Fig. 5, the angle of view and the display range of the measurement results displayed on the monitor 14 when the measurement distance between the target device Tg1 and the electromagnetic wave visualization device 100 changes will be described. Fig. 5 is a diagram illustrating an example of the display range for each measurement distance. The user in Fig. 5 holds the electromagnetic wave visualization device 100 to which the measurement unit 2 is attached, and measures the intensity of the electromagnetic waves generated from the target device Tg1 in operation at each of a plurality of measurement distances L1, L2, and L3. The change in the display range of the measurement results when the user moves from measurement distance L3 to measurement distance L1 will be described below. 5, the user captures the image of the target device Tg1 from the same direction so that the angle between the electromagnetic wave visualization device 100 (i.e., the measurement unit 2) held by the user and the target device Tg1 differs only in the imaging distance.

[0049] The display range here refers to the range displayed on monitor 14 of the composite image generated by superimposing a heat map image showing the measurement results of the electromagnetic wave intensity in the measurement range on the image captured by camera 13. This allows the user to check the measurement results shown in the composite image in a larger image, as the composite image of the range required by the user is cut out from the composite image and displayed on monitor 14.

[0050] The electromagnetic wave visualization device 100 at the measurement distance L3 captures an image of the target device Tg1 in an imaging area indicated by the angle of view Ar1, and sets a measurement range M1 including the target device Tg1 based on the captured image. The electromagnetic wave visualization device 100 also receives a designated range D1 that similarly includes the target device Tg1 from the user. In this case, the electromagnetic wave visualization device 100 sets the measurement range M1, which is a range that includes the measurement range M1 and the designated range D1, as the display range. Note that if the measurement range M1 is smaller than the designated range D1, the electromagnetic wave visualization device 100 sets the display range to the designated range D1.

[0051] The electromagnetic wave visualization device 100 at the measurement distance L2 captures an image of the target device Tg1 in an imaging area indicated by the angle of view Ar2. The angle of view Ar2 at the measurement distance L2 includes substantially the entire target device Tg1. The measurement range M2 is a range that includes a portion of the target device Tg1, and this range corresponds to the position and size of the measurement range M1 at the angle of view Ar1. Meanwhile, the designated range D1 remains unchanged from the range indicated by the angle of view Ar1 at the measurement distance L3 regardless of the measurement distance, and is therefore located outside the angle of view Ar2 at the measurement distance L2. In such a case, the electromagnetic wave visualization device 100 cannot set the designated range D1 desired by the user as the display range, and therefore sets the angle of view Ar2 as the display range. Note that the electromagnetic wave visualization device 100 may perform image processing within the angle of view Ar2 and set the angle of view Ar2 that includes substantially the entire target device Tg1 as the display range.

[0052] The electromagnetic wave visualization device 100 at the measurement distance L1 captures an image of the target device Tg1 in an imaging area indicated by the angle of view Ar3. The angle of view Ar3 and the measurement range M3 at the measurement distance L1 include a portion of the target device Tg1. Like the measurement range M2, the measurement range M3 is a range corresponding to the position and size of the measurement range M1 at the angle of view Ar1. The designated range D1 is located outside the angle of view Ar3 at the measurement distance L1. In such a case, the electromagnetic wave visualization device 100 cannot set the designated range D1 desired by the user as the display range, and therefore sets the angle of view Ar3 as the display range. Note that the electromagnetic wave visualization device 100 may perform image processing within the angle of view Ar3 and set the angle of view Ar3 that includes more of the target device Tg1 as the display range.

[0053] This allows the user to efficiently check the measurement results of the electromagnetic wave intensity of the target device in the area that the user needs.

[0054] Next, an example of an operation procedure of the electromagnetic wave visualization device 100 will be described with reference to Fig. 6 and Fig. 7. Furthermore, an example of each process shown in the example of the operation procedure of the electromagnetic wave visualization device 100 and an example of a display on the monitor 14 will be described with reference to Figs. 8A to 12B. Fig. 6 is a flowchart showing an example of an operation procedure of the electromagnetic wave visualization device 100 according to the first embodiment. Fig. 7 is a flowchart showing an example of an operation procedure of the electromagnetic wave visualization device 100 according to the first embodiment. Note that in the example of the operation procedure shown in Figs. 6 and 7, an example will be described in which the electromagnetic wave visualization device 100 includes a configuration of the camera 13 and the monitor 14, but it goes without saying that the configuration of the electromagnetic wave visualization device 100 is not limited to this.

[0055] The terminal device 1 displays the captured image captured by the camera 13 on the monitor 14. The terminal device 1 sets one target device Tg1 out of one or more target devices shown in the captured image as a target for electromagnetic wave measurement based on an input operation by the user (St1). Note that the processing of step St1 is not essential, and if there is no input operation by the user, the target device Tg1 may be set based on image processing by the camera 13.

[0056] The terminal device 1 performs image processing on the captured image to acquire the outline of the target device Tg1 for measuring the electromagnetic wave intensity. The terminal device 1 sets the range in which the sensor 30 can measure the electromagnetic wave intensity as the measurement range (St2).

[0057] The terminal device 1 displays the captured image captured by the camera 13 on the monitor 14, and sets a designated range based on the user's input operation on the captured image (St3). The designated range may be larger or smaller than the measurement range.

[0058] The terminal device 1 measures the electromagnetic wave intensity within the measurement range set in the process of step St2 (St4).

[0059] Here, the terminal device 1 proceeds to an operation procedure for setting the display range. The terminal device 1 determines whether the set measurement range is within the specified range (St5).

[0060] If the set measurement range is within the designated range in the process of step St5 (St5, YES), the terminal device 1 sets the designated range as the display range (St6).

[0061] Here, in the case where the set measurement range is within the specified range in the processing of step St5 (St5, YES), the relationship between the angle of view, the specified range, and the measurement range and a display example thereof will be described with reference to FIGS. 8A and 8B.

[0062] Fig. 8A is a diagram showing an example of a case where the measurement range M4 is included in the designated range D4. Fig. 8B is a diagram showing an example of the display of measurement results in a case where the measurement range M4 is included in the designated range D4. The angle of view Ar4 shown in Fig. 8A includes the entire target device Tg1, the designated range D4, and the measurement range M4. The designated range D4 includes the entire target device Tg1 and the entire measurement range M4. In addition, the measurement range M4 includes a portion of the target device Tg1.

[0063] In such a case, the terminal device 1 sets a designated range D4 including the entire measurement range M4 as the display range, thereby setting a display range including the entire measurement range and the designated range. As a result, the terminal device 1 generates a measurement result (screen Sc1) by cutting out the composite image of the set display range from the composite image, and displays it on the monitor 14. Note that a frame line that serves as a boundary line is displayed within the measurement range M4a on the screen Sc1, making it possible to distinguish between the inside and outside of the measurement range.

[0064] On the other hand, if the set measurement range is not within the specified range in the process of step St5 (St5, NO), the terminal device 1 sets a display range that includes the entire measurement range and the specified range (St7).

[0065] Here, in the case where the set measurement range is not within the specified range in the processing of step St5 (St5, NO), the relationship between the angle of view, the specified range, and the measurement range and display examples thereof will be explained with reference to Figures 9A, 9B, 10A, and 10B.

[0066] 9A is a diagram showing an example of a case where the designated range D5 is included in the measurement range M5, and FIG. 9B is a diagram showing an example of a display of the measurement result in a case where the designated range D5 is included in the measurement range M5. 9A. The angle of view Ar5 shown in FIG. 9A includes the entire target device Tg1, the designated range D5, and the measurement range M5. The entire target device Tg1 is included in the designated range D5. Furthermore, the designated range D5 is smaller than the measurement range M5, and its entire range is included in the measurement range M5.

[0067] In this case, the terminal device 1 sets the measurement range M5 including the entire range of the specified range D5 as the display range, thereby setting the display range including the entire range of the measurement range and the specified range. As a result, the terminal device 1 generates a measurement result (screen Sc2) by cutting out the composite image of the set display range from the composite image, and displays it on the monitor 14.

[0068] Another example will be described with reference to Fig. 10A and Fig. 10B. Fig. 10A is a diagram showing an example of a case where part of the designated range D6 is included in the measurement range M6. Fig. 10B is a diagram showing an example of a display of a measurement result in a case where part of the designated range D6 is included in the measurement range M6. The angle of view Ar6 shown in Fig. 10A includes the entire target device Tg1, the designated range D6, and the measurement range M6. The entire target device Tg1 is included in the designated range D6. Furthermore, the measurement range M6 includes part of the designated range D6 and part of the target device Tg1.

[0069] In such a case, the terminal device 1 sets the display range to include the measurement range M6 and the specified range D6. As a result, the terminal device 1 generates a measurement result (screen Sc3) by cutting out the composite image of the set display range from the composite image, and displays it on the monitor 14. Note that a frame line that acts as a boundary is displayed in the measurement range M6a on the screen Sc3, making it possible to distinguish between the inside and outside of the measurement range. Also, FIG. 10B shows a frame that makes it easy to understand each range included in the screen Sc3. Although a dashed line indicating the range of the specified range D6 is displayed for this purpose, this is not essential and does not have to be displayed.

[0070] The terminal device 1 further determines whether the specified range is within the current angle of view (St8). The process in step St8 is effective when, for example, the user reduces the measured distance between the terminal device 1 and the target device Tg1 (in other words, reduces the distance).

[0071] In the process of step St8, if the specified range is within the current angle of view (St8, YES), the terminal device 1 maintains the currently set display range and further proceeds to the process of step St10.

[0072] On the other hand, if the specified range is not within the current angle of view in the process of step St8 (St8, NO), the terminal device 1 sets the angle of view to the display range (St9).

[0073] The terminal device 1 determines whether the currently set display range matches the aspect ratio of the monitor 14 (St10).

[0074] In the processing of step St10, if the currently set display range matches the aspect ratio of the monitor 14 (St10, YES), the terminal device 1 generates measurement results by cutting out the composite image of the set display range from the generated composite image and displays it on the monitor 14 (St11).

[0075] On the other hand, in the process of step St10, if the currently set display range does not match the aspect ratio of the monitor 14 (St10, NO), the terminal device 1 adjusts the magnification of the set display range in the generated composite image. Specifically, the terminal device 1 adjusts the magnification so that the length of the long side of the composite image of the display range matches the short side of the displayable area of ​​the monitor 14. After the adjustment, the terminal device 1 cuts out the composite image of the display range, generates measurement results, and displays them on the monitor 14 (St12).

[0076] Here, in the case where the set measurement range is not within the specified range in the processing of step St10 (St10, NO), the relationship between the angle of view, the specified range, and the measurement range and a display example thereof will be described with reference to FIGS. 11A and 11B.

[0077] Fig. 11A is a diagram showing an example of a case where adjustment of the display range is necessary. Fig. 11B is a diagram showing an example of the display of measurement results when the display range is adjusted. The angle of view Ar7 shown in Fig. 11A includes the entire target device Tg1, a designated range D7, and a measurement range M7. The entire target device Tg1 is included in the designated range D7. Furthermore, the designated range D7 is smaller than the measurement range M7, and its entire range is included in the measurement range M7.

[0078] In this case, the terminal device 1 sets the measurement range M7, which includes the entire range of the specified range D7, as the current display range. As a result, the terminal device 1 generates a measurement result by cutting out the composite image of the set display range from the composite image. Here, the monitor 14 of the terminal device 1 has a display area capable of displaying the angle of view Ar7. Therefore, the terminal device 1 enlarges or reduces the length W1 of the long side of the display range of the measurement result by cutting out the composite image of the set display range to match the length W2 of the short side of the monitor 14.

[0079] In addition, a frame line that acts as a boundary line is displayed within the measurement range M7a on the screen Sc4, making it possible to distinguish between the inside and outside of the measurement range. Also, as shown in FIG. 11B, the original composite image before cutting out may be displayed in a blank area E1 outside the measurement range M7a.

[0080] The terminal device 1 determines whether or not there has been a change in the distance and positional relationship between the terminal device 1 and the target device Tg1 (St13).

[0081] If there is a change in the distance and positional relationship between the terminal device 1 and the target device Tg1 (St13, YES), the terminal device 1 further determines whether the target device Tg1 is within the current angle of view (St14).

[0082] On the other hand, if there is no change in the distance and positional relationship between the terminal device 1 and the target device Tg1 (St13, NO), the terminal device 1 proceeds to processing in step St4, and after the measurement, executes processing from step St5 onwards to set the display range to be displayed on the monitor 14 for the measurement results of the measured electromagnetic wave intensity.

[0083] If the target device Tg1 is within the angle of view in the processing of step St14 (St14, YES), the terminal device 1 executes processing from step St5 onwards to set the display range to be displayed on the monitor 14 for the measurement results of the electromagnetic wave intensity.

[0084] On the other hand, if the target device Tg1 is not in the field of view in the process of step St14 (St14, NO), the terminal device 1 proceeds to the process of step St9.

[0085] Here, in the case where the set measurement range is not within the specified range in the processing of step St14 (St14, NO), the relationship between the angle of view, the specified range, and the measurement range and a display example thereof will be described with reference to FIGS. 12A and 12B.

[0086] 12A is a diagram showing an example of a case where the designated range D8 is not included in the angle of view Ar8. FIG. 12B is a diagram showing an example of a display of measurement results in a case where the designated range D8 is not included in the angle of view Ar8. The angle of view Ar8 shown in FIG. 12A includes a part of the target device Tg1 and the measurement range M8. The designated range D8 includes the angle of view Ar8, the entire target device Tg1, and the entire range of the measurement range M8. The measurement range M8 is included in the angle of view Ar8 and includes a part of the target device Tg1.

[0087] In this case, the terminal device 1 sets the angle of view Ar8 as the display range. As a result, the terminal device 1 generates a measurement result (screen Sc5) consisting of the entire composite image. Note that a frame line that serves as a boundary line is displayed in the measurement range M8a on the screen Sc5, making it possible to distinguish between the inside and outside of the measurement range.

[0088] As described above, the electromagnetic wave visualization device 100 according to the first embodiment can efficiently display the measurement results of the electromagnetic wave intensity of the target device in the area that is required by the user, thereby improving user convenience.

[0089] A modification of the electromagnetic wave visualization device 100 according to the first embodiment will be described below.

[0090] The electromagnetic wave visualization device 100 according to the first embodiment may further include a laser device (not shown) in the terminal device 1 or the measurement unit 2. The laser device is controlled by the processor 11. The laser device irradiates a visible laser light to indicate one of a designated range, a measurement range, and a display range that is set for a target device Tg1 selected by a user from one or more target devices shown in the imaging area.

[0091] As a result, the electromagnetic wave visualization device 100 can irradiate (project) into the actual space any one of the designated range, measurement range, and display range displayed on the monitor 14. Therefore, the user can visually confirm any one of the designated range, measurement range, and display range displayed on the display screen of the monitor 14 of the electromagnetic wave visualization device 100 at hand. Furthermore, when multiple users each measure the electromagnetic wave intensity, the multiple users can easily share the settings of the designated range, measurement range, and display range.

[0092] The electromagnetic wave visualization device 100 according to the first embodiment may include a projection unit (not shown) in the terminal device 1 or the measurement unit 2. The projection unit is controlled by the processor 11. The projection unit projects a heat map image as a measurement result of the electromagnetic wave intensity onto the target device Tg1, enabling so-called projection mapping. This allows the electromagnetic wave visualization device 100 to irradiate (project) the measurement result (heat map image) of the electromagnetic wave intensity generated from the target device Tg1 in operation into an actual space. Therefore, a user can confirm the measurement result (heat map image) of the electromagnetic wave intensity of the target device Tg1 with the naked eye. Furthermore, when multiple users each measure the electromagnetic wave intensity, each of the multiple users can easily share the measurement result (heat map image) of the electromagnetic wave intensity of the target device Tg1.

[0093] As described above, the electromagnetic wave visualization device 100 according to the first embodiment includes an image acquisition unit (camera 13) that captures an image of a target device, a measurement unit 2 that measures the electromagnetic wave intensity of the target device Tg1, a control unit (processor 11) that generates a composite image by superimposing the measurement result of the electromagnetic wave intensity measured by the measurement unit 2 on the captured image of the target device Tg1 captured by the image acquisition unit, and an output unit (monitor 14) that displays the composite image generated by the control unit. The control unit in the electromagnetic wave visualization device 100 generates a composite image including the measurement range of the measurement unit 2 and outputs the composite image to the output unit.

[0094] As a result, the electromagnetic wave visualization device 100 according to the first embodiment can efficiently display the measurement results of the electromagnetic wave intensity of the target device Tg1 in the area that is required by the user, thereby improving user convenience.

[0095] Furthermore, the control unit in the electromagnetic wave visualization device 100 according to the first embodiment sets a specified range to be output to the output unit based on an input operation by the user, and generates a composite image including the specified range and a part or the entire range of the measurement range. As a result, the electromagnetic wave visualization device 100 according to the first embodiment can select the area required by the user from the measurement results regarding the electromagnetic wave intensity of the target device Tg1. It is possible to generate measurement results (synthetic images) of the area.

[0096] Furthermore, when the entire measurement range is not included in the designated range, the control unit in the electromagnetic wave visualization device 100 according to the first embodiment generates a composite image that includes the designated range and the entire measurement range. This allows the electromagnetic wave visualization device 100 according to the first embodiment to generate measurement results (composite image) that include the area (designated range) that the user wants to see and the area (measurement range) for which the measurement results are required, among the measurement results related to the electromagnetic wave intensity of the target device Tg1.

[0097] Furthermore, the control unit in the electromagnetic wave visualization device 100 according to the first embodiment calculates an offset amount consisting of the difference in coordinate position between the position of the central axis of the image acquisition unit and the center position of the measurement unit 2, and generates a composite image by superimposing, on the captured image, the measurement results of the electromagnetic wave intensity for each coordinate of the measurement unit 2 based on the offset amount. As a result, even if there is a deviation between the reference point of the angle of view of the image acquisition unit and the reference point of the reception range of the measurement unit 2, the electromagnetic wave visualization device 100 can generate a measurement result (composite image) in which the deviation has been corrected (corrected).

[0098] Furthermore, the control unit in the electromagnetic wave visualization device 100 according to embodiment 1 generates a composite image that is enlarged or reduced so that the composite image is displayed at its largest size on the output unit while maintaining the aspect ratio of the composite image. This allows the electromagnetic wave visualization device 100 to generate a larger, easier-to-view measurement result (composite image) and output it to the output unit.

[0099] Moreover, the electromagnetic wave visualization device 100 according to the first embodiment further includes a distance measurement unit (camera 13) that measures the distance and direction from the electromagnetic wave visualization device 100 to the target device Tg1, and the control unit changes the designated range based on the distance measurement result obtained by the distance measurement unit. This allows the electromagnetic wave visualization device 100 to efficiently display the measurement result of the area required by the user, out of the measurement results related to the electromagnetic wave intensity of the target device Tg1.

[0100] Furthermore, when the specified range is larger than the current angle of view, the control unit in the electromagnetic wave visualization device 100 according to the first embodiment generates a composite image of the current angle of view, which enables the electromagnetic wave visualization device 100 to efficiently display the measurement results of the area required by the user, among the measurement results related to the electromagnetic wave intensity of the target device Tg1.

[0101] Although various embodiments have been described above with reference to the accompanying drawings, the present disclosure is not limited to such examples. It is clear that those skilled in the art can conceive of various modifications, alterations, substitutions, additions, deletions, and equivalents within the scope of the claims, and it is understood that these also fall within the technical scope of the present disclosure. Furthermore, the components of the various embodiments described above may be combined in any manner without departing from the spirit of the invention. [Industrial Applicability]

[0102] The present disclosure is useful as an electromagnetic wave visualization device that efficiently displays measurement results related to the electromagnetic wave intensity of a device to be measured, in areas that are of interest to the user, thereby improving user convenience. [Explanation of symbols]

[0103] 1 Terminal device 2 Measuring part 10. Communications Department 11 processors 12 Memory 13 Camera 14 monitors 20 Signal Processing Section 30 sensors 40 ID holding part 100 Electromagnetic wave visualization device Tg1 target devices D1, D4, D5, D6, D7, D8 specified range DD1, MMA, MMB, M1, M2, M3, M4, M4a, M5, M6, M6a, M7, M7a, M8, M8a Measurement range Ar1, Ar2, Ar3, Ar4, Ar5, Ar6, Ar7, Ar8, MM1 angle of view

Claims

1. an image acquisition unit having a field of view and configured to capture an image of a target device, and a measurement unit for measuring the electromagnetic wave intensity of the target device; a control unit that sets a measurement range of the measurement unit and generates a composite image by superimposing the measurement result of the electromagnetic wave intensity on the captured image of the target device captured by the image acquisition unit; an output unit that outputs the composite image generated by the control unit, The measurement range of the measurement unit is set by reading from a memory the information necessary for measurement of the sensor equipped in the measurement unit based on ID information for each measurement unit, and the control unit generates the composite image including an area outside the angle of view of the measurement range of the measurement unit and outputs it to the output unit.

2. the control unit sets a designated range to be output to the output unit based on an input operation by a user, and generates the composite image including the designated range and a part or all of the measurement range. The electromagnetic wave visualization device according to claim 1 .

3. When the entire measurement range is not included in the designated range, the control unit generates the composite image including the designated range and the entire measurement range. The electromagnetic wave visualization device according to claim 2 .

4. the control unit calculates an offset amount consisting of a difference in coordinate position between the position of the central axis of the image acquisition unit and the center position of the measurement unit, and generates the composite image by superimposing the measurement result of the electromagnetic wave intensity for each coordinate of the measurement unit on the captured image based on the offset amount. The electromagnetic wave visualization device according to claim 1 .

5. the control unit generates the composite image by enlarging or reducing it so that the aspect ratio of the composite image is maintained and the composite image is output at the largest size by the output unit. The electromagnetic wave visualization device according to claim 1 .

6. 3. The electromagnetic wave visualization device of claim 2, further comprising a distance measurement unit that measures a distance and a direction from the electromagnetic wave visualization device to the target device, wherein the control unit changes the composite image to be output to the output unit based on a distance measurement result obtained by the distance measurement unit.

7. When the specified range is larger than a current angle of view, the control unit generates the composite image of the current angle of view. The electromagnetic wave visualization device according to claim 6.

Images