Information processing device, information processing method, and program

Abstract

This invention provides an information processing device, an information processing method, and a program that make it easier to understand the spatial structure when displaying the object to be visualized. [Solution] The information processing device generates data in which, based on data of the objects to be visualized for each unit region in real space, object TO2 representing the objects to be visualized is placed in the region corresponding to each unit region in the three-dimensional space MS1 corresponding to real space. The object TO2 is granular and moves within the range set for each region corresponding to the unit region in the three-dimensional space MS1.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] Attempts have been made to visually grasp, that is, visualize, the situation of invisible objects such as radio waves and heat that spread in a three-dimensional space. For example, in the systems of Patent Documents 1 to 3, characteristics related to the propagation of radio waves, such as electric field strength, are represented by a heat map or contour lines on a plan view showing the arrangement of structures in space.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Patent Document 3

Summary of the Invention

Problems to be Solved by the Invention

[0004] In some methods of superimposing a visualization target on a plan view as described above, there is a problem that it is difficult to grasp the three-dimensional structure of the space. Therefore, it has been considered to superimpose a visualization target on a space represented by a three-dimensional model. However, when a display showing a visualization target is superimposed on a three-dimensional space, the visibility within the space decreases considerably, and ultimately, it may be difficult to grasp the structure of the space. Therefore, it is required to show the visualization target so that at least one of the width, height, and depth, which are basic elements for spatial recognition, can be grasped more easily.

Means for Solving the Problems

[0005] This document describes various aspects of an information processing device, an information processing method, and a program for solving the above-mentioned problems. [Aspect 1] An information processing device comprising a control unit that generates data in which, based on data of objects to be visualized for each unit region in real space, object objects that represent the objects to be visualized are placed in regions corresponding to each unit region in a three-dimensional space corresponding to the real space, wherein the object objects are granular and move within a range set for each region corresponding to the unit region in the three-dimensional space.

[0006] According to the above configuration, because the target object moves, the continuous obstruction of specific areas in three-dimensional space by the target object is suppressed. Therefore, the view of the space improves, and it becomes easier to perceive the depth and height of the space. Consequently, in the three-dimensional space image displayed based on the above data, it becomes easier for the user to grasp the structure of the space.

[0007] [Aspect 2] The information processing apparatus according to [Aspect 1], wherein the number of target objects in each region corresponding to the unit region is 2 or more. With the above configuration, even if the target object is made smaller, it becomes easier to understand the appearance and behavior of the target object. Therefore, it is possible to reduce the area obstructed by a single object and improve the visibility of the space.

[0008] [Aspect 3] An information processing device according to [Aspect 1] or [Aspect 2] wherein at least one of the number of target objects for each region corresponding to the unit region, the appearance of the target objects, and the behavior of the target objects indicates the magnitude of the value of the object to be visualized. The above configuration allows for an accurate representation of the magnitude of the values ​​being visualized.

[0009] [Aspect 4] The aforementioned target object represents a plurality of the aforementioned visualization targets, and is an information processing device according to any one of [Aspect 1] to [Aspect 3]. According to the above configuration, it is possible to increase the amount of information about the visualization target provided to the user while minimizing obstruction within the three-dimensional space.

[0010] [Aspect 5] An information processing device according to any one of [Aspect 1] to [Aspect 4], wherein the appearance of the target object and the behavior of the target object indicate different magnitudes of the values ​​of the visualization target.

[0011] With the above configuration, elements that are easily distinguishable by the user without causing confusion, such as appearance and behavior, indicate the magnitude of values ​​for different visualization targets, allowing the user to accurately grasp the status of multiple visualization targets.

[0012] [Aspect 6] The three-dimensional space is a virtual space representing the real space using a three-dimensional model, as described in any one of [Aspect 1] to [Aspect 5]. With the above configuration, users can accurately grasp the structure of real space through images in three-dimensional space. Furthermore, it is easy to balance the colors, overlaps, and other aspects of each object, including the target object representing the object to be visualized and the object of the structure corresponding to the real space.

[0013] [Aspect 7] The information processing device according to any one of [Aspect 1] to [Aspect 6], wherein the object to be visualized is a characteristic relating to radio waves. With advancements in technologies such as communications, radar, and sensors, opportunities to utilize radio waves are increasing, and the importance of visualizing radio wave conditions is growing. Therefore, the usefulness of the information processing device is enhanced by the above configuration.

[0014] [Aspect 8] The information processing apparatus according to [Aspect 7], wherein the radio waves are either radio waves used for communication or radio waves used for radar or sensors. As mentioned above, the importance of visualizing the conditions of radio waves used in communications, radar, and sensors is increasing, and therefore the usefulness of the information processing device is enhanced by the above configuration.

[0015] [Aspect 9] An information processing apparatus according to any one of [Aspect 1] to [Aspect 8], wherein the appearance of the target object indicates the magnitude of the characteristics relating to the propagation of radio waves as the object to be visualized, and the behavior of the target object indicates the magnitude of the characteristics relating to communication using the radio waves as the object to be visualized. With the above configuration, users can accurately and intuitively grasp these visualization targets.

[0016] [Aspect 10] The information processing apparatus according to any one of [Aspect 1] to [Aspect 9], wherein the target object is a first object, and the control unit generates data in which, in addition to the first object, a second object which is a target object representing the object to be visualized is placed in the region corresponding to each unit region in the three-dimensional space, and the second object is a stationary object which is placed one at a time in each region corresponding to the unit region.

[0017] According to the above configuration, if the first object and the second object represent the same visualization target, the distribution of the visualization target becomes easier for the user to understand, and it is also possible to represent multiple visualization targets using these objects. Furthermore, the overall design aesthetics of the objects representing the visualization targets can be enhanced.

[0018] [Aspect 11] An information processing method in which one or more computers generate data in which target objects, which are objects representing the visualization targets, are placed in regions corresponding to each unit region in a three-dimensional space corresponding to the real space, based on data of the visualization targets for each unit region in the real space, wherein the target objects are granular and move within a range set for each region corresponding to the unit region in the three-dimensional space.

[0019] According to the above method, since the target object moves, it is possible to suppress the continuous blocking of a specific area of the three-dimensional space by the target object. Therefore, the visibility of the space is improved, and it becomes easier to recognize the depth and height of the space. Therefore, it becomes easier for the user to grasp the structure of the space in the image of the three-dimensional space displayed based on the above data.

[0020] [Aspect 12] A program for causing one or more computers to execute generating data in which a target object, which is an object representing the visualization target, is arranged in an area corresponding to each unit area in a three-dimensional space corresponding to the real space based on data of the visualization target for each unit area in the real space, wherein the target object is in a particulate state and moves within a range set for each area corresponding to the unit area in the three-dimensional space.

[0021] According to the above configuration, since the target object moves, it is possible to suppress the continuous blocking of a specific area of the three-dimensional space by the target object. Therefore, the visibility of the space is improved, and it becomes easier to recognize the depth and height of the space. Therefore, it becomes easier for the user to grasp the structure of the space in the image of the three-dimensional space displayed based on the above data.

Effect of the Invention

[0022] According to the present disclosure, it is possible to make it easier to grasp the structure of the space when displaying the visualization target.

Brief Description of the Drawings

[0023] [Figure 1] FIG. 1 is a diagram showing the overall configuration of a visualization system and the functional configuration of a visualization processing device according to an embodiment. [Figure 2] FIG. 2 is a diagram showing the hardware configuration of a visualization processing device according to an embodiment. [Figure 3] FIG. 3 is a flowchart showing the processing procedure of a visualization system according to an embodiment. [Figure 4]Figure 4 shows the configuration of a unit region in one embodiment. [Figure 5] Figure 5 shows an example of a space in which the target object of one embodiment is placed. [Figure 6] Figure 6 shows the configuration of a box object in one embodiment. [Figure 7] Figure 7 shows the configuration of a particle object in one embodiment. [Figure 8] Figure 8 shows a configuration combining a box object and a particle object according to one embodiment. [Figure 9] Figure 9 shows another example of a space in which the target object of one embodiment is placed. [Modes for carrying out the invention]

[0024] An embodiment of a visualization system will be described as one example of an information processing device, an information processing method, and a program, with reference to the drawings. [Overall Configuration of the Visualization System] Referring to Figure 1, the overall configuration of the visualization system 100 will be explained. The visualization system 100 is a system for visually showing the distribution of characteristics of invisible objects spread across three-dimensional space. In a broader sense, the visualization system 100 is a system for visually showing the characteristics of objects that are difficult for users to directly observe in three-dimensional space. In this embodiment, the explanation will focus on an example where the characteristics of radio waves are the object to be visualized.

[0025] The aforementioned radio waves may be radio waves used for information communication, or radio waves used in radar and sensors. These radars and sensors include, for example, radars and sensors used to realize advanced autonomous driving, radars and sensors used in automotive safety equipment such as collision avoidance and advanced driver assistance systems (ADAS), radars and sensors used in systems such as parking assistance for automobiles, radars and sensors used in medical and life support applications, and radars and sensors used in smart offices.

[0026] Regarding radio waves used for communication, specific examples of what can be visualized include characteristics related to radio wave propagation, such as electric field strength and received power, and characteristics related to communication using radio waves, such as communication speed. Regarding radio waves used in radar, specific examples of what can be visualized include characteristics of radar, such as electric field strength, power, phase, polarization angle, and frequency; characteristics of radio waves received by each receiving antenna in a radar equipped with multiple receiving antennas, such as electric field strength, power, phase, and frequency; and characteristics such as the degree of radio wave interference in an environment where multiple radars are used.

[0027] Furthermore, the objects to be visualized may be characteristics derived from the processing of information acquired by radar or sensors. For example, the objects to be visualized may be characteristics relating to objects detected by radar or sensors. Specific examples of such objects to be visualized include characteristics such as the distance and speed from a reference position of an object detected by radar or sensors, and, in cases where radar or sensors are used to observe the surrounding conditions of a protected object such as a vehicle, characteristics such as the distance and speed from a reference position of the protected object and other objects, and the degree of danger calculated from the direction of travel of the protected object. Note that only one characteristic may be visualized, or two or more characteristics may each be visualized.

[0028] As shown in Figure 1, the visualization system 100 comprises a visualization processing device 10 and a measuring device 20. The visualization processing device 10 is an example of an information processing device.

[0029] The measuring device 20 measures the object to be visualized in the target space, which is a three-dimensional real space. The target space may be indoors or outdoors. The measuring device 20 may be configured to be movable and measure the object to be visualized at multiple locations by repeatedly moving and measuring. Alternatively, the measuring device 20 may measure the object to be visualized at a fixed point. Furthermore, the visualization system 100 may be equipped with multiple measuring devices 20, and the object to be visualized may be measured at multiple locations through the cooperation of these measuring devices 20.

[0030] The measuring device 20 only needs to be equipped with measuring instruments appropriate to the object to be visualized. For example, if the object to be visualized is a characteristic of radio waves for communication, the measuring device 20 may be equipped with an area tester, spectrum analyzer, antenna, network tester, wireless router, etc. Alternatively, if the object to be visualized is a characteristic of radio waves used in radar, the measuring device 20 may be equipped with a spectrum analyzer, antenna, etc. Alternatively, if the object to be visualized is a characteristic derived from processing information acquired by radar or sensors, the measuring device 20 may be a radar or sensor.

[0031] Furthermore, the measuring device 20 may include a computer device for measuring the object to be visualized and processing the measurement results. The computer device includes one or more processors, one or more memories, and a communication interface.

[0032] Measurement data showing the measurement results from the measuring device 20 is sent from the measuring device 20 to the visualization processing device 10. The measuring device 20 and the visualization processing device 10 may be connected via a network such as the Internet or an intranet, or they may be connected to each other by wired or wireless means. The measuring device 20 may be equipped with a communication interface according to the communication means used. In addition, a relay device may be interposed in the transmission of data between the measuring device 20 and the visualization processing device 10.

[0033] The visualization processing device 10 generates visualization data, which is data for displaying a combination of a three-dimensional model representing the target space and an object representing the object to be visualized, based on measurement data. The visualization processing device 10 then displays an image based on the visualization data. The visualization processing device 10 is a computer device such as a personal computer.

[0034] [Configuration of the visualization processing device] The detailed configuration of the visualization processing device 10 will be described with reference to Figures 1 and 2. First, the functional configuration of the visualization processing device 10 will be described with reference to Figure 1.

[0035] The visualization processing device 10 includes a communication unit 11, a control unit 12, a storage unit 13, an operation unit 14, and a display unit 15. The communication unit 11 performs communication processing between the visualization processing device 10 and the measuring device 20. The operation unit 14 receives user input and sends data and signals corresponding to the input to the control unit 12. The display unit 15 receives data and signals from the control unit 12 and displays an image.

[0036] The control unit 12 functions as a unit area data generation unit 12a, a visualization data generation unit 12b, and a display processing unit 12c by executing a program stored in the storage unit 13.

[0037] The unit area data generation unit 12a generates unit area data 13b, which is data to be visualized for each unit area in the target space, using measurement data 13a acquired from the measurement device 20. Measurement data 13a is a collection of measurement results of visualization targets associated with their positions in the target space. Unit area data 13b is generated from this distributed data, measurement data 13a. Various statistical processes may be used to generate unit area data 13b from measurement data 13a. Machine learning models may also be used to generate unit area data 13b.

[0038] The unit domain data 13b may be data of the values ​​to be visualized for each unit domain, or data of the degree to which the values ​​to be visualized for each unit domain. The degree to which the values ​​to be visualized are indicated by classifications, that is, they indicate which of several stages the degree of high or low, strong or weak, of the values ​​to be visualized falls into.

[0039] A unit domain is a region consisting of a plane or space. The entire set of unit domains may be at least a part of the object space. In other words, a unit domain can be defined for at least a part of the object space. Furthermore, a unit domain may be a planar region, i.e., a two-dimensional region, defined by the components of two of the three axes that constitute the Cartesian coordinate system defined for the object space. For example, if a Cartesian coordinate system consisting of the x, y, and z axes, with the vertical direction as the z axis, is defined in the object space, the unit domain may be a region defined by the x and y components.

[0040] Multiple unit regions are arranged along at least one plane. These multiple unit regions may be arranged in two dimensions or in three dimensions. For example, they may be arranged in two dimensions along a horizontal plane, or in three dimensions along a horizontal plane and a vertical plane. On the plane along which the multiple unit regions are arranged, they are arranged in a two-dimensional grid. Examples of two-dimensional grids include square grids, triangular grids, and hexagonal grids. The shape of the unit regions along the above plane can be polygonal. If the multiple unit regions are arranged in a square grid along at least one plane, and the shape of the unit regions along the above plane is square, the complexity of the shape and arrangement of the unit regions can be suppressed, thus reducing the computational load related to the unit regions. The size of the unit area may be, for example, the size that one person can occupy while stationary. In one example, the unit area is 1m 2 It is a planar area of ​​a certain size.

[0041] The visualization data generation unit 12b generates visualization data 13d using unit domain data 13b and spatial data 13c, which is data representing the target space using a three-dimensional model. The space constructed using the above three-dimensional model is the model space. In other words, the model space is a virtual three-dimensional space that mimics the target space, which is the real space, using a three-dimensional model. The spatial data 13c includes information on the three-dimensional Cartesian coordinate system set for the model space, as well as position information and drawing information for objects representing structures placed in the model space. Positions in the model space are associated with positions in the target space.

[0042] The visualization data generation unit 12b generates visualization data 13d such that objects corresponding to the visualization target of each unit region are placed at positions corresponding to each unit region in the model space. These objects representing the visualization target are called target objects.

[0043] The target objects include box objects, which are geometric solids placed one per unit area, and particle objects, which are granular objects. Particle objects are an example of the first type of object, and box objects are an example of the second type of object.

[0044] The visualization data generation unit 12b configures the target object such that at least one of the appearance and behavior of the target object indicates the magnitude of the value to be visualized. The visualization target may indicate the magnitude of the value by an appearance or behavior that corresponds one-to-one with the value of the visualization target, such as a color for each value. Alternatively, the visualization target may indicate the magnitude of the value of the visualization target as a degree by an appearance or behavior that corresponds one-to-one with a classification indicating the degree of visualization. Thus, the visualization data 13d is data from the model space where the target object is placed.

[0045] The display processing unit 12c displays an image on the display unit 15 by performing drawing processing using the visualization data 13d. As a result, an image of the model space in which the target object is placed is displayed on the display unit 15.

[0046] The storage unit 13 stores various programs and data necessary for the execution of processing by the control unit 12. Examples of such data stored in the storage unit 13 include the measurement data 13a, unit area data 13b, spatial data 13c, and visualization data 13d described above. As described above, the measurement data 13a is data acquired from the measurement device 20, and the unit area data 13b and visualization data 13d are data generated by the visualization processing device 10.

[0047] Spatial data 13c is generated, for example, based on three-dimensional measurement of the target space using a known method. The generation of spatial data 13c may be performed by the visualization processing device 10 or by a device other than the visualization processing device 10. Furthermore, the three-dimensional measurement of the target space may be performed by the measurement device 20 or by a device other than the measurement device 20. When the measurement device 20 performs three-dimensional measurement of the target space, this three-dimensional measurement may be performed at the same time as the measurement of the object to be visualized, or at a different time from the measurement of the object to be visualized. When the measurement device 20 performs three-dimensional measurement, the measurement device 20 only needs to be equipped with measuring instruments such as sensors according to the three-dimensional measurement method.

[0048] Referring to Figure 2, the physical configuration, i.e., hardware configuration, of the visualization processing device 10 having the above-described functions will be explained. As shown in Figure 2, the visualization processing device 10 includes one or more processors 111, one or more memories 112, one or more storage devices 113, one or more communication interfaces 114, one or more input devices 115, and one or more output devices 116.

[0049] The processor 111 loads the operating system and various programs from the storage 113 into the memory 112 and executes instructions retrieved from the memory 112. The processor 111 and memory 112 implement the functions of the control unit 12, and the storage 113 implements the functions of the storage unit 13. Some of the functions of the storage unit 13 may be implemented by the memory 112.

[0050] The processor 111 may be a CPU (central processing unit), GPU (graphics processing unit), APU (accelerated processing unit), NPU (neural network processing unit), microprocessor, microcontroller, DSP (digital signal processor), FPGA (field programmable gate array), CPLD (complex programmable logic device), application-specific integrated circuit (ASIC), general-purpose processor, or any combination thereof.

[0051] Memory 112 is the main memory. Memory 112 may be ROM (read-only memory), RAM (random access memory), registered memory, unbuffered memory, etc.

[0052] Storage 113 is a non-temporary computer-readable medium for storing programs and data. Storage 113 may be, for example, an SSD (solid state drive) or an HDD (hard disk drive).

[0053] The communication interface 114 may be a LAN (local area network), Wi-Fi (registered trademark), Bluetooth (registered trademark), or another wireless communication interface. The communication interface 114 implements the functions of the communication unit 11.

[0054] The input device 115 includes a mouse, keyboard, touch panel, etc., and implements the functions of the operation unit 14. The output device 116 includes a display panel such as an LCD panel and implements the functions of the display unit 15.

[0055] Each process performed by the visualization processing device 10 may be executed by software provided by the visualization processing device 10, or by a combination of hardware and software provided by the visualization processing device 10.

[0056] [Visualization System Operation] Refer to Figures 3 to 5 to explain the processing flow by the visualization system 100. As shown in Figure 3, first, the measurement of the object to be visualized is performed in the target space by the measuring device 20 (step S10). As a result, the measurement data 13a is sent from the measuring device 20 to the visualization processing device 10.

[0057] The visualization processing device 10, having acquired the measurement data 13a, generates unit area data 13b (step S20). Figure 4 shows an example of a unit area UT1 set for the target space TS1, along with a plan view of the target space TS1. In the example shown in Figure 4, the unit area UT1 is a two-dimensional area along the horizontal plane and has a square shape. Multiple unit areas UT1 are arranged without gaps in a square grid.

[0058] After generating the unit region data 13b, the visualization processing device 10 generates visualization data 13d (step S30). Then, the visualization processing device 10 uses the visualization data 13d to display an image of the model space in which the target object is placed (step S40).

[0059] Figure 5 shows an example of a model space MS1 in which the target objects are placed. In the model space MS1, fixed objects FO1, which represent structures such as furniture, are placed corresponding to the shapes and arrangements of those structures in the target space. Then, box objects TO1 and particle objects TO2, which are the target objects, are placed in the region corresponding to the unit region. For example, if the unit region UT1 is a two-dimensional region along the horizontal plane as shown in Figure 4, the target objects corresponding to the objects to be visualized in the unit region UT1 are placed in the region in the horizontal plane whose position coincides with that unit region UT1.

[0060] Furthermore, it is not necessary for any target objects to be placed in the area where the fixed object FO1 is located. This configuration makes it easier for users viewing the model space image to understand the placement and shape of the fixed object FO1.

[0061] Furthermore, the viewpoint in the image of the model space MS1 may be changeable by user instruction. User instruction is input to the visualization processing device 10 through user operation of the operation unit 14.

[0062] [Configuration of the target object] Refer to Figures 6 to 8 to explain the detailed configuration of the target objects. Figures 6 to 8 are diagrams showing excerpts of target objects corresponding to four unit regions arranged in a square grid. Figure 6 shows only the box object TO1, Figure 7 shows only the particle object TO2, and Figure 8 shows both the box object TO1 and the particle object TO2. In the following explanation, in the three-dimensional Cartesian coordinate system set for the model space MS1, the axis corresponding to the vertical direction is the z axis, and the axes corresponding to the horizontal direction are the x axis and y axis.

[0063] <box object> As shown in Figure 6, one box object TO1 is placed in each unit area. The position of box object TO1 is fixed; in other words, box object TO1 is stationary.

[0064] Adjacent box objects TO1 are arranged along a single plane, which is a reference plane, with a gap G1 between them. The reference plane corresponds to the plane along which the unit region lies. The reference plane is preferably a horizontal or vertical plane. For example, if the unit region is a two-dimensional region along a horizontal plane, the plane along the xy plane is the reference plane, as shown in the example in Figure 6. In this case, the direction perpendicular to the reference plane is the z direction.

[0065] Because a gap G1 is provided between adjacent box objects TO1, visibility of the model space MS1 is improved in the direction perpendicular to the reference plane. For example, if the reference plane is a plane along the xy plane, a user viewing an image of the model space MS1 can directly see a portion of the floor or ceiling of the model space MS1 through the gap G1, without obstructing any objects. Therefore, the user can accurately perceive the height of the model space MS1, making it easier to grasp the structure of the space.

[0066] The box object TO1 is configured so that its exterior indicates the magnitude of the value being visualized. The exterior is the visual feature visible on the surface of the box object TO1, and includes color, gloss and other light behaviors, texture, pattern, etc. Color includes attributes such as hue, saturation, and brightness. The exterior is an element that can be controlled by the material and texture settings of the object.

[0067] For example, if the object to be visualized is received power, the box object TO1 may use color to indicate the magnitude of the value being visualized, such that a stronger reddish hue indicates a larger received power, and a stronger blued hue indicates a smaller received power.

[0068] Because a gap G1 is provided between adjacent box objects TO1, even when the differences in the exteriors of adjacent box objects TO1 are small, such as when the magnitude of the values ​​to be visualized in adjacent unit regions are similar, users can easily grasp the position corresponding to the boundary of the unit region.

[0069] Furthermore, the box object TO1 may indicate the magnitude of two types of visualized values ​​using two elements of its exterior. For example, the color may indicate the received signal strength, and the pattern may indicate the communication speed.

[0070] The box object TO1 is preferably semi-transparent. Semi-transparent means that the transparency set for the object is between 30% and 70%. Because the box object TO1 is semi-transparent, the floor, walls, and fixed objects in the model space MS1 become more visible through the box object TO1. This also makes it easier for the user to understand the structure of the space.

[0071] The planar shape of box object TO1, as viewed from a position opposite the reference plane, is preferably a polygon or a circle, and more preferably similar to the unit region as viewed from the same direction. For example, if the unit region is square, the planar shape of box object TO1 is also preferably square. If the planar shape of box object TO1 is similar to the unit region, even if there is a gap G1 between adjacent box objects TO1, the user can easily infer the position corresponding to the boundary of the unit region.

[0072] It is preferable that the cross-sectional shape of the box object TO1 along the reference plane is constant. That is, it is preferable that the box object TO1 is columnar in shape. Even with this configuration, it is easy to estimate the position corresponding to the boundary of the unit area.

[0073] The thickness t1 of the box object TO1 in the direction perpendicular to the reference plane is preferably smaller than the maximum width of the box object TO1 in the direction along the reference plane. With this configuration, the model space MS1 is less likely to be obstructed unnecessarily by the box object TO1, making it easier for the user to understand the structure of the space.

[0074] The width w1 of the gap G1 in the direction along the reference plane is preferably greater than 1 / 3 of the thickness t1 of the box object TO1. This minimizes obstruction of the view from the gap G1 by the box object TO1. Therefore, the model space MS1 becomes more easily visible directly from the gap G1.

[0075] Furthermore, it is preferable that the width w1 of the gap G1 is less than 1 / 3 of the maximum width of the box object TO1 in the direction along the reference plane. This ensures that the box object TO1 does not become too small relative to the gap G1, thereby accurately representing the object to be visualized.

[0076] In a direction perpendicular to the reference plane, it is preferable that the box object TO1 is separated from the inner surface of the model space MS1. For example, if the reference plane is a plane along the xy plane, it is preferable that the box object TO1 is separated from both the floor and ceiling surfaces. With this configuration, the planes that define the width, depth, and height of the model space MS1 become more visible, making it easier for the user to grasp the structure of the space.

[0077] The position of the box object TO1 in a direction perpendicular to the reference plane may be determined according to the measurement position of the object to be visualized. For example, if the unit area is a two-dimensional area along the horizontal plane, the x and y coordinates of the box object TO1 are determined according to the position of the unit area. In this case, the vertical position of the box object TO1, i.e., the z coordinate, may be set to the height at which the measuring device 20 measured the object to be visualized.

[0078] According to the above configuration, even if the unit domain is two-dimensional, the position of the box object TO1 reflects the distribution of the objects to be visualized in the target space, taking into account three-dimensional elements. Therefore, the user can grasp the distribution of the objects to be visualized more accurately.

[0079] <Particle Object> As shown in Figure 7, one or more particle objects TO2 are placed in each unit area and move within the movement range RA1 of each unit area. In Figure 7, the movement paths of some of the particle objects TO2 located in the movement range RA1 at the foreground are indicated by arrows.

[0080] The shape of particle object TO2 is not limited to a sphere; it may be a three-dimensional shape enclosed by curved or flat surfaces. Furthermore, particle object TO2 may be flat, like a piece of paper. If particle object TO2 is flat, for example, the object can be made more visible to the user by rotating the orientation of the plane while moving the object within the movement range RA1, or by controlling the object's orientation so that the plane always faces the user. Additionally, making particle object TO2 a shape where planes intersect in a cross shape can make the object appear three-dimensional and more visible.

[0081] The movement range RA1 is set for each unit region, in the region corresponding to that unit region in model space MS1 and its vicinity, so as not to overlap with other movement ranges RA1. For example, if the unit region is a two-dimensional region along the horizontal plane, the movement range RA1 of the particle object TO2 corresponding to that unit region is set within the region having the xy coordinates corresponding to that unit region in model space MS1. In the example shown in Figure 7, the movement range RA1 is a rectangular parallelepiped-shaped area extending in the z direction from the surface within the region corresponding to the unit region.

[0082] For example, if the unit region is a region consisting of three-dimensional space, the movement range RA1 of the particle object TO2 corresponding to the unit region may be set within the region corresponding to the unit region in the model space MS1.

[0083] Because particle object TO2 moves, it prevents a specific area of ​​model space MS1 from being continuously obstructed by particle object TO2. Therefore, the view of model space MS1 is improved from any viewpoint, making it easier for the user to grasp the structure of the space. In the example shown in Figure 7, the movement of particle object TO2 allows the user to accurately perceive the depth and height of the space.

[0084] Particle objects TO2 are configured to indicate the magnitude of the value to be visualized by at least one of the following: the number of particles per unit area, their appearance, and their behavior. The number of particles per unit area is the number of particle objects TO2 moving within one movement range RA1. Preferably, the number of particles per unit area is 2 or more. If the number of particles per unit area is 2 or more, it becomes easier to grasp the appearance and behavior even if the particle objects TO2 are small, making it possible to reduce the area obstructed by a single particle object TO2 and improve the visibility of the model space MS1.

[0085] The appearance of a particle object TO2 includes the object's shape, size, color, transparency, glossiness, and whether or not it emits light and the amount of light it emits.

[0086] The behavior of particle object TO2 includes the object's movement speed, direction of movement, and the shape and size of the movement range RA1. Particle object TO2 may remain within the movement range RA1. Alternatively, particle object TO2 may appear from a specific area within the movement range RA1 and disappear after a predetermined time has elapsed, or after moving to a predetermined area within the movement range RA1. In such configurations, the shape and size of the area where particle object TO2 appears, and its lifespan (the time from appearance to disappearance), are also included in the behavior of particle object TO2.

[0087] Furthermore, the behavior of particle object TO2 also includes whether or not collisions occur between objects and how they behave when collisions occur. Collision behavior includes, for example, disappearing or bouncing.

[0088] Multiple visualization targets may be indicated by several of the elements described above. In particular, it is preferable that two of the following three elements of particle object TO2—number of particles per unit area, appearance, and behavior—indicate the magnitude of the values ​​for each individual visualization target. For example, the color of particle object TO2 may be set to indicate the magnitude of the received power, and the movement speed of particle object TO2 may be set to indicate the magnitude of the communication speed. The appearance and behavior of particle object TO2 are elements that are easy for the user to distinguish without confusing them. Therefore, if the appearance and behavior are set to indicate the magnitude of values ​​for different visualization targets, the user can accurately grasp the status of multiple visualization targets.

[0089] Furthermore, for the particle object TO2, elements that do not indicate the magnitude of the value being visualized, such as the number of particles per unit area, appearance, and behavior, can be set arbitrarily.

[0090] As shown in Figure 8, when placing a box object TO1 and a particle object TO2 as target objects, for example, these objects are arranged so that the box object TO1 and particle object TO2, which correspond to the same unit area, are aligned in a direction perpendicular to the reference plane. In Figure 8, objects TO1 and TO2, which correspond to the same unit area, are aligned in the z direction.

[0091] The movement range of particle object TO2 is set, for example, to the area on the top surface of box object TO1. The top surface of box object TO1 is the surface that faces a wider area of ​​space among the surfaces along the reference plane. With this arrangement, the box object TO1 and the particle object TO2 will not obstruct each other, thus minimizing the reduction in visibility of objects TO1 and TO2.

[0092] The visualization target represented by box object TO1 and the visualization target represented by particle object TO2 may be the same or different. For example, if the same elements in objects TO1 and TO2 represent the same visualization target, such as when the colors of box object TO1 and particle object TO2 indicate the magnitude of the same visualization target value, the user can easily understand the status of the visualization target. In one example, the colors of box object TO1 and particle object TO2 are set to indicate the magnitude of the received power, and the movement speed of particle object TO2 is set to indicate the magnitude of the communication speed. In this case, the respective colors of box object TO1 and particle object TO2 corresponding to the same unit area will match.

[0093] Figure 9 shows another example of the model space MS1 in which the target object is placed. Figure 9 shows an example in which the electric field strength of radio waves from an in-vehicle radar such as a millimeter-wave radar is the target of visualization, and the colors of objects TO1 and TO2 indicate the magnitude of the electric field strength. Object FO2 of a stationary or moving structure may be placed in the model space MS1. From Figure 9, it can be seen that, as a radio wave propagation situation, the radio waves spread out in a fan shape from the installation position of the in-vehicle radar, and the electric field strength weakens as it moves away from the installation position of the in-vehicle radar. In this way, if the characteristics of radio waves from an in-vehicle radar are the target of visualization, it is easy to determine whether the spread and strength distribution of radio waves are appropriate for in-vehicle radars used in driver assistance systems such as collision avoidance and autonomous driving systems.

[0094] [Change settings for target object] The configuration of the target object may be changed according to user instructions. User instructions are input to the visualization processing device 10 through user operations on the operation unit 14. The control unit 12 then generates visualization data 13d with the target object configured according to the user instructions.

[0095] For example, if the magnitude of the value being visualized is indicated by the color of the target object, the color map used may be set according to the user's instructions. For instance, the color map to be used as the color of the target object may be selected from multiple color maps, such as a color map consisting of multiple hues or a color map where differences in brightness are the main feature. Grayscale may also be available as the color of the object.

[0096] Furthermore, among the elements of the target object mentioned above that can indicate the magnitude of the value being visualized, elements that are not used to indicate the magnitude of the value being visualized may be set according to the user's instructions. For example, if the number of particles per unit area or the movement speed of particle object TO2 are not used to indicate the magnitude of the value being visualized, these may be set according to the user's instructions. Even if these elements are used to indicate the magnitude of the value being visualized, the reference number or speed may be set according to the user's instructions.

[0097] Furthermore, when the viewpoint set for the model space to generate images of the model space is changed, the settings of the target objects may also be changed. For example, the width of the gap between box objects TO1 may be changed according to the viewpoint so that the inside of the model space can be more easily seen through the gap.

[0098] As described above, the following effects can be obtained according to this embodiment. (1) A particle object TO2 is placed as the target object representing the object to be visualized. Because particle object TO2 moves, it prevents a specific area of ​​the model space from being continuously obstructed by particle object TO2. Therefore, the view of the model space improves even from a single viewpoint, and the depth and height of the space become easier to perceive. Consequently, the user can more easily grasp the structure of the space.

[0099] (2) If the number of particle objects TO2 in each region corresponding to a unit region is 2 or more, it becomes easier to understand the appearance and behavior of the particle objects TO2 even if they are made smaller. Therefore, it is possible to improve the visibility of the model space by reducing the region that a single particle object TO2 obstructs.

[0100] (3) If the particle object TO2 represents multiple visualization targets, it is possible to increase the amount of information about the visualization targets provided to the user while suppressing the obstruction of the model space by an increase in the number of objects.

[0101] (4) The appearance and behavior of particle object TO2 indicate the magnitude of different values ​​of the visualized objects. With this configuration, the appearance and behavior, which are elements that are easy for the user to distinguish without confusion, indicate the magnitude of different values ​​of the visualized objects, so the user can accurately grasp the status of multiple visualized objects.

[0102] In particular, if the appearance of particle object TO2 indicates characteristics related to radio wave propagation, and the behavior of particle object TO2 indicates characteristics related to communication using radio waves, then users can intuitively grasp these visualized objects.

[0103] (5) Box object TO1 is placed as the target object. Then, adjacent box objects TO1 are arranged along a single plane with gaps between them. Therefore, the view of the model space is improved in the direction perpendicular to the above plane, and the elements of the width, height, and depth of the space that are perpendicular to the above plane become easier to recognize. As a result, it becomes easier for the user to grasp the structure of the space. In addition, even if the differences in the exterior of adjacent box objects TO1 are small, it becomes easier for the user to grasp the position corresponding to the boundary of the unit area.

[0104] (6) If the box object TO1 is semi-transparent, the structure of the model space becomes more visible through the box object TO1. Therefore, it becomes easier for the user to understand the structure of the space.

[0105] (7) If a box object TO1 has a columnar shape similar to the unit region in plan view, the user can easily infer the position corresponding to the boundary of the unit region even if there is a gap between adjacent box objects TO1.

[0106] (4) The unit domain is defined by two-dimensional components, and the position of the box object TO1 in the model space is set according to the measurement position of the object to be visualized in the target space, in a direction orthogonal to the unit domain. With this configuration, even if the unit domain is two-dimensional, the position of the box object TO1 reflects the distribution of the object to be visualized in the target space, taking into account three-dimensional elements. Therefore, the user can grasp the distribution of the object to be visualized more accurately.

[0107] (9) If the target object consists of a box object TO1 and a particle object TO2, and these objects represent the same visualization target, the distribution of the visualization target will be easier for the user to understand, and multiple visualization targets can also be accurately represented. Furthermore, the overall design of the target object can be enhanced.

[0108] (10) In recent years, the opportunities to use radio waves have increased due to advancements in technologies such as communications, radar, and sensors. Furthermore, the importance of visualizing radio wave conditions has increased due to the spread of wireless communication, the allocation of new frequency bands, the introduction of new communication standards, and the development of radar and sensor use in automotive systems. Therefore, the usefulness of the visualization system 100 increases when the object of visualization is a characteristic of radio waves. In particular, the usefulness of the visualization system 100 increases even more when the object of visualization is a characteristic of either radio waves used for communications or radio waves used for radar or sensors.

[0109] (11) Because the model space is a virtual space that represents the target space using a three-dimensional model, users can accurately grasp the structure of the target space through images of the model space. Furthermore, it is easy to balance the colors, overlaps, and other aspects of each object, including objects TO1, TO2, and the structural objects corresponding to the target space.

[0110] [Differentiation] The above embodiment can be implemented with the following modifications. The above embodiment and the following modifications can be combined with each other to the extent that they do not contradict each other technically.

[0111] The target object placed in model space may be either a box object TO1 or a particle object TO2. Furthermore, depending on user instructions, the target object placed in model space—in other words, the target object displayed in the model space image—may be switchable between two or more of the following: box object TO1 only, particle object TO2 only, or a combination of box object TO1 and particle object TO2.

[0112] Furthermore, the display unit 15 may allow switching between an image of the model space and an image in which the magnitude of the values ​​to be visualized is superimposed on the planar structure of the model space, according to the user's instructions. In other words, the distribution of the visualized objects may be switchable between a three-dimensional display and a two-dimensional display.

[0113] • A simulation such as ray tracing may be used to generate the unit domain data 13b. In this case, the measurement device 20 may collect information about the structure within the target space necessary for the simulation, in addition to, or instead of, the actual measurement of the object to be visualized. The measurement device 20 only needs to be equipped with measuring instruments appropriate to the object to be measured.

[0114] Furthermore, if the information necessary for the simulation can be obtained without performing measurements, the measurement device 20 does not need to be used. In other words, the visualization system 100 does not need to be equipped with the measurement device 20.

[0115] Furthermore, the measuring device 20 may collect data used to derive the visualization target in the target space, and the visualization target may be derived from this data by the measuring device 20 or the visualization processing device 10. Then, the visualization processing device 10 can generate unit area data 13b based on the derived visualization target.

[0116] • At least a portion of the three-dimensional space in which the target object is placed may use images from the real world, etc. In other words, the three-dimensional space in which the target object is placed does not have to be a virtual space composed entirely of three-dimensional models.

[0117] The control unit 12 may switch the visualization target among multiple characteristics. The control unit 12 may switch the visualization target according to instructions from the user, or it may switch the visualization target when conditions such as the elapsed of a predetermined time are met.

[0118] The objects to be visualized may be the characteristics of objects that propagate or are distributed in three-dimensional space, in addition to the objects exemplified in the above embodiments. For example, the objects to be visualized may be characteristics such as volume and pitch in sound, characteristics such as temperature in heat, characteristics such as wind speed in wind, or characteristics such as odor index in smell.

[0119] The visualization processing device 10 only needs to have the functionality of the visualization data generation unit 12b in the control unit 12. For example, if the visualization processing device 10 is a server, the functions of the display processing unit 12c, the operation unit 14, and the display unit 15 may be handled by a display terminal separate from the visualization processing device 10. The display terminal may be, for example, a personal computer or a smartphone. Alternatively, for example, if the visualization processing device 10 is a server, it may acquire unit area data 13b from an external device such as a personal computer and generate visualization data 13d. The display of the image based on the visualization data 13d may then be performed by an external device. Furthermore, the visualization processing device 10 may be implemented by multiple computer devices. [Explanation of symbols]

[0120] MS1...Model Space TO1... Box object TO2... Particle Object 10…Visualization Processing Device 20... Measuring device 100…Visualization System

Claims

1. The system includes a control unit that generates data in which, based on data of objects to be visualized for each unit region in real space, target objects, which are objects representing the objects to be visualized, are placed in regions corresponding to each unit region in a three-dimensional space corresponding to the real space. The aforementioned target object is granular and moves within a range set for each region corresponding to the unit region in the three-dimensional space. Information processing device.

2. The number of target objects in each region corresponding to the aforementioned unit region is two or more. The information processing apparatus according to claim 1.

3. At least one of the number of target objects in each region corresponding to the unit region, the appearance of the target objects, and the behavior of the target objects indicates the magnitude of the value of the visualization target. The information processing apparatus according to claim 1.

4. The aforementioned target object represents a plurality of the aforementioned visualization targets. The information processing apparatus according to claim 1.

5. The appearance of the target object and the behavior of the target object indicate different magnitudes of the values ​​of the visualized object. The information processing apparatus according to claim 1.

6. The aforementioned three-dimensional space is a virtual space that represents the real space using a three-dimensional model. The information processing apparatus according to claim 1.

7. The object to be visualized is a characteristic related to radio waves. The information processing apparatus according to claim 1.

8. The aforementioned radio waves are either radio waves used for communications, or radio waves used for radar or sensors. The information processing apparatus according to claim 7.

9. The appearance of the target object indicates the magnitude of the characteristics related to the propagation of radio waves as the object to be visualized, and the behavior of the target object indicates the magnitude of the characteristics related to communication using the radio waves as the object to be visualized. The information processing apparatus according to claim 1.

10. The aforementioned target object is the first object, The control unit generates data in which, in addition to the first object, a second object which is a target object representing the object to be visualized is placed in the region corresponding to each unit region in the three-dimensional space, The second object is a stationary object, one of which is placed in each region corresponding to the unit region. The information processing apparatus according to claim 1.

11. One or more computers, An information processing method that generates data in which, based on data of objects to be visualized for each unit region in real space, target objects, which are objects representing the objects to be visualized, are placed in regions corresponding to each unit region in a three-dimensional space corresponding to the real space, The aforementioned target object is granular and moves within a range set for each region corresponding to the unit region in the three-dimensional space. Information processing methods.

12. On one or more computers, A program that generates data in which, based on data of objects to be visualized for each unit region in real space, target objects, which are objects representing the objects to be visualized, are placed in regions corresponding to each unit region in a three-dimensional space corresponding to the real space, The aforementioned target object is granular and moves within a range set for each region corresponding to the unit region in the three-dimensional space. program.

Images