Information processing device, information processing method, program, and recording medium

Abstract

In this invention, on the basis of data of an element to be visualized in each unit region within a real space, a control unit provided for an information processing device generates data in which an object representing the element to be visualized is disposed in a region corresponding to each unit region within a three-dimensional space corresponding to the real space. One object each is disposed in each of the regions corresponding to the unit regions. Any set of objects positioned adjacent to each other are arranged at an interval along a single plane. The exterior of each object indicates the magnitude of the value of the element to be visualized.

Description

Information processing device, information processing method, program, and recording medium

[0001] The present disclosure relates to an information processing device, an information processing method, a program, and a recording medium.

[0002] Attempts have been made to visually grasp the status of invisible objects such as radio waves and heat spreading in three-dimensional space, i.e., to visualize them. For example, in the systems disclosed in Patent Documents 1 to 3, electric field strength, which is a characteristic related to radio wave propagation, is displayed using a heat map or contour lines on a plan view showing the layout of structures in space.

[0003] International Publication No. 2023 / 248763 International Publication No. 2021 / 131308 International Publication No. 2020 / 183967

[0004] As described above, the method of overlaying a visualized object on a floor plan has the problem of making it difficult to grasp the three-dimensional structure of the space. Therefore, overlaying a visualized object on a space represented using a three-dimensional model has been considered. However, overlaying a display showing a visualized object on a three-dimensional space significantly reduces the visibility of the space, which ultimately makes it difficult to grasp the structure of the space. Therefore, there is a need to display a visualized object in a way that makes it easier to grasp at least one of the basic elements of spatial recognition: width, height, and depth.

[0005] One aspect of an information processing device includes a control unit that generates data in which target objects, which are objects representing the visualization target, are placed in areas corresponding to each unit area in a three-dimensional space corresponding to the real space, based on data of the visualization target for each unit area in the real space, and the target objects are placed one per area corresponding to the unit area, and adjacent target objects are arranged along a single plane with gaps between them, and the exterior of the target objects indicates the magnitude of the value of the visualization target.

[0006] One aspect of the information processing method is an information processing method in which one or more computers generate data in which target objects, which are objects representing the visualization target, are placed in areas corresponding to each unit area in a three-dimensional space corresponding to the real space, based on data of the visualization target for each unit area in the real space, wherein the target objects are placed one for each area corresponding to the unit area, adjacent target objects are arranged along a single plane with gaps between them, and the exterior of the target objects indicates the magnitude of the value of the visualization target.

[0007] One aspect of the program is a program that causes one or more computers to execute the following: based on data of a visualization target for each unit area in real space, data in which target objects, which are objects representing the visualization target, are placed in areas corresponding to each unit area in a three-dimensional space that corresponds to the real space; the target objects are placed one for each area corresponding to the unit area, adjacent target objects are arranged along a single plane with gaps between them, and the exterior of the target objects indicates the magnitude of the value of the visualization target.

[0008] FIG. 1 is a diagram illustrating an overall configuration of a visualization system and a functional configuration of a visualization processing device according to an embodiment. FIG. 2 is a diagram illustrating a hardware configuration of the visualization processing device according to an embodiment. FIG. 3 is a flowchart illustrating a processing procedure of the visualization system according to an embodiment. FIG. 4 is a diagram illustrating a configuration of a unit area according to an embodiment. FIG. 5 is a diagram illustrating an example of a space in which target objects according to an embodiment are arranged. FIG. 6 is a diagram illustrating a configuration of a box object according to an embodiment. FIG. 7 is a diagram illustrating a configuration of a particle object according to an embodiment. FIG. 8 is a diagram illustrating a configuration in which a box object and a particle object are combined according to an embodiment. FIG. 9 is a diagram illustrating another example of a space in which target objects according to an embodiment are arranged.

[0009] The phrase "at least one" as used herein means "one or more" of the desired options. As an example, the phrase "at least one" as used herein means "only one option" or "both of two options" when the number of options is two. As another example, the phrase "at least one" as used herein means "only one option" or "any combination of two or more options" when the number of options is three or more.

[0010] With reference to the drawings, an embodiment of a visualization system will be described as an embodiment of an information processing device, an information processing method, a program, and a recording medium. [Overall Configuration of Visualization System] With reference to FIG. 1 , the overall configuration of the visualization system 100 will be described. The visualization system 100 is a system for visually showing the distribution of characteristics of an invisible object spreading in a three-dimensional space. In a broad sense, the visualization system 100 is a system for visually showing the characteristics of an object in a three-dimensional space that is difficult for a user to directly recognize. In this embodiment, an example in which characteristics related to radio waves are to be visualized will be mainly described.

[0011] The radio waves may be radio waves for information communication or radio waves used for radars and sensors, such as radars and sensors used to realize highly automated driving, radars and sensors used in automobile safety equipment such as collision prevention and advanced driver assistance systems (ADAS), radars and sensors used in systems such as automobile parking assistance, radars and sensors used in medical care and life support, and radars and sensors used in smart offices.

[0012] For radio waves for communication, specific examples of visualization targets include characteristics related to radio wave propagation, such as field strength and received power, and characteristics related to communication using radio waves, such as communication speed. For radio waves used for radar, specific examples of visualization targets include characteristics of the radar, such as field strength, power, phase, polarization angle, and frequency, characteristics of the radio waves received by each receiving antenna in a radar with multiple receiving antennas, such as the degree of radio wave interference in an environment where multiple radars are used, etc.

[0013] The visualization target may also be a characteristic derived by processing information acquired by a radar or a sensor. For example, the visualization target may be a characteristic related to an object detected by a radar or a sensor. Specific examples of such visualization targets include characteristics such as the distance and speed from a reference position of an object detected by a radar or a sensor, the distance and speed from a reference position of the protected object and other objects when the radar or a sensor is used to observe the surrounding conditions of the protected object such as a vehicle, and the degree of danger calculated from the traveling direction of the protected object. Note that only one characteristic may be the visualization target, or two or more characteristics may each be the visualization target.

[0014] 1, the visualization system 100 includes a visualization processing device 10 and a measurement device 20. The visualization processing device 10 is an example of an information processing device.

[0015] The measurement device 20 measures the visualization target in a target space, which is a three-dimensional real space. The target space may be indoors or outdoors. The measurement device 20 may be configured to be movable, and measure the visualization target at multiple points by repeating movement and measurement. Alternatively, the measurement device 20 may measure the visualization target at a fixed point. Furthermore, the visualization system 100 may include multiple measurement devices 20, and these measurement devices 20 may work together to measure the visualization target at multiple points.

[0016] The measurement device 20 may include measuring equipment appropriate for the visualization target. For example, if the visualization target is a characteristic related to radio waves for communication, the measurement device 20 may include an area tester, a spectrum analyzer, an antenna, a network tester, a wireless router, etc. Alternatively, if the visualization target is a characteristic related to radio waves used for radar, the measurement device 20 may include a spectrum analyzer, an antenna, etc. Alternatively, if the visualization target is a characteristic derived by processing information acquired by radar or a sensor, the measurement device 20 may be a radar or a sensor.

[0017] The measurement device 20 may also include a computer device for measuring the visualization target and processing the measurement results. The computer device includes one or more processors, one or more memories, and a communication interface.

[0018] Measurement data indicating the measurement results by the measurement device 20 is sent from the measurement device 20 to the visualization processing device 10. The measurement device 20 and the visualization processing device 10 may be connected via a network such as the Internet or an intranet, or may be connected to each other by wire or wirelessly. The measurement device 20 may be equipped with a communication interface according to the communication means used. Furthermore, a relay device may be used for transmitting data between the measurement device 20 and the visualization processing device 10.

[0019] The visualization processing device 10 generates visualization data, which is data for combining and displaying a three-dimensional model representing a target space and an object representing a visualization target, based on the measurement data. The visualization processing device 10 then displays an image based on the visualization data. The visualization processing device 10 is a computer device such as a personal computer.

[0020] [Configuration of the visualization processing device] The detailed configuration of the visualization processing device 10 will be described with reference to Figures 1 and 2. First, the functional configuration of the visualization processing device 10 will be described with reference to Figure 1.

[0021] The visualization processing device 10 includes a communication unit 11, a control unit 12, a storage unit 13, an operation unit 14, and a display unit 15. The communication unit 11 performs communication processing between the visualization processing device 10 and the measurement device 20. The operation unit 14 accepts operations by a user and sends data and signals corresponding to the operations to the control unit 12. The display unit 15 receives data and signals from the control unit 12 and displays an image.

[0022] The control unit 12 executes the programs stored in the storage unit 13 to function as a unit area data generation unit 12a, a visualization data generation unit 12b, and a display processing unit 12c.

[0023] The unit area data generator 12a uses the measurement data 13a acquired from the measurement device 20 to generate unit area data 13b, which is data on the visualization target for each unit area in the target space. The measurement data 13a is a collection of measurement results of the visualization target associated with a position in the target space. The unit area data 13b is generated from the measurement data 13a, which is this distributed data. Various statistical processes may be used to generate the unit area data 13b from the measurement data 13a. Furthermore, a machine learning model may be used to generate the unit area data 13b.

[0024] The unit area data 13b may be data on the value of the visualization target for each unit area, or data on the degree of the visualization target for each unit area. The degree of the visualization target indicates the magnitude of the value of the visualization target by a classification, that is, indicates which of a plurality of levels the degree of the visualization target, such as high / low or strength, falls into.

[0025] A unit area is an area consisting of a plane or space. The entire set of unit areas may be at least a part of the target space. In other words, a unit area may be set for at least a part of the target space. Furthermore, a unit area may be a planar area defined by components of two of the three axes constituting a Cartesian coordinate system set for the target space, i.e., a two-dimensional area. For example, if a Cartesian coordinate system consisting of x-, y-, and z-axes, with the vertical direction being the z-axis, is set for the target space, a unit area may be an area defined by the x-component and the y-component.

[0026] The multiple unit areas are arranged along at least one plane. The multiple unit areas may be arranged two-dimensionally or three-dimensionally. For example, the multiple unit areas may be arranged two-dimensionally along a horizontal plane, or three-dimensionally along a horizontal plane and a vertical plane. On the plane along which the multiple unit areas are arranged, the multiple unit areas are arranged in a two-dimensional lattice pattern. Examples of two-dimensional lattices include a square lattice, a triangular lattice, and a hexagonal lattice. The shape of the unit areas along the plane may be any polygon. If the multiple unit areas are arranged in a square lattice pattern along at least one plane and the shape of the unit areas along the plane is square, the shape and arrangement of the unit areas are prevented from becoming complex, thereby reducing the load of calculations related to the unit areas. The size of the unit area may be, for example, the size that one person can occupy when stationary. In one example, the unit area is 1 m ２ It is a planar area of ​​about the size of

[0027] The visualization data generator 12b generates visualization data 13d using the unit area data 13b and spatial data 13c, which is data representing a target space using a three-dimensional model. The space constructed using the three-dimensional model is a model space. In other words, the model space is a virtual three-dimensional space that simulates the target space, which is a real space, using a three-dimensional model. The spatial data 13c includes information on a three-dimensional Cartesian coordinate system set for the model space, position information of objects representing structures to be placed in the model space, and information for drawing. Positions in the model space are associated with positions in the target space.

[0028] The visualization data generator 12b generates the visualization data 13d so that an object corresponding to the visualization target of each unit area is placed at a position corresponding to each unit area in the model space. The object representing the visualization target is the target object.

[0029] The target objects include a box object, which is a geometric solid arranged one per unit area, and a particle object, which is a particle-like object. The box object is an example of a first object, and the particle object is an example of a second object.

[0030] The visualization data generator 12b sets the configuration of the target object so that at least one of the appearance and behavior of the target object indicates the magnitude of the value of the visualization target. The visualization target may indicate the magnitude of the value of the visualization target by its appearance or behavior corresponding one-to-one to the value of the visualization target, such as by using colors for each value. Alternatively, the visualization target may indicate the magnitude of the value of the visualization target as a degree by its appearance or behavior corresponding one-to-one to a category indicating the degree of the visualization target. In this way, the visualization data 13d is data of a model space in which the target object is arranged.

[0031] The display processing unit 12c performs drawing processing using the visualization data 13d, thereby displaying an image on the display unit 15. As a result, an image of the model space in which the target object is arranged is displayed on the display unit 15.

[0032] The storage unit 13 stores various programs and data necessary for the control unit 12 to execute processing. The storage unit 13 stores, as examples of such data, the measurement data 13a, the unit area data 13b, the space data 13c, and the visualization data 13d described above. As described above, the measurement data 13a is data acquired from the measurement device 20, and the unit area data 13b and the visualization data 13d are data generated by the visualization processing device 10.

[0033] The spatial data 13c is generated, for example, based on three-dimensional measurement of the target space performed by a known method. The generation of the spatial data 13c may be performed by the visualization processing device 10, or may be performed by a device different from the visualization processing device 10. Furthermore, the three-dimensional measurement of the target space may be performed by the measurement device 20, or may be performed by a device different from the measurement device 20. When the measurement device 20 performs three-dimensional measurement of the target space, this three-dimensional measurement may be performed at the same time as the measurement of the visualization target, or may be performed at a different time from the measurement of the visualization target. When the measurement device 20 performs three-dimensional measurement, it is sufficient that the measurement device 20 is equipped with measuring equipment such as sensors according to the three-dimensional measurement method.

[0034] The physical configuration, i.e., the hardware configuration, of the visualization processing device 10 having the above functions will be described with reference to Fig. 2. As shown in Fig. 2, the visualization processing device 10 includes one or more processors 111, one or more memories 112, one or more storages 113, one or more communication interfaces 114, one or more input devices 115, and one or more output devices 116.

[0035] The processor 111 loads the operating system and various programs from the storage 113 into the memory 112 and executes instructions retrieved from the memory 112. The processor 111 and the memory 112 implement the functions of the control unit 12, and the storage 113 implements the functions of the memory unit 13. Some of the functions of the memory unit 13 may be implemented by the memory 112.

[0036] The processor 111 may be a central processing unit (CPU), a graphics processing unit (GPU), an accelerated processing unit (APU), a neural network processing unit (NPU), a microprocessor, a microcontroller, a digital signal processor (DSP), a field programmable gate array (FPGA), a complex programmable logic device (CPLD), an application-specific integrated circuit (ASIC), other processors including general-purpose processors, or a combination thereof.

[0037] The memory 112 is a main storage device and may be a read only memory (ROM), a random access memory (RAM), a registered memory, an unbuffered memory, or the like.

[0038] The storage 113 is a non-transitory computer-readable medium that stores programs and data, and may be, for example, a solid state drive (SSD) or a hard disk drive (HDD).

[0039] The communication interface 114 may be a local area network (LAN), Wi-Fi (registered trademark), Bluetooth (registered trademark), or other wireless communication interface. The communication interface 114 realizes the functions of the communication unit 11.

[0040] The input device 115 includes a mouse, a keyboard, a touch panel, etc., and realizes the functions of the operation unit 14. The output device 116 includes a display panel such as a liquid crystal panel, and realizes the functions of the display unit 15.

[0041] Each process performed by the visualization processing device 10 may be executed by software included in the visualization processing device 10, or by a combination of hardware and software included in the visualization processing device 10. That is, the visualization processing device 10 may be configured as a circuit including: 1) one or more processors operating according to a computer program (software); 2) one or more dedicated hardware circuits performing at least some of the various processes; or 3) a combination thereof. The processor may be configured to include a computing device such as a CPU and memory such as RAM and ROM. The memory stores program code or instructions configured to cause the computing device to perform the processes. The memory, i.e., computer-readable medium, is a non-transitory computer-readable medium and includes any available medium accessible by a general-purpose or dedicated computer.

[0042] 3 to 5, the processing flow of the visualization system 100 will be described. As shown in Fig. 3, first, in the target space, measurement of the visualization target is performed by the measurement device 20 (step S10). As a result, measurement data 13a is sent from the measurement device 20 to the visualization processing device 10.

[0043] After acquiring the measurement data 13a, the visualization processing device 10 generates unit area data 13b (step S20). Fig. 4 shows an example of a unit area UT1 set in the target space TS1, along with a plan view of the target space TS1. In the example shown in Fig. 4, the unit area UT1 is a two-dimensional area along a horizontal plane and has a square shape. Multiple unit areas UT1 are arranged without gaps in a square lattice pattern.

[0044] After generating the unit area data 13b, the visualization processing device 10 generates visualization data 13d (step S30).The visualization processing device 10 then uses the visualization data 13d to display an image of the model space in which the target object is placed (step S40).

[0045] 5 shows an example of a model space MS1 in which target objects are arranged. In the model space MS1, fixed objects FO1, which are objects representing structures such as fixtures and furniture in the target space, are arranged in correspondence with the shapes and arrangement of the structures. Furthermore, target objects, namely, a box object TO1 and a particle object TO2, are arranged in areas corresponding to the unit areas. For example, if the unit area UT1 is a two-dimensional area along a horizontal plane as shown in FIG. 4, a target object corresponding to the visualized target in the unit area UT1 is arranged in an area whose position in the horizontal plane coincides with the unit area UT1.

[0046] It should be noted that the target object does not have to be located in the area where the fixed object FO1 is located. This configuration makes it easier for a user viewing the image in the model space to grasp the location and shape of the fixed object FO1.

[0047] The viewpoint in the image of the model space MS1 may be changeable in response to a user instruction, which is input to the visualization processing device 10 through the user's operation on the operation unit 14.

[0048] [Configuration of Target Objects] The detailed configuration of the target objects will be described with reference to Figures 6 to 8. Figures 6 to 8 are diagrams showing excerpts of target objects corresponding to four unit areas arranged in a square lattice pattern. Figure 6 shows only the box object TO1, Figure 7 shows only the particle object TO2, and Figure 8 shows both the box object TO1 and the particle object TO2. In the following description, in the three-dimensional orthogonal coordinate system set for the model space MS1, the axis corresponding to the vertical direction is the z-axis, and the axes corresponding to the horizontal direction are the x-axis and y-axis.

[0049] <Box Object> As shown in Fig. 6, one box object TO1 is placed for each unit area. The position of the box object TO1 is fixed, in other words, the box object TO1 is stationary.

[0050] Adjacent box objects TO1 are arranged along a reference plane, which is a plane, with a gap G1 between them. The reference plane corresponds to the plane along which the unit area is aligned. The reference plane is preferably a horizontal or vertical plane. For example, if the unit area is a two-dimensional area aligned along a horizontal plane, the reference plane is a plane aligned along the xy plane, as in the example shown in FIG. 6. In this case, the direction perpendicular to the reference plane is the z direction.

[0051] The gap G1 between adjacent box objects TO1 improves visibility of the model space MS1 in the direction perpendicular to the reference plane. For example, if the reference plane is a surface along the xy plane, a user viewing an image of the model space MS1 can see part of the floor or ceiling of the model space MS1 directly through the gap G1, rather than through an object. This allows the user to accurately recognize the height of the model space MS1, making it easier to grasp the structure of the space.

[0052] The box object TO1 is set to indicate the magnitude of the value to be visualized by its exterior. The exterior is a visual feature that appears on the surface of the box object TO1, and includes color, light behavior such as gloss, texture, pattern, etc. Color includes attributes such as hue, saturation, and brightness. The exterior is an element that can be controlled by setting the material and texture of the object.

[0053] In one example, if the object to be visualized is received power, the box object TO1 may indicate the magnitude of the value of the object to be visualized by color, such that a stronger reddish tinge indicates a higher received power and a stronger blue tinge indicates a lower received power.

[0054] Since a gap G1 is provided between adjacent box objects TO1, the user can easily grasp the position corresponding to the boundary of the unit area even when the difference in the exterior of adjacent box objects TO1 is small, such as when the magnitude of the values ​​to be visualized in adjacent unit areas is close.

[0055] The box object TO1 may also indicate the magnitude of two types of values ​​to be visualized by using two elements of its exterior. For example, the color may indicate the reception strength, and the pattern may indicate the communication speed.

[0056] It is preferable that the box object TO1 is semi-transparent. "Semi-transparent" means that the transparency set for the object is between 30% and 70%. By making the box object TO1 semi-transparent, the floor, walls, fixed objects, etc. of the model space MS1 can be easily seen through the box object TO1. This also makes it easier for the user to grasp the structure of the space.

[0057] The planar shape of the box object TO1 as viewed from a position facing the reference plane is preferably a polygon or a circle, and more preferably a shape similar to the unit area as viewed from the same direction. For example, if the unit area is square, the planar shape of the box object TO1 is also preferably square. If the planar shape of the box object TO1 is similar to the unit area, even if there is a gap G1 between adjacent box objects TO1, the user can easily estimate the position corresponding to the boundary of the unit area.

[0058] It is preferable that the cross-sectional shape of the box object TO1 along the reference plane is constant. That is, it is preferable that the box object TO1 has a cylindrical shape. This configuration also makes it easy to estimate the position corresponding to the boundary of the unit area.

[0059] The thickness t1, which is the length of the box object TO1 in the direction perpendicular to the reference plane, is preferably smaller than the maximum width of the box object TO1 in the direction along the reference plane. This configuration prevents the box object TO1 from obstructing the model space MS1 more than necessary, making it easier for the user to grasp the structure of the space.

[0060] The width w1 of the gap G1 in the direction along the reference plane is preferably greater than one-third of the thickness t1 of the box object TO1. This prevents the box object TO1 from blocking the view from the gap G1. This makes it easier to directly view the model space MS1 from the gap G1.

[0061] Furthermore, it is preferable that the width w1 of the gap G1 be smaller than 1 / 3 of the maximum width of the box object TO1 in the direction along the reference plane, so that the box object TO1 does not become too small relative to the gap G1, thereby accurately fulfilling its function of representing the visualization target.

[0062] In a direction perpendicular to the reference plane, the box object TO1 is preferably spaced apart from the inner surfaces of the model space MS1. For example, if the reference plane is a surface along the xy plane, the box object TO1 is preferably spaced apart from both the floor and ceiling surfaces. This configuration makes it easier for the user to visually recognize the surfaces that define the width, depth, and height of the model space MS1, making it easier for the user to grasp the structure of the space.

[0063] The position of the box object TO1 in a direction perpendicular to the reference plane may be determined according to the measurement position of the visualization target. For example, if the unit area is a two-dimensional area along a horizontal plane, the x- and y-coordinates of the box object TO1 are determined according to the position of the unit area. In this case, the vertical position of the box object TO1, i.e., the z-coordinate, may be set to the height at which the measurement device 20 measures the visualization target.

[0064] According to the above configuration, even if the unit area is two-dimensional, the position of the box object TO1 reflects the distribution of the visualization targets in the target space, taking into account three-dimensional elements, thereby allowing the user to more accurately grasp the distribution of the visualization targets.

[0065] <Particle Object> As shown in Fig. 7, one or more particle objects TO2 are placed in each unit area, and move within a movement range RA1 for each unit area. In Fig. 7, the movement path of a part of the particle object TO2 in the movement range RA1 located in the foreground is indicated by an arrow.

[0066] The shape of the particle object TO2 is not limited to a sphere, and may be a three-dimensional shape surrounded by curved or flat surfaces. Furthermore, the particle object TO2 may be planar, like a piece of paper. When the particle object TO2 is planar, the object can be made more visible to the user by, for example, rotating the orientation of the plane when moving the object within the movement range RA1, or by controlling the orientation of the object so that the plane always faces the user. Furthermore, by making the particle object TO2 a shape of crossed flat surfaces, the object becomes three-dimensional and more easily visible.

[0067] The movement range RA1 is set for each unit area in the area corresponding to the unit area in the model space MS1 and its vicinity so as not to overlap with other movement ranges RA1. For example, if the unit area is a two-dimensional area along a horizontal plane, the movement range RA1 of the particle object TO2 corresponding to the unit area is set within the area in the model space MS1 having x and y coordinates corresponding to the unit area. In the example shown in Figure 7, the movement range RA1 is a rectangular parallelepiped range extending in the z direction from the plane within the area corresponding to the unit area.

[0068] Furthermore, for example, if the unit area is an area consisting of a three-dimensional space, a movement range RA1 of the particle object TO2 corresponding to the unit area may be set within an area in the model space MS1 corresponding to the unit area.

[0069] Because the particle object TO2 moves, it is possible to prevent a specific area of ​​the model space MS1 from being continuously blocked by the particle object TO2. This improves visibility of the model space MS1 even from a single viewpoint, making it easier for the user to grasp the structure of the space. In the example shown in Figure 7, the movement of the particle object TO2 allows the user to accurately recognize the depth and height of the space.

[0070] The particle objects TO2 are set to indicate the magnitude of the value to be visualized by at least one of the number per unit area, their appearance, and their behavior. The number per unit area is the number of particle objects TO2 moving within one movement range RA1. The number per unit area is preferably two or more. If the number per unit area is two or more, the appearance and behavior of the particle objects TO2 can be easily grasped even if they are small, and therefore it is possible to reduce the area obstructed by one particle object TO2 and improve visibility into the model space MS1.

[0071] The appearance of the particle object TO2 includes the shape of the object, the size of the object, the color of the object, the transparency of the object, the glossiness of the object, whether the object emits light, and the amount of light emitted.

[0072] The behavior of the particle object TO2 includes the object's movement speed, object movement direction, and the shape and size of the movement range RA1. The particle object TO2 may continue to exist within the movement range RA1. Alternatively, the particle object TO2 may appear from a specific area within the movement range RA1 and disappear after a predetermined time has passed or after moving to a predetermined area within the movement range RA1. In this configuration, the behavior of the particle object TO2 also includes the shape and size of the area in which the particle object TO2 appears and the lifetime, which is the time from when the particle object TO2 appears until when it disappears.

[0073] The behavior of the particle object TO2 also includes whether or not the objects collide with each other and the behavior upon collision, such as disappearance, bouncing, etc.

[0074] A plurality of visualization targets may be represented by a plurality of the above elements. In particular, it is preferable that two of the number of particle objects TO2 per unit area, their appearance, and their behavior indicate the magnitude of the value of each visualization target. For example, the color of the particle object TO2 is set to indicate the magnitude of the received power, and the movement speed of the particle object TO2 is set to indicate the magnitude of the communication speed. The appearance and behavior of the particle object TO2 are elements that are easy for a user to distinguish without confusing them. Therefore, if the appearance and behavior are set to indicate the magnitude of the values ​​of different visualization targets, the user can accurately grasp the status of the plurality of visualization targets.

[0075] Among the number, appearance, and behavior of the particle objects TO2 per unit area, elements that do not indicate the magnitude of the value to be visualized may be set arbitrarily.

[0076] As shown in Fig. 8, when a box object TO1 and a particle object TO2 are arranged as target objects, for example, the box object TO1 and the particle object TO2 corresponding to the same unit area are arranged so that they are aligned in a direction perpendicular to the reference plane. In Fig. 8, the objects TO1 and TO2 corresponding to the same unit area are aligned in the z direction.

[0077] The movement range of the particle object TO2 is set, for example, to the area on the top surface of the box object TO1. The top surface of the box object TO1 is the surface along the reference plane that faces a wider space.

[0078] This arrangement prevents the box object TO1 and the particle object TO2 from obscuring each other, reducing the visibility of the objects TO1 and TO2. The visualized object represented by the box object TO1 and the visualized object represented by the particle object TO2 may be the same or different. For example, if the same elements in the objects TO1 and TO2 represent the same visualized object, such as when the color of the box object TO1 and the color of the particle object TO2 indicate the magnitude of the value of the same visualized object, the user can easily understand the status of the visualized object. In one example, the color of the box object TO1 and the color of the particle object TO2 are set to indicate the magnitude of the received power, and the movement speed of the particle object TO2 is set to indicate the magnitude of the communication speed. In this case, the colors of the box object TO1 and the particle object TO2 corresponding to the same unit area are the same.

[0079] FIG. 9 shows another example of a model space MS1 in which a target object is placed. FIG. 9 shows an example in which the electric field strength of radio waves from an automotive radar such as a millimeter-wave radar is visualized, with the color of objects TO1 and TO2 indicating the magnitude of the electric field strength. An object FO2 representing a stationary or moving structure may be placed in the model space MS1. From FIG. 9 , it can be seen that the radio waves propagate in a fan shape from the installation position of the automotive radar, with the electric field strength weakening as the distance from the installation position of the automotive radar increases. In this way, if the characteristics of the radio waves from an automotive radar are visualized, it is easy to determine whether the radio wave spread and intensity distribution are appropriate for an automotive radar used in driving assistance systems such as collision prevention and autonomous driving systems.

[0080] [Changing Settings of Target Object] The configuration of the target object may be changeable in response to a user instruction. The user instruction is input to the visualization processing device 10 through an operation by the user on the operation unit 14. The control unit 12 then generates visualization data 13d by setting the target object in accordance with the user instruction.

[0081] For example, when the magnitude of a value to be visualized is represented by the color of a target object, the color map to be used may be set according to a user's instruction. For example, a color map to be used as the color of the target object may be selected from a plurality of color maps, such as a color map consisting of multiple hues or a color map that mainly differs in brightness. Also, grayscale may be selectable as the color of the object.

[0082] Furthermore, among the elements of the target object described above as elements that can indicate the magnitude of the value of the visualization target, elements that are not used to indicate the magnitude of the value of the visualization target may be set in accordance with a user's instruction. For example, if the number and movement speed of particle objects TO2 per unit area are not used to indicate the magnitude of the value of the visualization target, these may be set in accordance with a user's instruction. Furthermore, even if these elements are used to indicate the magnitude of the value of the visualization target, the reference number and speed may be set in accordance with a user's instruction.

[0083] Furthermore, when the viewpoint set for the model space for generating the image of the model space is changed, the setting of the target object may be changed. For example, the width of the gap between the box objects TO1 may be changed according to the viewpoint so that the inside of the model space can be more easily seen through the gap.

[0084] As described above, according to this embodiment, the following effects can be obtained. (1) A box object TO1 is placed as a target object representing a visualization target. Adjacent box objects TO1 are then arranged along a single plane, with gaps between them. This improves visibility of the model space in directions perpendicular to the plane, making it easier to recognize elements of the width, height, and depth of the space that are aligned in directions perpendicular to the plane. This makes it easier for the user to grasp the structure of the space. Furthermore, even if the difference in the exterior appearance of adjacent box objects TO1 is small, the user can easily grasp the positions corresponding to the boundaries of the unit areas.

[0085] (2) If the box object TO1 is semi-transparent, the structure of the model space can be more easily seen through the box object TO1, making it easier for the user to grasp the structure of the space.

[0086] (3) If the box object TO1 has a cylindrical shape similar to the unit area in a planar view, even if there is a gap between adjacent box objects TO1, the user can easily guess the position corresponding to the boundary of the unit area.

[0087] (4) The unit area is an area defined by two-dimensional components, and the position of the box object TO1 in the model space is set according to the measurement position of the visualization target in the target space in a direction perpendicular to the unit area. With this configuration, even if the unit area is two-dimensional, the position of the box object TO1 reflects the distribution of the visualization target in the target space, taking into account three-dimensional elements. Therefore, the user can more accurately grasp the distribution of the visualization target.

[0088] (5) A particle object TO2 is placed as a target object. Because the particle object TO2 moves, it is possible to prevent a specific area of ​​the model space from being continuously blocked by the particle object TO2. This improves visibility of the model space even from a single viewpoint, making it easier to recognize the depth and height of the space. This makes it easier for the user to grasp the structure of the space.

[0089] (6) If the number of particle objects TO2 per unit area is two or more, the appearance and behavior of the particle objects TO2 can be easily grasped even if they are small. Therefore, it is possible to reduce the area obstructed by one particle object TO2 and improve visibility of the model space.

[0090] (7) If the particle object TO2 represents a plurality of visualization targets, it is possible to increase the amount of information about the visualization targets provided to the user while preventing the model space from being obstructed by an increase in the number of objects.

[0091] (8) The appearance and behavior of the particle object TO2 indicate the magnitude of the values ​​of the different visualization targets. With this configuration, the appearance and behavior, which are elements that are easy for the user to distinguish without confusion, indicate the magnitude of the values ​​of the different visualization targets, allowing the user to accurately grasp the status of multiple visualization targets.

[0092] In particular, if the appearance of the particle object TO2 indicates characteristics related to radio wave propagation and the behavior of the particle object TO2 indicates characteristics related to communication using radio waves, the user can intuitively grasp these visualized objects.

[0093] (9) If a box object TO1 and a particle object TO2 are arranged as target objects, and these objects represent the same visualization target, the user can easily grasp the distribution of the visualization target, and multiple visualization targets can be accurately represented. Furthermore, the design of the target object as a whole is improved.

[0094] (10) In recent years, opportunities for using radio waves have increased due to technological advances in communications, radar, sensors, and the like. Furthermore, the spread of wireless communications, new allocations of frequency bands, the introduction of new communication standards, and the development of radar and sensor use in automotive systems have made it increasingly important to visualize radio wave conditions. Therefore, the usefulness of the visualization system 100 increases when the visualization target is a characteristic related to radio waves. In particular, the usefulness of the visualization system 100 increases when the visualization target is a characteristic related to either radio waves used for communications or radio waves used for radar or sensors.

[0095] (11) Because the model space is a virtual space that represents the target space using a three-dimensional model, the user can accurately grasp the structure of the target space through an image of the model space. In addition, it is easy to balance the colors, overlaps, etc. of each object, including objects TO1 and TO2 and structural objects corresponding to the target space.

[0096] [Modifications] The above embodiment can be modified as follows: The above embodiment and the following modifications can be combined and implemented within the scope of technical compatibility.

[0097] The target object placed in the model space may be either a box object TO1 or a particle object TO2. Furthermore, in response to a user instruction, the target object placed in the model space, in other words, the target object displayed in the image of the model space, may be switchable between two or more of the box object TO1 only, the particle object TO2 only, and a combination of the box object TO1 and the particle object TO2.

[0098] Furthermore, the display on the display unit 15 may be switchable, in response to a user instruction, between an image of the model space and an image in which a display indicating the magnitude of the value of the visualization target is superimposed on the planar structure of the model space. That is, the distribution of the visualization target may be switchable between a three-dimensional display and a two-dimensional display.

[0099] A simulation such as a ray tracing method may be used to generate the unit area data 13b. In this case, the measurement device 20 may collect information on the structure within the target space required for the simulation, in addition to or instead of actually measuring the visualization target. The measurement device 20 may be equipped with measuring instruments appropriate for the measurement target.

[0100] Furthermore, in cases where the information required for the simulation can be obtained without performing measurements, the measurement does not need to be performed by the measuring device 20. In other words, the visualization system 100 does not need to include the measuring device 20.

[0101] Furthermore, the measurement device 20 may collect data in the target space to be used for deriving the visualization target, and the measurement device 20 or the visualization processing device 10 may derive the visualization target from this data. Then, the visualization processing device 10 may generate the unit area data 13b based on the derived visualization target.

[0102] An image of a real space may be used for at least a part of the three-dimensional space in which the target object is placed. In other words, the three-dimensional space in which the target object is placed does not have to be a virtual space entirely composed of a three-dimensional model.

[0103] The visualization target may be switched among a plurality of characteristics by the control unit 12. The control unit 12 may switch the visualization target in accordance with an instruction from the user, or may switch the visualization target when a condition such as the passage of a predetermined time is met.

[0104] The visualization target may be the target exemplified in the above embodiment, or may be the characteristics of a target propagating or distributed in three-dimensional space. For example, the visualization target may be a characteristic of sound such as volume or pitch, a characteristic of heat such as temperature, a characteristic of wind such as wind speed, or a characteristic of smell such as an odor index.

[0105] The visualization processing device 10 only needs to have at least the functions of the visualization data generation unit 12b in the control unit 12. For example, the visualization processing device 10 may be a server, and the functions of the display processing unit 12c, the operation unit 14, and the display unit 15 may be performed by a display terminal separate from the visualization processing device 10. The display terminal may be, for example, a personal computer or a smartphone. Alternatively, for example, the visualization processing device 10 may be a server that acquires unit area data 13b from an external device such as a personal computer and generates visualization data 13d. An image based on the visualization data 13d may then be displayed by the external device. Alternatively, the visualization processing device 10 may be implemented by multiple computer devices.

Claims

1. An information processing device comprising: a control unit that generates data in which target objects, which are objects representing the visualization target, are placed in areas corresponding to each unit area in a three-dimensional space corresponding to the real space, based on data of the visualization target for each unit area in the real space; the target objects are placed one by one in each area corresponding to the unit area; adjacent target objects are arranged along a single plane with a gap between them; and the exterior of the target objects indicates the magnitude of the value of the visualization target.

2. The information processing device according to claim 1, wherein the target object is semi-transparent.

3. The information processing device according to claim 1, wherein the target object has a cylindrical shape similar to the unit area in a plan view.

4. An information processing device as described in claim 1, wherein the unit area is an area defined by two-dimensional components, and the position of the target object in the three-dimensional space is set according to the measured position of the visualization target in the real space in a direction perpendicular to the unit area.

5. The information processing device according to claim 1, wherein the three-dimensional space is a virtual space that represents the real space using a three-dimensional model.

6. The information processing device according to claim 1, wherein the visualization target is a characteristic related to radio waves.

7. The information processing device according to claim 6, wherein the radio waves are either radio waves used for communication or radio waves used for radar or sensors.

8. The information processing device of claim 1, wherein the target object is a first object, the control unit generates the data in which, in addition to the first object, a second object, which is a target object representing a target to be visualized, is placed in an area corresponding to each unit area in the three-dimensional space, and the second object is in the form of particles and moves within a range set for each area corresponding to the unit area in the three-dimensional space.

9. The information processing device according to claim 8, wherein the number of the second objects for each area corresponding to the unit area is two or more.

10. An information processing device as described in claim 8, wherein at least one of the number of the second objects per area corresponding to the unit area, the appearance of the second objects, and the behavior of the second objects indicates the magnitude of the value to be visualized.

11. The information processing device according to claim 8, wherein the second object represents a plurality of the visualization targets.

12. The information processing device according to claim 8, wherein the appearance of the second object and the behavior of the second object indicate different magnitudes of the values ​​of the visualization target.

13. An information processing device as described in claim 8, wherein the appearance of the second object indicates the magnitude of the characteristics related to the propagation of radio waves as the visualization target, and the behavior of the second object indicates the magnitude of the characteristics related to communication using radio waves as the visualization target.

14. An information processing method in which one or more computers execute the process of generating data in which target objects, which are objects representing the visualization target, are placed in areas corresponding to each unit area in a three-dimensional space corresponding to the real space, based on data of the visualization target for each unit area in the real space, wherein the target objects are placed one for each area corresponding to the unit area, adjacent target objects are arranged along a single plane with a gap between them, and the exterior of the target objects indicates the magnitude of the value of the visualization target.

15. A program that causes one or more computers to execute the following: based on data of a visualization target for each unit area in real space, data in which target objects that represent the visualization target are placed in areas corresponding to each unit area in a three-dimensional space that corresponds to the real space, wherein the target objects are placed one for each area corresponding to the unit area, adjacent target objects are arranged along a single plane with gaps between them, and the exterior of the target objects indicates the magnitude of the value of the visualization target.

16. A computer-readable recording medium on which the program according to claim 15 is recorded.

Images