Information processing device

Abstract

To restrain positional deviation between a real world and a virtual world in augmented reality.SOLUTION: An information processing device includes an acquisition unit that acquires vehicle body shape data indicating the shape of a vehicle body and coating agent shape data indicating the shape of a coating agent applied to the vehicle body, a pre-process unit that executes an emphasizing process of emphasizing a feature portion of the vehicle body in the vehicle body shape data, and a creation unit that creates augmented reality data using the coating agent shape data and the vehicle body shape data having undergone the emphasizing process such that the coating agent in a virtual world obtained by positioning based on the feature portion of the vehicle body in a real world and the feature portion of the vehicle body in the virtual world, is displayed so as to be superimposed on the vehicle body in the real world.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device. [Background technology]

[0002] A technique for processing product shape data has been disclosed (for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2011-186845 Summary of the Invention [Problem to be solved by the invention]

[0004] When aligning the real world and the virtual world in augmented reality so that the features of an object in the real world overlap with the features of an object in the virtual world, the features of the object in the virtual world may not be detected properly, resulting in a misalignment between the real world and the virtual world. [Means for solving the problem]

[0005] The present disclosure can be realized in the following forms.

[0006] (1) According to a first aspect of the present disclosure, there is provided an information processing device including: an acquisition unit that acquires vehicle body shape data representing a shape of a vehicle body and coating agent shape data representing a shape of a coating agent applied to the vehicle body, a preprocessing unit that performs an enhancement process on the vehicle body shape data to enhance characteristic features of the vehicle body, and a generation unit that uses the coating agent shape data and the vehicle body shape data after the enhancement process to generate augmented reality data that displays the coating agent in the virtual world, aligned with the characteristic features of the vehicle body in the real world and the characteristic features of the vehicle body in the virtual world, superimposed on the vehicle body in the real world. According to this type of information processing device, it is possible to suppress positional deviation between the real world and the virtual world. The present disclosure may be realized in various forms other than an information processing device, such as an information processing method, a computer program, or a recording medium on which a computer program is recorded. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is an explanatory diagram showing the configuration of an information processing apparatus. [Figure 2] 10 is a flowchart showing the contents of an augmented reality data generation process. [Figure 3] 10A and 10B are explanatory diagrams showing vehicle body shape data before and after enhancement processing; DETAILED DESCRIPTION OF THE INVENTION

[0008] A. First embodiment: FIG. 1 is an explanatory diagram showing the configuration of an information processing device 100 in a first embodiment. The information processing device 100 generates augmented reality data DT for supporting work by a worker WK using augmented reality. In this embodiment, the work to be supported is the application of a coating agent to the body BD of an automobile, and the coating agent is a sealant. Note that the coating agent is not limited to a sealant, and may be any substance that can be applied to the body BD by the worker WK. For example, the coating agent may be an adhesive.

[0009] The information processing device 100 is configured by a computer including a processor 101, a memory 102, an input / output interface 103, and an internal bus 104. The processor 101, the memory 102, and the input / output interface 103 are connected via the internal bus 104 so as to be able to communicate bidirectionally. The processor 101 executes a computer program PG pre-stored in the memory 102, thereby functioning as an acquisition unit 110, a pre-processing unit 120, and a generation unit 130.

[0010] The acquisition unit 110 acquires vehicle body shape data representing the shape of the vehicle body BD and plaster shape data representing the shape of the plaster applied to the vehicle body BD. The vehicle body shape data and plaster shape data are generated in advance using, for example, 3D CAD software or 3D CG software. The acquisition unit 110 acquires the vehicle body shape data and plaster shape data from outside the information processing device 100, for example, via wired communication or wireless communication. When the vehicle body shape data and plaster shape data are stored in the memory 102, the acquisition unit 110 may acquire the vehicle body shape data and plaster shape data from the memory 102.

[0011] The preprocessing unit 120 performs preprocessing on the vehicle body shape data and the plaster shape data acquired by the acquisition unit 110. In this embodiment, the preprocessing includes a grouping process, an emphasis process, and a weight reduction process. Details of the grouping process, the emphasis process, and the weight reduction process will be described later.

[0012] The generation unit 130 generates augmented reality data DT using the vehicle body shape data and plaster shape data preprocessed by the preprocessing unit 120. The augmented reality data DT is data for displaying an image of the vehicle body and plaster in the virtual world superimposed on a scene including the vehicle body BD in the real world. The augmented reality data DT generated by the generation unit 130 is input to a mobile terminal 200 operated by a worker WK, for example, via wired or wireless communication.

[0013] The mobile terminal 200 may be, for example, a tablet terminal, a smartphone, or a laptop personal computer. The mobile terminal 200 includes a camera and a display. An application program for viewing augmented reality data DT is pre-stored in the mobile terminal 200. When the mobile terminal 200 receives the augmented reality data DT, it captures an image of a real-world vehicle body BD from a predetermined position and orientation using a camera. The mobile terminal 200 displays an image of a virtual-world vehicle body BD and a plaster superimposed on the image of the real-world vehicle body BD on the display. When the mobile terminal 200 superimposes the virtual world on the real world, it aligns the real world and the virtual world so that the characteristic features of the vehicle body BD in the real world overlap with the characteristic features of the virtual world vehicle body. Changing the position or orientation of the camera changes the appearance of the real world displayed on the display. Therefore, the mobile terminal 200 changes the appearance of the virtual world to follow the change in the position or orientation of the camera, in other words, to follow the change in the appearance of the real world. By viewing the image of the real world and the virtual world superimposed on the display, the worker WK can easily grasp the location where the adhesive should be applied. Therefore, the augmented reality data DT can improve the work efficiency of the application work.

[0014] Fig. 2 is a flowchart showing the contents of the augmented reality data generation process. Fig. 3 is an explanatory diagram showing vehicle body shape data before and after enhancement processing. The augmented reality data generation process shown in Fig. 2 is executed by the processor 101 of the information processing device 100. The augmented reality data generation process is started, for example, when a predetermined start operation is executed on the information processing device 100.

[0015] When the augmented reality data generation process is started, in step S10, the acquisition unit 110 acquires vehicle body shape data and coating material shape data. In this embodiment, the vehicle body shape data includes shape data of multiple parts that make up the vehicle body BD, and the coating material shape data includes shape data of multiple coating materials to be applied to each part of the vehicle body BD.

[0016] In step S20, the preprocessing unit 120 executes a grouping process. In the grouping process, the preprocessing unit 120 groups each component included in the vehicle body shape data and each coating agent included in the coating agent shape data according to a predetermined rule. In this embodiment, the preprocessing unit 120 groups each component according to a rule determined by the component layout and assembly order, and groups each coating agent according to a rule determined by the coating agent layout and application order. More specifically, the preprocessing unit 120 groups each component into units such as the roof, left side panel, right side panel, dash panel, front floor, rear floor, hood, left front door, right front door, left rear door, and right rear door. The preprocessing unit 120 groups each coating agent into units such as the upper body, the upper floor side of the underbody, and the lower floor side of the underbody.

[0017] In step S30, the preprocessing unit 120 executes an emphasis process. In the emphasis process, the preprocessing unit 120 emphasizes the characteristic parts of the vehicle body BD represented in the vehicle body shape data. In this embodiment, the emphasis process includes a process of coloring each group, a process of thickening contour lines such as hole edges and edges, and a process of removing unnecessary lines other than the contour lines. As shown in FIG. 3, the process of coloring each group emphasizes the boundaries between groups. The process of thickening the contour lines emphasizes the contour lines. The process of removing unnecessary lines other than the contour lines emphasizes the contour lines. Note that in FIG. 3, different colors are represented by different types of hatching.

[0018] In step S40, the preprocessing unit 120 executes a weight reduction process. In the weight reduction process, the preprocessing unit 120 reduces the weight of the vehicle body shape data and the plaster shape data. In this embodiment, the preprocessing unit 120 reduces the weight of the vehicle body shape data and the plaster shape data by converting the surfaces and solids that make up the vehicle body shape data and the plaster shape data into a polygon mesh. The preprocessing unit 120 further reduces the weight of the vehicle body shape data and the plaster shape data by combining adjacent polygons to reduce the number of polygons in the polygon mesh. In this embodiment, the processes from step S20 to step S40 are referred to as preprocessing.

[0019] In step S50, the generation unit 130 generates augmented reality data DT using the preprocessed vehicle body shape data and application material shape data, and stores the augmented reality data DT in the memory 102. Thereafter, the processor 101 ends the augmented reality data generation process.

[0020] According to the information processing device 100 of the present embodiment described above, augmented reality data DT is generated using vehicle body shape data and plaster shape data that have been subjected to preprocessing, including emphasis processing. The emphasis processing emphasizes the features of the vehicle body BD represented in the vehicle body shape data, improving the accuracy of detection of the features of the vehicle body BD represented in the vehicle body shape data when the augmented reality data DT is viewed on the mobile terminal 200, and improving the accuracy of alignment between the features of the vehicle body BD in the real world and the features of the vehicle body in the virtual world. Therefore, when the augmented reality data DT is viewed on the mobile terminal 200, it is possible to reduce misalignment between the real world and the virtual world.

[0021] In this embodiment, the preprocessing includes a grouping process. The grouping process enables switching between displaying and hiding each group when viewing the augmented reality data DT on the mobile terminal 200. By displaying the necessary groups and hiding the unnecessary groups, the worker WK can more easily grasp the positions where the coating agent should be applied. This further improves the work efficiency of the coating work.

[0022] In this embodiment, the preprocessing includes a weight reduction process, which reduces the weight of the vehicle body shape data and the plaster shape data, thereby reducing the processing load on the processor 101 when generating the augmented reality data DT.

[0023] B. Other Embodiments: (B1) In the first embodiment described above, the mobile terminal 200 is used to view the augmented reality data DT, and the display of the mobile terminal 200 displays an image of the virtual world superimposed on an image of the real world. In contrast, a see-through head-mounted display may be used to view the augmented reality data DT. In this case, the see-through head-mounted display displays an image of the virtual world, not an image of the real world. A worker WK wearing the see-through head-mounted display sees the scenery of the real world and the image of the virtual world superimposed on each other, as seen through the see-through head-mounted display.

[0024] (B2) In the first embodiment described above, the preprocessing unit 120 performs an enhancement process that includes a process of coloring each group, a process of thickening contour lines, and a process of removing unnecessary lines other than the contour lines. In contrast, the preprocessing unit 120 may perform an enhancement process that includes, in addition to the three processes described above, a process of changing the color of contour lines to enhance the contrast between the contour lines and surfaces. The enhancement process may include at least one of the following: a process of coloring each group, a process of thickening contour lines, a process of removing unnecessary lines other than the contour lines, and a process of changing the color of contour lines to enhance the contrast between the contour lines and surfaces. The preprocessing does not necessarily include any process other than the enhancement process.

[0025] (B3) In the first embodiment described above, the acquisition unit 110, the preprocessing unit 120, and the generation unit 130 are provided on one computer. However, the acquisition unit 110, the preprocessing unit 120, and the generation unit 130 may be provided in a distributed manner on multiple computers.

[0026] The present disclosure is not limited to the above-described embodiments and can be realized in various configurations without departing from the spirit thereof. For example, the technical features in the embodiments corresponding to the technical features in each aspect described in the Summary of the Invention section can be appropriately replaced or combined to solve some or all of the above-described problems or achieve some or all of the above-described effects. Furthermore, if a technical feature is not described as essential in this specification, it can be appropriately deleted. [Explanation of symbols]

[0027] 100...information processing device, 101...processor, 102...memory, 103...input / output interface, 104...internal bus, 110...acquisition unit, 120...preprocessing unit, 130...generation unit, 200...mobile terminal, BD...vehicle body, DT...augmented reality data, PG...computer program, WK...worker

Claims

[Claim 1] An information processing device, An acquisition unit that acquires vehicle body shape data representing a shape of a vehicle body and coating agent shape data representing a shape of a coating agent applied to the vehicle body; a pre-processing unit that executes an enhancement process for enhancing characteristic portions of the vehicle body on the vehicle body shape data; a generation unit that generates augmented reality data by using the coating agent shape data and the vehicle body shape data that has been subjected to the emphasis processing, the augmented reality data being displayed by superimposing the coating agent in the virtual world, the augmented reality data being aligned with a feature of the vehicle body in the real world and a feature of the vehicle body in the virtual world, on the vehicle body in the real world; An information processing device comprising:

Images