Information processing device, terminal device, and information processing method

Abstract

In an information processing device (14) comprising a controller (140) that transmits information to an output device (12), the controller (140) acquires information indicating a selected connector that a user has selected from among connectors to be connected to a wire included in an target, generates a selected component image showing, in an emphasized manner, the selected connector and another component related to the selected connector, and transmits, to the output device, the selected component image shown such that the selected component image superimposed on the target.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, a terminal device, and an information processing method.

Background Art

[0002] There is known a technique for displaying a component image in a state where it is superimposed on a vehicle on a display visible to a user, and highlighting the component in the component image when the component is selected from a component configuration diagram displayed together with the component image.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the technique described in Patent Document 1, when an operator inspects a connector included in a wire harness, for example, it is difficult to determine the connection destination of the connector and the positions of the wirings connected to each pin of the connector. Therefore, it takes time to confirm the information necessary for the inspection of the connector, and there is a problem that the work efficiency of inspection and the like is low.

[0005] The problem to be solved by the present invention is to provide an information processing apparatus, a terminal device, and an information processing method that improve the work efficiency in work such as inspection of connectors.

Means for Solving the Problems

[0006] The present invention solves the above problem by acquiring information indicating the selected connector chosen by the user from among the connectors connected to the wiring included in the object, generating a selected component image that highlights the selected connector and other components related to the selected connector, and transmitting the selected component image, which is displayed superimposed on the object, to an output device.

[0007] The present invention solves the above problem by transmitting information indicating a selected connector chosen by the user from among the connectors connected to the wiring included in the object to an information processing device, receiving a selected component image from the information processing device, displaying the selected component image so that it overlaps with the object, and the selected component image is an image that highlights the selected connector and other components related to the selected connector. [Effects of the Invention]

[0008] According to the present invention, it is possible to improve work efficiency in tasks such as inspecting connectors. [Brief explanation of the drawing]

[0009] [Figure 1] Figure 1 is a configuration diagram showing an example of an information processing system including an information processing device according to the first embodiment. [Figure 2] Figure 2 shows an example of a screen displayed on the terminal's display in the first embodiment. [Figure 3] Figure 3 is an example of a screen displayed on the terminal device's display when the user selects a connector in the first embodiment. [Figure 4A] Figure 4A is an example of a connector information image of the selected connector displayed on the terminal's display in the first embodiment. [Figure 4B] Figure 4B is an example of a connector information image of the relevant connector displayed on the terminal's display in the first embodiment. [Figure 5] Figure 5 is a flowchart showing an example of a control procedure for an information processing method executed by the information processing device according to the first embodiment. [Figure 6]Figure 6 is a configuration diagram showing an example of an information processing system including an information processing device according to the second embodiment. [Modes for carrying out the invention]

[0010] <<First Embodiment>> Hereinafter, an embodiment of the information processing apparatus and information processing method according to the present invention will be described with reference to the drawings. In the first embodiment, an information processing apparatus installed in a terminal owned by a user will be described as an example.

[0011] Figure 1 is a block diagram showing an example of an information processing system 100 including an information processing device 14 according to the first embodiment. The information processing system 100 of this embodiment is a system that presents information about the parts contained in an object via a terminal 1 when a user performs work such as inspection and repair (hereinafter referred to as "inspection, etc.") on the object. The information processing system of this embodiment provides a service that presents information that is easy for the user to intuitively understand using AR (augmented reality) technology. The object to be inspected, etc. is, for example, a vehicle. In the following description, an example is given in which information about the parts necessary for vehicle inspection, etc. is presented, using a vehicle as the object, but the object is not limited to a vehicle, and may be, for example, a train, an aircraft, a home appliance, etc.

[0012] Augmented reality (AR) technology has traditionally been known to include a video see-through method that realizes augmented reality using non-transparent display devices, and a see-through method that realizes augmented reality using transparent display devices. In this embodiment, as a video see-through method, an example is described in which the information processing device 14 displays a virtual image on the output device 12 of the terminal device 1 so that the virtual image is superimposed on the real space or an image captured from the real space. A virtual image is a virtual image that does not exist in the real space. A virtual image is a so-called computer graphic, and is an image of a 2D model or a 3D model. The terminal device 1 can be a smartphone, mobile phone, tablet device, portable computer, etc. Note that the terminal device 1 may also be smart glasses, which are glasses-type terminals that can be worn on the user's head.

[0013] As shown in Figure 1, in the information processing system 100 of this embodiment, the terminal 1 comprises an input device 11, an output device 12, a detection device 13, and an information processing device 14. These devices exchange information with each other via wired or wireless connections. The information processing device 14 acquires various information from the input device 11 and the detection device 13 and provides component information to the user via the output device 12.

[0014] The information processing device 14 presents an augmented reality (AR) space to the user via the output device 12. The augmented reality space is a space constructed based on real-world information and virtual-world information. Specifically, the augmented reality space is a space in which the real world is visually extended by displaying virtual images on a display (corresponding to the output device 12) such that the virtual images overlap with the real world or captured images of the real world.

[0015] In this embodiment, when the user launches the vehicle inspection application on terminal 1, the output device 12 functions as a non-transparent display device. The captured image of the surrounding scenery, captured by the detection device 13, is output to the information processing device 14. Then, after processing in the information processing device 14 (described later) is completed, information about the superimposed image, including the captured image and the virtual image, is input from the information processing device 14 to the output device 12, and the superimposed image is displayed on the output device 12. The superimposed image is an image in which a virtual image is superimposed on an image of the scenery that reflects the real space. The user perceives the virtual image as being superimposed on the real space via the output device 12. Through video see-through augmented reality, the user can perceive the real space and also perceive the information shown by the virtual image.

[0016] The input device 11 is a device for inputting information and is operated by the user. The input device 11 is used, for example, to perform various operations such as starting an application for vehicle inspection, selecting information presented to the user, and making a decision by the user. As the input device 11, for example, a touch panel arranged on a display, a button arranged on a keyboard, or a device capable of input by manual operation of the user such as a joystick may be used, or alternatively, a device capable of input by the user's spoken voice such as a microphone may be used. The input information from the user input by the input device 11 is output to the information processing device 14. The input information is, for example, vehicle identification information of the vehicle that the user wants to inspect, inspection area information indicating the inspection target area of the vehicle, and information indicating the selected connector selected by the user.

[0017] The output device 12 is a device for outputting information to the user and is used, for example, for display on a screen and voice guidance. The output device 12 receives the information transmitted from the information processing device 14. When the output device 12 receives information from the information processing device 14 or receives a control command to display information from the information processing device 14, the output device 12 outputs the information received from the information processing device 14 to the user. The output device 12 includes, for example, a device capable of outputting an image or video that acts on the user's vision such as a display. Further, the output device 12 may include a device capable of outputting a voice that acts on the user's hearing such as a speaker.

[0018] Displays include transmissive displays and non-transmissive displays. In the case of a transmissive display, since the video behind the display can be seen through, the user can directly visually recognize the video, that is, the image generated by the refraction and reflection of light rays. In the case of a non-transmissive display, the user visually recognizes the captured image of the real space displayed on the display, that is, the image reproduced by electrical conversion.

[0019] In this embodiment, the output device 12 will be described as a non-transmissive display. For example, when the output device 12 receives a vehicle component image from the information processing device 14, it displays the component image so that the vehicle component image overlaps the captured image of the vehicle. The vehicle component image will be described later. When the output device 12 is a transmissive display, when the output device 12 receives a vehicle component image from the information processing device 14, it displays the component image so that the vehicle component image overlaps the real space including the vehicle.

[0020] The detection device 13 includes, for example, a device capable of imaging the surroundings of the terminal device 1. The detection device 13 includes, for example, a camera having an imaging element such as a CCD. When the user activates the vehicle inspection application of the terminal device 1, the detection device 13 takes a still image or shoots a video. The detection device 13 is provided at a predetermined position of the terminal device 1 and images the direction in which the lens faces. For example, the detection device 13 is provided at the front of the terminal device 1. In this embodiment, the image that can be imaged by the detection device 13 may be at least one of a still image and a video. The captured image captured by the detection device 13 is output to the information processing device 14 as image information at a predetermined cycle. In this embodiment, after the user activates the vehicle inspection application, by turning the camera lens toward the vehicle for inspection, etc., the detection device 13 images the real space including the vehicle. The detection device 13 may have a shake correction function.

[0021] Also, the detection device 13 may detect the illuminance in the real space around the terminal device 1. The detection device 13 may be constituted by an illuminance meter, or may be configured to be able to acquire brightness information from the image information of the camera.

[0022] The information processing device 14 of this embodiment is composed of a computer equipped with hardware and software, and consists of a ROM that stores programs, a CPU that executes the programs stored in the ROM, and RAM that functions as an accessible storage device. The controller 140 shown in Figure 1 corresponds to the CPU, and the storage device 143 shown in Figure 1 corresponds to the ROM and RAM.

[0023] In this embodiment, the controller 140 transmits information to the output device 12. For example, the controller 140 transmits an image to be displayed on the output device 12 and a control command to display the image. As shown in Figure 1, the controller 140 includes a target identification unit 141 and an information presentation unit 142 as functional blocks. These blocks implement the functions described later by software established in ROM. In this embodiment, the controller 140 may simply transmit the image to be displayed on the output device 12 without transmitting a control command.

[0024] First, the function of the target identification unit 141 will be explained. The target identification unit 141 acquires the captured image from the detection device 13. The target identification unit 141 performs image recognition processing on the acquired captured image to determine whether the captured image contains the whole or a part of the vehicle. As a result, the target identification unit 141 can acquire a captured image that contains at least a part of the vehicle. In this embodiment, the captured image is described as a video, but the captured image may also be a still image.

[0025] The target identification unit 141 acquires vehicle identification information entered by the user and identifies the type of vehicle to be inspected or otherwise inspected based on the vehicle identification information. The vehicle type is, for example, the vehicle's model. The vehicle identification information is, for example, the vehicle identification number (VIN). Alternatively, the target identification unit 141 may extract the characteristics of the vehicle's model through image recognition processing of the acquired vehicle image and identify the vehicle's model.

[0026] Furthermore, the target identification unit 141 identifies the parts to be displayed from among the parts of the vehicle in the captured image based on the information acquired from the input device 11 and the detection device 13. The parts to be displayed are the parts to be superimposed and displayed as virtual images, and are, for example, electronic components, wiring connecting electronic components, and connectors connecting electronic components and wiring. Electronic components are, for example, control unit-related parts such as IPDM, fuse box, ECM, and BCM. Wiring consists of electric wires connecting electronic components. Wiring may be a harness made up of multiple electric wires bundled together, or it may be each electric wire included in the harness. In other words, in this embodiment, a virtual image corresponding to the parts to be displayed is displayed on the display (corresponding to the output device 12).

[0027] The target identification unit 141 first acquires inspection area information from the input device 11, which indicates the inspection target area entered by the user. The inspection target area is the inspection area of ​​the vehicle that the user wants to inspect. The inspection area is an area that indicates a part of the vehicle, such as the engine compartment, body harness, door harness, front door, rear door, dashboard, etc. In this embodiment, the vehicle's inspection area is pre-set, and the inspection area information is stored in the storage device 143. The inspection area information includes vehicle part information included in the inspection area. The part information includes part type, location, and image information. For example, if the inspection area is the engine compartment, the inspection area information includes part information such as connectors, wiring, and electronic components included in the engine compartment. In this embodiment, when a selection image for selecting an inspection area is displayed on the output device 12, the user selects the inspection target area that they want to inspect from the displayed selection image and inputs inspection area information indicating the selected inspection target area. For example, in the selection image for selecting an inspection area, multiple inspection areas are displayed in a selectable format such as a pull-down menu. The user inputs inspection area information by touching the inspection area they wish to inspect from the inspection areas included in the displayed selection image.

[0028] When the target identification unit 141 acquires inspection area information, it recognizes the inspection target area indicated by the inspection area information in the image captured by the detection device 13. For example, the target identification unit 141 acquires a reference shape corresponding to the inspection target area indicated by the inspection area information from the storage device 143 and determines whether or not there is a shape corresponding to the reference shape in the captured image. The reference shape is a shape that is set in advance for each inspection target area and is the external shape of each part of the vehicle. For example, if the inspection target area is the engine room, the reference shape is the external shape inside the engine room. Also, if the inspection target area is the door harness, the reference shape is the external shape of the door. The storage device 143 stores the reference shapes set for each inspection target area.

[0029] The target identification unit 141 recognizes the location of a shape corresponding to the reference shape of the inspection target area as the inspection target area if such a shape exists in the captured image. The target identification unit 141 identifies the parts included in the recognized inspection target area as parts to be displayed. For example, if there is a shape corresponding to the reference shape of the engine room in the captured image, the target identification unit 141 recognizes the location of such a shape as the engine room included in the captured image and identifies the parts included in the engine room as parts to be displayed. Alternatively, the target identification unit 141 may identify the parts to be displayed by image recognition processing of the captured image captured by the detection device 13. In other words, the target identification unit 141 may identify the parts to be displayed from the captured image without user input of inspection area information.

[0030] As described above, in this embodiment, when the user points the camera of the detection device 13 toward the inspection area they wish to inspect, the target identification unit 141 recognizes the inspection target area within the image captured by the detection device 13 and identifies the components included in the inspection target area as components to be displayed.

[0031] Furthermore, in this embodiment, the inspection area may be represented in a multi-level hierarchical structure. For example, the inspection area may be represented by major items and minor items. A minor item represents an area that is even more limited than the area represented by the major item. For example, the harness included in the engine compartment can be further divided into several parts. Therefore, when the engine compartment is set as the major item of the inspection area, each part of the harness included in the engine compartment is set as a minor item of the inspection area. The user selects the major item of the inspection area, and then selects the target inspection area from the minor items included in the major item.

[0032] In this embodiment, vehicle information is stored in the storage device 143 for each vehicle type. The vehicle information includes information on each component included in the vehicle, information on inspection areas set for the vehicle, and information on the reference shape corresponding to the inspection area. When the target identification unit 141 identifies the vehicle type, it retrieves the vehicle information stored for the identified vehicle type from the storage device 143.

[0033] Furthermore, each part of the vehicle may have multiple variations. For example, each part may have different grades, options, etc. The storage device 143 stores information about each part and information about different types of parts for each type of vehicle. The target identification unit 141 may identify the type of part to be displayed when there are multiple parts of different types among the parts to be displayed. For example, the target identification unit 141 may perform image recognition processing on the captured image to recognize the type of part. If the type of part cannot be recognized from the captured image, the target identification unit 141 may obtain information indicating the type of part selected by the user.

[0034] Furthermore, the target identification unit 141 may identify the display target parts from the captured image including the vehicle other than the damaged or modified parts, even if the vehicle is damaged or modified, or if the vehicle's external shape differs in part from the corresponding vehicle model obtained from the storage device 143. Also, the target identification unit 141 may identify the display target parts from the captured image including the vehicle other than the part obscured by the obstacle, even if an obstacle is present in front of the vehicle. Furthermore, the target identification unit 141 may identify the display target parts from the captured image including the vehicle other than the removed interior and / or exterior parts, even if the vehicle has had its interior and / or exterior parts removed. Interior parts include, for example, door finishers, instrument panel assemblies, seats, center consoles, floor trims, etc. Exterior parts include, for example, lamps, grilles, front and rear bumpers, rear bumpers, etc.

[0035] Furthermore, the target identification unit 141 may control the detection device 13 to adjust the amount of light taken in according to the illuminance of the real space detected by the detection device 13 and perform imaging. For example, the target identification unit 141 controls the detection device 13 to take in more light and image the real space when it is darker. Conversely, the target identification unit 141 controls the detection device 13 to take in less light and image the real space when it is brighter. As a result, the target identification unit 141 can recognize vehicle parts based on the captured image, regardless of whether the real space is dark or bright.

[0036] Next, the functions of the information display unit 142 will be described. The information display unit 142 controls the output device 12 to display part images related to the parts to be displayed to the user. That is, the information display unit 142 transmits part images and control commands to display the part images to the output device 12. The part images are virtual images representing each part of the vehicle. For example, part images include part images representing electronic components, part images representing wiring, and part images representing connectors. The part images are so-called computer graphics, images of two-dimensional models or images of three-dimensional models. The part images are acquired from the storage device 143. In this embodiment, the information display unit 142 controls the output device 12, but it is not limited to this, and the information display unit 142 may not have the function of controlling the output device 12, and may simply transmit part images to the output device 12.

[0037] In this embodiment, when a component to be displayed is identified, the information display unit 142 acquires a component image corresponding to the component to be displayed from the storage device 143 as a reference component image, and displays the reference component image on the output device 12 so that the reference component image overlaps with the vehicle. That is, the information display unit 142 transmits the reference component image and a control command to the output device 12 to display the reference component image so that the reference component image overlaps with the vehicle. For example, the information display unit 142 generates a superimposed image by superimposing the reference component image onto an image of a vehicle captured in real space, and displays the superimposed image on the output device 12. The reference component image is superimposed on the position of the component to be displayed on the vehicle in the image. In this embodiment, a non-transparent display is used as an example, but the reference component image may also be displayed on a transparent display. In this case, the reference component image is displayed at a position on the display corresponding to the position of the component to be displayed on the vehicle in real space. The user can directly view the augmented reality space, including the vehicle with the reference component image superimposed, through the display. Note that the reference part image is not a mandatory component and may be used as needed. Furthermore, the information display unit 142 may simply transmit the reference part image, which is displayed superimposed on the vehicle, to the output device 12 without transmitting a control command.

[0038] In this embodiment, the information display unit 142 acquires component information relating to connectors, wiring, and electronic components as components to be displayed. The information display unit 142 causes the output device 12 to display component images representing connectors, wiring, and electronic components as reference component images. The information display unit 142 also acquires component information relating to electronic components equipped with fuses among the electronic components included in the vehicle, and based on the component information, causes the output device 12 to display a reference component image representing the electronic component so that the reference component image representing the electronic component overlaps with the vehicle. The information display unit 142 may also transmit the reference component image representing the electronic component, which is displayed to overlap with the vehicle, to the output device 12 without transmitting a control command.

[0039] Furthermore, the reference component images may be component images represented in different colors depending on the type of component. For example, a reference component image representing a connector may be an image in which the connector is represented in a different color than the reference component images representing electronic components and reference component images representing wiring, for example, an image in which the connector is represented in blue. Similarly, a reference component image representing wiring may be an image in which the wiring is represented in green. Similarly, a reference component image representing electronic components may be an image in which the electronic components are represented in orange.

[0040] Here, using Figure 2, we will explain an example of a screen in which a reference part image is displayed so that the reference part image is superimposed on the vehicle. Figure 2 is an example of a screen displayed on the terminal's display by the information processing device according to this embodiment. In the following explanation, the output device 12 will be described as the display. As shown in Figure 2, the information processing device 14 displays on the display (corresponding to the output device 12) a screen in which a reference part image C representing a connector and a reference part image H representing wiring are superimposed on an image taken of the vehicle V.

[0041] In this embodiment, the reference component image representing the connector includes an identification tag image for identifying the connector. The identification tag image includes an identification number for identifying the connector. The identification tag image is, for example, an image in which the identification number is displayed in red letters on a white background. In the example in Figure 2, the identification tag image T, which includes the identification number of the connector, is displayed on the display so as to overlap the vehicle V with the reference component image C representing the connector. That is, the identification tag image is displayed around the reference component image of the corresponding connector. In other words, the identification tag image is displayed in a position where the corresponding connector can be identified. Furthermore, the identification tag image is displayed so that the identification number faces the direction of the user. For example, even if the user moves around the vehicle, the identification number included in the identification tag image is displayed so as to face the direction of the terminal 1 that the user is operating, based on the position of the terminal 1. The orientation of the identification number included in the identification tag image may also be adjusted vertically. For example, if the position of the identification tag image is higher than the position of the terminal 1, such as when the identification tag image corresponding to a connector installed on the roof is located on the roof, the orientation of the identification tag image is adjusted vertically so that it faces the direction of the terminal 1. Additionally, the connector identification tag image is displayed in an opaque state, regardless of the user's emphasis setting. The emphasis setting will be explained later.

[0042] Furthermore, the screen displayed on the output device 12 may include an image representing an input section for the user to input various operation information. In the example in Figure 2, the output device 12 displays an image B of the previous screen button that instructs the user to return to the previous screen, an image R of the reset button that updates the display of component images on the screen to its initial state, selection images T1 and T2 for selecting the inspection target area, an image S of the search bar for searching for a connector, and an image N of the emphasis slider bar for adjusting the emphasis of the reference component image displayed on the output device 12. When the user touches the image B of the previous screen button on the display, the information processing device 14 displays the image of the previous screen on the output device 12. When the user touches the image R of the reset button on the display, the information processing device 14 stops the display of component images and resumes the recognition process of the component to be displayed. Images T1 and T2 display the names of each item in the inspection target area in a pull-down format. Image T1 is a selection image for selecting a major item in the inspection target area. Image T2 is a selection image for selecting a minor item in the inspection target area. When a user operates the scroll bars displayed on images T1 and T2 on the display and touches an item name in the inspection target area, the information processing device 14 acquires inspection area information indicating the touched inspection target area.

[0043] Furthermore, if the user selects the search bar image S and enters a keyword, the information display unit 142 may display a reference part image representing the connector based on the entered keyword. The user touches the search bar image S on the output device 12 and enters a keyword to search for a connector. A reference part image representing the connector corresponding to the entered keyword is displayed. In this embodiment, as long as the application is running, the search bar image S is displayed on the output device 12 even if the screen switches. In a connector search, the connector name and / or connector number of the connector are the search targets. Also, in a connector search, if the keyword entered in the search bar exactly matches the connector name or connector number, the information display unit 142 may display a reference part image of the connector corresponding to the exactly matched connector name or connector number, or if the keyword entered in the search bar partially matches the connector name or connector number, the information display unit 142 may display a reference part image of the connector corresponding to the partially matched connector name or connector number.

[0044] Furthermore, the information display unit 142 may display a reference part image representing a connector when a connector included in the inspection target area selected by the user is found. If a connector not included in the inspection target area selected by the user is found, the information display unit 142 may display a connector information image containing the connector information of that connector instead of displaying a reference part image representing the connector.

[0045] Furthermore, the information display unit 142 may change the emphasis of the reference component image based on the user's operation of the emphasis slider bar and display the reference component image based on the changed emphasis. The user adjusts the emphasis value of the reference component image by operating the position of the slider on the emphasis slider bar. When the emphasis value is 0, the reference component image is transparent, i.e., hidden. When the emphasis value is 100, the reference component image is opaque. When the emphasis value is between 0 and 100, it is semi-transparent. The emphasis of the reference component image is set for each type of component. That is, an emphasis slider bar is displayed on the screen for each type of component. The screen in Figure 2 includes images of three emphasis slider bars for adjusting the emphasis of wiring, connectors, and electronic components, respectively. In the initial settings, the emphasis of the reference component images representing connectors, wiring, and electronic components is set to 100.

[0046] In this embodiment, if the user performs an operation to set the emphasis of a reference component image representing a wiring, the information display unit 142 may change the emphasis of the reference component image representing wiring other than the target wiring connecting the selected connector and the related connector to the set emphasis. The selected connector and the related connector will be described later.

[0047] The information display unit 142 may adjust the emphasis of the reference component image according to the illuminance of the real space detected by the detection device 13. For example, the information display unit 142 may set the emphasis of the reference component image higher when the real space is brighter and lower when the real space is darker. This allows the emphasis to be adjusted so that the reference component image is easily visible whether the real space is bright or dark.

[0048] Furthermore, the information display unit 142 displays a reference part image within 3 seconds of identifying the part to be displayed. If the time from identifying the part to be displayed to displaying the reference part image takes more than 3 seconds, the information display unit 142 may display an image indicating that it is preparing to display the reference part image. For example, such an image may be an icon image indicating "Loading".

[0049] Furthermore, if the parts to be displayed include different types of parts due to differences in specifications, the information display unit 142 may acquire a reference part image from the storage device 143 representing the type of part to be displayed identified by the target identification unit 141, and display the acquired reference part image on the output device 12. Also, even if the vehicle included in the captured image is a damaged or modified vehicle, or otherwise differs in appearance from the corresponding vehicle model, the information display unit 142 may estimate the position of the parts to be displayed from the appearance of the vehicle other than the damaged or modified parts, and display the reference part image on the output device 12 so as to overlap the estimated position of the parts to be displayed. Furthermore, even if there is an obstacle in front of the vehicle included in the captured image, the information display unit 142 may estimate the position of the parts to be displayed from the appearance of the vehicle other than the part obscured by the obstacle, and display the reference part image on the output device 12 so as to overlap the estimated position of the parts to be displayed. Furthermore, even if the vehicle has had its interior and / or exterior parts removed, the information display unit 142 may estimate the position of the parts to be displayed from the external shape of the vehicle other than the removed interior and / or exterior parts, and display a reference part image on the output device 12 so as to overlap with the estimated position of the parts to be displayed.

[0050] If the part image cannot be displayed due to the influence of the environment in the real space and / or the positional relationship with the vehicle, the information display unit 142 may cause the output device 12 to display an instruction image that includes instructions regarding the conditions related to the environment in the real space and / or the positional relationship with the vehicle so that the part image can be displayed. For example, if the target identification unit 141 cannot identify the part to be displayed from the captured image because the real space is dark, the information display unit 142 will cause the output device 12 to display an instruction image that includes the text "Please brighten the surroundings." Also, if the target identification unit 141 cannot identify the part to be displayed from the captured image because the distance to the vehicle is too close or too far, the information display unit 142 will cause the output device 12 to display an instruction image that includes the text "Please move away from the object" or "Please move closer to the object." Furthermore, if the inspection target area identified from the captured image differs from the inspection target area entered by the user, and the target identification unit 141 cannot identify the inspection target area entered by the user from the captured image, the information display unit 142 displays an instruction image containing the text, "The inspection area the camera is pointing at is different from the selected inspection target area. Please point the camera at the selected inspection target area," on the output device 12.

[0051] After starting to display the part image, the information display unit 142 displays the part image on the output device 12 in a manner that maintains the state in which the part image overlaps the vehicle, in response to changes in the user's position and orientation. Based on the vehicle's position and orientation information and the user's position and orientation information, the information display unit 142 recognizes the user's position and orientation in the real space including the vehicle. That is, the information display unit 142 recognizes the relative positional relationship between the user and the vehicle (including the direction and distance of the vehicle) with respect to the user. The user's position and orientation are determined by the position and orientation of the terminal 1. At regular intervals, the information display unit 142 recognizes the relative positional relationship between the user and the vehicle and changes the position and orientation of the part displayed on the output device 12 to correspond to the recognized positional relationship. As a result, even if the user operating the terminal 1 moves closer to or further away from the vehicle, moves around the vehicle, or views the vehicle from above or below, the part image can be displayed on the output device 12 in a manner that overlaps the vehicle, even if the user's position and orientation change.

[0052] Furthermore, for example, if the display position of the part image on the output device 12 deviates from the position of the corresponding part, the information display unit 142 recalculates the display position of the part image based on the vehicle's position and orientation information and the user's position and orientation information at that time, and redisplays the part image at the recalculated display position. Also, if the user inputs an instruction to pause, the information display unit 142 stops updating the display of the part image based on the vehicle's position and orientation information and the user's position and orientation information, and pauses the screen displaying the captured image of the vehicle taken at the time the pause instruction was input and the corresponding part image.

[0053] In this embodiment, if the user selects an inspection target area before the part images are displayed, the information display unit 142 displays the part images included in the selected inspection target area and hides the part images included in areas other than the inspection target area. Furthermore, in this embodiment, the information display unit 142 may also display the part images included in the selected inspection target area and hide the part images included in areas other than the inspection target area if the user selects an inspection target area after the part images have been displayed. In other words, the information display unit 142 changes the display and hiding of the corresponding part images based on the user's selection of whether to display or hide the inspection target area. In addition, if the inspection target area has major and minor items, the information display unit 142 may change the display and hiding of the part images in the inspection target area for each item.

[0054] Furthermore, when a user selects a connector from among the connectors connected to the wiring included in the vehicle, the information display unit 142 acquires from the storage device 143 the component image of the selected connector, component images of related components that are other components related to the selected connector, connector information regarding the selected connector, and connector information regarding the related components. In this embodiment, the user selects the connector they want to inspect by touching the identification tag image corresponding to the connector. Based on the acquired component images, the information display unit 142 generates a selected component image that highlights the selected connector and related components, and causes the output device 12 to display the selected component image so that it overlaps with the vehicle. That is, the information display unit 142 transmits the selected component image and a control command to the output device 12 to display the selected component image so that it overlaps with the vehicle. The component images of the selected connector and related components are displayed on the output device 12 so that they overlap with the selected connector and related components included in the captured image, respectively. The selected component image is, for example, an image that displays the selected connector and related components in a different color from components other than the selected connector and related components. In this embodiment, the output device 12 is described as an opaque display, but it is not limited to this. If the output device 12 is a transparent display, the information display unit 142 may display the images of each component on the output device 12 so as to overlap the selected connector and related components included in the real space. The information display unit 142 may also simply transmit the images of the selected components, which are displayed to overlap the vehicle, to the output device 12 without transmitting any control commands.

[0055] Here, an example of a selected component image generated by the information display unit 142 will be described. For example, the selected component image is an image that displays the selected connector and the associated connector connected to the other end of the wiring opposite to one end to which the selected connector is connected, in different forms. The information display unit 142 obtains the component image of the selected connector and the component image of the associated connector from the storage device 143 and generates a selected component image that displays the selected connector and the associated connector in different forms. For example, the information display unit 142 generates a selected component image by adding different marker images to the component image of the selected connector and the component image of the associated connector. The marker image of the selected connector is, for example, a red pin icon image. The marker image of the associated connector is, for example, a pink pin icon image.

[0056] Furthermore, the selected component image may be an image that highlights the selected connector and the wiring connected to each pin of the selected connector. The information display unit 142 obtains the component image of the selected connector and the component images of the wiring connected to each pin of the selected connector from the storage device 143, and generates a selected component image that highlights the selected connector and the wiring connected to each pin of the selected connector. For example, the information display unit 142 generates a selected component image that displays the components including the selected connector and the wiring connected to each pin of the selected connector in a different form from other components. An image displayed in a different form is, for example, an image displayed in a different color. The information display unit 142 displays the selected connector and the wiring connected to each pin of the selected connector in red. The information display unit 142 also displays other connectors in blue and other wiring in green.

[0057] Furthermore, the information display unit 142 may also display a selection component image on the output device 12, highlighting the selection connector and the wiring connected to the selected pin, when the user selects a pin from among the multiple pins of the selection connector. For example, the selection component image is an image that displays, in different forms, the wiring connected to the selected pin and the wiring connected to other pins besides the selected pin, among the wiring connected to the selection connector. Note that these selection component images are just examples and are not essential to the present invention; they may be provided as needed.

[0058] Furthermore, the information display unit 142 may generate a selection component image that displays the target wiring connecting the selected connector and the related connector in a different form from the wiring other than the target wiring. For example, the information display unit 142 may display the target wiring in red and the wiring other than the target wiring in green. For example, when the user selects a pin number for the selected connector, the information display unit 142 generates a selection component image that displays the target wiring from the selected pin to the pin of the related connector connected to the selected pin in a different form from the wiring other than the target wiring. In this embodiment, if the related connector is within the inspection target area, the information display unit 142 highlights and displays the target wiring from the selected connector to the related connector, and if the related connector is outside the inspection target area, it highlights and displays the target wiring within the inspection target area. In this case, if the related connector is outside the inspection target area, the information display unit 142 may display a marker image to be added to the related connector outside the vehicle and display a connector information image related to the related connector.

[0059] Furthermore, if an intermediate connector is present, the information display unit 142 may generate a selection component image that displays the selection connector and the intermediate connector in different forms. The intermediate connector is a connector different from the selection connector and the related connector, and is connected to the target wiring that connects the selection connector and the related connector. That is, the intermediate connector is interposed between the selection connector and the related connector and electrically connects the selection connector and the related connector. For example, in this embodiment, the information display unit 142 generates a selection component image by adding different marker images to the component image of the selection connector and the component image of the intermediate connector, respectively. Alternatively, the information display unit 142 may add a different marker image to either the related connector or the intermediate connector depending on the user's selection.

[0060] Furthermore, in this embodiment, when a connector is selected by the user, the information display unit 142 may display a connector information image on the output device 12 that includes connector information relating to the selected connector and / or related connectors. That is, the information display unit 142 transmits the connector information image and a control command to display the connector information image to the output device 12. For example, the connector information relating to the selected connector includes at least one of the following: the shape of the selected connector, the model, the pin configuration, the voltage, and the wiring connected to the selected connector. Furthermore, the information included in the connector information relating to the selected connector is not limited to this information. For example, the connector information relating to the selected connector may include the color of the selected connector, the pin number of each pin of the selected connector, the connector name of the selected connector, and the Each pin The information may include the color of the connected wires, as well as the signal name and specifications for each pin number of the selected connector. If multiple different specifications and options exist for a pin number, all existing specifications and options will be displayed. If the selected connector includes voltage information, the connector information will include the connected connector, pin number, conditions, and voltage value. The information display unit 142 may also simply transmit the connector information image to the output device 12 without transmitting a control command.

[0061] Furthermore, the connector information relating to the related connector includes at least one of the following: the shape, model, pin configuration, voltage, and wiring connected to the related connector. However, the information included in the connector information relating to the related connector is not limited to this information. The connector information relating to the related connector may include other information, similar to the connector information relating to the selected connector. In this embodiment, when the user selects the pin configuration of the selected connector, the information display unit 142 displays an image of the connector information relating to the related connector connected to the selected pin configuration. The information display unit 142 may also highlight the selected pin number.

[0062] Furthermore, the information display unit 142 may rotate the selected connector and display a component image in response to user operation. Alternatively, the information display unit 142 may display an enlarged component image of the selected connector, or, after displaying an enlarged image of the selected connector, display a component image representing the original size of the selected connector. The user may select a connector by touching the enlarged component image. In addition, the information display unit 142 may select either a connector information image including the pin configuration on the wiring side connected to the wiring of the selected connector, or a connector information image including the pin configuration on the electronic component side opposite to the wiring side of the selected connector, and output the selected connector information image to the output device. 12 You may send it to [the appropriate address].

[0063] Furthermore, if the user selects a position other than the display position of the connector information image, the information display unit 142 may hide the connector information image and return to the screen before the connector selection. Also, if the user selects the identification tag image of another connector while the connector information image is displayed, the information display unit 142 may change the displayed connector information image to that of the other connector. In addition, the information display unit 142 may continue to display the identification tag image of another connector even if the user selects the identification tag image corresponding to a specific connector.

[0064] Furthermore, in this embodiment, the information display unit 142 may display connectors and fuses included in an electronic component if a component image representing an electronic component is selected by the user. For example, the information display unit 142 acquires information indicating the selected fuse among the fuses included in the electronic component that the user has selected, and displays the selected component image including information about the selected fuse on the output device 12. The information about the selected fuse includes an identification number, amperage, and wire color information that identifies the selected fuse. The information display unit 142 may also transmit only the selected component image including information about the selected fuse to the output device 12 without transmitting a control command.

[0065] Here, using Figure 3, we will explain an example of a screen that displays the selected part image so that it overlaps with the vehicle. Figure 3 is a diagram showing an example of a screen displayed on the output device 12 when the user selects a part. In the following explanation, the output device 12 will be described as a display. As shown in Figure 3, the information processing device 14 is, The following images are displayed on the display (corresponding to the output device 12) so that they are superimposed on the captured image including the vehicle V: part image C1 representing the selected connector, marker image P1 for the selected connector, part image C2 representing the related connector, marker image P2 for the related connector, part image W1 for the wiring connected to the selected pin of the selected connector, and part image W2 for the wiring other than the wiring connected to the selected pin. The display also shows a screen in which the connector information image SC1 for the selected connector and the connector information image SC2 for the related connector are superimposed on the captured image.

[0066] Next, an example of a connector information image for a selected connector will be explained using Figure 4A. Figure 4A is a diagram showing an example of a connector information image for a selected connector in this embodiment. That is, Figure 4 is an example of the connector information image SC1 for the selected connector in Figure 3. The connector information image SC1 for the selected connector includes an image IC1 representing a switching function that switches the display of the pin configuration of the selected connector between the wiring side and the electronic component side, an image IC2 representing the pin configuration of the selected connector, an image IC3 representing the connector number of the selected connector, and an image representing the connector color of the selected connector. image This includes IC4, an image IC5 representing the pin number of the selected pin in the selected connector and the color of the wire connected to the pin, an image IC6 representing the shape of the selected connector, an image IC7 representing the function to switch the display and hide of the selected connector, an image IC8 representing the rotation function of the selected connector, and an image IC9 representing the zoom in and out function of the selected connector.

[0067] Furthermore, the connector information image SC1 of the selected connector includes image IC10 representing the connector number, connector name, and connector type of the selected connector, image IC11 representing the pin numbers of the selected connector, image IC12 representing the color of the wires connected to each pin, and image IC13 representing the signal name corresponding to each pin.

[0068] Next, an example of a connector information image for a related connector will be explained using Figure 4B. Figure 4B is a diagram showing an example of a connector information image for a related connector in this embodiment. That is, Figure 4B is an example of the connector information image SC2 for the related connector in Figure 3. The connector information image SC2 for the related connector includes an image IC14 representing the connector number and color of the related connector, an image IC15 representing the pin number of the related connector connected to the pin of the selected connector and the color of the wire to be connected, an image IC16 representing the connector name of the related connector, an image IC17 representing the connector shape of the related connector, and an image IC18 representing the pin number and pin arrangement of the related connector. Furthermore, if there is an intermediate connector, the connector information image SC2 for the related connector may also include images IC20 and 21 for selecting transitions to the connector information images of connectors located before and after it. For example, if the user selects image IC20, the connector information image of the connector closer to the selected connector than the currently displayed connector will be displayed. Also, if the user selects image IC21, the connector information image of the connector further from the selected connector than the currently displayed connector will be displayed.

[0069] Next, the procedure of the information processing method according to this embodiment will be explained using Figure 5. Figure 5 is a flowchart showing an example of the procedure of the information processing method according to this embodiment. In this embodiment, when the user starts the vehicle inspection application, the controller 140 starts the control flow from step S101.

[0070] In step S101, the controller 140 acquires the captured image from the detection device 13, which is captured by the camera of the detection device 13. In step S102, the controller 140 identifies the display target parts included in the captured image based on the image acquired in step S101. For example, the controller 140 recognizes the inspection target area selected by the user and identifies the parts included in the inspection target area as display target parts. In step S103, the controller 140 transmits a reference part image corresponding to the display target parts, which is displayed overlapping the vehicle, to the output device 12.

[0071] In step S104, the controller 140 obtains information indicating the selected connector selected by the user. For example, if a connector is selected by the user via the input device 11, the controller 140 obtains information indicating the selected connector from the input device 11. In step S105, the controller 140 generates a selected component image that highlights the selected connector and other components associated with the selected connector. In step S106, the controller 140 transmits the selected component image, which is displayed superimposed on the vehicle, to the output device 12. In this embodiment, the controller 140 may also transmit control commands to display a reference component image and a selected component image. In this embodiment, the user selects the components they wish to inspect by referring to the reference component image after it has been displayed, but the present invention is not limited to this. For example, without displaying a reference component image, the user may display an image of the vehicle captured by the output device 12, and then select the components they wish to inspect by referring to the vehicle included in the image.

[0072] As described above, in the information processing apparatus and information processing method according to this embodiment, the controller that transmits information to the output device that outputs the received information acquires information indicating the selected connector selected by the user from among the connectors connected to the wiring included in the object, generates a selected component image that highlights the selected connector and other components related to the selected connector, and transmits the selected component image, which is displayed so as to overlap the object, to the output device. This makes it possible to improve the work efficiency in tasks such as connector inspection.

[0073] Furthermore, in the information processing apparatus and information processing method according to this embodiment, the controller generates a selection component image that displays the selected connector and the associated connector connected to the other end of the wiring opposite to one end to which the selected connector is connected in different forms. This allows the user to efficiently confirm the selected connector and the other connectors connected to the selected connector via wiring.

[0074] Furthermore, in the information processing apparatus and information processing method according to this embodiment, the controller generates a selection component image that displays the selected connector and the wiring connected to each pin of the selected connector in different forms. This allows the user to efficiently confirm the selected connector and the wiring connected to the pins of the selected connector.

[0075] Furthermore, in the information processing apparatus and information processing method according to this embodiment, the controller generates a selected component image that displays the target wiring connecting the selected connector and related connectors in a different form from the wiring other than the target wiring. This allows the user to efficiently confirm the wiring from the selected connector to the connectors related to the selected connector.

[0076] Furthermore, in the information processing apparatus and information processing method according to this embodiment, if an intermediate connector different from the selected connector and the related connector is connected to the target wiring connecting the selected connector and the related connector, the controller generates a selected component image that displays the selected connector and the intermediate connector in different forms from each other. This allows the user to efficiently confirm the connectors between the selected connector and the connectors related to that connector.

[0077] Furthermore, in the information processing apparatus and information processing method according to this embodiment, the controller transmits a connector information image containing connector information relating to the selected connector and / or related connectors to the output device. The connector information relating to the selected connector includes at least one of the following: the shape, model, pin configuration, voltage, and wiring connected to the selected connector. The connector information relating to the related connector includes at least one of the following: the shape, model, pin configuration, voltage, and wiring connected to the related connector. This allows the user to efficiently confirm detailed information about the selected connector and / or connectors related to the selected connector.

[0078] Furthermore, in the information processing apparatus and information processing method according to this embodiment, the controller acquires wiring information relating to the wiring, transmits a reference component image to the output device so that the reference component image representing the wiring overlaps the object based on the wiring information, and when the user performs an operation to set the emphasis of the reference component image representing the wiring, the emphasis of the reference component image representing wiring other than the target wiring connecting the selected connector and related connectors is changed to the set emphasis. This allows the user to change the emphasis of other wiring while highlighting the wiring between the selected connector and the connectors related to the selected connector.

[0079] Furthermore, in the information processing apparatus and information processing method according to this embodiment, the controller switches between displaying on the output device a connector information image including the pin configuration on the wiring side connected to the wiring of the selected connector, and a connector information image including the pin configuration on the electronic component side opposite to the wiring side of the selected connector, in response to user operation. This allows the user to switch and confirm the pin configuration of the connector.

[0080] Furthermore, in the information processing apparatus and information processing method according to this embodiment, the controller acquires component information relating to a component equipped with a fuse among the components included in the object, and based on the component information, displays a reference component image representing the component on the output device so that the reference component image representing the component overlaps with the object, acquires information indicating the selected fuse selected by the user among the fuses, and displays a selected component image including information about the selected fuse on the output device. This allows the user to efficiently confirm the fuses included in the selected component.

[0081] Furthermore, in the information processing apparatus and information processing method according to this embodiment, the controller displays the selected part image on the output device such that the selected part image overlaps with an image of the target object or with the real space containing the target object. As a result, the user can view the extended space including the vehicle with the selected part image overlapping via the output device.

[0082] <<Second Embodiment>> In the first embodiment, the information processing device was described as being installed in a terminal, but the invention is not limited to this, and the information processing device may be installed in a server located at a location separate from the terminal. An example in which the information processing device is installed in a server will be described below. Figure 6 is a configuration diagram showing an example of an information processing system including an information processing device according to the second embodiment of the present invention. As shown in Figure 6, the information processing system 100 includes a terminal 1, a server 2, and a network 3. In the second embodiment, the information processing system 100 includes an information processing device. 14The second embodiment differs from the first embodiment in that it includes a server 2 equipped with a network 3 for sending and receiving information between the terminal 1 and the server 2. That is, in the first embodiment, information was directly exchanged between the input device 11, output device 12 and detection device 13 and the information processing device 14 in the terminal 1, but in the second embodiment, information is exchanged between the input device 11, output device 12 and detection device 13 and the information processing device 14 via the terminal communication device 15 and the server communication device 16. The other configurations are the same as in the first embodiment described above, and in the following description, the same configurations and control processes as in the first embodiment will be omitted from the description, but the description of the first embodiment will be appropriately referenced in the omitted descriptions.

[0083] Terminal 1 includes a terminal communication device 15. The terminal communication device 15 is a device that can communicate with the server communication device 16 via a network 3 and exchanges information with each other. The network 3 refers to a telecommunications network such as the Internet or a LAN, and is not particularly limited as long as it can exchange information between the terminal communication device 15 and the server communication device 16; any known network can be used. The terminal communication device 15 transmits, for example, information input to the input device 11 and information detected by the detection device 13 to the server communication device 16. The information input to the input device 11 includes information indicating the selected connector. The terminal communication device 15 also receives, for example, a part image from the server communication device 16. The part image includes a reference part image and a selected part image. The part image received by the terminal communication device 15 is transmitted to the output device 12. When the output device 12 receives the part image, it displays the part image so that it overlaps with the vehicle.

[0084] Server 2 includes a server communication device 16. The server communication device 16 is a device that can communicate with the terminal communication device 15 via the network 3 and exchanges information with each other. For example, the server communication device 16 receives information input to the input device 11 and information detected by the detection device 13 from the terminal communication device 15. The server communication device 16 also transmits, for example, a component image generated by the information processing device 14 to the terminal communication device 15.

[0085] The controller 140 acquires information input to the input device 11 via the server communication device 16. The acquired information includes, for example, information indicating the selected connector. The controller 140 transmits the component image to the output device 12. For example, the controller 140 generates a selected component image based on the acquired information indicating the selected connector and transmits the selected component image to the output device 12 via the server communication device 16 and the terminal communication device 15. Alternatively, the controller 140 may transmit the selected component image and a control command to display the selected component image to the output device 12.

[0086] As described above, the terminal according to this embodiment inputs information indicating a selected connector chosen by the user from among the connectors to be connected to the wiring included in the object, transmits the information indicating the selected connector to an information processing device that generates a selected component image based on the information indicating the selected connector, receives the selected component image from the information processing device, displays the selected component image so that it overlaps with the object, and the selected component image is an image that highlights the selected connector and other components related to the selected connector. This makes it possible to improve the work efficiency in tasks such as connector inspection.

[0087] The embodiments described above are provided to facilitate understanding of the present invention and are not intended to limit it. Therefore, each element disclosed in the above embodiments is intended to include all design modifications and equivalents that fall within the technical scope of the present invention. Furthermore, the components described in the above embodiments may be combined as needed, and the combinations of components are not particularly limited. [Explanation of Symbols]

[0088] 1…Terminal 11…Input device 12…Output device 13…Detection device 14…Information Processing Devices 140... Controller 141...Specific target area 142…Intelligence Prompt Department 143…Memory Device

Claims

1. An information processing device comprising a controller that transmits information to an output device that outputs received information, The aforementioned controller, The system retrieves information indicating the selected connector chosen by the user from among the connectors connected to the wiring included in the object. A selection component image is generated that highlights the selection connector and other components related to the selection connector in different ways. An information processing device that transmits the selected part image, which is displayed so as to overlap the object, to the output device.

2. The aforementioned controller, The information processing apparatus according to claim 1, which generates a selected component image in which the selected connector and the associated connector connected to the other end of the wiring opposite to one end to which the selected connector is connected are displayed in different forms.

3. The aforementioned controller, The information processing apparatus according to claim 1 or 2, which generates a selected component image that highlights the selected connector and the wiring connected to each pin of the selected connector.

4. The aforementioned controller, The information processing apparatus according to claim 2, which generates a selected component image that displays the target wiring connecting the selected connector and the associated connector in a different form from the other wiring.

5. The aforementioned controller, The information processing apparatus according to claim 2 or 4, which generates the selected component image in which the selected connector and the intermediate connector are displayed in different forms from each other, if there is an intermediate connector that is different from the selected connector and the associated connector and is connected to the target wiring that connects the selected connector and the associated connector.

6. The aforementioned controller, A connector information image including connector information relating to the selected connector and / or the related connector is transmitted to the output device. The connector information relating to the selection connector includes at least one of the shape, model, pin configuration, voltage, and wiring connected to the selection connector. The information processing device according to claim 2 or 4, wherein the connector information relating to the related connector includes at least one of the shape, type, pin configuration, voltage of the related connector, and the wiring connected to the related connector.

7. An information processing device comprising a controller that transmits information to an output device that outputs received information, The aforementioned controller, Obtain wiring information regarding the wiring contained in the object, Based on the wiring information, a reference component image representing the wiring, displayed so as to overlap the object, is transmitted to the output device. The system obtains information indicating the selected connector chosen by the user from among the connectors connected to the aforementioned wiring. A selection component image is generated that displays the selection connector and the associated connector connected to the other end of the wiring opposite to one end to which the selection connector is connected, in different forms from each other. The selected part image, which is displayed so as to overlap the object, is transmitted to the output device. If the user performs an operation to set the emphasis of the reference component image representing the wiring, the information processing device changes the emphasis of the reference component image representing the wiring other than the target wiring connecting the selected connector and the associated connector to the set emphasis.

8. The aforementioned controller, In response to the user's operation, the system selects either a connector information image including the pin configuration on the wiring side of the selected connector that connects to the wiring, or a connector information image including the pin configuration on the electronic component side opposite to the wiring side of the selected connector. The information processing apparatus according to claim 1 or 2, which transmits the selected connector information image to the output device.

9. The aforementioned controller, Obtain component information relating to the component equipped with a fuse among the components included in the aforementioned object. Based on the aforementioned part information, a reference part image representing the part, which is displayed so as to overlap the object, is transmitted to the output device. The system acquires information indicating the selected fuse chosen by the user from among the aforementioned fuses. The information processing device according to claim 1 or 2, which transmits the selected component image, which includes information regarding the selected fuse, to the output device.

10. The aforementioned controller, The information processing apparatus according to claim 1 or 2, which transmits to the output device an image of the object, or an image of the selected component that is displayed so as to overlap with the real space including the object.

11. An information processing device comprising a controller that transmits information to an output device that outputs received information, The aforementioned controller, The system retrieves information indicating the selected connector chosen by the user from among the connectors connected to the wiring included in the object. A selection component image is generated by adding different marker images to the selection connector and the associated connector connected to the other end of the wiring opposite to one end to which the selection connector is connected. An information processing device that transmits the selected part image, which is displayed so as to overlap the object, to the output device.

12. An information processing device comprising a controller that transmits information to an output device that outputs received information, The aforementioned controller, Obtain wiring information regarding the wiring contained in the object, Based on the wiring information, a reference component image representing the wiring is transmitted to the output device. The system obtains information indicating the selected connector chosen by the user from among the connectors connected to the aforementioned wiring. A selected component image is generated that highlights the selected connector and other components related to the selected connector. The selected part image, which is displayed so as to overlap the object, is transmitted to the output device. If the user performs an operation to set the emphasis of the reference component image representing the wiring, the information processing device changes the emphasis of the reference component image representing the wiring other than the target wiring connecting the selected connector and the associated connector connected to the other end of the wiring opposite to one end to which the selected connector is connected to the set emphasis.

13. An input device for entering information, A communication device capable of communicating with an information processing device, It comprises an output device that outputs information, The aforementioned input device is Enter information indicating the selected connector among the connectors to be connected to the wiring included in the object, as chosen by the user. The aforementioned communication device is The information processing device that generates a selected component image based on the information indicating the selected connector transmits the information indicating the selected connector to the information processing device, The information processing device receives the selected part image, The output device is The selected part image is displayed so that it overlaps with the object. The aforementioned selected component image is a terminal device in which the selected connector and other components related to the selected connector are highlighted in different ways from each other.

14. An information processing method performed by a controller that transmits information to an output device that outputs received information, The aforementioned controller, The system retrieves information indicating the selected connector chosen by the user from among the connectors connected to the wiring included in the object. A selection component image is generated that highlights the selection connector and other components related to the selection connector in different ways. An information processing method for transmitting the selected part image, which is displayed so as to overlap the object, to the output device.

Images