Information providing method and device, and computer-readable non-transitory storage medium

Abstract

The present invention provides an information providing method, a computer-readable non-temporary storage medium storing a program, and an information providing device. The information providing method is a method in which a terminal device (12) having a photographing unit (16) and a display unit (28) displays an image of the interior of a vehicle (100) captured by the photographing unit on the display unit. A plurality of devices (102) are arranged in the vehicle, and the plurality of devices are classified into a plurality of categories. The method comprises an image acquisition step (S1) and a display step (S5). In the image acquisition step (S1), an image of the interior of the vehicle captured by the photographing unit is acquired; in the display step (S5), the image is displayed on the display unit, and when at least one of the plurality of devices is included in the image, a graphic corresponding to the device is displayed on the device in an overlapping manner, and information indicating the category to which the device belongs is also displayed. Accordingly, information related to the devices in the vehicle can be better provided.

Description

Technical Field

[0001] The present invention relates to an information providing method, a computer-readable non-transitory storage medium storing a program, and an information providing device. Background Art

[0002] A vehicle information providing system for providing vehicle information is disclosed in Japanese Patent Publication No. 2018-36811. In Japanese Patent Publication No. 2018-36811, a photo of the query object part of the vehicle's equipment and equipment is taken by a mobile terminal, and the taken photo is sent from the mobile terminal to a processing server. The processing server has an identification server and an FAQ database. The identification server identifies the query object part shown in the photo sent from the mobile terminal. The FAQ database has a plurality of explanatory information for explanations related to the equipment and equipment. The processing server selects and sends the explanatory information corresponding to the query object part identified by the identification server from the FAQ database. The explanatory information sent from the processing server is displayed by a display device provided in the vehicle. Summary of the invention

[0003] However, Japanese Patent Publication No. 2018-36811 simply discloses that the display device displays the description information corresponding to the query object part shown in the photo. That is, the information providing system disclosed in Japanese Patent Publication No. 2018-36811 may not be able to provide information related to the equipment in the car well.

[0004] The purpose of the present invention is to solve the above technical problems.

[0005] An information providing method involved in one embodiment of the present invention is a method in which a terminal device having a camera and a display unit displays an image of the interior of a vehicle captured by the camera on the display, wherein a plurality of devices are arranged in the vehicle, and the plurality of devices are classified into a plurality of categories. The information providing method comprises an image acquisition step and a display step, wherein in the image acquisition step, the image of the interior of the vehicle captured by the camera is acquired; in the display step, the image is displayed on the display, and when at least one of the plurality of devices is included in the image, a graphic corresponding to the device is displayed overlappingly on the device, and information indicating the category to which the device belongs is also displayed.

[0006] A computer-readable non-transitory storage medium storing a program according to another aspect of the present invention stores a program for causing a computer to execute the above-mentioned information providing method.

[0007] Another embodiment of the present invention relates to an information providing device having a camera unit and a display unit, and displaying an image of the interior of a vehicle captured by the camera unit on the display unit. A plurality of devices are arranged in the vehicle, and the plurality of devices are classified into a plurality of categories. The information providing device has an image acquisition unit and a display control unit, wherein the image acquisition unit acquires the image of the interior of the vehicle captured by the camera unit; the display control unit displays the image on the display unit, and when at least one of the plurality of devices is included in the image, causes a graphic corresponding to the device to be displayed overlappingly on the device, and also displays information indicating the category to which the device belongs.

[0008] According to the present invention, it is possible to provide an information providing method capable of better providing information related to equipment in a vehicle, a computer-readable non-transitory storage medium storing a program, and an information providing apparatus.

[0009] The above-mentioned objects, features and advantages will be easily understood from the following description of the embodiments with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 This is a block diagram showing an information providing system according to one embodiment.

[0011] Figure 2 The diagrams show examples of images displayed on the display screen of the display unit.

[0012] Figure 3 The diagrams show examples of images displayed on the display screen of the display unit.

[0013] Figure 4 The diagrams show examples of images displayed on the display screen of the display unit.

[0014] Figure 5 This is a flowchart showing an example of an information providing method according to an embodiment.

[0015] Figure 6 This is a flowchart showing an example of an information providing method according to an embodiment.

[0016] Figure 7 This is a flowchart showing an example of an information providing method according to an embodiment.

[0017] Figure 8 This is a flowchart showing an example of an information providing method according to an embodiment.

[0018] Fig. 9 This is a flowchart showing an example of an information providing method according to an embodiment. DETAILED DESCRIPTION

[0019] [One embodiment]

[0020] use Figures 1 to 9 An information providing method, a computer-readable non-transitory storage medium storing a program, and an information providing device according to an embodiment will be described. Figure 1 It is a block diagram showing the information providing system involved in this embodiment.

[0021] The information providing system 10 according to the present embodiment can be composed of a terminal device (user terminal, mobile terminal, information providing device) 12 and a server device (server) 14 , but is not limited thereto.

[0022] The terminal device 12 includes a camera 16, a sensor group 18, a computing unit 20, a storage unit 22, a communication device 24, an operation unit 26, and a display unit 28. In addition, the terminal device 12 can also include components other than these components, but the description thereof is omitted here. The server device 14 includes a computing unit 48, a storage unit 50, and a communication device 52. In addition, the server device 14 can also include components other than these components, but the description thereof is omitted here.

[0023] An application program for causing a computer to execute the information providing method according to the present embodiment is pre-installed in the terminal device 12. The application program can be started based on, for example, a user's operation.

[0024] The imaging unit 16, that is, the camera can be provided at least on the back side of the terminal device 12. The image acquired by the imaging unit 16 is displayed on the display screen 28A (see FIG. 2A ) of the display unit 28 provided on the front side (front side) of the terminal device 12. Figure 2 )superior.

[0025] The sensor group 18 can include, for example, an acceleration sensor 30 and a gyro sensor 32. The acceleration sensor 30 can, for example, simultaneously measure accelerations in three directions. The gyro sensor 32, i.e., an angular velocity sensor, can, for example, simultaneously measure angular velocities in three directions. Based on the information obtained by the acceleration sensor 30 and the gyro sensor 32, the three-dimensional behavior of the terminal device 12 can be grasped.

[0026] The computing unit 20 can be constituted by, for example, a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), etc., but is not limited thereto. The computing unit 20 includes a control unit 34, an image acquisition unit 36, a correction unit 38, a position and posture determination unit 40, a determination unit 42, a display control unit 44, and an information acquisition unit 46. The control unit 34, the image acquisition unit 36, the correction unit 38, the position and posture determination unit 40, the determination unit 42, the display control unit 44, and the information acquisition unit 46 can be realized by the computing unit 20 executing a program stored in the storage unit 22.

[0027] The storage unit 22 includes a volatile memory (not shown) and a nonvolatile memory (not shown). Examples of the volatile memory include RAM, etc. Examples of the nonvolatile memory include ROM, flash memory, etc. Programs, tables, maps, etc., for example, can be stored in the nonvolatile memory.

[0028] The communication device (communication unit) 24 has, for example, a communication module (not shown) that can correspond to a mobile phone network. The communication device 24 can communicate via the telephone network. The communication device 24 can communicate with the communication device 52 provided in the server device 14 via the relay station 54 and the network 56.

[0029] The operation unit 26 can be used when the user operates the terminal device 12. The display unit 28 has a display element not shown. The display element can use a liquid crystal display element, an organic electroluminescent display element, etc. The operation unit 26 and the display unit 28 can be configured by a touch panel not shown having such a display element.

[0030] The control unit 34 is responsible for overall control of the terminal device 12 .

[0031] The image acquisition unit 36 ​​can acquire the image of the interior of the vehicle captured by the imaging unit 16 .

[0032] The calibration unit 38 can perform calibration processing. Before starting to provide information to the user, calibration can be performed. When the application program according to the present embodiment is activated, for example, the camera unit 16 of the terminal device 12 can be used to capture a video of the vehicle 100 (see FIG. 1 ). Figure 2) is used to perform the calibration. More specifically, the user aligns the imaging unit 16 of the terminal device 12 with the home page button so that the home page button is displayed in a specified size at the center of the display screen 28A of the display unit 28. The calibration unit 38 can determine the position and posture of the terminal device 12 based on the image including the home page button and the signal supplied from the sensor group 18. When it is determined that the position and posture of the terminal device 12 are within a predetermined range, the calibration unit 38 determines that the calibration is successful and completes the calibration. When the calibration is completed, the display control unit 44 displays information indicating that the calibration is completed on the display screen 28A of the display unit 28. As information indicating that the calibration is completed, for example, a check mark not shown in the figure can be cited.

[0033] The position and posture determination unit 40 can determine the position and posture of the terminal device 12. The position and posture determination unit 40 stores information related to the position and posture of the terminal device 12 in the storage unit 22. That is, the position and posture determination unit 40 stores the position and posture information in the storage unit 22. The position and posture determination unit 40 uses the position and posture information obtained during calibration as a reference, and updates the position and posture information at any time based on the image acquired by the image acquisition unit 36 ​​and the signal supplied from the sensor group 18.

[0034] Figure 2 FIG. 1 is a diagram showing an example of an image displayed on a display screen of a display unit. Figure 2 2 shows an example of an image displayed when photographing the interior of a vehicle, that is, the interior of the vehicle (interior of the vehicle) 100. Figure 2 As shown, an image of the interior of the vehicle 100 can be displayed. A plurality of operation buttons 60A to 60C can be displayed on a portion of the display screen 28A. The operation button 60A is, for example, a useful information button. The operation button 60B is, for example, a warning light list button. The operation button 60C is, for example, a setting button. In addition, the operation buttons 60A to 60C are not limited thereto. The operation button 60A, i.e., the useful information button, is a button for switching to a screen displaying information that is assumed to be useful to the user. The operation button 60B, i.e., the warning light list button, is a button for switching to a screen displaying a warning light list. The operation button 60C, i.e., the setting button, is a button for switching to a screen for performing various settings related to the application. The recalibration button 60D, the voice search button 60E, etc. can also be displayed on the display screen 28A, but are not limited thereto. The recalibration button 60D is a button for instructing execution of recalibration. The voice search button 60E is a button for instructing execution of voice search.

[0035] like Figure 2As shown, a plurality of devices 102A to 102O are provided in the vehicle 100. When describing the device as a whole, reference numeral 102 is used, and when describing each device, reference numerals 102A to 102O are used. Device 102A is, for example, an infotainment multi-window display device. Device 102B is, for example, a driving system display. Devices 102C and 102D are, for example, driving system rear displays. Device 102E is, for example, a steering wheel. Device 102F is, for example, a content multi-way switch. Device 102G is, for example, a driving system switch. Device 102H is, for example, an infotainment switch. Device 102I is, for example, a simple parking switch. Device 102J is, for example, a hazard warning light switch. Device 102K is, for example, an air conditioner, i.e., an air conditioning device. Device 102L is, for example, a console operation system switch. Device 102M is, for example, an ETC vehicle-mounted device. Device 102N is, for example, a camera exterior mirror system adjustment switch. The device 102O is, for example, a vehicle door handle.

[0036] like Figure 2 As shown, in this embodiment, graphics 31A to 31O corresponding to these devices 102A to 102O are overlapped and displayed on these devices 102A to 102O, and information indicating the types of these devices 102A to 102O is displayed at the same time. That is, in this embodiment, augmented reality (AR) display can be performed. In addition, when describing the entire graphic, the reference numeral 31 is used, and when describing each graphic, the reference numerals 31A to 31O are used.

[0037] The determination unit 42 determines whether at least one of the multiple devices 102 set in the vehicle 100 is included in the image acquired by the image acquisition unit 36. More specifically, the determination unit 42 determines whether the device 102 that is the object of augmented reality display is included in the image. This determination can be performed based on the position and posture information obtained by the position and posture determination unit 40 and the image acquired by the image acquisition unit 36. In addition to the image acquired by the image acquisition unit 36, it is also determined whether the device 102 that is the object of augmented reality display is included in the image based on the position and posture information, which is for more accurate determination. Information indicating the device 102 set in the vehicle 100 is pre-stored in the storage unit 22. More specifically, the position information of each of the multiple devices 102 set in the vehicle 100, the image information of each of these devices 102, etc. are pre-stored in the storage unit 22. The determination unit 42 compares this information stored in the storage unit 22 with the information obtained from the image acquired by the image acquisition unit 36. Based on this, the determination unit 42 can determine whether at least one of the multiple devices 102 installed in the vehicle 100 is included in the image. In addition, the determination unit 42 can also determine whether the device 102 included in the image is any one of the multiple devices 102 installed in the vehicle 100.

[0038] The plurality of devices 102 provided in the vehicle 100 are pre-classified into a plurality of categories. For example, the classification can be performed according to the functions of the devices 102, but is not limited thereto. Such categories include, for example, a driving system, an entertainment system, a comfort system, etc., but are not limited thereto. The device 102 classified as a driving system is a device related to the driving of the vehicle, and for example, a speedometer, etc. can be cited. The device 102 classified as an entertainment system is a device associated with entertainment, and for example, an audio device, etc. can be cited. The device 102 classified as a comfort system is a device for ensuring the comfort of the vehicle 100, and for example, an air conditioning device, etc. can be cited.

[0039] When the image acquired by the image acquisition unit 36 ​​is displayed on the display screen 28A of the display unit 28 and at least one of the plurality of devices 102 installed in the vehicle 100 is included in the image, the display control unit 44 performs the following processing. That is, in this case, the display control unit 44 causes the graphic 31 corresponding to the device 102 to be displayed superimposed on the device 102, and also displays information indicating the category to which the device 102 belongs.

[0040] The graphic 31 corresponding to the device 102 is, for example, a semi-transparent graphic, but the present invention is not limited thereto. For example, only the outline of the graphic 31 may be displayed.

[0041] The information indicating the type to which the device 102 belongs is, for example, a color corresponding to the type. A graphic 31 of a color corresponding to the type is displayed superimposed on the device 102, so that the user can well understand the function of the device 102 based on the color. For example, a device 102 of a driving system can use, for example, a red graphic 31. In addition, a device 102 of an entertainment system can use, for example, a blue graphic 31. In addition, a device 102 of a comfort system can use, for example, a yellow graphic 31. In addition, the information indicating the type to which the device 102 belongs is not limited to this.

[0042] Preferably, the graphic 31 corresponding to the device 102 is a three-dimensional graphic. Displaying the three-dimensional graphic 31 helps the user to recognize it smoothly.

[0043] In addition, it is preferable that the graphic 31 corresponding to the device 102 is a graphic of a size corresponding to the size of the device 102. Displaying the graphic 31 of a size corresponding to the size of the device 102 also helps the user to recognize it smoothly.

[0044] In addition, it is preferable that the graphic 31 corresponding to the device 102 is a graphic having a shape corresponding to the shape of the device 102. Displaying the graphic 31 having a shape corresponding to the shape of the device 102 also helps the user to recognize it smoothly.

[0045] In addition, if Figure 2 As shown, the name of the device 102 and the like may also be displayed together with the graphic 31 corresponding to the device 102 .

[0046] The device 102 installed in the vehicle 100 may include a plurality of components (structural elements) 104FA, 104FB, 104FC (see Figure 4 ). In addition, when describing the components as a whole, reference numeral 104 is used, and when describing the individual components of the device 102F, reference numerals 104FA, 104FB, and 104FC are used. The component 104 can include operating components such as operating switches, operating buttons, and operating levers. In addition, component 104FA is a rotary selector (selector wheel). Component 104FB is a home page switch. Component 104FC is a sound switch. In addition, component 104 can include a display such as a tachometer. In addition, component 104 is not limited to this.

[0047] Although the device 102 includes a plurality of components 104 constituting the device 102, when the distance between the terminal device 12 and the device 102 is relatively large, the plurality of components 104 are captured in an image in a state close to each other. In this case, when simply displaying the information 64FA to 64FC related to the plurality of components 104 (see Figure 4 ), it is difficult to understand which component 104 the information is related to. When describing the information as a whole, figure mark 64 is used, and when describing each piece of information, figure marks 64FA to 64FC are used. On the other hand, when the distance between the terminal device 12 and the device 102 is relatively small, adjacent components 104 are captured in the image in a state where they are sufficiently far away from each other. In this case, even if information 64 related to a plurality of components 104 is displayed for each of the plurality of components 104, the user can well understand which component 104 the information 64 is related to. Therefore, in the present embodiment, when the distance between the device 102 and the terminal device 12 is greater than the first distance threshold DTH1, the information 64 related to the component 104 is not displayed for the component 104, but the graphic 31 corresponding to the device 102 is displayed overlappingly on the device 102. On the other hand, when the distance between the terminal device 12 and the device 102 is less than the first distance threshold DTH1, the graphic 31 related to the device 102 is not displayed superimposed on the device 102, but information 64 related to the component 104 of the device 102 is displayed. The information 64 related to the component 104 can include, for example, the name of the component 104, but is not limited to this. In addition, the distance between the terminal device 12 and the device 102 can be measured using, for example, the distance measurement function of the imaging unit 16, but is not limited to this.

[0048] Figure 3 FIG. 1 is a diagram showing an example of an image displayed on a display screen of a display unit. Figure 3 FIG. 1 shows an example of an image in which the distance between the device 102F and the terminal device 12 is relatively large. Figure 3 As shown, the display control unit 44 does not communicate with the components 104FA to 104FC (see Figure 4 ) is not displayed, but a graphic 31F related to the device 102F is displayed superimposed on the device 102F. The device 102F may be an entertainment system, for example. Therefore, the graphic 31F may be displayed in blue, for example.

[0049] Figure 4 FIG. 1 is a diagram showing an example of an image displayed on a display screen of a display unit. Figure 4FIG. 4 shows an example of an image displayed when the distance between the device 102F and the terminal device 12 is relatively small. Figure 4 As shown, the display control unit 44 does not communicate with the device 102F (see Figure 3 ) corresponding to the graph 31F (refer to Figure 3 ) is displayed on the device 102F, but the information 64FA to 64FC related to the components 104FA to 104FC constituting the device 102F is displayed. As described above, the device 102F may belong to an entertainment system, for example. Therefore, the information 64FA to 64FC related to the components 104FA to 104FC may be displayed in blue, for example.

[0050] In a state where the graphic 31 corresponding to the device 102 is displayed superimposed on the device 102, when the distance between the device 102 and the terminal device 12 is less than the first distance threshold DTH1, the display control unit 44 can perform the following control. Figure 3 When the distance between the device 102 and the terminal device 12 is less than the first distance threshold DTH1 in the display state, the display control unit 44 can perform the following control. Figure 4 As shown, the display control unit 44 can hide the graphic 31 corresponding to the device 102 and display the information 64 related to the component 104 constituting the device 102 .

[0051] When the distance between the device 102 and the terminal device 12 reaches or exceeds the second distance threshold DTH2 which is greater than the first distance threshold DTH1 while the information 64 related to the component 104 constituting the device 102 is displayed, the display control unit 44 can perform the following control. Figure 4 When the distance between the device 102 and the terminal device 12 reaches a second distance threshold DTH2 greater than the first distance threshold DTH1 in the display state shown in FIG. Figure 3 As shown, the display control unit 44 can hide the information 64 related to the components 104 constituting the device 102 and display the graphic 31 related to the device 102 in an overlapping manner on the device 102 .

[0052] In this way, the distance threshold when the state of transitioning to displaying the information 64 related to the component 104 of the device 102 is changed from the distance threshold when the state of transitioning to displaying the graphic 31 related to the device 102 in an overlapping manner on the device 102 can be made different from each other. In this way, even if the terminal device 12 is away from the device 102 to some extent, the information 64 related to the component 104 constituting the device 102 continues to be displayed on the display screen 28A of the display unit 28, which helps to improve convenience.

[0053] When the time for which the user continues to observe the display unit 28 displaying the information 64 is longer than the time threshold TTH, the display control unit 44 can perform the following control, wherein the information 64 is information related to the component 104 constituting the device 102. That is, in this case, when the distance between the device 102 and the terminal device 12 reaches or exceeds the third distance threshold DTH3, the display control unit 44 makes the information 64 related to the component 104 not displayed, and causes the graphic 31 corresponding to the device 102 to be displayed in an overlapping manner on the device 102. On the other hand, when the time for which the user continues to observe the display unit 28 displaying the information 64 is shorter than the time threshold TTH, the display control unit 44 can perform the following processing, wherein the information 64 is information related to the component 104. That is, in this case, when the distance between the device 102 and the terminal device 12 reaches or exceeds the fourth distance threshold DTH4, the information 64 related to the component 104 is not displayed, and causes the graphic 31 related to the device 102 to be displayed in an overlapping manner on the device 102. The fourth distance threshold DTH4 can be set smaller than the third distance threshold DTH3.

[0054] In this way, the distance threshold for transitioning to a state where the information 64 is not displayed can be made different according to the time for which the user continues to observe the display unit 28 displaying the information 64, which is information about the component 104 constituting the device 102. In this way, when the user observes the information 64 about the component 104 for a relatively long time, even if the terminal device 12 is away from the device 102 to some extent, the information 64 about the component 104 continues to be displayed on the display screen 28A of the display unit 28. Therefore, it helps to improve convenience.

[0055] In a state where the graphic 31 corresponding to the device 102 is displayed overlappingly on the device 102, when the user selects the graphic 31, the display control unit 44 can display detailed information about the device 102 on which the selected graphic 31 is displayed overlappingly on the display screen 28A of the display unit 28. More specifically, the following processing can be performed. That is, in a state where the graphic 31 corresponding to the device 102 is displayed overlappingly on the device 102, when the user selects the graphic 31, the information acquisition unit 46 performs the following processing. That is, in this case, the information acquisition unit 46 sends the identification information indicating the device 102 on which the graphic 31 is displayed overlappingly to the server device 14 through the communication device 24. The server device 14 reads the information about the device 102 from the storage unit 50 of the server device 14, and sends the information to the terminal device 12 through the communication device 52 of the server device 14. The information acquisition unit 46 receives detailed information about the device 102 from the server device 14. The display control unit 44 displays the detailed information about the device 102 on the display screen 28A of the display unit 28. In addition, when the detailed information about the device 102 is already stored in the storage unit 22 of the terminal device 12, it is not necessary to obtain the detailed information from the server device 14. In this case, the information acquisition unit 46 can obtain the detailed information from the storage unit 22 of the terminal device 12.

[0056] As described above, sometimes the device 102 has a plurality of components 104 constituting the device 102. Information on whether the device 102 has a plurality of components 104 is pre-stored in the storage unit 22. In a state where a graphic 31 corresponding to the device 102 is displayed overlappingly on the device 102 having a plurality of components 104, when the user selects the graphic 31, the display control unit 44 performs the following processing. That is, in this case, the display control unit 44 can display a detailed information list on the display screen 28A of the display unit 28, and the detailed information list is information related to the plurality of components 104 constituting the device 102 that constitutes the selected graphic 31 that is displayed overlappingly. More specifically, the following processing can be performed. That is, in a case where the user selects a graphic 31 that is displayed overlappingly on the device 102 having a plurality of components 104, the information acquisition unit 46 sends identification information indicating the device 102 on which the graphic 31 is displayed overlappingly to the server device 14 via the communication device 24. The server device 14 reads out a detailed information list about the plurality of components 104 of the device 102 from the storage unit 50 of the server device 14, and transmits the list to the terminal device 12 via the communication device 52 of the server device 14. The information acquisition unit 46 receives the detailed information list about the plurality of components 104 of the device 102 from the server device 14. The display control unit 44 displays the detailed information list about the plurality of components 104 of the device 102 on the display screen 28A of the display unit 28. In addition, when the detailed information list about the plurality of components 104 of the device 102 is already stored in the storage unit 22 of the terminal device 12, it is not necessary to acquire the detailed information list from the server device 14. In this case, the information acquisition unit 46 can acquire the detailed information list from the storage unit 22 of the terminal device 12. Furthermore, when the detailed information list is displayed on the display screen 28A of the display unit 28 , the user can view desired detailed information among the plurality of detailed information included in the detailed information list by appropriately scrolling the display screen 28A.

[0057] like Figure 4As shown, the display control unit 44 can display an icon 66 together with information 64, wherein the icon 66 is an icon for indicating that detailed information related to the component 104 is displayed; the information 64 is information related to the component 104 that constitutes the device 102. The display control unit 44 can display the information 64 related to the component 104 and the icon 66 in the frames 62FA to 62FC. When the frame is described as a whole, the reference numeral 62 is used, and when the individual frames are described, the reference numerals 62FA to 62FC are used. The display control unit 44 can display the frame 62 with a conversation balloon 74. The display control unit 44 can position the tip of the conversation balloon 74 at the position of the component 104 corresponding to the frame 62.

[0058] In the state where the information 64 related to the component 104 possessed by the device 102 is displayed, when the user selects the icon 66 for indicating the display of the detailed information of the component 104, the display control unit 44 displays the detailed information related to the component 104 on the display unit 28. More specifically, the following processing can be performed. That is, in this case, the information acquisition unit 46 sends the identification information representing the component 104 to the server device 14 through the communication device 24. The server device 14 reads the detailed information related to the component 104 from the storage unit 50 possessed by the server device 14, and sends the detailed information to the terminal device 12 through the communication device 52 possessed by the server device 14. The information acquisition unit 46 receives the detailed information related to the component 104 from the server device 14. The display control unit 44 displays the detailed information related to the component 104 on the display screen 28A of the display unit 28. In addition, when the detailed information related to the component 104 has been stored in the storage unit 22 possessed by the terminal device 12, it is not necessary to obtain the detailed information from the server device 14 again. In this case, the information acquisition unit 46 can acquire the detailed information from the storage unit 22 included in the terminal device 12 .

[0059] The display control unit 44 can make the information 64 related to the device 102 hidden by the device 102 displayed on the image displayed smaller than the information 64 related to the device 102 displayed on the image on the display screen 28A of the display unit 28. Figure 4In the example shown, the device 102M is hidden by the device 102F displayed on the image. In this case, the display control unit 44 can make the information 64M related to the hidden device 102M displayed on the display screen 28A of the display unit 28 smaller than the information 64FA to 64FC related to the device 102F displayed on the image. That is, the display control unit 44 makes the information 64M related to the hidden device 102M displayed on the display screen 28A of the display unit 28 smaller than the information 64FA to 64FC related to the components 104FA to 104FC constituting the device 102F displayed on the image. According to this, the user can well understand whether it is the information 64 related to the device 102 displayed on the image or the information 64 related to the hidden device 102.

[0060] When the user performs an operation for not displaying the information 64 related to the hidden device 102, the display control unit 44 can not display the information 64 related to the hidden device 102. As an operation for not displaying the information 64 related to the hidden device 102, for example, the selection of the non-display button 76 for not displaying the information 64 related to the hidden device 102 can be cited. In addition, as an operation for not displaying the information 64 related to the hidden device 102, a sliding operation on the frame 62 showing the information 64 related to the hidden device 102 can be cited. For example, in Figure 4 In the example shown, when the user selects the non-display button 76, the display control unit 44 causes the information 64M related to the hidden device 102M to not be displayed. Figure 4 In the illustrated example, when the frame 62M is slid, the display control unit 44 causes the information 64M related to the hidden device 102M to not be displayed.

[0061] When the user performs an operation for not displaying the information 64 related to the device 102 displayed on the image, the display control unit 44 can not display the information 64 related to the device 102. As an operation for not displaying the information 64 related to the device 102 displayed on the image, for example, a selection of a non-display button 76 for not displaying the information 64 related to the device 102 can be cited. In addition, as an operation for not displaying the information 64 related to the device 102, a sliding operation on the frame 62 showing the information 64 related to the device 102 can be cited. For example, in Figure 4 In the example shown, when the user selects the non-display button 76 displayed superimposed on the components 104FA to 104FC, the display control unit 44 causes the information 64FA to 64FC related to the device 102F to not be displayed. Figure 4In the illustrated example, when the frames 62FA to 62FC are slid, the display control unit 44 hides the information 64FA to 64FC related to the device 102F.

[0062] The display control unit 44 can display a not-shown unified non-display button on the display screen 28A of the display unit 28. The unified non-display button is a button for collectively non-displaying the information 64 related to each of the plurality of devices 102 hidden by the device 102 displayed on the image. When the user selects this unified non-display button, the display control unit 44 can collectively non-display the information 64 related to each of the plurality of hidden devices 102.

[0063] Next, use Figure 5 An example of the information providing method according to the present embodiment will be described. Figure 5 This is a flowchart showing an example of the information providing method according to the present embodiment.

[0064] First, in step S1, the image acquisition unit 36 ​​acquires an image obtained using the imaging unit 16. Thereafter, the process moves to step S2.

[0065] In step S2, the determination unit 42 determines whether at least one of the multiple devices 102 installed in the vehicle 100 is included in the image acquired by the image acquisition unit 36. If at least one of the multiple devices 102 installed in the vehicle 100 is included in the image (Yes in step S2), the process moves to step S3. More specifically, if the device 102 to be displayed in augmented reality is included in the image, the process moves to step S3. If at least one of the multiple devices 102 installed in the vehicle 100 is not included in the image (No in step S2), the process moves to step S6.

[0066] In step S3, the control unit 34 determines whether the distance between the device 102 and the terminal device 12 is less than the first distance threshold DTH1. If the distance between the device 102 and the terminal device 12 is less than the first distance threshold DTH1 (yes in step S3), the process proceeds to step S4. If the distance between the device 102 and the terminal device 12 is greater than the first distance threshold DTH1 (no in step S3), the process proceeds to step S5.

[0067] In step S4, the display control unit 44 does not display the graphic 31 corresponding to the device 102 superimposed on the device 102, but displays the information 64 related to the component 104 constituting the device 102. When step S4 is completed, Figure 5 The shown processing ends.

[0068] In step S5, the display control unit 44 does not display the information 64 related to the components 104 constituting the device 102, but displays the graphic 31 corresponding to the device 102 in an overlapping manner on the device 102. When step S5 is completed, Figure 5 The indicated processing is completed.

[0069] In step S6, the display control unit 44 displays neither the graphic 31 corresponding to the device 102 nor the information 64 related to the component 104 constituting the device 102 on the display unit 28, but displays the image acquired by the image acquisition unit 36 ​​on the display unit 28. When step S6 is completed, Figure 5 The indicated processing is completed.

[0070] Next, use Figure 6 An example of the information providing method according to the present embodiment will be described. Figure 6 This is a flowchart showing an example of the information providing method according to the present embodiment.

[0071] First, steps S1 and S2 are the same as the above-mentioned steps S1 and S2, and thus description thereof is omitted. If at least one of the plurality of devices 102 installed in the vehicle 100 is included in the image acquired by the image acquisition unit 36 ​​(yes in step S2), the process proceeds to step S11. If at least one of the plurality of devices 102 installed in the vehicle 100 is not included in the image (no in step S2), the process proceeds to step S6.

[0072] In step S11, the display control unit 44 determines whether to display information 64 related to the component 104 constituting the device 102 instead of displaying the graphic 31 corresponding to the device 102 in an overlapping manner on the device 102. In the case where information 64 related to the component 104 constituting the device 102 is displayed instead of displaying the graphic 31 corresponding to the device 102 in an overlapping manner on the device 102 (yes in step S11), the process proceeds to step S12. In the case where information 64 related to the component 104 constituting the device 102 is displayed instead of displaying the graphic 31 corresponding to the device 102 in an overlapping manner on the device 102 (no in step S11), Figure 6 The indicated processing is completed.

[0073] In step S12, the control unit 34 determines whether the distance between the device 102 and the terminal device 12 is greater than or equal to the second distance threshold DTH2. If the distance between the device 102 and the terminal device 12 is less than the second distance threshold DTH2 (No in step S12), the process moves to step S4. If the distance between the device 102 and the terminal device 12 is greater than or equal to the second distance threshold DTH2 (Yes in step S12), the process moves to step S5.

[0074] Steps S4 to S6 are the same as the above-mentioned steps S4 to S6, and thus description thereof will be omitted.

[0075] In this way, it is possible to Figure 6 Processing shown.

[0076] Next, use Figure 7 An example of the information providing method according to the present embodiment will be described. Figure 7 This is a flowchart showing an example of the information providing method according to the present embodiment.

[0077] First, steps S1, S2, and S11 are the same as the above-mentioned steps S1, S2, and S11, and thus the description thereof is omitted. In the case where the information 64 related to the component 104 constituting the device 102 is displayed instead of the graphic 31 corresponding to the device 102 being overlapped and displayed on the device 102 (Yes in step S11), the process proceeds to step S21. In the case where the information 64 related to the component 104 constituting the device 102 is displayed instead of the graphic 31 corresponding to the device 102 being overlapped and displayed on the device 102 (No in step S11), Figure 7 The indicated processing is completed.

[0078] In step S21, the control unit 34 determines whether the time for which the user continues to observe the display unit 28 displaying the information 64 related to the component 104 constituting the device 102 is longer than the time threshold TTH. If the time for which the user continues to observe the display unit 28 displaying the information 64 related to the component 104 is longer than the time threshold TTH (yes in step S21), the process proceeds to step S22. If the time for which the user continues to observe the display unit 28 displaying the information 64 related to the component 104 is shorter than the time threshold TTH (no in step S21), the process proceeds to step S23.

[0079] In step S22, the control unit 34 determines whether the distance between the device 102 and the terminal device 12 is greater than or equal to the third distance threshold DTH3. If the distance between the device 102 and the terminal device 12 is greater than or equal to the third distance threshold DTH3 (yes in step S22), the process proceeds to step S5. If the distance between the device 102 and the terminal device 12 is less than the third distance threshold DTH3 (no in step S22), the process proceeds to step S4.

[0080] In step S23, the control unit 34 determines whether the distance between the device 102 and the terminal device 12 is greater than or equal to the fourth distance threshold DTH4. If the distance between the device 102 and the terminal device 12 is greater than or equal to the fourth distance threshold DTH4 (yes in step S23), the process proceeds to step S5. If the distance between the device 102 and the terminal device 12 is less than the fourth distance threshold DTH4 (no in step S23), the process proceeds to step S4.

[0081] Steps S4 to S6 are the same as the above-mentioned steps S4 to S6, and thus description thereof will be omitted.

[0082] In this way, it is possible to Figure 7 Processing shown.

[0083] Next, use Figure 8 An example of the information providing method according to the present embodiment will be described. Figure 8 This is a flowchart showing an example of the information providing method according to the present embodiment.

[0084] In step S31, the display control unit 44 determines whether the graphic 31 corresponding to the device 102 is displayed overlapping the device 102. If the graphic 31 corresponding to the device 102 is displayed overlapping the device 102 (Yes in step S31), the process moves to step S33. If the graphic 31 corresponding to the device 102 is not displayed overlapping the device 102 (No in step S31), the process moves to step S32.

[0085] In step S32, the display control unit 44 determines whether the information 64 related to the component 104 constituting the device 102 is displayed on the display unit 28. If the information 64 related to the component 104 constituting the device 102 is displayed on the display unit 28 (Yes in step S32), the process proceeds to step S34. If the information 64 related to the component 104 constituting the device 102 is not displayed on the display unit 28 (No in step S32), Figure 8 The indicated processing is completed.

[0086] In step S33, the display control unit 44 determines whether the user has selected a graphic 31 related to the device 102. If the user has selected a graphic 31 corresponding to the device 102 (Yes in step S33), the process moves to step S35. If the user has not selected a graphic 31 corresponding to the device 102 (No in step S33), the process after step S31 is repeated.

[0087] In step S34, the display control unit 44 determines whether the user has selected the icon 66 for indicating the display of detailed information about the component 104 constituting the device 102. If the user has selected the icon 66 (Yes in step S34), the process proceeds to step S38. If the user has not selected the icon 66 (No in step S34), Figure 8 The indicated processing is completed.

[0088] In step S35, the display control unit 44 determines whether the device 102 has a plurality of components 104 constituting the device 102. If the device 102 has a plurality of components 104 (yes in step S35), the process proceeds to step S37. If the device 102 does not have a plurality of components 104 (no in step S35), the process proceeds to step S36.

[0089] In step S36 , the display control unit 44 displays detailed information on the device 102 on which the graphic 31 selected by the user is displayed in a superimposed manner on the display screen 28A of the display unit 28 .

[0090] In step S37 , the display control unit 44 displays, on the display screen 28A of the display unit 28 , a list of detailed information on the plurality of components 104 constituting the device 102 on which the graphic 31 selected by the user is displayed in a superimposed manner.

[0091] In step S38, the display control unit 44 displays detailed information about the component 104 constituting the device 102 on the display screen 28A of the display unit 28. That is, the display control unit 44 displays detailed information about the component 104 whose icon 66 is selected on the display screen 28A of the display unit 28.

[0092] In this way, it is possible to Figure 8 Processing shown.

[0093] Next, use Fig. 9 An example of the information providing method according to the present embodiment will be described. Fig. 9 This is a flowchart showing an example of the information providing method according to the present embodiment.

[0094] In step S41, the display control unit 44 determines whether there is a device 102 hidden by the device 102 displayed on the image. If there is a device 102 hidden by the device 102 displayed on the image (Yes in step S41), the process proceeds to step S42. If there is no device 102 hidden by the device 102 displayed on the image (No in step S41), Fig. 9 The indicated processing is completed.

[0095] In step S42, the display control unit 44 displays the information 64 about the hidden device 102 smaller than the information 64 about the device 102 displayed on the image on the display screen 28A of the display unit 28. Thereafter, the process moves to step S43.

[0096] In step S43, the display control unit 44 determines whether the user has selected the non-display button 76, which is a button for non-displaying the information 64 related to the hidden device 102. If the user has selected the non-display button 76 for non-displaying the information 64 related to the hidden device 102 (Yes in step S43), the process moves to step S46. If the user has not selected the non-display button 76 for non-displaying the information 64 related to the hidden device 102 (No in step S43), the process moves to step S44.

[0097] In step S44, the display control unit 44 determines whether the user has slid the frame 62 displaying the information 64 related to the hidden device 102. If the user has slid the frame 62 (Yes in step S44), the process proceeds to step S46. If the user has not slid the frame 62 (No in step S44), the process proceeds to step S45.

[0098] In step S45, the display control unit 44 determines whether the user has selected a not-shown unified hidden button, which is a button for collectively hiding the information 64 related to the plurality of hidden devices 102. If the user has selected the unified hidden button (yes in step S45), the process proceeds to step S46. If the user has not selected the unified hidden button (no in step S45), Fig. 9 The indicated processing is completed.

[0099] In step S46, the display control unit 44 hides the information 64 related to the hidden device 102. If the user selects the hide button 76 or slides the frame 62, the information 64 related to the hidden device 102 is hidden. If the user selects the unhide button, the information 64 related to the plurality of hidden devices 102 is hidden.

[0100] In this way, Fig. 9 The indicated processing is completed.

[0101] Thus, according to the present embodiment, when at least one of the plurality of devices 102 installed in the vehicle 100 is included in the image, the graphic 31 corresponding to the device 102 is displayed overlapping the device 102, and information indicating the type of the device 102 is also displayed. Therefore, according to the present embodiment, information related to the device 102 in the vehicle 100 can be better provided.

[0102] In addition, the present invention is not limited to the above-mentioned embodiment, and various structures can be adopted within the scope not departing from the gist of the present invention.

[0103] The above-mentioned embodiments are summarized as follows.

[0104] An information providing method is a method in which a terminal device (12) having a camera unit (16) and a display unit (28) displays an image of a vehicle interior (100) captured by the camera unit on the display unit, wherein a plurality of devices (102A to 102O) are arranged in the vehicle, and the plurality of devices are classified into a plurality of categories. The information providing method comprises an image acquisition step (S1) and a display step (S5), wherein the image of the vehicle interior captured by the camera unit is acquired in the image acquisition step (S1); and the image is displayed on the display unit in the display step (S5), and when at least one of the plurality of devices is included in the image, a graphic (31A to 31O) corresponding to the device is displayed superimposed on the device, and information indicating the category to which the device belongs is also displayed. According to this structure, when at least one of the plurality of devices arranged in the vehicle is included in the image, a graphic corresponding to the device is displayed superimposed on the device, and information indicating the category to which the device belongs is also displayed. Therefore, according to this structure, information related to the equipment in the vehicle can be better provided.

[0105] The graphic may also be a semi-transparent graphic.

[0106] The information indicating the category to which the device belongs may be a color corresponding to the category. A graphic of a color corresponding to the category is superimposed and displayed on the device, so that the user can well understand the function of the device based on the color.

[0107] The graphic may also be a three-dimensional graphic. Displaying a three-dimensional graphic helps the user to recognize it smoothly.

[0108] The graphic may also be a graphic of a size corresponding to the size of the device.

[0109] Displaying a graphic with a size corresponding to the size of the device helps the user to identify it smoothly.

[0110] The graphic may also be a graphic having a shape corresponding to the shape of the device.

[0111] Displaying a graphic of a shape corresponding to the shape of the device helps the user to smoothly recognize it.

[0112] Alternatively, the device may include a component (104FA to 104FC) that constitutes a part of the device, and in the display step (S4, S5), when the distance between the device and the terminal device is greater than a first distance threshold (DTH1), information related to the component is not displayed for the component, but the graphic is displayed in an overlapping manner on the device; and when the distance between the device and the terminal device is less than the first distance threshold, the graphic is not displayed, but information related to the component is displayed for the component. According to this structure, when the distance between the device and the terminal device is greater than the first distance threshold, information related to the component is not displayed for the component, but the graphic is displayed in an overlapping manner on the device. According to this structure, it is possible to prevent information of multiple components from being displayed close to each other. In addition, according to this structure, when the distance between the device and the terminal device is less than the first distance threshold, the graphic is not displayed in an overlapping manner, but information related to the component is displayed for the component. When the distance between the device and the terminal apparatus is less than the first distance threshold, adjacent components are captured in the image in a state where they are sufficiently separated from each other. Therefore, even if information on a plurality of components is displayed, the user can well understand the information.

[0113] Alternatively, the device may include a component that constitutes a part of the device, and in the display step, when the graphic is displayed overlappingly on the device, if the distance between the device and the terminal device is less than a first distance threshold, the graphic is not displayed, and information related to the component is displayed for the component; when the information related to the component is displayed for the component, if the distance between the device and the terminal device reaches a second distance threshold (DTH2) greater than the first distance threshold, the information related to the component is not displayed, and the graphic is displayed overlappingly on the device. According to this structure, even if the terminal device is away from the device to some extent, the information related to the component that constitutes the device continues to be displayed on the display screen of the display unit, thereby helping to improve convenience.

[0114] Alternatively, the device may include a component that constitutes a part of the device, and in the display step, when the time for which the user continuously observes the display unit displaying information related to the component is greater than a time threshold (TTH), when the distance between the device and the terminal device reaches a third distance threshold (DTH3) or greater, the information related to the component is not displayed, and the graphic is displayed in an overlapping manner on the device; when the time for which the user continuously observes the display unit displaying information related to the component is less than the time threshold, when the distance between the device and the terminal device reaches a fourth distance threshold (DTH4) smaller than the third distance threshold, the information related to the component is not displayed, and the graphic is displayed in an overlapping manner on the device. According to this structure, when the user observes the information related to the component for a relatively long time, even if the terminal device is somewhat away from the device, the information related to the component continues to be displayed on the display screen of the display unit. Therefore, it helps to improve convenience.

[0115] Alternatively, in the display step, when the graphic is displayed superimposed on the device, if the user selects the graphic, detailed information related to the device on which the selected graphic is displayed superimposed is displayed on the display unit.

[0116] Alternatively, when the device has a plurality of the components and the graphic is displayed overlappingly on the device, if the user selects the graphic, in the display step, a detailed information list is displayed on the display unit, the detailed information list being information related to the plurality of components possessed by the device on which the selected graphic is displayed overlappingly.

[0117] Alternatively, in the display step, when information related to the components possessed by the device is displayed, if a user selects an icon (66) for indicating display of detailed information of the components, detailed information related to the components is displayed on the display unit.

[0118] Alternatively, in the display step, the information (64M) related to the device (102M) hidden by the device (102) displayed on the image may be displayed on the display unit in a smaller size than the information (64FA to 64FC) related to the device displayed on the image. According to this configuration, the user can well understand whether the information is related to the device displayed on the image or the information is related to the hidden device.

[0119] Alternatively, in the display step, when the user performs an operation for not displaying the information related to the hidden device, the information related to the hidden device is not displayed. According to this structure, the user can appropriately not display information that is not necessary to be displayed.

[0120] The operation for not displaying the information related to the hidden device may be: selecting a non-display button (76) for not displaying the information related to the hidden device.

[0121] Alternatively, the operation for not displaying the information related to the hidden device may be: sliding the frame (62M) showing the information related to the hidden device.

[0122] Alternatively, in the display step, a unified non-display button is displayed, wherein the unified non-display button is a button for uniformly non-displaying information related to each of the multiple devices hidden by the device displayed on the image, and when the user selects the unified non-display button, the information related to each of the multiple hidden devices is uniformly non-displayed.

[0123] The computer-readable non-transitory storage medium storing a program is a program for causing a computer to execute the above-mentioned information providing method.

[0124] The information providing device (12) has a camera and a display unit, and displays the image of the interior of the vehicle captured by the camera on the display unit. A plurality of devices are arranged in the vehicle, and the plurality of devices are classified into a plurality of categories. The information providing device (12) has an image acquisition unit (36) and a display control unit (44), wherein the image acquisition unit (36) acquires the image of the interior of the vehicle captured by the camera; the display control unit (44) displays the image on the display unit, and when at least one of the plurality of devices is included in the image, a graphic related to the device is displayed on the device in an overlapping manner, and information indicating the category to which the device belongs is also displayed.

Claims

1. A method for providing information, comprising: a terminal device having a camera and a display unit, wherein the terminal device displays an image of a vehicle interior captured by the camera on the display unit; It is characterized in that A plurality of devices are arranged in the vehicle. A plurality of the devices are classified into a plurality of categories, The information providing method comprises an image acquisition step and a display step, wherein: In the image acquisition step, the image inside the vehicle captured by the capturing unit is acquired; In the display step, the image is displayed on the display unit, and when at least one of the plurality of devices is included in the image, a graphic corresponding to the device is displayed superimposed on the device, and information indicating the type to which the device belongs is also displayed. The device has a component constituting a part of the device, In the display step, when the distance between the device and the terminal device is greater than a first distance threshold, the information related to the component is not displayed for the component, but the graphic is displayed overlappingly on the device; when the distance between the device and the terminal device is less than the first distance threshold, the graphic is not displayed, but information related to the component is displayed for the component.

2. The information providing method according to claim 1, characterized in that: The graphic is a semi-transparent graphic.

3. The information providing method according to claim 1, characterized in that: The information indicating the category to which the device belongs is a color corresponding to the category.

4. The information providing method according to claim 1, characterized in that: The graphic is a three-dimensional graphic.

5. The information providing method according to claim 1, characterized in that: The size of the graphic corresponds to the size of the device.

6. The information providing method according to claim 1, characterized in that: The shape of the graphic corresponds to the shape of the device.

7. The information providing method according to claim 1, characterized in that: In the display step, in a state where the graphic is displayed superimposed on the device, when the user selects the graphic, detailed information on the device on which the selected graphic is displayed superimposed is displayed on the display unit.

8. The information providing method according to claim 7, characterized in that: When the device has a plurality of the components and the graphic is displayed overlappingly on the device, if the user selects the graphic, in the display step, a detailed information list is displayed on the display unit, and the detailed information list is information related to the plurality of components possessed by the device on which the selected graphic is displayed overlappingly.

9. The information providing method according to claim 1, characterized in that: In the display step, when the user selects an icon for instructing to display detailed information of the constituent components while the information on the constituent components of the device is displayed, the detailed information on the constituent components is displayed on the display unit.

10. The information providing method according to claim 1, characterized in that: In the display step, information about a device hidden by the device displayed on the image is displayed on the display unit in a smaller size than information about the device displayed on the image.

11. The information providing method according to claim 10, characterized in that: In the display step, when the user performs an operation for not displaying the information related to the hidden device, the information related to the hidden device is not displayed.

12. The information providing method according to claim 11, characterized in that: The operation for not displaying the information related to the hidden device refers to selecting a non-display button for not displaying the information related to the hidden device.

13. The information providing method according to claim 11, characterized in that: The operation for hiding the information related to the hidden device is to slide the frame showing the information related to the hidden device.

14. The information providing method according to claim 10, characterized in that: In the display step, a unified non-display button is displayed, and the unified non-display button refers to: a button for uniformly non-displaying information related to each device among the multiple devices hidden by the device displayed on the image. When the user selects the unified non-display button, the information related to each device among the multiple hidden devices is uniformly non-displayed.

15. An information providing method, wherein a terminal device having a camera and a display unit displays an image of a vehicle interior captured by the camera on the display unit, wherein a plurality of devices are provided in the vehicle. A plurality of the devices are classified into a plurality of categories, The information providing method comprises an image acquisition step and a display step, wherein: In the image acquisition step, the image inside the vehicle captured by the capturing unit is acquired; In the display step, the image is displayed on the display unit, and when at least one of the plurality of devices is included in the image, a graphic corresponding to the device is displayed superimposed on the device, and information indicating the type to which the device belongs is also displayed. It is characterized in that The device has a component constituting a part of the device, In the display step, when the graphic is displayed overlappingly on the device, if the distance between the device and the terminal device is less than a first distance threshold, the graphic is not displayed, and information related to the constituent components is displayed for the constituent components; when the information related to the constituent components is displayed for the constituent components, if the distance between the device and the terminal device reaches or exceeds a second distance threshold that is larger than the first distance threshold, the information related to the constituent components is not displayed, and the graphic is displayed overlappingly on the device.

16. An information providing method, wherein a terminal device having a camera and a display unit displays an image of a vehicle interior captured by the camera on the display unit, wherein a plurality of devices are provided in the vehicle. A plurality of the devices are classified into a plurality of categories, The information providing method comprises an image acquisition step and a display step, wherein: In the image acquisition step, the image inside the vehicle captured by the capturing unit is acquired; In the display step, the image is displayed on the display unit, and when at least one of the plurality of devices is included in the image, a graphic corresponding to the device is displayed superimposed on the device, and information indicating the type to which the device belongs is also displayed. It is characterized in that The device has a component constituting a part of the device, In the display step, when the time during which the user continuously observes the display unit displaying the information related to the constituent component is longer than a time threshold, when the distance between the device and the terminal device reaches longer than a third distance threshold, the information related to the constituent component is not displayed, and the graphic is displayed overlappingly on the device; when the time during which the user continuously observes the display unit displaying the information related to the constituent component is shorter than the time threshold, when the distance between the device and the terminal device reaches longer than a fourth distance threshold that is smaller than the third distance threshold, the information related to the constituent component is not displayed, and the graphic is displayed overlappingly on the device.

17. A computer-readable non-transitory storage medium, characterized in that: A program for causing a computer to execute the information providing method according to any one of claims 1 to 16 is stored.

18. An information providing device comprising a camera and a display unit, wherein an image of a vehicle interior captured by the camera is displayed on the display unit. It is characterized in that A plurality of devices are arranged in the vehicle. A plurality of the devices are classified into a plurality of categories, The information providing device comprises an image acquisition unit and a display control unit, wherein: The image acquisition unit acquires the image of the interior of the vehicle captured by the capturing unit; The display control unit displays the image on the display unit, and when at least one of the plurality of devices is included in the image, causes a graphic corresponding to the device to be displayed superimposed on the device, and also displays information indicating the type to which the device belongs. The device has a component constituting a part of the device, When the distance between the device and the information providing apparatus is greater than a first distance threshold, the display control unit does not display information related to the component but displays the graphic overlaid on the device; when the distance between the device and the information providing apparatus is less than the first distance threshold, the display control unit does not display the graphic but displays information related to the component.

Images