Maintenance work display program, maintenance work display system, and product explanation display method

Abstract

Provided are a maintenance work display program, a maintenance work display system, and a product explanation display method that improve the operability of display operations in maintenance work. The maintenance work display program is a program for displaying a plurality of items of work content on a display. The maintenance work display program causes a processing circuit to execute: image generation processing for generating a display image for displaying, on the display, a table of contents in which headings of the plurality of items of work content are respectively displayed, and specific work content; voice recognition processing for converting voice instructions issued by an operator into screen operation instructions on the basis of a voice conversion table; and image update processing for updating the display image on the basis of the screen operation instructions. The voice conversion table includes information associating voice instructions corresponding to each heading with screen operation instructions for causing the display to display the work content corresponding to the heading.

Description

Maintenance work display program, maintenance work display system, and product description display method

[0001] The present disclosure relates to a maintenance work display program, a maintenance work display system, and a product description display method for displaying maintenance work content or product description on a display.

[0002] The electronic manual display device disclosed in Patent Document 1 displays drawings and task items related to a task in accordance with voice instructions from a worker.

[0003] Japanese Patent Application Laid-Open No. 2004-29932

[0004] According to the electronic manual display device described in Patent Document 1, the worker must input the task items to be displayed by voice. If the task items are not input by voice, the intended drawings cannot be displayed on the display device. Therefore, the worker must accurately memorize each task item. In other words, the display device requires the worker to be skilled in order to display the intended drawings, resulting in low operability.

[0005] The present disclosure aims to provide a maintenance work display program, a maintenance work display system, and a product description display method that improve the operability of display operations during maintenance work.

[0006] The present disclosure provides a maintenance work display program for displaying a plurality of work contents on a display, which causes a processing circuit to execute an image generation process for generating a display image on the display that displays a table of contents showing the headings of the plurality of work contents and a specific work content; a voice recognition process for converting voice instructions given by a worker into screen operation instructions based on a voice conversion table; and an image update process for updating the display image based on the screen operation instructions, wherein the voice conversion table includes information that associates the screen operation instructions for displaying the work content corresponding to the heading on the display in accordance with the voice instruction corresponding to the heading.

[0007] According to the maintenance work display program disclosed herein, a display image including a table of contents and work details is displayed on the display, and the display image is updated based on voice instructions corresponding to the headings of the table of contents. Therefore, the worker can give voice instructions while checking the table of contents displayed on the display, eliminating the need to accurately memorize each individual work detail. Therefore, the maintenance work display program can improve the operability of the display image.

[0008] FIG. 1 is a block diagram of a maintenance work display system according to the present embodiment; FIG. 2 is a flowchart showing an example of a processing procedure by a maintenance work display program according to the present embodiment; FIG. 3 shows an example of a display image displayed on a display; FIG. 4 shows an example of a display image displayed on a display; FIG. 5 shows an example of a display image displayed on a display; FIG. 6 shows an example of a display image displayed on a display according to a modified example of the present embodiment; FIG. 7 is a flowchart showing an example of a processing procedure before the flowchart shown in FIG. 2;

[0009] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings.

[0010] 1 shows a block diagram of a maintenance work display system 1. In this embodiment, the maintenance work display system 1 includes a terminal 100 and a server device 200 connected to the terminal 100 via an online network 300.

[0011] The maintenance work display system 1 of this embodiment and a maintenance work display program described below are used to display the contents of a maintenance work manual on the terminal 100. A maintenance work manual refers to a manual that contains detailed explanations of maintenance work to be performed when servicing product equipment. A worker performs maintenance work on the product equipment while checking the manual. The maintenance work manual may contain explanations of periodic inspection work and replacement of worn or broken parts. The maintenance work manual may also contain explanations of work related to removing parts included in the target product, installing parts, or disassembling / assembling the target product. The maintenance work manual may also contain written descriptions of the work content, or may include illustrations, still images, or videos.

[0012] In this embodiment, a motorcycle, which is a vehicle, is used as an example of a product for which a maintenance work manual is provided. The maintenance work manual may include, for example, replacement work for consumable parts such as an air cleaner element, lubricating oil, an oil filter, a spark plug, and a sealing member. The maintenance work manual may also include, for example, predetermined periodic inspection work for a steering device, a braking device, a lighting device, and the like.

[0013] In this embodiment, the terminal 100 displays information related to a maintenance work manual (hereinafter referred to as maintenance work information 204). The terminal 100 has a control unit 101 that controls the entire terminal 100, a communication unit 105 that is a means for communicating with the server device 200, a display 106 that displays the maintenance work information 204, a voice acquisition unit 107 that acquires voice, and a storage device 109 that stores data files and programs. The control unit 101, communication unit 105, display 106, voice acquisition unit 107, and storage device 109 are connected to one another via a bus 108.

[0014] The terminal 100 may be a so-called desktop type in which the display and keyboard are separate, or may be a notebook type in which the display and keyboard are integrated, or may be a tablet type in which the display is equipped with a touch interface.

[0015] The control unit 101 has a CPU (Central Processing Unit) 102, a ROM (Read-On Memory) 103, and a RAM (Random Access Memory) 104. The CPU 102 is a processing circuit that performs calculations, processing, conditional judgments, and control of various devices in accordance with programs stored in the ROM 103 or programs loaded into the RAM 104. Processes such as display image generation, voice recognition, and screen updating, which will be described later, are executed by the CPU 102. That is, the CPU 102 includes a display image generation unit, a voice recognition unit, and an image update unit.

[0016] The display image generation unit, the voice recognition unit, and the image update unit are configured by circuits or processing circuits, including general-purpose processors, dedicated processors, integrated circuits, ASICs (Application Specific Integrated Circuits), conventional circuits, and / or combinations thereof. A processor is considered a processing circuit or circuit because it includes transistors and other circuits. In this disclosure, a circuit, unit, or means is hardware that performs the recited functions or hardware that is programmed to perform the recited functions. The hardware may be hardware disclosed herein or other known hardware that is programmed or configured to perform the recited functions. In the case of a processor, where the hardware is considered a type of circuit, the circuit, means, or unit is a combination of hardware and software, and the software is used to configure the hardware and / or the processor.

[0017] The display 106 is an image display device such as a liquid crystal display or an organic EL display. In this embodiment, a display image 400 (see FIGS. 3 to 7 ) relating to the maintenance work manual generated via the CPU 102 is displayed on the display 106. The display 106 may be built into the terminal 100. The display 106 may be wired to the terminal 100 via a cable or the like, or may be connected to the terminal 100 according to a predetermined wireless communication standard such as LTE (registered trademark), Wi-Fi (registered trademark), or Bluetooth (registered trademark). The display 106 is preferably provided so as to be portable to the maintenance work site. This allows the worker to bring the display 106 to the maintenance work site and perform maintenance work while visually checking the display image 400 displayed on the display.

[0018] The voice acquisition unit 107 is a so-called microphone. When a worker speaks into the voice acquisition unit 107, the voice is acquired as voice information and input to the terminal 100. The voice acquisition unit 107 may be built into the terminal 100, or may be connected to the terminal 100 via a USB (registered trademark) cable or the like, or may be connected to the terminal 100 via wireless communication means such as Bluetooth (registered trademark). From the perspective of ease of maintenance work, the voice acquisition unit 107 may be a headset microphone or a pin microphone with a wireless communication function.

[0019] The communication unit 105 communicates with the server device 200 via the network 300 and receives the maintenance work information 204 and the like. The communication unit 105 is not limited to communication with the server device 200, and may also be capable of accessing any internet browser.

[0020] The storage device 109 is a semiconductor memory. For example, the storage device 109 may be a nonvolatile semiconductor memory such as a flash memory. The storage device is not limited to a semiconductor memory, and may be a magnetic disk such as a hard disk drive. The storage device 109 stores an HTML (HyperText Markup Language) file for accessing the server device 200.

[0021] The server device 200 has a control unit 201 and a communication unit 202. The server device 200 also has a storage device 203 in which maintenance work information 204 and the like are stored. The control unit 201, the communication unit 202, and the storage device 203 are interconnected via a bus within the server device 200.

[0022] The storage device 203 stores, as electronic data, a plurality of pieces of maintenance work information 204 and a database 215 that accumulates information about workers (hereinafter referred to as worker information 216). The storage device 203 may be, for example, the magnetic disk described above.

[0023] The maintenance work information 204 includes a data storage unit 209 that stores the specific details of the maintenance work, and a program storage unit 205 that stores various programs for operating the display image 400. In other words, the data storage unit 209 stores information related to the contents of the maintenance work manual, and the program storage unit 205 stores programs for operating the maintenance work manual. The maintenance work information 204 is stored in the storage device 203 for each type of target product. Furthermore, even if the target product is the same, maintenance work information 204 corresponding to different languages ​​may be stored.

[0024] The maintenance work information 204 can be updated by an administrator. For example, when a change occurs in the consumable parts of the target product, the administrator can update the maintenance work information 204. This allows the worker to display the contents of the maintenance work instruction manual that is appropriate at that time when receiving the maintenance work information on the terminal 100.

[0025] The data storage unit 209 stores data relating to a table of contents 210, work contents 211, screen operation instructions 213, and a voice conversion table 214.

[0026] The work content 211 is composed of a heading for one maintenance work in a series of maintenance works and a detailed description and / or diagram related to that maintenance work. Here, a heading is a short description of an individual maintenance work content. The detailed descriptions of some of the work contents 211 include links for displaying other work contents 211. A large number of work contents 211 are stored in the data storage unit 209.

[0027] The table of contents 210 is made up of a plurality of the above-mentioned headings. The table of contents 210 contains information in which the individual headings are arranged in a predetermined order.

[0028] The screen operation instructions 213 are data for operating the display image 400 displayed on the display 106. The screen operation instructions 213 include an instruction to display the work content 211 corresponding to the heading on the display 106, an instruction to change the display mode of the heading, an instruction to display other work content 211 according to a link displayed in the detailed explanation, and the like.

[0029] The screen operation instructions 213 further include an instruction to display a list of the above-mentioned respective screen operation instructions 213 on the display 106. The screen operation instructions 213 are not limited to the above-mentioned instructions, and may include all screen operation instructions that the worker may operate by touching the terminal 100 during maintenance work.

[0030] The speech conversion table 214 includes information that associates the voice instructions of the worker with the screen operation instructions 213. Here, the voice instructions in this embodiment are character data in which the voice information of the worker is verbalized via the voice recognition program 207, which will be described later. For example, the speech conversion table 214 includes information in which a specific screen operation instruction 213 is associated with a group of words that are homonyms for the screen operation instruction 213. For example, "two," which is an example of the screen operation instruction 213, and "too," which is an example of a voice instruction, may be included in the speech conversion table 214 as associated information.

[0031] The program storage unit 205 stores an image generation program 206, a voice recognition program 207, and an image update program 208. These programs are for displaying and manipulating the display image 400 on the display 106, i.e., the maintenance work display program of this embodiment. The maintenance work display program is loaded into the RAM 104, and the CPU 102 executes this program, thereby enabling the display image 400 to be manipulated as described below. These programs are written in a predetermined programming language (for example, HTML).

[0032] The image generation program 206 is a program for generating a display image 400 that displays a table of contents 210 showing a plurality of headings, a specific task content 211, and voice instructions from the worker on the display 106. The image generation program 206 may further be programmed to display model information of the target product on the display 106.

[0033] The voice recognition program 207 is a program for converting the voice uttered by the worker into the screen operation instructions 213 based on the voice conversion table 214. Specifically, the voice recognition program 207 is configured to verbalize the voice information obtained by the voice acquisition unit 107 into voice instructions, and convert the voice instructions into the screen operation instructions 213 based on the voice conversion table 214. The verbalization process may be performed via language software pre-installed in the terminal 100 or the server device 200, or via a browser on the Internet (e.g., Google Chrome (registered trademark)).

[0034] Image update program 208 is a program for updating display image 400 based on screen operation instructions 213. In other words, image update program 208 is a program that causes a processing circuit to execute screen operations that are normally performed by a worker touching terminal 100. For example, the process in which a worker clicks a heading in table of contents 210 with a mouse to display specific task content 211 can be executed by image update program 208 without the action of clicking.

[0035] The database 215 stores worker information 216 and screen operation instruction information 217. The worker information 216 is an identification number assigned to each worker or their user (e.g., a dealer). In this embodiment, when an HTML file for accessing the server device 200 is opened, an internet browser is launched and an input screen for inputting the worker information 216, etc. is displayed. By inputting the worker information 216 into the input screen, the worker information 216 is stored in the database 215. The worker information 216 may include attributes such as the country of the worker, the language used by the worker, and the type of worker (e.g., the size of the worker, such as individual worker or commercial worker).

[0036] The screen operation instruction information 217 is information related to each screen operation instruction 213 that was actually executed based on the voice instruction of the worker. The screen operation instructions 213 that were executed based on the voice instruction during the maintenance work are stored in the database 215 as the screen operation instruction information 217. The voice instructions of the worker may be stored in the database 215 in order to reduce the frequency of erroneous conversion or erroneous recognition of the voice instruction.

[0037] In this way, by storing the worker information 216 and the screen operation instruction information 217 in the database 215, it is possible to analyze how each worker uses the maintenance work information 204. This makes it possible to easily improve the maintenance work information 204. The database 215 may also store the date and time when the worker acquired the maintenance work information 204, product information corresponding to the maintenance work information 204, and the like, linked to the worker information 216 and the screen operation instruction information 217. This allows the administrator to aggregate data by worker attributes, period of use of the maintenance work information 204, and target product, and obtain information useful for manufacturing, sales, and other management purposes.

[0038] Next, an example of the operation procedure for the display image 400 in the maintenance work display system 1 according to this embodiment will be described with reference to FIGS.

[0039] First, the worker starts up the terminal 100 installed at the maintenance site or the like, and opens an HTML file for accessing the server device 200, which is stored in the storage device 109. When the HTML file is opened, an input screen for inputting the worker information 216 and the like is displayed, as described above, so the worker inputs the worker information 216 and the like. The worker inputs the worker information 216 and the like by using, for example, a keyboard. By inputting the worker information 216, the worker information 216 is stored in the database 215 in the server device 200.

[0040] When the worker information 216 and the like are input, the input screen is updated and a product information input screen is displayed. The worker inputs product information (e.g., a vehicle identification number) of the product to be serviced on the product information input screen. This input is made using a keyboard.

[0041] When the product information is input, the maintenance work information 204 for the target product stored in the server device 200 is read, and a display image 400 is displayed on the display 106. This point is regarded as the start of the flowchart shown in Fig. 2. Fig. 3 shows the display image 400 displayed on the display 106. The display image 400 is an image that displays the contents of the maintenance work manual for the target product. The display image 400 shown in Fig. 3 is the initial screen of the maintenance work manual in this embodiment.

[0042] The initial screen of the display image 400 shown in Fig. 3 is divided into multiple areas. Each divided area displays a table of contents area 401 showing the table of contents, a product information area 404 showing information about the target product, an initial information area 406 showing initial information, and a voice instruction display area 403 where voice instructions are displayed. In this embodiment, the initial screen is divided horizontally, with the table of contents area 401 displayed on one side of the horizontal direction (the left side in this embodiment) and the initial information area 406 displayed on the other side of the horizontal direction (the right side in this embodiment). When the screen is formed horizontally, dividing the initial screen horizontally makes it easier to display the horizontal dimensions of the areas other than the table of contents area 401 larger.

[0043] The voice instruction display area 403 is displayed in an area separate from, specifically above, the table of contents area 401 and the initial information area 406. The product information area 404 is displayed vertically between the table of contents area 401 and the voice instruction display area 403. When one maintenance work manual is used for multiple target products, the product information area 404 displays the names of the multiple products.

[0044] The initial information area 406 displays the identification number of the maintenance work manual, the issue date (or expiration date), the version number, the product name, the name of the maintenance work manual, and the appearance of the product. The initial information area 406 is a relatively large area and is displayed in larger characters than the table of contents area 401, so that if there is a mismatch between the target product and the maintenance work manual, the worker can easily notice the mismatch. The initial information area 406 may also display the model year, chassis number, etc. of the target product.

[0045] A plurality of "headings" are displayed in a vertical line in the table of contents area 401. "Overview," "Periodic Inspection and Maintenance," and the like in the table of contents area 401 correspond to headings of specific work contents 211. For ease of explanation, headings displayed below the heading "Cooling System" are displayed as "headings" with alphabets added.

[0046] Before each "heading," a mark to identify the heading, specifically a number, is displayed. The number corresponds to the heading, for example, the number "5" corresponds to heading E. Before each number, a mark to identify that the heading has a hierarchical structure, specifically a symbol "+," is displayed. The symbol "+" means that the heading has a hierarchical structure. In other words, the headings displayed in FIG. 3 have a hierarchical structure. Scroll bars are displayed at the right and bottom ends of the table of contents area 401 to indicate whether the table of contents area 401 can be scrolled up, down, left, or right.

[0047] In the present embodiment, nothing is displayed in the voice instruction display area 403 on the initial screen. In an alternative embodiment, the voice instruction display area 403 on the initial screen may display "Please issue a voice instruction to specify the table of contents."

[0048] For example, when checking the task content 211 corresponding to heading E, the worker utters "five" toward the voice acquisition unit 107 of the terminal 100 to identify the number "5" displayed before heading E. The voice uttered by the worker is acquired by the voice acquisition unit 107 and converted into voice data (S1). The voice data is converted into language by, for example, an internet browser via the voice recognition program 207 and becomes a voice instruction (S2).

[0049] 4, the display image 400 is updated by the image update program 208 so that the voice instruction is displayed in the voice instruction display area 403 (S3). In Fig. 4, "five" is displayed in the voice instruction display area 403. Since the voice data is converted into words while taking into consideration the pronunciation of the voice data, a voice instruction contrary to the intention of the worker may be displayed.

[0050] Next, the voice recognition program 207 determines whether the voice instruction is associated with the screen operation instruction 213 based on the voice conversion table 214 (S4). "Five" is associated with one of the screen operation instructions 213, "5." If it is determined that the voice instruction is associated with the screen operation instruction 213, the voice instruction is converted into the screen operation instruction 213 corresponding to the voice instruction, i.e., "5," via the voice recognition program 207 (S5). If it is determined that the voice instruction is not associated with the screen operation instruction 213, for example, if the voice instruction is recognized as "file" instead of "five," the voice instruction is not converted into the screen operation instruction 213, and the next process (S5) is not executed. Therefore, the worker needs to speak again to the voice acquisition unit 107. Since the voice instruction is displayed in the voice instruction display area 403, the worker can speak more appropriately while checking the displayed voice instruction.

[0051] Next, the display image 400 is updated based on the screen operation instruction 213 via the image update program 208 (S6). This completes the series of operation procedures for the display image 400. FIG. 4 shows the display image 400 updated by the above operations. Based on the screen operation instruction 213 of "5," "5. Heading E" is specified in the table of contents area 401, the hierarchy below "5. Heading E" is expanded, and "5-1. Heading E-1" in the lower hierarchy is selected. "5-1. Heading E-1" is the top heading in the expanded hierarchy. In other words, if the specified heading has a hierarchical structure, the display image 400 is updated so that the hierarchy below the specified heading is expanded and the top heading in the lower hierarchy is selected.

[0052] 4, the display mode of "5-1. Heading E-1" has changed and is surrounded by a rectangular frame. This makes it easy for the worker to recognize which heading has been selected based on the screen operation instruction 213. The display mode of the selected heading may change so that the font color, thickness, size, etc. differs from the display mode of other headings.

[0053] In Figure 4, the symbol before "5. Heading E" changes from "+" to "-". The symbol "-" means that the heading is expanded to a lower level. In the lower level of "5. Heading E", the symbol "*" is displayed before "5-1. Heading E-1" to "5-4. Heading E-4". The symbol "*" means that the heading does not have a further hierarchical structure. On the other hand, the symbol "+" is displayed before "5-5. Heading E-5" and "5-6. Heading E-6". In other words, "5-5. Heading E-5" and "5-6. Heading E-6" have a further hierarchical structure. The symbols "+", "-", and "*" may be other symbols. No symbols may be displayed, and the display mode of the heading (font color, thickness, size, etc.) may change depending on whether or not there is a hierarchical structure.

[0054] To the right of the table of contents area 401, i.e., in the area where the initial information area 406 was displayed on the initial screen, a work content area 402 is displayed, displaying the work content 211 corresponding to the selected heading. The work content area 402 in FIG. 4 displays the work content 211 corresponding to "5-1. Heading E-1." A detailed explanation of the work content 211 is displayed in the upper left of the work content area 402, and an illustration of the work content 211 is displayed in the lower right of the work content area 402. This allows the worker to perform maintenance work while checking the detailed explanation and illustration. Depending on the identified work content 211, only the detailed explanation may be displayed in the work content area 402, or only the illustration may be displayed in the work content area 402.

[0055] The detailed explanation displays the statements "1: See removal of part X" and "2: See removal of part X" to refer to other work contents 211. Of the statements, for example, "1: Removal of part X" is underlined and the font is italicized. "1: Removal of part X" has a link function to display the work contents 211 related to the removal of part X.

[0056] Next, when the worker utters "Link 1," "1: Remove part X" is selected in the work content area 402, and the display image 400 is updated as shown in Fig. 5 according to the processing procedure shown in the flowchart of Fig. 2. In Fig. 5, the worker's voice is verbalized as "Link 1" as intended by the worker, and the voice instruction of "Link 1" is displayed in the voice instruction display area 403.

[0057] Here, "1: Remove part X" corresponds to the work content 211 of "5-5-1. Heading E-5-1," and based on the screen operation instruction 213 by the voice instruction of "Link 1," "5-5-1. Heading E-5-1" is selected in the table of contents area 401. As a result, a detailed explanation and diagram of the work content 211 related to "5-5-1. Heading E-5-1" are displayed in the work content area 402.

[0058] In this way, by including links in one task content 211 that display other task content 211, the individual task content 211 can be simplified, and the worker can easily confirm the task content 211. Links may not be displayed depending on the individual task content 211. The display mode of links displayed in the detailed explanation is displayed differently from the display mode of the rest of the explanation. For example, the display mode of the links may be different from that of other explanations in at least one of font color, thickness, and size in order to be distinguished from other explanations.

[0059] When checking the specific contents of the plurality of screen operation instructions 213 stored in the maintenance work information 204, the worker issues a voice command to display the screen operation instruction list, such as "help," and a screen operation instruction list 405 is displayed, as shown in Fig. 6 . In Fig. 6 , the display image 400 is updated so that the table of contents area 401, the work content area 402, the voice command display area 403, and the product information area 404 are not displayed, and only the screen operation instruction list 405 is displayed. In another embodiment, the display image 400 may be updated so that the screen operation instruction list 405 is displayed together with the table of contents area 401, the work content area 402, and the voice command display area 403.

[0060] The left column of the screen operation instruction list 405 displays the target for which the screen operation is to be performed, the center column displays the content of the specific screen operation instruction 213, and the right column displays the specific screen operation content, i.e., how the display image 400 is updated.

[0061] For example, when the worker utters "Table of Contents Up" or "Table of Contents Down," the table of contents area 401 is scrolled up or down. When multiple headings are expanded into sub-concepts, when the worker utters "Reset Table of Contents," all expanded headings are collapsed, and the table of contents area 401 of the initial screen is displayed. When the worker utters "Previous" or "Next," the heading one level above or below the selected heading is selected, and the work content 211 corresponding to that heading is displayed.

[0062] For example, if the operator utters "3," "3. Fuel System" in FIG. 5 is selected, and if the operator utters "5-2 (go no ni)," "5-2. Heading E-2" in FIG. 5 is selected. By displaying a number before each heading, the operator can select a specific heading by uttering a number or a combination of a number and a simple letter. This can reduce the frequency of misrecognition of voice instructions.

[0063] For example, when the worker utters "up" or "down," the work content area 402 is scrolled up or down. When the worker utters "top" or "bottom," the work content area 402 is scrolled to the top or bottom.

[0064] For example, when the worker utters "enlarge" or "reduce," the table of contents area 401 and the task content area 402 are enlarged or reduced and displayed. When the worker utters "reset scale" while the table of contents area 401 and the task content area 402 are enlarged or reduced, the scales of the table of contents area 401 and the task content area 402 return to the scale of the initial screen. When the worker utters "back" or "forward," the previously displayed display image 400 (i.e., the display image 400 before the update) is displayed, or the next displayed display image 400 (i.e., the display image 400 after the update) is displayed. When the worker utters "close help," the screen operation instruction list 405 is closed, and, for example, the display image 400 before the screen operation instruction list 405 was displayed is displayed.

[0065] The screen operation instructions 213 and the corresponding screen operation contents are not limited to those shown in FIG. 6 and described above. The table of contents area 401 and / or the work content area 402 may be scrolled left and right based on the worker's voice instruction. A heading displayed in a lower hierarchy may be collapsed to display a higher hierarchy based on the worker's voice instruction. Only the table of contents area 401 or only the work content area 402 may be enlarged or reduced based on the worker's voice instruction. The table of contents area 401 may be hidden or redisplayed based on the worker's voice instruction. When a pointer is displayed in the table of contents area 401 and / or the work content area 402, the pointer may move up, down, left, or right based on the worker's voice instruction, and the heading displayed at the pointer's position may be selected. In this way, the display mode of the table of contents area 401 and / or the work content area 402 may change according to the worker's voice instruction.

[0066] In this way, by using the maintenance work display system 1 of the present disclosure, i.e., by having the CPU 102, which is the processing circuit, execute the maintenance work display program of the present disclosure, the worker can issue voice while looking at the table of contents, thereby improving the operability of display operations.

[0067] The present disclosure can be applied not only to maintenance work manuals but also to product manuals containing detailed descriptions and headings related to the detailed descriptions. Product manuals include a parts list (parts list) that illustrates the names, installation locations, model numbers, and other information of the parts included in the product, along with diagrams for each part of the product, for product repairs and periodic inspections. In this case, the table of contents area is divided by product part or by part item. Product manuals also include an owner's manual (owner's manual) that illustrates product usage instructions, precautions, and warnings for each part of the product, along with diagrams. In other words, the maintenance work display method disclosed in this specification can be applied to product manuals. This allows users of product manuals to speak while viewing the table of contents, improving the operability of display operations.

[0068] The maintenance work display program, maintenance work display system, and product description display method according to this embodiment have the following advantages.

[0069] (1) A maintenance work display program for displaying a plurality of work contents 211 on a display 106, the program causing a processing circuit to execute the following steps: an image generation process for generating a display image 400 on the display 106 that displays a table of contents 210 displaying the headings of the plurality of work contents 211 and a specific work content 211; a voice recognition process for converting a voice instruction given by a worker into a screen operation instruction 213 based on a voice conversion table 214; and an image update process for updating the display image 400 based on the screen operation instruction 213. The voice conversion table 214 includes information that associates a screen operation instruction 213 that displays a work content 211 corresponding to a heading on the display 106 in accordance with a voice instruction corresponding to the heading.

[0070] According to the maintenance work display program, the table of contents 210 and work details 211 of the maintenance work information 204 are displayed on the display 106, and the display image 400 is updated based on the voice of the worker. This allows the worker to give voice instructions while checking the headings of the table of contents, eliminating the need to accurately memorize each work detail, thereby improving operability. Furthermore, because the display image 400 is updated without the worker having to touch the terminal 100, the worker can check the work details without, for example, putting on or taking off protective gloves for maintenance work.

[0071] (2) The voice conversion table 214 includes information associated with the screen operation instruction 213 for changing the display mode of the heading. As a result, the display mode of the heading in the table of contents 210 changes in response to the voice instruction, so that the worker can easily recognize the heading corresponding to the work content 211 displayed in the work content area 402.

[0072] (3) The headings have a hierarchical structure, and the voice conversion table 214 includes information associated with a screen operation instruction 213 for expanding the headings to a lower level and displaying them, and information associated with a screen operation instruction 213 for collapsing the displayed lower level and displaying the higher level.

[0073] If the headings in the table of contents 210 have a hierarchical structure, the headings can be expanded or collapsed by voice instruction. This makes it possible to make the table of contents area 401 more compact and display general headings compared to when all headings are expanded. This makes it easier for the operator to select the intended heading.

[0074] (4) The speech conversion table 214 includes information associated with the screen operation instructions 213 for scrolling, enlarging, or reducing the table of contents area 401 displaying the table of contents 210. As a result, even in a display area with a limited size, the operator can easily select the intended heading.

[0075] (5) The work content 211 includes a link for displaying other work content 211, and the voice conversion table 214 includes information that associates screen operation instructions 213 for displaying other work content 211 in response to voice instructions corresponding to the links.

[0076] As a result, the worker can select a link by voice instruction to display other work contents 211, and can easily check other work contents 211. Furthermore, since each work content 211 can be simplified, the worker can easily check the work contents 211.

[0077] (6) The image update process displays voice instructions on the display 106. By displaying the voice instructions on the display 106, the worker can check how their voice is being recognized, which can reduce the frequency of incorrect voice instructions.

[0078] (7) The voice conversion table 214 includes information associated with the screen operation instructions 213 for displaying a list of the screen operation instructions 213. As a result, the list of the screen operation instructions 213 is displayed, allowing the worker to issue appropriate voice instructions.

[0079] (8) Worker information 216 for identifying the worker and on-screen operation instruction information 217 related to the on-screen operation instruction 213 are stored in a database 215 in a specific server device 200. As a result, the worker information 216 and the on-screen operation instruction information 217 can be collected and analyzed together, and the maintenance work information 204 can be easily improved.

[0080] (9) The maintenance work display system 1 includes a control unit 101 having: a display 106 that displays a plurality of work contents 211; a voice acquisition unit 107 that acquires voice instructions given by the worker; an image generation unit that generates a display image 400 that displays a table of contents 210 that displays the headings of the plurality of work contents 211 and a specific work content 211 on the display 106; a voice recognition unit that converts the voice instructions into screen operation instructions 213 based on a voice conversion table 214; and an image update unit that updates the display image 400 based on the screen operation instructions 213. The voice conversion table 214 includes information that associates screen operation instructions 213 that display work contents 211 corresponding to a heading in accordance with a voice instruction corresponding to the heading.

[0081] According to the maintenance work display system 1, the table of contents 210 and work details 211 of the maintenance work information 204 are displayed on the display 106, and the display image 400 is updated based on the voice of the worker. This allows the worker to give voice instructions while checking the headings of the table of contents, eliminating the need to accurately memorize each work detail, thereby improving operability. Furthermore, because the display image 400 is updated without the worker touching the terminal 100, the worker can check the work details without, for example, putting on or taking off protective gloves for maintenance work.

[0082] (10) A product description display method for displaying a plurality of description contents relating to a product on a display 106, the method comprising: generating a display image 400 for displaying a table of contents 210, in which headings of the plurality of description contents are respectively displayed, and a specific description content on the display 106; converting a voice instruction given by a user into a screen operation instruction 213 based on a voice conversion table 214; and updating the display image 400 based on the screen operation instruction 213, wherein the voice conversion table 214 includes information for associating, in accordance with a voice instruction corresponding to a heading, a screen operation instruction 213 for displaying the description content corresponding to the heading.

[0083] According to the product description display method, the table of contents and description of the product manual are displayed on the display, and the displayed image is updated based on the user's voice. This allows the user to give voice instructions while checking the headings of the table of contents, eliminating the need to accurately memorize each detailed description and allowing the user to easily check the description without touching the terminal.

[0084] Next, a first modification of this embodiment will be described, focusing on differences from the embodiment described above.

[0085] The data storage unit 209 further stores data related to specific items 212. The specific items 212 are data for displaying a list of task groups in which specific task contents 211 related to common content are extracted from a plurality of task contents 211. For example, specific item A includes data of a list of task groups in which the task content 211 described in the detailed description as "tightening torque" is extracted from the plurality of task contents 211.

[0086] 7 shows the initial screen of the first modified example of this embodiment. To the right of the table of contents area 401, a specific item area 407 is displayed, in which each specific item 212 is displayed. The specific items 212 may be displayed in either the table of contents area 401 or the task content area 402, for example.

[0087] The screen operation instruction 213 includes an instruction to display a list of task groups related to the specific item 212. For example, when the worker utters "specific item A," the specific item A in the specific item area 407 is selected, and the display image 400 is updated as shown in FIG. 8. In this embodiment, the specific item A is related to tightening torque. Therefore, the task group list displays task content 211 that includes tightening torque information, the heading of the task content 211, and the tightening torque set in the task content 211. By displaying the task group list in this manner, the worker can check task content 211 by focusing on a specific task item (e.g., tightening).

[0088] According to the first variant of this embodiment, the image generation process generates a display image 400 that displays on the display 106 specific items for displaying a list of work groups in which specific work contents 211 related to common content are extracted from multiple work contents 211, and the voice conversion table 214 includes information associated with screen operation instructions 213 for displaying the list of work groups.

[0089] As a result, the specific item 212 is displayed on the display 106 , and the worker can check the work content 211 by focusing on the specific item 212 .

[0090] Next, a second modification of this embodiment will be described.

[0091] The storage device 203 further stores supplementary information 218 as electronic data that is used supplementarily during maintenance work. The supplementary information 218 is electronic data of instructions that can be referenced during maintenance work in addition to the maintenance work information 204. Examples of the supplementary information 218 include a parts list for the target product, a parts list for the components (e.g., engine) that make up the product, and an owner's manual. The data storage unit 209 may also store a link for displaying the supplementary information 218 related to the product.

[0092] If a link for displaying supplementary information 218 (e.g., a parts list) related to the work content 211 is displayed in either the table of contents area 401 or the work content area 402, the link is selected based on a voice command from the worker, and the supplementary information 218 is displayed. This allows the worker to easily check the supplementary information 218 (e.g., a parts list, an owner's manual, etc.) related to the work content 211, enabling the worker to perform maintenance work smoothly.

[0093] According to the second modification of this embodiment, the speech conversion table 214 includes information associated with the screen operation instruction 213 for displaying supplementary information 218 related to the displayed work content 211 .

[0094] This allows the worker to easily check the supplementary information 218 related to the work content 211, and allows the maintenance work to be carried out smoothly.

[0095] Next, a third modification of this embodiment will be described.

[0096] FIG. 9 is a flowchart showing an example of a processing procedure prior to the flowchart shown in FIG. 2 according to the third modified example.

[0097] In the above-described embodiment, the input of worker information 216 and product information was performed by the worker using a keyboard, but in the third variant, these input tasks can be performed by the worker without using a keyboard.

[0098] Specifically, the worker utters a voice related to the worker information 216, etc., to the voice acquisition unit 107 of the terminal 100, and the worker information is accepted (S7).

[0099] Thereafter, the product information is received by reading the information of the target product using a device separately connected to the terminal 100 (S8). For example, if an electric cable for diagnosing the product's condition is electrically connected between the product and the terminal 100, the product information may be automatically input to the product information input screen via the electric cable. For example, if a QR code (registered trademark) containing product information is attached to the product, the product information may be automatically input to the product information input screen by reading the QR code (registered trademark) with a QR code reader (registered trademark) electrically connected to the terminal 100. For example, the product information may be automatically input to the product information input screen using RFID (registered trademark).

[0100] Thereafter, the worker speaks language information into the voice acquisition unit 107 of the terminal 100, and the language information is received (S9). The language information is information related to the language used by the worker. Based on the above information, a maintenance work manual for the target product suitable for the worker's language is automatically selected (S10), and the selected maintenance work manual is displayed. Thereafter, the display image 400 is updated according to the flowchart shown in FIG. 2.

[0101] According to the third modification, the worker can check the details of the maintenance work without touching the terminal 100 during the series of maintenance work.

[0102] The maintenance work display program, maintenance work display system 1, and product description display method according to the present disclosure are not limited to the configurations of the above-described embodiments, and various modifications are possible.

[0103] The maintenance work information 204 is stored in the storage device 203 of the server device 200, but may also be stored in the storage device 109 of the terminal 100. In this case, the operation of the display image 400 may be performed offline, i.e., without going through the server device 200. The terminal 100 may receive the maintenance work information 204 separately from the server device 200. For example, the terminal 100 may receive the maintenance work information 204 by being connected to a portable storage medium. Furthermore, when the operation of the display image 400 is performed offline, the worker information 216 and the screen operation instruction information 217 may be appropriately stored in the database 215 of the server device 200 via the communication units 105 and 202 while the display image 400 is being operated.

[0104] The maintenance work display program, maintenance work display system, and product description display method may be applied to maintenance work instructions for vehicles other than motorcycles. The target product may be something other than a vehicle. The target product may be an electrical appliance or a device equipped with an internal combustion engine. The target product may also be a household product or a commercial product. The program, etc. disclosed herein may be suitably applied to target products that require periodic inspections or part replacements. The target product may require complex operations or have multiple functions. In this case, a detailed explanation of the operation and / or functions of the target product may be displayed on the display instead of the work content.

[0105] The maintenance work display program does not have to be included in the maintenance work information 204. The maintenance work display program may be separately installed in the terminal 100. The terminal 100 or the server device 200 may have a program recording medium on which the maintenance work display program is recorded, or may be connected to the recording medium.

[0106] The maintenance work display program is executed by, but is not limited to, the processing circuit of the control unit 101 of the terminal 100. A part of the maintenance work display program (e.g., the voice recognition program 207) may be executed by the processing circuit of the control unit 201 of the server device 200, and the process of displaying the display image 400 on the display 106 may be executed by the processing circuit of the control unit 101 of the terminal 100.

[0107] The display image may be divided not only horizontally but also vertically. The display image may be divided in a direction perpendicular to the main direction of scrolling the area within the display image.

[0108] In this embodiment, a number is placed before the heading, but a symbol other than a number, such as an alphabet, may be used. Alternatively, a heading may be selected by the operator uttering the word displayed in the heading.

[0109] It is preferable that the information displayed in the table of contents area 401 and operable by voice instructions is displayed in a different manner than the information displayed in other table of contents area 401. This makes it easier for the worker to recognize the intended voice instructions.

[0110] The headings may have a hierarchical structure of three or more levels, or may not have a hierarchical structure at all.

[0111] The language of the screen operation instructions and the voice instructions related to the screen operation instructions may be changed as appropriate depending on the language used by the worker.

[0112] [Additional Notes] The maintenance work display program, maintenance work display system, and product description display method according to the present disclosure provide the following aspects.

[0113] [Aspect 1] A maintenance work display program for displaying a plurality of work contents on a display, the program causing a processing circuit to execute the following steps: an image generation process for generating a display image for displaying on the display a table of contents showing the headings of the plurality of work contents and a specific work content; a voice recognition process for converting a voice instruction given by a worker into a screen operation instruction based on a voice conversion table; and an image update process for updating the display image based on the screen operation instruction, wherein the voice conversion table includes information that associates the screen operation instruction for displaying on the display the work content corresponding to the heading in accordance with the voice instruction corresponding to the heading.

[0114] [Aspect 2] The maintenance work display program according to Aspect 1, wherein the voice conversion table includes information associated with the screen operation instruction for changing the display mode of the heading.

[0115] [Aspect 3] The maintenance work display program according to Aspect 1 or 2, wherein the headings have a hierarchical structure, and the voice conversion table includes information associated with the screen operation instruction for expanding and displaying the headings at a lower level, and information associated with the screen operation instruction for collapsing the displayed lower level and displaying a higher level.

[0116] [Aspect 4] The maintenance work display program according to any one of Aspects 1 to 3, wherein the voice conversion table includes information associated with the screen operation instruction for scrolling, enlarging, or reducing a table of contents area in which the table of contents is displayed.

[0117] [Aspect 5] The maintenance work display program according to any one of Aspects 1 to 4, wherein the work content includes a link for displaying other work content, and the voice conversion table includes information that associates the screen operation instruction for displaying the other work content with the voice instruction corresponding to the link.

[0118] [Aspect 6] The maintenance work display program according to any one of Aspects 1 to 5, wherein the image update process displays the voice instruction on the display.

[0119] [Aspect 7] The maintenance work display program according to any one of Aspects 1 to 6, wherein the voice conversion table includes information associated with the screen operation instructions for displaying a list of the screen operation instructions.

[0120] [Aspect 8] The maintenance work display program according to any one of Aspects 1 to 7, wherein the image generation process generates the display image that displays on the display specific items for displaying a list of work groups in which specific work contents related to common content are extracted from a plurality of the work contents, and the voice conversion table includes information associated with the screen operation instruction for displaying the list of the work groups.

[0121] [Aspect 9] The maintenance work display program according to any one of Aspects 1 to 8, wherein worker information identifying the worker and screen operation instruction information relating to the screen operation instruction are stored in a database within a specific server device.

[0122] [Aspect 10] The maintenance work display program according to any one of Aspects 1 to 9, wherein the voice conversion table includes information associated with the screen operation instruction for displaying supplemental information related to the displayed work content.

[0123] [Aspect 11] A maintenance work display system comprising: a control unit having: a display that displays a plurality of work contents; a voice acquisition unit that acquires voice instructions uttered by a worker; an image generation unit that generates a display image on the display that displays a table of contents showing each of the plurality of work contents with headings of the work contents and a specific one of the work contents; a voice recognition unit that converts the voice instructions into screen operation instructions based on a voice conversion table; and an image update unit that updates the display image based on the screen operation instructions, wherein the voice conversion table includes information that associates the screen operation instructions for displaying the work contents corresponding to the headings in accordance with the voice instructions corresponding to the headings.

[0124] [Aspect 12] A product description display method for displaying a plurality of description contents relating to a product on a display, comprising: generating a display image on the display that displays a table of contents with headings for each of the plurality of description contents and a specific one of the description contents; converting a voice instruction given by a user into a screen operation instruction based on a voice conversion table; and updating the display image based on the screen operation instruction, wherein the voice conversion table includes information that associates the screen operation instruction for displaying the description content corresponding to the heading in accordance with the voice instruction corresponding to the heading.

Claims

1. A maintenance work display program for displaying a plurality of work contents on a display, the program causing a processing circuit to execute the following steps: an image generation process for generating a display image on the display showing a table of contents with headings for each of the plurality of work contents and a specific work content; a voice recognition process for converting voice instructions given by a worker into screen operation instructions based on a voice conversion table; and an image update process for updating the display image based on the screen operation instructions, wherein the voice conversion table includes information that associates the screen operation instructions for displaying the work content corresponding to the heading on the display in accordance with the voice instruction corresponding to the heading.

2. The maintenance work display program according to claim 1, wherein the voice conversion table includes information associated with the screen operation instruction for changing the display mode of the heading.

3. The maintenance work display program according to claim 2, wherein the headings have a hierarchical structure, and the voice conversion table includes information associated with the screen operation instructions for expanding and displaying the headings at lower levels, and information associated with the screen operation instructions for collapsing the displayed lower levels and displaying the higher levels.

4. A maintenance work display program as described in claim 2 or 3, wherein the voice conversion table includes information associated with the screen operation instructions for scrolling, enlarging, or reducing the table of contents area in which the table of contents is displayed.

5. A maintenance work display program as described in claim 1 or 2, wherein the work content includes a link for displaying other work content, and the voice conversion table includes information that associates the screen operation instruction for displaying the other work content with the voice instruction corresponding to the link.

6. The maintenance work display program according to claim 1 or 2, wherein the image update process displays the voice instructions on the display.

7. The maintenance work display program according to claim 1 or 2, wherein the voice conversion table includes information associated with the screen operation instructions for displaying a list of the screen operation instructions.

8. A maintenance work display program as described in claim 1 or 2, wherein the image generation process generates the display image that displays on the display specific items for displaying a list of work groups in which specific work contents related to common content are extracted from multiple work contents, and the voice conversion table includes information associated with the screen operation instructions for displaying the list of work groups.

9. The maintenance work display program according to claim 1 or 2, wherein worker information for identifying the worker and screen operation instruction information related to the screen operation instruction are stored in a database within a specific server device.

10. A maintenance work display program as described in claim 1 or 2, wherein the voice conversion table includes information associated with the screen operation instructions for displaying supplementary information related to the work content being displayed.

11. A maintenance work display system comprising: a display that displays a plurality of work contents; a voice acquisition unit that acquires voice instructions uttered by a worker; an image generation unit that generates a display image on the display that displays a table of contents showing the headings of the plurality of work contents and a specific work content; a voice recognition unit that converts the voice instructions into screen operation instructions based on a voice conversion table; and an image update unit that updates the display image based on the screen operation instructions, wherein the voice conversion table includes information that associates the screen operation instructions for displaying the work content corresponding to the heading in accordance with the voice instruction corresponding to the heading.

12. A product description display method for displaying multiple product-related description contents on a display, comprising: generating a display image on the display that displays a table of contents in which the headings of the multiple description contents are respectively displayed and a specific description content; converting voice instructions given by a user into screen operation instructions based on a voice conversion table; and updating the display image based on the screen operation instructions, wherein the voice conversion table includes information that associates the screen operation instructions for displaying the description content corresponding to the heading in accordance with the voice instruction corresponding to the heading.

Images