Program, computer system and guidance presentation control method

Abstract

To provide a technique for performing creation support in cutting away formed parts from a runner and assembling a plurality of cut-away formed parts to create an object.SOLUTION: A server system 1100 performs creation support in cutting away formed parts 14 from a runner 16 and assembling a plurality of cut-away formed parts to create an object. Concretely, the server system 1100 identifies a creation object based on a photographic image 36 obtained by photographing the runner 16, selects, from creation support information prepared for each of different types of creation object, creation support information corresponding to the identified creation object, and performs presentation control of a guidance 35 based on the selected creation support information.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to a program and the like. [Background technology]

[0002] There is a technology that, when an object is photographed with a camera, displays a virtual space in which the object is placed at the image position, thereby reproducing in the virtual space the arrangement of the object and parts being assembled in the real world, and displaying information related to the next assembly step (see, for example, Patent Document 1). This allows the user to know how to attach the parts to the object. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-156131 Summary of the Invention [Problem to be solved by the invention]

[0004] A typical example of an object that can be enjoyed by assembling parts is a plastic model. A plastic model is a typical example of an assembly model, and is a toy that allows users to enjoy assembling parts molded from synthetic resin to complete a single created object (for example, a character or robot that appears in manga or anime, or a vehicle such as an airplane or automobile).

[0005] A plastic model package comes with one or more runners (also called runner blocks) on which multiple parts (hereafter referred to as "molded parts") are molded together, along with assembly instructions. Referring to the assembly instructions, the user follows the instructions to find where on the runner the molded part for the next assembly step is located, detach it, and assemble it. This series of steps is one of the joys of plastic models.

[0006] As the structure of a manufactured object becomes more complex, the number of runners (or runner blocks) as well as the number of molded parts and assembly steps increases. The number of molded parts also increases. For this reason, in the case of a plastic model of a manufactured object with a complex structure, it becomes difficult for the user to find the molded part required for the next assembly step from the runner. This can be particularly difficult for users who are not accustomed to assembling plastic models.

[0007] The conventional technology disclosed in Patent Document 1 and other publications is based on the premise that there are parts to be assembled next, and provides guidance on how to assemble those parts. Therefore, the conventional technology cannot be applied to the production of objects, such as plastic models, which require the procedure of "finding and separating a molded part from a runner."

[0008] The problem that the present invention aims to solve is to provide a technique for assisting in the production of an object by separating a molded product from a runner and assembling a plurality of the separated molded products. [Means for solving the problem]

[0009] The first invention for solving the above-mentioned problems is a program for a computer system to provide support for manufacturing an object by separating a molded product from a runner and assembling the separated molded products, the program including: an identification means (e.g., the control board 1150 in FIG. 1, the server processing unit 200s in FIG. 9, the identification unit 220, the image recognition dictionary data library 510 in FIG. 10, the manufactured object determination criteria data 519, step S12 in FIG. 16) for identifying a manufactured object based on read information read by a reading means for reading the runner; This is a program for causing the computer system to function as a guidance presentation control means (e.g., control board 1150 in Figure 1, server processing unit 200s in Figure 9, guidance presentation control unit 230 in Figure 10, guidance presentation control data 610 in Figure 17, step S54 in Figure 17) that selects production support information corresponding to the production object identified by the identification means from the production support information prepared for each object, and controls the presentation of guidance based on the selected production support information.

[0010] Further, the second invention is a program of the first invention, in which the identification means has a runner identification means (for example, the runner identification unit 222 in Figure 9, step S12 in Figure 16) that identifies a read runner based on the read information, and identifies the production object based on the read runner.

[0011] Further, a third invention is a program of the second invention, in which the production support information includes support information for each runner (for example, data package for each assembly procedure 530 and combination of runners used 533 in Figure 12), and the guidance presentation control means selects support information for each runner included in the production support information corresponding to the production object that corresponds to the read runner, and controls the presentation of guidance based on the selected support information.

[0012] A fourth aspect of the present invention is a program for a computer system to provide support for manufacturing an object by separating molded articles from runners and assembling the separated molded articles, the program including: identification means for identifying a read runner based on read information read by reading means for reading the runner; This is a program that causes the computer system to function as a guidance presentation control means that selects support information corresponding to the read runner identified by the identification means from the support information prepared for each runner, and controls the presentation of guidance based on the selected support information.

[0013] According to any one of the first to fourth aspects of the present invention, the computer system identifies the object to be produced or the read runner based on the read information from the runner, selects information to support the production, and presents guidance. This makes it possible to support the production of an object by separating a molded product from a runner and assembling the separated molded products.

[0014] A fifth invention is a method in which the reading means is a camera, and the read information is a photographed image, The program of any one of the second to fourth inventions, wherein the identification means identifies the read runner based on any of the color, shape, and arrangement of the runner and / or the molded product connected to the runner shown in the captured image.

[0015] According to the fifth invention, the computer system can identify the read runner based on the runner itself shown in the captured image, or on the color, shape, or arrangement of the molded product connected to the runner.

[0016] A sixth invention is a program of the third or fourth invention, wherein the support information includes support information corresponding to a predetermined combination of the runners (for example, data package 530 by assembly procedure and combination of runners used 533 in Figure 12), and the guidance presentation control means controls the presentation of guidance based on the support information corresponding to the predetermined combination when the identification means identifies multiple read runners and the multiple read runners correspond to the predetermined combination.

[0017] A seventh invention is a program according to the sixth invention, wherein the support information according to the predetermined combination includes other runner combination support information for assembling using molded products of each of the runners of the predetermined combination, and the guidance presentation control means controls the presentation of guidance based on the other runner combination support information as the support information according to the predetermined combination.

[0018] According to the sixth or seventh aspect of the present invention, the computer system can present support information according to the combination of read runners as guidance.

[0019] An eighth invention is the program of any one of the second to seventh inventions, wherein the guidance presentation control means controls presentation of guidance regarding assembly of the molded product separated from the read runner.

[0020] According to the eighth aspect of the present invention, the computer system can provide guidance for assembling molded products even if they are separated from the runner.

[0021] A ninth invention is the program of any one of the second to eighth inventions, wherein the guidance presentation control means controls the display of a presentation image of a molded product related to the read runner.

[0022] According to the ninth aspect of the present invention, the computer system can display a presentation image of the molded product together with the guidance.

[0023] A tenth aspect of the present invention is the program according to any one of the second to ninth aspects of the present invention, wherein the guidance presentation control means controls the display of supplementary information of the molded product related to the read runner.

[0024] According to the ninth aspect of the present invention, the computer system can display supplementary information about the molded product together with the guidance.

[0025] An eleventh invention is a program of any of the first to tenth inventions, which further causes the computer system to function as a detachment status detection means (e.g., control board 1150 in Figure 1, server processing unit 200s in Figure 9, detachment status detection unit 224, step S12 in Figure 16) that detects the detachment status of the molded product based on the read information, and the guidance presentation control means controls the presentation of the guidance based on the detachment status.

[0026] According to the eleventh aspect of the present invention, the computer system can control the presentation of guidance based on the disconnection situation.

[0027] A twelfth aspect of the present invention is the program according to the eleventh aspect of the present invention, wherein the guidance presentation control means predicts the next step in the production process and controls the presentation of the guidance based on the prediction.

[0028] A thirteenth aspect of the present invention is the program of the twelfth aspect, wherein the guidance presentation control means controls the presentation of the guidance for identifying the runner and / or the molded product related to the predicted next step.

[0029] According to either the twelfth or thirteenth aspect of the present invention, the computer system can predict the next steps involved in production and control the presentation of guidance.

[0030] In a fourteenth aspect of the present invention, the reading means is a camera, the read information is a photographed image, the guidance presentation control means has a runner image display control means (e.g., the control board 1150 in FIG. 1, the server processing unit 200s in FIG. 9, the runner image display control unit 232, step S54 in FIG. 17) that controls the display of the runner image, The runner image display control means is a program according to any one of the first to thirteenth aspects of the present invention, which controls the color of the runner image based on the color of the runner appearing in the photographed image.

[0031] According to the fourteenth aspect of the present invention, the computer system can control the color of the runner image based on the color of the runner in the photographed image, thereby changing the color of the runner image to the color of the actual runner in the photographed image and presenting it.

[0032] A 15th invention is a program of any of the first to fourteenth inventions, in which the guidance presentation control means has a molded product designation receiving means (e.g., server processing unit 200s in Figure 9, molded product designation receiving unit 234, step S12 in Figure 16) that receives the designation of the molded product based on user operation, and controls the presentation of the guidance regarding the designated molded product.

[0033] According to the fifteenth aspect of the present invention, the computer system can present guidance regarding a molded product designated by the user.

[0034] A 16th invention is a program of any of the first to fifteenth inventions, which further causes the computer system to function as a user information acquisition means for acquiring user information (e.g., the control board 1150 in FIG. 1, the server processing unit 200s in FIG. 9, the user information acquisition control unit 218, the user information 600 in FIG. 14), and the guidance presentation control means controls to change the presentation control of the guidance based on the user information.

[0035] A seventeenth aspect of the present invention is the program according to the sixteenth aspect of the present invention, wherein the user information includes any one of the user's age, sex, and production experience.

[0036] According to the sixteenth or seventeenth aspect of the present invention, the computer system can change the guidance presentation control based on the user information.

[0037] An 18th invention is a program of any of the 1st to 17th inventions, in which the guidance presentation control means variably controls the presentation of the guidance over time (for example, additional guide data 546 in the support level data set 540 in FIG. 13, step S64 in FIG. 17).

[0038] According to the eighteenth aspect of the present invention, the computer system can variably control the presentation of guidance over time.

[0039] A nineteenth invention is a computer system that provides production support when an object is produced by separating a molded product from a runner and assembling the separated molded products, the computer system comprising: identification means for identifying a production object based on read information read by reading means that reads the runner; and guidance presentation control means for selecting production support information corresponding to the production object identified by the identification means from production support information prepared for each object, and for controlling the presentation of guidance based on the selected production support information.

[0040] According to the nineteenth aspect, a computer system that brings about the same effects as the first aspect can be realized.

[0041] A twentieth invention is a computer system that provides production support when cutting a molded product from a runner and assembling the cut-off molded products to produce an object, and is equipped with an identification means that identifies the read runner based on the read information read by the runner reading means, and a guidance presentation control means that selects support information corresponding to the read runner identified by the identification means from support information prepared for each runner, and controls the presentation of guidance based on the selected support information.

[0042] According to the twentieth aspect, a computer system can be realized that provides the same effects as the fourth aspect.

[0043] A 21st aspect of the present invention is a production support method in which a computer system provides production support when a user cuts out molded products from a runner and assembles the cut out molded products to produce an object, the method comprising: a read information acquisition step (for example, step S12 in FIG. 16) of acquiring read information obtained by reading the runner; an identification step (e.g., step S14 in FIG. 16) of identifying a production object based on the read information; This production support method includes a guidance presentation control step (e.g., step S54 in Figure 17) that selects production support information corresponding to the production object identified in the identification step from production support information prepared for each object, and controls the presentation of guidance based on the selected production support information to the user.

[0044] According to the twenty-first aspect of the invention, a production support method can be realized that brings about the same effects as the first aspect of the invention.

[0045] A 22nd aspect of the present invention is a production support method in which a computer system provides production support when a user cuts out molded products from a runner and assembles the cut out molded products to produce an object, the method comprising: a read information acquisition step of acquiring read information obtained by reading the runner; an identification step of identifying a read runner based on the read information; A production support method including a guidance presentation control step of selecting support information corresponding to the read runner identified in the identification step from support information prepared for each runner, and controlling the presentation of guidance based on the selected support information to the user.

[0046] According to the twenty-second aspect of the invention, a production support method can be realized that brings about the same effects as the fourth aspect of the invention. [Brief explanation of the drawings]

[0047] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of a production support system. [Figure 2] A diagram for explaining the packaging of a plastic model and the object produced from it. [Figure 3] FIG. 10 is a diagram for explaining production support. [Figure 4] A diagram showing an example of a production support screen (part 1). [Figure 5] FIG. 10 is a diagram showing an example of a guidance display. [Figure 6]FIG. 2 shows an example of a production support screen. [Figure 7] FIG. 10 is a diagram showing an example of a shortage warning display. [Figure 8] FIG. 3 shows an example of a production support screen. [Figure 9] FIG. 2 is a functional block diagram showing an example of the functional configuration of a server system. [Figure 10] FIG. 3 is a diagram showing examples of programs and data stored in a server storage unit. [Figure 11] FIG. 2 is a diagram showing an example of the data configuration of an image recognition dictionary data library. [Figure 12] FIG. 4 is a diagram showing an example of the data structure of production support information. [Figure 13] FIG. 10 is a diagram showing an example of the data structure of a data set classified by level of support. [Figure 14] FIG. 4 is a diagram showing an example of the data configuration of user information. [Figure 15] FIG. 2 is a functional block diagram showing an example of the functional configuration of a user terminal. [Figure 16] Flowchart for explaining the operation of the production support system [Figure 17] Flowchart continued from Figure 16. [Figure 18] FIG. 10 is a functional block diagram showing an example of the functional configuration of a user terminal according to the second embodiment. [Figure 19] FIG. 10 is a diagram showing an example of programs and data stored in a terminal storage unit according to the second embodiment. [Figure 20] FIG. 4 shows an example of a production support screen. DETAILED DESCRIPTION OF THE INVENTION

[0048] An example of an embodiment of the present invention will be described below, but it goes without saying that the forms to which the present invention can be applied are not limited to the following embodiment. In this embodiment, an example of an embodiment in which the reading means is a camera and the read information is a photographed image will be described. In addition, a plastic model will be described as an example of the object to be produced.

[0049] [First embodiment] FIG. 1 is a diagram showing an example of the configuration of a production support system 1000. As shown in FIG. The production support system 1000 is a computer system that includes a server system 1100 and a user terminal 1500 for each user, with the user terminal 1500 serving as a man-machine interface (MMIF). Although only one user terminal 1500 is shown in Fig. 1, the number of user terminals 1500 is not an issue in actual system operation.

[0050] The server system 1100 and the user terminal 1500 can communicate data with each other via a network 9. The network 9 refers to a communication path over which data communication is possible. In other words, the network 9 includes a dedicated line (dedicated cable) for direct connection, a LAN (Local Area Network) such as Ethernet (registered trademark), a telephone communication network, a cable network, the Internet, and other communication networks, and the communication method can be either wired or wireless.

[0051] The server system 1100 has a main device 1101, a keyboard, a touch panel, and storage 1140, and a control board 1150 is mounted on the main device 1101. The control board 1150 is mounted with various microprocessors such as a CPU (Central Processing Unit) 1151, a GPU (Graphics Processing Unit), and a DSP (Digital Signal Processor), various IC memories 1152 such as VRAM, RAM, and ROM, and a communication device 1153. Note that part or all of the control board 1150 may be realized by an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or an SoC (System on a Chip).

[0052] Although the server system 1100 is illustrated as a single server device, it may be realized by a configuration of multiple devices working together. For example, it may be configured to include multiple blade servers that share each function and are connected to each other via an internal bus so that data communication is possible. Furthermore, the location of the hardware installation is not important. It may be configured so that multiple independent servers installed in remote locations communicate data via the network 9, and function as the server system 1100 as a whole.

[0053] The user terminal 1500 is a computer system used by a user to utilize the production support system 1000, and is an electronic device (electronic equipment) that accesses the server system 1100 via the network 9. The user terminal 1500 includes an operation input device (e.g., a keyboard, a touch panel, a game controller, a mouse, etc.), a touch panel 1506 (e.g., a video monitor, a touch panel, a head-mounted display, etc.), a camera 1521 that captures images on the side opposite to the side on which the touch panel 1506 is provided, and a control board 1550.

[0054] The control board 1550 is equipped with a CPU 1551, various microprocessors such as a GPU and a DSP, various IC memories 1552 such as a VRAM, a RAM and a ROM, a communication module 1553 for connecting to the network 9, and the like. These elements equipped on the control board 1550 are electrically connected via a bus circuit or the like, and are connected so as to be able to read and write data and send and receive signals. A part or all of the control board 1550 may be configured using an ASIC, an FPGA, or an SoC. The control board 1550 stores programs and various data for realizing the functions of a user terminal in the IC memory 1552.

[0055] In this embodiment, the user terminal 1500 is configured to download programs and various setting data from the server system 1100, but it may also be configured to read them from a separately obtained storage medium such as a memory card.

[0056] The user terminal 1500 may take any form as long as it is a computer system. For example, it may be a smartphone, a wearable computer such as a smartwatch, a portable game device, a home-use game device, a tablet computer, a personal computer, an arcade game device, etc. When multiple electronic devices are communicatively connected to perform a single function, such as a combination of a smartphone and a smartwatch communicatively connected to the smartphone, the multiple electronic devices can be considered as a single user terminal 1500.

[0057] FIG. 2 is a diagram for explaining the package of the plastic model and the production object. The plastic model package 10 contains parts for a construction toy that the user can assemble into a production object 12. The production object 12 is modeled on themes such as characters and robots that appear in manga, anime, video games, etc., and vehicles such as airplanes, cars, and ships.

[0058] The package 10 includes a plurality of runners 16 (16a, 16b, ...) on which a plurality of molded articles 14 (14a, 14b, ...; only some of the molded articles are numbered as many are shown in the figure) corresponding to parts for assembling the object 12 are integrally molded, a decal sheet 19 containing decals 18 to be affixed to the surfaces of the molded articles 14, and an assembly instruction manual 20 which is a printed matter illustrating the assembly procedure.

[0059] The components of the production object 12 included in the package 10 are not limited to the molded product 14, the runner 16, and the decal 18, but may also include other elements.

[0060] The box of the package 10 itself has an image of the production object 12 and a product name (for example, the name of the character or the like that was the basis for creating the production object 12) printed on the surface.

[0061] The runner 16 is a block made by injection molding synthetic resin, and is molded in a single color or a mixed color. Some runners are molded from transparent synthetic resin. The runner 16 has a tag 17. On the tag 17, text (alphabet in the example of FIG. 2) for identifying the runner 16 is formed in relief or printed.

[0062] The assembly instructions 20 describe a number of steps, and for each step, the multiple molded parts 14 required for that step are associated with illustrations that show how to assemble the molded parts 14. By referring to the assembly instructions 20, the user can assemble the production object 12 in the conventional manner by repeating the steps shown in the assembly instructions 20, such as finding the necessary molded parts 14 from the runner 16, cutting them out, and assembling them.

[0063] However, when the object 12 to be produced has a complex shape, the number of molded parts 14 and the number of runners 16 also increase. There is also a high possibility that the number of molded parts 14 with similar shapes increases. This makes it difficult to find the necessary molded part 14 from among the runners 16 for each step.

[0064] The production support system 1000 can support production through the user terminal 1500 in place of the assembly manual 20 .

[0065] FIG. 3 is a diagram for explaining production support. When the user inputs a predetermined support start operation on the user terminal 1500, a message is displayed prompting the user to take a photo of all of the runners 16 and the decal sheet 19. The package 10 may also be included in the objects to be photographed. As shown in FIG. 3, when the user takes a photo with the user terminal 1500 in accordance with the message, the data of the captured image (hereinafter referred to as the entire image) is saved in the user terminal 1500 and undergoes image recognition processing. Note that although an example is shown in which all of the objects to be photographed are photographed at once, a group of captured image data obtained by photographing each of the runners 16 and the decal sheet 19 individually may be used instead of the entire image data.

[0066] Dictionary data for image recognition processing is prepared for each of the various types of production objects 12, and includes dictionary data for image recognition of the package 10, runner 16, molded product 14, and decal 18. The contents of the dictionary data can be set as appropriate. Necessary data is prepared according to the image recognition algorithm used, such as data on color, full and partial outline shapes, feature shapes and their relative positional relationships, etc.

[0067] The production support system 1000 determines the type of production object 12 that is the target of production support, i.e., the type of production object 12 that the user is about to assemble, from the results of image recognition processing of the entire image. Then, guidance to support assembly is presented on the user terminal 1500 based on production support provided in advance for each type of production object 12.

[0068] FIG. 4 shows an example of a production support screen W2 displayed on the touch panel 1506 of the user terminal 1500.

[0069] The production support screen W2 has a sequence display 30, a procedure heading 31, an automatic progress operation icon 32, a manual progress operation icon 33, molded product information 34, guidance 35, a captured image 36, and a display switching operation icon 38.

[0070] The sequence display 30 indicates which step of the assembly procedure the guidance 35 is currently being displayed for.

[0071] The assembly order is predicted from the results of image recognition of the molded products 14, runners 16, and decals 18 photographed by the user terminal 1500. For example, if it is recognized that all molded products 14 are in their predetermined connection positions relative to the runners 16, it is predicted that assembly has not yet begun or is about to begin. Therefore, the assembly order is predicted to be "1." As the assembly procedure progresses, some molded products 14 may not be captured in the captured image 36 because they have been detached from the runners 16. Therefore, for example, among the molded products 14 photographed while connected to the runners 16, the assembly order with the smallest order number among the assembly orders requiring the molded products 14 can be predicted as the next assembly order. Alternatively, assembly orders requiring molded products 14 that have not been photographed and have been detached from the runners 16 can be searched for and excluded, and the assembly order with the smallest order number among the assembly orders not found can be predicted as the next assembly order.

[0072] The user can switch between automatic and manual progression of the assembly steps. Touching the automatic progression icon 32 sets the step to automatic progression, and when the time elapsed since the guidance for that step was presented reaches a given reference value, the guidance step automatically advances one step at a time. The given reference value here can be a value that changes depending on the user's level of building experience. In the case of manual progression, touching the manual progression icon 33 advances or rewinds one step in the guidance. The direction of the arrow on the icon determines whether to advance or rewind.

[0073] The molded product information 34 displays various information related to the molded product 14 required for assembly in the relevant procedure. For example, the molded product information 34 displays information about the molded product name (such as "left eyebrow" or "left eye" in FIG. 4), material (such as "material 1" in FIG. 4), and paint color in association with the molded product ID (such as "A2" or "C1" in FIG. 4) indicating which runner 16 the molded product 14 is on.

[0074] The guidance 35 is an illustration or video that explains the assembly procedure. The video may be a video of an instructor actually assembling the molded product 14, or a video created using 3DCG (3 Dimensions Computer Graphics).

[0075] When the guidance 35 is a video image drawn using 3DCG, the CG image of the molded product 14 reflects the paint color to be applied to the molded product 14 and the color of the resin material of the molded product 14. For example, when variations in the production object 12 are created by changing the paint color on the transparent parts, and packages 10 for each variation are produced, it is preferable to set the color scheme of the CG model of the transparent molded product 14 to a color corresponding to the variation, as this allows for easy production of images of each variation. The same applies when variations are set by changing the color of the resin material. The 3DCG model is the same, but the display color can be set to the color of the resin material (which may be the color of the runner 16 and molded product 14 shown in the photographed image 36). This has the secondary effect of reducing the data size of the guidance 35.

[0076] In the example guidance 35 of Figure 4, only the separated molded part 14 is depicted, but the guidance 35 may also show the runner 16 to be used in the next assembly step (the runner to which the molded part 14 to be used is connected).

[0077] 5, a 3DCG model 61 (61a, 61b) of the runner 16 and a tool model 62 are displayed, and an image is displayed showing where to cut with the tool to separate the molded product 14. Furthermore, after displaying the required molded product 14, a video may be displayed that provides step-by-step instructions on how to orient the separated molded product 14 when assembling it.

[0078] Even in this configuration, if variations are set by differences in the resin material color, the display color of the 3DCG model 61 can be set to the resin material color (which may be the color of the runner 16 and molded product 14 shown in the photographed image 36). Incidentally, the resin material color is different between the 3DCG model 61a of the runner 16 in Fig. 5(1) and the 3DCG model 61b of the runner 16 in Fig. 5(2).

[0079] Returning to Figure 4, if both illustration and video data are available for guidance 35, the two may be displayed in sequence, or the data displayed as guidance 35 may be switched when a specified switching operation by the user (for example, a flick operation within the display area of ​​guidance 35) is detected.

[0080] The example in Figure 4 shows a state in which guidance 35 is displayed in a small section and the captured image 36 is displayed in a large section, but when the user touches the display switching operation icon 38, the display sections for guidance 35 and captured image 36 are swapped, allowing the user to display whichever one they prefer larger on the screen.

[0081] The captured image 36 is a live image captured by the camera 1521 of the user terminal 1500, and is image-recognized in real time. Each of the molded articles 14, runners 16, and decals 18 shown in the image is image-recognized in real time, and among the molded articles 14, runners 16, and decals 18 shown in the captured image 36, a performance display element 44 is compositely displayed on each molded article 14 used in the assembly order shown by the sequence display 30. The purpose and display form of the performance display element 44 can be set as appropriate.

[0082] By superimposing the effect display object 44 on the photographed image 36, the user can see at a glance which molded product 14 should be separated from which runner 16. Even if the molded product 14 shown in the photographed image 36 has already been separated, if the effect display object 44 is displayed on that molded product 14, the user can see at a glance that it corresponds to the molded product to be used in the assembly order indicated by the order display 30. Therefore, the display of the photographed image 36 with the effect display object 44 superimposed thereon functions as second guidance 34B.

[0083] Because the captured image 36 is a live image, if the user changes the position or orientation of the user terminal 1500 or performs a zoom operation, the captured image 36 also changes in real time. The display position and size of the effect display object 44 are then controlled to follow based on the results of real-time image recognition processing. For example, FIG. 6 shows the production support screen W4 in a state where the user terminal 1500 is moved closer to a specific molded product 14 from the state shown in FIG. 4. If the molded product 14 or runner 16 appears small in the captured image 36, the user may find it difficult to understand what the effect display object 44 is indicating. In such a case, the user can immediately confirm the location indicated by the effect display object 44 by moving the user terminal 1500 closer to the runner 16.

[0084] If a molded part 14 required for the predicted next assembly step cannot be recognized in the captured image 36, a shortage warning display 40 such as that shown in FIG. 7 is displayed. The shortage warning display 40 includes, for example, the molded part ID of the unrecognized molded part 14 (missing molded part) and the runner ID of the runner 16 to which the molded part 14 is connected. The shortage warning display 40 is cleared when the missing molded part is recognized in the captured image 36. The display of the shortage warning display 40 helps to determine which runner 16 the molded part 14 required for the next assembly step is on and whether it has already been separated.

[0085] Furthermore, when a predetermined touch operation (for example, a two-finger tap operation) is performed on the section displaying the captured image 36, the captured image 36 switches from live video display to still image display. When the predetermined touch operation is performed again, the still image display returns to live video display.

[0086] In this way, by referring to the production support screen W2, the user can immediately see which molded product 14 should be separated from which runner 16 in the next assembly procedure. Finding the molded product 14 from the runner 16 is much easier than referring to the assembly manual 20.

[0087] FIG. 8 is a diagram showing an example of a guidance presentation for a procedure subsequent to the assembly procedure in the example of FIG. 4, and shows an example of a production support screen W6 displayed on the touch panel 1506 of the user terminal 1500.

[0088] When the user arbitrarily photographs the runner 16 or the molded product 14 separated from the runner 16 (in the example of FIG. 8, molded products 14h and 14j), the next assembly procedure is automatically predicted, and guidance 35 for the predicted procedure is presented on the production support screen W6. The screen configuration of the production support screen W6 is the same as that of FIG.

[0089] Specifically, a user who is assembling using the assembly manual 20 as a reference but cannot find the molded part 14 to be used in the next assembly step, a user who is able to find the molded part 14 but does not understand the assembly step, a user who has tried to separate the molded parts 14 but is not confident that he or she has separated all of the necessary molded parts 14, or a user who is resuming an interrupted assembly can take a photo of the runner 16 from which some of the molded parts 14 have been separated, or the molded parts 14 that have been separated from the runner 16, and these will be recognized as images.

[0090] The separation status of the molded articles 14 from the runners 16 is detected from the results of image recognition. That is, information (connection position information) indicating the relative positional relationship of the molded articles 14 in a connected (unseparated) state on each runner 16 is prepared in advance, and by comparing the image recognition results with the connection position information, it is determined which molded articles 14 have been separated and which have not. Then, it is determined that the assembly procedure using the unseparated molded articles 14 has not been completed. In addition, it is determined that the assembly procedure using the molded articles 14 that have been separated and are not recognized in the captured image 36 has been completed. By narrowing down the assembly procedures in this way, it is possible to predict the next assembly procedure to be performed from the state of the captured image 36.

[0091] On the production support screen W6, the sequence display 30 displays the sequence of the predicted assembly steps, and the step heading 31 displays the heading. The molded product information 34 displays information about the molded product 14 used in the predicted assembly steps, and the guidance 35 displays guidance for the predicted assembly steps.

[0092] Therefore, the user can easily and immediately obtain guidance for the next assembly step even from any intermediate assembly stage. For example, a user who cannot find the molded part 14 to be used in the next assembly step can quickly find the molded part 14 to be used in the next step by photographing the runner 16 or molded part 14 and finding the effect display 44 displayed in the photographed image 36. The user can also be helped by the missing part warning display 40 being displayed unless a molded part 14 required for the next assembly step is photographed. A user who has tried to separate the molded parts 14 but is unsure whether they have separated all of the necessary molded parts 14 can begin assembly with peace of mind. A user who has found the molded parts 14 but is unable to understand the assembly procedure from the assembly manual 20 can easily understand the assembly procedure by looking at the guidance 35.

[0093] Even if the user photographs only the separated molded products 14 with the user terminal 1500, these images are individually recognized and the assembly procedure requiring them is searched for. Then, the assembly procedure using the photographed molded products 14 is predicted and the associated guidance 35 is displayed. Therefore, the production support system 1000 can also be used in a manner that accepts the specification of a molded product 14 based on a user operation of photographing the separated molded product 14 and presents guidance 35 related to the specified molded product 14.

[0094] Next, the functional configuration will be described. FIG. 9 is a functional block diagram showing an example of the functional configuration of the server system 1100. The server system 1100 includes an operation input unit 100s, a server processing unit 200s, a sound output unit 390s, an image display unit 392s, a communication unit 394s, and a server storage unit 500s.

[0095] The operation input unit 100s is a means for inputting various operations for managing the server system 1100. For example, a keyboard, a touch panel, a mouse, etc., correspond to this.

[0096] The server processing unit 200s is realized by electronic components such as a processor serving as an arithmetic circuit, such as a CPU, GPU, ASIC, or FPGA, as well as IC memory, and controls input and output of data between the server processing unit 200s and each functional unit including the operation input unit 100s and the server storage unit 500s. The server processing unit 200s performs various types of arithmetic processing based on predetermined programs and data, operation input signals from the operation input unit 100s, data received from the user terminal 1500, etc., and comprehensively controls the operation of the server system 1100.

[0097] The server processing unit 200s includes a user information acquisition control unit 218, a recognition unit 220, a detachment status detection unit 224, a guidance presentation control unit 230, a timing unit 280s, a sound generation unit 290s, an image generation unit 292s, and a communication control unit 294s. Of course, other functional units may also be included as appropriate.

[0098] The user information acquisition control unit 218 acquires user information, which includes any of the user's age, sex, and production experience.

[0099] The identification unit 220 identifies the production object based on the captured image 36 of the runner 16. The identification unit 220 includes a runner identification unit 222.

[0100] The runner identification unit 222 identifies the photographed runner based on the photographed image. The identification unit 220 identifies the production object 12 based on the photographed runner (see FIG. 3). Specifically, the identification unit 220 identifies the photographed runner based on any one of the color, shape, and arrangement configuration of the runner 16 and / or the molded product 14 connected to the runner 16 that appear in the photographed image 36.

[0101] The separation status detection unit 224 detects the separation status of the molded product 14 based on the captured image 36.

[0102] The guidance presentation control unit 230 selects production support information corresponding to the production object 12 identified by the identification unit 220 from the production support information prepared for each object, and variably controls the presentation of guidance based on the selected production support information over time.

[0103] Specifically, the guidance presentation control unit 230 selects support information corresponding to the photographed runner from the support information for each runner included in the production support information corresponding to the production object 12, and controls the presentation of guidance based on the selected support information.

[0104] Furthermore, when the identification unit 220 identifies multiple photographed runners and the multiple photographed runners correspond to a predetermined combination, the guidance presentation control unit 230 controls the presentation of guidance based on support information corresponding to the predetermined combination. More specifically, the guidance presentation control unit 230 controls the presentation of guidance based on support information for a combination of different runners as support information corresponding to the predetermined combination.

[0105] Furthermore, the guidance presentation control unit 230 performs control to change the guidance presentation control based on user information.

[0106] The guidance presentation control unit 230 also controls the presentation of guidance regarding the assembly of the molded product separated from the photographed runner. The guidance presentation control unit 230 also controls the display of a presentation image of the molded product related to the photographed runner and additional information about the molded product. The presentation display 44 in Fig. 4 corresponds to the presentation image, and the information about the material displayed in the molded product information 34 corresponds to the additional information. Furthermore, the guidance presentation control unit 230 predicts the next steps in the production process based on the separation status of the molded product 14 detected by the separation status detection unit 224, and controls the presentation of guidance based on the prediction (see FIG. 8).

[0107] The guidance presentation control unit 230 includes a runner image display control unit 232 and a molded product designation receiving unit 234 .

[0108] The runner image display control unit 232 controls the color of the runner image included in the guidance based on the color of the runner 16 appearing in the captured image.

[0109] The molded product designation receiving unit 234 performs control to receive the designation of the molded product 14 based on a user operation. The guidance presentation control unit 230 performs control to present guidance 35 related to this designated molded product 14. If the presentation method of the guidance 35 is set to "optional," the "designation of a molded product 14 based on a user operation" here refers to the user arbitrarily taking a photograph of the runner 16 from which a portion of the molded product 14 has been separated, or the separated molded product 14, in order to obtain guidance on the next assembly procedure, or to designating a molded product 14 from among those shown in the photographed image.

[0110] The timekeeping unit 280s uses a system clock to measure various times such as the current date and time, time limit, and elapsed time.

[0111] The sound generation unit 290s is realized by executing an IC or software that generates or decodes audio data, and generates or decodes audio data such as operation sounds, sound effects, background music, and voice calls related to system management of the production support system 1000 and the provision of online games. Audio signals related to system management are output to the sound output unit 390s.

[0112] The sound output unit 390s is realized by a speaker or the like, and emits sound based on an audio signal.

[0113] The image generation unit 292s generates images of various management screens for system management of the server system 1100, and outputs the image data to the image display unit 392s. The image display unit 392s is realized by a device that displays images, such as a flat panel display, a head-mounted display, or a projector.

[0114] The image generation unit 292s also generates various images required for the production support screen (see Figs. 4 to 8). For example, if the guidance 35 is a 3DCG image, it places a CG object representing the molded product 14 in a virtual three-dimensional space, controls the movement of the CG object, and performs 3DCG rendering and image processing of the CG object photographed by a virtual camera.

[0115] The communication control unit 294s executes data processing related to data communication, and realizes data exchange with external devices via the communication unit 394s.

[0116] The communication unit 394s connects to the network 9 and realizes communication. For example, it is realized by a wireless communication device, a modem, a TA (terminal adapter), a jack for a wired communication cable, a control circuit, etc. In the example of FIG. 1, this corresponds to the communication device 1153.

[0117] The server storage unit 500s stores programs and various data for implementing various functions that allow the server processing unit 200s to comprehensively control the server system 1100. It is also used as a work area for the server processing unit 200s, temporarily storing results of calculations executed by the server processing unit 200s according to various programs. This function is realized by, for example, IC memory such as RAM or ROM, magnetic disks such as hard disks, optical disks such as CD-ROMs or DVDs, online storage, etc. In the example of FIG. 1, these correspond to storage media such as the IC memory 1152 and hard disks mounted on the main device 1101. Online storage may also be included in the server storage unit 500s.

[0118] 10 is a diagram showing examples of programs and data stored in the server storage unit 500s. The server storage unit 500s in this embodiment stores a server program 501, a distribution client program 503, an image recognition dictionary data library 510, production object determination criterion data 519, production support information 520, user information 600, guidance presentation control data 610, and a current date and time 900. The server storage unit 500s also stores other programs and data (for example, timers, counters, various flags, etc.) as appropriate.

[0119] The server program 501 is a program that is read and executed by the server processing unit 200s to cause the server system 1100 to realize the functions of the user information acquisition control unit 218, the identification unit 220, the detachment status detection unit 224, and the guidance presentation control unit 230.

[0120] The delivery client program 503 is an original program that is provided to the user terminal 1500 and executed.

[0121] 11, the image recognition dictionary data library 510 includes package-specific dictionary data 511 prepared for each type of package 10, runner-specific dictionary data 512 prepared for each type of runner 16, molded product-specific dictionary data 513 prepared for each type of molded product 14, and decal-specific dictionary data 514 prepared for each type of decal 18. These dictionary data correspond to IDs indicating the elements (e.g., package ID, runner ID, molded product ID, decal ID), and store dictionary data groups for image recognition of the elements from the captured image 36. Note that if the components of the manufactured object 12 included in the package 10 include elements other than the molded product 14, runner 16, and decal 18, type-specific dictionary data for those elements is also stored.

[0122] Returning to Figure 10, the production object determination criteria data 519 is prepared for each type of production object 12 and package 10, and stores information on the components (component runner ID list, component molded product ID list, component decal ID list, etc.) used to determine them from combinations of image-recognized elements.

[0123] The production support information 520 is prepared for each type of production object 12 and package 10, and stores various data for realizing support for assembling the production object. One piece of production support information 520 includes, for example, as shown in FIG. (1) A unique production support information ID 521; (2) an applicable production object ID 522 (e.g., the name of the production object 12) that indicates which type of production object 12 the information is for; (3) Runner-specific molded product layout configuration data 523, (4) A transparent runner ID list 524 indicating the runner 16 (transparent runner) molded from transparent resin; (5) A paint color setting 525 for each molded product 14, which is prepared for each molded product and indicates the paint color to be applied to the molded product; (6) Supplementary information 526; (7) an assembly procedure data package 530; (8) Language conversion data 560 for converting and displaying the language displayed on the production support screen; Of course, other information may also be included as appropriate.

[0124] The runner-specific molded product layout configuration data 523 indicates which molded product 14 is connected to which location on which runner 16. Specifically, the data includes a runner ID, a molded product ID list, and a connection position coordinate list. The connection position coordinate list is data that stores relative position coordinates with respect to the reference position coordinates of the runner in the order of the molded product ID list.

[0125] The additional information 526 stores information related to the runner 16 and the molded product 14 connected to the runner 16. One piece of additional information 545 stores information such as paint color and material information in association with a runner ID, a molded product ID, or a used decal ID. Of course, other data can also be stored as appropriate.

[0126] An assembly procedure-specific data package 530 is prepared for each assembly procedure and stores various data related to that procedure. One assembly procedure-specific data package 530 stores (1) a sequence number 531, (2) a used molded product combination 532 which is a list of molded product IDs of the molded products 14 used in that procedure, (3) a used runner combination 533 which is a list of runner IDs of the runners 16 to which the molded products 14 used in that procedure are connected, (4) other runner combination support information 535, and (5) a support level-specific data set 540. Of course, data other than these can also be stored as appropriate.

[0127] The separate runner combination support information 535 is prepared for each type of shortage warning display 40 (see FIG. 7). One separate runner combination support information 535 stores a molded product ID indicating a molded product 14 (missing molded product) that is not recognized in the photographed image 36, a missing runner ID indicating the runner 16 to which the missing molded product is connected, and data on the display content of the shortage warning display 40, in association with each other.

[0128] The support level data set 540 is prepared for different levels of support, which vary in the level of detail and ease of understanding of the procedure explanation. In this embodiment, two levels of support are prepared: "standard," which provides support at the same level of ease of understanding / carefulness as the contents of the assembly manual 20, and "thorough," which provides support that is easier to understand / more careful than the standard level and is aimed at users with little experience building plastic models. Of course, the support level settings may be divided into more levels.

[0129] One support level-specific data set 540 includes, for example, a support level type 541, an application requirement 542, guidance data 543, effect display data 544, and additional guide data 546, as shown in FIG.

[0130] The application requirements 542 indicate conditions that the user must meet in order for the data set to be applied. The application requirements 542 are written by combining multiple sub-conditions with AND or OR. Examples of sub-conditions that may be used include a purchase history condition regarding the user's package 10 purchase history (e.g., described using the number of purchases, the date and time since previous purchases, and the type of package 10 purchased), an assembly experience condition regarding the completed assembly of the production object 12 (e.g., described using the type and number of completed assembly of the production object 12), an age condition, and a gender condition. These sub-conditions can also be set to essentially indicate "unlimited" or "no conditions."

[0131] The guidance data 543 stores various data for executing the display of the guidance 35 (see FIG. 4). For example, this includes image data of illustrations, video data, 3DCG models and motion data, etc. The example in FIG. 13 illustrates a case where one support level-specific data set 540 includes only one guidance data 543, but if both illustrations and videos are prepared, the corresponding support level-specific data set 540 will include each of the guidance data 543.

[0132] The performance display data 544 is prepared for each type of performance display body 44 (see FIG. 4), and stores various data for displaying and executing the performance display body 44 in the photographed image 36. For example, one performance display data 544 includes a unique performance display ID, performance display body data (shape, color, image data of the performance display body 44, etc.) that defines the performance display body 44, display form setting data that is set when changing the display form of the performance display body 44, an applied runner ID that indicates the runner 16 to which the performance display is applied, an applied molded product ID that indicates the molded product 14 to which the performance display is applied, an applied decal ID that indicates the decal 18 to which the performance display is applied, and relative display position information that indicates the display position relative to the applied molded product ID (for example, relative position coordinates with respect to the reference position of the photographed runner photographed in the photographed image 36).

[0133] The additional guide data 546 defines the content of the additional guidance that supplements the guidance 35 indicated by the guidance data 543 to make the assembly procedure easier to understand. Specifically, one additional guide data 546 stores a unique additional guide ID, activation requirements that must be met to activate the additional guide, and execution data for the additional guide, all in association with each other. The activation requirements are described, for example, as the elapsed time from the start of display of the guidance 35, a list of executed additional guide IDs, or the like. The content of the additional guidance may be an illustration or a video, similar to the guidance 35.

[0134] Returning to FIG. 10, user information 600 is prepared for each user who has completed a predetermined user registration procedure, and stores information related to that user. As shown in FIG. 14, one piece of user information 600 stores a unique user account 601, age 603, gender 605, and production experience data 607. Of course, other data may also be stored as appropriate. For example, history information on packages 10 purchased by the user may also be stored.

[0135] The production experience data 607 is a history of the production objects 12 that the user has completed assembling. For example, the date and time of assembly completion and the production object ID are stored in association with each other. The production experience data 607 may also include the number of years of experience in assembling plastic models and the number of assemblies completed.

[0136] 10, the guidance presentation control data 610 is prepared for each user terminal 1500 and temporarily stores various data for executing production support. For example, the guidance presentation control data 610 stores the user account of the support recipient, language settings, received image data (data of the image 36 captured by the camera 1521 and transmitted from the user terminal 1500), image recognition work data and image recognition results, the type of production object 12 to be supported, progress type settings, the number of turns in the next assembly step, elapsed time, etc.

[0137] 15 is a functional block diagram showing an example of the functional configuration of a user terminal 1500. The user terminal 1500 includes an operation input unit 100, a device processing unit 200, a sound output unit 390, an image display unit 392, a communication unit 394, and a device storage unit 500.

[0138] The operation input unit 100 outputs an operation input signal corresponding to various operation inputs made by the user to the device processing unit 200. For example, the operation input unit 100 can be realized by a push switch, a joystick, a touchpad, a trackball, an acceleration sensor, a gyro, or the like.

[0139] The device processing unit 200 is realized by electronic components such as a microprocessor such as a CPU or GPU, and an IC memory, and controls input and output of data between the device and each functional unit including the operation input unit 100 and the device storage unit 500. The device processing unit 200 controls the operation of the user terminal 1500 by executing various arithmetic processes based on predetermined programs and data, operation input signals from the operation input unit 100, and various data received from the server system 1100.

[0140] The device processing unit 200 in this embodiment includes a client control unit 260 , a clock unit 280 , a sound generation unit 290 , an image generation unit 292 , and a communication control unit 294 .

[0141] The client control unit 260 performs various controls to make the user terminal 1500 function as an MMIF (Man-Machine Interface) as a client in the production support system 1000. Specifically, the client control unit 260 has an operation input information providing unit 261 and a display control unit 262.

[0142] The operation input information providing unit 261 controls transmission of operation input information to the server system 1100 in response to input from the operation input unit 100 .

[0143] The display control unit 262 performs control to display various images based on the data received from the server system 1100 .

[0144] The timekeeping unit 280 uses a system clock to keep track of the current date and time, time limit, and the like.

[0145] The sound generation unit 290 is realized by, for example, a digital signal processor (DSP), a processor such as a voice synthesis IC, or an audio codec capable of playing audio files, and generates sound signals for music, sound effects, and various operation sounds, and outputs them to the sound output unit 390.

[0146] The sound output unit 390 is realized by a device that outputs (emits sound) based on the sound signal input from the sound generation unit 290, such as a speaker.

[0147] The image generation unit 292 generates and outputs an image signal that causes the image display unit 392 to display an image based on the control of the client control unit 260. In the example of Fig. 1, this corresponds to a GPU (Graphics Processing Unit), a graphics controller, a graphics board, etc., mounted on the control board 1550.

[0148] The image display unit 392 is realized by a device that displays images, such as a flat panel display, a head-mounted display, or a projector.

[0149] The communication control unit 294 executes data processing related to data communication, and realizes data exchange with external devices via the communication unit 394.

[0150] The communication unit 394 connects to the network 9 to realize communication. For example, it is realized by a wireless communication device, a modem, a TA (terminal adapter), a jack for a wired communication cable, a control circuit, etc. In the example of FIG. 1, this corresponds to the communication module 1553.

[0151] The device storage unit 500 stores programs for causing the device processing unit 200 to realize given functions, various data, etc. It is also used as a work area for the device processing unit 200, and temporarily stores the results of calculations executed by the device processing unit 200 in accordance with the various programs, input data input from the operation input unit 100, etc. These functions are realized by, for example, IC memory such as RAM or ROM, magnetic disks such as hard disks, optical disks such as CD-ROMs or DVDs, etc. In the example of FIG. 1, this corresponds to the IC memory 1552 mounted on the control board 1550.

[0152] Specifically, the terminal storage unit 500 stores a client program 502 (application program) for causing the user terminal 1500 to function as the client control unit 260, and a current date and time 900. Of course, other data can also be stored as appropriate.

[0153] 16 and 17 are flowcharts for explaining the operation of the production support system 1000, and are flowcharts for explaining the flow of processing executed by the server system 1100. It is assumed that user registration has already been completed.

[0154] A user who wishes to receive production support for a production object 12 inputs a predetermined production support start operation into the user terminal 1500. In response to the operation input, the user terminal 1500 transmits a production support request to the server system 1100 and starts live transmission of an image (captured image 36) being captured by the camera 1521.

[0155] When the server system 1100 receives the request, it sets the language type to be used on the production support screen (step S10). Choices may be displayed on the user terminal 1500 to allow the user to select the language type, or language setting information from the system setting information of the user terminal 1500 may be acquired from the user terminal 1500 and the same language may be set.

[0156] Next, the server system 1100 starts image recognition of the photographed image 36 transmitted from the user terminal 1500 (step S12), and accepts the setting of the production object to be supported (step S12).

[0157] There are two ways to accept settings for the production object and 12: manual setting and automatic setting. As a process related to manual setting, the server system 1100 creates a list of the names of the production objects 12 indicated by the applied production object ID 522 in the production support information 520 (see FIG. 12 ), displays the list on the user terminal 1500, and allows the user to select one. The user terminal 1500 returns the selection result to the server system 1100, and the server system 1100 sets the production object to be supported in accordance with this return and stores the setting data as guidance presentation control data 610.

[0158] As part of the automatic setting process, the server system 1100 displays a message on the user terminal 1500 instructing the user to photograph all runners 16, all molded products 14, and all decals 18 or decal sheets 19 included in the package 10. The server system 1100 then compares the results of the image recognition of the photographed image 36, which began in step S10, with the production object determination criteria data 519 (see FIG. 10), and determines the production object 12 to be supported.

[0159] Next, the server system 1100 initially sets the progress type of the production support to "manual progress" (step S16), and starts displaying the production support screen on the user terminal 1500 (step S18).

[0160] When the display of the production support screen starts, if the server system 1100 can recognize the molded product 14 and the runner 16 as a result of the image recognition process of the photographed image 36 (YES in step S30), it predicts the next assembly procedure (step S32). That is, it searches the production support information 520 (see FIG. 12) of the production object to be supported, compares the used molded product combination 532 and used runner combination 533 in the data package by assembly procedure 530 with the image recognition results, and predicts the most likely next assembly procedure.

[0161] If a prediction is not possible (NO in step S34), the server system 1100 displays a message on the user terminal 1500 requesting the user to take photos of all runners and separated molded products together (step S36). If the user sees this and increases the number of subjects to be photographed, the number of runners 16 and molded products 14 that are recognized by image recognition will increase, and the amount of information required for prediction will increase, making prediction possible or improving the accuracy of prediction. If the unpredictable state continues for more than a predetermined time, a timeout may be set to end the series of processes.

[0162] If the next assembly procedure can be predicted (YES in step S34), the server system 1100 stores the order number of the next assembly procedure in the guidance presentation control data 610 and updates the order display 30 (see FIG. 4) on the production support screen (step S50).

[0163] Moving on to Figure 17, the server system 1100 refers to the supplementary information 526 corresponding to the next assembly procedure and the molded part combination 532 used in the data package 530 for each assembly procedure, and updates the display of the molded part information 34 to that of the predicted next assembly procedure (step S52).

[0164] Next, the server system 1100 displays the guidance 35 for the next assembly procedure (step S54). Specifically, the server system 1100 searches for a data set that satisfies the application requirements 542 among the support level-specific data sets 540 (see FIG. 13) that correspond to the next assembly procedure, and displays the guidance 35 based on the guidance data 543. In addition, the server system 1100, in connection with the display of the guidance 35, reflects and displays the paint color of the molded product 14 to be painted (for example, in a display using a 3DCG model, the color of the model is displayed as the paint color, etc.).

[0165] Next, the server system 1100 starts display control of the performance display object 44 (step S56). That is, the performance display object 44 is compositely displayed on the runner 16 (photographed runner) recognized from the photographed image 36. Specifically, among the support level-specific data sets 540 (see FIG. 13) corresponding to the next assembly procedure, a data set that satisfies the application requirement 542 is searched for, and the performance display object 44 based on the performance display data 544 is compositely displayed for each molded product 14.

[0166] If all of the molded products 14 or runners 16 to be used in the next assembly procedure have not been photographed (NO in step S60), the server system 1100 displays the support information for the molded products (missing molded products) that were identified as missing in step S60 from the other runner combination support information 535 in the data package 530 for each assembly procedure as a missing product warning display 40 (see Figure 7) (step S62).

[0167] Next, the server system 1100 presents the additional guide that satisfies the activation requirements (step S64). Specifically, the server system 1100 measures the elapsed time from the start of displaying the guidance 35 in step S54, searches for additional guide data 546 (see FIG. 13) that satisfies the activation requirements from the support level-specific data set 540 corresponding to the next assembly procedure, and if there is any corresponding data, displays the additional guide on the user terminal 1500. For example, the guidance 35 may be replaced or displayed as a pop-up on the captured image 36.

[0168] The time elapsed since the start of display may be replaced by the time elapsed since the runner was detected, or the time elapsed since the user operated the guidance, or the like.

[0169] From the start of displaying the production support screen, the server system 1100 monitors whether the user has input an operation to terminate production support. That is, the user can terminate production support at will, and when a predetermined operation to terminate production support is performed on the user terminal 1500, the user terminal 1500 transmits a termination request to the server system 1100. The server system 1100 monitors the request.

[0170] If there is no operation to end production support (YES in step S70), the server system 1100 determines whether the progress timing according to the set time of the progress type has arrived (step S72). Specifically, if the progress type setting stored in the guidance presentation control data 610 is "automatic," a positive determination is made if the elapsed time from the start of the most recent display of the guidance 35 reaches a predetermined reference value. If the progress type setting is "manual," a positive determination is made if the manual progress operation icon 33 (see FIG. 4) is operated on the user terminal 1500.

[0171] If step S72 is judged to be positive (YES in step S72) and the number of orders of the assembly procedure has not reached the final value (step S74), the server system 1100 increases the number of orders of the next assembly stored in the guidance presentation control data 610 by "1" (step S76) and returns to step S30.

[0172] If the number of assembly steps has reached the final value (YES in step S74), the server system 1100 displays a notification of assembly completion on the user terminal 1500 (step S78), adds new production experience data 607 (see Figure 14) (step S80), and ends the series of processes.

[0173] As described above, according to this embodiment, when the runner 16 or the separated molded parts 14 are photographed with the user terminal 1500, the production support system 1000 performs image recognition on them, identifies the production object 12, and displays guidance 35 based on the production support information 520 on the user terminal 1500. Therefore, even if the production object 12 has a large number of molded parts 14 due to the complex structure of the plastic model, the user can refer to the guidance 35 to easily find the molded parts 14 from the runner 16, separate them, and immediately understand how to assemble the multiple separated molded parts 14, thereby smoothly assembling the production object 12.

[0174] Second Embodiment Next, a second embodiment will be described. In this embodiment, differences from the first embodiment will be mainly described, and the same components as those in the first embodiment will be assigned the same reference numerals as those in the first embodiment, and redundant explanations will be omitted.

[0175] The system configuration of the production support system 1000 in the second embodiment is the same as that in the first embodiment.

[0176] FIG. 18 is a functional block diagram showing an example of the functional configuration of the user terminal 1500B of this embodiment. The user terminal 1500B includes a user information acquisition control unit 218, an identification unit 220, a detachment status detection unit 224, and a guidance presentation control unit 230.

[0177] 19 is a diagram showing examples of programs and data stored in the terminal storage unit 500 of the user terminal 1500B. The terminal storage unit 500 of the user terminal 1500B stores a guidance presentation program 504, an image recognition dictionary data library 510, production object determination criterion data 519, production support information 520, user information 600, guidance presentation control data 610, and a current date and time 900.

[0178] The guidance presentation program 504 is a program for causing the user terminal 1500 B to function as the user information acquisition control unit 218 , the identification unit 220 , the detachment status detection unit 224 , and the guidance presentation control unit 230 .

[0179] In this embodiment, the server system 1100 stores the original data of the guidance presentation program 504, the image recognition dictionary data library 510, the production object judgment criteria data 519, and the production support information 520, and the user terminal 1500B downloads and stores them from the server system 1100 as appropriate.

[0180] The operation of the production support system 1000 in this embodiment is a process in which the execution subject of each step in the flowcharts of FIGS. 16 and 17 is replaced by the user terminal 1500B instead of the server system 1100.

[0181] In this embodiment, the same effects as in the first embodiment can be obtained.

[0182] [Modification] An example of an embodiment to which the present invention is applied has been described above, but the forms to which the present invention can be applied are not limited to the above-described form, and components can be added, omitted, or modified as appropriate.

[0183] (Variation 1) For example, the functions of the user information acquisition control unit 218, the identification unit 220, the detachment status detection unit 224, and the guidance presentation control unit 230 may be all realized in the server system 1100 as in the first embodiment, or all realized in the user terminal 1500B as in the second embodiment, but it is also possible to have them distributed between the server system 1100 and the user terminal 1500.

[0184] (Variation 2) Furthermore, on a production support screen (for example, production support screen W2 in FIG. 4), instead of the photographed image 36, a 3DCG model of the runner 16 or the molded product 14 recognized as an image in the photographed image 36 may be displayed instead. In this case, it is preferable to set the display color of the 3DCG model 61 of the runner 16 (see FIG. 5) to the color of the corresponding runner 16 recognized as an image in the photographed image 36.

[0185] (Variation 3) The above embodiment has illustrated a manufacturing support system that mainly explains assembly procedures, but is not limited to this. A "reverse lookup use" mode that retrieves information about the molded product 14 may be added to the manufacturing support system 1000.

[0186] Specifically, when a predetermined reverse lookup start operation is input on the user terminal 1500, the server system 1100 displays a production support screen W8 as shown in Fig. 20. The production support screen W8 includes a viewfinder 50 and a reverse lookup operation icon 52 within the captured image 36. The user places the molded product 14 that the user wants to check within the viewfinder 50 and operates the reverse lookup operation icon 52.

[0187] When the user terminal 1500 detects an operation input to the reverse lookup operation icon 52, it takes a photograph and transmits the photographed image data together with a reverse lookup request to the server system 1100. When the server system 1100 receives the request and image data, it performs image recognition processing on the molded product 14 that appears in the received image data at a position equivalent to the viewfinder 50, and searches for an assembly procedure that requires the recognized molded product 14. The server system 1100 then predicts the found assembly procedure as the next assembly procedure, and displays molded product information 34 and guidance 35. Of course, in the case of the user terminal 1500B of the second embodiment, it is possible to perform image recognition processing and search / prediction of the assembly procedure within the user terminal 1500B and display the guidance 35 without transmitting image data to the server system 1100.

[0188] The manufacturing support screen W8 allows the user to immediately understand in which assembly procedure the molded product 14 he or she is interested in is used and how it is used.

[0189] (Variation 4) In the above embodiment, the molded article 14 and the runner 16 are recognized by image recognition processing, but this is not limited to this. For example, if an IC tag is enclosed in or attached to the molded article 14 and the runner 16, the molded article 14 and the runner 16 may be recognized by connecting an IC tag reader to the user terminal 1500 and reading the identification information of the molded article 14 and the runner 16 from the IC tag. Also, for example, in a configuration in which the molded article 14 and the runner 16 are provided with codes printed in invisible ink, the molded article 14 and the runner 16 may be recognized by connecting a code reader to the user terminal 1500 and reading the identification information of the molded article 14 and the runner 16 from the codes. [Explanation of symbols]

[0190] 12...Production object 14…Molded product 16...Runner 30...Sequential display 34…Molded product information 35... Guidance 36...Photo 44…Direction display body 200s...Server processing section 218...User information acquisition control unit 220...Identification unit 222...Runner identification section 224...Disconnection status detection unit 230... Guidance presentation control unit 232...Runner image display control unit 234… Molded Product Designation Reception Department 500s...Server storage section 501...Server program 502...Client program 504... Guidance Presentation Program 510...Image recognition dictionary data library 520…Production support information 526...Additional information 530...Assembly procedure data package 531...Number of turns 532...Combination of molded products used 533...Runner combination used 535…Other runner combination support information 543... Guidance data 544...Performance display data 545...Additional information 600...User information 607...Production experience data 610... Guidance presentation control data 1000...Production support system 1100...Server system 1150...Control board 1500...User terminal 1550...Control board W2~W8…Production support screen

Claims

1. A program for a computer system to provide given guidance before completing the production of an object by separating molded parts from a runner and assembling the separated molded parts, the program comprising: an identification means for identifying a production object based on the read information read by the reading means for reading the runner; a guidance presentation control means for selecting guidance data corresponding to the production object identified by the identification means from among the guidance data prepared for each object, and for controlling the presentation of guidance based on the selected guidance data; A program for causing the computer system to function as a

2. the identification means includes a runner identification means for identifying a read runner based on the read information, and identifying the production object based on the read runner; The program according to claim 1.

3. the guidance data is associated with each of the runners, the guidance presentation control means selects guidance data associated with the read runner and controls the presentation of guidance based on the selected guidance data; The program according to claim 2.

4. A program for a computer system to provide given guidance before completing the production of an object by separating molded parts from a runner and assembling the separated molded parts, the program comprising: an identification means for identifying the read runner based on the read information read by the reading means for reading the runner; a guidance presentation control means for selecting guidance data corresponding to the read runner identified by the identification means from the guidance data corresponding to each runner, and for controlling the presentation of guidance based on the selected guidance data; A program for causing the computer system to function as a

5. the reading means is a camera, the read information is a photographed image, the identification means identifies the read runner based on any one of the color, shape, and arrangement of the runner and / or the molded product connected to the runner shown in the photographed image. The program according to any one of claims 2 to 4.

6. the guidance data is associated with the combination of runners, the guidance presentation control means, when the identification means identifies a plurality of read runners, controls the presentation of guidance based on guidance data corresponding to a combination of the plurality of read runners; The program according to claim 3 or 4.

7. a separation status detection means for detecting a separation status of the molded product based on the read information; and further causing the computer system to function as the guidance presentation control means controls the presentation of the guidance based on the separation status. The program according to any one of claims 1 to 6.

8. user information acquisition means for acquiring user information; and further causing the computer system to function as the guidance presentation control means performs control to change the presentation control of the guidance based on the user information. The program according to any one of claims 1 to 7.

9. The user information includes any one of the user's age, gender, and production experience. The program according to claim 8.

10. the guidance presentation control means variably controls the presentation of the guidance over time. The program according to any one of claims 1 to 9.

11. A computer system that provides guidance before completing the fabrication of an object by separating molded parts from a runner and assembling the separated molded parts, comprising: an identification means for identifying a production object based on the read information read by the reading means for reading the runner; a guidance presentation control means for selecting guidance data corresponding to the production object identified by the identification means from among the guidance data prepared for each object, and for controlling the presentation of guidance based on the selected guidance data; A computer system comprising:

12. A computer system that provides guidance before completing the fabrication of an object by separating molded parts from a runner and assembling the separated molded parts, comprising: an identification means for identifying the read runner based on the read information read by the reading means for reading the runner; a guidance presentation control means for selecting guidance data corresponding to the read runner identified by the identification means from the guidance data corresponding to each runner, and for controlling the presentation of guidance based on the selected guidance data; A computer system comprising:

13. A guidance presentation control method for a computer system to provide given guidance to a user before the user completes the production of an object by separating molded products from a runner and assembling the separated molded products, comprising: a read information acquisition step of acquiring read information obtained by reading the runner; an identification step of identifying a production object based on the read information; a guidance presentation control step of selecting guidance data corresponding to the production object identified in the identification step from among the guidance data prepared for each object, and performing control to present guidance based on the selected guidance data to the user; A guidance presentation control method including:

14. A guidance presentation control method for a computer system to provide given guidance to a user before the user completes the production of an object by separating molded products from a runner and assembling the separated molded products, comprising: a read information acquisition step of acquiring read information obtained by reading the runner; an identification step of identifying a read runner based on the read information; a guidance presentation control step of selecting guidance data corresponding to the read runner identified in the identification step from the guidance data corresponding to each runner, and performing control to present guidance based on the selected guidance data to the user; A guidance presentation control method including:

Images