Handwriting and drawing support system, mobile terminal provided with handwriting and drawing support system, handwriting and drawing support device, and handwriting and drawing object manufacturing method

Abstract

To solve the problem that writing and drawing operations are inconvenient.SOLUTION: In a handwriting and drawing support system that supports a user in drawing on an object to be drawn by projecting a projected image of a handwriting drawing object to be drawn on the object to be drawn, the system is operated by a control unit of a mobile terminal used by the user, a plurality of type options from which the type of handwriting drawing object can be selected is displayed as a type selection screen on a display unit of the mobile device, and depending on the type option selected by the user, one of a plurality of lower-level screens that differ for each type option is displayed on the display unit of the mobile terminal, the user operates the lower-level screen to determine the handwriting drawing object, the handwriting drawing object is converted into projection data to be projected on the object to be drawn and displayed on the display unit, and the projection data is transmitted so that the projection data is projected onto the object to be drawn, allowing the user to easily operate the mobile terminal to perform writing and drawing.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a handwriting and drawing support system, a mobile terminal equipped with the handwriting and drawing support system, a handwriting and drawing support device, and a handwriting and drawing object manufacturing method. [Background technology]

[0002] For our third-year high school research project, we worked on developing new technological products from a unique high school student perspective, based on the theme, "Making school life more convenient with the power of electricity." We brainstormed together issues and problems in school life and club activities, classified and organized them using the KJ method, and considered developing technological products that would solve those problems. Among the ideas proposed was one that addressed the need for technical high school students to handwrite their resumes and applications for employment and further education. For students who are not adept at writing neatly, this can require numerous rewrites and teacher corrections, which can be a significant time and effort. Furthermore, in everyday life, students often have opportunities to write and draw by hand, which can be painful for those who have difficulty writing neatly.

[0003] Therefore, we have developed a writing and drawing assistance device. A writing and drawing assistance device projects a projected image of the characters or picture the user wants to write or draw onto paper, allowing the user to write beautiful characters or draw pictures by hand simply by tracing the projected image. In this case, there is a method for controlling the projected image by dimming at least a portion of the projected image to make it easier for the user to trace it (for example, Patent Document 1). Also, there is a method for drawing beautiful pictures by intermittently projecting a projected image of the picture the user wants to draw, allowing the user to trace the intermittent projected image, making it easier to draw the picture (for example, Patent Document 2). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2023-107704 [Patent Document 2] Patent No. 7326641 Summary of the Invention [Problem to be solved by the invention]

[0005] However, currently, text and images are edited using dedicated document editing software and image editing software on a PC for writing and drawing, which makes operation inconvenient, as editing is only possible on a PC equipped with dedicated document editing software and image editing software. Furthermore, dedicated document editing software and image editing software for writing and drawing have limited uses and specific operating methods for each software, making them difficult to use for people who do not regularly use such software. Furthermore, data such as text and images is transferred from a PC to the writing and drawing support device and projected, making it difficult to carry around and making operation inconvenient. [Means for solving the problem]

[0006] In a handwriting drawing support system that supports a user in drawing on an object to be drawn by projecting a projected image of a handwriting drawing object to be drawn on the object to be drawn, the system is operated by a control unit of a mobile terminal used by the user, and causes a display unit of the mobile terminal to display a type selection screen from a plurality of type options from which the type of the handwriting drawing object can be selected, and causes the display unit of the mobile terminal to display one of a plurality of lower-level screens that differ for each type option depending on the type option selected by the user, and the handwriting drawing object is determined by the user operating the lower-level screen, and the handwriting drawing object is converted into projection data to be projected on the object to be drawn and displayed on the display unit, thereby determining the projection data.

[0007] A handwriting and drawing support system is provided in a mobile terminal used by a user, which supports a user in handwriting and drawing on an object to be drawn by projecting a projected image of the object to be drawn on the object to be drawn; a control unit for operating the handwriting and drawing support system; and a projection unit for projecting the projected image onto the object to be drawn. The control unit displays a plurality of type options from which the type of the object to be drawn can be selected as a type selection screen on a display unit of the mobile terminal, and displays one of a plurality of lower-level screens that differ for each type option on the display unit of the mobile terminal according to the type option selected by the user. The user operates the lower-level screen to determine the object to be drawn, converts the object to be drawn into projection data to be projected onto the object to be drawn and displays it on the display unit, and projects the projection data from the projection unit onto the object to be drawn based on the projection data.

[0008] A handwriting drawing assistance device that supports a user in drawing a handwritten drawing object by projecting a projection image of the handwriting drawing object onto the object to be drawn, includes a receiving unit that receives projection data of the handwriting drawing object, and a projection unit that projects the projection data onto the object to be drawn based on the projection data received by the receiving unit, wherein the receiving unit is operated by a control unit of a mobile terminal used by the user, and a display unit of the mobile terminal displays a type selection screen on which a plurality of type options from which the type of the handwriting drawing object can be selected, and one of a plurality of lower-level screens that differ for each type option is displayed on the display unit of the mobile terminal depending on the type option selected by the user, the handwriting drawing object is determined by operating the lower-level screen, the handwriting drawing object is converted into projection data to be projected onto the object to be drawn and displayed on the display unit, and the transmitted projection data is received.

[0009] A method for producing a handwritten drawing object in which a handwritten drawing target is handwritten and drawn includes the steps of: preparing a handwritten drawing support system that supports a user's action of handwriting drawing on an object to be drawn by projecting a projection image of the handwritten drawing target onto the object to be drawn; preparing the object to be drawn; receiving the projection data transmitted from the handwritten drawing support system; projecting the projection data onto the object to be drawn based on the projection data received in the receiving step; and handwriting drawing the handwritten drawing target on the object to be drawn; wherein in the receiving step, The system is operated by a control unit of a mobile terminal used by the user, and displays a type selection screen on a display unit of the mobile terminal from which a plurality of type options can be selected as the type of the handwriting drawing object, and displays one of a plurality of lower-level screens that differ for each type option on the display unit of the mobile terminal according to the type option selected by the user, and the handwriting drawing object is determined by the user operating the lower-level screen, and the handwriting drawing object is converted into projection data to be projected onto the handwriting drawing object and displayed on the display unit, and the transmitted projection data is received. [Effects of the Invention]

[0010] The present invention allows users to write and draw by simply operating a mobile terminal. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram showing a handwriting drawing support system WDS according to a first embodiment of the present invention. [Figure 2] This is a screen transition diagram of the handwriting and drawing support system WDS. [Figure 3] This is a screen transition diagram of the handwriting and drawing support system WDS. [Figure 4] This is a screen transition diagram of the handwriting and drawing support system WDS. [Figure 5] This is a screen transition diagram of the handwriting and drawing support system WDS. [Figure 6] This is a screen transition diagram of the handwriting and drawing support system WDS. [Figure 7] This is a screen transition diagram of the handwriting and drawing support system WDS. [Figure 8] This is a screen transition diagram of the handwriting and drawing support system WDS. [Figure 9] FIG. 1 is a block diagram showing the configuration of a first embodiment of a handwriting and drawing support system WDS. [Figure 10] FIG. 10 is a block diagram showing the configuration of a second embodiment of the handwriting and drawing support system WDS. [Figure 11] 1 is a flowchart of the writing and drawing support system WDS. [Figure 12] This is a diagram showing a student using the writing and drawing support device WDM. [Figure 13] This is a diagram showing tracing using the drawing assistance device WDM. [Figure 14] FIG. 10 is a screen transition diagram of another embodiment of the handwriting and drawing support system WDS. [Figure 15] FIG. 10 is a screen transition diagram of another embodiment of the handwriting and drawing support system WDS. [Figure 16] FIG. 10 is a screen transition diagram of another embodiment of the handwriting and drawing support system WDS. [Figure 17] 1 is a diagram showing a manufacturing flow of a method for manufacturing a written or drawn object according to the present invention. [Figure 18] 1 is an example of a written or drawn object produced by the method for producing a written or drawn object of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0012] The present invention relates to a control system for a mobile device that supports handwriting and drawing, allowing a user to write beautiful characters or draw beautiful pictures by simply tracing the projected image of the characters or pictures the user wants to write onto a workpiece. A user can write beautiful characters or draw beautiful pictures by hand by using the control system of the present invention to project selected characters or pictures onto the workpiece using a projection unit PJU of the mobile device MD, or by projecting the characters or pictures onto the workpiece using a projection unit D2 of a handwriting and drawing support device WMD separate from the mobile device. This allows the user to write or draw beautiful characters or draw beautiful pictures by simply operating the mobile device MD. Note that handwriting and drawing refers to an act that includes at least one of writing characters, sentences, etc., and drawing pictures, illustrations, etc.

[0013] Mobile devices (MDs) include smartphones, tablets, and wearable devices such as wearable watches and glasses. A written or drawn object is an object on which at least one of the following actions is performed: writing or drawing. Examples include flat objects such as paper, notebooks, New Year's cards, letters, colored paper, construction paper, drawing paper, fans, T-shirts, plates, coasters, and smartphone covers; three-dimensional objects such as bowls, bowls, cups, cookies, and cakes; and human figures such as arms, legs, faces, and bodies. A written or drawn object is an object on which characters or pictures are written or drawn by at least one of the following actions: writing or drawing. Users can freely choose the written or drawn object they want to write or draw. Users include the person who actually writes or draws, the person who assists the person who writes or draws, and the manufacturer or employee who produces the written or drawn object as a product. In addition, the control system of the mobile terminal is the handwriting and drawing support system WDS of the present invention, and includes smartphone apps, software, application software, etc.

[0014] The handwriting and drawing support system WDS in the first embodiment of the present invention is a smartphone app installed on a smartphone serving as a user's mobile terminal MD. FIG. 1 shows a main screen MG displayed on the mobile terminal MD by the handwriting and drawing support system WDS. The main screen MG displays multiple icon buttons IB1 to IB8 as type selection options, and the main screen MG is referred to herein as a type selection screen. On the main screen MG, the user can select a type of writing or drawing according to the user's purpose with simple operations. For example, icon button IB1 displays "Prescribed Writing," icon button IB2 displays "Freehand Writing," icon button IB3 displays "Illustration," icon button IB4 displays "Photo," icon button IB5 displays "Photography," and icon button IB6 displays "Search." The main screen MG may also display the name of the app NM, advertisements AD, etc.

[0015] 2(a) to 2(c) show screen transition diagrams of the mobile terminal MD when the "Predefined Writing Sentence" displayed on the icon button IB1 of the main screen MG is selected. When the icon button IB1 is selected on the main screen MG shown in FIG. 2(a), the screen transitions to FIG. 2(b), and the first lower-level screen LG1 is displayed. The first lower-level screen LG1 displays multiple icon buttons IB11 to IB16, allowing the user to select the handwriting drawing target to write. That is, the user can select the writing from the "Predefined Writing Sentence" according to the purpose. For example, the icon button IB11 displays "Happy New Year," the icon button IB12 displays "Good Morning," the icon button IB3 displays "Thanks," the icon button IB4 displays "Tomi Kotaro (user's name)," the icon button IB5 displays "Hope," and the icon button IB6 displays "Heart." Note that the icon buttons may be configured to allow other frequently used phrases to be set.

[0016] FIG. 2(c) shows the second lower-level screen LG2 when the icon button IB11 displaying "Happy New Year" is selected from among the multiple icon buttons IB11 to IB16. The second lower-level screen LG2 includes a projection screen PG1 and multiple operation icon buttons IB111 to IB114. The projection screen PG1 displays "Happy New Year," selected on the first lower-level screen LG1. For example, the text is displayed vertically in a digital textbook font for ease of writing. Furthermore, the projection screen PG1 displays the text in a black background and white. This allows the user to project the projection image PG1 onto the object to be written, making the projected text easier to see when writing. This is because reducing the amount of projection light PL projected onto the object to be written reduces the glare caused by the light reflected from the object to be written.

[0017] Furthermore, the operation icon button IB111 displays "Edit," which allows the user to change the direction, size, shape, font, etc. of the characters displayed on the projection screen PG1. For example, the user can change the characters "Happy New Year" from vertical to horizontal writing, change the font from digital textbook font to Gothic or Mincho, change the size of the characters, enlarge only the character "Happy New Year" in "Happy New Year," or change the characters to more stylish fonts.

[0018] The operation icon button IB112 displays "Save," and the edited character data can be saved by selecting the operation icon button IB111. For example, the data is saved in the memory U5 of the mobile terminal MD or in an external memory such as a microSD card that is detachable from the mobile terminal MD.

[0019] The operation icon button IB113 is labeled "Action," and animation can be applied to help users understand the stroke order of the characters displayed on the projection screen PG1. For example, a yellow spotlight can be displayed above the characters, and the yellow spotlight can move according to the stroke order of the characters, or the color of the characters can change according to the stroke order.

[0020] The operation icon button IB114 displays "Projection," and the projection data of the characters displayed on the projection screen PG1 is determined. Then, the projection data of the characters displayed on the projection screen PG1 is transmitted. The projection unit PJU of the portable terminal MD or the communication unit D1 of the handwriting support device WMD, which is separate from the portable terminal MD, receives the projection data. The projection unit PJU of the portable terminal MD or the projection unit D2 of the handwriting support device WMD projects the projection image onto the object to be drawn via the projection light PL. The user can then write beautiful characters by hand simply by tracing the projection image. Projection data refers to electronic data such as characters, images, videos, and animations, and includes data in formats such as TXT, JPEG, MPEG, Word, Excel, and PPT.

[0021] As described above, the present invention allows writing and drawing to be performed by simply operating the mobile terminal MD.

[0022] 3(a) to 3(c) show screen transition diagrams of the mobile terminal MD when "Freehand writing" displayed on icon button IB2 on the main screen MG is selected. When icon button IB2 is selected on the main screen MG shown in FIG. 3(a), the screen transitions to FIG. 3(b), and the first lower-level screen LG1 is displayed. The first lower-level screen LG1 is provided with a text input screen TX, a keyboard screen KB, and a confirm icon button IB21. The user can input sentences into the text input screen TX by operating the keyboard screen KB to select characters.

[0023] When the user finishes inputting the text and selects the confirmation icon button IB21, the screen transitions to FIG. 3(c), and the second lower-level screen LG2 is displayed. The second lower-level screen LG2 is provided with a projection screen PG2 and a plurality of operation icon buttons IB211-IB214. The projection screen PG2 displays the text that was input on the first lower-level screen LG1 and that the user will write by hand. For example, "I am Tomi Kotaro. Nice to meet you." is displayed horizontally in a digital textbook font to make it easier for the user to write.

[0024] Furthermore, the operation icon button IB211 displays "Edit," which allows the user to change the direction, size, shape, font, etc. of the text displayed on the projection screen PG2. For example, the user can change the text entered on the first lower-level screen LG1 from horizontal to vertical writing, change the font from digital textbook font to Gothic or Mincho, change the size of the text, enlarge only the text for "Tomi Kotaro" and "Please," or change the text to one with a more stylish design.

[0025] The operation icon button IB212 displays "Save," and the edited text data can be saved by selecting the operation icon button IB211. For example, the data is saved in the memory U5 of the mobile terminal MD or in an external memory such as a microSD card that is detachable from the mobile terminal MD.

[0026] The operation icon button IB213 is labeled "Action," and animation can be applied to help users understand the stroke order of the characters displayed on the projection screen PG2. For example, a yellow spotlight can be displayed above the characters, and the yellow spotlight can move according to the stroke order of the characters, or the color of the characters can change according to the stroke order.

[0027] The operation icon button IB214 displays "Projection," and the projection data of the text displayed on the projection screen PG2 is determined. Then, the projection data of the text displayed on the projection screen PG2 is transmitted. As a result, the projection unit PJU of the portable terminal MD or the communication unit D1 of the handwriting support device WMD, which is separate from the portable terminal MD, receives the projection data, and the projection unit PJU of the portable terminal MD or the projection unit D2 of the handwriting support device WMD projects the projection image onto the object to be drawn via the projection light PL, allowing the user to write beautiful text by hand simply by tracing the projection image.

[0028] As described above, the present invention allows writing and drawing to be performed by simply operating the mobile terminal MD.

[0029] 4(a) to 4(c) show screen transition diagrams of the mobile terminal MD when the "Illustration" displayed on the icon button IB3 on the main screen MG is selected. When the icon button IB3 is selected on the main screen MG shown in FIG. 4(a), the screen transitions to FIG. 4(b), and the first lower-level screen LG1 is displayed. The first lower-level screen LG1 displays a plurality of illustrated images IG1 to IG8, allowing the user to select a handwritten drawing object to draw. For example, the illustrated image IG1 displays an illustrated image of a flower, the illustrated image IG2 displays an illustrated image of a rabbit, the illustrated image IG3 displays an illustrated image of a fish, the illustrated image IG4 displays an illustrated image of an anime character, the illustrated image IG5 displays an illustrated image of a movie character, the illustrated image IG6 displays an illustrated image of a seasonal event, the illustrated image IG7 displays an illustrated image of a child, and the illustrated image IG8 displays an illustrated image of a building. It should be noted that the illustrated images may be configured to allow frequently used illustrated images to be set.

[0030] FIG. 4(c) shows the second lower-level screen LG2 when the illustrated image IG2 displaying a "rabbit" is selected from the plurality of illustrated images IG1 to IG8. The second lower-level screen LG2 is provided with a projection screen PG3 and a plurality of operation icon buttons IB311 to IB314. The projection screen PG3 displays the "rabbit" selected on the first lower-level screen LG1. For example, the "rabbit" is displayed in color to make it easier for the user to draw.

[0031] Furthermore, the operation icon button IB311 displays "Edit," allowing the user to change the direction, rotation, size, shape, pointillism, etc., of the illustration displayed on the projection screen PG3. FIG. 5 shows the third lower-level screen LG3 when "Edit" is selected on the operation icon button IB311 on the second lower-level screen LG2. As shown in FIG. 5(a), the third lower-level screen LG3 includes a projection screen PG3 and multiple operation icon buttons IB3a to IB3c. The operation icon button IB3a displays "Transform," allowing the user to change the direction, rotation, size, shape, etc., of the illustration displayed on the projection screen PG3. The operation icon button IB3b displays "Pointillism," allowing the user to pointillize the illustration displayed on the projection screen PG3. FIG. 5(b) shows the screen transitions that occur when the operation icon button IB3b labeled "Pointillism" is pressed. The projection screen LG3 on which the illustration is drawn is changed, and a pointillized image DT is displayed, in which the illustration is pointillized. Pointillism refers to image processing such as intermittently forming the outline of an illustration. The details of the "pointillism" function are specifically described in detail in Japanese Patent No. 7326641, so a detailed description will be omitted here. The handwriting and drawing support system WDS of the present invention can implement the technical content described in Japanese Patent No. 7326641. This allows users to draw beautiful illustrations.

[0032] The operation icon button IB3c displays "Back" and is configured to return to the second lower layer screen LG2 shown in FIG. 4(c).

[0033] The operation icon button IB312 on the second lower-level screen LG2 in FIG. 4(c) displays "Save," allowing the edited illustration data to be saved. For example, the data is saved in the memory U5 of the mobile terminal MD or in an external memory such as a microSD card that is detachable from the mobile terminal MD. Note that the configuration may also be such that the data can be saved when "Back" on the operation icon button IB3c on the third lower-level screen LG3 is selected.

[0034] The operation icon button IB313 is labeled "Action," and animation can be applied to show the stroke order of the illustration displayed on the projection screen PG3. For example, it is possible to display a part of the illustration that the user wants to draw, to display a yellow spotlight on the illustration and move the spotlight, or to change the color of the illustration according to the stroke order.

[0035] The operation icon button IB314 displays "Projection," and the projection data of the illustration displayed on the projection screen PG3 is determined. Then, the projection data of the illustration displayed on the projection screen PG3 is transmitted. As a result, the projection unit PJU of the portable terminal MD or the communication unit D1 of the handwriting drawing support device WMD, which is separate from the portable terminal MD, receives the projection data, and the projection unit PJU of the portable terminal MD or the projection unit D2 of the handwriting drawing support device WMD projects the projection image onto the drawing object via the projection light PL. This allows the user to draw a beautiful illustration by hand simply by tracing the projection image.

[0036] As described above, the present invention allows writing and drawing to be performed by simply operating the mobile terminal MD.

[0037] 6(a) to 6(c) show screen transition diagrams of the mobile terminal MD when "Photo" displayed on icon button IB4 of the main screen MG is selected. When icon button IB4 is selected on the main screen MG shown in FIG. 6(a), the screen transitions to FIG. 6(b), and the first lower-level screen LG1 is displayed. The first lower-level screen LG1 has photo icon buttons PB1 to PB8, each displaying a plurality of photos. For example, photo icon button PB1 displays a photo image of flowers, photo icon button PB2 displays a photo image of a classroom, photo icon button PB3 displays a photo image of a landscape, photo icon button PB4 displays a photo image of a person, photo icon button PB5 displays a photo image of a movie, photo icon button PB6 displays a photo image of a seasonal event, photo icon button PB7 displays a photo image of children, and photo icon button PB8 displays a photo image of a building. Selecting icon button IB4 of the main screen MG may be linked to an image folder on the mobile terminal MD, allowing the user to select a photo stored in that image folder.

[0038] FIG. 6(c) shows the second lower-level screen LG2 when the photo icon button PB2 displaying "Classroom" is selected from the multiple photo icon buttons PB1 to PB8. The second lower-level screen LG2 is provided with a projection screen PG4 and multiple operation icon buttons IB411 to IB414. The projection screen PG4 displays "Classroom," which is selected on the first lower-level screen LG1 and is the drawing target that the user will draw. For example, the projection screen PG3 is displayed in color to make it easier for the user to draw.

[0039] Furthermore, the operation icon button IB411 displays "Edit," which allows the user to change the direction, rotation, size, shape, pointillism, etc. of the photo displayed on the projection screen PG4. Furthermore, the operation icon button IB412 displays "Save," which allows the user to save the edited photo data.

[0040] The operation icon button IB413 is labeled "Action," and animations can be applied to show the stroke order of the photo displayed on the projection screen PG4. For example, it is possible to display a part of the photo that the user wants to write on, to display a yellow spotlight on the photo and move the spotlight, or to change the color of the photo according to the stroke order.

[0041] The operation icon button IB414 displays "Projection," and the projection data of the photo displayed on the projection screen PG4 is determined. Then, the projection data of the photo displayed on the projection screen PG4 is transmitted. The projection unit PJU of the portable terminal MD or the communication unit D1 of the handwriting drawing support device WMD, which is separate from the portable terminal MD, receives the projection data, and the projection unit PJU of the portable terminal MD or the projection unit D2 of the handwriting drawing support device WMD projects the projection image onto the object to be drawn via the projection light PL. The user can then draw a beautiful photo by hand simply by tracing the projection image. A "Pointillism" operation icon button may also be provided, allowing the user to turn the photo into a pointillism image.

[0042] As described above, the present invention allows writing and drawing to be performed by simply operating the mobile terminal MD.

[0043] 7(a) to 7(c) show screen transition diagrams of the portable terminal MD when "Photography" displayed on icon button IB5 on the main screen MG is selected. When icon button IB5 is selected on the main screen MG shown in FIG. 7(a), the screen transitions to FIG. 7(b), and the first lower-level screen LG1 is displayed. The first lower-level screen LG1 displays a photographed image TG captured using the camera function of the portable terminal MD. For example, the photographed image TG displays a school gate. The first lower-level screen LG1 also has a photograph button TB, and the user can press the photograph button TB to capture an image captured using the camera. This allows the photographed image TG to be captured.

[0044] 7(c) shows the second lower-level screen LG2 when the capture button TB is pressed to capture an image. The second lower-level screen LG2 includes a projected image PG5 and a plurality of operation icon buttons IB511 to IB514. The projected image PG5 displays the captured image TG as a handwriting drawing target for the user. For example, the projected image PG5 is displayed in color to make it easier for the user to draw.

[0045] Furthermore, the operation icon button IB511 displays "Edit," allowing the user to change the direction, rotation, size, shape, pointillism, etc., of the captured image TG displayed on the projection screen PG5. The operation icon button IB512 displays "Save," allowing the user to save the edited captured image TG data. The operation icon button IB513 displays "Action," allowing the user to apply animation to the captured image TG displayed on the projection screen PG5 so that the user can understand the stroke order. For example, the operation icon button IB513 can display a portion of the captured image TG that the user wants to write, display a yellow spotlight on the captured image TG and move the spotlight, or change the color of the captured image TG according to the stroke order. The operation icon button IB514 displays "Project," allowing the projection data of the captured image TG displayed on the projection screen PG5 to be determined. The projection data of the captured image TG displayed on the projection screen PG5 is then transmitted. As a result, the projection unit PJU of the portable terminal MD or the communication unit D1 of the handwriting drawing support device WMD separate from the portable terminal MD receives the projection data, and the projection unit PJU of the portable terminal MD or the projection unit D2 of the handwriting drawing support device WMD projects the projection image onto the object to be drawn via the projection light PL, allowing the user to draw a beautiful captured image TG by hand simply by tracing the projection image. Note that a "pointillism" operation icon button may be provided so that the captured image TG can be pointillism-drawn.

[0046] As described above, the present invention allows writing and drawing to be performed by simply operating the mobile terminal MD.

[0047] 8(a) to 8(c) show screen transition diagrams of the mobile terminal MD when "Search" displayed on the icon button IB6 on the main screen MG is selected. When the icon button IB6 is selected on the main screen MG shown in FIG. 1, the screen transitions to FIG. 8(a), and the search hierarchy screen LGS is displayed. The search hierarchy screen LGS is provided with a search bar SW and a search execution button SB. The search bar SW allows the user to input words, URLs, etc. to be searched for. The search execution button SB is a button that executes a search for the words, URLs, etc. input into the search bar SW. The search execution button SB may be substituted with the enter button on the keyboard used to input words, URLs, etc. By selecting the search execution button SB, the screen transitions to the first lower-level screen LG1 shown in FIG. 8(b).

[0048] The first lower-level screen LG1 displays a search bar SW and multiple search images SG1-SG4. The search bar SW is located at the top of the first lower-level screen LG2 and remains displayed even when the screen is scrolled, allowing for immediate search execution when changing the search word or URL. The multiple search images SG1-SG4 are images such as photographs and illustrations extracted as search results when a search is performed. For example, when searching for "Tateyama mountain range," search image SG1 displays "Tateyama mountain range in summer," search image SG2 displays "Scenery from Toyama city," search image SG3 displays "Tateyama mountain range in winter," and search image SG4 displays "Tateyama mountain range as seen from the coast." In addition, explanatory text ET1-ET3 for explaining each search image is displayed below the multiple search images SG1-SG4. Note that the multiple search images SG1-SG4 may display characters or sentences extracted as search results.

[0049] 8(c) shows the second lower-level screen LG2 when the search image SG2 is selected on the first lower-level screen LG2. The second lower-level screen LG2 includes a projection image PG6 and a plurality of operation icon buttons IB611 to IB614. The projection image PG6 displays the search image SG2 as a handwritten drawing target for the user. For example, the projection image PG6 is displayed in color to make it easier for the user to draw. The operation icon button IB611 displays "Edit," which allows the user to change the direction, rotation, size, shape, pointillism, etc. of the search image SG displayed on the projection screen PG5.

[0050] Additionally, the operation icon button IB612 displays "Save," allowing the user to save the edited data of the search image SG. The operation icon button IB613 displays "Action," allowing the user to apply animation to the search image SG2 displayed on the projection screen PG6 to clarify the stroke order. The operation icon button IB614 displays "Projection," allowing the projection data of the search image SG displayed on the projection screen PG6 to be determined. The projection data of the search image SG displayed on the projection screen PG6 is then transmitted. The projection unit PJU of the portable terminal MD or the communication unit D1 of the handwriting support device WMD, which is separate from the portable terminal MD, receives the projection data, and the projection image is projected onto the drawing object via the projection light PL from the projection unit PJU of the portable terminal MD or the projection unit D2 of the handwriting support device WMD. The user can then draw a beautiful search image by handwriting simply by tracing the projection image. A "Pointillism" operation icon button may also be provided to allow the search image SG to be pointillized.

[0051] As described above, the present invention allows writing and drawing to be performed by simply operating the mobile terminal MD.

[0052] In another embodiment, the main screen MG may be provided with a "History" icon button, allowing previously used characters or pictures to be quickly selected. The main screen MG may also be provided with a "Practice" icon button, allowing characters or pictures to be selected before writing or drawing, as preparation for writing or drawing, or as a warm-up for the hands or brain. The main screen MG may also be provided with a "Game" icon button, allowing games to be played while writing or drawing. Icon buttons with various other functions and features may also be provided and configured to be operable.

[0053] The names given to the various icon buttons are not limited to the names mentioned above, and various names and symbols may be used as long as the user can distinguish and select them. The handwriting drawing support system WDS only needs to have at least one of the icon buttons IB1 to IB8 displayed on the main screen MG, and the names, configurations, arrangements, types, number of items, etc. may be freely set by selecting them according to the user's purpose and the manufacturer's strategy.

[0054] Next, the configuration of the handwriting and drawing support system WDS in a first embodiment of the present invention will be described. Figure 9 shows a block diagram illustrating the configuration of the handwriting and drawing support system WDS. The smartphone serving as the mobile terminal MD includes a control unit U1 that controls computer operations and processing, a camera U2 that captures images of the surrounding scenery, a display unit U3 that displays text and images on a display screen, an input unit U4 such as a touch panel for inputting text, a memory U5 that can store and accumulate data, and a projection unit (projector unit) PJU that receives projection data transmitted from the control unit U1, emits projection light PL, and projects the projection data onto the object being drawn. In this embodiment, the projection unit PJU is built into or integrally connected to the mobile terminal MD, enabling it to receive projection data without using wireless communication or communication means using a communication cord. An app APP that includes the handwriting and drawing support system WDS is installed on the mobile terminal MD, and data can be exchanged between the camera U2, display unit U3, input unit U4, memory U5, projection unit PJU, and the like under data control by the control unit U1.

[0055] The control unit U1 is an operating system (OS) that can execute basic operations and processes of the mobile terminal MD, and is operated by a central processing unit called a CPU. The control unit U1 can activate the camera U2 to capture external images such as people and landscapes, control the images and videos displayed on the display unit U3, recognize and process characters and pictures input through the input unit U4, and save and retrieve data to and from the memory U5. The control unit U1 can also handle control signals for sending and receiving data such as images and videos to and from the projection unit PJU.

[0056] The camera U2 is an imaging device that can capture external images of people, landscapes, etc. and acquire them as data. For example, it is an imaging element such as a CCD or CMOS.

[0057] The display unit U3 is a display that displays characters and pictures. By looking at the characters and pictures displayed on the display unit U3, the user can recognize the state of the characters and pictures they are about to trace. For example, a liquid crystal display (LCD) or an organic light-emitting diode (OLED) display may be used. The display unit U3 displays a main screen MG, a first lower-level screen LG1, a second lower-level screen LG2, a third lower-level screen LG3, a search level screen LGS, and the like, and can operate various icon buttons IB, photo icon buttons PB1-PB8, illustration images IG1-IG8, captured images TG, a capture button TB, projection screens PG1-PG9, a text screen TX, a keyboard screen KB, search screens SG1-SG4, a search button SB, a search bar SW, a time attack screen TA, and the like.

[0058] The input unit U4 is a touch panel that can be used to input characters and select items by pressing icon buttons. A touch panel display is used that also serves as the display for the display unit U3. For example, by operating the keyboard screen KB, characters can be input to the text screen TX or search bar SW, and various icon buttons IB and illustration images IG can be pressed to make selections.

[0059] The memory U5 is a device capable of storing data, such as a flash memory provided inside the mobile terminal MD or an external memory such as a microSD card that is detachable from the mobile terminal MD.

[0060] The projection unit PJU is a projector that receives data such as projection data transmitted from the control unit U1, emits projection light PL, and projects the projection data onto an object to be drawn. The projector unit PJU projects the projection data displayed on the projection screens PG1 to PG6 selected by the handwriting and drawing support system WDS in the first embodiment of the present invention onto an object to be drawn, and the user can write beautiful letters or draw beautiful pictures by tracing the projected image.

[0061] As described above, the present invention allows writing and drawing to be performed by simply operating the mobile terminal MD.

[0062] Next, a description will be given of the configuration of the handwriting drawing support system WDS according to the second embodiment of the present invention, with the description of the same configuration as in the above-mentioned embodiment being omitted.

[0063] Figure 10 shows a block diagram of the handwriting and drawing support system WDS. The smartphone serving as the mobile terminal MD includes a control unit U1 that controls computer operations and processing, a camera U2 that allows the user to capture images of the surrounding scenery, a display unit U3 that displays text and images on a display, an input unit U4 such as a touch panel for entering text, a memory U5 that can store and accumulate data, and a communication unit U6 that can exchange data with external devices. The mobile terminal MD has an app APP that includes the handwriting and drawing support system WDS installed, and data can be exchanged between the camera U2, display unit U3, input unit U4, memory U5, communication unit U6, and other units through data control by the control unit U1.

[0064] The communication unit U6 is a device that can exchange data with the Internet or an external terminal via wireless communication WC. For example, data is sent and received using wireless communication standards such as Wi-Fi or Bluetooth. However, data may also be exchanged using wired communication.

[0065] The handwriting and drawing support device WDM also includes a receiving unit D1 that receives data from the outside and a projection unit D2 that projects the data from the outside via projection light PL. The handwriting and drawing support device WDM is a device configured to form a projected image at hand using a projector board, and projects projection data displayed on projection screens PG1 to PG6 selected by the handwriting and drawing support system WDS in the first embodiment of the present invention onto an object to be drawn, allowing the user to write beautiful letters or draw beautiful pictures by tracing the projected image. The portable terminal MD and the handwriting and drawing support device WDM may be collectively referred to as a handwriting and drawing support kit.

[0066] As described above, the present invention allows writing and drawing to be performed by simply operating the mobile terminal MD.

[0067] An example of a flowchart of the handwriting and drawing support system WDS in the first embodiment of the present invention is shown in Fig. 11. In the start process ST, an application having the handwriting and drawing support system WDS is started on the mobile terminal MD.

[0068] In the first process P1, a main screen MG, which is the top page of the application, is displayed on the display unit U3 of the mobile terminal MD. The main screen MG displays multiple icon buttons IB1 to IB8, allowing the user to select writing, drawing, etc. with a simple operation according to their purpose.

[0069] In the second process P2, as shown in (a) of FIGS. 2 to 8, a plurality of icon buttons IB1 to IB8 are displayed on the main screen MG. This allows the user to select one of the plurality of icon buttons IB1 to IB8. For example, selecting the icon button IB1 labeled "Prescribed Written Sentence" transitions to the first selection process C1, selecting the icon button IB2 labeled "Freehand Written Sentence" transitions to the second selection process C2, selecting the icon button IB3 labeled "Illustration" transitions to the third selection process C3, selecting the icon button IB4 labeled "Photo" transitions to the fourth selection process C4, selecting the icon button IB5 labeled "Photograph" transitions to the fifth selection process C5, and selecting the icon button IB6 labeled "Search" transitions to the sixth selection process C6. In other words, if the number of options is N, one of up to the Nth selection process CN can be selected.

[0070] In the first selection process C1, as shown in FIG. 2(b), a plurality of icon buttons IB11 to IB16 are displayed as a first lower-level screen LG1. The user can select one of the plurality of icon buttons IB11 to IB16 from the "Prescribed Writing Sentences" to select a handwritten drawing object as a character or sentence to be written. For example, the user can select the character or sentence to be traced from options such as "Happy New Year," "Good Morning," "Thank You," "Tomo Kotaro," "Hope," and "Heart." In addition, a plurality of operation icon buttons IB111 to IB114 are displayed as a second lower-level screen LG2, allowing the user to edit the handwritten drawing object, save the edited handwritten drawing object, and operate the handwritten drawing object.

[0071] In the second selection process C2, as shown in FIG. 3(b), a text input screen TX, a keyboard screen KB, and a confirmation icon button IB21 are displayed as a first lower-level screen LG1. The user can input text into the text input screen TX by operating the keyboard screen KB to select characters. For example, the user can input "I'm Tomi Kotaro. Nice to meet you." to set the characters or text he or she wants to trace. In addition, a plurality of operation icon buttons IB211 to IB214 are provided as a second lower-level screen LG2, allowing the user to edit the handwritten drawing object, save the edited handwritten drawing object, and operate the handwritten drawing object.

[0072] In the third selection process C3, as shown in FIG. 4(b), a plurality of illustration images IG1-IG8 are displayed as the first lower-level screen LG1. The user can select one of the plurality of illustration images IG1-IG8 from the "Illustration" category to select the handwritten drawing object as the illustration to be drawn. For example, the user can select the illustration they want to trace from options such as "Flowers," "Rabbits," "Fish," "Anime Characters," "Movie Characters," "Seasonal Events," "Illustrated Images of Children," and "Illustrated Images of Buildings." In addition, a plurality of operation icon buttons IB311-IB314 are provided as the second lower-level screen LG2, which can be used to edit the handwritten drawing object, save the edited handwritten drawing object, operate the handwritten drawing object, and pointillize the handwritten drawing object.

[0073] In the fourth selection process C4, as shown in FIG. 6(b), a plurality of photo icon buttons PB1-PB8 are displayed as the first lower-level screen LG1. The user can select one of the plurality of photo icon buttons PB1-PB8 from "Photo" to select a handwritten drawing object as a photo to be drawn. For example, the user can select a photo to trace from options such as "Flowers," "Classroom," "Landscape," "People," "Photos of Movies," "Photos of Seasonal Events," "Photos of Children," and "Photos of Buildings." In addition, a plurality of operation icon buttons IB411-IB414 are provided as the second lower-level screen LG2, which can be used to edit the handwritten drawing object, save the edited handwritten drawing object, operate the handwritten drawing object, and pointillize the handwritten drawing object.

[0074] In the fifth selection process C5, as shown in FIG. 7(b), a captured image TG is displayed as the first lower-level screen LG1. The user can capture an external image using the camera U2 to acquire a handwritten drawing object as the captured image TG to be drawn. For example, the user can capture an image of a "school gate" using the camera U2 to acquire the captured image TG. The user can then set the image as the image to be traced. In addition, the second lower-level screen LG2 is provided with a plurality of operation icon buttons IB511 to IB514, which can be used to edit the handwritten drawing object, save the edited handwritten drawing object, operate the handwritten drawing object, and pointillize the handwritten drawing object.

[0075] In the sixth selection process C6, as shown in FIG. 8(b), a search bar SW and multiple search images SG1-SG4 are displayed as the first lower-level screen LG1. The user can select one of the multiple search images SG1-SG4 displayed by executing a "search" to select a handwritten drawing object as the search image SG to be drawn. For example, by searching for "Tateyama Mountain Range," the user can select "View from Toyama City" from the search results displayed: "Tateyama Mountain Range in Summer," "View from Toyama City," "Tateyama Mountain Range in Winter," and "Tateyama Mountain Range as Seen from the Coast." The user can then select the search image SG to trace. The second lower-level screen LG2 is provided with multiple operation icon buttons IB611-IB614, which allow the user to edit the handwritten drawing object, save the edited handwritten drawing object, operate the handwritten drawing object, and pointillize the handwritten drawing object.

[0076] Similarly, in the Nth selection process CN, options are provided according to the user's purpose, and the program can be configured to satisfy the user's purpose, allowing the user to set what they want to trace. For example, a "History" icon button is provided, which is configured to allow the user to quickly select characters or pictures that they have used in the past. Also, a "Practice" icon button is provided, which is configured to allow the user to select characters or pictures as preparation for writing or drawing, or as a warm-up for their hands or brain, before writing or drawing. Also, a "Game" icon button is provided, which is configured to allow the user to play games while writing or drawing. Other icon buttons with various functions and features may be provided and configured to be operable. Then, operations such as editing, saving, operating, and pointillizing the handwriting or drawing object are performed.

[0077] In the third process P3, the projection data of the handwriting object that has undergone any one of the first selection process C1 to Nth selection process CN is displayed as a projection image PG of the second lower layer screen LG2 on the display unit U3 of the portable terminal MD.

[0078] In the fourth process P4, the projection image PG displayed in the third process P3 is determined as projection data. The projection data is determined by selecting the "Projection" operation icon button. This determines the projection data of the handwriting drawing target selected in the first selection process to the Nth selection process CN.

[0079] In the fifth process P5, the projection data determined in the fourth process P4 is transmitted. As a result, the projection unit PJU of the portable terminal MD or the communication unit D1 of the handwriting drawing support device WMD separate from the portable terminal MD receives the projection data, and the projection unit PJU of the portable terminal MD or the projection unit D2 of the handwriting drawing support device WMD can project a projection image of the projection data onto the object to be drawn via projection light PL.

[0080] In the termination process ED, the application having the handwriting drawing support system WDS is terminated on the mobile terminal MD.

[0081] As a result, the handwriting and drawing support device WDM can be easily operated and used with a smartphone.

[0082] The lower-level screens include a first lower-level screen LG1, a second lower-level screen LG2, a third lower-level screen LG3, and a search level screen SG. The handwriting drawing object includes a fixed-level sentence, a free-level sentence, an illustration, a photograph, a captured image, a searched image, etc., and also includes a video and an animation. The basic image data is electronic data of an image to be handwritten, including a fixed-level sentence, a free-level sentence, an illustration, a photograph, a captured image, a searched image, a video, an animation, etc.

[0083] Figure 12 shows an example of a student writing using the WDM writing and drawing support device. The WDM writing and drawing support device is a compact and stylish device that can be installed on a school desk. Figure 13 shows a student tracing an image projected by the WDM writing and drawing support device. Model characters are projected onto a notebook as a projected image by the WDM writing and drawing support device, so the student can write beautiful characters simply by tracing the projected image. Similarly, if the WDM writing and drawing support device projects a model picture onto a notebook as a projected image, the student can draw a beautiful picture simply by tracing the projected image.

[0084] Today's high school students are part of the generation (known as Generation Z) that was born into a world where the Internet has become widespread. They have few opportunities to write or draw by hand, and many of them are not good at writing or drawing neatly. However, in society at large, there are times when they are required to write or draw by hand. Therefore, by using the handwriting and drawing support system (WDS) of the present invention, anyone can easily practice writing or tracing characters freely, anytime, anywhere.

[0085] By using the WDS writing and drawing support system of the present invention to write or draw, characters can be projected onto unusually shaped items such as gift envelopes and condolence envelopes, allowing for neat writing. It also allows for careful writing down to the finer details when tracing four-character idioms or English words onto a notebook to memorize them, or when writing down the differences between world maps or Jomon and Yayoi pottery to organize learning content. Furthermore, characters can be projected onto calligraphy paper, making it ideal for calligraphy practice. In this way, the WDS writing and drawing support system of the present invention can be used to project and write desired characters and pictures onto a variety of papers and objects, tailored to a variety of users and purposes.

[0086] Furthermore, since it supports the writing action of elderly people and people with disabilities while activating brain function through the act of writing, it can be used for brain training, medical treatment, and rehabilitation. The act of writing letters and pictures is one of the essential human actions, and is closely linked to brain cells and brain function, making it effective for the development and recovery of hand and brain function. In addition, being able to write beautiful characters improves the user's self-esteem. Furthermore, seeing beautiful handwritten characters makes the reader feel good, which gives them a sense of happiness.

[0087] By using the handwriting and drawing assistance device WDM that utilizes the handwriting and drawing assistance system WDS of the present invention, users can write postcards in beautiful, human-like handwriting and draw beautiful illustrations, photographs, and other pictures on drawing paper. This can be useful in businesses such as inbound tourism and well-being. Furthermore, even people with attention disorders or hand disabilities can write beautiful handwriting or draw beautiful pictures simply by tracing the projected image, and the act of writing can stimulate brain activity. This can be useful in fields such as rehabilitation, welfare, and medicine.

[0088] Next, another embodiment of the handwriting and drawing support system WDS of the present invention will be described.

[0089] FIG. 14 shows an example of an application APP configured to enable the user to create a paper craft using the handwriting drawing support system WDS of the present invention. The main screen MG of FIG. 1 includes a paper craft icon button. Selecting this button transitions to the first lower-level screen LG1 of FIG. 14(a). The first lower-level screen LG1 displays multiple icon buttons IB71 to IB75. That is, the user can select a paper craft from the "Paper Craft" menu according to their intended purpose. For example, icon button IB71 displays "Plant," icon button IB72 displays "Cube," icon button IB73 displays "Robot," icon button IB74 displays "Airplane," and icon button IB75 displays "Sky Tree." The icon buttons may be configured to allow the user to set other frequently used paper crafts or to search for and download them from the Internet.

[0090] FIG. 14(b) shows the second lower-level screen LG2 when the icon button IB72 labeled "cube" is selected on the first lower-level screen LG1. The second lower-level screen LG2 has a projection screen PG7 on which a development diagram of a "cube" is displayed. That is, by selecting the development diagram of an object or figure to be created as a paper craft on the first lower-level screen LG1, the user can draw it on paper or cloth, and then assemble it to create the object or figure. Various shapes of objects can be created, including stuffed toys, toys, ornaments, bags, clothing, plastic models, figurines, monuments, simple cubicles, and houses.

[0091] As a result, the handwriting drawing support device WDM can be easily operated on a mobile terminal to create a development drawing of a paper craft.

[0092] FIG. 15 shows an example of an application APP configured to enable a time attack using the handwriting and drawing assistance system WDS of the present invention. The main screen MG of FIG. 1 includes a time attack icon button. Selecting this icon button transitions to the first lower-level screen LG1 of FIG. 15(a). The first lower-level screen LG1 displays multiple icon buttons IB81 to IB85. That is, the user can practice writing characters quickly or compete in a picture drawing contest using the "Time Attack" feature. For example, icon button IB81 displays "Once in a Lifetime" ("Ichigo Ichie"), icon button IB82 displays "Gashinsen Shodan" ("Gasenshodan"), icon button IB83 displays "Panda", icon button IB84 displays "Shinkansen" ("Bullet Train"), and icon button IB75 displays "Rain and Rain, Rain and Rain." The icon buttons may be configured to allow other frequently used characters or pictures for time attacks to be set, or to allow downloads via Internet search.

[0093] FIG. 15(b) shows the second lower-level screen LG2 when the icon button IB82 displaying "Gashinshodan" (``Gashinshodan'') is selected on the first lower-level screen LG1. The second lower-level screen LG2 has, as projection screens PG8, a time attack screen TA displaying the time for the time attack and a writing screen WG displaying the characters "Gashinshodan'' (``Gashinshodan'') that the user traces. The time for the time attack is automatically counted down as soon as the projection of the selected characters begins, and the user is notified by sound or video when the time attack time has elapsed. In other words, by selecting the characters or pictures that the user wants to use for the time attack on the first lower-level screen LG1, the user can enjoy using the handwriting and drawing support system WDS of the present invention to quickly write or draw.

[0094] As described above, the handwriting and drawing support device WDM can be easily operated on a mobile terminal, and the handwriting and drawing support system WDS of the present invention can be enjoyed in a time attack mode.

[0095] FIG. 16 shows an example of an application APP configured to allow users to study or learn using the writing and drawing support system WDS of the present invention. When a question set is selected on the main screen MG of FIG. 1, the screen transitions to the first lower-level screen LG1 of FIG. 16(a). The first lower-level screen LG1 displays multiple icon buttons IB91 to IB95. That is, the user can select questions from the "question set" according to their intended purpose. For example, icon button IB91 displays "Class 1 Electrician Examination," icon button IB92 displays "Class 2 Electrician Examination," icon button IB93 displays "Class 3 Chief Electrical Engineer Examination," icon button IB94 displays "Hazardous Materials Handler Examination," and icon button IB95 displays "Electrical Construction Manager Examination." The icon buttons may also be configured to allow frequently used exam questions or past exam questions to be set, or to allow questions to be searched and downloaded from the Internet.

[0096] FIG. 16(b) shows the second lower-level screen LG2 when the icon button IB92 labeled "Second-Class Electrician Examination" is selected on the first lower-level screen LG1. The second lower-level screen LG2 has a projection screen PG9 displaying questions for the "Second-Class Electrician Examination." In other words, by selecting exam questions or past exam questions to use as a question bank on the first lower-level screen LG1, the user can use them to study for exams or learn. This allows users to memorize by handwriting, thereby improving the retention of learning. For example, the system can be used for practicing characters for kindergarteners, practicing kanji and illustrations for elementary and junior high school students, studying for qualifications or social studies for working adults, and document preparation for companies.

[0097] As a result, the handwriting and drawing support device WDM can be easily operated on a mobile terminal and can be used for studying and learning.

[0098] Next, a method for producing a handwritten or drawn object using the handwriting and drawing support system WDS of the present invention will be described. Note that a description of the same configuration as in the above-described embodiment will be omitted. The method for producing a handwritten or drawn object of the present invention is a method for producing a handwritten or drawn object on which characters or pictures are drawn by projecting a projected image of a handwritten or drawn object onto a workpiece and allowing the user to simply trace the projected image. The user is the person who actually writes or draws the handwritten or drawn object on the workpiece, such as an employee of a manufacturing company or a customer who wants to produce a handwritten or drawn object on which the handwritten or drawn object is formed. The manufacturer is a businessman or company that conducts business by writing or drawing the handwritten or drawn object on the workpiece.

[0099] A manufacturing flow of the handwritten drawing manufacturing method is shown in Fig. 17. First, as shown in Fig. 17, the flow for manufacturing the drawing starts in a start step ST2.

[0100] In the first step P21, characters to be written or pictures to be drawn on the drawing object are prepared. In the first step P21, a user or manufacturer selects and prepares characters to be written or pictures to be drawn on the drawing object using the writing and drawing support system WDS of the present invention. Examples of characters to be written or pictures to be drawn on the drawing object include the characters "Gashinshodan" (Gashinshodan), the characters of one's own name "Tomi Kotaro," an illustration of a "rabbit," or a photograph of a "classroom" or the "Tateyama mountain range." Customers or consumers can also freely select characters, mascots, logos, family crests, traditional patterns, portraits, cartoons, landscapes, commemorative photographs, and more, depending on their needs and purpose.

[0101] In the second step P22, a target object on which characters or pictures will be written or drawn is prepared. In the second step P22, the user or manufacturer places the target object at a position where the projection light PL containing the projection data will be irradiated. For example, the target object may be ceramics such as cups, glasses, coasters, and plates, Japanese paper, towels, badges, or traditional crafts. The target object may be prepared by the manufacturer or by the customer who purchases the target object.

[0102] In the third step P23, projection data of the handwriting / drawing target to be projected onto the object to be handwritten / drawn is received. The user or the manufacturer receives the projection data selected and transmitted using the handwriting / drawing support system WDS of the present invention.

[0103] In the third step P23, the user or manufacturer operates the mobile device used by the user to select from "prescribed writing," "freehand writing," "illustration," "photo," and other options for the type of handwritten drawing object displayed on the mobile device's display. The user or manufacturer then operates a lower-level screen displayed according to the selected option, thereby determining the type of handwritten drawing object. Furthermore, the handwritten drawing object is converted into projection data for projecting onto the object to be drawn, and displayed on the display. The projection data is then transmitted by the user or manufacturer, and received by the manufacturer.

[0104] In a fourth step P24, the projection data is projected onto the drawing target based on the projection data received in the third step P23. A user or a user such as a manufacturer may check the projection image projected onto the drawing target and adjust the projection data by operating the mobile terminal. For example, the focus, size, light intensity, color, etc. of the projection data may be adjusted.

[0105] In the fifth step P25, the user traces the projection data while viewing the projection image projected onto the object to be drawn, thereby writing the handwriting projection target on the object to be drawn. To enable the user to neatly trace the projection data, the manufacturer or the like may give the user advice on how to trace the projection data while viewing the user's tracing. Because the projection data is projected onto the object to be drawn, the user can neatly write the handwriting projection target.

[0106] In the sixth step P26, the user or manufacturer colors the object to be drawn. In the sixth step P26, a projection image of the projection data is projected onto the object to be drawn as needed. By forming the projection image on the object to be drawn, the user or manufacturer can check the color of the interior of the picture and color the object to be drawn. Note that the user or manufacturer may color the object to be drawn without projecting the projection data onto the object to be drawn. Also, in cases where there is no chromatic color inside the object to be drawn or where coloring is to be done in a different location, the sixth step P26 may be omitted.

[0107] In the end step ED2, the flow in which the user or manufacturer writes or draws the handwriting drawing object on the drawing object is ended. This allows the user or manufacturer to obtain the handwriting drawing object that they want to produce. Note that the order of the flow may be changed as appropriate depending on the requests of the user or manufacturer and the design of the program.

[0108] As described above, the present invention allows users to write and draw by simply operating the mobile terminal MD. Even people with experience as tourists or inexperienced craftsmen can neatly create a writing and drawing object on a writing and drawing object.

[0109] FIG. 18 shows an example of a handwritten drawing produced using the handwritten drawing production method of the present invention. The handwritten drawing is shown when a "rabbit" is selected as the handwritten drawing target. For example, FIG. 18(a) shows a "mug" with a rabbit picture, FIG. 18(b) shows a "coaster" with a rabbit picture, FIG. 18(c) shows a "postcard" with a rabbit picture, FIG. 18(d) shows a "smartphone case" with a rabbit picture, FIG. 18(e) shows a "T-shirt" with a rabbit picture, and FIG. 18(f) shows a "cake" with a rabbit picture. For example, the handwritten drawing production method of the present invention can be used by individuals or tourists as users, or by tourism operators to offer painting experiences to create original souvenirs as mementos of their trips.

[0110] The method for producing a handwritten drawing of the present invention can also be used to produce traditional crafts as handwritten drawings. For example, the method for producing a handwritten drawing of the present invention can be implemented by users such as painters or workers to apply traditional patterns or marks, and can be used to produce traditional crafts as the result of the implementation. Note that only a part of the flow of the method for producing a handwritten drawing of the present invention may be implemented.

[0111] The handwriting and drawing support system WDS, the portable terminal MD equipped with the handwriting and drawing support system, the handwriting and drawing support device WDM, and the handwriting and drawing object production method of the present invention may be used by users of various ages, including infants, elementary school students, junior high school students, high school students, adults, and the elderly. For example, they can be used as educational handwriting and drawing support for infants and elementary school students to practice writing and drawing, rehabilitation handwriting and drawing support for adults and the elderly to use for brain training and functional recovery, painting handwriting and drawing support for tourists to write and draw letters and pictures for souvenirs and gifts, and well-being handwriting and drawing support for drawing letters and pictures on parts of the body as makeup or tattoos. This allows users to easily operate the portable terminal MD to write and draw. The handwriting and drawing support system WDS of the present invention may also be installed in medical equipment. It can also be used to project treatment marks onto a patient's body as projection data for doctors to use in surgery and diagnosis. This supports doctors' medical procedures and allows them to perform careful treatment.

[0112] The handwriting and drawing support system WDS, the portable terminal MD equipped with the handwriting and drawing support system, the handwriting and drawing support device WDM, and the handwriting and drawing object manufacturing method of the present invention can be used to project light onto a blackboard to write on it, or onto a wall to draw pictures.In addition, the portable terminal MD can be easily operated to write or draw pictures or write letters by projecting light onto various papers or objects, so the applications and future potential are immeasurable.

[0113] Although the embodiments of the present invention have been described above, the technical scope of the present invention is not limited to the scope described in the above-mentioned embodiments. It will be apparent to those skilled in the art that various improvements and modifications can be made to each embodiment depending on the product, location, environment, type, and subject of implementation. It is clear from the claims that embodiments incorporating these changes or modifications are also included within the technical scope of the present invention. [Explanation of symbols]

[0114] WDS handwriting drawing support system, WDM handwriting drawing support device, MD mobile terminal MG main screen, TG captured image, TB capture button LG1: First lower-level screen, LG2: Second lower-level screen LG3 Third lower level screen NM App name, AD Advertisement, SW Search bar, SB Search button LGS search hierarchy screen, SG1, SG2, SG3, SG4 search screen DT stippled image, KB keyboard screen, TX text screen TA Time Attack Screen, ET1, ET2, ET3 Description IB1, IB2, IB3, IB4, IB5, IB6, IB7, IB8, IB11, IB12, IB13, IB14, IB15, IB16, IB21, IB71, IB72, IB73, IB74, IB75, IB81, IB82, IB83, IB84, IB85, IB91, IB92, IB93, IB94, IB95, IB111, IB112, IB113, IB114, IB211, IB212, IB213, IB214, IB311, IB312, IB313, IB314, IB3a, IB3b, IB3c, IB411, IB412, IB413, IB414, IB511, IB512, IB513, IB514, IB611, IB612, IB613, IB614 Icon buttons PG1, PG2, PG3, PG4, PG5, PG6, PG7, PG8, PG9 Projection screen PB1, PB2, PB3, PB4, PB5, PB6, PB7, PB8 Photo icon buttons IG1, IG2, IG3, IG4, IG5, IG6, IG7, IG8 illustration images APP app, U1 control unit, U2 camera, U3 display unit, U4 input unit U5 Memory, U6 Communication Unit, PJU Projection Unit (Projector Unit), PL Projection Light D1 receiving unit, D2 projection unit, WC wireless communication ST start processing, P1, P2, P3, P4, P5 processing C1, C2, C3, C4, CN process, ED termination processing ST2 start process, P21, P22, P23, P24, P25 process ED2 End Process

Claims

1. A handwriting and drawing support system that supports a user's handwriting and drawing action on an object to be drawn by projecting a projection image of a handwriting and drawing target onto the object to be drawn, Operated by a control unit of a mobile terminal used by the user, displaying a plurality of type options, from which the type of the handwriting drawing object can be selected, as a type selection screen on a display unit of the mobile terminal; displaying, on a display unit of the mobile device, one screen from a plurality of lower-level screens that differ for each of the category options selected by the user; The user operates the lower layer screen to determine the handwriting drawing target, A handwriting and drawing support system, characterized in that the handwriting and drawing object is converted into projection data to be projected onto the object to be drawn, and the projection data is displayed on the display unit, and the projection data is determined.

2. The handwriting and drawing support system of claim 1, characterized in that the type options include a written template icon button that allows the user to select a template to write, a freehand text icon button that allows the user to input any characters, an illustration icon button that allows the user to select an illustration to draw, a photo icon button that allows the user to select a photo taken by the user, and a search icon button that allows the user to search and select an icon on the Internet.

3. The lower layer screen is a first lower-level screen on which a plurality of icon buttons are displayed as the handwriting drawing targets; 2. The handwriting projection support system according to claim 1, further comprising: a second lower-level screen displaying projection data of a selected one of the handwriting / drawing objects.

4. On the lower layer screen, 2. The handwriting projection support system according to claim 1, wherein an image captured by a camera is determined as the handwriting drawing target, and the captured image is converted into the projection data.

5. In the mobile device used by the user, a handwriting drawing support system that supports a user's handwriting drawing action on an object to be drawn by projecting a projection image of a handwriting drawing target onto the object to be drawn; A control unit that operates the handwriting drawing assistance system; a projection unit that projects the projection image onto the drawing object, The control unit A mobile terminal characterized in that a plurality of type options from which the type of the handwritten drawing object can be selected are displayed on a display unit of the mobile terminal as a type selection screen, and one of a plurality of lower-level screens that differ for each type option is displayed on the display unit of the mobile terminal depending on the type option selected by the user, the handwritten drawing object is determined by the user operating the lower-level screen, the handwritten drawing object is converted into projection data to be projected onto the handwritten drawing object and displayed on the display unit, and the projection data is projected from the projection unit onto the handwritten drawing object based on the projection data.

6. A handwriting drawing assistance device that supports a user's handwriting drawing action on an object to be drawn by projecting a projection image of a handwriting drawing target onto the object to be drawn, a receiving unit that receives projection data of the drawing object; a projection unit that projects the projection data onto the drawing object based on the projection data received by the receiving unit, The receiving unit a control unit of a portable terminal used by the user, wherein a plurality of type options from which the type of the handwriting drawing object can be selected are displayed on a display unit of the portable terminal as a type selection screen, and one of a plurality of lower-level screens that differ for each type option is displayed on the display unit of the portable terminal according to the type option selected by the user, wherein the handwriting drawing object is determined by the user operating the lower-level screen, and the handwriting drawing object is converted into projection data to be projected onto the object to be drawn and displayed on the display unit, and the transmitted projection data is received.

7. A method for producing a handwritten drawing object in which a handwritten drawing target is handwritten and drawn, a step of preparing a handwriting and drawing support system that supports a user in performing handwriting and drawing on an object to be drawn by projecting a projection image of the handwriting and drawing target onto the object to be drawn; preparing the object to be drawn; receiving the projection data transmitted from the handwriting drawing assist system; a step of projecting the projection data onto the object to be drawn based on the projection data received in the receiving step; and drawing the drawing target on the drawing object by handwriting, In the receiving step, A method for producing a handwritten drawing object, the method being operated by a control unit of a mobile terminal used by the user, wherein a plurality of type options from which the type of the handwritten drawing object can be selected are displayed on a display unit of the mobile terminal as a type selection screen, and depending on the type option selected by the user, one of a plurality of lower-level screens that differ for each type option is displayed on the display unit of the mobile terminal, the handwritten drawing object is determined by the user operating the lower-level screen, the handwritten drawing object is converted into projection data to be projected onto the handwritten drawing object and displayed on the display unit, and the transmitted projection data is received.

Images