Intelligent drawing auxiliary system and method

Abstract

The invention provides an intelligent drawing auxiliary system and method, and belongs to the technical field of computer-aided drawing, and the system comprises a host, and a camera, a projector and a touch film which are in communication connection with the host; the camera is used for collecting an interface image in a drawing interface in real time; the touch film is used for collecting touch operation information of the drawing interface in real time; the host is used for determining a drawing type and a drawing feature in the drawing interface based on the interface image and the touch operation information, and generating a drawing suggestion based on the drawing type and the drawing feature; and the projector is used for projecting and displaying the drawing suggestions and the drawing data in the drawing interface. By generating the drawing suggestion, the pause and hesitation time in the drawing process can be shortened, and the purpose of improving the drawing efficiency and the drawing quality is achieved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer-aided drawing, in particular to an intelligent drawing auxiliary system and method. BACKGROUND

[0002] With the development of computer technology, computer software-based drawing methods have gradually become popular. Although such drawing software provides basic auxiliary functions such as basic graphic drawing tools, layer management, and simple alignment and distribution functions, they mostly mechanically provide some preset operation options, lacking deep perception and intelligent analysis capabilities for real-time drawing actions of the drawer.

[0003] When using such software, the drawer still needs to think about how to optimize the drawing details, that is, the drawing quality still depends on the professional technical knowledge and artistic aesthetic ability of the drawer, and the software cannot provide real-time and drawing-intention-matching effective suggestions for the drawer. If you want to get suggestions on composition, color matching, etc. during the drawing process, you usually need to manually switch to the corresponding function menu or consult the help document, which is a cumbersome operation process that seriously interrupts the continuity of drawing. It cannot provide real-time and drawing-intention-matching effective suggestions for the drawer, and it is difficult to substantially improve the drawing efficiency and quality.

[0004] Therefore, it is necessary to provide an intelligent drawing auxiliary system and method that can provide effective drawing suggestions for the drawer in real time to improve drawing efficiency and quality. SUMMARY

[0005] Therefore, it is necessary to provide an intelligent drawing auxiliary system and method that can provide effective drawing suggestions for the drawer in real time to improve drawing efficiency and quality.

[0006] In one aspect, to solve the above technical problems, the present application provides an intelligent drawing auxiliary system, comprising: a host computer and a camera, a projector, and a touch film in communication connection with the host computer. The camera is used to collect interface images in a drawing interface in real time. The touch film is used to collect touch operation information of the drawing interface in real time. The host computer is used to determine the drawing type and drawing features in the drawing interface based on the interface images and the touch operation information, and to generate drawing suggestions based on the drawing type and the drawing features. The projector is used to project and display the drawing suggestions and the drawing data in the drawing interface.

[0007] In a possible implementation, the host comprises a feature extraction module, an identification module, and a drawing suggestion generation module. The feature extraction module is configured to perform feature extraction on the interface image to obtain color features, brush stroke features, and theme features, and determine a drawing trajectory based on the touch operation information. The identification module is configured to determine the drawing type based on the color features, the brush stroke features, and the theme features, and determine the drawing features based on the drawing trajectory; the drawing type comprises sketch, watercolor painting, oil painting, and engineering drawing, and the drawing features comprise a plurality of trajectory lines and starting points, ending points, trajectory directions, and trajectory widths of the trajectory lines. The drawing suggestion generation module is configured to take the drawing type and the drawing features as query items, search in a preset rule library to obtain a target rule, and generate the drawing suggestion based on the target rule.

[0008] In a possible implementation, the target rule comprises a trajectory constraint rule and a trajectory attribute rule, and the drawing suggestion comprises a trajectory modification suggestion; the drawing suggestion generation module comprises a trajectory judgment unit and a trajectory suggestion generation unit. The trajectory judgment unit is configured to determine whether the plurality of trajectory lines satisfy the trajectory constraint rule and whether the trajectory lines satisfy the trajectory attribute rule. The trajectory suggestion generation unit is configured to generate the trajectory modification suggestion when the plurality of trajectory lines do not satisfy the trajectory constraint rule and / or the trajectory lines do not satisfy the trajectory attribute rule.

[0009] In a possible implementation, the target rule comprises a brush rule, and the drawing suggestion comprises a brush switching suggestion; the drawing suggestion generation module further comprises a brush judgment unit and a brush switching suggestion generation unit. The brush judgment unit is configured to determine a current brush of the interface image based on the drawing features, and determine whether the current brush satisfies the brush rule. The brush switching suggestion generation unit is configured to generate the brush switching suggestion when the current brush does not satisfy the brush rule.

[0010] In a possible implementation, the drawing suggestion generation module further comprises a style trend determination unit and an overall modification suggestion generation unit. The style trend determination unit is configured to input the drawing features into a trained style identification model to obtain drawing style trends; the drawing style trends comprise color matching styles and graphic symmetry styles. The overall modification suggestion generation unit is configured to generate an overall modification suggestion based on the drawing style trend; the overall modification suggestion comprises a graphical adjustment suggestion and / or a color adjustment suggestion.

[0011] In a possible implementation, the feature extraction module comprises an image denoising unit, an image enhancement unit and a feature extraction unit. The image denoising unit is configured to perform denoising processing on the interface image to obtain a denoised image. The image enhancement unit is configured to perform edge enhancement processing on the denoised image to obtain an enhanced image. The feature extraction unit is configured to perform feature extraction on the enhanced image to obtain color features, brush stroke features and subject matter features, and determine a painting trajectory based on the touch operation information.

[0012] In a possible implementation, the camera is further configured to acquire a user gesture image, and the host further comprises a gesture response module. The gesture response module is configured to identify the user gesture image to obtain a gesture recognition result, and generate a gesture response result corresponding to the gesture recognition result based on a preset gesture and gesture response association relationship. The gesture response result comprises translating, zooming and rotating the drawing interface.

[0013] In a possible implementation, the host further comprises a trajectory extraction module and a trajectory determination module. The trajectory extraction module is configured to perform trajectory identification on a plurality of continuous interface images to obtain an image trajectory. The trajectory determination module is configured to determine whether the image trajectory and the trajectory line are the same, if yes, take the image trajectory or the trajectory line as a drawing trajectory, and if not, reacquire the image trajectory and the trajectory line.

[0014] In a possible implementation, the host further comprises a projection parameter setting module. The projection parameter setting module is configured to acquire a size of the drawing interface, an ambient brightness and an output resolution of the camera, determine a projection scale based on the size of the drawing interface, a projection brightness based on the ambient brightness and a projection resolution based on the output resolution.

[0015] On the other hand, the present application further provides an intelligent drawing assistance method, which is applicable to the intelligent drawing assistance system in any of the possible implementation manners described above, and the method comprises: Acquiring an interface image in a drawing interface based on a camera; Acquiring touch operation information of the drawing interface based on a touch film; determine a drawing type and a drawing feature in the drawing interface based on the interface image and the touch operation information, and generate a drawing suggestion based on the drawing type and the drawing feature; project the drawing suggestion and drawing data in the drawing interface based on a projector.

[0016] The intelligent drawing auxiliary system provided by the present application can accurately capture the interface image in the drawing interface in real time through the camera, and the touch film can collect diversified touch operation information of the drawer in real time, so as to provide abundant original data for the drawing suggestion in the host computer, ensure that the generated drawing suggestion is targeted and accurate, and thus improve the drawing efficiency and drawing quality. Moreover, the drawing suggestion is automatically generated in the host computer, and the drawer does not need to spend a lot of time to think and repeatedly modify by himself, but can directly refer to the drawing suggestion for optimization, thereby reducing the pause and hesitation time in the drawing process and further improving the drawing efficiency.

[0017] Further, the projector projects and displays the drawing data and the drawing suggestion in real time, so that the drawer can intuitively see the drawing suggestion while drawing, without interrupting the drawing operation to obtain the suggestion, realizing real-time interaction in the drawing process, and further improving the drawing efficiency and drawing quality.

[0018] Further, by setting the touch film, the drawer can more conveniently perform various interactive operations on the drawing data, enhancing the drawing interactivity, making the drawing process no longer a single drawing action, but a more flexible and interactive creation process, further stimulating the creation inspiration of the drawer. BRIEF DESCRIPTION OF DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0020] Figure 1 An embodiment structure diagram of the intelligent drawing auxiliary system provided by the present application; Figure 2 An embodiment structure diagram of the host computer provided by the present application; Figure 3 An embodiment flow diagram of the intelligent drawing auxiliary method provided by the present application. DETAILED DESCRIPTION

[0021] With reference to the drawings and the embodiments of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative work fall within the scope of the present application.

[0022] It should be understood that the schematic drawings are not drawn to scale. The flowcharts used in the present application show the operations implemented according to some embodiments of the present application. It should be understood that the operations of the flowcharts can not be implemented in sequence, the steps without logical context relationship can be reversed in sequence or implemented simultaneously. In addition, one or more other operations can be added to the flowcharts or one or more operations can be removed from the flowcharts by those skilled in the art under the guidance of the content of the present application. Some block diagrams shown in the drawings are functional entities, which do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different network and / or processor systems and / or microcontroller systems.

[0023] Reference to "an embodiment" in this document means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The phrase appears at various places in the specification does not necessarily all refer to the same embodiment, nor is it necessarily independent or alternative embodiments to other embodiments. Those skilled in the art explicitly and implicitly understand that the embodiments described herein can be combined with other embodiments.

[0024] The present application provides an intelligent drawing assistance system and method, which are described below respectively.

[0025] Figure 1 The embodiment structure schematic diagram of the intelligent drawing assistance system provided by the present application is shown in FIG. 1, which includes a host 100, a camera 200, a projector 300, and a touch film 400 in communication connection with the host 100. Figure 1 The camera 200 is used for real-time acquisition of interface images in a drawing interface. The touch film 400 is used for real-time acquisition of touch operation information of the drawing interface. The host 100 is used for determining a drawing type and a drawing feature in the drawing interface based on the interface images and the touch operation information, and generating a drawing suggestion based on the drawing type and the drawing feature. The projector 300 is used for projecting and displaying the drawing suggestion and drawing data in the drawing interface.

[0026] ​The communication mode between the host 100 and the camera 200, the projector 300 and the touch film 400 can be wired communication or wireless communication, specifically, the wired communication can be USB line, HDMI line connection. The wireless communication can be Wifi connection or Bluetooth connection, etc.

[0027] It should be noted that: in order to improve the integration of the intelligent drawing auxiliary system 10, the touch film 400 can be attached to the drawing interface, and the projection area of the projector 300 is also the drawing interface.

[0028] It should be understood that: since the camera 200 needs to collect the interface image of the entire drawing interface, when installing the camera 200, the appropriate horizontal and vertical angles are selected and set in the appropriate position above or beside the drawing system.

[0029] And the parameters of the camera 200, the touch film 400, the host 100 and the projector 300 should meet the needs of the intelligent drawing auxiliary system 10.

[0030] In the specific embodiments of the present application, the touch film 400 is a multi-point touch film, such as protouchi multi-point touch film, which can improve the diversity and accuracy of touch operation information, and further improve the drawing quality of the intelligent drawing auxiliary system 10.

[0031] Compared with the prior art, the intelligent drawing auxiliary system 10 provided by the embodiments of the present application can accurately capture the interface image in the drawing interface in real time through the camera 200, and the touch film 400 can collect the diversified touch operation information of the drawer in real time, which can provide rich raw data for the drawing suggestion in the host 100, and ensure that the generated drawing suggestion is targeted and accurate, thereby improving the drawing efficiency and drawing quality. Moreover, the drawing suggestion is automatically generated in the host 100, without the need for the drawer to spend a lot of time thinking and repeatedly modifying, and the drawing suggestion can be directly referred to for optimization, reducing the pause and hesitation time in the drawing process, and further improving the drawing efficiency.

[0032] Further, the projector 300 projects and displays the drawing data and the drawing suggestion in real time, so that the drawer can see the drawing suggestion intuitively while drawing, without interrupting the drawing operation to obtain the suggestion, realizing real-time interaction in the drawing process, and further improving the drawing efficiency and drawing quality.

[0033] Further, by setting the touch film 400, the drawer can more conveniently perform various interactive operations on the drawing data, enhancing the drawing interactivity, so that the drawing process is no longer a single drawing action, but a more flexible and interactive creation process, further stimulating the creative inspiration of the drawer.

[0034] As can be seen from the above description, the more accurate the generated drawing suggestion is, the higher the drawing quality and drawing efficiency are, and therefore, in some embodiments of the present application, as shown in Figure 2 The host 100 includes a feature extraction module 110, an identification module 120, and a drawing suggestion generation module 130. The feature extraction module 110 is configured to perform feature extraction on the interface image to obtain color features, stroke features, and theme features, and determine a painting trajectory based on touch operation information. The identification module 120 is configured to determine a drawing type based on the color features, the stroke features, and the theme features, and determine drawing features based on the painting trajectory; the drawing type includes sketch, watercolor painting, oil painting, and engineering drawing, and the drawing features include a plurality of trajectory lines and starting points, ending points, trajectory directions, and trajectory widths of the trajectory lines. The drawing suggestion generation module 130 is configured to take the drawing type and the drawing features as query items, search in a preset rule library to obtain a target rule, and generate a drawing suggestion based on the target rule.

[0035] In the embodiments of the present application, the color features, the stroke features, and the theme features of the interface image are extracted to determine the drawing type, which can improve the accuracy of the drawing type and provide an accurate reference for the generation of subsequent drawing suggestions, i.e., the accuracy of the generated drawing suggestion can be improved.

[0036] Specifically, different drawing types have different requirements for lines and layouts, and therefore, the embodiments of the present application first determine the drawing type, and then determine the target rule based on the drawing type, which can further ensure the adaptability of the generated drawing suggestion to the drawing requirement.

[0037] Since the sketch, the watercolor painting, the oil painting, and the engineering drawing have different forms of expression (color and stroke) and different theme contents (theme features) in the entire drawing, for example, portrait painting is mostly sketch, landscape painting is mostly watercolor painting, and architectural structure drawing is mostly engineering drawing, the drawing type can be accurately determined by extracting the color features, the stroke features, and the theme features.

[0038] It should be understood that a trained deep learning network model can be pre-set in the identification module 120, which is configured to determine the drawing type based on the color features, the stroke features, and the theme features.

[0039] In specific embodiments of the present application, when the drawing type is engineering drawing, the target rule includes, but is not limited to, standard size ratio, reasonable spacing of structure layout, and standard format of labeled text.

[0040] In the feature extraction module 110, the painting trajectory is determined based on the pressing state information and the angle information collected by the touch film 400.

[0041] In specific embodiments of the present application, the target rules include trajectory constraint rules and trajectory attribute rules, and the drawing suggestion includes a trajectory modification suggestion; then, as shown in FIG. 13, the drawing suggestion generation module 130 includes a trajectory judgment unit 131 and a trajectory suggestion generation unit 132. Figure 2 The trajectory judgment unit 131 is configured to judge whether the plurality of trajectory lines satisfy the trajectory constraint rules and whether each trajectory satisfies the trajectory attribute rules. The trajectory judgment unit 131 is configured to judge whether the plurality of trajectory lines satisfy the trajectory constraint rules and whether each trajectory satisfies the trajectory attribute rules. The trajectory suggestion generation unit 132 is configured to generate a trajectory modification suggestion when the plurality of trajectory lines do not satisfy the trajectory constraint rules and / or each trajectory does not satisfy the trajectory attribute rules.

[0042] In specific embodiments of the present application, when the drawing type is a building engineering drawing, the trajectory constraint rules include, but are not limited to, constraint rules representing the proportional relationship of graphics of different buildings, representing the parallel and perpendicular relationship between wall trajectories, etc. The trajectory attribute rules include, but are not limited to, wall thickness, wall inclination angle, etc.

[0043] Specifically, if the inclination angle of a certain wall line does not meet the vertical requirement, resulting in that it is not parallel to the adjacent wall, the trajectory modification suggestion is: "it is suggested to adjust the drawing angle of the wall to keep it perpendicular to the adjacent wall to meet the stability requirement of the building structure".

[0044] Since different drawing fields need to be drawn with different brushes to ensure drawing quality, for example, oil painting needs to be drawn with an oil painting brush, sketch needs to be drawn with a pencil, and different types of pencils need to be changed during the sketch drawing process.

[0045] Therefore, in specific embodiments of the present application, the target rules include brush rules, and the drawing suggestion includes a brush switching suggestion; then, the drawing suggestion generation module 130 further includes a brush judgment unit 133 and a brush switching suggestion generation unit 134. The brush judgment unit 133 is configured to determine the current brush of the interface image based on the drawing feature and judge whether the current brush satisfies the brush rules. The brush switching suggestion generation unit 134 is configured to generate a brush switching suggestion when the current brush does not satisfy the brush rules.

[0046] The embodiments of the present application determine the current brush based on the drawing feature, and generate a brush switching suggestion when the current brush does not satisfy the brush rules, to ensure that the subsequent drawing is performed with a suitable brush, and further improve the drawing quality.

[0047] Specifically, the brush judgment unit 133 determines the current brush by inputting the drawing feature into the trained brush recognition model.

[0048] In specific embodiments of the present application, if the current brush is a pencil, but the drawing type determined by the current drawing feature is oil painting, the brush switching suggestion is: "Suggest adjusting the brush to oil painting to meet the requirements of oil painting drawing".

[0049] Further, since the drawing styles of each painter are different, to make the drawing drawn by the intelligent drawing assistance system 10 more in line with the personal drawing style of the painter, i.e., to improve the drawing flexibility and personalization, in some embodiments of the present application, as shown in Figure 2 The drawing suggestion generation module 130 further includes a style trend determination unit 135 and an overall modification suggestion generation unit 136. The style trend determination unit 135 is configured to input the drawing feature into the trained style recognition model to obtain a drawing style trend; the drawing style trend includes a color matching style and a figure symmetry style. The overall modification suggestion generation unit 136 is configured to generate an overall modification suggestion based on the drawing style trend; the overall modification suggestion includes a figure adjustment suggestion and / or a color adjustment suggestion.

[0050] The embodiments of the present application identify the drawing style trend to generate an overall modification suggestion in line with the drawing style trend, so that the subsequent drawing is more in line with the personal style, avoiding repeated modification, ensuring the drawing efficiency while having drawing flexibility and personalization.

[0051] The figure symmetry style refers to whether the painter prefers symmetric figures, if so, a figure adjustment suggestion is generated to adjust asymmetric figures to symmetric figures. The color adjustment suggestion is similar, which will not be described here.

[0052] As can be seen from the above description: the generation of accurate drawing suggestions depends on accurate feature extraction, therefore, in some embodiments of the present application, as shown in Figure 2 The feature extraction module 110 includes an image denoising unit 111, an image enhancement unit 112, and a feature extraction unit 113. The image denoising unit 111 is configured to perform denoising processing on the interface image to obtain a denoised image. The image enhancement unit 112 is configured to perform edge enhancement processing on the denoised image to obtain an enhanced image. The feature extraction unit 113 is configured to perform feature extraction on the enhanced image to obtain color features, brush stroke features, and subject matter features, and determine a painting trajectory based on the touch operation information.

[0053] The processing means of the denoising processing includes but is not limited to mean filtering, median filtering, Gaussian filtering, wavelet denoising, and non-local mean denoising, etc.

[0054] The processing means of the edge enhancement processing includes but is not limited to sharpening processing based on Laplace operator, edge enhancement technology based on nonlinear filter, adaptive edge enhancement algorithm and edge image enhancement algorithm based on deep learning, etc.

[0055] The embodiment of the application eliminates the adverse effects on the feature extraction result by denoising the interface image, and enhances the trajectory in the denoised image through edge enhancement processing on the denoised image, thereby further improving the accuracy of the feature extraction result.

[0056] In some drawing scenarios, the drawer may wish to conveniently scale, translate, rotate and the like the drawn graphics, so as to better view the overall layout or adjust the local details, however, the traditional drawing software either does not support natural and smooth interaction, or only supports limited touch gestures, which cannot meet the diversified operation requirements of the drawer, and limits the flexibility and creativity in the drawing creation process.

[0057] To further improve the interactivity of the intelligent drawing auxiliary system 10, in some embodiments of the application, the camera 200 is further configured to acquire a user gesture image, and as shown in Figure 2 the host 100 further comprises a gesture response module 140; The gesture response module 140 is configured to identify the user gesture image, obtain a gesture recognition result, and generate a gesture response result corresponding to the gesture recognition result based on a preset gesture and gesture response association relationship; The gesture response result includes translation, scaling and rotation of the drawing interface.

[0058] Specifically, through the double-finger pinch gesture, the touch film 400 identifies the distance change of the touch point and feeds back the information to the gesture response module 140, and the gesture response module 140 adjusts the projection content of the projector 300 accordingly to realize the magnification display effect, and the drawn part of the drawing is enlarged to view the details, through the single-finger sliding gesture, the touch film 400 transmits the sliding direction and distance information to the gesture response module 140, and the gesture response module 140 controls the projector 300 to move the projection picture to realize the translation of the drawing interface.

[0059] The embodiment of the application introduces the gesture response module 140, which can improve the interactivity of the host 100 with the projector 300 and the camera 200, improve the diversity of the interactive function in the drawing process through various interactive gestures, and further stimulate the creative inspiration of the drawer.

[0060] In order to avoid the technical problem that the touch operation information of the drawing interface collected based on the touch film 400 is incorrect due to the abnormal touch of the touch film 400, and the recognized track is incorrect, and the drawing quality is greatly reduced, in some embodiments of the present application, as shown in Figure 2 The host 100 further includes a track extraction module 150 and a track determination module 160. The track extraction module 150 is configured to perform track recognition on the continuous multiple interface images to obtain image tracks. The track determination module 160 is configured to determine whether the image tracks and the track lines are the same, if yes, the image tracks or the track lines are taken as the drawing track, if not, the image tracks and the track lines are reacquired.

[0061] In the embodiments of the present application, the interface images obtained based on the camera 200 are additionally used for track recognition to obtain image tracks, and the image tracks and the track lines are mutually verified, when the image tracks and the track lines are the same / overlapped, it is determined that the track recognition is accurate, otherwise, the track lines are reacquired, the accuracy of the determined track lines is ensured, the false touch is avoided, and the drawing quality is further improved.

[0062] The specific process of the track extraction module 150 is as follows: first, the track lines in each frame of interface image are extracted, the track lines of the multiple interface images are matched and tracked based on the time sequence to obtain the image tracks.

[0063] In order to improve the projection effect of the projector 300, in some embodiments of the present application, as shown in Figure 2 The host 100 further includes a projection parameter setting module 170. The projection parameter setting module 170 is configured to acquire the size of the drawing interface, the ambient brightness, and the output resolution of the camera 200, and determine the projection scale based on the size of the drawing interface, the projection brightness based on the ambient brightness, and the projection resolution based on the output resolution.

[0064] The output resolution is the projection resolution, the size of the drawing interface and the projection scale of the light emitting area of the projector 300, and the projection brightness and the ambient brightness satisfy a preset relationship.

[0065] In the embodiments of the present application, the projection scale, the projection brightness, and the projection resolution of the projector 300 are determined, and high-quality projection in any lighting environment and any projection distance is realized.

[0066] In summary, the intelligent drawing auxiliary system provided by the embodiments of the present application has the following advantages: 1. The interface image and the touch operation information are captured in real time, and drawing suggestions that conform to the drawing intention are quickly generated based on the interface image and the touch operation information, so that the drawer does not need to spend a lot of time to think and repeatedly modify, can directly refer to the suggestions to optimize, reduces the pause and hesitation time in the drawing process, and thus the overall efficiency of drawing is significantly improved. 2. The drawing suggestions given based on the professional drawing rule library can help the drawer better grasp the key drawing elements such as composition, line, color, etc., so that the drawn figure is more in line with the specifications and aesthetic requirements of the corresponding field, and the drawing quality is effectively improved. 3. The addition of the touch film enables the drawer to conveniently perform various interactive operations on the drawing content, and the host can update the suggestions in real time in response to these operations, so that the drawing process is no longer a single drawing action, but a more flexible and interactive creation process, which further stimulates the creative inspiration of the drawer.

[0067] Correspondingly, the embodiments of the present application also provide an intelligent drawing auxiliary method suitable for the intelligent drawing auxiliary system in any of the above embodiments, as shown in the following. Figure 3 The intelligent drawing auxiliary method comprises the following steps. S301, capturing an interface image in a drawing interface based on a camera; S302, capturing touch operation information of the drawing interface based on a touch film; S303, determining a drawing type and a drawing feature in the drawing interface based on the interface image and the touch operation information, and generating a drawing suggestion based on the drawing type and the drawing feature; S304, projecting and displaying the drawing suggestion and drawing data in the drawing interface based on a projector.

[0068] It should be noted that the intelligent drawing auxiliary method provided by the above embodiments can realize the technical solutions described in the above intelligent drawing auxiliary system embodiments, and the principles or specific implementation details realized by the above steps can be referred to the corresponding content in the above intelligent drawing auxiliary system embodiments, which will not be described here.

[0069] Those skilled in the art can understand that all or part of the processes of the above-mentioned embodiments can be completed by a computer program instructing related hardware (such as a processor, a controller, etc.) to complete, and the computer program can be stored in a computer readable storage medium. Among them, the computer readable storage medium is a disk, an optical disk, a read-only memory or a random access memory, etc.

[0070] The above describes in detail the intelligent drawing auxiliary system and method provided by the present application, and the principles and implementation manners of the present application are described by using specific examples. The above description of the examples is only used to help understand the method of the present application and the core idea thereof. Meanwhile, for those skilled in the art, the specific implementation manners and application ranges will be changed according to the idea of the present application. In summary, the content of the present description should not be understood as a limitation on the present application.

Claims

1. An intelligent drawing aid system, characterized by, The application relates to a drawing suggestion generation method and device. The application comprises: a host and a camera, a projector and a touch film connected with the host; the camera is used for collecting interface images in a drawing interface in real time; the touch film is used for collecting touch operation information of the drawing interface in real time; the host is used for determining a drawing type and a drawing feature in the drawing interface based on the interface images and the touch operation information, and generating a drawing suggestion based on the drawing type and the drawing feature; 2. The intelligent drawing aid system of claim 1, wherein, the projector is used for projecting and displaying the drawing suggestion and drawing data in the drawing interface. The host comprises a feature extraction module, an identification module and a drawing suggestion generation module; the feature extraction module is used for extracting features of the interface images, obtaining color features, brush stroke features and theme features, and determining a painting track based on the touch operation information; the identification module is used for determining the drawing type based on the color features, the brush stroke features and the theme features, and determining the drawing feature based on the painting track; the drawing type comprises sketch, watercolor painting, oil painting and engineering drawing, and the drawing feature comprises a plurality of track lines and starting points, ending points, track directions and track widths of the track lines; 3. The intelligent drawing aid system of claim 2, wherein, the drawing suggestion generation module is used for taking the drawing type and the drawing feature as query items, searching in a preset rule base, obtaining a target rule, and generating the drawing suggestion based on the target rule. The target rule comprises a track constraint rule and a track attribute rule, and the drawing suggestion comprises a track modification suggestion; the drawing suggestion generation module comprises a track judgment unit and a track suggestion generation unit; the track judgment unit is used for judging whether the plurality of track lines satisfy the track constraint rule and whether the tracks satisfy the track attribute rule; 4. The intelligent drawing aid system of claim 2, wherein, the track suggestion generation unit is used for generating the track modification suggestion when the plurality of track lines do not satisfy the track constraint rule and / or the tracks do not satisfy the track attribute rule. The target rule comprises a brush rule, and the drawing suggestion comprises a brush switching suggestion; the drawing suggestion generation module further comprises a brush judgment unit and a brush switching suggestion generation unit; the brush judgment unit is used for determining a current brush of the interface images based on the drawing feature, and judging whether the current brush satisfies the brush rule; 5. The intelligent drawing aid system of claim 2, wherein, the brush switching suggestion generation unit is used for generating a brush switching suggestion when the current brush does not satisfy the brush rule. The drawing suggestion generation module further comprises a style trend determination unit and a whole modification suggestion generation unit; the style trend determination unit is used for inputting the drawing feature into a trained style identification model to obtain a drawing style trend; the drawing style trend comprises a color matching style and a figure symmetry style; 6. The intelligent drawing aid system of claim 2, wherein, the whole modification suggestion generation unit is used for generating a whole modification suggestion based on the drawing style trend; the whole modification suggestion comprises a figure adjustment suggestion and / or a color adjustment suggestion. The feature extraction module comprises an image denoising unit, an image enhancement unit and a feature extraction unit. The image denoising unit is configured to perform denoising processing on the interface image to obtain a denoised image. The image enhancement unit is configured to perform edge enhancement processing on the denoised image to obtain an enhanced image. The feature extraction unit is configured to perform feature extraction on the enhanced image to obtain color features, brush stroke features and theme features, and determine a painting trajectory based on the touch operation information.

7. The intelligent drawing aid system of claim 1, wherein, The camera is further configured to acquire a user gesture image, and the host further includes a gesture response module. The gesture response module is configured to identify the user gesture image to obtain a gesture recognition result, and generate a gesture response result corresponding to the gesture recognition result based on a pre-set gesture and gesture response association relationship. The gesture response result includes translation, scaling and rotation of the drawing interface.

8. The intelligent drawing aid system of claim 2, wherein, The host further includes a trajectory extraction module and a trajectory determination module. The trajectory extraction module is configured to perform trajectory identification on a plurality of continuous interface images to obtain an image trajectory. The trajectory determination module is configured to determine whether the image trajectory and the trajectory line are the same, and if so, take the image trajectory or the trajectory line as a drawing trajectory, and if not, reacquire the image trajectory and the trajectory line.

9. The intelligent drawing aid system of claim 1, wherein, The host further includes a projection parameter setting module. The projection parameter setting module is configured to acquire the size of the drawing interface, the ambient brightness and the output resolution of the camera, determine a projection scale based on the size of the drawing interface, a projection brightness based on the ambient brightness, and a projection resolution based on the output resolution.

10. An intelligent drawing aid method, characterized by, The method is suitable for the intelligent drawing auxiliary system of any one of claims 1-9, and the method comprises: acquiring an interface image in a drawing interface based on a camera; acquiring touch operation information of the drawing interface based on a touch film; determining a drawing type and drawing features in the drawing interface based on the interface image and the touch operation information, and generating a drawing suggestion based on the drawing type and the drawing features; projecting and displaying the drawing suggestion and drawing data in the drawing interface based on a projector.

Images