Electronic seal system and program

Abstract

To provide an electronic seal system that can make up for insufficient communications.SOLUTION: A facial impression image KG generated by imaging the face of a user (a person who sealed) includes the expression of the face of the user. A seal image can thus express feelings (passions, emotions) of the person who sealed. Attaching (sealing) the facial seal image to a seal target of an electronic document, for example, makes it possible to convey the feeling of the person who sealed to another person such as an approver through the facial seal image.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to an electronic seal system and a program. [Background technology]

[0002] Conventionally, there is known an electronic seal system that enables the act of stamping electronically by attaching a seal image (seal impression picture) to an electronic document displayed on the display screen of a terminal (see, for example, Patent Document 1). By using this type of electronic seal system, it becomes possible for an applicant to apply and an approver to approve without paper (paperless processing). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2003-169051 Summary of the Invention [Problem to be solved by the invention]

[0004] As mentioned above, conventional electronic seal systems can achieve paperless applications and approvals, but they also eliminate face-to-face interaction between applicants and approvers, which can lead to problems such as a lack of communication, especially in today's world where remote work (telework) is becoming more common.

[0005] The present invention has been made in view of the above circumstances, and its object is to provide an electronic seal system and program that can compensate for the lack of communication. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems, the present invention employs the following configuration.

[0007] The electronic seal system in Method 1 is A photographing means capable of photographing the face of the person who affixes the seal; a generating means for performing a predetermined imprinting process based on the photographed image taken by the photographing means to generate a face imprint image showing the face of the person who has affixed the seal; and a seal means for attaching the face seal image to a seal location of a seal target displayed on a predetermined display screen. 、 the captured image is a raster image, The imprinting process includes converting the captured image into a binary image in vector format. The gist of this is as follows.

[0008] According to this, the facial seal imprint image generated by performing a seal imprint process on an image captured by a photographing device (a captured image including the face of the person applying the seal) includes the facial expression of the person applying the seal. This makes it possible to express the feelings (enthusiasm, emotions, etc.) of the person applying the seal in the seal imprint image. Then, by attaching (sealing) the facial seal imprint image to the object to be stamped (for example, an electronic document, etc.), a unique form of communication can be achieved in which the feelings of the person applying the seal are conveyed to the other party (for example, an approver, etc.) through the facial expression included in the facial seal imprint image. This provides an electronic seal system that can compensate for lack of communication.

[0010] Also The facial seal imprint image generated by performing the seal imprint process on the captured image is a binary image in vector format. This makes it possible to make the facial seal imprint image look like an actual seal imprint, thereby increasing the reality of the facial seal imprint image as an imprint.

[0011] means 2 The electronic seal system is a means 1 In the electronic seal system, The imprinting process includes a process of changing the black part of the binary image to another color. The gist of this is as follows.

[0012] According to this, the facial seal imprint image (binary image) generated by applying the seal imprint process to the photographed image is displayed in a color other than black. This makes it possible to make the facial seal imprint image look more similar to the actual seal imprint.

[0013] means 3 The electronic seal system is a means 1 or 2 In the electronic seal system, The imprinting process includes a masking process for extracting an imprint portion from the captured image or the binary image. The gist of this is as follows.

[0014] According to this, the facial seal imprint image generated by applying the seal imprint process based on the photographed image includes the seal imprint portion extracted from the photographed image or the binary image by the mask process. This makes it easy to obtain a facial seal imprint image corresponding to any shape (shape of the seal imprint).

[0015] means 4 The electronic seal system is from means 1 to 3 In any one of the electronic seal systems, an editing means for editing the face seal image generated by the generating means based on an external instruction; The gist of this is as follows.

[0016] This allows the generated facial seal imprint image to be edited as desired, thereby enabling correction, customization, etc. of the facial seal imprint image.

[0017] means 5 The electronic seal system is a means 4 In the electronic seal system, When the facial seal imprint image is edited by the editing means, a presentation means is provided for generating and presenting an edited image based on the photographed image or the facial seal imprint image in accordance with a predetermined editing pattern. The gist of this is as follows.

[0018] According to this, when editing a facial seal imprint image, the edited image can be presented as a candidate (sample) of the edited (edited) facial seal imprint image. This makes it possible to improve the convenience of editing.

[0019] means 6 The program will run the computer from the means 1 5 It is a program to function as one of the means of the electronic seal system. The gist of this is as follows.

[0020] This makes it possible to provide a program that functions as each means of the electronic seal system. [Effects of the Invention]

[0021] According to the present invention, it is possible to provide an electronic seal system and program that can compensate for lack of communication. [Brief explanation of the drawings]

[0022] [Figure 1] 1 is a schematic diagram of a system according to an embodiment. [Figure 2] FIG. 2 is a configuration diagram of a terminal device. [Figure 3] 10 is a flowchart of a seal processing. [Figure 4] 10 is a flowchart of a print imprinting process. [Figure 5] 1A is a diagram showing a display example of an electronic document including a seal field, and FIG. 1B is an enlarged view of the seal field in which a face seal impression image has been affixed. [Figure 6] FIG. 10A is a diagram showing an example of a shooting screen, and FIG. 10B is a diagram showing an example of a confirmation screen. [Figure 7] (A) is a diagram showing an example of a photographed image, (B) is a diagram showing an example of a binary image, and (C) is a diagram showing an example of a face seal imprint image. [Figure 8] 10 is a flowchart of a seal processing according to the first modified example. [Figure 9]10 is a flowchart of a seal imprinting process according to a second modified example. [Figure 10] FIG. 10A is a diagram showing an example of a character imprint image of a laughing pattern, and FIG. 10B is a diagram showing an example of a character imprint image of a sad pattern. DETAILED DESCRIPTION OF THE INVENTION

[0023] Next, an embodiment of the present invention will be described using an example. [Example]

[0024] This embodiment is an electronic seal system that enables electronic stamping (hereinafter simply referred to as "sealing") by attaching a face imprint image (seal image) of the person stamping onto the object to be stamped, such as an electronic document.

[0025] As shown in FIG. 1, the electronic seal system of this embodiment (also referred to as "this system") is mainly composed of a terminal device 1 on which a dedicated program (also referred to as "electronic seal software") that realizes the system is installed. This terminal device 1 corresponds to an example of the "electronic seal system" of the present invention. Note that the terminal device 1 on which the electronic seal software is installed is also referred to as the "electronic seal device."

[0026] The terminal device 1 is configured by a general personal computer (PC), and one or more terminal devices can be provided. The terminal device 1 can be connected to a network such as an in-house LAN or the Internet. In this embodiment, the terminal device 1 is a desktop personal computer, but it may also be a notebook personal computer or a mobile terminal such as a smartphone or tablet.

[0027] In addition to electronic seal software, various application software such as document creation software such as a word processor and document viewing software that enables viewing of electronic documents is installed on the terminal device 1. Various application software (programs) including the electronic seal software are provided, for example, from recording media such as CD-ROMs or servers on the Internet (network).

[0028] [Terminal device configuration] Next, a description will be given of the configuration of the terminal device 1. As shown in Fig. 2, the terminal device 1 includes a control unit 10, a storage unit 11, a display unit 12, an operation input unit 13, a communication unit 14, a camera 15, and the like.

[0029] The control unit 10 executes various processes for controlling the operation of the terminal device 1, and is configured by a CPU (Central Processing Unit) and the like.

[0030] The storage unit 11 stores the OS (Operating System) that runs the terminal device 1, various application software (programs) that can be executed by the terminal device 1, and various other data necessary for the operation of the terminal device 1, and is composed of a non-volatile memory such as a ROM (Read Only Memory), a volatile memory such as a RAM (Random Access Memory), etc. The programs stored in the storage unit 11 include the aforementioned electronic seal software, document creation software, document viewing software, and other programs.

[0031] The display unit 12 displays various images, screens, electronic documents, etc., and is configured, for example, by a color liquid crystal display, etc. The display unit 12 is also called a "display screen."

[0032] The operation input unit 13 is configured with a keyboard, a mouse, etc. that are operated to perform various inputs by a user of the terminal device 1. Signals (operation signals, instruction signals) based on inputs by the operation input unit 13 are input to the control unit 10.

[0033] In addition, if the terminal device 1 is a mobile terminal such as a smartphone and the display unit of the mobile terminal includes a liquid crystal display with a touch panel function, various inputs can be made by touch operations (e.g., tapping) on ​​buttons, icons, etc. displayed on the display unit (liquid crystal display).

[0034] The communication unit 14 performs data communication with other devices via a network such as the Internet, for example, performing wireless communication in accordance with the IEEE802.11 standard. Examples of other devices include other terminal devices on which electronic seal software is installed, and server devices that provide application software such as electronic seal software.

[0035] Camera 15 becomes available when the camera function is activated under the control processing of control unit 10, and captures a subject such as the face of a user based on an operation (instruction) by the user using terminal device 1. This camera 15 can be, for example, an external web camera or a camera built into a liquid crystal display that constitutes display unit 12.

[0036] [Stamping process] Next, the seal processing (S100) executed by the control unit 10 of the terminal device 1 in which the electronic seal software is installed will be described with reference to the flowchart shown in Fig. 3. In this specification, "S" ("S" in the flowchart) such as S100 means a step.

[0037] The seal stamping process (S100) is executed (started) by the control unit 10 upon the activation of the electronic seal stamp software. In this embodiment, when the electronic seal stamp software is installed on the terminal device 1 on which document creation software, document viewing software, or the like is installed, the electronic seal stamp software is incorporated as an add-in into the existing document creation software, document viewing software, or the like. Therefore, for example, as shown in FIG. 5(A), when a user wants to affix a seal to a document (electronic document) to be viewed using document viewing software while the document is displayed on the display unit 12 (display screen), the user can activate the electronic seal stamp software by specifying (selecting) the appropriate seal stamp field (e.g., the "Draft" field) on the document and inputting an instruction to activate the electronic seal stamp software (to start the seal stamping process) (e.g., clicking the "seal icon") Note that various inputs, such as selections and instructions, on the display screen are performed by the operation input unit 13.

[0038] As shown in Fig. 3, in the stamping process (S100), first, the camera 15 is activated and a photographed screen is displayed on the display unit 12 (S101). An example of the photographed screen (photographed screen 20) is shown in Fig. 6(A). Note that the photographed screen 20, as well as a confirmation screen 30 and an editing screen (not shown), which will be described later, can all be displayed superimposed on a document display (see Fig. 5(A)) by word processing software or document viewing software.

[0039] 6(A), the photographing screen 20 includes a photographing target display area 20a (photographing target display section) in which the photographing target (subject) is displayed through the lens section (not shown) of the camera 15, and a photographing icon 20b (photographing instruction input section) for inputting instructions to perform photographing (also called "photographing instructions"). The photographing target (subject) in this system is the face (expression) of the user (sealer) of the terminal device 1.

[0040] In the photographing target display area 20a, a frame line 20c is displayed that is set according to the outer shape (imprint shape) of the imprint image that can be stamped by this system. In this embodiment, the shape of the frame line 20c (imprint shape) is a circle (round). By displaying the frame line 20c, it is possible to easily visualize the imprint image (imprint shape) to be stamped.

[0041] The shape of the frame line 20c (imprint shape) is not limited to a circle (circle) and may be a shape other than a circle, such as a square. The shape of the frame line 20c (imprint shape) may be arbitrarily selected by the user from among a plurality of predetermined shapes. In this case, the selection input may be performed by, for example, providing a button (selection button) for selecting the frame shape on the shooting screen and clicking the button.

[0042] The user (the person who will affix the seal) looks at their own face displayed in the photographing subject display area 20a (within the frame 20c) through the lens (not shown) of the camera 15, and moves and adjusts the position of their face so that it fits neatly within the frame 20c. At this time, they also create an expression that matches their feelings when stamping, such as a smile or a stern look. Then, when they are ready to take the photograph, they click the photograph icon 20b while maintaining the position and expression of their face. This inputs a photographing instruction.

[0043] 6A, the subject is displayed so as to be visible throughout the entire subject display area 20a, that is, both inside and outside the frame line 20c, but it may be displayed only inside the frame line 20c. Also, the visibility of the outside of the frame line 20c may be reduced more than the inside by, for example, displaying the outside of the frame line 20c in a blurred or semi-transparent manner, so that the inside of the frame line 20c is clearly displayed.

[0044] Returning to FIG. 3, following S101, the control unit 10 determines whether or not a shooting instruction has been input (S103). If a shooting instruction has not been input (NO in S103), the control unit 10 waits until a shooting instruction is input. On the other hand, if a shooting instruction has been input (YES in S103), the camera 15 takes a photo (S105). In this embodiment, the content displayed in the entire shooting target display area 20a is the subject of shooting. Note that the configuration may also be such that the content displayed within at least the frame line 20c of the shooting target display area 20a is the subject of shooting. The camera 15 and the processing of S105 correspond to an example of the "shooting means" of the present invention.

[0045] The image captured in S105 (also referred to as the "captured image") is stored (saved) in a predetermined storage area (captured image storage area) of the storage unit 11. The captured image (photographic data) is stored (saved) as an image (raster data) in a raster format such as JPEG.

[0046] Next, in S107, based on the image (photographed image) photographed in S105, a seal imprint process is performed to generate a seal imprint image (also called a "face seal imprint image") including the face (expression) of the user (sealer) (S107). That is, the photographed image is subjected to the seal imprint process to generate a face seal imprint image of the user (sealer) (S107). The process of S107 corresponds to an example of the "generation means" of the present invention. Details of the seal imprint process (S107) will be described later.

[0047] Next, in S109, the facial seal imprint image generated in S107 is displayed on the display unit 12 (S109). Here, a confirmation screen for allowing the user (sealer) to confirm the generated facial seal imprint image is displayed on the display unit 12, and the facial seal imprint image is displayed on the confirmation screen. An example of the confirmation screen (confirmation screen 30) is shown in FIG. 6(B).

[0048] As shown in the figure, the confirmation screen 30 is composed of a seal imprint image display area 30a (seal imprint image display section) in which the generated facial seal imprint image KG is displayed, a retake icon 30b (retake instruction input section) for inputting an instruction to retake the image (also called a "retake instruction"), an edit icon 30c (edit instruction input section) for inputting an instruction to edit the generated facial seal imprint image (also called an "edit instruction"), and a stamp icon 30d (stamp instruction input section) for inputting an instruction to stamp the generated facial seal imprint image (also called a "stamp instruction").

[0049] The outer periphery (seal imprint frame) of the facial seal imprint image KG displayed in the seal imprint image display area 30a corresponds to the frame line 20c displayed in the photographing subject display area 20a of the photographing screen 20 described above (see FIGS. 6(A) and (B)). Note that the frame image constituting the seal imprint frame of the facial seal imprint image KG may be displayed as the frame line 20c in the photographing subject display area 20a. In this way, it is possible to make it easier to imagine the seal imprint image at the photographing stage.

[0050] The user (sealer) checks the face seal imprint image KG displayed in the seal imprint image display area 30a, and if he / she wants to retake the image, he / she clicks the retake icon 30b. This inputs an instruction to retake the image (YES in S110), and the process returns to S101. On the other hand, if an instruction to retake the image is not input (NO in S110), the process proceeds to S111.

[0051] The user (sealer) checks the facial seal imprint image KG displayed in the seal imprint image display area 30a, and if the user wants to modify the facial seal imprint image KG, he / she clicks the edit icon 30c. This inputs an edit instruction (YES in S111). On the other hand, if an edit instruction is not input (NO in S111), the process proceeds to S117.

[0052] When an editing instruction is input (YES in S111), the control unit 10 displays an editing screen (not shown) on the display unit 12 to enable editing of the facial seal impression image KG based on instructions from the user (sealer) (S113).

[0053] The editing screen is configured to include, for example, a seal imprint image display area similar to the confirmation screen 30 (see FIG. 6(B)), a control bar (change instruction input section) for changing the color density (brightness) of the facial seal imprint image KG and the thickness of the lines constituting the facial seal imprint image KG, and an editing completion icon (editing completion instruction input section) for inputting an instruction to complete editing (also called an "editing completion instruction"). The facial seal imprint image KG displayed in the seal imprint image display area 30a of the confirmation screen 30 is displayed in the seal imprint image display area of ​​the editing screen.

[0054] The user (sealer) can edit the facial seal imprint image KG on the editing screen (seal imprint image display area) by operating the operation input unit 13 to make adjustments (input change instructions) using a control bar (not shown) on the editing screen. In other words, the control unit 10 is configured to edit the facial seal imprint image KG based on input using the control bar on the editing screen. The processing related to editing the facial seal imprint image KG performed by the control unit 10, including the processing of S113, corresponds to an example of the "editing means" of the present invention.

[0055] In this embodiment, the color shading, line thickness, etc. of the facial seal imprint image KG are considered editable content (editing items), but the content is arbitrary. For example, in addition to standard content such as color shading (brightness), it is also possible to change (edit) the facial expression included in the facial seal imprint image displayed on the editing screen (seal imprint image display area) (expression change means). Specifically, for example, by inputting using a predetermined expression change tool (toolbar, control bar, etc.) included in the editing screen, it is possible to change the facial expression of the face included in the facial seal imprint image, such as changing the corners of the mouth or the angle or degree of opening of the eyes. This makes it possible to correct the facial expression included in the facial seal imprint image without having to retake the image.

[0056] When the user (sealer) has finished editing the face seal imprint image KG, he / she clicks on an edit completion icon (not shown) on the edit screen. This inputs an edit completion instruction (YES in S115). On the other hand, if an edit completion instruction is not input after the edit screen is displayed (NO in S115), the process waits until an edit completion instruction is input.

[0057] When an instruction to complete editing is input (YES in S115), the control unit 10 displays the confirmation screen 30 (see FIG. 6(B)) again on the display unit 12 (S116). At this time, the edited (post-edit) facial seal imprint image KG is displayed in the seal imprint image display area 30a of the confirmation screen 30.

[0058] Then, the control unit 10 determines whether or not a seal instruction has been input (S117) while the confirmation screen 30 is displayed on the display unit 12 (S109 or S116).

[0059] When the user (sealer) wishes to affix a seal using the face seal imprint image KG displayed in the seal imprint image display area 30a, he / she clicks on the seal icon 30d (see FIG. 6(B)) on the confirmation screen 30. This inputs an instruction to affix a seal (YES in S117). On the other hand, if an instruction to affix a seal is not input (NO in S117), the process returns to S110.

[0060] When a seal instruction is input (YES in S117), the control unit 10 pastes the facial seal imprint image KG into the specified seal field (seal location) of the electronic document (see FIG. 5(A)) being displayed on the display unit 12 (S119), and ends this seal processing. As the facial seal imprint image KG is pasted (sealed), the confirmation screen 30 is erased. An example of the seal field to which the facial seal imprint image KG has been pasted is shown in FIG. 5(B).

[0061] As shown in the figure, the facial seal imprint image KG (see FIG. 6(B)) displayed in the seal imprint image display area 30a of the confirmation screen 30 is pasted (stamped) in the stamp field according to the size of the stamp field. The process of S119 in which the facial seal imprint image is pasted (stamped) in the stamp field in this way corresponds to an example of the "sealing means" of the present invention.

[0062] [Imprint processing] Next, the imprinting process (S107) performed in the sealing process (S100) will be described with reference to the flowchart shown in FIG.

[0063] As shown in Fig. 4, in the imprinting process (S107), first, the captured image captured in the above-mentioned S105 is acquired (S201). As mentioned above, the captured image is stored (saved) in the captured image storage area as a raster format image, so in S201, the captured image is read from the captured image storage area. An example of the captured image (captured image SG) is shown in Fig. 7(A).

[0064] Next, in S203, the captured image acquired in S201 is converted into a binary image in vector format (S203). That is, the captured image is simplified into a black and white image. An example of the binary image after conversion (binary image NG) is shown in FIG. 7(B).

[0065] When an actual seal is pressed onto a piece of paper, the impression is produced when the ink or other coloring material attached to the seal surface is transferred to the paper, and its appearance is usually distinguished by two colors: the color of the paper surface (e.g., white) and the color of the coloring material (e.g., vermilion). In order to resemble the appearance of such an actual seal impression, the captured image in raster format (see Figure 7(A)) is converted into a binary image in vector format (see Figure 7(B)).

[0066] Next, in S205, the black parts of the binary image after conversion in S203, i.e., the black and white binary image, are changed to vermilion (S205). Specifically, the black parts (black portions) of the binary image NG shown in Fig. 7(B) are changed to vermilion. The reason for changing to vermilion is to express the color of an impression stamped using vermilion ink pad (vermilion ink pad).

[0067] In addition, when changing the black portion to another color, the changed color (i.e., the color of the seal impression) may be a color other than vermilion, such as red or blue. Also, the user (sealer) may be able to select the color of the seal impression. In this case, for example, "seal impression color" may be provided as an editable content (editing item) on the above-mentioned editing screen, and the user (sealer) may select a desired color from a plurality of predetermined colors such as vermilion, red, blue, green, etc., and change to the selected color. In other words, "color change" can be included in the editing of the facial seal impression image by the editing means. In this way, it is possible to increase the color variation of the facial seal impression image.

[0068] It is also possible to invert the white and black parts of the binary image and change the inverted black parts to another color (such as vermilion). In this way, it is possible to express the face seal impression image as a so-called reverse-engraved seal impression (a white seal impression).

[0069] Next, in S207, a masking process is performed to extract a portion to be displayed as a face seal imprint image (also referred to as a "seal imprint portion") from the binary image (also referred to as a "color-changed image") that has undergone color change in S205 (S207). Masking is image processing that displays (extracts) only a specific portion (range) of an image and hides the rest. For example, a clipping mask or layer mask method can be used as the masking process (masking function).

[0070] In this embodiment, a color-changed image in which the black parts of the binary image NG shown in Figure 7(B) are changed to vermilion is combined with a mask image (not shown) that represents the range (imprint part) and imprint frame (frame image) to be displayed (extracted) from the image (i.e., a mask process is applied to the color-changed image), thereby generating the facial imprint image KG shown in Figure 7(C).

[0071] In this embodiment, the shapes of the "range to be displayed (extracted)" and the "seal impression frame (frame image)" shown in the mask image are both "circular." Also, the color of the seal impression frame shown in the mask image is the same color as the color changed in S205 (vermilion in this embodiment). Note that the shape and color shown in the mask image can be changed as appropriate according to the specifications (seal impression shape, color, size, etc.) of the facial seal impression image KG to be generated.

[0072] In addition, the seal imprint frame (frame image) may not be displayed in the mask image, but may be prepared as a separate image from the mask image. In this case, the face seal imprint image KG shown in Fig. 7(C) can be obtained by combining the color-changed image that has been subjected to mask processing (a color-changed image in which the seal imprint portion is displayed and the other portions are not displayed) with the frame image that represents the seal imprint frame.

[0073] When the facial seal imprint image KG is generated in the above manner, the generated facial seal imprint image KG is displayed in the seal imprint image display area 30a of the confirmation screen 30 as shown in Fig. 6(B) (S109). Then, the facial seal imprint image KG displayed in the seal imprint image display area 30a can be pasted (sealed) on an electronic document or the like (see Fig. 5).

[0074] [Effects of the Example] According to the electronic seal system of this embodiment described above, the facial expression of the user (sealer) is included in the facial seal imprint image generated by performing the seal imprint process (S107) on the image captured by the camera 15 (processing of S105) with the user's (sealer) face as the subject. This makes it possible to express the feelings (enthusiasm, emotions, etc.) of the sealer in the seal imprint image. Then, by attaching (sealing) the facial seal imprint image to the subject to be sealed, such as an electronic document, a unique communication can be achieved in which the feelings of the sealer can be conveyed to the other party (e.g., the approver) through the facial expression included in the facial seal imprint image.

[0075] In particular, when users of terminal devices 1 on which the electronic seal software according to this embodiment is installed exchange electronic documents, etc., with their respective facial seal imprint images attached (stamped) via a network by e-mail, workflow, etc., it becomes possible to convey each other's thoughts through the facial expressions shown in each other's facial seal imprint images. This makes it possible to give the electronic seal system the function of a fresh and interesting new communication tool, which in turn makes it possible to compensate for the lack of communication that is a concern in remote work, etc.

[0076] In addition, in this embodiment, the seal imprint process (S107) performed on the captured image obtained by photographing the face of the user (sealer) includes a process (S203) of converting the captured image in raster format into a binary image in vector format. Therefore, it is possible to make the appearance of the facial seal imprint image generated through the seal imprint process resemble an actual seal imprint. This makes it possible to increase the reality of the facial seal imprint image as a seal imprint.

[0077] In this embodiment, the seal imprint process (S107) performed on the captured image obtained by photographing the face of the user (sealer) includes the process of converting into a binary image (S203) as described above, as well as the process of changing the black parts of the binary image to vermilion (S205). This makes it possible to make the appearance of the face seal imprint image more similar to the actual seal imprint.

[0078] In this embodiment, the seal imprint process (S107) performed on the captured image obtained by photographing the face of the user (sealer) includes a mask process (S207) that extracts the range (seal imprint portion) to be displayed as a face seal imprint image from the above-mentioned binary image (color-changed image). This makes it easy to handle any seal imprint shape.

[0079] In addition, in this embodiment, the facial seal imprint image generated through the seal imprinting process (S107) can be edited based on instructions from the user (sealer) (S111 to S115). Therefore, the user (sealer) can arbitrarily edit the facial seal imprint image before sealing. This makes it possible to correct or customize the facial seal imprint image.

[0080] In this embodiment, in the seal imprint process (S107), the range (seal imprint portion) to be displayed as a facial seal imprint image is extracted from the binary image (color-changed image) by masking process (S207), but the range (seal imprint portion) to be displayed as a facial seal imprint image from the photographed image acquired in S201 may be extracted by masking process. In other words, before converting the photographed image into a binary image, the seal imprint portion may be extracted from the photographed image by masking process, and then conversion to a binary image (S203) and color change of the black portion (S205) may be performed. This also makes it possible to generate the facial seal imprint image shown in Fig. 7(C).

[0081] In addition, in this embodiment, the process of changing the black parts of the binary image to vermilion (S205) is performed in the seal imprint process (S107), but the color change may not be performed. In other words, the process of S205 may not be included. In this case, the color of the facial seal imprint image (seal imprint color) will be black. It is also possible to configure the system so that the user (seal maker) can select whether or not to perform the process of S205, that is, whether or not to change the color of the black parts. In this way, it is possible to increase the degree of freedom in selecting the color of the facial seal imprint image (seal imprint color).

[0082] In addition, in this embodiment, the face (expression) of the user (sealer) included in the photographed image is made into a seal impression as it is, but a portrait image or an avatar image may be generated based on the face (expression) of the user (sealer) included in the photographed image, and the portrait image or avatar image may be made into a seal impression to generate a face seal impression image. In other words, the seal impression processing (S107) may include processing to generate a portrait image or an avatar image of the user (sealer) from the photographed image acquired in S201. In this way, it is possible to add a unique touch to the face seal impression image.

[0083] Next, a modified example of the embodiment described above will be explained. Note that the following explanation will focus on the differences from the embodiment, and explanation of the commonalities with the embodiment will be omitted.

[0084] [Variation 1] The first modification is provided with a function (so-called "recommendation function") to display (present) candidates for edited (edited) facial seal imprint images in advance when editing the facial seal imprint image generated through the seal imprint process (S107). This function is an example of the "presentation means" of the present invention.

[0085] In the first modification, the control unit 10 executes a sealing process (S100a) shown in Fig. 8 instead of the sealing process (S100) shown in Fig. 3. In this sealing process (S100a), if an editing instruction is input (YES in S111), an edited image (also referred to as an "edited image") according to a predetermined editing pattern is generated based on the face seal imprint image generated in S107 (S112), and the generated edited image is displayed on the display unit 12 together with the editing screen (S113).

[0086] An editing pattern defines specific editing content (editing manner) of image editing. For example, a plurality of editing patterns are prepared in advance, such as making colors darker or lighter, changing the type of color, or thickening or thinning lines for the original image. These editing patterns are stored and managed in the storage unit 11. The editing patterns can also include patterns of various facial expressions, such as a normal face, a smiling face, a sad face, and an angry face. In this case, it is also possible to provide gradually different patterns for each expression, such as the degree of laughter or the degree of sadness.

[0087] When an editing instruction is input (YES in S111), the control unit 10 generates an edited image (not shown) by editing the facial seal imprint image generated in S107 based on one or more of a plurality of predetermined editing patterns (S112). For example, an image with a darker color than the original facial seal imprint image, or an image in which the facial expression included in the original facial seal imprint image is changed to a smile, a big smile, a sad face, etc. may be generated. The number of edited images generated at this time may be one or more. Then, the generated edited image is displayed together with the editing screen (S113).

[0088] When an edited image is generated and displayed (presented), the edited image is displayed (presented) so that the user (sealer) can select it. At this time, if there are multiple edited images, they are displayed (presented) so that the user (sealer) can select the edited image he / she desires from the multiple edited images. Then, when the user (sealer) selects an edited image on the editing screen, the content of the selected edited image is reflected in the facial seal imprint image generated in S107 (the facial seal imprint image displayed in the seal imprint image display area of ​​the editing screen). In this way, it is possible to reduce the effort required for editing by the user (sealer).

[0089] According to the above-described first modification, it is possible to improve the convenience when the user (sealer) edits the generated face seal imprint image.

[0090] In addition, in the first modified example, an edited image is generated and presented based on the facial seal imprint image generated in S107, but if the facial expression included in the facial seal imprint image is made editable (changeable), an edited image according to an editing pattern including a facial expression pattern may be generated based on the photographed image taken in S105 and presented. This is because the photographed image also includes the facial expression of the user (the person who affixed the seal).

[0091] In this case, it is sufficient to configure the system so that an edited image generated based on a photographed image is displayed on the editing screen, and input (change instruction input) related to editing of the facial seal imprint image can be performed while comparing the edited image with the facial seal imprint image displayed in the seal imprint image display area of ​​the editing screen. This also makes it possible to improve the convenience of editing.

[0092] [Variation 2] In the modified example 2, the control unit 10 executes the sealing process (S100) by recognizing the facial expression of the photographed user (sealer) (the user's face included in the photographed image), generating a seal impression image based on the recognition result, and pasting (sealing) the generated seal impression image on the object to be sealed, such as an electronic document. Note that the modified example 2 can also be applied to the modified example 1.

[0093] The seal imprint image generated by the control unit 10 in Modification 2 includes characters such as the surname and given name of the user (sealer), and is generated separately from the facial seal imprint image according to the above-mentioned embodiment and Modification 1. Hereinafter, in order to distinguish it from the facial seal imprint image described above, the seal imprint image including characters such as the surname and given name according to Modification 2 will also be referred to as a "character seal imprint image."

[0094] In the second modification, at least the imprinting process (S107) of the stamping process (S100) shown in FIG. 3 is different from that of the embodiment.

[0095] Here, in Modification 2, it may or may not include the aforementioned facial seal imprint image. If the facial seal imprint image is included, the character seal imprint image will be pasted (sealed) on the seal target together with the aforementioned facial seal imprint image, and if the facial seal imprint image is not included, the character seal imprint image will be pasted (sealed) on the seal target. Also, if the facial seal imprint image is not included, the facial seal imprint image in S109 and S116 of the sealing process (S100) shown in Fig. 3 is replaced with the character seal imprint image. Note that if the facial seal imprint image is not included, the processes (S111 to S116) related to editing the seal imprint image may or may not be performed.

[0096] In the second modification, the control unit 10 executes the imprinting process (S107a) shown in Fig. 9 instead of the imprinting process (S107) shown in Fig. 4. In this imprinting process (S107a), first, a captured image is acquired (S301). The process of S301 is the same as S201 in the imprinting process (S107) of the embodiment.

[0097] Next, in S303, the facial expression of the user (the person who affixed the seal) contained in the captured image acquired in S301 is recognized (S303). Specifically, the facial expression is recognized based on the corners of the mouth and the angle of the eyes of the face contained in the captured image, and the expression is identified as, for example, a smile or a sad face. The control unit 10 that executes the process of S303 can be said to function as "facial expression recognition means" or "facial expression identification means." Note that facial expressions that can be recognized (identified) in S303 are not limited to a smile or a sad face.

[0098] Next, in S305, character data (also referred to as "surname data") representing the surname of the user (sealer) is acquired (S305). Here, for example, if user information (user information) as a user of the electronic seal system is managed in advance in the memory unit 11, etc., the surname data of the user (sealer) is acquired based on the user's surname included in the user information. Alternatively, when starting to use the electronic seal system or starting to execute the seal processing, the user (sealer) is asked to input their surname, and the surname data of the user (sealer) is acquired based on the surname that has been input. The control unit 10 that executes the processing of S305 can be said to function as a "character data acquisition means" or a "surname data acquisition means."

[0099] Next, in S307, a character seal imprint image is generated based on the facial expression included in the captured image recognized (specified) in S303, i.e., the facial expression of the user (sealer), and the family name data acquired in S305 (S307). Here, a character image is generated (fontified) in which the facial expression recognized in S303 is reflected in the family name data (character data), and the character image is synthesized with an image (frame image) of a seal imprint frame prepared in advance (stored in the memory unit 11) to generate a character seal imprint image. The control unit 10 that executes the process of S307 can be said to function as a "seal imprint image generating means" or "generating means."

[0100] An example of a character imprint image (character imprint image MG) generated in S307 is shown in Fig. 10. The character imprint image MG shown in the figure represents the surname "Tanaka," where (A) is a character imprint image MG1 when the facial expression recognized (identified) in S303 is a smiling face (laughing pattern), and (B) is a character imprint image MG2 when the facial expression recognized (identified) in S303 is a sad face (disappointing pattern).

[0101] According to the above-mentioned modified example 2, it is possible to express the feelings of the seal maker not only by the face seal impression image mentioned above but also by a character seal impression image, and to convey the seal maker's thoughts to the other party. Also, it is possible to affix a seal using a novel character seal impression image that could not be expressed with conventional electronic seal software (electronic seal system) that affixes the user's surname as a seal impression image. Therefore, modified example 2 also makes it possible to endow the electronic seal system with the function of a fresh and interesting new communication tool.

[0102] In addition, in the second modified example, when the face seal imprint image is stamped together with the character seal imprint image, for example, the character seal imprint image and the face seal imprint image can be stamped in different sizes, for example, by making the size of the character seal imprint image smaller than the size of the face seal imprint image and pasting it around the character seal imprint image (for example, at the bottom right), or by making the size of the character seal imprint image larger than the size of the face seal imprint image and pasting it around the character seal imprint image (for example, at the bottom right). In this way, it becomes possible to stamp in a well-balanced manner.

[0103] The facial expression recognized in S303 may also be reflected in the shape of the seal imprint frame (frame image). That is, in S307, a frame image that reflects the facial expression recognized in S303 may be generated, and a character seal imprint image including that frame image may be generated. In this way, it is possible to increase the variety of character seal imprint images that express the feelings of the seal maker.

[0104] In addition, in the second modification, the surname is the subject of the imprinting, but characters other than the surname, such as the given name or nickname, may also be the subject of the imprinting.

[0105] In addition, in the second modification, a character imprint image is generated based on the family name data acquired in S305. However, if, for example, conventional electronic seal software that stamps the user's family name as a seal imprint image is installed in the terminal device 1 and the seal imprint image is already managed in the storage unit 11, the characters included in the existing seal imprint image may be transformed based on the facial expression recognized in S303 to generate a character imprint image. In this way, it is possible to utilize the existing seal imprint image to add (upgrade) a function that expresses the feelings of the seal maker.

[0106] The electronic seal stamp system of the second modification described above can be specified as follows. A photographing means capable of photographing the face of the person who affixes the seal; facial expression recognition means capable of recognizing facial expressions included in the photographed image taken by the photographing means; a generating means for generating a seal impression image that reflects the facial expression recognized by the facial expression recognition means; and a stamping means for attaching the seal impression image to a stamping location of a stamping target displayed on a predetermined display screen.

[0107] In the above embodiment and modified example, the control unit 10 of the terminal device 1 in which the electronic seal stamp software is installed performs the sealing process (S100, S100a) and the imprinting process (S107, S107a). However, it is also possible to configure the control unit of a server device (for example, a web server) managed by a business that provides the service of the electronic seal stamp system to perform the above-mentioned sealing process (S100, S100a) and the imprinting process (S107, S107a).

[0108] Specifically, the system can be configured such that a terminal device used by a user (sealer) is connected to a server device via a network, and based on a seal request (seal instruction) from the terminal device, the server device performs a seal processing (S100, S100a) and a seal imprint processing (S107, S107a) to seal a face seal image or a character seal image on an electronic document or the like displayed on the display screen of the terminal device. This also makes it possible to achieve the same effects as the above-mentioned embodiments and modifications. It also makes it possible to improve the popularity of the system. [Explanation of symbols]

[0109] 1 terminal device, 10 control unit, 11 memory unit, 12 display unit, 13 operation input unit, 14 communication unit, 15 camera, 20 shooting screen, 20a shooting target display area, 20b shooting icon, 20c frame line, 30 confirmation screen, 30a seal imprint image display area, 30b retake icon, 30c editing icon, 30d seal icon, KG face seal imprint image, SG shooting image, NG binary image, MG (MG1, MG2) character seal imprint image.

Claims

1. A photographing means capable of photographing the face of the person who affixes the seal; a generating means for performing a predetermined imprinting process based on the photographed image taken by the photographing means to generate a face imprint image showing the face of the person who has affixed the seal; a seal means for attaching the face seal image to a seal location of a seal target displayed on a predetermined display screen; the captured image is a raster image, The imprinting process includes converting the captured image into a binary image in vector format. An electronic seal system characterized by:

2. The imprinting process includes a process of changing the black part of the binary image to another color.

2. The electronic seal system according to claim 1.

3. The imprinting process includes a masking process for extracting an imprint portion from the captured image or the binary image.

3. The electronic seal system according to claim 1 or 2.

4. an editing means for editing the face seal image generated by the generating means based on an external instruction; 4. The electronic seal system according to claim 1, wherein the electronic seal system is a digital signature system.

5. When the facial seal imprint image is edited by the editing means, a presentation means is provided for generating and presenting an edited image based on the photographed image or the facial seal imprint image in accordance with a predetermined editing pattern.

5. The electronic seal system according to claim 4.

6. A program for causing a computer to function as each means of the electronic seal system according to any one of claims 1 to 5.

Images