Information processing system, information processing method, and program

Abstract

To provide an information processing system, an information processing method and a program, allowing efficient and highly accurate confirmation of time being a recognition result of character recognition.SOLUTION: The information processing system includes an image acquisition unit, a character recognition unit, and a time display unit. The image acquisition unit acquires an object image of an object on which a time is displayed. The character recognition unit recognizes the time based on the acquired object image. The time display portion is configured to display a recognition result time that is a result of recognition by the character recognition portion, in a display mode associated with the recognition result time.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing method, and a program that can be applied to checking character recognition results, etc. [Background technology]

[0002] Patent Document 1 discloses a character recognition correction system that enables an operator to accurately and efficiently make corrections to the character recognition results obtained by an OCR (Optical Character Recognition / Reader) on image data such as handwritten forms.

[0003] In the character recognition correction system described in Patent Document 1, the character recognition results and image data (original image) are displayed on the operator's terminal so that they can be observed in comparison. If the operator finds an unsatisfactory part in the character recognition results, he or she can use the search function provided in the character recognition correction system to search for the correct information to replace that part. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2004-220181 Summary of the Invention [Problem to be solved by the invention]

[0005] Character recognition using OCR as described in Patent Document 1 can also be performed on times stamped on time cards, etc., and there is a demand for technology that can efficiently and accurately confirm the recognized time.

[0006] In view of the above circumstances, an object of the present invention is to provide an information processing system, an information processing method, and a program that enable the time, which is the recognition result of character recognition, to be confirmed efficiently and with high accuracy. [Means for solving the problem]

[0007] In order to achieve the above object, an information processing system according to an embodiment of the present invention includes an image acquisition unit, a character recognition unit, and a time display unit. The image acquisition unit acquires an object image of an object on which a time is displayed. The character recognition unit recognizes the time based on the acquired object image. The time display unit displays a recognition result time, which is a recognition result by the character recognition unit, in a display mode associated with the recognition result time.

[0008] The display mode may include at least one of a display color of the recognition result time, a size of the recognition result time, a display position of the recognition result time, a font of the recognition result time, a decoration of the characters of the recognition result time, a display color of a display field in which the recognition result time is displayed, and a pattern displayed in the display field.

[0009] The display manner associated with the recognition result time may include a fraction-related display manner associated with the minute of the recognition result time.

[0010] The fraction-related display manner may include at least one of displaying a bar graph having a length corresponding to the fraction, displaying a segment of a pie chart having a size corresponding to the fraction, and displaying a line segment extending in a direction corresponding to the fraction.

[0011] The fraction-related display mode may include at least one of filling in an area of ​​a size corresponding to the fraction in a display field in which the recognition result time is displayed, and displaying one or more line segments extending in a direction corresponding to the fraction as a pattern displayed in the display field.

[0012] The information processing system may further include a cutout image generation unit that generates a cutout image cut out from the object image for each of the recognized times. In this case, the time display unit may display the generated cutout image so as to be comparable with the recognition result time corresponding to the cutout image.

[0013] The time display unit may display the cut-out image in a corresponding display mode that corresponds to the display mode for displaying the recognition result time corresponding to the cut-out image.

[0014] The corresponding display manner may include at least one of a display color of the cut-out image, a size of the cut-out image, and a display position of the cut-out image.

[0015] The corresponding display manner may include displaying the cut-out image at a display position relative to the recognition result time that corresponds to the number of minutes of the recognition result time.

[0016] The corresponding display manner may include displaying a superimposed image generated to correspond to the minutes of the recognition result time so as to be superimposed on the extracted image.

[0017] The display mode associated with the recognition result time may include a fraction-related display mode associated with a minute of the recognition result time, in which case the superimposed image may correspond to an image displayed in the fraction-related display mode when the recognition result time is displayed.

[0018] The information processing system may further include a storage unit that sets association information that associates a time period with a display color. In this case, the time display unit may determine a display color for the recognition result time based on the association information.

[0019] The object may be a time card for each employee. In this case, the storage unit may store the related information in which a display color with relatively high conspicuity is associated with a time period in which a relatively high degree of attention is required to check the recognition result time, and a display color with relatively low conspicuity is associated with a time period in which a relatively low degree of attention is required.

[0020] The time display unit may set a reference time for displaying the recognition result time, and may determine a display color for the recognition result time based on the reference time.

[0021] The time display unit may determine a display color for the recognition result time based on a difference between the recognition result time and the reference time.

[0022] The object may be a time card for each employee. In this case, the time display unit may determine a display color for the recognition result time such that the greater the difference between the recognition result time and the reference time, the greater the visibility.

[0023] The time display unit may set the reference time for each employee.

[0024] An information processing method according to an aspect of the present invention is an information processing method executed by a computer system, and includes acquiring an object image of an object on which a time is displayed. The time is recognized based on the acquired object image. The recognition result time, which is the recognition result of the time, is displayed in a display mode associated with the recognition result time.

[0025] A program according to an aspect of the present invention causes a computer system to execute the information processing method. [Effects of the Invention]

[0026] As described above, according to the present invention, it is possible to efficiently and accurately check the time, which is the recognition result of character recognition. [Brief explanation of the drawings]

[0027] [Figure 1] 1 is a diagram illustrating an example of a basic configuration of a character recognition system according to an embodiment of the present invention. [Figure 2] 10 is a flowchart illustrating an example of a basic operation of the server device. [Figure 3] FIG. 2 is a block diagram illustrating an example of a functional configuration of a server device. [Figure 4] 10 is a flowchart illustrating an example of a character recognition operation performed by the server device. [Figure 5] FIG. 10 is a schematic diagram showing an example of a photographed image of a time card. [Figure 6] FIG. 10 is a schematic diagram illustrating an example of recognition result information. [Figure 7] FIG. 10 is a schematic diagram illustrating an example of a recognition result image. [Figure 8] FIG. 10 is a schematic diagram showing an example of a time comparison display. [Figure 9] 10A and 10B are schematic diagrams showing an example of display of a recognition result time in a time-related display mode and display of a clipped image in a corresponding display mode. [Figure 10] 10A and 10B are diagrams for explaining specific examples of time-related display modes. [Figure 11] FIG. 10 is a schematic diagram showing an example of a fraction-related display mode. [Figure 12] 10A to 10C are schematic diagrams showing variations of time-related display modes. [Figure 13] 10A and 10B are schematic diagrams showing examples of corresponding display modes for displaying cut-out images. [Figure 14] 10A and 10B are schematic diagrams showing examples of corresponding display modes for displaying cut-out images. [Figure 15] FIG. 2 is a block diagram showing a more detailed configuration example of the character recognition system. [Figure 16] FIG. 2 is a block diagram showing an example of the hardware configuration of a computer that can be used as an operator terminal and a server device. DETAILED DESCRIPTION OF THE INVENTION

[0028] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0029] [Basic configuration example of a character recognition system] Fig. 1 is a schematic diagram showing an example of the basic configuration of a character recognition system according to one embodiment of the present invention. The character recognition system 1 shown in Fig. 1 is one embodiment of an information processing system according to the present invention.

[0030] The character recognition system 1 includes an operator terminal 2 and a server device 3.

[0031] The operator terminal 2 is a terminal used by the operator 4, and has a photographing function, an image display function, and an input reception function. The photographing function can be realized by installing a photographing device such as a digital camera. The display function can be realized by installing a display device using, for example, an LCD or EL. The input reception function can be realized by installing an operation device such as a keyboard, a pointing device, or a touch panel.

[0032] 1, a smartphone is used as the operator terminal 2. A digital camera (not shown) of the smartphone realizes a photographing function, and a touch panel 5 of the smartphone realizes an image display function and an input reception function.

[0033] 1, the operator terminal 2 and the server device 3 are communicably connected to each other via a network 6. The network 6 is constructed, for example, by the Internet or a wide area communication network. Alternatively, any WAN (Wide Area Network) or LAN (Local Area Network) may be used, and the protocol for constructing the network 6 is not limited.

[0034] The operator terminal 2 and the server device 3 each have hardware necessary for a computer, such as a processor such as a CPU, GPU, or DSP, memory such as a ROM or RAM, and a storage device such as an HDD (see FIG. 16). The processor loads the program according to the present invention stored in the storage unit or memory into the RAM and executes it, thereby executing the information processing method (character recognition method / character recognition result presentation method) according to the present invention.

[0035] As the operator terminal 2 having the photographing function, the image display function, and the input reception function, it is also possible to use other computers such as a tablet terminal or a notebook PC.

[0036] It is also possible to connect a digital camera and a notebook PC so that they can communicate with each other via wire or wirelessly, and use both devices as a set as the operator terminal 2. In other words, it is also possible to use a set of multiple devices that each have a photographing function, an image display function, and an input reception function.

[0037] The server device 3 may be any computer such as various PCs or tablet terminals.

[0038] In this embodiment, the server device 3 provides a character recognition application service (hereinafter referred to as a character recognition application) that includes presenting the character recognition results to the operator 4.

[0039] The character recognition application is provided as, for example, a web application, and the operator 4 can use the character recognition application on a web page displayed by a web browser using the operator terminal 2.

[0040] Of course, the present invention is not limited to this, and the character recognition application may be provided as a native application. In this case, the character recognition application program is downloaded to the operator terminal 2 of the operator 4.

[0041] It is also possible to install the functions of the server device 3 described below in the operator terminal 2, and to configure the character recognition system 1 using the operator terminal 2 alone. For example, it is also possible to operate a character recognition application downloaded to the operator terminal 2 as a stand-alone application. In addition, various other modes for using the character recognition application may be adopted.

[0042] In this embodiment, in the character recognition application, the server device 3 executes various processes such as character recognition, presentation of the character recognition results, acceptance of input of corrections to the character recognition results from the operator 4, correction of the character recognition results, etc. The server device 3 also executes generation and output of various GUIs (Graphical User Interfaces), such as a GUI for checking the character recognition results and a GUI for correcting the character recognition results.

[0043] 1, the server device 3 is illustrated as a computer consisting of a single housing. However, the configuration is not limited to this, and the character recognition system 1 may be realized by multiple server devices with various functions working together.

[0044] For example, the operator 4 starts a character recognition application using the operator terminal 2. Then, the operator 4 transmits a captured image of an object on which characters to be recognized are displayed to the server device 3 via the network 6.

[0045] In particular, the present invention can be widely applied to objects that display a time such as "8:30."

[0046] 1, in this embodiment, an object on which the time to be recognized is displayed will be described using, as an example, a time card 7 for each employee on which the arrival time, departure time, etc. are printed (punched). Note that "an object on which the time is displayed" means a state in which the time is written on the object by any method, such as printing, inscription, or handwriting, and the time is displayed.

[0047] For example, the operator 4 inputs an instruction to execute a character recognition function (character reading function) in the character recognition application. For example, the operator 4 selects a button or the like displayed on the touch panel 5 of the operator terminal 2 for executing character recognition.

[0048] The operator terminal 2 is switched to a photographing mode, and the operator 4 photographs the time card 7 using the operator terminal 2. The photographed image of the time card 7 is sent to the server device 3, and the server device 3 performs character recognition on the characters including the punched time.

[0049] The result of the character recognition performed by the server device 3 is transmitted to the operator terminal 2. For example, a GUI including the character recognition result is generated, transmitted to the operator terminal 2, and displayed on the touch panel 5. The operator 4 can check the character recognition result and input corrections, etc.

[0050] It is also possible to use a scanned image obtained by an image scanner, etc., as an image for which character recognition is performed. For example, a scanned image of the time card 7 can be generated by an image scanner and sent from the operator terminal 2 to the server device 3, where character recognition of the time stamped, etc. can be performed.

[0051] The photographed image of the time card 7 photographed by the operator terminal 2 and the scanned image of the time card 7 generated by the image scanner are embodiments of the object image according to the present invention.

[0052] In this embodiment, a time card 7 is taken as an example of an object on which the time according to the present invention is displayed. However, the scope of application of the present invention is not limited to the time card 7, and the present invention can be applied to any object on which the time to be recognized is displayed.

[0053] In this embodiment, various information for configuring the character recognition system 1 is stored in the storage unit of the server device 3 (see FIG. 16). For example, a photographed image of an object on which the time is displayed, character recognition results, format information for generating various GUIs, etc. are stored. The storage unit of the server device 3 also stores recognition result information (see FIG. 6) and related information 28 (see FIG. 10), which will be described later. Any other information related to character recognition may be stored.

[0054] 1, the server device 3 is configured on the network 6. However, the configuration is not limited to this, and the server device 3 may be configured near the operator terminal 2, and the server device 3 and the operator terminal 2 may be connected to each other so as to be able to communicate with each other via wire or wirelessly.

[0055] 1, in this embodiment, the processor of the server device 3 executes the program according to the present invention to configure the following functional blocks: an image acquisition unit 8, a character recognition unit 9, and a time display unit 10. Of course, dedicated hardware such as an IC (integrated circuit) may be used to realize each functional block.

[0056] The program is installed in the server device 3 via, for example, various recording media. Alternatively, the program may be installed via the Internet or the like. There are no limitations on the type of recording medium on which the program is recorded, and any computer-readable recording medium may be used. For example, any computer-readable non-transitory storage medium may be used.

[0057] 2 is a flowchart showing an example of the basic operation of the server device 3. First, the image acquisition unit 8 acquires a photographed image of an object on which a time is displayed (step 101). In this embodiment, a photographed image of a time card 7 on which the arrival and departure times of work and the like are printed is acquired. The acquired photographed image of the time card 7 is stored in the memory unit of the server device 3.

[0058] The character recognition unit 9 performs character recognition using OCR based on the acquired photographed image, and recognizes the time displayed on the time card 7 (step 102).

[0059] In character recognition by OCR, for example, a character area displaying the time is detected from the captured image, and the time included in the detected character area is recognized character by character. In addition, the specific algorithm for performing character recognition by OCR is not limited, and any algorithm may be used.

[0060] Deep learning can be used for character recognition. LSTM (Long Short Term Memory), a type of deep learning like Tesseract, or the YOLO (You Only Look Once) model for object detection can be used. For example, by using AI (artificial intelligence) that performs deep learning, character recognition can be performed with high accuracy. OCR using AI technology is also called AI-OCR.

[0061] The time display unit 10 displays the time (hereinafter referred to as recognition result time) that is the recognition result by the character recognition unit 9 in a display format associated with the recognition result time (step 103).

[0062] [Display mode associated with recognition result time] The display mode associated with the recognition result time according to the present invention will be described below: The inventors have conducted extensive research into a technology that enables efficient and highly accurate confirmation of the recognition result time, which is the recognition result.

[0063] A number indicating a time, such as "8:30," is linguistic information, but when people work, they use a lot of non-verbal information. For example, when cooking, it is considered appropriate to fry fried chicken in oil at 170°C for five minutes, but few people actually measure these verbalized values ​​of "170°C" and "5 minutes" while cooking. In reality, people use non-verbal information such as sound, the appearance of bubbles, color, smell, and the temperature felt by the skin to determine the optimal temperature and frying time.

[0064] This non-verbal information is pattern processed in the right brain. On the other hand, time, which is linguistic information, is logically processed in the left brain. It is said that the right brain's pattern processing is good at intuitive judgment. For this reason, when it comes to clocking in and out, by presenting non-verbal information in addition to the punched time (numbers), it becomes possible to intuitively detect errors using pattern processing as well as logical processing.

[0065] In this way, the present inventor has discovered that presenting not only linguistic information but also non-linguistic information when presenting the recognition result time to the operator 4 is a new and unprecedented technical idea.

[0066] 2, the process of displaying the recognition result time in a display mode associated with the recognition result time executed by the time display unit 10 realizes presentation of non-verbal information to the operator 4. Hereinafter, the display mode associated with the recognition result time will be referred to as a time-related display mode.

[0067] For example, the time-related display mode includes the display color of the recognition result time, the size of the recognition result time, the display position of the recognition result time, the font of the recognition result time, the decoration of the characters of the recognition result time, the display color of the display field in which the recognition result time is displayed, and the pattern displayed in the display field.

[0068] That is, the display of the recognition result time listed below is included in the display in the time-related display mode, and it is possible to realize the presentation of non-verbal information as well. Display in the color associated with the recognition result time Display in size associated with recognition result time Display at the display position associated with the recognition result time Displaying the recognition result in a font associated with the time Displaying characters associated with the recognition result time in decorative format Display using a display column of the display color associated with the recognition result time Display using a display box showing the pattern associated with the recognition result time

[0069] Of course, the displays according to the time-related display modes of the present invention are not limited to the displays listed above. Any display mode that can present non-verbal information that is pattern-processed by the right brain along with the display of a number indicating the time, such as "8:30," can be included in the time-related display modes of the present invention.

[0070] Hereinafter, detailed embodiments of the character recognition system 1 according to the present invention and specific examples of time-related display modes will be described.

[0071] Fig. 3 is a block diagram showing an example of the functional configuration of a server device 3 according to one embodiment of the present invention. In this embodiment, as shown in Fig. 3, a processor of the server device 3 executes a program according to the present technology to configure the following functional blocks: an image acquisition unit 8, a character recognition unit 9, a recognition result image generation unit 12, a cut-out image generation unit 13, a display control unit 14, and an input acceptance unit 15. Of course, dedicated hardware such as an IC (integrated circuit) may be used to realize each functional block.

[0072] In the example shown in FIG. 3, the recognition result image generating unit 12 and the display control unit 14 function as the time display unit 10 shown in FIG.

[0073] 4 is a flowchart showing an example of the character recognition operation by the server device 3 shown in FIG. 3. The image acquisition unit 8 acquires a photographed image of the time card 7 (step 201). The acquired photographed image of the time card 7 is stored in the storage unit of the server device 3.

[0074] 5 is a schematic diagram showing an example of a captured image 17 of a time card 7. As shown in FIG. 5, the time card 7 has a printing area 18 for times such as clock-in and clock-out. In this embodiment, the following printing columns are configured from the left side of the printing area 18. The printing columns can also be called punch columns.

[0075] "Date"...Numbers 1 to 15 are pre-printed. Numbers 16 to 31 are pre-printed on the back. "Regular arrival time": The regular arrival time will be printed. "Leave on time": The time of leaving within working hours will be printed. "Left within working hours": The return time from leaving work during working hours will be printed. "Leave work on time": The normal time for leaving work is clocked in.

[0076] In the example shown in Figure 5, the normal arrival time and normal departure time are printed for each of the "Regular Arrival Time" and "Regular Leave Time" columns for the 1st, 3rd, 5th to 7th, 10th, and 12th to 15th days.

[0077] The character recognition unit 9 performs character recognition using OCR based on the acquired photographed image 17, and recognizes the characters displayed on the time card 7 (step 202). In this embodiment, in the printing area 18 shown in FIG. 5, the pre-printed characters for "date," the characters 1 to 15, the characters for "start on time," the characters for "within time," the characters for "leave" below "within time," the character for "start" below "within time," and the character for "leave on time" are recognized. The character recognition unit 9 also recognizes the time to be printed in each printing column of the printing area 18.

[0078] 6 is a schematic diagram showing an example of recognition result information. In this embodiment, the character recognition unit 9 performs character recognition to generate recognition result information 20 shown in FIG.

[0079] As shown in FIG. 6, the recognition result information 20 includes the following information: "Date": Information indicating the date. In this embodiment, any one of 1 to 31 is stored. For example, in the case of the normal work start time of "8:55" on "1st" in FIG. 5, "1" is stored in "Date."

[0080] "Print column": The column in which the recognized time is printed. In this embodiment, one of "Leave on time," "Leave on time," "Leave within time," or "Leave on time" is stored. For example, index numbers 1 to 4 may be assigned in order to these print columns, and the index numbers may be stored. For example, if the normal arrival time on "Day 1" is "8:55," then "Leave on time" or the index number "1" for "Leave on time" is stored.

[0081] "Recognition result (time)": Recognition result time. If the normal start time for "Day 1" is "8:55", the recognition result of "8:55" will be stored.

[0082] "Position (area)": The position on the captured image 17 at the recognized time is stored. For example, the X and Y coordinates of the pixel in the upper left corner of the recognized time and the number of pixels for the width and height of the character area are stored. For example, in the case of a normal work start time of "8:55" on "Day 1," (X, Y) = (102, 175), width = 16, and height = 12 are stored. This information means that the characters "8:55" were recognized from an image area of ​​16 pixels wide and 12 pixels high, starting from the pixel whose X and Y coordinates on the captured image 17 are (102, 175).

[0083] "Cut-out image (link)": Stores a link to a cut-out image stored in the storage unit of the server device 3. Cut-out images will be described later.

[0084] The specific data format of the recognition result information 20 is not limited, and any data format may be used.

[0085] The recognition result image generation unit 12 generates a recognition result image including the recognition result by the character recognition unit 9 (step 203). The recognition result image includes any image including the recognition result by the character recognition unit 9. Of course, the recognition result image also includes text data of the recognition result. The recognition result image also includes any image that allows the operator 4 to understand what kind of recognition result has been obtained.

[0086] 7 is a schematic diagram showing an example of a recognition result image 22. As shown in FIG. 7, the recognition result image 22 is constructed by inputting the recognition result time by the character recognition unit 9 into a time card image 23 having a configuration similar to the print area 18 of the time card 7.

[0087] 7 is configured with a "date" (1 to 15) and four display columns 24, columns 1 to 4. Each of columns 1 to 4 corresponds to the printing columns of "Clock in on time," "Clock out on time," "Clock in on time," and "Clock out on time" on the time card 7 (photographed image 17).

[0088] That is, column 1 = "Clock in on time", column 2 = "Clock out on time", column 3 = "Clock out on time", column 4 = "Clock out on time". Of course, the names of the corresponding printing columns may be displayed in the positions of columns 1 to 4 on the time card image 23. Format information for the time card image 23 may be stored in advance in the storage unit of the server device 3.

[0089] The recognition result image generating unit 12 reads out the recognition result information 20 shown in FIG. 6 from the storage unit of the server device 3. Then, based on the read out recognition result information 20, the "recognition result (time)" is input into each display column 24 (columns 1 to 4) of the time card image 23. This generates the recognition result image 22. Each display column 24 (columns 1 to 4) corresponds to an embodiment of the display column according to the present invention in which the recognition result time is displayed.

[0090] In the character recognition system 1 according to this embodiment, it is possible to display the recognition result time in a time-related display mode on the recognition result image 22 shown in Fig. 7. That is, the recognition result image generating unit 12 can generate the recognition result image 22 so that the recognition result time is displayed in a time-related display mode. A specific example of display in the time-related display mode will be described later.

[0091] The cut-out image generating unit 13 generates cut-out images cut out for each recognized time from the photographed image 17 (step 204). That is, the cut-out image generating unit 13 cuts out each time printed in the print area 18 from the photographed image 17 and generates the cut-out image.

[0092] The cut-out image generation unit 13 reads out the photographed image 17 and the recognition result information 20 shown in Fig. 6 from the storage unit of the server device 3. Then, based on the recognition result information 20, the cut-out image generation unit 13 cuts out an image area defined by the "position (area)" of the "recognition result (time)" and generates it as a cut-out image.

[0093] The generated cut-out image is stored in the storage unit of the server device 3. Then, a link to the cut-out image is stored in "cut-out image (link)" of the recognition result information 20 shown in FIG.

[0094] 3 controls the display of various images on the touch panel 5 of the operator terminal 2 as a function of the character recognition application. For example, the display control unit 14 controls the display of text, icons, etc. for using the character recognition application, the display of character recognition results, etc. In this embodiment, the display control unit 14 also controls the display of various GUIs, such as a GUI for checking the character recognition results and a GUI for correcting the character recognition results.

[0095] As shown in Fig. 4, in this embodiment, the display control unit 14 displays the recognition result image 22 exemplified in Fig. 7. In addition, in this embodiment, the display control unit 14 can also execute a time comparison display (step 205).

[0096] 8 is a schematic diagram showing an example of a time comparison display. The time comparison display is a process of displaying the recognition result time and the cut-out image 25 generated in step 204 so that they can be compared. That is, in this embodiment, as shown in FIG. 8, the display control unit 14 can display the cut-out image 25 at the generated time so that it can be compared with the recognition result time corresponding to the cut-out image 25.

[0097] The display control unit 14 reads out the recognition result information 20 shown in Fig. 6 from the storage unit of the server device 3, and acquires the clipped image 25 from the "clipped image (link)". Then, the display control unit 14 displays the clipped image 25 so that it can be compared with the "recognition result (time)".

[0098] In the example shown in Fig. 8, a cut-out image 25 corresponding to the "recognition result (time)" is displayed to the right of the display field 24 where the "recognition result (time)" is input. In the example shown in Fig. 8, the cut-out image 25 corresponding to the recognition result time input in the display field 24 for dates 1 to 5 is displayed so as to be comparable. Of course, it is also possible to display the cut-out image 25 corresponding to the recognition result time input in the display field 24 for dates 6 and onwards so as to be comparable.

[0099] Any method may be adopted as a method for displaying the recognition result time input in the display field 24 and the corresponding cut-out image 25 so that they can be compared. For example, a method may be used in which the cut-out image 25 is displayed in a balloon or speech bubble slightly to the upper right of the display field 24.

[0100] 7 is selected, the cut-out image 25 corresponding to the selected display field 24 is displayed, and when the selection of the display field 24 is cancelled, the cut-out image 25 is hidden. In other words, the operator 4 may be able to switch between displaying and hiding the cut-out image 25.

[0101] 8, it is possible to generate the recognition result image 22 so that the recognition result time is displayed in a time-related display mode. It is also possible to display the cut-out image 25 in a display mode (hereinafter referred to as a corresponding display mode) corresponding to the time-related display mode for displaying the recognition result time corresponding to the cut-out image 25. Specific examples of the corresponding display mode will also be described later.

[0102] 9 is a schematic diagram showing an example of displaying the recognition result time in a time-related display mode and displaying the extracted image 25 in a correspondence display mode. Specific examples of the time-related display mode and the correspondence display mode will be described, including the example shown in FIG.

[0103] [Examples of time-related display modes] In describing a specific example of a time-related display mode, in this embodiment, it is assumed that an employee who uses the time card 7 is a regular employee who starts work at 9:00 and finishes work at 17:00.

[0104] For example, in the recognition result image 22 shown in Figures 7 to 9, the recognition result time of "8:50" is entered in column 1 corresponding to "Leave on time" on date = 1, which means that the person arrived at work a little before the start of work. The recognition result time of "17:01" is entered in column 4 corresponding to "Leave on time" on the same date = 1, which means that the person left work immediately after finishing work. Note that column 2 corresponding to "Leave on time" and column 3 corresponding to "Leave on time" are not used.

[0105] 7 to 9, in the column 1 corresponding to "Leave on time," "3:50" is entered as the recognition result time in the display column 24 for date = 5. As can be seen from the clipped images 25 shown in FIGS. 8 and 9, this recognition result time "3:50" is the result of erroneous recognition of the actual time stamped as "8:50."

[0106] Furthermore, in column 4 corresponding to "Leave work on time" on the time card 7, "17:01" is entered as the recognition result time in display column 24 for date = 5. As can be seen from the cropped images 25 shown in Figures 8 and 9, this recognition result time of "17:01" is the result of misrecognizing the actual time stamped, "17:31."

[0107] Of course, the application of the present invention is not limited to the working style of employees, and the present invention can be applied to employees with various working styles.

[0108] 10 is a diagram for explaining a specific example of a time-related display mode. The time-related display mode includes displaying the recognition result time 27 shown in FIG. 10 in a display color associated with the recognition result time. For example, as shown in FIG. 10, association information 28 that associates a time period with a display color is set. The association information 28 is stored in the storage unit of the server device 3.

[0109] In the example shown in FIG. 10, the following related information 28 is set: 0:01~6:59 Brown 7:00~8:29 Blue 8:30~8:59 Light blue 9:00~9:59 Orange 17:00~17:59 Green 18:00~18:59 Dark green

[0110] Displaying the recognition result time 27 shown in Fig. 10 in a display color based on the related information 28 is included in the time-related display mode, and it is possible to realize presentation that also includes non-verbal information. In the example shown in Fig. 10, the recognition result time 27 is "8:50", so it is displayed in light blue.

[0111] In the time comparison display of the recognition result image 22 shown in Fig. 8, it is assumed that a display mode is adopted in which each recognition result time is displayed in a display color based on the related information 28. That is, it is assumed that each recognition result time shown in black in the drawing is displayed in a display color based on the related information 28 shown in Fig. 10.

[0112] Furthermore, it is easy for operator 4 to recognize the colors of employees who work regular hours, starting at 9:00 and finishing at 17:00, as follows: "Brown" - Time periods when clock-in is not normally done "Blue": Relatively early hours compared to the start of work "Light blue": Time before work starts "Orange": Time period that corresponds to lateness after the start of work "Green": Time after the end of work hours "Dark green": Relatively late hours compared to the end of work hours Of course, it is not difficult to accurately remember the related information 28 shown in FIG.

[0113] When operator 4 sequentially checks the arrival times in column 1 corresponding to "Regular Arrival" while checking the time comparison display shown in Fig. 8, "8:50" for day 1 is displayed in light blue, and the cut-out image 25 to the right also has the same time "8:50". This means that the recognition has been correct. For the following day, day 2, "8:55" is displayed in light blue, and the cut-out image 25 to the right also has the same time "8:55", so it is clear that the recognition has been correct.

[0114] For example, based on the non-verbal information that the recognition result time is displayed in light blue for the first and second days, operator 4 can intuitively understand that the person will arrive at work at an appropriate time before the start of work.

[0115] On the 3rd, the recognition result time is "8:00" and is displayed in blue. For example, operator 4 can intuitively understand that the employee arrived at work relatively early based on the non-verbal information that the time is displayed in blue. Furthermore, as shown in Figure 8, for employees who usually come to work during the light blue time slot, it can be intuitively understood that the employee arrived at work earlier than usual. Furthermore, since "8:00" matches the extracted image 25, it has been recognized correctly and there is no problem.

[0116] On the 4th, the recognition result time is "9:05" and is displayed in orange. Operator 4 can intuitively understand that the person arrived at work at a time that corresponds to being late, based on the non-verbal information of the orange color. If the person is late due to a recognition error, this is a problem, so Operator 4's attention is drawn and he or she carefully checks the recognition result time. As a result, since the cut-out image 25 also matches and is "9:05," it is clear that the recognition was correct and the person is indeed late.

[0117] On the 5th, the recognition result time is "3:50" and is displayed in brown. Operator 4 can intuitively understand, based on the non-verbal information that brown is a time period during which clock-in is not normally made, meaning that there is a high possibility that a recognition error has occurred. Operator 4 carefully checks the recognition result time and realizes that it does not match the time in extracted image 25, "8:50," and that a recognition error has occurred.

[0118] As in the case of the misrecognition of "3:50" instead of "8:50," the numbers 0, 3, and 8 have similar shapes and can easily be confused during character recognition using OCR. In this character recognition system 1, by also presenting non-verbal information such as color information, it is possible to prevent misrecognition from being overlooked, and the recognized time can be confirmed efficiently and with high accuracy.

[0119] Returning to FIG. 10, the time-related display mode includes displaying the display field 24 in which the recognition result time is displayed in a display color associated with the recognition result time.

[0120] 10 in a display color based on the related information 28 is included in the time-related display mode, and it is possible to realize presentation of non-verbal information as well. Displaying the display field 24 in a display color based on the related information 28 also includes displaying, for example, the frame 24a of the display field 24 and the internal area 24b of the display field 24 (display area where the recognition result time is displayed) in a display color based on the related information 28.

[0121] 10, the recognition result time 27 is "8:50", so the frame 24a and display area 24b of the display box 24 are displayed in light blue. When the display area 24b is displayed in light blue, the recognition result time may be displayed in black or the like. In other words, the time-related display mode in which the recognition result time is displayed in a display color based on the related information 28 does not have to be adopted.

[0122] For example, in the time comparison display of the recognition result image 22 shown in Fig. 8, each display field 24 is displayed in a display color based on the related information 28. This produces the same effect as when the recognition result time is displayed in a display color based on the related information 28. Also, in many cases, displaying the display field 24 in color is more noticeable, and in some cases this is more advantageous for intuitive judgment than coloring the recognition result time.

[0123] (Fraction related display mode) 11 is a schematic diagram showing an example of a fraction-related display mode. The time-related display mode includes a fraction-related display mode associated with the minutes of the recognition result time. For example, the fraction-related display mode includes the following displays: Display of a bar graph whose length corresponds to the number of minutes of the recognition result time Display of pie chart segments with size corresponding to the minutes of recognition result time Display of a line segment extending in the direction corresponding to the recognition result time fraction Any other display mode that allows the user to intuitively grasp fractions (magnitude of values ​​from 00 to 60) can be adopted as the fraction-related display mode.

[0124] 11, a bar graph 30 having a length corresponding to the fraction is displayed in the display area 24b of the display field 24. The bar graph 30 is configured to start from the left side of the frame 24a of the display field 24 and extend toward the right side. The length of the bar graph 30 (the size in the horizontal direction) corresponds to the fraction.

[0125] For example, it is possible to set the length of the bar graph 30 to 1 / 60 of the horizontal size of the display field 24 multiplied by a fraction. This is not limiting, and for example, it is also possible to divide 00 minutes to 59 minutes into multiple time periods in units of a predetermined number of minutes. Then, it is possible to set the length of the bar graph 30 for each of the divided time periods of minutes. For example, the following settings are possible.

[0126] 00~05 minutes Length of bar graph 30 = 0 6 minutes to 11 minutes Length of bar graph 30 = Left and right size of display column 24 x 1 / 9 12~17 minutes Length of bar graph 30 = Left and right size of display column 24 x 2 / 9 18~23 minutes Length of bar graph 30 = size of left and right of display column 24 x 3 / 9 24~29 minutes Length of bar graph 30 = Left and right size of display field 24 x 4 / 9 30~35 minutes Length of bar graph 30 = Left and right size of display column 24 x 5 / 9 36~41 minutes Length of bar graph 30 = size of left and right of display column 24 x 6 / 9 42~47 minutes Length of bar graph 30 = Left and right size of display column 24 x 7 / 9 48~53 minutes Length of bar graph 30 = Left and right size of display column 24 x 8 / 9 54~59 minutes Length of bar graph 30 = size of left and right of display column 24 In this way, it is possible to set the length of the bar graph 30 in stages corresponding to the fraction. Of course, there are no particular limitations on the specific method for setting the length of the bar graph 30 in stages.

[0127] 11, the bar graph 30 is displayed with a length corresponding to the number of minutes of the recognition result time "17:30", which is equal to 50. It is also effective to set the display color of the bar graph 30 based on the related information 28 shown in FIG. 10. In this case, the display of the bar graph 30 exemplified in FIG. 10 can also be included in a display mode in which the display field 24 is displayed in a display color based on the related information 28.

[0128] The operator 4 can intuitively grasp the number of minutes in the recognition result time based on non-verbal information, namely the length of the bar graph 30. Of course, there are cases where the number of minutes is not accurate and the operator can only grasp a rough number, but this is still sufficiently effective.

[0129] (Supported display modes) 11, a cut-out image 25 is displayed so as to be comparable with a recognition result time 27. As described above, the cut-out image 25 can be displayed in a corresponding display mode corresponding to a time-related display mode for displaying the recognition result time corresponding to the cut-out image 25.

[0130] For example, the corresponding display mode includes the display color of the cut-out image 25, the size of the cut-out image 25, the display position of the cut-out image 25, and the like.

[0131] That is, the display of the clipped images 25 listed below is included in the display in the corresponding display mode, and it is possible to realize the presentation of non-verbal information as well. Displayed in the color corresponding to the recognition result time Displayed in a size corresponding to the recognition result time. Display at the display position corresponding to the recognition result time Of course, the display of the extracted image 25 is not limited to this, and any display mode corresponding to the time-related display mode may be included in the corresponding display mode.

[0132] 11, a frame 25a surrounding the cut-out image 25 is displayed in the same display color as the display color of the recognition result time. For example, assume that the recognition result time "17:30" shown in FIG. 11 and the display field 24 are displayed in green in accordance with the related information 28 shown in FIG. 10. In this case, the frame 25a of the cut-out image 25 is also displayed in green based on the related information 28.

[0133] 11, a bar graph 32 corresponding to the minutes of the recognition result time is displayed so as to be superimposed on the cut-out image 25. In the example shown in Fig. 11, the bar graph 32 has the same color and length as the bar graph 30 displayed in the display field 24, and is displayed with the left side of the cut-out image 25 as its starting point.

[0134] The length of the bar graph 32 can also be determined by multiplying the left and right sizes of the cut-out image 25 by the same ratio as the length of the bar graph 30 relative to the left and right sizes of the display field 24 .

[0135] In this way, the corresponding display mode includes displaying a superimposed image (bar graph 32) generated to correspond to the minutes of the recognition result time 27 so as to be superimposed on the cut-out image 25. For example, by generating a superimposed image (bar graph 32) to correspond to the image (bar graph 30) displayed in the fraction-related display mode when displaying the recognition result time, it becomes possible to easily find a recognition error.

[0136] In the time comparison display of the recognition result image 22 shown in Fig. 9, first, in a time-related display mode, the frame of each display field 24 is displayed in a display color based on the related information 28 shown in Fig. 10. Also, a fraction-related display mode is adopted, and a bar graph 30 corresponding to a fraction is displayed in each display field 24. The display color of the bar graph 30 is a display color based on the related information 28 shown in Fig. 10 (i.e., the same display color as the frame of the display field 24).

[0137] Furthermore, a corresponding display mode is adopted for displaying the cutout image 25, and the frame of the cutout image 25 is displayed in a display color based on the related information 28 shown in Fig. 10 (i.e., the same display color as the frame of the display field 24). Also, a bar graph 32 generated to correspond to the minutes of the recognition result time is displayed so as to be superimposed on the cutout image 25. The display color of the bar graph 32 is also based on the related information 28 shown in Fig. 10 (i.e., the same display color as the frame of the display field 24 and the bar graph 30).

[0138] 9, operator 4 sequentially checks the clock-out times in column 4 corresponding to "Leave work on time," and finds that the clock-out time for one day is "17:01" (framed in green), and that the extracted image 25 to the right also has the same time, "17:01" (framed in green). In other words, it can be seen that the recognition has been correct.

[0139] For the following day, the 2nd, "17:15" (framed in green) matches the cropped image 25 (framed in green) to the right, and it can be seen that it has been correctly recognized. A green bar graph is displayed in display field 24 of column 4 for the 2nd. In this example, the number of minutes in "17:15" = "15" is 25% of 1 hour (= 60 minutes), and correspondingly, bar graph 30 is displayed from the left side of display field 24 with a length that is 25% of the length of display field 24.

[0140] A bar graph 32 is also displayed superimposed on the adjacent cut-out image 25 to the right. The length of the bar graph 32 is 25% of the horizontal size of the cut-out image 25. The operator 4 can intuitively grasp the fraction based on non-verbal information, namely the lengths of the bar graphs 30 and 32 in the display field 24 and the cut-out image 25.

[0141] It can be seen that the punch times were also recognized correctly for the 3rd and 4th days. In addition, in the display field 24 of field 4 on the 3rd day, a bar graph 30 is displayed with a length that is 50% of the length of the display field 24, corresponding to the number of minutes = "30" of "17:30". A bar graph 32 with a length corresponding to the number of minutes = "30" is also displayed superimposed on the cut-out image 25 to the right.

[0142] In the display field of column 4 for the 4th day, a bar graph 30 is displayed with a length that is 98% of the length of the display field 24, corresponding to the minutes of "17:59" = "59". A bar graph 32 with a length corresponding to the minutes = "59" is also displayed superimposed on the cut-out image 25 to the right. This allows the operator 4 to intuitively grasp the minutes of each recognition result time.

[0143] The recognition result time for the 5th day, which is the time to leave work, is "17:01", and the frame of the display column 24 is displayed in green, just like the display columns for the 1st to 4th days. Also, the number of minutes is "01", and no bar graph is displayed in the display column 24 (or a very short bar graph 30 is displayed).

[0144] The time in cutout image 25 is "17:35", which means that a recognition error has occurred, but the display color corresponding to the recognition result time, "17:01", is green, and the frame of cutout image 25 is displayed in green. On the other hand, bar graph 32 superimposed on cutout image 25 is not displayed (or a very short bar graph 32 is displayed).

[0145] If the character recognition had been performed correctly, the recognition result time would have been "17:35", and a bar graph 32 with a length approximately half the left-right size of the cut-out image 25 would have been displayed superimposed on the cut-out image 25.

[0146] The operator 4 can feel a strong sense of incongruity based on the non-verbal information that the bar graph 32 that should be displayed is not displayed in the extracted image 25. Then, the operator 4 can carefully check the recognition result time and understand that a recognition error has occurred.

[0147] In this way, by appropriately adopting the time-related display mode, fraction-related display mode, and correspondence display mode, the character recognition system 1 can present non-verbal information when presenting the recognition result time. As a result, it is possible to prevent erroneous recognition from being overlooked, and it is possible to check the recognition result time efficiently and with high accuracy.

[0148] Regarding the recognition result of the arrival time for work on the 5th, "3:50," the recognition result time and display field 24 are displayed in brown, so it is intuitively understood that a time period that is not normally clocked in has been recognized, making it easy to discover misrecognitions.

[0149] Regarding the recognition result of the end of work time on the 5th, "17:01", the time in the cut-out image 25 does not correspond to the length of the bar graph 32, which makes it easy to discover the misrecognition.

[0150] Fig. 12 is a schematic diagram showing variations of the time-related display mode. Fig. 12A is a diagram showing the bar graph 30 described in Fig. 11. As shown in Fig. 12A, the bar graph 30 is displayed with a length corresponding to the number of minutes of the recognition result time.

[0151] 12A can be said to be a fraction-related display mode in which an area of ​​a size corresponding to a fraction is filled in the display field 24 where the recognition result time is displayed. The area in which the bar graph 30 is displayed corresponds to the filled-in area. Note that a display mode in which the bar graph 30 is displayed outside the display field 24 is also included in the fraction-related display mode.

[0152] 12B is a schematic diagram showing an example of a fraction-related display mode, in which a pie chart segment 34 is displayed in a size corresponding to the minutes of the recognition result time. The display of the pie chart segment 34 means displaying an area formed when a reference line extending upward from the rotation center point is rotated clockwise to a fraction corresponding line extending at an angle corresponding to the minutes of the recognition result time.

[0153] 12B, the center 24c of the display field 24 is set as the rotation center point, and a reference line 35 is set extending upward to a position corresponding to the 00 minute (12 o'clock) position on an analog clock. A fraction correspondence line 36 is also set along the extension direction of the minute hand on the analog clock that indicates the minutes of the recognition result time. Then, the area formed when the reference line 35 is rotated clockwise to the fraction correspondence line 36 is displayed as a segment 34 of the pie chart.

[0154] The display of the pie chart segment 34 corresponds to the display of the area formed when the minute hand of an analog clock is rotated clockwise from the 00 minute position to the minute of the recognition result time. Note that when the minute is "00", only the reference line 35 may be displayed as the pie chart segment 34, or nothing may be displayed.

[0155] The operator 4 can intuitively grasp the minutes of the recognition result time based on non-verbal information, namely the size of the segments 34 of the pie chart.

[0156] Regarding the setting of the fraction correspondence lines 36, the fraction correspondence lines 36 may be set to correspond to each of the minutes from 00 to 59 on an analog clock. However, this is not limiting, and for example, the minutes from 00 to 59 may be divided into a plurality of time periods in units of a predetermined number of minutes. Then, the fraction correspondence lines 36 may be set for the time periods of the divided minutes. For example, the following settings are possible.

[0157] 00~05 minutes The fraction line 36 extends towards the 00 minute position on an analog clock. 6 to 11 minutes: The fraction line 36 extends toward the 6 minute position on the analog clock. 12-17 minutes The fraction line 36 extends towards the 12-minute position on an analog clock. 18-23 minutes The fraction line 36 extends to the 18-minute position on the analog clock. 24-29 minutes The fraction line 36 extends towards the 24 minute position on an analog clock. 30-35 minutes The fraction line 36 extends towards the 30-minute position on an analog clock. 36-41 minutes The fraction line 36 extends towards the 36 minute position on an analog clock. 42-47 minutes The fraction line 36 extends to the 42 minute position on the analog clock. 48-53 minutes The fraction line 36 extends to the 48-minute position on the analog clock. 54-59 minutes The fraction line 36 extends to the 54 minute position on the analog clock. In this way, it is possible to set the extension direction of the fraction correspondence line 36 in stages corresponding to the fractions. Of course, the specific method for setting the extension direction of the fraction correspondence line 36 in stages is not limited.

[0158] It is also effective to set the display color of the pie chart segments 34 based on the related information 28 shown in Fig. 10. The display of the pie chart segments 34 shown in Fig. 12B can be said to be a display in which an area of ​​a size corresponding to a fraction is filled in the display field 24 in which the recognition result time is displayed. The area in which the pie chart segments 34 are displayed corresponds to the filled-in area. The display mode in which the pie chart segments 34 are displayed outside the display field 24 is also included in the fraction-related display mode.

[0159] 12C is a schematic diagram showing an example of a display of a line segment extending in a direction corresponding to the minutes of the recognition result time, which is one of the fraction-related display modes. As the line segment extending in a direction corresponding to the minutes of the recognition result time, for example, a line segment extending in the direction of the minute hand of an analog clock that indicates the minutes of the recognition result time (which can also be said to be a line segment at the same angle as the minute hand) can be used.

[0160] 12C, a line segment 38 is displayed extending in the direction of the minute hand indicating the minutes of the recognition result time from the center 24c of the display field 24. The line segment 38 corresponds to the fraction correspondence line 36 shown in FIG. 12B.

[0161] In setting the line segments 38, similar to the fraction corresponding lines 36, the line segments 38 may be set to correspond to each of the minutes from 00 to 59 on an analog clock. However, this is not limiting, and for example, the period from 00 to 59 may be divided into a plurality of time periods in units of a predetermined number of minutes. Then, the line segments 38 may be set for the time periods of the divided minutes. In other words, the extension direction of the line segments 38 may be set in stages corresponding to the minutes.

[0162] It is also effective to set the display color of the line segment 38 based on the related information 28 shown in Fig. 10. The operator 4 can intuitively grasp the number of minutes of the recognition result time based on non-verbal information, namely the extension direction of the line segment 38.

[0163] 12D and 12E are schematic diagrams showing an example of a display using the display field 24 in which a pattern associated with the recognition result time is displayed. In Fig. 12D and 12E, one or more line segments 39 extending in a direction corresponding to the minutes of the recognition result time are displayed as the pattern displayed in the display field 24.

[0164] 12D and 12E, the one or more line segments extending in a direction corresponding to the minutes of the recognition result time can be a line segment 39 extending in the same direction as the minute hand of an analog clock that indicates the minutes of the recognition result time. That is, it is possible to use a line segment 39 extending in the same direction as the fraction corresponding line 36 shown in FIG. 12B or the line segment 38 shown in FIG. 12C.

[0165] 12D, multiple line segments 39 are displayed aligned in a direction perpendicular to the direction in which the line segments 39 extend across the entire display field 24. Relatively thick line segments 39a are displayed for minutes from 00 to 29. Relatively thin line segments 39b are displayed for minutes from 30 to 59.

[0166] In the example shown in Fig. 12E, multiple line segments 39c of the same thickness are displayed. On the other hand, in the example shown in Fig. 12E, the area in which the multiple line segments 39c are displayed is defined according to the number of minutes of the recognition result time.

[0167] For example, when the minutes are 00, multiple line segments 39c are displayed in the upper half of the display field 24. When the minutes are 01 to 29, multiple line segments 39c are displayed in the right half of the display field 24. When the minutes are 30, multiple line segments 39c are displayed in the lower half of the display field 24. When the minutes are 31 to 59, multiple line segments 39c are displayed in the left half of the display field 24.

[0168] In setting the multiple line segments 39, similar to the line segment 38, multiple line segments 39 may be set to correspond to the minutes from 00 to 59 on an analog clock. However, this is not limiting, and for example, the time from 00 to 59 may be divided into multiple time periods in units of a predetermined number of minutes. Then, multiple line segments 39 may be set for the divided time periods of minutes. In other words, it is also possible to set the extension directions of the multiple line segments 39 in stages corresponding to the minutes.

[0169] It is also effective to set the display colors of the plurality of line segments 39 based on the related information 28 shown in Fig. 10. The operator 4 can intuitively grasp the minutes of the recognition result time based on non-verbal information, that is, the extending directions of the plurality of line segments 38 displayed as a pattern.

[0170] 11 employs a corresponding display mode, in which a bar graph 32 corresponding to a bar graph 30 displayed in a display field 24 is displayed as a superimposed image superimposed on the cut-out image 25. Similarly, superimposed images corresponding to the pie chart segment 34, line segment 38, and multiple line segments 39 shown in FIGS. 12B to 12E may be displayed superimposed on the cut-out image 25. This makes it possible to prevent erroneous recognition from being overlooked, and to check the recognition result time efficiently and with high accuracy.

[0171] 13 and 14 are schematic diagrams showing examples of corresponding display modes for displaying the cut-out image 25. As shown in Fig. 13 and 14, the corresponding display mode includes the display position of the cut-out image. That is, the corresponding display mode includes displaying the cut-out image 25 at a display position corresponding to the number of minutes of the recognition result time with respect to the recognition result time.

[0172] 13, cutout image 25 is displayed above display field 24, which displays the recognition result time. As illustrated in FIGS. 13A to 13C, cutout image 25 is displayed at a position where the left side of cutout image 25 is positioned at the same position as the left side of display field 24, which corresponds to the minute 00. As the minute approaches 59, the display position of cutout image 25 is moved to the right.

[0173] For example, the display position of cutout image 25 is set according to the number of minutes, with the position where the left side of cutout image 25 is equal to the position of the right side of display field 24 being set as the display position corresponding to 59 minutes. Of course, it is also possible to set the display position of cutout image 25 in stages according to the number of minutes.

[0174] In the example shown in Fig. 13D, cut-out image 25 is "17:31", and if correct character recognition had been performed, cut-out image 25 would have been displayed in the same position as in Fig. 13B. However, cut-out image 25 is displayed in a position shifted to the left from the position where it should have been displayed.

[0175] The operator 4 can feel a strong sense of incongruity based on the non-verbal information that the cut-out image 25 is not displayed in the display position where it should be displayed. Then, the operator 4 can carefully check the recognition result time and understand that a recognition error has occurred.

[0176] In the example shown in Fig. 14, cutout images 25 are displayed around a display field 24 that displays the recognition result time. As illustrated in Figs. 14A to 14C, cutout images 25 are displayed at positions corresponding to the minutes of an analog clock, with display field 24 at the center. That is, the position directly above display field 24 is the display position corresponding to the minute 00. From that position, as the minute approaches 59, the display position of cutout image 25 is moved clockwise, just like the minute hand of an analog clock rotates clockwise. Of course, it is also possible to set the display position of cutout image 25 in stages corresponding to the minutes.

[0177] In the example shown in Fig. 14D, cut-out image 25 is "17:31", and if correct character recognition had been performed, cut-out image 25 would have been displayed in a position similar to that shown in Fig. 14C. However, cut-out image 25 is displayed in a position at the top of display field 24, which is different from the display position where it should originally be displayed.

[0178] The operator 4 can feel a strong sense of incongruity based on the non-verbal information that the cut-out image 25 is not displayed in the display position where it should be displayed. Then, the operator 4 can carefully check the recognition result time and understand that a recognition error has occurred.

[0179] 13 and 14, bar graphs 30 and 32 corresponding to fractions are displayed in the display field 24 and the cut-out image 25. In this way, it is also effective to combine a plurality of display modes.

[0180] The time-related display mode, fraction-related display mode, and correspondence-related display mode according to the present invention are not limited to the time comparison display of the recognition result image 22 as exemplified in Fig. 8 and Fig. 9, but can be applied to various displays of recognition result times. For example, the present invention can also be applied to the display of only the recognition result image 22 without displaying the cropped image 25 as exemplified in Fig. 7.

[0181] For example, any display capable of presenting non-verbal information may be adopted, such as adjusting the display size of the recognition result time in accordance with the recognition result time, or adjusting the display position of the recognition result time in accordance with the recognition result time.

[0182] It is also effective to adjust the font of the recognition result time and adjust the character decoration of the recognition result time according to the recognition result time. Character decoration includes various expressions for emphasizing characters, such as bold, thin, italic, underline, etc. Character decoration can also be called character decoration.

[0183] For example, numbers that are prone to misrecognition, such as the numbers 0, 3, and 8, or the numbers 5 and 6, are highlighted using fonts, character decorations, and display colors (font colors). This allows the operator 4 to carefully check numbers that are prone to misrecognition, enabling the operator 4 to check the recognition result time efficiently and with high accuracy.

[0184] The pattern associated with the recognition result time displayed in the display field 24 is not limited to the line segment 39 as exemplified in FIGS. 12D and 12E, and other patterns may be used.

[0185] 11 and the like, various other display modes may be adopted for displaying the cut-out image 25. For example, the size of the cut-out image 25 may be adjusted so as to correspond to a time-related display mode for displaying the recognition result time corresponding to the cut-out image 25.

[0186] Regarding the association information 28 illustrated in FIG. 10, the method for associating the time period with the color is not limited, and any method may be adopted.

[0187] For example, a display color with relatively high conspicuousness may be associated with a time period in which a relatively high degree of caution is required when checking the recognition result time, and a display color with relatively low conspicuousness may be associated with a time period in which a relatively low degree of caution is required.

[0188] Note that eye-catching refers to the degree to which a color attracts people's attention. For example, warm colors such as red, pink, orange, yellow, and brown are highly eye-catching. On the other hand, cool colors such as blue, green, purple, white, black, and gray are less eye-catching.

[0189] For example, in the related information 28 illustrated in FIG. 10, the time period when clocking out is not normally done (0:01-6:59) and the time period when being late (9:00-9:59) are associated with the relatively eye-catching colors "brown" and "orange," as they are time periods when a person needs to be relatively careful when checking the recognition result time.

[0190] The relatively early time period relative to the start of work (7:00-8:29), the time period before the start of work (8:30-8:59), the time period after the end of work (17:00-17:59), and the relatively late time period relative to the end of work (18:00-18:59) are time periods in which it is relatively less necessary to pay attention to checking the recognition result time, and are therefore associated with the relatively low conspicuous colors "blue," "light blue," "green," and "dark green."

[0191] This allows the operator 4 to focus on checking the time period when attention is required to check the recognition result time, and makes it possible to prevent overlooking erroneous recognition. As a result, it becomes possible to check the recognition result time efficiently and with high accuracy.

[0192] It is also possible to set a reference time for displaying the recognition result time for each employee who uses the time card 7, and determine the display color of the recognition result time based on the reference time. For example, it is also possible to determine the display color of the recognition result time based on the difference between the recognition result time and the reference time. A specific example is a method of determining the display color of the recognition result time so that the greater the difference between the recognition result time and the reference time, the more eye-catching the color becomes.

[0193] For example, an employee's past arrival times are obtained from the employee's attendance information. Then, the average of the past arrival times is set as the reference time. The display color of the recognition result time in the display field 24 where the arrival time on the time card 7 is punched is determined so that the greater the difference between the recognition result time and the reference time, the more eye-catching the recognition result time becomes.

[0194] As a result, times close to the employee's past arrival times are displayed in a less conspicuous color, and when a recognized time is different from a past arrival time, it is displayed in a more conspicuous color. As a result, the operator 4 can easily identify arrival times that are recognized as different from past arrival times, and can carefully check whether the recognized time is correct. This makes it possible to prevent erroneous recognition from being overlooked, and to check the recognized time efficiently and with high accuracy.

[0195] For example, when the related information 28 shown in Fig. 10 is set, a certain employee is an extremely early riser who usually arrives at work around 7:00. In this case, for that employee, arriving at work at 6:55 and arriving at 7:05 are both considered normal arrival times.

[0196] On the other hand, for Operator 4, the recognition result time that indicates the start time of work as "6:55" is displayed in "brown." This may make Operator 4 aware that it may be a misrecognition, which may increase the effort required to check the recognition result time.

[0197] In such a case, the average of the employee's past arrival times (for example, "7:00") is set as the reference time, and the greater the difference from the reference time ("7:00"), the more eye-catching the display color is used. This means that even an arrival time of "6:55" will be displayed in a less eye-catching color, making it possible to prevent the employee from carefully checking the normal arrival time, and realizing efficient confirmation of the recognition result time.

[0198] For example, when calculating the average of past arrival times for the current month, it is possible to set the reference time by retrieving arrival times for this month from the storage unit. On the other hand, when arrival times from previous months are used, it is possible to retrieve past arrival times from employee attendance information by accessing a database such as an employment management system.

[0199] In addition, for employees with different work schedules for each month, for employees with different work schedules for the "first half" and "second half" of the year, or for employees with different work schedules for each "quarter," it is possible to obtain attendance information for the same month, the "first half" or the "second quarter" of the year ago, etc., and set the average of these as the reference time.

[0200] Of course, the determination of the display color based on the reference time is not limited to the display color of the arrival time, but can also be applied to the display color of the departure time and other times.Furthermore, it is not limited to the display color of the recognition result time, but can also be applied to the display color of the display column, the display color of the bar graph, etc.

[0201] Furthermore, other parameters that can reflect the trend of past arrival times, such as the median or mode, may be used instead of the average of past arrival times, etc. Also, in the related information 28 as shown in Fig. 10, the time boundary at which the display color is changed may be set for each employee.

[0202] 4, the input receiving unit 15 determines whether or not an input for correction to the recognition result time displayed on the recognition result image 22 has been received (step 206). If an input for correction to the recognition result time has not been received (No in step 206), the process ends.

[0203] If an input to correct the recognition result time is accepted (Yes in step 206), the recognition result time is corrected (step 207). For example, the display control unit 14 displays a GUI for correcting the recognition result time recognized by the character recognition unit 9. The input accepting unit 15 accepts the input of correction by the operator 4.

[0204] In this embodiment, the operator 4 corrects the start time on the 5th, "3:50", in column 1 corresponding to "Start on time" shown in Figures 7 to 9, to "8:50" displayed in the cut-out image 25. In addition, the operator 4 corrects the leave time on the 5th, "17:01", in column 4 corresponding to "Leave on time", to "17:31" displayed in the cut-out image 25.

[0205] The correction content is stored in the storage unit of the server device 3 (step 208). In this embodiment, the "recognition result (time)" of the recognition result information 20 shown in Fig. 6 is changed in response to the correction operation by the operator 4. As a result, the correction content of the recognition result is stored.

[0206] The GUI for correcting the recognition result and the operation method for correcting the recognition result by the operator 4 are not limited and may be set arbitrarily.

[0207] 15 is a block diagram showing a more detailed example of the configuration of character recognition system 1. Character recognition system 1 according to this embodiment has an image input unit 42, a timestamp reading unit 43, a timestamp image extraction unit 44, a reference time estimation unit 45, a display mode determination unit 46, and a display control unit 47. Character recognition system 1 also has an attendance information storage unit 48 and an image storage unit 49.

[0208] 15 functions as an embodiment of the image acquisition unit according to the present invention, and embossment reading unit 43 functions as an embodiment of the character recognition unit according to the present invention.

[0209] 15 functions as an embodiment of the cut-out image generating unit according to the present invention. Also, the reference time estimating unit 46, the display mode determining unit 46, and the display control unit 47 function as an embodiment of the time display unit according to the present invention.

[0210] The image input unit 42, the embossment reading unit 43, the embossment image extraction unit 44, the reference time estimation unit 45, and the display mode determination unit 46 are configured, for example, within the server device 3 shown in FIG.

[0211] 15 are configured, for example, in the storage unit of the server device 3. Of course, it is also possible to adopt a configuration in which the attendance information is stored in another database and is accessible by the server device 3.

[0212] The image input unit 42 inputs the photographed image 17 of the time card 7 into the system and outputs it to the stump reading unit 43. The stump reading unit 43 performs character recognition using OCR to read the printed time, date, display fields, etc. from the photographed image 17. Then, the recognition result information 20 shown in FIG. 6 is generated.

[0213] The generated recognition result information 20 and the captured image 17 of the time card 7 are output to the embossed image extraction unit 44. The embossed image extraction unit 44 cuts out the image area defined by the “position (area)” of the recognition result information 20 and generates it as a cut-out image 25.

[0214] The generated cropped image 25 is stored in the image storage unit 49 in association with the display field 24. The "position (area)" information of the recognition result information 20 can also be called print coordinates. The display field 24 can also be called a cell.

[0215] Next, the embossed image extraction unit 44 outputs the recognition result information 20 to the reference time estimation unit 45. Upon receiving the recognition result information 20, the reference time estimation unit 45 acquires the employee's past attendance information from the attendance information storage unit 48. Then, based on the attendance information, it calculates the reference times for each of the employee's arrival time and departure time.

[0216] In this embodiment, the median of the arrival time of a work day over the past year is calculated as the reference time for arrival time (hereinafter referred to as the reference arrival time), and the median of the departure time of a work day over the past year is calculated as the reference time for departure time (hereinafter referred to as the reference departure time).

[0217] As mentioned above, the reference time is not limited to the median, and the average or mode may be used. Furthermore, the reference time may be set for each day using multiple regression analysis or an AI model, taking into account the day of the week and month. The reference time may also be called the base time or base time.

[0218] After estimating the work arrival reference time and the work departure reference time, the reference time estimation unit 45 outputs this information and the recognition result information 20 to the display mode determination unit 46 .

[0219] The display mode determination unit 46 determines the display mode for displaying the recognition result time and the extracted image. The display mode can also be called the display format.

[0220] In this embodiment, the display mode determination unit 46 reads the time of each display column (cell) from the recognition result information 20, and determines the color of the frame and background of the display column (cell) based on the difference from the reference time (work arrival reference time and work departure reference time).

[0221] Next, the display mode determination unit 46 extracts the "minute" value of the recognition result time and generates a background pattern for the display column (cell) corresponding to the minute. Next, the display mode determination unit 46 determines the display position of the cropped image 25 using the center position of the display column (cell) and the minute value of the recognition result time. That is, the corresponding display mode shown in FIG. 14 is adopted.

[0222] The color of each display column (cell), background pattern, and display position of the cut-out image 25 determined by the display mode determination unit 46 are output to the display control unit 47. The display control unit 47 acquires the cut-out image 25 from the image storage unit 49 together with the received information, and displays each display column (cell).

[0223] As described above, in the character recognition system 1 according to this embodiment, the recognition result time recognized by the character recognition unit 9 is displayed in a display mode associated with the recognition result time. This makes it possible to efficiently and accurately check the time, which is the recognition result of character recognition.

[0224] In attendance management using time cards7, the task of aggregating the printed times at the end of the month and calculating payroll is a time-consuming and burdensome task for the person in charge. To solve this problem, attendance management systems have been proposed that electronically record arrival and departure times and automatically calculate payroll.

[0225] On the other hand, in workplaces with a small number of employees or where part-time employees are frequently replaced, time cards are still widely used because they are inexpensive and do not require the work of registering employees, which means a lot of work is required to tally the data at the end of the month.

[0226] In workplaces where time cards 7 are used, a system has been proposed that uses OCR to read the time printed on the time card 7 and reduce the burden on the person in charge of tasks such as tallying up the time at the end of the month.

[0227] However, when OCR is used to recognize characters, reading errors often occur due to lighting conditions, shadows, or dirt on the time card when photographing or scanning the time card. If the time is read incorrectly, the work hours will not be calculated correctly, which can lead to incorrect payroll calculations, which can be a major problem. For this reason, even if time cards are read using OCR, manual checking is still required.

[0228] When checking the results of character recognition using OCR, it is not easy for humans to find errors in a string of numbers. For example, the "3" and "8" look similar in shape, as in "17:13" and "17:18," and are easily overlooked. Also, in a company where the regular working time is "17:15," leaving work at "17:13" is considered early, but leaving work at "17:18" is considered regular, which means that the meanings are very different in terms of attendance management. For this reason, careful checking is required, and even using character recognition using OCR, checking requires a lot of man-hours.

[0229] When a person checks whether the time printed on the time card 7 matches the time read by OCR and displayed on the screen, they first memorize the time on the time card 7, for example, that the start time on April 1st is "8:50." Then they move their eyes to the screen, find the column (cell) displaying the start time on April 1st, and confirm that "8:50" is displayed there.

[0230] A typical workplace that uses a time recorder is an office or restaurant with around 10 to 20 employees, so if we assume 20 people x 20 days x 2 punches, the above process would be repeated each month to check whether the 800 punches match.

[0231] For example, even if the character recognition accuracy of OCR is 99.8%, one or two reading errors (misrecognition) occur every month, and these must be found. Identifying just one or two reading errors using only numbers (linguistic information) as a clue places a high cognitive load.

[0232] In the character recognition system 1 according to the present technology, when the recognition result time is presented to the operator 4, non-verbal information can also be presented. This makes it possible to intuitively detect misrecognition using not only logical processing but also pattern processing. As a result, it becomes possible to prevent misrecognition from being overlooked, and to efficiently and accurately check the recognition result time.

[0233] For example, it is possible to use a color, pattern, display position, etc. determined based on the time as non-verbal information to be presented together with the time information of the recognition result. By presenting this non-verbal information, it becomes possible to easily notice a recognition error when, for example, an unfamiliar color, pattern, or display position appears.

[0234] In addition, in this character recognition system 1, as illustrated in Figure 9, it is possible to display the recognition result time read by OCR and an extracted image 25 in which only the time is extracted from the photographed image 17 that was the basis for the reading, so that they can be compared.

[0235] At this time, by changing the frame color of the display field 24, the background pattern, the display position of the extracted image 25, etc. based on the recognition result time, it is possible to provide multiple clues to the operator 4. As a result, it is possible to realize a time card confirmation and acknowledgement system that can quickly and easily detect reading errors.

[0236] As a result, it is possible to significantly reduce the burden on the operator 4 who performs tasks such as tallying at the end of the month, and to facilitate payroll calculations, etc. It is also possible to quickly and efficiently find the position of the printed characters that will cause a reading error, and to easily correct the error, thereby achieving extremely high operability.

[0237] <Other embodiments> The present invention is not limited to the above-described embodiment, and various other embodiments can be realized.

[0238] The character recognition system 1 shown in FIG. 1 can also be called a time card reading system or a time card confirmation system.

[0239] FIG. 16 is a block diagram showing an example of the hardware configuration of a computer 60 that can be used as the operator terminal 2 and the server device 3.

[0240] The computer 60 includes a CPU 61, a ROM 62, a RAM 63, an input / output interface 65, and a bus 64 that interconnects these components. The input / output interface 65 is connected to a display unit 66, an input unit 67, a storage unit 68, a communication unit 69, a drive unit 70, and the like. The display unit 66 is a display device using, for example, a liquid crystal display, an electroluminescent display, etc. The input unit 67 is, for example, a keyboard, a pointing device, a touch panel, or other operating device. When the input unit 67 includes a touch panel, the touch panel can be integrated with the display unit 66. The storage unit 68 is a non-volatile storage device such as a HDD, flash memory, or other solid-state memory. The drive unit 70 is a device capable of driving a removable storage medium 71 such as an optical storage medium or magnetic recording tape. The communication unit 69 is a modem, router, or other communication device that can be connected to a LAN, WAN, or the like and that communicates with other devices. The communication unit 69 may communicate either wired or wirelessly. The communication unit 69 is often used separately from the computer 60. Information processing by computer 60 having the above hardware configuration is realized by software stored in storage unit 68, ROM 62, etc., working in cooperation with the hardware resources of computer 60. Specifically, the information processing method according to the present invention is realized by loading a program constituting the software stored in ROM 62, etc., into RAM 63 and executing it. The program is installed in the computer 60 via, for example, the recording medium 71. Alternatively, the program may be installed in the computer 60 via a global network or the like. Any other computer-readable non-transitory storage medium may be used.

[0241] The information processing method (character recognition method / method for presenting character recognition results) and program according to the present invention may be executed by cooperation of multiple computers connected to each other so as to be able to communicate via a network or the like, thereby constructing an information processing system or information processing device according to the present invention. That is, the information processing method and program according to the present invention can be executed not only in a computer system configured by a single computer, but also in a computer system in which a plurality of computers operate in conjunction with each other. In this disclosure, a system refers to a collection of multiple components (devices, modules (components), etc.), regardless of whether all the components are in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device housed in a single housing with multiple modules, are both systems.

[0242] The execution of the information processing method and program according to the present invention by a computer system includes both cases where the acquisition of an object image, character recognition, display of the recognition result time in a time-related display mode, generation of a cut-out image, display of the cut-out image in a corresponding display mode, generation of a recognition result image, etc. are performed by a single computer, and cases where each process is performed by a different computer. Furthermore, the execution of each process by a specific computer includes having another computer execute part or all of the process and obtaining the results. That is, the information processing method and program according to the present invention can also be applied to a cloud computing configuration in which a single function is shared and processed jointly by a plurality of devices via a network.

[0243] The character recognition system, operator terminal, server terminal, photographing device, cropped image, recognition result image, time-related display mode, fraction display mode, correspondence display mode, configuration of each GUI, acquisition of object image, character recognition, display of recognition result time in the time-related display mode, generation of cropped image, display of cropped image in the correspondence display mode, generation of recognition result image, and other processing flows described with reference to each drawing are merely one embodiment and can be modified as desired without departing from the spirit of the present invention. In other words, any other configuration, algorithm, etc. for implementing the present invention may be adopted.

[0244] In this disclosure, to facilitate understanding of the explanation, words such as "approximately," "almost," and "roughly" may be used as appropriate. However, there is no clear difference between using and not using words such as "approximately," "almost," and "roughly." In other words, in the present disclosure, concepts that define shape, size, positional relationship, state, etc., such as "center," "middle," "uniform," and "equal" are concepts that include "substantially center," "substantially central," "substantially uniform," "substantially equal," etc. For example, this also includes a state where the state is within a predetermined range (for example, a range of ±10%) based on the criteria of "perfectly centered," "perfectly central," "perfectly uniform," "perfectly equal," etc. Therefore, even if the words "roughly," "almost," "approximately," etc. are not added, the concept expressed by adding "roughly," "almost," "approximately," etc. may be included. Conversely, a state expressed by adding "roughly," "almost," "approximately," etc. does not necessarily exclude a complete state.

[0245] In this disclosure, expressions using "more than," such as "greater than A" and "smaller than A," are expressions that comprehensively include both concepts that include equivalent to A and concepts that do not include equivalent to A. For example, "greater than A" is not limited to cases that do not include equivalent to A, but also includes "A or greater." Furthermore, "smaller than A" is not limited to "less than A," but also includes "A or less." When implementing the present technology, specific settings and the like may be appropriately adopted from the concepts included in "greater than A" and "smaller than A" so as to achieve the effects described above.

[0246] It is also possible to combine at least two of the features of the present invention described above. That is, the various features described in each embodiment may be combined in any way without distinguishing between the embodiments. Furthermore, the various effects described above are merely examples and are not limiting, and other effects may also be achieved. [Explanation of symbols]

[0247] 1. Character recognition system 2...Operator terminal 3. Server equipment 4...Operator 6. Network 7...Time card 17...Photo 22...Recognition result image 24…Display field 25...Cutout image 27…Recognition result time 28...Related information 30, 32...Bar graph 34...pie chart segments 38, 39...Line segments extending in the direction corresponding to the fraction 60...Computer

Claims

1. an image acquisition unit that acquires an object image of an object on which a time is displayed; a character recognition unit that recognizes the time based on the acquired object image; a time display unit that displays a recognition result time, which is a recognition result by the character recognition unit, in a display mode associated with the recognition result time; An information processing system comprising:

2. 2. The information processing system according to claim 1, The display mode includes at least one of a display color of the recognition result time, a size of the recognition result time, a display position of the recognition result time, a font of the recognition result time, a decoration of characters of the recognition result time, a display color of a display field in which the recognition result time is displayed, and a pattern displayed in the display field. Information processing system.

3. 2. The information processing system according to claim 1, The display manner associated with the recognition result time includes a fraction-related display manner associated with the minute of the recognition result time. Information processing system.

4. 4. The information processing system according to claim 3, The fraction-related display manner includes at least one of displaying a bar graph having a length corresponding to the fraction, displaying a pie chart segment having a size corresponding to the fraction, and displaying a line segment extending in a direction corresponding to the fraction. Information processing system.

5. 4. The information processing system according to claim 3, The fraction-related display mode includes at least one of a display in which an area of ​​a size corresponding to the fraction is filled in a display field in which the recognition result time is displayed, and a display of one or more line segments extending in a direction corresponding to the fraction as a pattern displayed in the display field. Information processing system.

6. The information processing system according to claim 1, further comprising: a cut-out image generating unit that generates a cut-out image cut out from the object image for each of the recognized times; The time display unit displays the generated cutout image so as to be comparable with the recognition result time corresponding to the cutout image. Information processing system.

7. 7. The information processing system according to claim 6, The time display unit displays the cut-out image in a corresponding display mode corresponding to the display mode for displaying the recognition result time corresponding to the cut-out image. Information processing system.

8. 8. The information processing system according to claim 7, The corresponding display mode includes at least one of a display color of the cut-out image, a size of the cut-out image, and a display position of the cut-out image. Information processing system.

9. 8. The information processing system according to claim 7, The corresponding display mode includes displaying the cut-out image at a display position corresponding to the number of minutes of the recognition result time with respect to the recognition result time. Information processing system.

10. 8. The information processing system according to claim 7, The corresponding display mode includes displaying a superimposed image generated to correspond to the minutes of the recognition result time so as to be superimposed on the extracted image. Information processing system.

11. 11. The information processing system according to claim 10, the display manner associated with the recognition result time includes a fraction-related display manner associated with a minute of the recognition result time, The superimposed image corresponds to an image displayed in the fraction-related display mode when the recognition result time is displayed. Information processing system.

12. The information processing system according to claim 1, further comprising: a storage unit for setting association information that associates a time period with a display color; The time display unit determines a display color for the recognition result time based on the related information. Information processing system.

13. 13. The information processing system according to claim 12, The object is a time card for each employee, The storage unit stores the related information in which a display color with relatively high conspicuousness is associated with a time period in which a relatively high degree of attention is required to check the recognition result time, and a display color with relatively low conspicuousness is associated with a time period in which a relatively low degree of attention is required. Information processing system.

14. 2. The information processing system according to claim 1, The time display unit sets a reference time for displaying the recognition result time, and determines a display color for the recognition result time based on the reference time. Information processing system.

15. 15. The information processing system according to claim 14, The time display unit determines a display color for the recognition result time based on a difference between the recognition result time and the reference time. Information processing system.

16. 16. The information processing system according to claim 15, The object is a time card for each employee, The time display unit determines a display color of the recognition result time so that the greater the difference between the recognition result time and the reference time, the more eye-catching the display color is. Information processing system.

17. 15. The information processing system according to claim 14, The time display unit sets the reference time for each employee. Information processing system.

18. Acquire an object image of the object with the time displayed; Recognizing the time based on the acquired object image; A recognition result time, which is a recognition result of the time, is displayed in a display mode associated with the recognition result time. An information processing method implemented by a computer system.

19. Acquire an object image of the object with the time displayed; Recognizing the time based on the acquired object image; A recognition result time, which is a recognition result of the time, is displayed in a display mode associated with the recognition result time. A program that causes a computer system to do something.

Images