Display device, and display system
The display device and system address the lack of guidance in entry fields by using a transmissive display to specify and guide users on filling entry fields, reducing defects in entered content.
Patent Information
- Application Number
- JP2023073335
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-04-27
- Publication Date
- 2024-11-08
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing information processing systems do not provide sufficient guidance to users on what content to enter in entry fields, leading to potential defects in the entered information.
A display device and system that includes a transmissive display, imaging section, and display section to specify entry fields and provide auxiliary images guiding the user on how to fill in the fields, using a transparent display to overlay the sheet with entry instructions.
Reduces defects in the content entered in entry fields by providing clear guidance through auxiliary images, minimizing incomplete or incorrect entries.
Smart Images

Figure 2024158270000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a display device and a display system. [Background technology]
[0002] The information processing system of Patent Document 1 can create a printout in which a handwritten message or the like is placed at a set position on an image of a mount having a pattern or the like. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2021-129164 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, the information processing device of Patent Document 1 does not present the user with information regarding the content to be entered in the entry fields on the form. Therefore, the user needs to determine what to enter in the entry fields. Therefore, unless sufficient guidance regarding the content to be entered in the entry fields is provided on the form, the user cannot enter appropriate content in the entry fields.
[0005] The present invention has been made in consideration of the above-mentioned problems, and has an object to provide a display device and a display system that can reduce errors in the content written in the entry fields formed on the sheet. [Means for solving the problem]
[0006] According to one aspect of the present invention, a display device includes a translucent display, an imaging unit, a first identification unit, an acquisition unit, and a display unit. The translucent display is translucent. The translucent display is disposed on a line of sight toward an area where the sheet is in view. The first identification unit images the sheet and identifies a writing field formed on the sheet. The acquisition unit acquires an auxiliary image showing how to fill in the writing field. The display unit displays the auxiliary image on the translucent display.
[0007] According to another aspect of the present invention, a display system includes an image forming device, an information processing device, and a display device. The image forming device includes a forming section and a form data transmitting section. The forming section forms a form having a fill-in field on a sheet. The form data transmitting section transmits form data corresponding to the form to the information processing device. The information processing device includes a form data receiving section, a storage section, and a filling-in guide transmitting section. The form data receiving section receives the form data. The storage section stores filling-in guide data indicating a filling-in guide for a fill-in field of the form corresponding to the form data. The filling-in guide transmitting section transmits the filling-in guide data to the display device. The display device includes a translucent display, a first identifying section, a filling-in guide receiving section, an acquiring section, and a display section. The translucent display has light transmissibility. The translucent display is disposed on a line of sight toward an area in which the sheet is in view. The first identifying section images the sheet and identifies the filling-in guide field of the form formed on the sheet. The entry guide receiving unit receives the entry guide data from the information processing device. The acquisition unit acquires an auxiliary image showing the entry guide to be filled in the entry field from the entry guide data. The display unit displays the auxiliary image on the translucent display. Effect of the Invention
[0008] According to the display device and display system of the present invention, it is possible to reduce improper entries in the entry fields formed on the sheet. [Brief description of the drawings]
[0009] [Figure 1] 1 is a schematic diagram of a display system according to an embodiment. [Diagram 2] 1 is a perspective view of a display device according to an embodiment; [Diagram 3] 1 is a block diagram of a display device according to an embodiment. [Figure 4] 13 is a diagram of a sheet viewed through a transparent display, showing a first identification unit identifying an entry field. FIG. [Diagram 5] FIG. 13 is a diagram of the sheet as viewed through a transparent display, showing the state before any entry is made in the entry field corresponding to the auxiliary image that is first in the display order. [Figure 6] FIG. 13 is a diagram of the sheet as viewed through a transparent display, showing the state after the entry field corresponding to the auxiliary image that is first in the display order has been filled in. [Figure 7] FIG. 13 is a diagram of the sheet as viewed through a transparent display, showing the state before the entry field corresponding to the auxiliary image that is second in the display order is filled in. [Figure 8] This is a diagram of a sheet viewed through a transparent display, showing that the filling-in instructions for the field corresponding to the auxiliary image that is third in the display order are multiple-choice filling-in instructions. [Figure 9] FIG. 8 shows a subordinate entry instruction that is displayed in the entry field corresponding to the auxiliary image that is ranked fourth in the display order after X1 is entered in the entry field corresponding to the auxiliary image that is ranked third in the display order. [Figure 10] FIG. 8 shows a subordinate entry instruction that is displayed in the entry field corresponding to the auxiliary image that is ranked fourth in the display order after Y1 is entered in the entry field corresponding to the auxiliary image that is ranked third in the display order. [Figure 11] 1 is a block diagram of a display system according to an embodiment. [Figure 12] 13 is a flowchart showing a process of the display system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, an embodiment will be described with reference to the drawings. In the drawings, the same or corresponding parts are designated by the same reference characters and description thereof will not be repeated.
[0011] A display system 100 according to an embodiment will be outlined with reference to Fig. 1. Fig. 1 is a schematic diagram of the display system 100 according to an embodiment.
[0012] There is a sheet S on which a form having a fill-in section SC is formed. Necessary information is written by hand in the fill-in sections SC of the sheet S. An example of such a sheet S is an application form for making some kind of application. Information such as the name is written as necessary information in the fill-in sections SC of the application form. Here, a typical sheet S includes the meaning of flat paper. However, the sheet S may also include a non-flat surface. In addition, the material of the sheet S may be cloth, rubber, plastic, or the like.
[0013] The display system 100 assists the user P in filling in the necessary information in the entry fields SC formed on the sheet S.
[0014] As shown in FIG. 1, the display system 100 includes an image forming device 2, an information processing device 3, a network 4, an authentication device 5, and a display device 1.
[0015] The image forming apparatus 2, the information processing apparatus 3, and the display apparatus 1 communicate with each other via a network 4. The network 4 includes, for example, the Internet, a Wide Area Network (WAN), and a Local Area Network (LAN).
[0016] The authentication device 5 and the display device 1 communicate with each other by a short-distance wireless communication method. Note that the authentication device 5 and the display device 1 may communicate with each other by a method other than the short-distance wireless communication method as long as they can communicate with each other.
[0017] The image forming device 2 is a device having an image forming function for forming an image on a sheet S, and a communication function for transmitting format data indicating the image of the format formed on the sheet S.
[0018] The image forming function forms an image of a form on a sheet S based on form data indicating an image of a form having an entry column SC. The image forming function is realized by an electrophotographic method or an inkjet method. The image forming device 2 is, for example, a printer, a copier, or an MFP (Multi Function Printer). The communication function transmits the form data to the information processing device 3.
[0019] The information processing device 3 has a storage function for storing data and a communication function. The data stored in the storage function includes filling-in guideline data showing how to fill in the entry columns SC of the form formed on the sheet S. The communication function is a function for receiving the form data from the image forming device 2 and transmitting the filling-in guideline data to the display device 1. The information processing device 3 includes an information processing server, a personal computer, and a mobile information communication terminal such as a smartphone.
[0020] The authentication device 5 has an authentication function for identifying and authenticating a user P of the display system 100, and a communication function. The authentication function is a function for generating authentication information corresponding to the user P. The authentication information is transmitted to the display device 1 by the communication function. The authentication device 5 includes a wearable device having a short-range communication function, such as a smart watch, and a portable information communication terminal, such as a smartphone.
[0021] The display device 1 has an assistance function for assisting the user P in filling in the necessary items in the entry columns SC of the sheet S. Specifically, the assistance function is a function for displaying, to the user P, the entry instructions indicated by the entry instruction data received from the information processing device 3. The display device 1 is, for example, an Augmented Reality (AR) glass or a Head Mounted Display (HMD).
[0022] The configuration of the display device 1 will be described with reference to Fig. 2. Fig. 2 is a perspective view of the display device 1 according to the embodiment.
[0023] As shown in FIG. 2, the display device 1 includes a transmissive display 11, an imaging unit 12, a communication unit 13, and a control unit .
[0024] The transmissive display 11 is a display that transmits light. The display includes, for example, a lens onto which an image is projected, a lens to which a polarizing shutter is attached, a transparent liquid crystal display, or a transparent organic electroluminescence display.
[0025] The see-through display 11 is disposed on a line of sight EL toward an area ES where the sheet S comes into view. As an example of a display disposed on the line of sight EL, Fig. 3 illustrates glasses whose lens portions are constituted by the see-through display 11. The eye EB of a user P wearing the glasses looks at the sheet S so that both the sheet S and the area surrounding the sheet S come into view.
[0026] The imaging unit 12 generates image data corresponding to a sheet image obtained by imaging the sheet S. The imaging unit 12 images the sheet S in time series. The imaging unit 12 includes, for example, a charge coupled device (CCD) image sensor or a complementary metal oxide semiconductor (CMOS) image sensor.
[0027] The communication unit 13 transmits and receives various information between the information processing device 3 and the authentication device 5. Transmission and reception of various information between the information processing device 3 and the communication unit 13 is performed via the network 4. Transmission and reception of various information between the authentication device 5 and the communication unit 13 includes communication using a short-range wireless communication method that does not go through the network 4. The communication unit 13 is an example of the "filling instructions receiving unit," "image data transmitting unit," and "authentication information transmitting and receiving unit" of the present invention.
[0028] The control unit 14 will be described with reference to Fig. 3. Fig. 3 is a block diagram of the display device 1 according to the embodiment.
[0029] 3, the control unit 14 includes a processing unit 14A and a storage unit 14B. The processing unit 14A is, for example, a processor. The processor is, for example, a CPU (Central Processing Unit). The processing unit 14A controls the transmissive display 11, the imaging unit 12, and the communication unit 13 by executing a control program stored in the storage unit 14B.
[0030] The storage unit 14B stores various data including image data and entry procedure data, as well as a control program. The storage unit 14B is configured, for example, with a ROM (Read Only Memory), a RAM (Random Access Memory), and / or a Solid State Drive (SSD). The storage unit 14B may include an external memory. The external memory is a removable medium. The storage unit 14B may include, for example, a USB (Universal Serial Bus) memory and / or an SD (Secure Digital) card as the external memory.
[0031] The function of the processing unit 14A will be described with reference to FIGS.
[0032] FIG. 4 is a diagram of the sheet S seen through the transparent display 11, and the first identification unit 141 is a diagram of identifying the entry field SC. FIG. 5 is a diagram of the sheet S seen through the transparent display 11, and is a diagram showing a state before the entry field SC corresponding to the auxiliary image 110 with the first display order is filled in. FIG. 6 is a diagram of the sheet S seen through the transparent display 11, and is a diagram showing a state after the entry field SC corresponding to the auxiliary image 110 with the first display order is filled in. FIG. 7 is a diagram of the sheet S seen through the transparent display 11, and is a diagram showing a state before the entry field SC corresponding to the auxiliary image 110 with the second display order is filled in. FIG. 8 is a diagram of the sheet S seen through the transparent display 11, and is a diagram showing that the entry instructions for the entry field SC corresponding to the auxiliary image 110 with the third display order are alternative entry instructions. FIG. 9 is a diagram showing a subordinate entry instruction displayed in the entry field SC with the fourth display order after X1 is filled in the entry field SC corresponding to the auxiliary image 110 with the third display order in FIG. 8. FIG. 10 is a diagram showing a subordinate entry instruction that is displayed in the entry field SC that is fourth in the display order after Y1 is entered in the entry field SC that corresponds to the auxiliary image 110 that is third in the display order in FIG.
[0033] Processing unit 14A includes first identification unit 141, acquisition unit 142, display unit 143, second identification unit 144, reception unit 145, match determination unit 146, notification unit 147, and display determination unit 148. Functions included in first identification unit 141, acquisition unit 142, display unit 143, second identification unit 144, reception unit 145, match determination unit 146, notification unit 147, and display determination unit 148 are realized by processing unit 14A executing a control program stored in storage unit 14B.
[0034] 4, the first identification unit 141 images the sheet S and identifies the entry columns SC formed on the sheet S. Specifically, the first identification unit 141 causes the imaging unit 12 to image the sheet S, and identifies the entry columns SC filled in on the sheet S based on the image data generated by the imaging unit 12. The first identification unit 141 identifies the entry columns SC corresponding to the entry instructions included in the entry instructions data from the entry instructions data corresponding to the format included in the image data.
[0035] The acquisition unit 142 acquires the supplementary image 110 (see FIG. 5) showing the filling-in instructions for the entry field SC. The supplementary image 110 is generated from filling-in instructions data showing the filling-in instructions corresponding to the entry field SC identified by the first identification unit 141.
[0036] The auxiliary image 110 is composed of an image for the user P to grasp the position of the entry field SC and an image for the user P to understand the entry instructions. Specifically, as shown in Fig. 5, the auxiliary image 110 includes a highlighting image 11A and a text image 11B. The highlighting image 11A is an image that highlights the entry field SC by surrounding the entry field SC that corresponds to the entry instructions. The text image 11B is an image that indicates the entry instructions in text.
[0037] The display unit 143 displays the auxiliary image 110 on the transparent display 11. By displaying the auxiliary image 110 on the transparent display 11, both the sheet S and the auxiliary image 110 are within the field of view of the user P, as shown in Fig. 5. This allows the user P to fill in the entry fields SC while visually checking the filling-in instructions shown in the auxiliary image 110. This reduces improper filling in the entry fields SC.
[0038] In detail, the display unit 143 displays the highlighted image 11A and the text image 11B on the transparent display 11. This allows the user P to identify the entry field SC corresponding to the displayed text image 11B by the highlighted image 11A, and to understand the entry instructions in text.
[0039] 6, the second identification unit 144 identifies sheet entries UW entered in entry columns SC of the sheet S from the sheet image based on the image data. The sheet entries UW are entries written by the user P in the entry columns SC of the sheet S by hand or by other means. The second identification unit 144 performs OCR (Optical Character Recognition) processing on the sheet entries UW. This allows the second identification unit 144 to handle the sheet entries UW as character information.
[0040] The receiving unit 145 receives an operation (determination operation) for causing a determination to be made by the match determining unit 146, which will be described later, when the second identifying unit 144 identifies the sheet entry UW.
[0041] Specifically, the reception unit 145 displays an icon 11C for receiving a judgment operation on the transparent display 11. In Fig. 6, a pattern containing the word "Complete" is displayed as the icon 11C next to the auxiliary image 110. The second identification unit 144 identifies the sheet entry item UW, and the icon 11C is highlighted. This allows the user P to recognize that a judgment operation can be performed.
[0042] The accepting unit 145 can detect the action of the user P based on a plurality of image data generated in time series. By detecting the action of the user P pressing the icon 11C, the accepting unit 145 accepts a determination operation.
[0043] The match determination unit 146 determines whether the sheet entry items UW identified by the second identification unit 144 match the items to be entered. The items to be entered are items that the user P is expected to enter in the entry field SC. Specifically, the items to be entered are information unique to the user P, such as a name. The items to be entered are character information included in the entry guide data. The match determination unit 146 makes a determination by comparing the sheet entry items UW recognized as character information with the items to be entered, which are character information.
[0044] The determination by the match determination unit 146 is performed when the reception unit 145 receives a determination operation from the user P. Therefore, the user P can determine whether or not to perform a determination by the match determination unit 146 depending on the entry status in the entry field SC.
[0045] When the match determination unit 146 determines that the sheet entry item UW does not match the item to be entered, the notification unit 147 notifies the user that the sheet entry item UW does not match the item to be entered. The notification unit 147 causes the display unit 143 to display an image (notification image 11D) indicating that the sheet entry item UW does not match the item to be entered. The notification image 11D shown in Fig. 6 indicates that the sheet entry item UW "OO OO" does not match the item to be entered "△△ OO". The user P who sees the notification image 11D can notice an error in the entry in the entry field SC.
[0046] The function of the processing unit 14A when the entry guide data indicates a plurality of entry guides will be described in detail.
[0047] After the first identification unit 141 identifies a plurality of entry fields SC, the display unit 143 displays the auxiliary image 110 corresponding to the entry field SC formed at the end of the sheet S. As a specific example, the first auxiliary image 111 corresponding to the first entry field SC1 formed at the upper end of the sheet S is displayed on the transparent display 11 shown in FIG. 6. Here, a user P looking at the sheet S often starts looking at the first entry field SC1. In other words, the first entry field SC1 and the initial line of sight EL of the user P when looking at the sheet S coincide with each other. This reduces the movement of the line of sight EL of the user P. As a result, the burden on the user P is reduced, and the number of entries in the entry fields SC is reduced.
[0048] The reception unit 145 receives an instruction (switching instruction) to switch the display on the display unit 143 at the same time as the judgment operation. When the match judgment unit 146 judges that the sheet entry items UW and the items to be entered match as a result of the judgment operation, the reception unit 145 instructs the display unit 143 to switch the auxiliary image 110. That is, by receiving the judgment operation, the display unit 143 switches the display on the transparent display 11 from a first auxiliary image 111 (see FIG. 6) including one entry guide to a second auxiliary image 112 (see FIG. 7) including another entry guide. Therefore, even if there are multiple entry fields SC, the user P can see the auxiliary image 110 corresponding to each entry field SC. As a result, improper entry into the entry fields SC can be reduced.
[0049] The second entry field SC2 corresponding to the second auxiliary image 112 is the entry field SC closest to the first entry field SC1 corresponding to the first auxiliary image 111 among the multiple entry fields SC formed on the sheet S. When the direction in which characters are arranged is fixed, such as horizontal writing or vertical writing, the closest entry field SC is determined based on the direction in which the characters are arranged. For example, in horizontal writing, the entry field SC arranged vertically of the filled-in entry field SC may be arranged at the closest position among all the entry fields SC. In this case, the entry field SC arranged horizontally of the filled-in entry field SC is regarded as the closest entry field SC. Similarly, in vertical writing, the entry field SC arranged vertically is regarded as the closest entry field SC. In this way, the movement of the user P's line of sight EL can be minimized. As a result, the burden on the user P is reduced, and improper entry in the entry field SC is reduced.
[0050] The multiple entry guidelines may include alternative entry guidelines and subordinate entry guidelines that are subordinate to a selected entry guideline selected from the alternative entry guidelines, as shown in Fig. 8. A case where the alternative entry guidelines and subordinate entry guidelines are included in the entry guidelines will be described.
[0051] 8, the auxiliary image 11E showing alternative filling instructions indicates that either the filling instruction "X1" or the filling instruction "Y1" can be selected. The user P fills in the third entry field SC3 according to either the filling instruction showing "X1" or the filling instruction showing "Y1."
[0052] As shown in Figures 9 and 10, the display unit 143 switches the display on the transparent display 11 from a selected entry guideline including items to be filled in that match the sheet entry item UW identified by the second identification unit 144 to a subordinate entry guideline that is subordinate to the selected entry guideline including items to be filled in that match the sheet entry item UW identified by the second identification unit 144.
[0053] Specifically, as shown in Fig. 9, when the sheet entry item UW entered in the third entry column SC3 is "X1", the display unit 143 displays "X2" indicating a subordinate entry method of the selection entry method "X1" as the auxiliary image 11F. On the other hand, as shown in Fig. 10, when the sheet entry item UW entered in the third entry column SC3 is "Y1", the display unit 143 displays "Y2" indicating a subordinate entry method of the selection entry method "Y1" as the auxiliary image 11F. Therefore, it is possible to reduce entry errors in entry columns SC where multiple choice entries are required, and also to reduce entry errors in entry columns SC where the entry content changes due to multiple choice entries.
[0054] The display determination unit 148 determines whether or not all of the auxiliary images 110 indicating the filling instructions have been displayed on the transparent display 11. When the filling instructions data indicates a plurality of filling instructions, if there are no auxiliary images 110 remaining to be displayed, the display determination unit 148 determines that all of the auxiliary images 110 have been displayed on the transparent display 11. On the other hand, if there are auxiliary images 110 remaining to be displayed, the display determination unit 148 determines that all of the auxiliary images 110 have not been displayed on the transparent display 11.
[0055] When the display determination unit 148 determines that all of the entry instructions have been displayed on the display unit 143, it instructs the communication unit 13 to transmit the latest image data of the image data generated by the imaging unit 12. This causes the communication unit 13 to transmit the latest image data. Therefore, a third party who receives the latest image data can carry out a task using the sheet S with the entry columns SC filled in.
[0056] The configuration of the display system 100 according to the embodiment will be described with reference to Fig. 2, Fig. 3, and Fig. 11. Fig. 11 is a block diagram of the display system 100 according to the embodiment.
[0057] As described above, the display system 100 includes the image forming device 2, the information processing device 3, the authentication device 5, and the display device 1.
[0058] As shown in FIG. 11, the image forming device 2 includes a forming unit 21, a format data transmitting unit 22, and an image forming device control unit .
[0059] The forming unit 21 forms a form having a fill-in column SC on a sheet S based on the form data. The form data transmitting unit 22 transmits form data corresponding to the form formed on the sheet S by the forming unit 21 to the information processing device 3. The image forming device control unit 23 stores the form data and a control program for controlling the forming unit 21 and the form data transmitting unit 22.
[0060] The information processing device 3 includes an information processing device communication unit 31 , an information processing device control unit 32 , and an input unit 33 .
[0061] The information processing device communication unit 31 receives form data from the image forming device 2 and transmits filling-in guideline data to the display device 1. The information processing device communication unit 31 is an example of a "form data receiving unit," a "fill-in guideline transmitting unit," and an "authentication information receiving unit."
[0062] The information processing device control unit 32 stores filling-in guideline data indicating how to fill in the entry column SC of the form corresponding to the form data, and a control program that controls the information processing device communication unit 31. Having executed the control program, the information processing device control unit 32 causes the information processing device communication unit 31 to transmit the filling-in guideline data corresponding to the received form data. The information processing device communication unit 31 transmits the filling-in guideline data corresponding to the form formed on the sheet S by the image forming device 2 to the display device 1. Thus, the display device 1 receives the filling-in guideline data corresponding to the form formed by the image forming device 2. The information processing device control unit 32 is an example of a "storage unit".
[0063] The communication unit 13 (see FIG. 3) of the display device 1 receives the filling-in guideline data indicating the filling-in guideline from the information processing device 3. Then, the acquisition unit 142 (see FIG. 3) acquires the auxiliary image 110 from the filling-in guideline data received from the information processing device 3. Therefore, the transparent display 11 displays the auxiliary image 110 indicating the filling-in guideline corresponding to the format formed on the sheet S.
[0064] The input unit 33 is a device for inputting new entry guideline data. The input unit 33 includes, for example, a keyboard. By inputting new entry guideline data to the input unit 33, the information processing device control unit 32 updates the stored entry guideline data to the new entry guideline data input to the input unit 33. Therefore, the entry guideline data stored in the information processing device control unit 32 can be updated to the latest content.
[0065] The filling instructions, which indicate the filling instruction data input to the input unit 33, include at least the items to be filled out of the items to be filled out and related information. The items to be filled out include updated items to be filled out. An example of the updated items to be filled out is a seal to be used for authentication. For example, if the design of the seal is changed, the items to be filled out are updated to the changed design of the seal. The related information is information related to the items to be filled out. The related information includes examples of past entries on the same type of application form.
[0066] The display unit 143 that has received the entry guide data displays the latest items to be entered and related information as the auxiliary image 110 on the transparent display 11. Since the user P can see the latest items to be entered, the possibility of entering incorrect information in the entry field SC is reduced. In addition, the user P who has seen the related information can smoothly enter information in the entry field SC.
[0067] The entry instructions data is information unique to the user P that is obtained by authenticating the user P. The entry instructions unique to the user P are linked to authentication information (described later) for each user P.
[0068] The authentication device 5 authenticates the user P. The authentication device 5 includes an authentication information generating unit 51 and an authentication information transmitting unit 52.
[0069] The authentication information generation unit 51 authenticates the user P and generates authentication information. The authentication information is information that differs for each user P and identifies the user P. The authentication information generation unit 51 generates authentication information in response to a request for authentication information from the display device 1. The request for authentication information from the display device 1 is made through communication between the display device 1 and the authentication device 5. The authentication information generation unit 51 authenticates the user P using a password and / or biometric information of the user P, such as a fingerprint, and generates authentication information.
[0070] The authentication information transmitting unit 52 transmits the authentication information to the display device 1. The communication unit 13 of the display device 1 receives the authentication information and transmits the authentication information to the information processing device 3. The authentication information is received from the display device 1.
[0071] When the information processing device 3 receives the authentication information, the information processing device control unit 32 causes the information processing device communication unit 31 to transmit the entry guide data unique to the user P to the display device 1. Thus, the display device 1 receives the entry guide data unique to the user P. The display device 1 displays the entry guide indicating the entry guide data unique to the user P as the auxiliary image 110. Thus, the display device 1 can display the auxiliary image 110 suitable for each user P.
[0072] The processing of the display system 100 will be described with reference to Fig. 2, Fig. 3 to Fig. 12. Fig. 12 is a flowchart showing the processing of the display system 100. The processing of the display system 100 includes steps S102 to S136.
[0073] In step S102, the forming unit 21 of the image forming apparatus 2 forms a pattern on the sheet S.
[0074] In step S104, the form data transmission unit 22 transmits the form data to the information processing device 3.
[0075] In step S106, the imaging unit 12 of the display device 1 captures an image of the sheet S on which the format is formed.
[0076] In step S108, the communication unit 13 transmits to the authentication device 5 a signal requesting authentication information.
[0077] In step S110, the authentication information generating unit 51 of the authentication device 5 generates the authentication information of the user P in response to the request for authentication information.
[0078] In step S112, the authentication information transmitting unit 52 transmits the authentication information to the display device 1.
[0079] In step S114, the communication unit 13 of the display device 1 receives the authentication information.
[0080] In step S116, the communication unit 13 transmits the authentication information to the information processing device 3.
[0081] In step S118, the information processing device control unit 32 of the information processing device 3 acquires entry instruction data unique to the user P, which is linked to the received authentication information.
[0082] In step S120, the information processing device communication unit 31 transmits the acquired entry instruction data to the display device 1.
[0083] In step S122, the first identification unit 141 of the display device 1 identifies the entry column SC formed on the sheet S as shown in FIG.
[0084] In step S124, the acquisition unit 142 acquires the auxiliary image 110 based on the entry guide data received from the information processing device 3. The display unit 143 displays the auxiliary image 110 on the translucent display 11, as shown in Fig. 5. The user P who sees the auxiliary image 110 enters the necessary items in the target entry field SC in the auxiliary image 110.
[0085] In step S126, the second identification unit 144 identifies the sheet entry UW shown in Fig. 6. After the sheet entry UW is identified, the reception unit 145 becomes able to receive a determination operation. When the reception unit 145 receives the determination operation, the process proceeds to step S128.
[0086] In step S128, the match determination unit 146 determines whether or not the sheet entry UW matches the scheduled entry. If the determination is affirmative (YES), the process proceeds to step S132. On the other hand, if the determination is negative (NO), the process proceeds to step S130.
[0087] In step S130, as shown in Fig. 6, a notification is issued that the sheet entry items UW do not match the items to be entered. The user P corrects the items to be entered, and the reception unit 145 accepts the determination operation again. As shown in Fig. 7, if the corrected sheet entry items UW match the items to be entered, the process proceeds to step S132. Note that the reception unit 145 may correct the sheet entry items UW and accept only a switching instruction instead of accepting the determination operation. If a switching instruction is accepted, the process proceeds to step S132 even if the sheet entry items UW do not match the items to be entered.
[0088] In step S132, the display determination unit 148 determines whether or not all the entry instructions have been displayed. If the determination is negative (NO), the process returns to step S124. On the other hand, if the determination is positive (YES), the process proceeds to step S134.
[0089] In step S134, the imaging unit 12 captures an image of the sheet S on which all the entry columns SC are filled in, and generates a sheet image.
[0090] In step S136, the communication unit 13 transmits the sheet image to the information processing device 3. The information processing device control unit 32 of the information processing device 3 stores the sheet image.
[0091] The embodiments of the present invention have been described above with reference to the drawings. However, the present invention is not limited to the above embodiments, and can be implemented in various forms without departing from the spirit of the present invention. The drawings are mainly schematic illustrations of each component for ease of understanding, and the thickness, length, number, spacing, etc. of each component shown in the drawings are different from the actual ones due to the convenience of drawing. In addition, the material, shape, dimensions, etc. of each component shown in the above embodiments are merely examples and are not particularly limited, and various modifications are possible within a range that does not substantially deviate from the configuration of the present invention. [Industrial Applicability]
[0092] INDUSTRIAL APPLICABILITY The present invention provides a display device and a display system, and has industrial applicability. [Explanation of symbols]
[0093] 1:Display device 2: Image forming device 3: Information processing equipment 5: Authentication device 11: Transparent display 12: Imaging unit 21:Formation part 22: Form data transmission section 31: Information processing device communication unit 32: Information processing device control unit 33: Input section 51: Authentication information generation unit 52: Authentication information transmission unit 110: Auxiliary image 11A: Highlighted image 11B: Text image 141:1st specific part 142: Acquisition Department 143:Display section 144: Reception 145:Second Specific Part 146: Match determination section 147: Information Department 148:Display judgment section
Claims
1. a transmissive display that is translucent and is disposed on a line of sight toward an area where the sheet is in view; a first identification unit that images the sheet and identifies a column formed on the sheet; An acquisition unit that acquires an auxiliary image showing a method for filling in the entry field; a display unit that displays the auxiliary image on the transmissive display; A display device comprising:
2. The auxiliary image is a highlighting image that is arranged on a line of sight toward an area surrounding the entry field corresponding to the entry guideline and highlights the entry field; A text image that is arranged on the line of sight toward the area outside the entry column and indicates the entry instructions in text; The display device of claim 1 .
3. A filling-in guideline receiving unit for receiving filling-in guideline data indicating the filling-in guideline, The display device according to claim 1 , wherein the acquisition unit acquires the auxiliary image from the entry guide data.
4. The display device according to claim 3 , wherein the entry instructions are information unique to the user that is obtained by authenticating the user.
5. The filling instructions include at least the items to be filled in the entry fields and related information related to the items to be filled in, The display device of claim 3 , wherein the to-be-entered items include updated to-be-entered items.
6. an imaging unit that captures an image of the sheet and generates image data corresponding to the sheet image; a second identification unit that identifies sheet entries written in the entry fields of the sheet from the sheet image based on the image data; a match determination unit that determines whether the sheet entry item identified by the second identification unit matches the scheduled entry item; a notification unit that notifies the user that the sheet entry items do not match the items to be entered when the match determination unit determines that the sheet entry items do not match the items to be entered; The display device according to claim 5 , further comprising:
7. The display device according to claim 6 , further comprising a reception unit configured to receive an operation for causing the match determination unit to perform a determination.
8. There are several ways to fill out the form. The display device according to claim 7 , wherein the display unit switches the display of the transparent display from a first auxiliary image including one filling instruction to a second auxiliary image including another filling instruction when the reception unit receives the operation.
9. The plurality of filling instructions include an alternative filling instruction and a dependent filling instruction that is dependent on a selected filling instruction selected from the alternative filling instructions; The display device described in claim 8, wherein the display unit switches the display of the transparent display from a selected entry guideline including items to be filled in that match the sheet entry items identified by the second identification unit to a dependent entry guideline that is subordinate to the selected entry guideline including items to be filled in that match the sheet entry items identified by the second identification unit.
10. 10. The display device according to claim 8 or claim 9, wherein the second entry field corresponding to the second auxiliary image is, among a plurality of entry fields formed on the sheet, the entry field closest to the first entry field corresponding to the first auxiliary image.
11. The display device according to claim 10 , wherein the display unit displays an auxiliary image corresponding to a column formed at an edge of the sheet after the first identification unit identifies the plurality of columns.
12. a display determination unit that determines whether or not all of the plurality of filling-out instructions are displayed on the transparent display; an image data transmission unit that transmits the latest image data among the image data generated by the imaging unit when the display determination unit determines that all of the filling-in instructions have been displayed on the display unit; The display device of claim 8 , further comprising:
13. A display system including an image forming apparatus, an information processing apparatus, and a display apparatus, The image forming apparatus includes: A forming unit that forms a form having a fill-in column on a sheet; a format data transmission unit that transmits format data corresponding to the format to the information processing device; Equipped with The information processing device includes: A format data receiving unit for receiving the format data; A storage unit that stores entry instruction data indicating an entry instruction for an entry field of a form corresponding to the form data; a filling-in procedure transmission unit that transmits the filling-in procedure data to the display device; Equipped with The display device includes: a transmission display having light-transmitting properties and disposed on a line of sight toward an area including the sheet; a first identification unit that images the sheet and identifies a fill-in section of a form formed on the sheet; an entry guideline receiving unit for receiving the entry guideline data from the information processing device; an acquisition unit that acquires an auxiliary image showing the filling-in guideline for the entry field from the filling-in guideline data; a display unit that displays the auxiliary image on the transmissive display; A display system comprising:
14. An authentication device for authenticating a user is further provided, The authentication device includes: an authentication information generating unit that authenticates the user and generates authentication information; an authentication information transmission unit that transmits the authentication information to the display device; having The display device includes: an authentication information transmitting / receiving unit that receives the authentication information from the authentication device and transmits the authentication information to the information processing device; The information processing device includes: An authentication information receiving unit that receives the authentication information from the display device, The storage unit stores entry instruction data unique to the user and associated with the authentication information; The display system according to claim 13 , wherein the entry guide transmission unit transmits entry guide data specific to the user to the display device.
15. The information processing device further includes an input unit for inputting new entry instruction data, 15. The display system according to claim 13, wherein the storage unit updates the stored entry guide data with new entry guide data inputted to the input unit.
Citation Information
Patent Citations
Information processing system, information processing program, and information processing method
JP2021129164A
