Multifunctional form filling machine
Through the combination of multi-functional single-filling camera module, location allocation, voice reception and display module, the existing single-filling camera cannot guide visitors in a timely manner, and an efficient form filling process and user experience improvement have been achieved.
Patent Information
- Application Number
- CN202111471393.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-04
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2041-12-04
AI Technical Summary
The existing single-filling unit has a single function, and it is impossible to guide the form filling needs of visitors in a timely manner, resulting in inefficient filling.
Design a multi-functional single-packing unit, including a camera module for video stream data detection and analysis, the position allocation module allocates single-packing positions according to idle situations, and the voice receiving module and display device are used to generate and display single-packing documents of type of single-packing guide Template, the sensing module is used to prompt for filling out matters, and the broadcast module is used to guide prompts.
It realizes timely guide to the visiting personnel to fill in the form, improves the efficiency of filling in the form, and automatically assigns the filling position and provides filling in the form guidance through the analysis of video streaming data and voice information, which improves the user experience.
Smart Images

Figure CN114169858B_ABST
Abstract
Description
Technical Field
[0001] The invention relates to the technical field of form filling guidance, and in particular to a multifunctional form filling station. Background Art
[0002] The form filling station is used for users to fill in relevant information. However, the current form filling station has a relatively single function and cannot guide visitors who have business form filling needs to fill in the form in a timely manner, so it needs to be improved. Summary of the invention
[0003] In order to promptly guide visitors who have business form filling needs, this application provides a multi-functional form filling station.
[0004] The above-mentioned invention objective of the present application is achieved through the following technical solutions:
[0005] A multifunctional form filling machine, comprising:
[0006] A platform body, the platform body comprising a reception position and at least one form filling position;
[0007] A camera module disposed at the reception location for acquiring video stream data of the reception location;
[0008] A form filling analysis module, used to detect and analyze the video stream data of the reception location to determine whether there is a person with a form filling request;
[0009] A position allocation module, configured to allocate a form filling position to the person with the form filling request according to the availability of the form filling position when the analysis module detects and analyzes that there is a person with a form filling request at the reception position;
[0010] A voice receiving module disposed at the form filling location for receiving voice information at the form filling location;
[0011] A voice analysis module, used to analyze the voice information to generate a form filling type;
[0012] A display device is arranged at the form filling position, and the display device is used to display a document guide template corresponding to the form filling type.
[0013] By adopting the above-mentioned technical scheme, the camera module arranged at the reception position obtains the video stream data at the reception position, and then detects and analyzes the video stream data to determine whether the person arriving at the reception position has a form filling request. When it is detected and analyzed that there is a person with a form filling request at the reception position, a form filling position is allocated to the person with the form filling request according to the availability of the form filling position. Then, after the corresponding person with the form filling request arrives at the form filling position, the voice receiving module receives the voice information at the form filling position, the voice analysis module analyzes the voice information to generate a form filling type, and then the display device displays the document guidance template corresponding to the form filling type for the person to view, thereby achieving the effect of form filling guidance and filling instructions.
[0014] In a preferred example, the present application can be further configured as follows:
[0015] A document placement location is arranged at the form filling location, and a sensing module is arranged at the document placement location, wherein the sensing module is used to sense the pressure at each point of the document placement location and display prompt information at a corresponding position of the document guide template.
[0016] By adopting the above technical solution, when a person fills in or touches a document placed at the document placement location with a pen, prompt information is displayed at a corresponding position of the document guide template, that is, a mark for filling in items.
[0017] In a preferred example, the present application can be further configured as follows: a document slot is provided on the platform, and the document slot is where the document is placed.
[0018] By adopting the above technical solution, the setting of the document slot facilitates the positioning and limiting of the document, thereby improving the sensing accuracy.
[0019] In a preferred example, the present application can be further configured as follows: it also includes a broadcast module, and the broadcast module is used to issue a guiding prompt sound after the position allocation module allocates the form filling position.
[0020] By adopting the above technical solution, the broadcast module emits a guidance prompt sound, which makes it easier for personnel to understand the guidance intuitively and cooperate.
[0021] In a preferred example, the present application can be further configured as follows: allocating a form filling position to the person having the form filling request according to the availability of the form filling position includes:
[0022] When there are vacant form filling positions, the form filling positions are allocated according to the distance between each vacant form filling position and the reception position;
[0023] When there is no free form filling position, a waiting message is issued.
[0024] In a preferred example, the present application may be further configured as follows: the detecting and analyzing the video stream data of the reception location to determine whether there is a person with a form filling request includes:
[0025] Input each frame of the video stream data into a pre-trained first analysis model for inference to obtain whether there is a person with a form filling request in each frame of the video stream data;
[0026] The first analysis model is trained by:
[0027] Each image sample in the image sample training set is annotated to indicate whether there is a person with a form filling request in each image sample; and a neural network is trained using the annotated image sample training set to obtain a first analysis model.
[0028] In a preferred example, the present application can be further configured as follows: the voice information is analyzed to generate the form filling type, including:
[0029] Inputting the voice information into a pre-trained second analysis model for inference to obtain the form type;
[0030] The second analysis model is trained by:
[0031] Each speech information sample in the speech information sample training set is labeled to mark the form-filling type in each speech information sample, and the form-filling type is associated with all or part of the information in the speech information sample; and a neural network is trained using the labeled speech information sample training set to obtain a second analysis model.
[0032] In a preferred example, the present application can be further configured as follows: when the form filling analysis module detects and analyzes that there is a person with a form filling request, the voice receiving module starts to receive voice information.
[0033] In a preferred example, the present application can be further configured as follows:
[0034] The database module stores a mapping relationship table between form filling types and document guide templates. The database matches the corresponding document guide template according to the form filling type and sends the document guide template to the display device.
[0035] In summary, the present application includes at least one of the following beneficial technical effects:
[0036] 1. The camera module arranged at the reception position obtains the video stream data at the reception position, and then detects and analyzes the video stream data to determine whether the person arriving at the reception position has a form filling request. When it is detected and analyzed that there is a person with a form filling request at the reception position, a form filling position is allocated to the person with the form filling request according to the availability of the form filling position. After the corresponding person with the form filling request arrives at the form filling position, the voice receiving module receives the voice information at the form filling position, and the voice analysis module analyzes the voice information to generate a form filling type. Then, the display device displays the document guide template corresponding to the form filling type for the person to view, thereby achieving the effect of form filling guidance and filling instructions.
[0037] 2. When a person fills in or touches a document placed in the document placement area with a pen, prompt information is displayed at the corresponding position of the document guide template, i.e., the mark of the items to be filled in;
[0038] 3. The setting of the document slot facilitates the positioning and limiting of the document and improves the sensing accuracy. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] Figure 1 It is a structural schematic diagram of a multifunctional form filling station in one embodiment of the present application;
[0040] Figure 2 It is a schematic diagram of the connections between the modules of the multifunctional form filling station in one embodiment of the present application.
[0041] Figure numerals: 1. platform; 11. reception position; 12. form filling position; 2. camera module; 3. voice receiving module; 4. display device; 5. document placement; 6. document slot; 7. broadcast module. DETAILED DESCRIPTION
[0042] The following is a description of exemplary embodiments of the present application in conjunction with the accompanying drawings, including various details of the embodiments of the present application to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present application. Similarly, for the sake of clarity and conciseness, the description of well-known functions and structures is omitted in the following description.
[0043] It should be noted that the terms "first", "second", etc. in the present invention are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure.
[0044] In addition, the term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article, unless otherwise specified, generally means that the associated objects before and after are in an "or" relationship.
[0045] The multifunctional form filling station of the present application is described below with reference to the accompanying drawings.
[0046] The current form filling stations have a single function and only provide personnel with a desk for writing. They are unable to respond promptly to the different form filling needs of different personnel and provide form filling guidance, resulting in congestion near the form filling stations and low form filling efficiency.
[0047] In response to the above-mentioned problems, the present application discloses a multifunctional form filling station, which obtains video stream data at the reception position 11 through a camera module 2 arranged at the reception position 11, and then detects and analyzes the video stream data to determine whether the person arriving at the reception position 11 has a form filling request. When it is detected and analyzed that there is a person with a form filling request at the reception position 11, the form filling position 12 is allocated to the person with the form filling request according to the vacancy of the form filling position 12. After that, after the corresponding person with the form filling request arrives at the form filling position 12, the voice receiving module 3 receives the voice information at the form filling position 12, the voice analysis module analyzes the voice information to generate a form filling type, and then the display device 4 displays the document guidance template corresponding to the form filling type for the person to view, thereby achieving the effect of form filling guidance and filling instructions.
[0048] Figure 1 is a schematic diagram of the structure of a multifunctional form filling station according to an embodiment of the present application. Figure 1 As shown, the multifunctional form filling station includes a station body 1, and the station body 1 includes a reception position 11 and at least one form filling position 12; the station body 1 has a reception position 11 for receiving personnel, and at least one form filling position 12 for personnel to fill in forms. In some embodiments, there may be multiple reception positions 11, and multiple form filling positions 12 may also be provided to provide reception and filling for multiple people. The station body 1 may be in the shape of a long cabinet, or may be in the shape of a circular ring, a semi-circular ring, etc. The specific shape of the station body 1 is not limited here;
[0049] Reference Figure 1 and Figure 2A camera module 2 is provided at the reception position 11, and the camera module 2 is used to shoot the reception position 11 to obtain video stream data of the reception position 11. The platform body 1 is built with a form filling analysis module and a position allocation module, wherein the form filling analysis module is connected to the camera module 2 for communication, and the form filling analysis module receives the video stream data collected from the camera module 2, and detects and analyzes the video stream data of the reception position 11 to determine whether there is a person with a form filling request;
[0050] The position allocation module is used to allocate the form filling position 12 to the person with the form filling request according to the availability of the form filling position 12 when the analysis module detects and analyzes that there is a person with the form filling request at the reception position 11;
[0051] For example, person A arrives at reception position 11, and the camera module 2 collects video stream data of reception position 11. The form filling analysis module monitors and analyzes the collected video stream data. When person A makes a specific action, it is determined that person A has a form filling request. Then there is a person with a form filling request at reception position 11. At this time, the position allocation module allocates form filling position 12 to person A based on the vacancy of form filling position 12.
[0052] The form filling position 12 is provided with a voice receiving module 3, and the voice receiving module 3 is used to receive the voice information at the form filling position 12;
[0053] The platform 1 also has a built-in voice analysis module, which is connected to the voice receiving module 3 for communication. The voice analysis module is used to analyze the voice information to generate the form type.
[0054] For example, a reminder message can be set at the form filling position 12, for example, a paper with the message "Please verbally describe the to-do items" can be posted, or an electronic display screen and a sensing device at the front end can be used to sense whether there is a person at the form filling position 12. When it is sensed that there is a person at the form filling position 12, the sensing device sends a start signal to the electronic display screen, and the electronic display screen displays an electronic reminder message "Please verbally describe the to-do items" after receiving the start signal. After person A arrives at the form filling position 12, he starts to speak, and the voice receiving module 3 receives the voice information. The voice analysis module receives the voice information sent from the voice receiving module 3 and analyzes the voice information to generate the form filling type;
[0055] A display device 4 is also provided at the form filling position 12, and the display device 4 is used to display a document guide template corresponding to the form filling type. The document guide template can be a blank document with filling items marked, that is, the filling items are marked in each place that needs to be filled in the corresponding unfilled document, which can be electronically marked, or it can be a document guide module scanned into the system after paper marking; when the document guide template is displayed on the display device 4, the personnel can select the document pre-placed at the form filling position 12. In addition, for the acquisition of documents, the document corresponding to the document guide template can also be printed out by a printing device to enable the personnel to obtain the document.
[0056] In one embodiment, the document guiding template is stored in a database module, which stores a mapping relationship table between form filling types and document guiding templates. The database matches the corresponding document guiding template according to the form filling type and sends the document guiding template to the display device 4.
[0057] In one embodiment, the form filling position 12 is further provided with a form placement position 5, and a sensing module disposed at the form placement position 5, the sensing module is used to sense the pressure of each point of the form placement position 5 and display prompt information at the corresponding position of the form guide template. For example, when a form is placed at the form placement position 5, the form guide template is configured to mark the filling items on the electronic form in an electronic marking manner, and only after receiving the pressure signal at the corresponding position, the marking of the filling items at the position will be displayed at the corresponding position of the electronic form, so that when a person fills in or touches the form placed at the form placement position 5 with a pen, prompt information, i.e., marking of the filling items, is displayed at the corresponding position of the form guide template.
[0058] For example, a document slot 6 is provided at the form filling position 12 of the platform 1, and the document slot 6 contains a document placement position 5 for placing the document. The slot shape is adapted to the document to achieve a limiting effect. Furthermore, the document slot 6 can be provided in multiple numbers to accommodate different documents.
[0059] In another embodiment, the above-mentioned allocating a form filling position 12 to a person having a form filling request according to the availability of the form filling position 12 includes:
[0060] When there are vacant form filling positions 12, the form filling positions 12 are allocated according to the distance between each vacant form filling position 12 and the reception position 11;
[0061] When there is no idle form filling position 12, a waiting message is issued.
[0062] To determine whether the form filling position 12 is vacant, the above-mentioned sensing device can be used to sense whether there is a person at the form filling position 12. When it is sensed that there is a person at the form filling position 12, it indicates that the form filling position 12 is in an occupied state; when no person is sensed at the form filling position 12, it indicates that the form filling position 12 is vacant; when at least one sensing device determines that the form filling position 12 is vacant, it indicates that there is a vacant form filling position 12; when no sensing device determines that the form filling position 12 is vacant, it indicates that there is no vacant form filling position 12.
[0063] It can be understood that allocating the form filling positions 12 according to their distance from the reception position 11 is based on the principle of distance priority. Among all the free form filling positions 12, the position closest to the reception position 11 is selected as the allocated form filling position 12. The distance can be determined by pre-measurement and setting, or by sorting the distances from each form filling position 12 to the reception position 11 in advance.
[0064] Optionally, the multifunctional form filling station further includes a broadcasting module 7, which can be arranged at the reception position 11 or near the reception position 11, which is not limited here, and the broadcasting module 7 is used to send a guidance prompt sound after the position allocation module allocates the form filling position 12. For example, after the position allocation module allocates the form filling position 12, the information of the form filling position 12 is sent to the broadcasting module 7, and after the broadcasting module 7 receives the information of the form filling position 12, it broadcasts the corresponding form filling position 12 number.
[0065] Furthermore, the above-mentioned detection and analysis of the video stream data of the reception position 11 to determine whether there is a person with a form filling request includes:
[0066] Input each frame of the video stream data into the pre-trained first analysis model for inference to obtain whether there is a person with a form filling request in each frame of the video stream data;
[0067] The first analysis model is trained in the following way:
[0068] Each image sample in the image sample training set is annotated to indicate whether there is a person with a form filling request in each image sample; and a neural network is trained using the annotated image sample training set to obtain a first analysis model.
[0069] The collection of image samples can be to collect video stream data of people who have arrived at the reception position 11 in the past, so as to obtain and classify images of people with form filling requests and images of people without form filling requests; when the camera module 2 is relatively fixed, background modeling can also be performed, the foreground can be set, and the foreground can be removed in each frame image to improve the recognition accuracy.
[0070] The above analysis of voice information to generate form filling types includes:
[0071] Input the voice information into the pre-trained second analysis model for inference to obtain the form type;
[0072] The second analysis model is trained in the following way:
[0073] Each speech information sample in the speech information sample training set is labeled to mark the form-filling type in each speech information sample, and the form-filling type is associated with all or part of the information in the speech information sample; and a neural network is trained using the labeled speech information sample training set to obtain a second analysis model.
[0074] Among them, the collection of voice information samples can be to obtain samples by recording the voice information of personnel when applying for and filling out documents in the past, and then denoising and labeling these samples accordingly, marking the type of form filling corresponding to each voice information sample, and then training the neural network to obtain a second analysis model.
[0075] In another embodiment, when the form filling analysis module detects and analyzes that there is a person with a form filling request, the voice receiving module 3 starts to receive voice information;
[0076] That is, the voice receiving module 3 is connected to the form filling analysis module for communication. When the form filling analysis module detects and analyzes that there is a person with a form filling request, it sends a start message, the voice receiving module 3 receives the start message, and then starts to receive voice messages.
[0077] Various implementations of the systems and techniques described herein can be realized in digital electronic circuit systems, integrated circuit systems, dedicated ASICs (application specific integrated circuits), computer hardware, firmware, software, and / or combinations thereof. These various implementations may include being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.
[0078] These computer programs (also referred to as programs, software, software applications, or code) include machine instructions for programmable processors and can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, device, and / or means (e.g., disk, optical disk, memory, programmable logic device (PLD)) for providing machine instructions and / or data to a programmable processor, including a machine-readable medium that receives machine instructions as machine-readable signals. The term "machine-readable signal" refers to any signal for providing machine instructions and / or data to a programmable processor.
[0079] To provide interaction with a user, the systems and techniques described herein may be implemented on a computer having: a display device 4 (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).
[0080] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.
[0081] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this application can be executed in parallel, sequentially or in different orders, as long as the expected results of the technical solution disclosed in this application can be achieved, and this document is not limited here.
[0082] The above specific implementations do not constitute a limitation on the protection scope of this application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of this application should be included in the protection scope of this application.
Claims
1. A multifunctional form filling machine, characterized in that: include: A platform body, the platform body comprising a reception position and at least one form filling position; A camera module disposed at the reception location for acquiring video stream data of the reception location; The form filling analysis module is used to detect and analyze the video stream data of the reception position to determine whether there is a person with a form filling request; specifically, each frame of the video stream data is input into a pre-trained first analysis model for inference, Get whether there is a person with a form filling request in each frame of the video stream data; the first analysis model is through the following The training is obtained by: labeling each image sample in the image sample training set to label each image sample whether there is a person who has a form filling request in the current case; and to train the neural network through the labeled image sample training set. Perform training to obtain a first analysis model; A position allocation module, configured to allocate a form filling position to the person with the form filling request according to the availability of the form filling position when the analysis module detects and analyzes that there is a person with a form filling request at the reception position; A voice receiving module disposed at the form filling location for receiving voice information at the form filling location; A voice analysis module, used for analyzing the voice information to generate a form filling type; A display device provided at the form filling position, the display device being used to display a document guide template corresponding to the form filling type; The voice information is analyzed to generate the form filling type, including: Inputting the voice information into a pre-trained second analysis model for inference to obtain the form type; The second analysis model is trained by: Each speech information sample in the speech information sample training set is labeled to mark the form-filling type in each speech information sample, and the form-filling type is associated with all or part of the information in the speech information sample; and a neural network is trained using the labeled speech information sample training set to obtain a second analysis model.
2. The multifunctional form filling station according to claim 1, characterized in that: Also includes: A document placement location is arranged at the form filling location, and a sensing module is arranged at the document placement location, wherein the sensing module is used to sense the pressure at each point of the document placement location and display prompt information at a corresponding position of the document guide template.
3. The multifunctional form filling station according to claim 2, characterized in that: The platform body is provided with a document slot, and the document slot is a place for placing documents.
4. The multifunctional form filling station according to claim 1, characterized in that: Also includes: A broadcast module, wherein the broadcast module is used to issue a guiding prompt tone after the position allocation module allocates a form filling position.
5. The multifunctional form filling station according to claim 1, characterized in that: The allocating a form filling position to the person having the form filling request according to the availability of the form filling position comprises: When there are vacant form filling positions, the form filling positions are allocated according to the distance between each vacant form filling position and the reception position; When there is no free form filling position, a waiting message is issued.
6. The multifunctional form filling station according to claim 1, characterized in that: When the form filling analysis module detects and analyzes that there is a person with a form filling request, the voice receiving module starts to receive voice information.
7. The multifunctional form filling station according to claim 1, characterized in that: Also includes: The database module stores a mapping relationship table between form filling types and document guide templates. The database matches the corresponding document guide template according to the form filling type and sends the document guide template to the display device.
Citation Information
Patent Citations
Novel customer identification and form-filling preprocessing system based on multichannel processing
CN104318356A
Intelligent voice interaction type self-service bill filling and printing system
CN106815940A
