Terminal mode switching method, system and equipment based on face recognition and medium
Through the terminal mode switching method based on face recognition, the operation mode and interface of the self-service terminal are automatically adjusted, which solves the problems of difficulty and high labor costs for the elderly, and achieves a more convenient user experience and lower operating costs for the elderly.
Patent Information
- Application Number
- CN202410987768.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-23
- Publication Date
- 2024-11-12
AI Technical Summary
The existing self-service terminal equipment has problems such as difficulty in operation and high labor costs when used by the elderly, especially the limited effect of voice prompt assistance, which cannot meet the 24-hour use scenario.
The terminal mode switching method based on face recognition is adopted, and the user's facial images are collected through the camera, the user's age attributes are analyzed, and the operation mode is automatically switched to the elder mode, and the interface and voice guidance are optimized to adapt to the operation needs of the elderly.
Without anyone’s intervention, the user experience of the elderly has been improved, labor costs have been reduced, and the problem of difficulty in operating the elderly has been solved, which has improved the applicability and usage rate of self-service terminals.
Smart Images

Figure CN118942180A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of self-service terminals, and in particular to a terminal mode switching method, system, device and medium based on face recognition. Background Art
[0002] With the digital upgrade of business scenarios, more and more self-service terminal devices are being put into various business scenarios, including government halls, banks, hospitals, shopping malls and other places. The fast and convenient use characteristics can be quickly adapted and accepted by young people. As the functions of self-service terminal devices become more and more complete, the business coverage is getting higher and higher, and the functional complexity is also increasing. Young people have a strong ability to learn and accept new things, and may not think it is a problem. However, for the elderly, it is difficult to operate and use. The function menu selection and interface text reading on the interface have hindered the further use of the elderly.
[0003] Current solutions for assisting the elderly in using self-service terminals include voice prompts to guide operations. This solution uses voice prompts to provide the required operations for each step, and the user makes further operations based on the guidance and their own understanding. Although this solution plays a certain auxiliary role, for the elderly, the operation and display of the entire operation process have not changed, and it is still difficult to use, and the auxiliary effect is not obvious.
[0004] Another common assistance program for the elderly is human intervention. Staff or volunteers are arranged to provide guidance on the operation of the self-service machines to the elderly who need help next to the self-service terminals, so as to help them handle the required business more quickly. Although this program is the most friendly to assisting the elderly, it requires a lot of human resources. For self-service terminals that need to be used 24 hours a day, it is difficult to provide round-the-clock human assistance.
[0005] In summary, the existing solutions have the following defects: Waste of manpower: Using dedicated personnel to assist the elderly will increase labor costs, which is especially obvious when the number of devices is large. It increases the cost of device operation and is not conducive to device promotion. Manual assistance cannot meet 24-hour usage scenarios.
[0006] Large limitations: Voice prompts have limited assistive effect on the operation of the elderly; the elderly are not aware of voice prompts, especially due to environmental conditions, a large number of devices, concentrated and interspersed voice prompts, and noisy human voices, which reduces the guiding effect on users and makes it difficult to accurately assist the elderly.
[0007] Poor applicability: None of the existing solutions solves the problem of operational difficulties faced by the elderly from the root; the key problem is that the business processing procedures and interface displays are not friendly to the elderly, such as small interface text, overly complex screens, and too many business function options, which still leads to poor applicability of existing solutions. Summary of the invention
[0008] The object of the present invention is to provide a terminal mode switching method, system, device and medium based on face recognition, so as to solve all or one of the above problems existing in the prior art.
[0009] In order to solve the above technical problems, the specific technical solutions of the present invention are as follows: On the one hand, the present invention provides a terminal mode switching method based on face recognition, comprising the following steps: Face collection and recognition: Call the self-service terminal camera to collect the user's facial image; User attribute judgment: Analyzing the user's age attribute based on the collected facial image of the user; Operation mode switching: The operation mode of the self-service terminal is switched to the senior mode or maintained in the normal mode according to the user's age attribute.
[0010] As an improved solution, calling the self-service terminal camera to collect the user's facial image includes: In response to the user entering the camera recognition range of the self-service terminal, the camera of the self-service terminal is called to capture the user's facial image.
[0011] As an improved solution, the analyzing the user age attribute based on the collected user facial image includes: Setting judgment thresholds for the elderly; Analyzing the user's age stage based on the user's facial image based on a face recognition algorithm; The analyzed age stage of the user is compared with the elderly judgment threshold to obtain an elderly result or a non-elderly result as the user age attribute.
[0012] As an improved solution, the method of switching the operation mode of the self-service terminal to the elder mode or keeping the operation mode of the self-service terminal in the normal mode according to the user's age attribute includes: When the user age attribute is the elderly result, it is determined whether the current operation mode of the self-service terminal device is the elder mode; if not the elder mode, the operation mode of the self-service terminal is switched to the elder mode.
[0013] As an improved solution, the method of switching the operation mode of the self-service terminal to the elder mode or keeping the operation mode of the self-service terminal in the normal mode according to the age attribute of the user further includes: When the user age attribute is the elderly result, it is determined whether the current operation mode of the self-service terminal device is the elder mode; if it is the elder mode, the operation mode of the self-service terminal is maintained as the elder mode.
[0014] As an improved solution, the method of switching the operation mode of the self-service terminal to the elder mode or keeping the operation mode of the self-service terminal in the normal mode according to the age attribute of the user further includes: When the user age attribute is not the elderly result, it is determined whether the current operation mode of the self-service terminal device is the normal mode; if it is the normal mode, the operation mode of the self-service terminal is maintained as the normal mode.
[0015] As an improved solution, the switching of the operation mode of the self-service terminal to the elder mode includes: Enlarging the icons and texts on the self-service terminal application interface; Simplifying the interface of the self-service terminal; reducing the function menu level of the self-service terminal; Increase the volume of the voice guidance prompts of the self-service terminal; Improve the interface timeout period of the self-service terminal.
[0016] On the other hand, the present invention also provides a terminal mode switching system based on face recognition, comprising: The face collection and recognition module is used to: call the self-service terminal camera to collect the user's facial image; A user attribute judgment module is used to: analyze the user's age attribute based on the collected user's facial image; The operation mode switching module is used to switch the operation mode of the self-service terminal to the elder mode or keep the operation mode of the self-service terminal in the normal mode according to the age attribute of the user.
[0017] On the other hand, the present invention also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the terminal mode switching method based on face recognition are implemented.
[0018] On the other hand, the present invention further provides a computer device, comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; wherein: The memory is used to store computer programs; The processor is used to execute the steps of the terminal mode switching method based on face recognition by running the program stored in the memory.
[0019] The beneficial effects of the technical solution of the present invention are: 1. The terminal mode switching method based on face recognition described in the present invention can realize the promotion and use of self-service terminal equipment in various business scenarios. It can automatically provide operation assistance to the elderly without human intervention, greatly improving the user experience of the elderly; it can better release the dependence on human assistance, so that more elderly people can independently complete the business operations of the self-service terminal and reduce the investment in human costs; it solves the problem of difficulty in operation for the elderly from the source: by switching the elder mode, it optimizes and transforms the operation interface, operation process, menu selection, sound prompts and other aspects, which is more suitable for the elderly to operate independently, making up for the defects of the existing technology and having high application value.
[0020] 2. The terminal mode switching system based on face recognition described in the present invention can realize the terminal mode switching method based on face recognition described in the present invention through the mutual cooperation of system modules.
[0021] 3. The computer-readable storage medium described in the present invention can realize the cooperation of the guidance system module, thereby realizing the terminal mode switching method based on face recognition described in the present invention, and the computer-readable storage medium described in the present invention also effectively improves the operability of the terminal mode switching method based on face recognition.
[0022] 4. The computer device described in the present invention can store and execute the computer-readable storage medium, thereby realizing the terminal mode switching method based on face recognition described in the present invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0024] Figure 1 is a flowchart of the terminal mode switching method based on face recognition according to Embodiment 1 of the present invention; Figure 2 It is a logical flow diagram of the terminal mode switching method based on face recognition described in Example 1 of the present invention; Figure 3Schematic diagram of the architecture of the terminal mode switching system based on face recognition according to Embodiment 2 of the present invention; Figure 4 is a schematic diagram of the structure of the computer device described in Example 4 of the present invention; The symbols in the accompanying drawings are explained as follows: 1501, processor; 1502, communication interface; 1503, memory; 1504, communication bus. DETAILED DESCRIPTION
[0025] The preferred embodiments of the present invention are described in detail below in conjunction with the accompanying drawings so that the advantages and features of the present invention can be more easily understood by those skilled in the art, thereby making a clearer and more definite definition of the protection scope of the present invention.
[0026] In the description of the present invention, it should be noted that the embodiments described in the present invention are only part of the embodiments of the present invention, rather than all of the embodiments; based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present invention.
[0027] The terms "first", "second", etc. in the specification and claims of this article and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of this article described here can be implemented in an order other than those illustrated or described here. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, device, product or equipment that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or equipment. Example 1
[0028] This embodiment provides a terminal mode switching method based on face recognition, such as Figure 1 and Figure 2 As shown, the following steps are included: The core function of this method is: based on face recognition technology, face recognition is performed on users in front of the self-service terminal, and the user's age is evaluated through an algorithm. If the user is determined to be an elderly person, the operation mode of the self-service terminal application interface will be automatically switched to the senior mode. The senior mode is optimized for the elderly in terms of user interface display and business menu logic, which is more suitable for the elderly to operate and use, thereby greatly improving the utilization rate of the self-service terminal, better meeting the use and operation needs of the elderly, reducing the difficulty of use for the elderly, and improving the use experience of the elderly, as follows: S100, face collection and recognition: In this step, the self-service terminal camera is called to automatically capture the user's facial image; Specifically, when a user enters the recognition range of the camera equipped with the self-service terminal, the camera of the self-service terminal will be triggered to capture and collect the user's facial image; S200, user attribute determination: In this step, age attribute analysis is performed based on the collected facial images through algorithms; Specifically, the self-service terminal's internal algorithm will perform algorithmic analysis on the facial image captured by the camera, and through the analysis, the user's age will be determined, and compared with the set elderly judgment threshold to give a result of whether the user is elderly. S300, operation mode switching: In this step, the analyzed age attribute result is identified to determine whether the person is an elderly person; if the person is determined to be an elderly person, the operation mode of the self-service terminal is automatically switched to the elder mode; if the person is determined to be a non-elderly person, the operation mode of the self-service terminal remains unchanged in the normal mode; Specifically, it is determined whether the current user attribute result matches the operation mode. If they match, the operation mode remains unchanged. If they do not match, the operation mode is automatically switched according to the user attribute. Specifically, in the elder mode, the icon text of the application interface is enlarged, the interface is simplified, the function menu level is reduced, and the corresponding voice guidance prompt volume is increased, and the interface timeout time is increased to solve the problem of timeout caused by the elderly's lack of operational proficiency.
[0029] It should be noted that the above examples are only for explaining the present invention and cannot limit the protection scope of the present invention. Example 2
[0030] This embodiment is based on the same inventive concept as the terminal mode switching method based on face recognition described in Embodiment 1, and provides a terminal mode switching system based on face recognition, such as Figure 3 As shown, including: The face collection and recognition module is used to: call the self-service terminal camera to automatically collect the user's facial image; Specifically, when a user enters the recognition range of the camera equipped with the self-service terminal, the camera of the self-service terminal will be triggered to capture and collect the user's facial image; User attribute judgment module, used to: perform age attribute analysis based on the collected facial images through algorithms; Specifically, the self-service terminal's internal algorithm will perform algorithmic analysis on the facial image captured by the camera, and through the analysis, the user's age will be determined, and compared with the set elderly judgment threshold to give a result of whether the user is elderly. The operation mode switching module is used to: identify the analyzed age attribute results to determine whether the person is an elderly person; if the person is determined to be an elderly person, the operation mode of the self-service terminal is automatically switched to the elder mode; if the person is determined to be a non-elderly person, the operation mode of the self-service terminal remains unchanged in the normal mode; Specifically, it is determined whether the current user attribute result matches the operation mode. If they match, the operation mode remains unchanged. If they do not match, the operation mode is automatically switched according to the user attribute. Specifically, in the elder mode, the icon text of the application interface is enlarged, the interface is simplified, the function menu level is reduced, and the corresponding voice guidance prompt volume is increased, and the interface timeout time is increased to solve the problem of timeout caused by the elderly's lack of operational proficiency.
[0031] It should be noted that the above examples are only for explaining the present invention and cannot limit the protection scope of the present invention. Example 3
[0032] This embodiment provides a computer-readable storage medium, including: The storage medium is used to store computer software instructions used to implement the terminal mode switching method based on face recognition described in the above-mentioned Example 1, which includes a program for executing the above-mentioned program set for the terminal mode switching method based on face recognition; specifically, the executable program can be built into the terminal mode switching system based on face recognition described in Example 2, so that the terminal mode switching system based on face recognition can implement the terminal mode switching method based on face recognition described in Example 1 by executing the built-in executable program.
[0033] In addition, the computer-readable storage medium of this embodiment may adopt any combination of one or more computer-readable storage media, wherein the computer-readable storage medium includes electrical, optical, electromagnetic, infrared or semiconductor systems, devices or components, or any combination thereof. Example 4
[0034] This embodiment provides an electronic device, such as Figure 4 As shown, the electronic device may include: a processor 1501 , a communication interface 1502 , a memory 1503 and a communication bus 1504 , wherein the processor 1501 , the communication interface 1502 , and the memory 1503 communicate with each other via the communication bus 1504 .
[0035] Memory 1503, used for storing computer programs; The processor 1501 is used to implement the steps of the terminal mode switching method based on face recognition described in the above embodiment 1 when executing the computer program stored in the memory 1503.
[0036] As an embodiment of the present invention, the communication bus mentioned in the above terminal can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The communication bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 4 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.
[0037] As an implementation mode of the present invention, the communication interface is used for communication between the above-mentioned terminal and other devices.
[0038] As an embodiment of the present invention, the memory may include a random access memory (RAM) or a non-volatile memory, such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.
[0039] As an embodiment of the present invention, the above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.
[0040] Different from the prior art, the present application adopts a terminal mode switching method, system, device and medium based on face recognition, which can be promoted and used in self-service terminal equipment in various business scenarios. Without human intervention, it can automatically provide operation assistance to the elderly, greatly improving the user experience of the elderly; it can better release the dependence on human assistance, so that more elderly people can independently complete the business operations of self-service terminals and reduce the investment in labor costs; it solves the problem of difficult operation for the elderly from the source: by switching the elder mode, it optimizes and transforms the operation interface, operation process, menu selection, sound prompts and other aspects, which is more suitable for the elderly to operate independently, makes up for the defects of the prior art, and has high application value.
[0041] It should be understood that in the various embodiments of this document, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this document.
[0042] It should also be understood that in the embodiments of this article, the term "and / or" is only a description of the association relationship of the associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.
[0043] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this article.
[0044] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0045] In the several embodiments provided herein, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, or can be electrical, mechanical or other forms of connection.
[0046] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiments of this article.
[0047] In addition, each functional unit in each embodiment of this invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit may be implemented in the form of hardware or in the form of software functional unit.
[0048] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this article is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of this article. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.
[0049] The above descriptions are merely embodiments of the present invention and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.
Claims
1. A terminal mode switching method based on face recognition, It is characterized in that The following steps are involved: Face collection and recognition: Call the self-service terminal camera to collect the user's facial image; User attribute judgment: Analyzing the user's age attribute based on the collected facial image of the user; Operation mode switching: The operation mode of the self-service terminal is switched to the elder mode or maintained in the normal mode according to the user's age attribute.
2. The terminal mode switching method based on face recognition according to claim 1, Features: The calling of the self-service terminal camera to collect the user's facial image includes: In response to the user entering the camera recognition range of the self-service terminal, the camera of the self-service terminal is called to capture the user's facial image.
3. The terminal mode switching method based on face recognition according to claim 1, Features: The analyzing the user's age attribute based on the collected user's facial image includes: Setting judgment thresholds for the elderly; Analyzing the user's age stage based on the user's facial image based on a face recognition algorithm; The analyzed age stage of the user is compared with the elderly judgment threshold to obtain an elderly result or a non-elderly result as the user age attribute.
4. The terminal mode switching method based on face recognition according to claim 3, Features: The step of switching the operation mode of the self-service terminal to the elder mode or keeping the operation mode of the self-service terminal in the normal mode according to the user's age attribute includes: When the user age attribute is the elderly result, it is determined whether the current operation mode of the self-service terminal device is the elder mode; if not the elder mode, the operation mode of the self-service terminal is switched to the elder mode.
5. The terminal mode switching method based on face recognition according to claim 3, Features: The switching of the operation mode of the self-service terminal to the elder mode or keeping the operation mode of the self-service terminal in the normal mode according to the user age attribute also includes: When the user age attribute is the elderly result, it is determined whether the current operation mode of the self-service terminal device is the elder mode; if it is the elder mode, the operation mode of the self-service terminal is maintained as the elder mode.
6. The terminal mode switching method based on face recognition according to claim 3, Features: The switching of the operation mode of the self-service terminal to the elder mode or keeping the operation mode of the self-service terminal in the normal mode according to the user age attribute also includes: When the user age attribute is not the elderly result, it is determined whether the current operation mode of the self-service terminal device is the normal mode; if it is the normal mode, the operation mode of the self-service terminal is maintained as the normal mode.
7. The terminal mode switching method based on face recognition according to claim 3, Features: The step of switching the operation mode of the self-service terminal to the elder mode includes: Enlarging the icons and texts on the self-service terminal application interface; Simplifying the interface of the self-service terminal; reducing the function menu level of the self-service terminal; Increase the volume of the voice guidance prompts of the self-service terminal; Improve the interface timeout period of the self-service terminal.
8. A terminal mode switching system based on face recognition, It is characterized in that include: The face collection and recognition module is used to: call the self-service terminal camera to collect the user's facial image; A user attribute judgment module is used to: analyze the user's age attribute based on the collected user's facial image; The operation mode switching module is used to switch the operation mode of the self-service terminal to the elder mode or keep the operation mode of the self-service terminal in the normal mode according to the age attribute of the user.
9. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by the processor, the steps of the terminal mode switching method based on face recognition in any one of claims 1 to 7 are implemented.
10. A computer device, It is characterized in that It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; wherein: The memory is used to store computer programs; The processor is used to execute the steps of the terminal mode switching method based on face recognition in any one of claims 1 to 7 by running the program stored in the memory.
Citation Information
Cited By
Intelligent power bank renting method and device based on user attributes and renting equipment
CN119888925A
