Method for processing a transaction, system and corresponding program
Patent Information
- Application Number
- EP2023700966
- Authority / Receiving Office
- EP · EP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-01-14
- Filing Date
- 2023-01-13
- Publication Date
- 2024-11-20
AI Technical Summary
Existing transaction processing systems fail to adequately secure sensitive information entry on digital terminals from spying threats such as shoulder surfing and malware, as conventional privacy measures like privacy films are ineffective and user-dependent, and do not account for the broader environmental context.
A method and system that utilize a picture-taking device connected to the terminal to analyze the user's environment, detecting faces and radioelectric activity to assess security, triggering warnings, masking screens, or blocking input zones when unsecured conditions are detected, and updating a database for frequent face recognition to identify potential risks.
Enhances transaction security by proactively alerting users and merchants to potential spying risks, ensuring sensitive data entry occurs in a secure environment beyond the camera's field of view, and reducing false positives through biometric analysis and environmental context evaluation.
Smart Images

Figure 1.1
Abstract
Description
[0001] DESCRIPTION
[0002] TITLE: Transaction processing method, system and corresponding program
[0003] 1. Domain
[0004] The invention relates to the field of securing transactions. More particularly, the invention relates to securing transactions, involving the entry, by a user, of sensitive information on an input device. The invention aims more particularly to secure such input.
[0005] 2. Prior Art
[0006] The digitalization of the economy and the explosion in the use of digital technologies have radically changed our lives. In particular, the use of increasingly intelligent communication terminals has certainly opened up new possibilities for interacting with many institutions and services while increasing security risks. Among the security issues raised, the theft of sensitive information is a difficult threat to counter. Indeed, it is very common to have to enter sensitive data (credit card number, PIN code, account number, etc.) on a digital device, for example a public one, which fraudsters are fond of.To be able to access this data entered without the user's knowledge, two main techniques are implemented: the first technique consists of inserting one or more spyware programs into the digital terminal, the objective of which is to recover the sensitive data entered by the user to transmit them to fraudsters via the communication networks to which the digital device is connected. The second, simpler technique consists of spying on the entries made by the user. In English, this technique is called "Shoulder Surfing".
[0007] To prevent these spying problems, one technique can be to use a privacy film to ensure that the terminal screen can only be seen clearly when the line of sight and the screen are within a certain angle range using optical principles. But with this technique, there is no way to prevent spying from a viewing angle close to that of the legitimate user. In addition, the privacy film affects the brightness of the screen and it is up to the user to ensure that it is in good conditions of use.
[0008] It is therefore necessary to provide complementary systems and techniques which make it possible to preserve the confidentiality of the information displayed on the screen of the device while reducing the disadvantages of the prior art. 3. Summary
[0009] The technique designed by the inventors has been tested to address at least in part the issues raised by the prior art. Thus, the present disclosure relates to a method for processing a transaction of the type comprising the provision, by a user, of sensitive data on a digital terminal. Such a method comprises: a step of initialization by the digital terminal, of a transaction requiring the entry of the sensitive data; a step of obtaining, after initialization, by means of a shooting device connected to the terminal, multimedia data representative of an environment of the user; a step of analysis of the previously obtained multimedia data; and a step of modification of a context of implementation of the transaction when the step of analysis of the multimedia data delivers a result representative of an unsecured environment.
[0010] This makes it possible to take into account the user's environment to assess whether or not the user can safely enter sensitive data.
[0011] According to a particular characteristic, the analysis step comprises: a step of searching, within the multimedia data, for a set of at least one face; when the number of faces is greater than or equal to two, a step of providing the result representative of an unsecured environment.
[0012] Thus, disclosure makes it easier to segregate risky situations, in which multiple faces are detected, to estimate the security level of the user's environment.
[0013] According to a particular characteristic, the analysis step comprises: a step of searching, within the multimedia data, for a set of at least one face; when the number of faces is equal to one, a step of searching, within the detected face, for an orientation of the eyes of the detected face; and when the orientation of the eyes of the detected face indicates that the user is not looking at the screen of the terminal, a step of providing the result representative of an unsecured environment. Thus, it is possible to determine whether the user is actively focused on the task of entering the sensitive data, in order to trigger, for example, the masking of the screen when the user is not looking at it.
[0014] According to a particular characteristic, the obtaining step comprises a step of obtaining, from sensors of the digital terminal, at least one piece of data representative of the radio electrical environment of the digital terminal and the analysis step comprises, when the data representative of the radio electrical environment is not in conformity with an expected value, a step of providing the result representative of an unsecured environment.
[0015] Thus, the technique does not only take into account data from the visual sensor, but also changes in the radio environment, which may represent the premises of a coordinated attack, consisting for example of spying on the user's input and obtaining digital data from the digital terminal with the aim of combining the data from the radio attack with those obtained by spying on the user. In addition, the analysis of the radio environment associated with the analysis of the visual environment makes it possible to respond to the orientation constraints of the shooting device. Indeed, the analysis of the radio environment makes it possible not to limit the secure environment to the field of vision of the shooting device.In combination with multimedia data analysis, the entire terminal environment is secured, whether the risk is within the field of vision of the shooting device or not.
[0016] According to a particular characteristic, the analysis step comprises, when the data representative of the radioelectric environment is in conformity with said expected value, said step of searching, within the multimedia data, for a set of at least one face.
[0017] Indeed, it is best to first ensure that the terminal is not under cyberattack, and only then check the visual environment. This is the optimal strategy.
[0018] According to a particular characteristic, the step of modifying the context of implementation of the transaction comprises: a step of displaying, to the user, a warning message relating to the detection of the unsecured environment; a step of alerting a terminal manager; a step of masking at least one item of information displayed on the terminal screen; and / or a step of blocking a sensitive data entry zone. According to a particular characteristic, the step of modifying the context of implementation of the transaction further comprises a step of displaying, to the user, a warning message relating to the detection of the unsecured environment.
[0019] According to a particular characteristic, after the step of displaying the warning message relating to the detection of the unsecured environment, the method comprises a step of receiving, by the digital terminal, data representing an acceptance, by the user, of the continuation of the entry of the sensitive data.
[0020] According to a particular characteristic, the step of modifying a context for implementing the transaction comprises, when at least two faces are detected within the multimedia data: a step of calculating biometric characteristics of at least one of the at least two detected faces; and a step of updating, within the terminal itself, or a device connected to the terminal, a database of characteristics of detected faces.
[0021] Thus, it is possible to keep detected face occurrences to perform a correlation of the detected faces in order to identify the most frequent occurrences.
[0022] According to a particular characteristic, the step of updating a database of detected face characteristics comprises a search, within the database, for composite identifiers of face characteristics corresponding to the characteristics calculated for a current face, and when such data are already present in the database for the current face, a step of incrementing a counter relating to these characteristics for this current face.
[0023] Thus, it is possible to count the appearances of a face, and to detect a face which appears abnormally often (potentially a lookout).
[0024] According to a particular characteristic, the step of modifying the context of implementation of the transaction comprises: when the data representative of the radioelectric environment is not in conformity with an expected value, or when the counter associated with the characteristics calculated for a current face exceeds a predetermined ceiling, the step of alerting the terminal manager; when the orientation of the eyes of the detected face indicates that the user is not looking at the terminal screen, or when the number of faces is greater than or equal to two, the step of masking at least one piece of information displayed on the terminal screen; and when the number of faces is greater than or equal to two, the step of displaying, to the user, a warning message relating to the detection of the unsecured environment and / or the step of blocking a sensitive data entry zone.
[0025] According to another aspect, the invention also relates to a digital terminal suitable for processing a transaction of the type comprising the provision, by a user, of sensitive data on the digital terminal. Such a terminal comprises: means for initializing, by the digital terminal, a transaction requiring the entry of the sensitive data; means for obtaining, after initialization, via a shooting device connected to the terminal, multimedia data representative of an environment of the user; means for analyzing the previously obtained multimedia data; and means for modifying a context for implementing the transaction when the means for analyzing the multimedia data deliver a result representative of an unsecured environment.
[0026] According to a preferred implementation, the different steps of the methods according to the present disclosure are implemented by one or more software or computer programs, comprising software instructions intended to be executed by a data processor of an execution terminal according to the present technique and being designed to control the execution of the different steps of the methods, implemented at the level of a communication terminal, a remote server and / or a blockchain, within the framework of a distribution of the processing operations to be carried out and determined by a scripted source code or a compiled code.
[0027] Accordingly, the present technique also relates to programs, capable of being executed by a computer or by a data processor, these programs comprising instructions for controlling the execution of the steps of the methods as mentioned above.
[0028] A program may use any programming language, and may be in the form of source code, object code, or intermediate code between source code and object code, such as in a partially compiled form, or in any other desirable form. The present technique also provides an information medium readable by a data processor, and comprising instructions of a program as mentioned above.
[0029] The information carrier may be any entity or terminal capable of storing the program. For example, the carrier may include a storage medium, such as a ROM, for example a CD ROM or a microelectronic circuit ROM, or a magnetic recording medium, for example a mobile medium (memory card) or a hard disk or an SSD.
[0030] Furthermore, the information carrier may be a transmissible medium such as an electrical, optical and / or sound signal, which may be conveyed via an electrical or optical cable, by radio or by other means. The program according to the present technique may in particular be downloaded over a network such as the Internet.
[0031] Alternatively, the information carrier may be an integrated circuit in which the program is incorporated, the circuit being adapted to perform or to be used in the performance of the method in question.
[0032] According to an exemplary embodiment, the present technique is implemented by means of software and / or hardware components. In this regard, the term "module" can correspond in this document to a software component, a hardware component or a set of hardware and software components.
[0033] A software component corresponds to one or more computer programs, one or more sub-programs of a program, or more generally to any element of a program or software capable of implementing a function or a set of functions, as described below for the module concerned. Such a software component is executed by a data processor of a physical entity (terminal, server, gateway, set-top-box, router, etc.) and is likely to access the hardware resources of this physical entity (memories, recording media, communication buses, electronic input / output cards, user interfaces, etc.).
[0034] Similarly, a hardware component corresponds to any element of a hardware assembly capable of implementing a function or a set of functions, as described below for the module concerned. It may be a programmable hardware component or one with an integrated processor for executing software, for example an integrated circuit, a smart card, a memory card, an electronic card for executing firmware, etc. Each component of the system described above of course implements its own software modules.
[0035] The different embodiments mentioned above can be combined with each other for the implementation of the present technique.
[0036] 4. Drawings
[0037] Other aims, characteristics and advantages of the invention will appear more clearly on reading the following description, given as a simple illustrative, and non-limiting, example, in relation to the figures, among which:
[0038] [fig. 1] represents the general principle implemented;
[0039] [fig. 2a] represents an example of implementation of the transaction processing method;
[0040] [fig. 2b] represents an example of implementation of the transaction processing method;
[0041] [fig. 3] represents the process of extracting image features;
[0042] [fig. 4] represents a simplified physical architecture of a device in which the methods previously described can be implemented.
[0043] 5. Description
[0044] 5.1. Reminders of the principle
[0045] The general principle of the invention, in a terminal on which an entry is made as part of a transaction, consists of processing visual information from a front sensor of the terminal to determine whether or not the user can enter sensitive data. To do this, it is determined whether the user is paying attention to the information displayed on the terminal screen and / or whether he is alone in front of the terminal to be able to enter this sensitive data (PIN, password, etc.).
[0046] Among the devices often used to capture sensitive information, payment terminals are considered secure because they are used to process payments. New terminals can also be used for other purposes, depending on the merchant's business case. For example, the terminal can be used to run value-added services or business applications that may request personal information. Even if the data provided to the terminal is securely processed within the terminal itself, there is no guarantee that the user is not being spied on when entering their personal data. For example, entering a PIN is a critical step during a payment transaction on a payment terminal. During this entry phase, the attacker watches over the user's shoulder to see what digits are being entered when entering the PIN.Thanks to the implemented technique, the user, the customer or even the merchant is proactively notified that the surrounding physical context is potentially risky, in order to allow them to decide whether or not to continue entering data. For a payment, the transaction processing can be automatically stopped when the environment surrounding the terminal (for example the payment terminal) is noted to have changed. For data entry on a user communication terminal, the transaction can also be stopped, or the screen can be hidden.
[0047] Thus, in general, in relation to Figure 1, the invention relates to a method for processing a transaction of the type comprising the provision, by a user, of sensitive data on a digital terminal. According to the invention, such a method comprises: a step of initialization (A00) by the digital terminal, of a transaction requiring the entry of the sensitive data; a step of obtaining (A01), after the initialization (A00), by means of a shooting device connected to the terminal, a multimedia data (DM) representative of an environment of the user; a step of analysis (A02) of the multimedia data (DM) previously obtained; and a step of modification (A03) of a context of implementation of the transaction when the step of analysis of the multimedia data (DM) delivers a result representative of a non-secure environment (NS).
[0048] Depending on the operational implementation conditions, the processing method is carried out using a 2D or 3D camera as a shooting device. Sensors integrated into the digital terminal system can also be used. During the data provision phase of a transaction or payment application, the camera films the user's environment. The payment terminal, based on the camera images and optionally data from the sensors, analyzes this or these images to try to identify the faces that are visible from the front on the terminal screen; optionally the sensors can also check if anything unusual is happening (network changes, WiFi jamming, location changes, etc.).So, for example, when the payment terminal detects several faces and considers that the environment is risky, it modifies the transaction execution context, for example by warning the customer and / or the merchant that one or more other people can see the data they are about to provide and that there is a risk that this data will be stolen. If the risk is considered by the terminal to be too high, the terminal can modify the transaction context by interrupting the interaction (the PIN entry phase of the payment, for example) or by automatically abandoning the transaction (without user action). It can also warn the merchant of a potential fraudulent act that may occur within their business.In addition, as explained below, it is possible to store biometric characteristics of detected faces, when these characteristics are frequently recognized, it is possible to alert the merchant's security in real time (in addition to the warning on the POS screen), for example for video protection purposes. To avoid false positives, a white list of faces that the digital terminal could recognize (such as faces on posters or billboards, in store or at the user's home when the process is implemented on a user's personal communication terminal) is implemented and thus makes it possible to avoid unexpected alerts on the screen. This technology also makes it possible to complete the security of the store or point of sale thanks to a "local" analysis (in the point of sale) which complements the store's video surveillance.Thus, the camera (and module) that captures the multimedia data and provides the images (or the characteristics extracted from the images) to the digital terminal is not necessarily integrated into the terminal itself. It may be one or more video surveillance cameras positioned so as to allow the capture of faces on the one hand and the position of one or more people within the store for example.
[0049] 5.2. Implementation of the transaction
[0050] In relation to Figure 2a, the general method implemented for conducting a transaction, according to the present disclosure, in the situation where a front sensor of a digital terminal is used is presented. This general processing method comprises: the initialization (G00) of a transaction, involving the entry of the sensitive data; the activation (G01) of the sensor of the terminal and the execution (G02) of a module for detecting and extracting image characteristics from this sensor; this module provides at least one indication of a number of faces present in the image captured by the sensor; an analysis step, by an environment analysis module, comprising: when a single face is detected (Y), a step of determining (G03) an orientation of the face and / or the eyes of the face detected within the image;when the face and / or eyes are determined to be correctly oriented (Y), a step of displaying (G04), on the terminal screen, the fields and information necessary for entering the sensitive data; when the face and / or eyes are determined to be incorrectly oriented (N), a step of changing the execution context comprising a step of masking (G05) the information displayed on the terminal screen and / or blocking (G06) the form for entering such information, and this as long as the face and / or eyes are determined to be incorrectly oriented (N);when several faces are detected on the image (N), a step of changing the execution context comprising a step of calculating (G07) biometric characteristics of at least one of the plurality of detected faces, a step of masking (G05) the information displayed on the screen of the terminal and / or blocking (G06) the form for entering such information and a step of displaying (G08) a message to the user; when the user indicates (G09), for example by pressing a key on the terminal or an element of the screen, that the context in which he is located is suitable for entering the sensitive data, the step of displaying (G04), on the screen of the terminal, the fields and information necessary for entering the sensitive data is implemented.;
[0051] In addition, following the calculation (G07) of (biometric) characteristics of at least a portion of the plurality of detected faces, the method may comprise a step of updating (G10), either within the terminal itself or a device or server connected to the terminal, a database of characteristics of detected faces. This updating step comprises in particular, a search, within the database, for composite identifiers of facial characteristics corresponding to the characteristics calculated for a current face, and when such data are already present in the database for the current face, a step of incrementing a counter relating to these characteristics for this current face; when it is detected that it is a new face (absence of the characteristics of this face in the database) a new record is created relating to this new face.In addition to the (biometric) characteristics of this supernumerary face that is detected, a portion of the image comprising this supernumerary face is also stored in a database. In addition, if facial characteristics are detected too frequently (i.e. the counter associated with these characteristics exceeds a predetermined ceiling), the method may comprise a step of transmission, by the terminal or the device to which it is connected (server), of a message indicating to the user or the merchant (if it is a payment terminal), that the same face is frequently detected within the range of the terminal's front sensor and that caution should be exercised. Depending on the legislation, any portions of images stored in the database may also be provided to the user or the merchant so that they can more easily recognize the individual to whom this face belongs.Optionally, if the user or merchant has this frequently recognized face, they can, in the event of a recurring false alert, transmit a response requiring the placement of this face on a white list (for example in the case of a couple frequently captured as a duo in the images in question).
[0052] Optionally, the step of hiding (G05) and / or displaying (G08) a message to the user can be supplemented or replaced by a step of broadcasting an audible alert. Such additional information is clever for two reasons: if the user is visually impaired (for accessibility reasons), he cannot easily know on the one hand what is displayed on the screen and on the other hand who are the people who could spy on his screen without his knowledge. The emission of an audible warning makes it possible to solve this problem.Furthermore, when the user is "distracted" (his eyes are not in the right orientation), this audible warning causes the user to regain attention, and jointly, any people who could be the cause of the user's distraction, and consequently, for the method described here, causes the possibility of seeing the faces of these potentially malicious people appear in the following image (step G02).
[0053] Optionally, as previously explained, additional data is provided by the terminal's integrated sensors. In particular, the initialization of the transaction causes the execution of the environmental analysis module, as previously indicated, and this module comprises, for example, in addition to the means previously described, a module for analyzing the radioelectric activity around the terminal (wireless connection break, reception of RFID data) and / or for example a sudden modification of terminal data, such as a modification of the location thereof. When such modifications are provided / detected to the environmental analysis module, the latter can modify the context of execution of the transaction, as previously indicated.
[0054] Optionally, in addition to face detection, and more particularly the user's face, the analysis step may include the analysis of other characteristics of the image itself, such as changes in color or brightness in the background of the image. Cleverly, as explained in relation to Figure 3, when such changes in characteristics of the images themselves are detected, the analysis module may also modify the execution context of the transaction as explained previously. Thus, for example, when the image is abnormally light or dark (characteristics obtained using global descriptors of the image), or when two successive images are substantially identical, the analysis module may also implement the measures described previously, regardless of whether or not faces are detected within these images.
[0055] Since the implementation of the method is at least partially iterative, the display and / or control and / or masking and / or blocking steps are followed by at least one new iteration of the steps described here, as long as the sensitive information is not entered by the user or until a predetermined timer is activated or the user himself cancels the transaction. Thus, in a standard implementation, only some of the steps described above can be implemented until the transaction on the terminal is successful or abandoned.
[0056] 5.3. Implementation of the transaction
[0057] In relation to Figure 2b, a preferred embodiment implemented for conducting a transaction, according to the present disclosure, in the situation where, in addition, a sensor of at least one piece of data representative of the radio electrical environment of the digital terminal is used. This processing method comprises, in addition to the steps shown in Figure 2a: the activation (G01') of the sensor of at least one piece of data representative of the radio electrical environment (before, after, or at the same time as step (G01)); the execution (G02') of a module for verifying the data representative of the radio electrical environment; this module provides at least one indication of whether or not the data representative of the radio electrical environment complies with an expected value.This step is preferably before step (G02) (even if it can possibly be after or at the same time), it is moreover possible to implement step (G02) only when the data representative of the radio electrical environment is in conformity with said expected value, and otherwise when the data representative of the radio electrical environment is not in conformity with said expected value, to implement a step (Gll) of alerting the terminal manager, i.e. the merchant.
[0058] The idea of step (Gll) is to inform the merchant that his terminal is potentially undergoing a coordinated attack, and to let him react. He can, for example, perform a network security analysis to confirm or deny the attack, or query a remote server.
[0059] Optionally, step (G11) is either followed by a return to normal, i.e. implementation of step (G02), typically if no attack is actually confirmed, or on the contrary by a step (G12) of blocking the terminal (if the attack is confirmed). It is thus preferable to start with the radioelectric checks of step (G02') because we understand that in the event of an attack it is useless to look at the faces (step (G02)).
[0060] Furthermore, as explained, if the step of updating (G10) a database of detected face characteristics comprises a search, within the database, for composite identifiers of face characteristics corresponding to the characteristics calculated for a current face, and when such data are already present in the database for the current face, a step of incrementing a counter relating to these characteristics for this current face; then the step (G10) can comprise the comparison of the counter associated with the characteristics calculated for a current face (and preferably each current face) with a predetermined ceiling.
[0061] Then, optionally the alert step (Gll) of the terminal manager can be implemented when said counter associated with the characteristics calculated for a current face exceeds a predetermined ceiling.
[0062] In fact, the trader can react, in particular try to identify the face frequently detected within the range of the terminal's front sensor, and either find that it is a false alert and repeat the process, or find that it is a malicious lookout and block the terminal (step (G12)) for example while the police intervene.
[0063] Otherwise, i.e. when said counter associated with the characteristics calculated for a current face does not exceed said predetermined ceiling, it is possible, as explained previously, to modify the context of implementation of the transaction by implementing steps (G05), (G06) and / or (G08). In particular, it is possible: to implement step (G05) in the case of a user not looking at the terminal screen (following step (G03)), to implement steps (G08) and (G06) in the case of a plurality of faces detected but the counter associated with the characteristics calculated for a current face does not exceed the predetermined ceiling (following step (G10)).
[0064] 5.4. Description of an example of implementation
[0065] Figure 3 is a flowchart showing an example of a method for iteratively processing the images acquired according to an exemplary embodiment of the present disclosure. Such a method can be implemented in addition to, instead of, or in combination with the method described in Figure 1 and Figure 2. This method aims to continuously compare the images with each other. It makes it possible, just as in Figure 1 or Figure 2, to detect the presence or absence of faces, but in a more analytical manner. As explained in Figure 3, the method comprises: at least one iteration of a processing step (B10) of an image coming from a sensor (of the terminal or another sensor), comprising: obtaining (B100) an image coming from the sensor; detecting (B110) at least one current element within the image; a temporary storage step (B120) of at least one characteristic of said at least one current element;an optional comparison step (B20), within said at least one characteristic stored in memory relating to the detected elements, so that the characteristics of the elements detected during a current iteration are compared with the characteristics of the elements detected during a subsequent iteration, said comparison step providing as a result data representative of the differences between characteristics of elements of the current iteration and of the subsequent iteration; and when the data representative of the differences between characteristics of elements of the current iteration and of the subsequent iteration differ by one or more predetermined ceilings or thresholds, a change of execution context of the transaction comprising a step of implementing (B30) a measure for protecting the transaction conducted by the terminal.;
[0066] According to an exemplary embodiment of the present disclosure, the detection of current elements within the image may comprise the detection of one or more faces, one or more image components, one or more image backgrounds. Thus, the characteristics measured in the different iterations (at least two) make it possible to segregate (partition) the images. For example, the step of detecting (B110) at least one current element within the current image (i.e. the image acquired at the current iteration) may comprise: an optional step of calculating, on the current image, a set of descriptors of the current image: for example calculating one or more global descriptors (histogram, dominant color, CCV) and / or one or more local descriptors (Harris, SIFT); a step of detecting a face qualified as main (i.e.the dominant face in the image); an optional step of obtaining biometric characteristics of the main face, including in particular a step of obtaining an orientation of the face and a step of obtaining an orientation of the eyes of the face; a step of extracting, from the main face, an image background (i.e.portion of the image which does not include the detected dominant face); an optional step of calculating, on the image background, a set of descriptors of the current image: for example calculating one or more global descriptors (histogram, dominant color, CCV) and / or one or more local descriptors (Harris, SIFT) of the image background; a step of detecting, on the image background, one or more additional faces; an optional step of extracting biometric characteristics of each additional face; an optional step of obtaining biometric characteristics, for all or part of each additional face, including in particular a step of obtaining an orientation of all or part of each face and / or a step of obtaining an orientation of the eyes of all or part of each face.
[0067] Thus, using all or part of this information obtained on the extraction of these images, according to an exemplary embodiment of the present disclosure, a face image is acquired when at least one face is extracted from an acquired image, and it is determined that there are one or more additional faces according to the recognition result. At this time, the terminal implements the corresponding protection measures according to the embodiments.
[0068] In an exemplary embodiment, face recognition is performed on the acquired image containing at least one human face, and the number of human faces contained in the image is determined. The number of faces contained in the acquired image can be identified according to a face recognition algorithm. In an exemplary embodiment, according to the number of faces contained in the acquired image, the recognition result of the previous image adjacent to the current image is compared with the recognition result, if the number of faces contained in the current image is greater than the number of faces in the previous image, the execution context of the transaction is changed. For example, when a user normally uses a mobile terminal, the acquired face image contains only one face of the user.When an additional face is detected next to the user's, the transaction execution context is modified, as explained below.
[0069] In an exemplary embodiment, the characteristic information of at least one facial image is obtained from the acquired image containing at least one face, and the characteristic information is matched with facial characteristics of the user who performs the operation on the terminal. These characteristics are pre-recorded to perform face recognition (and not just identification). These pre-recorded characteristics can be obtained, by the merchant's payment terminal for example, from either the bank card (for example biometric) used by the user to make his purchase, or from his communication terminal (if he uses his mobile terminal (smartphone) to make a payment.In a different context, if the transaction is conducted directly on the user's mobile terminal, the pre-recorded facial characteristics of the user are present within the user's communication terminal itself and, for example, stored in a secure element or in a trusted environment.
[0070] In a further exemplary embodiment, the facial feature information of the image obtained from the sensor of at least one face is matched with the pre-recorded facial features of the user. If the facial features of the image obtained from the sensor do not match the predetermined user facial features, it is determined that the environment is unsafe or the user is distracted (e.g., when the user's eyes are not in the direction of the screen).
[0071] In an exemplary embodiment, when it is determined that the environment around the user is not secure or that the user is distracted, the step of blocking the transaction executed by the terminal may be, for example, one of the following operations, taken alone or in combination: blurring the screen, turning off the screen, or displaying an informational message. For example, an informational message may appear to warn the user that there may be a security problem with their input environment. Advantageously, the informational message is displayed above the sensitive data input field(s) so as to prevent the user from entering this data. Blurring the screen may cause the writing displayed on the terminal to become blurred and illegible.
[0072] In at least some embodiments, the technique is implemented using a 3D camera to implement more precise detection of the user's environment. This makes it possible to detect whether a real face is behind the first one (not just an image), and can also help to more easily detect the distance at which the possible malicious person is located. The distance of the main face in front of the camera can also be used to blur or modify the content of the screen and wait for the user to return if the terminal considers that it is not close enough to interact correctly. The 3D camera is also useful for facial recognition itself.
[0073] 5.5. Other features and benefits
[0074] We present, in relation to Figure 4, a simplified architecture of a communication terminal, of the payment terminal type (TProf) capable of carrying out all or part of the processing as presented previously. A communication terminal comprises a first electronic module comprising a memory 41, a processing unit 42 equipped for example with a microprocessor, and controlled by a computer program 43. The communication terminal optionally comprises, for security functionalities, such as the generation of cryptographic materials, a second electronic module comprising a secure memory 44, which can be merged with the memory 41 (as indicated by dotted lines, in this case the memory 41 is a secure memory), a secure processing unit 45 equipped for example with a secure microprocessor and physical protection measures (physical protection around the chip, by lattice, vias, etc.and protection on the data transmission interfaces, possibly merged with the processing unit 42), and driven by a computer program 46 specifically dedicated to this secure processing unit 45, this computer program 46 implementing all or part of the method for processing a transaction as previously described. The group composed of the secure processing unit 45, the secure memory 44 and the dedicated computer program 46 constitutes the secure module (PS) of the communication terminal. In at least one embodiment, the present technique is implemented in the form of a set of programs installed in part or in full on this secure portion of the transaction processing terminal.In at least one other embodiment, the present technique is implemented in the form of a dedicated component (CpX) capable of processing data from the processing units and installed in part or in full on the secure portion of the processing device. Furthermore, the device also comprises communication means (CIE) presented for example in the form of network components (Wi-Fi, 3G / 4G / 5G, wired, RFID / NFC, Bluetooth, BLE, LPWan, VLC, etc.) which allow the device to receive data (I) from entities connected to one or more communication networks and to transmit processed data (T) to such entities.
[0075] Such a device comprises, depending on the embodiments: means for initializing a transaction requiring the entry of sensitive data; means for obtaining, after initialization, via a shooting device connected to the terminal, multimedia data representative of a user's environment; means for analyzing the previously obtained multimedia data; and means for modifying a context for implementing the transaction when the means for analyzing the multimedia data deliver a result representative of an unsecured environment.
[0076] As explained above, these means are implemented through modules and / or components, for example secure ones. They thus ensure the security of the transactions carried out while guaranteeing greater maintainability of the device.
Claims
CLAIMS A method for processing a transaction of the type comprising the provision, by a user, of sensitive data on a digital terminal, characterized in that it comprises: an initialization step (A00) by the digital terminal, of a transaction requiring the input of the sensitive data; a subsequent obtaining step (A01), via a camera connected to the terminal, of multimedia data (MD) representative of a user environment; an analysis step (A02) of the previously obtained multimedia data (MD); and a modification step (A03) of a transaction implementation context when the multimedia data (MD) analysis step delivers a result representative of an insecure environment (NS).A method for processing a transaction, according to claim 1, characterized in that the analysis step (A02) comprises: a search step (G02), within the multimedia data, for a set of at least one face; when the number of faces is equal to one, a search step (G03), within the detected face, for an eye orientation of the detected face; and when the eye orientation of the detected face indicates that the user is not looking at the terminal screen, a step of providing the result representative of an insecure environment (NS).A method for processing a transaction, according to any one of claims 1 to 3, characterized in that the obtaining step (A01) comprises a step of obtaining, from sensors of the digital terminal, at least one data representative of the radio-electric environment of the digital terminal; and the analysis step (A02) comprises, when the data representative of the radio-electric environment is not in conformity with an expected value, a step of providing the result representative of an unsecured environment (NS).
4. A method for processing a transaction, according to any one of claims 1 to 3, characterized in that the analysis step (A02) comprises: a search step (G02), within the multimedia data, for a set of at least one face; when the number of faces is greater than or equal to two, a step of providing the result representative of an insecure environment (NS).
5. A method for processing a transaction according to claims 2, 3 and 4 in combination, characterized in that the analysis step (A02) comprises, when the data representing the radio-electric environment is in conformity with said expected value, said search step (G02), within the multimedia data, of a set of at least one face.
6. A method for processing a transaction according to any one of claims 4 and 5, characterized in that the modification step (A03) of a transaction implementation context comprises, when at least two faces are detected within the multimedia data: a calculation step (G07) of biometric characteristics of at least one of the at least two faces detected; and an update step (G10), within the terminal itself, or a device connected to the terminal, of a database of detected face characteristics.
7. A method for processing a transaction according to claim 6, characterized in that the update step (G10) of a database of detected face features comprises, a search, within the database, for composite identifiers of face features corresponding to the features calculated for a current face, and when such data are already present in the database for the current face, a step of incrementing a counter relating to these features for this current face. A method for processing a transaction according to any one of claims 1 to 1, characterized in that the step of modifying (A03) the context of implementing the transaction comprises: a step of displaying (G08), to the user, a warning message relating to the detection of the insecure environment; a step of alerting (G11) a terminal manager; a step of masking (G05) at least one piece of information displayed on the terminal screen;and / or a blocking step (G06) of a sensitive data input area. A method for processing a transaction according to claims 7 and 8 in combination, characterized in that the modification step (A03) of the transaction implementation context comprises: when the data representing the radio environment does not conform to an expected value, or when the counter associated with the characteristics calculated for a current face exceeds a predetermined ceiling, the alert step (G11) of the terminal manager; when the eye orientation of the detected face indicates that the user is not looking at the terminal screen, or when the number of faces is greater than or equal to two, the masking step (G05) of at least one piece of information displayed on the terminal screen;and when the number of faces is greater than or equal to two, the display step (G08), intended for the user, of a warning message relating to the detection of the insecure environment and / or the blocking step (G06) of an input area for sensitive data. Method for processing a transaction according to one of claims 8 and 9, characterized in that, subsequent to the display step (G08) of the warning message relating to the detection of the insecure environment, the method comprises, a reception step (G09), by the digital terminal, of data representing an acceptance, by the user, of the continuation of the input of sensitive data. 22 11. A digital terminal adapted for processing a transaction of the type comprising the provision, by a user, of sensitive data on the digital terminal, characterized in that it comprises: means for initializing (A00) by the digital terminal, a transaction requiring the entry of the sensitive data; means for obtaining (A01), subsequent to initialization (A00), by means of a camera connected to the terminal, multimedia data (MD) representative of a user environment; means for analyzing (A02) the multimedia data (MD) previously obtained; and - means for modifying (A03) a context of implementation of the transaction when the means for analyzing the multimedia data (MD) deliver a result representative of an insecure environment (NS).
12. Product computer program comprising program code instructions for the implementation of a communication method according to any one of claims 1 to 10, when executed by a processor.
