A method and device for contact recognition

Abstract

The present invention provides a method and device for contact recognition. When it is determined that the first touch surface faces the current user, since a sensing unit is provided below the first touch surface, the processing unit will control the sensing unit to collect contact information of the user's touch part located within the contact recognition area. When it is determined that the second touch surface faces the current user, the processing unit will control the second touch surface to display a virtual user's second touch part and a virtual contact recognition area. Since the display position of the virtual user's second touch part on the second touch surface corresponds to the position of the current user's second touch part on the first touch surface, when the virtual user's second touch part is within the virtual contact recognition area on the second touch surface, at this time the processing unit will control the sensing unit to collect second contact information of the user's second touch part located within the contact recognition area. This application can solve the problem of inconvenient operation of in-screen fingerprint recognition devices after the display screen is folded.

Description

[0001] This application is a divisional application. The application number of the original application is 201710514071.7, the application date is June 29, 2017, and the application title is: A Contact Recognition Method and Device for a Foldable Display Screen. Technical Field

[0002] The present invention relates to the field of electronic device control, and particularly to a contact recognition method and device. Background Art

[0003] Currently, touch mobile devices including smart phones, smart tablets, or notebook computers, etc. have been widely used in users' daily lives. Since a large amount of user information is often involved during the use of these devices, the protection of information security becomes particularly important. Among numerous information security protection methods, fingerprint recognition encryption is an important one. Most of the existing fingerprint recognition technologies still stay at the functions of power-on unlocking or screen unlocking of the terminal. A special button (such as the home button of an Apple mobile phone) needs to be set, and a capacitive fingerprint recognition sensor is placed below the button to collect the fingerprints left by the user on the button. Due to the need to set a capacitive fingerprint recognition sensor, on the one hand, it increases the complexity of terminal processing and installation, and on the other hand, it also increases the overall thickness of the terminal, restricting the development of thin, full-screen, and rollable applications of the terminal screen. Therefore, developing fingerprint recognition technologies and operation methods embedded in the display screen to achieve full-screen display and multi-finger fingerprint recognition functions can meet the perfect user experience of mobile devices.

[0004] The common essential component of such devices is a touch display screen, and the current display technology is rapidly developing towards flexible display screens. Flexible display screens can be widely used in foldable mobile devices or rollable mobile devices, and derive different appearances and functions from current rigid mobile devices. For example: A foldable smart phone can be unfolded into a smart tablet and paired with an external keyboard to become a portable notebook computer, etc. By realizing the functions of flexible display screens, the features of multiple individual mobile devices can be integrated into a single device, and the user experience of thin, light, and portable devices can be achieved, as described in patents such as US Patent US8804324 and US Patent US9176535.

[0005] Current display technologies include liquid crystal display (LCD) screens or active matrix organic light emitting diode (AMOLED) display screens, etc. All of them use a thin film transistor (TFT) structure to scan and drive a single pixel to achieve the display function of the pixel array on the screen. The main structure for forming the TFT switching function is a semiconductor field effect transistor (FET). Well-known main materials for the semiconductor layer include amorphous silicon, polycrystalline silicon, indium gallium zinc oxide (IGZO), or organic compounds mixed with carbon nanomaterials, etc. By means of a high-temperature resistant polymer substrate, such as a polyimide film, such thin film transistor devices can be realized on a flexible substrate.

[0006] Since the structure of a photodiode can also be prepared using such semiconductor materials, and the production equipment is also compatible with the production equipment of the TFT array, in recent years, TFT photodiodes have begun to be produced in the way of preparing the TFT array and are widely used in X-ray sensing flat panel devices, as described in the Chinese patents CN103829959B and CN102903721B. Compared with the image sensor devices prepared from traditional crystalline materials, the optical bandgaps of the TFT photosensing array thin film materials mainly have the visible light as the main absorption range. Therefore, they are more susceptible to interference from ambient visible light to form noise, resulting in a lower signal-to-noise ratio (SNR). Limited by this, the initial application of the TFT photosensing array is mainly for X-ray sensing flat panel devices. The main reason is that X-rays are short-wavelength light with high collimation. The X-ray image first enters the wavelength conversion material configured on the sensing flat panel, converts the X-ray image into visible light with a longer wavelength, and then directly transmits it inside the sensing flat panel to the TFT photosensing array thin film, avoiding the noise interference caused by the visible light in the surrounding environment, as described in the above-mentioned Chinese patents CN103829959B and CN102903721B.

[0007] If such well-known TFT visible light sensing array thin films are prepared on a flexible substrate and configured in a flexible display screen structure, it can be a technology for integrating the light detection function into the flexible display screen, and the original image can be reconstructed and analyzed according to the optical wave theory operation to implement the fingerprint recognition solution in the foldable display screen. However, due to cost considerations, the light detection thin film will not be configured as a fingerprint recognition device in the entire area of the non-foldable display screen. Taking the application of a double-screen foldable display screen as an example, if the previous use of the mobile device is after folding and both screens face outwards, when the user picks up the mobile device and starts it again, only the display screen on the side facing outwards (the other side of the human eye) on the back has the in-screen fingerprint recognition device. The user still needs to flip the mobile device and find the fingerprint recognition area indicated by the display screen to press in order to implement the identity recognition function, which cannot improve the user experience of in-screen fingerprint recognition in the foldable full screen and also limits the convenience of multi-finger fingerprint recognition operation in the display screen. Summary of the Invention

[0008] The technical problem to be solved by the present invention is to provide a technical solution for contact recognition, so as to solve the problems such as inconvenient operation and poor user interaction experience of in-screen fingerprint recognition devices after the screen is folded.

[0009] To solve the above technical problem, a first aspect of the present invention provides a contact recognition device, which includes a first touch surface, a second touch surface, a first judgment unit, a sensing unit and a processing unit;

[0010] The first touch surface and the second touch surface are located on the same plane or different planes. A contact recognition area is provided on the first touch surface, and a sensing unit is provided below the contact recognition area. The sensing unit is used to collect contact information of a touch part located in the contact recognition area;

[0011] The first judgment unit is used for: when the first touch surface and the second touch surface are not on the same plane, judging whether the first touch surface faces the current user;

[0012] When the first judgment unit determines that the first touch surface faces the current user, the processing unit is used to control the sensing unit to collect first contact information of a first touch part located in the contact recognition area;

[0013] When the first judgment unit determines that the second touch surface faces the current user, the processing unit is used to control the second touch surface to display a virtual second touch part and a virtual contact recognition area. The display position of the virtual contact recognition area on the second touch surface corresponds to the display position of the contact recognition area on the first touch surface, and the display position of the virtual second touch part on the second touch surface corresponds to the position of the current second touch part on the first touch surface; the processing unit is further used for: when the virtual second touch part is located in the virtual contact recognition area, controlling the sensing unit to collect second contact information of the current second touch part in the contact recognition area.

[0014] Further, it further includes a display panel. The first touch surface and the second touch surface are located in different areas of the display panel. The display panel is suitable for unfolding or folding along a first bending direction; when the display panel is in an unfolded state, the first touch surface and the second touch surface are in the same plane; when the display panel is in a folded state along the first bending direction, the first touch surface and the second touch surface face away from each other.

[0015] Further, it further includes:

[0016] A contact information preset unit, which is used to set the correspondence between preset contact information and operation instructions;

[0017] A second judgment unit, configured to judge whether the contact information acquired by the sensing unit matches the preset contact information. If it matches, the processing unit is configured to execute the operation instruction corresponding to the preset contact information. If it does not match, the processing unit does not execute the operation instruction corresponding to the preset contact information.

[0018] Further, the preset contact information includes preset contact information of different parts of the user.

[0019] Further, the device includes an operation instruction receiving unit, and the "contact information preset unit is configured to set the correspondence between the preset contact information and the operation instruction" includes:

[0020] The operation instruction receiving unit is configured to receive a user setting instruction, and the display panel is configured to display a contact recognition area on the first touch surface;

[0021] The sensing unit is configured to acquire and save the contact information of the user's touch part on the contact recognition area;

[0022] The display panel is configured to display a list of operation instruction identifiers, where the list of operation instruction identifiers includes one or more operation instruction identifiers, and each operation instruction identifier corresponds to an operation instruction;

[0023] The operation instruction receiving unit is further configured to receive a selection instruction of the operation instruction identifier by the user, and establish and save the correspondence between the operation instruction corresponding to the operation instruction identifier selected by the user and the contact information acquired by the sensing unit.

[0024] Further, the "displaying a contact recognition area on the first touch surface" includes: increasing the brightness of the contact recognition area or displaying a prompt input box on the contact recognition area.

[0025] Further, the operation instruction includes one or more of a system startup instruction, a text operation instruction, an image operation instruction, a video operation instruction, and an application operation instruction.

[0026] Further, the "first judgment unit is configured to judge whether the first touch surface faces the current user" includes: the first judgment unit is configured to judge whether the current sensing unit captures user feature information. If so, it is determined that the first touch surface faces the current user. Otherwise, it is determined that the second touch surface faces the current user.

[0027] Further, the user feature information includes one or more of face feature information, ear feature information, and lip feature information.

[0028] Further, the statement that "the first determination unit is configured to determine whether the first touch surface faces the current user" includes: the first determination unit is configured to determine whether the ambient light intensity sensed by the current sensing unit is lower than a preset light intensity value. If so, it is determined that the second touch surface faces the current user; otherwise, it is determined that the first touch surface faces the current user.

[0029] Further, the statement that "the first determination unit is configured to determine whether the first touch surface faces the current user" includes: the first determination unit is configured to determine whether the number of contact points detected on the current first touch surface is greater than a preset number of contact points. If so, it is determined that the second touch surface faces the current user; otherwise, it is determined that the first touch surface faces the current user.

[0030] Further, the number of contact points on the current first touch surface is detected by the sensing unit or the touch panel of the display panel.

[0031] Further, the contact point information is fingerprint information; the statement that "the second determination unit is configured to determine whether the contact point information acquired by the sensing unit matches the preset contact point information" includes: the second determination unit is configured to calculate the eigenvalue of the contact point information acquired by the sensing unit and compare it with the preset contact point information. When the error is less than a preset error, it is determined to be a match; otherwise, it is determined not to be a match.

[0032] Further, the processing unit is further configured to issue a prompt message when the second determination unit determines that the contact point information does not match the preset contact point information.

[0033] Further, the prompt message includes one or more of a sound prompt message, an image prompt message, a light prompt message, and a video prompt message.

[0034] Further, the device includes more than two touch surfaces. When the display panel is in a folded state along the first folding direction, one or more other touch surfaces are also folded or arranged between the first touch surface and the second touch surface.

[0035] Further, the sensing unit includes a TFT image sensing array film.

[0036] Further, the TFT image sensing array film includes an infrared sensing layer; the infrared sensing layer is configured to receive a first trigger signal and emit an infrared light signal, and is also configured to receive a second trigger signal and be in a state of detecting infrared light.

[0037] Further, the infrared sensing layer includes an odd-column pixel point array and an even-column pixel point array; the first trigger signal is a forward bias signal, and the second trigger signal is a zero bias or negative bias signal.

[0038] The odd-column pixel point array is used to receive a forward bias signal and emit an infrared light signal; the even-column pixel point array is used to receive a zero bias or negative bias signal and is in a state of detecting infrared light.

[0039] Alternatively, the even-column pixel point array is used to receive a forward bias signal and emit an infrared light signal; the odd-column pixel point array is used to receive a zero bias or negative bias signal and is in a state of detecting infrared light.

[0040] Further, the first trigger signal and the second trigger signal are alternately switched and conform to a preset frequency.

[0041] Further, the display panel is a display screen using an active matrix thin film transistor for scanning drive and data transmission.

[0042] Further, the display panel includes any one of an AMOLED display screen, an LCD liquid crystal display screen, a micro light-emitting diode display screen, a quantum dot display screen, or an electronic ink display screen.

[0043] Further, when the display panel is an LCD liquid crystal display screen or an electronic ink display screen, a backlight unit is further provided below the sensing unit, and the sensing unit is disposed between the backlight unit and the LCD liquid crystal display screen, or between the backlight unit and the electronic ink display screen.

[0044] Further, the contact recognition area includes a plurality of contact recognition sub-areas, and a sensing unit is correspondingly disposed below each contact recognition sub-area.

[0045] Further, the device further includes an operation instruction receiving unit and a sensing unit control circuit. The operation instruction receiving unit is used to receive a start instruction of the user for the contact recognition sub-area, and the sensing unit control circuit is used to turn on the sensing unit below the contact recognition sub-area; the operation instruction receiving unit is further used to receive a close instruction of the user for the contact recognition sub-area, and the sensing unit control circuit is used to turn off the sensing unit below the contact recognition sub-area.

[0046] Further, the contact information includes fingerprint feature information.

[0047] A second aspect of the present invention further provides a contact recognition method, which is applied to a contact recognition device. The device includes a first touch surface, a second touch surface, a first judgment unit, a sensing unit, and a processing unit;

[0048] The first touch surface and the second touch surface are located on the same plane or different planes. A contact recognition area is provided on the first touch surface, and a sensing unit is provided below the contact recognition area. The sensing unit is configured to collect contact information of a touch part located within the contact recognition area;

[0049] The method includes the following steps:

[0050] When the first touch surface and the second touch surface are not on the same plane, a first judgment unit judges whether the first touch surface faces the current user;

[0051] When the first judgment unit determines that the first touch surface faces the current user, the processing unit controls the sensing unit to collect first contact information of a first touch part located within the contact recognition area;

[0052] When the first judgment unit determines that the second touch surface faces the current user, the processing unit controls the second touch surface to display a virtual second touch part and a virtual contact recognition area. The display position of the virtual contact recognition area on the second touch surface corresponds to the display position of the contact recognition area on the first touch surface, and the display position of the virtual second touch part on the second touch surface corresponds to the position of the current user's second touch part on the first touch surface; when the virtual second touch part is located within the virtual contact recognition area, the processing unit controls the sensing unit to collect second contact information of the current second touch part within the contact recognition area.

[0053] Further, the device further includes a contact information preset unit and a second judgment unit; the method further includes the following steps:

[0054] The contact information preset unit sets the correspondence between preset contact information and operation instructions;

[0055] The second judgment unit judges whether the contact information obtained by the sensing unit matches the preset contact information. If it matches, the processing unit executes the operation instruction corresponding to the preset contact information; if it does not match, the processing unit does not execute the operation instruction corresponding to the preset contact information.

[0056] Further, the device includes an operation instruction receiving unit, and "the contact information preset unit sets the correspondence between preset contact information and operation instructions" includes:

[0057] The operation instruction receiving unit receives a user setting instruction, and the display panel displays the contact recognition area on the first touch surface;

[0058] The sensing unit obtains and saves the contact information of the user's touch part on the contact recognition area;

[0059] The display panel displays a list of operation instruction identifiers, where the list of operation instruction identifiers contains one or more operation instruction identifiers, and each operation instruction identifier corresponds to an operation instruction;

[0060] The operation instruction receiving unit receives a selection instruction of the user for the operation instruction identifier, establishes a correspondence between the operation instruction corresponding to the operation instruction identifier selected by the user and the contact information acquired by the sensing unit, and saves it.

[0061] Further, the "displaying a contact recognition area on the first touch surface" includes: increasing the brightness of the contact recognition area or displaying a prompt input box on the contact recognition area.

[0062] Further, the "first judgment unit judges whether the first touch surface is facing the current user" includes:

[0063] The first judgment unit judges whether the current sensing unit captures the contact information of the touch part. If so, it determines that the first touch surface is facing the current user; otherwise, it determines that the second touch surface is facing the current user.

[0064] Further, the "first judgment unit judges whether the first touch surface is facing the current user" includes:

[0065] The first judgment unit judges whether the ambient light intensity sensed by the current sensing unit is lower than a preset light intensity value. If so, it determines that the second touch surface is facing the current user; otherwise, it determines that the first touch surface is facing the current user.

[0066] Further, the "first judgment unit judges whether the first touch surface is facing the current user" includes:

[0067] The first judgment unit judges whether the number of contacts detected on the current first touch surface is greater than a preset number of contacts. If so, it determines that the second touch surface is facing the current user; otherwise, it determines that the first touch surface is facing the current user.

[0068] Further, the number of contacts on the current first touch surface is detected by the sensing unit or the touch panel of the display panel.

[0069] Further, the contact information is fingerprint information; the "second judgment unit judges whether the contact information acquired by the sensing unit matches the preset contact information" includes:

[0070] The second judgment unit calculates the characteristic value according to the contact information acquired by the sensing unit, and compares it with the preset contact information; when the error is less than the preset error, it is determined to be a match, otherwise it is determined to be a mismatch.

[0071] Further, the method further includes:

[0072] When the second determination unit determines that the contact information does not match the preset contact information, the processing unit issues a prompt message.

[0073] Further, the sensing unit includes a TFT image sensing array film.

[0074] Further, the TFT image sensing array film includes an infrared sensing layer; the method includes:

[0075] The infrared sensing layer receives a first trigger signal and emits an infrared light signal; and the infrared sensing layer receives a second trigger signal and is in a state of detecting infrared light.

[0076] Further, the infrared sensing layer includes an odd-numbered pixel point array and an even-numbered pixel point array; the first trigger signal is a forward bias signal, and the second trigger signal is a zero bias or negative bias signal;

[0077] The method includes:

[0078] The odd-numbered pixel point array receives a forward bias signal and emits an infrared light signal; the even-numbered pixel point array receives a zero bias or negative bias signal and is in a state of detecting infrared light;

[0079] Or, the even-numbered pixel point array receives a forward bias signal and emits an infrared light signal; the odd-numbered pixel point array receives a zero bias or negative bias signal and is in a state of detecting infrared light.

[0080] Further, the first trigger signal and the second trigger signal are alternately switched and conform to a preset frequency.

[0081] Further, the contact recognition area includes a plurality of contact recognition sub-areas, and a sensing unit is correspondingly arranged below each contact recognition sub-area.

[0082] Further, the device further includes an operation instruction receiving unit and a sensing unit control circuit, and the method includes the following steps:

[0083] The operation instruction receiving unit receives a start instruction of the user for the contact recognition sub-area, and the sensing unit control circuit turns on the sensing unit below the contact recognition sub-area;

[0084] Or, the operation instruction receiving unit receives a close instruction of the user for the contact recognition sub-area, and the sensing unit control circuit turns off the sensing unit below the contact recognition sub-area.

[0085] The beneficial effects after adopting the above technical solutions are as follows: When it is determined that the first touch surface faces the current user, since a sensing unit is provided below the first touch surface, the processing unit will control the sensing unit to collect the contact information of the user's touch part located in the contact recognition area. When it is determined that the second touch surface faces the current user, the processing unit will control the second touch surface to display the virtual user's second touch part and the virtual contact recognition area. Since the display position of the virtual user's second touch part on the second touch surface corresponds to the position of the current user's touch part on the first touch surface, when the virtual user's second touch part is located in the virtual contact recognition area on the second touch surface, the current user's second touch part is just located in the contact recognition area on the first touch surface. At this time, the processing unit will control the sensing unit to collect the second contact information of the user's second touch part located in the contact recognition area. This application can solve the problem of inconvenient operation of the in-screen fingerprint recognition device after the display screen is folded, and effectively enhance the user experience. Description of the Drawings

[0086] Figure 1 It is a flowchart of a contact recognition method according to an embodiment of the present invention;

[0087] Figure 2 It is a flowchart of a contact recognition method according to another embodiment of the present invention;

[0088] Figure 3 It is a schematic diagram of a contact recognition device according to another embodiment of the present invention;

[0089] Figure 4 It is a schematic diagram of a contact recognition device according to another embodiment of the present invention;

[0090] Figure 5 It is a schematic diagram of a sensing unit according to an embodiment of the present invention;

[0091] Figure 6 It is a schematic diagram of a sensing unit according to another embodiment of the present invention.

[0092] Reference Numeral Description:

[0093] 101, First display panel; 111, Second display panel;

[0094] 102, Sensing unit;

[0095] 103, Backlight unit;

[0096] 104, Contact information preset unit;

[0097] 105, Operation instruction receiving unit;

[0098] 106, Processing unit;

[0099] 107. Judgment unit; 117. First judgment unit; 127. Second judgment unit;

[0100] 108. Storage unit. Detailed implementation manner

[0101] To describe in detail the technical content, structural features, achieved objectives and effects of the present invention, the following will be described in detail in conjunction with the implementation manners and with reference to the accompanying drawings.

[0102] Please refer to Figure 3 , which is a schematic diagram of a contact recognition device for a foldable display screen according to an embodiment of the present invention. The device is an electronic device having two or more foldable display panels, such as smart mobile devices such as mobile phones, tablet computers, and personal digital assistants having flexible display panels. As Figure 3 shown, the solution of the present application is implemented as follows:

[0103] The device includes a first display panel 101 and a second display panel 111. The first display panel 101 includes a first touch surface, and the second display panel 111 includes a second touch surface. The first touch surface and the second touch surface can be folded or unfolded towards each other, and the first touch surface and the second touch surface are located on the same plane or different planes.

[0104] A contact recognition area is provided on the first touch surface, and a sensing unit 102 is provided below the contact recognition area. The sensing unit 102 is used to capture the contact information of the user. The device includes a contact information preset unit 104, a processing unit 106, and a judgment unit 107. The judgment unit 107 includes a first judgment unit 117 and a second judgment unit 127.

[0105] The contact information preset unit 104 is used to set the correspondence between preset contact information and operation instructions. The preset contact information includes first preset contact information and second preset contact information. The contact information is the information input after the touch part contacts the display panel. The touch part can be a part of the human body, such as a finger. The preset contact information is the contact information pre-entered and stored by the user. Each piece of contact information can be associated with an operation instruction; each operation instruction can correspond to multiple pieces of contact information, that is, when any one of these pieces of contact information is received, the corresponding operation instruction can be triggered. The correspondence between the preset contact information and the operation instruction can be stored in the storage unit 108 of the device, such as the memory of a mobile phone or the hard disk of a computer, or can be stored in the storage unit of the server. When it is necessary to obtain the correspondence between the preset contact information and the operation instruction, only need to establish a communication connection between the device and the server, and then the device can obtain it from the server. The communication connection includes a wired communication connection or a wireless communication connection.

[0106] Generally, each display panel in a foldable display screen has a touch surface and a non-touch surface (the back of the display panel), so that the foldable display screen has two forms when in the folded state. Taking a double-fold (with two display panels) display screen as an example, when the first touch surface of the first display panel is folded and attached to the second touch surface of the second display panel facing each other, the foldable display screen is in an unused state; when the first touch surface of the first display panel is folded and attached to the second touch surface of the second display panel back to back, at this time, both the first touch surface and the second touch surface are arranged facing outward. Also, since there is only a sensing unit provided below the first display panel, when the second touch surface faces the user, the user needs to first flip the display screen in this state so that the first touch surface faces the user, so that the user can input the first contact information on the first touch surface and then execute the corresponding operation (such as an unlocking operation). This brings a bad experience to the user. To solve this problem, when the first touch surface and the second touch surface are in the folded state and both the first touch surface and the second touch surface are arranged facing outward (hereinafter referred to as the "folded use state"), the first determination unit 117 is used to determine whether the first touch surface faces the current user.

[0107] If it is determined that the first touch surface faces the current user, the sensing unit 102 is used to obtain the first contact information of the first touch part in the contact recognition area, and the second determination unit 127 is used to determine whether the obtained first contact information matches the first preset contact information. If it matches, the processing unit 106 is used to execute the operation instruction corresponding to the first preset contact information. If it does not match, the processing unit 106 does not execute the operation instruction corresponding to the first preset contact information. The first contact information is the contact information input after the first touch part contacts the first touch surface. In the folded use state, when the first touch surface faces the current user, since the first display panel is provided with a sensing unit, the user can directly input the first contact information on the sensing unit.

[0108] If it is determined that the second touch surface faces the current user, the processing unit is configured to control the second touch surface to display a virtual second touch portion and a virtual contact point recognition area. The display position of the virtual contact point recognition area on the second touch surface corresponds to the display position of the contact point recognition area on the first touch surface, and the display position of the virtual second touch portion on the second touch surface corresponds to the position of the current second touch portion on the first touch surface. The second contact information is the contact information input after the second touch portion contacts the first touch surface. In the folded usage state, when the second touch surface faces the current user, since the second display panel is not provided with a sensing unit, the contact information input by the user on the second touch surface cannot be recognized by the underlying sensing unit. In this case, there is a second touch portion on the first touch surface in contact with it, but since the first touch surface faces away from the user, the user cannot accurately move the second touch portion to the contact point recognition area. Therefore, the second touch portion and the contact point recognition area on the first touch surface are projected onto the second touch surface, that is, a virtual second touch portion and a virtual contact point recognition area are generated on the second touch surface for the user to operate.

[0109] Also, since the display position of the virtual second touch portion on the second touch surface corresponds one-to-one to the position of the real second touch portion on the first touch surface, that is, when the real second touch portion moves, the display position of the virtual second touch portion on the second touch surface also moves correspondingly. Therefore, when the virtual second touch portion is located in the virtual contact point recognition area (indicating that the real second touch portion is also in the contact point recognition area at this time), the sensing unit 102 is configured to obtain the second contact information of the second touch portion in the contact point recognition area, and the second determination unit 127 is configured to determine whether the obtained second contact information matches the second preset contact information. If it matches, the processing unit 106 is configured to execute the operation instruction corresponding to the second preset contact information. If it does not match, the processing unit 106 does not execute the operation instruction corresponding to the second preset contact information.

[0110] The following takes the user part (i.e., the touch part) as the user's finger, the contact point information as the fingerprint information, and the contact point recognition area as a rectangular area located at the center of the first touch surface as an example to further illustrate the solution of this embodiment. Usually, when using the terminal, the user will hold the mobile phone with one hand (such as the right hand) and use the thumb for fingerprint unlocking. Assume that the first contact point information is the fingerprint information of the right thumb, and the second contact point information is the fingerprint information of one or more of the other four fingers of the right hand except the thumb. When the device is in the folded state and the first judgment unit detects that the first touch surface faces the user (i.e., the first touch surface is aligned with the side facing the human eye), since the sensing unit is arranged below the first touch surface, after the user holds the mobile phone, the user can press the contact point recognition area with the right thumb so that the sensing unit can receive the fingerprint information of the thumb, and then complete the unlocking operation after the fingerprint information is matched. When the device is in the folded state and the first judgment unit detects that the second touch surface faces the user (i.e., the first touch surface is back to the human eye), in this case, one or more of the other four fingers of the user's right hand except the thumb still have contact with the first touch surface, but because the first touch surface is back to the user's human eye, the user cannot accurately move one of the other four fingers (such as the ring finger) to the contact point recognition area. Therefore, the processing unit controls the display of virtual 4 fingers (or virtual ring finger) and virtual contact point recognition area on the second touch surface. Since the second touch surface faces the user's human eye, the user can easily move the virtual second touch part to the virtual contact point recognition area (specifically, it can be realized by moving the real second touch part on the first touch surface). Taking the second touch part as the right ring finger as an example, when the virtual ring finger is located in the virtual contact point recognition area, it means that the right ring finger in contact with the first touch surface also moves to the contact point recognition area. At this time, the sensing unit can capture the fingerprint information on the right ring finger, and then compare it with the preset fingerprint information, and complete the unlocking operation after the comparison passes. Through the above solution, when the device is in the folded display state, whether the first touch surface or the second touch surface is aligned with the user, the user can perform the contact point recognition operation without flipping the device, which simplifies the user operation process and greatly improves the user experience.

[0111] In some embodiments, the device includes an operation instruction receiving unit 105, and the "contact point information preset unit is used to set the correspondence between the preset contact point information and the operation instruction" includes:

[0112] The operation instruction receiving unit is used to receive user setting instructions, and the first display panel is used to display a contact recognition area. The setting instructions can be triggered by the user clicking on a certain button in the setting bar on the first touch surface or the second touch surface. After the device receives the setting instructions, it will display the contact recognition area to facilitate the user to place the touch part in the contact recognition area so that the sensing unit can capture the contact information. In this embodiment, displaying the contact recognition area may include: increasing the brightness of the contact recognition area or displaying a prompt input box on the contact recognition area. In some embodiments, before receiving the user setting instructions, it further includes receiving the user's account information, and the account information includes the user ID and password. The user needs to input the correct user ID and password in ways such as voice control, eye control, or button password control. After logging in to the user account, the setting instructions can be triggered. On the one hand, this can improve the security of setting the touch configuration information (i.e., the correspondence between the preset contact information and the operation instructions), and on the other hand, it can also achieve the effect of distinguishing different users on one device and saving different touch configuration information.

[0113] The sensing unit is used to obtain and save the contact information of the user on the contact recognition area. In this embodiment, the device includes a storage unit, and the processing unit is further used to determine whether the obtained contact information has been stored in the storage unit. When it is determined to be yes, it prompts the user that the contact information has been entered; when it is determined to be no, it saves the contact information to the storage unit. This can effectively avoid duplicate entry of contact information.

[0114] The first display panel or the second display panel is used to display a list of operation instruction identifiers, and the operation instruction receiving unit is further used to receive the user's selection instruction for the operation instruction identifier, establish and save the correspondence between the operation instruction corresponding to the selected operation instruction identifier and the contact information captured by the sensing unit. The list of operation instruction identifiers contains the identifiers corresponding to one or more operation instructions, and each operation instruction identifier corresponds to an operation instruction. The selection instruction can be triggered by the user clicking to check, double-clicking, etc.

[0115] In some embodiments, the operation instructions include one or more of system startup instructions, text operation instructions, image operation instructions, video operation instructions, and application operation instructions. The system startup instructions include power-on startup instructions. The text operation instructions include instructions for sharing, forwarding, adding, deleting, modifying, etc. of text. The image operation instructions include instructions for sharing, forwarding, adding, deleting, modifying, etc. of images. The video operation instructions include instructions for sharing, forwarding, adding, deleting, modifying, etc. of videos. The application operation instructions include instructions for opening, deleting, moving, etc. of application programs. In short, the types of operation instructions can be set according to the actual needs of users. Users can encrypt contact information for the opening of some key information or the startup of application programs to improve the security of information storage.

[0116] In some embodiments, the statement "the first judgment unit is used to judge whether the first touch surface faces the current user" includes: the first judgment unit is used to judge whether the current sensing unit captures preset biometric information. If so, it is determined that the first touch surface faces the current user; otherwise, it is determined that the second touch surface faces the current user. Among them, the preset biometric information includes one or more of facial feature information, ear feature information, and lip feature information. Taking the preset biometric information as facial feature information as an example, the facial feature information includes facial contour information. When the user aligns the human face with the first touch surface, the sensing unit below the touch surface will collect the facial feature contour information, thereby determining that the first touch surface faces the current user.

[0117] In some embodiments, the statement "the first judgment unit is used to judge whether the first touch surface faces the current user" includes: the first judgment unit is used to judge whether the ambient light intensity sensed by the current sensing unit is lower than a preset light intensity value. If so, it is determined that the second touch surface faces the current user; otherwise, it is determined that the first touch surface faces the current user. Similarly, taking the contact information as fingerprint information as an example, when the user holds the mobile terminal in the folded state, if the first touch surface faces away from the user, then its surface is blocked by the user's palm, and the ambient light intensity it senses is weaker than when the first touch surface faces the user. Therefore, it is possible to judge whether the current first touch surface faces the user by detecting the ambient light intensity sensed by the sensing unit. The preset light intensity value is a certain numerical value, which can be specifically set according to actual needs.

[0118] In some embodiments, the statement "the first determination unit is configured to determine whether the first touch surface faces the current user" includes: the first determination unit is configured to determine whether the number of contacts on the currently detected first touch surface is greater than a preset number of contacts. If so, it is determined that the second touch surface faces the current user; otherwise, it is determined that the first touch surface faces the current user. Taking the contact information as fingerprint information as an example, when the user holds the mobile terminal in the folded state, if the first touch surface faces away from the user, then usually more than two fingers (i.e., touch parts) will contact the first touch surface. Therefore, it is possible to determine whether the first touch surface faces the user by detecting the number of contacts on the currently detected first touch surface. Preferably, the number of contacts on the currently detected first touch surface is detected by the sensing unit or the touch panel of the first display panel.

[0119] In short, there are multiple ways to "determine whether the first touch surface faces the current user", which can be specifically determined according to the actual needs of the user, effectively expanding the applicable scenario range of the device and enhancing the user experience.

[0120] In some embodiments, the contact information is fingerprint information; the statement "the second determination unit is configured to determine whether the contact information obtained by the sensing unit matches the preset contact information" includes: the second determination unit is configured to calculate the eigenvalue of the contact information obtained by the sensing unit and compare it with the preset contact information; when the error is less than the preset error, it is determined to be a match; otherwise, it is determined not to be a match.

[0121] Preferably, the contact information includes first contact information or second contact information. The preset contact information includes first preset contact information or second preset contact information, and the first contact information or second contact information is fingerprint information; the statement "the second determination unit is configured to determine whether the obtained first contact information matches the first preset contact information" includes: the second determination unit is configured to calculate the eigenvalue of the first contact information captured by the sensing unit and compare it with the first preset contact information; when the error is less than the preset error, it is determined to be a match; otherwise, it is determined not to be a match. Alternatively, the statement "the second determination unit is configured to determine whether the obtained second contact information matches the second preset contact information" includes: the second determination unit is configured to calculate the eigenvalue of the second contact information captured by the sensing unit and compare it with the second preset contact information; when the error is less than the preset error, it is determined to be a match; otherwise, it is determined not to be a match. The comparison of fingerprint information can be performed through a fingerprint recognition algorithm, which includes steps such as preprocessing of the fingerprint image, data feature extraction, feature matching, and fingerprint recognition, and can be implemented by multiple algorithms. These algorithms are mature existing technologies and have been applied in various encryption and decryption fields, so they will not be elaborated here.

[0122] In some embodiments, the processing unit is further configured to issue a prompt message when the second determination unit determines that the first contact information does not match the first preset contact information or the second contact information does not match the second preset contact information. The prompt message includes one or more of a sound prompt message, an image prompt message, a light prompt message, and a video prompt message. The sound prompt message includes a voice prompt message for prompting the user that "the currently acquired contact information does not match the preset contact information", the image prompt message includes a pop-up window prompt message for prompting the user that "the currently acquired contact information does not match the preset contact information", the video prompt message includes an animation prompt message for prompting to input contact information again in the contact recognition area so that the sensing unit can capture the user's contact information, and the light prompt message includes changing the screen brightness or making the display screen emit light of different colors, etc.

[0123] In some embodiments, the device includes more than two touch surfaces. When the first touch surface and the second touch surface are in a folded state, one or more other touch surfaces are also folded and arranged between the first touch surface and the second touch surface. For example, taking the device further including a third display panel as an example, the third display panel includes a third touch surface. When the device is in a folded use state, the third touch surface can be attached to the back surface (non-touch surface) of the first display panel, and the non-touch surface of the third display panel can be attached to the back surface (non-touch surface) of the second display panel, so that only two touch surfaces of the folded display screen are arranged facing outward. The case where the device includes more than three display panels is similar to the case where it includes three display panels, and will not be elaborated here. In short, it is only necessary to ensure that when the device is in a folded use state, two touch surfaces are arranged facing outward.

[0124] In some embodiments, in order to save the cost of the device, the shape of the contact recognition area is a rectangle, and the center of the rectangle is located at the center position of the first touch surface. Correspondingly, the shape of the sensing unit is a rectangular film and is disposed below the contact recognition area. Of course, in some other embodiments, the number of sensing units can also be multiple, as long as multiple sensing units are spliced into a size adapted to the contact recognition area and are disposed below the contact recognition area.

[0125] Such as Figure 5As shown, in some embodiments, the sensing unit includes a TFT image sensing array film. The TFT image sensing array film includes a light detection and induction layer, and the light detection and induction layer is an array formed by photosensitive diodes. For both liquid crystal display (LCD) panels and organic light-emitting diode (OLED) display panels, a TFT structure is used to drive and scan a single pixel to achieve the display function of the pixel array on the panel. The main structure for forming the TFT switching function is a semiconductor field-effect transistor (FET). Well-known semiconductor layer materials mainly include amorphous silicon, polysilicon, indium gallium zinc oxide (IGZO), or organic compounds mixed with nano-carbon materials, etc. Since the structure of the light-sensing diode can also be prepared using such semiconductor materials, and the production equipment is also compatible with the production equipment of the TFT array, in recent years, TFT light-detection diodes have begun to be produced in the preparation method of the TFT array. The TFT image sensing array film described in this embodiment is the above-mentioned TFT light-detection diode (such as Figure 5 the light-sensing diode region part in), and the specific structure can refer to the description of the sensing unit structure in US Patent US6943070B2 and Chinese Patent CN204808361U. The difference between the production process of the TFT image sensing array film and the TFT structure of the display panel is that: the original pixel opening area on the display panel is changed to a light-sensing area in the production process. The TFT preparation method can use thin glass as the substrate or high-temperature resistant plastic materials as the substrate, as described in US Patent US6943070B2.

[0126] Figure 5 The sensing unit shown is vulnerable to factors such as reflection and refraction of ambient light or visible light emitted by the display screen pixels, causing optical interference, which seriously affects the signal-to-noise ratio (SNR) of the TFT image sensing array film embedded under the display panel. To improve the signal-to-noise ratio, it is possible to Figure 5 make further improvements on the basis of the sensing unit shown, so that the TFT image sensing array film can detect and identify the infrared signal of the contact information of the user's touch position. To enable the first touch surface to still obtain contact information in a dark environment, in some embodiments, the photosensitive diode is an infrared photosensitive diode, and the infrared photosensitive diode includes an infrared induction layer, and the infrared induction layer can be used to sense infrared signals, so that the sensing unit can also capture the user's contact information in a dark environment, and then execute operation instructions on the device.

[0127] As Figure 6 shown, in order to extend the wavelength range of the light signal that the TFT image sensing array film can recognize from the visible light range to the infrared light range, improvements are made to the Figure 5 TFT image sensing array film, specifically by using an infrared photosensitive diode to replace Figure 5The photodiode layer of the TFT image sensing array thin film, and the infrared photosensitive diode includes a microcrystalline silicon photodiode or an amorphous silicon compound photodiode.

[0128] Example 1: Replace the amorphous silicon p-type / i-type / n-type photodiode structure ( Figure 5 the photodiode layer in) with a microcrystalline silicon p-type / i-type / n-type photodiode structure. In this example, the degree of microcrystallinity of the photodiode is mainly controlled by mixing an appropriate hydrogen concentration into the gas silane (SiH4) during the chemical vapor deposition process to bond the dangling bonds of amorphous silicon with hydrogen atoms, so as to achieve the coating of the microcrystalline silicon p-type / i-type / n-type photodiode structure. By adjusting the hydrogen concentration of the chemical vapor deposition, the operating wavelength range of the microcrystalline photodiode can be extended to the range of optical wavelengths from 600 nm to 1000 nm.

[0129] In the example using a microcrystalline photodiode, in order to further improve the quantum efficiency of the photoelectric conversion, the microcrystalline silicon photodiode can also be formed by connecting more than two p-type / i-type / n-type structures in series. The p-type / i-type / n-type material of the first junction layer of the photodiode is still in an amorphous structure, and the p-type / i-type / n-type material above the second junction layer can be in a microcrystalline structure or a polycrystalline structure.

[0130] Example 2: Replace the amorphous silicon p-type / i-type / n-type photodiode structure ( Figure 5 the photodiode layer in) with a p-type / i-type / n-type photodiode structure doped with an amorphous silicon compound that can extend the photosensitive wavelength range. A preferred compound example is germanium silicide. In this example, during the coating process of the intrinsic layer (i-type) of the photodiode by chemical vapor deposition, germane (GeH4) is introduced into silane (SiH4) to achieve a photosensitive range of the amorphous germanium silicide p-type / i-type / n-type photodiode reaching the range of optical wavelengths from 600 nm to 1000 nm.

[0131] In the example using an amorphous silicon compound photodiode, in order to improve the quantum efficiency of the photoelectric conversion, the amorphous silicon photodiode can also be formed by connecting more than two p-type / i-type / n-type structures in series. The p-type / i-type / n-type material of the first junction layer of the photodiode is still in an amorphous silicon structure, and the p-type / i-type / n-type material above the second junction layer can be in a microcrystalline structure, a polycrystalline structure or a compound material doped with a compound that can extend the photosensitive wavelength range.

[0132] When the infrared sensing layer is an array formed by infrared photosensitive diodes, during the actual application process, a bias voltage (including a forward bias voltage, or a zero bias voltage or a negative bias voltage) can be applied between the p-type / i-type / n-type photodiodes by scanning driving with a TFT to achieve the function of the TFT image sensing array thin film emitting infrared light.

[0133] In some embodiments, the first trigger signal can be triggered by applying a forward bias voltage between the p-type / i-type / n-type infrared photosensitive diodes, and the second trigger signal can be triggered by applying a zero bias voltage or a negative bias voltage between the p-type / i-type / n-type infrared photosensitive diodes. For example, assuming that the array formed by the infrared photosensitive diodes has 10 columns (assuming the numbers are 1-10), a forward bias voltage can be applied to the pixel point array with odd numbers, so that the pixel point arrays in odd columns can emit infrared light signals, and a zero bias voltage or a negative bias voltage can be applied to the pixel point arrays with even numbers, so that the pixel point arrays in even columns are in a state of detecting infrared light, to capture the infrared light reflected back by the touch part and convert it into an infrared image for output. Of course, in some other embodiments, the first trigger signal can be triggered by applying a zero bias voltage or a negative bias voltage between the p-type / i-type / n-type infrared photosensitive diodes, and the second trigger signal can be triggered by applying a forward bias voltage between the p-type / i-type / n-type infrared photosensitive diodes. The first trigger signal can be a light source trigger signal, and the second trigger signal can be a detection trigger signal; of course, the first trigger signal can also be a detection trigger signal, and the second trigger signal can be a light source trigger signal.

[0134] In some embodiments, a forward bias voltage, or a zero bias voltage or a negative bias voltage, can also be alternately applied between the p-type / i-type / n-type infrared photosensitive diodes to trigger the first trigger signal or the second trigger signal. Still taking the array of 10 columns of pixel points formed by the infrared photosensitive diodes as an example, a forward bias voltage is applied to the p-type / i-type / n-type infrared photosensitive diodes in the first period, so that all 10 columns of pixel point arrays are in a state of emitting infrared light; a zero bias voltage or a negative bias voltage is applied to the p-type / i-type / n-type infrared photosensitive diodes in the second period, so that all 10 columns of pixel point arrays are in a state of detecting infrared light, for capturing the infrared light information reflected back by the touch part and generating a corresponding infrared image for output; a forward bias voltage is applied to the p-type / i-type / n-type infrared photosensitive diodes in the third period again, so that all 10 columns of pixel point arrays are in a state of emitting infrared light, and so on by repeating alternately. The light source trigger signal (the first trigger signal) and the detection trigger signal (the second trigger signal) are alternately switched and conform to a preset frequency. The time interval between adjacent periods can be set according to actual needs, and preferably the time interval can be set to the time required for the TFT array to drive and scan each frame (Frame) of the infrared photosensitive diode array to receive at least one frame of complete image signal, that is, the preset frequency is to perform a switch every time the above time interval passes.

[0135] In some embodiments, the first display panel or the second display panel is a display screen using active matrix thin film transistors as scanning drivers and data transmitters, including AMOLED display screens, LCD liquid crystal display screens, micro light emitting diode display screens, quantum dot display screens, or electronic ink display screens. As Figure 4As shown, when the first display panel is an LCD liquid crystal display screen or an electronic ink display screen, a backlight unit 103 is further provided below the sensing unit, and the sensing unit is disposed between the backlight unit and the LCD liquid crystal display screen, or between the backlight unit and the electronic ink display screen. Since the LCD liquid crystal display screen or the electronic ink display screen is not a self-luminous element, a backlight unit needs to be added below the sensing unit during installation. The backlight unit can be an LCD backlight module or other electronic components with self-luminous functions. In some other embodiments, when the display unit is an AMOLED display screen, a micro-LED display screen, or a quantum dot display screen, since these display screens are self-luminous elements, there is no need to provide a backlight unit. By setting the above two solutions, the production requirements of different manufacturers can be effectively met, and the applicable range of the terminal can be improved.

[0136] In some embodiments, when the first display panel is an LCD liquid crystal display screen or an electronic ink display screen, the TFT image sensing array film includes an infrared sensing layer, and the infrared sensing layer is an array formed by infrared photodiodes or infrared phototransistors. The LCD liquid crystal display screen or the electronic ink display screen is not a self-luminous element, so a Figure 6 TFT image sensing array film is required to sense and realize the recognition of contact information. For an AMOLED display screen, a micro-LED display screen, or a quantum dot display screen, since these display screens are self-luminous elements, Figure 5 the sensing unit can be used to detect and identify contact information (such as fingerprint recognition function), and of course, Figure 6 the structure of the sensing unit can also be used to improve the wavelength detection range of the sensing unit.

[0137] In some embodiments, the contact recognition area includes a plurality of contact recognition sub-areas, and a sensing unit is correspondingly provided below each contact recognition sub-area. The device further includes an operation instruction receiving unit and a sensing unit control circuit. The operation instruction receiving unit is used to receive a start instruction from the user for the contact recognition sub-area, and the sensing unit control circuit is used to turn on the sensing unit below the contact recognition sub-area; the operation instruction receiving unit is further used to receive a close instruction from the user for the contact recognition sub-area, and the sensing unit control circuit is used to turn off the sensing unit below the contact recognition sub-area. The start instruction can be triggered by the user turning on the power switch of the folding display screen, or by detecting that the current display screen is in a folded state.

[0138] Taking the number of contact recognition sub - regions as two as an example, the two contact recognition sub - regions can be evenly distributed one above the other or one to the left and one to the right on the first touch surface, or can be distributed in other arrangements on the first touch surface. During use, the sensing unit control circuit receives the start signal triggered by the user and sets the light detection devices (i.e., the sensing units) below the two contact recognition sub - regions to the on state. In a preferred embodiment, the range formed by the two contact recognition sub - regions covers the central region position of the first touch surface (such as a rectangular region centered on the screen with a size of 2 cm x 2 cm). This can ensure that when the light detection devices below the two contact recognition sub - regions are both set to the on state, the light signals entering the contact recognition area can be absorbed by the TFT image sensing array film (i.e., the light detection device) below, so as to capture the user's contact information.

[0139] In other embodiments, the range formed by the two contact recognition sub - regions can also account for 2 / 3, 3 / 4, etc. of the entire display screen area. Of course, the user can also, according to their own preferences, set the light detection device below one contact recognition sub - region to be on and the light detection device below the other contact recognition sub - region to be off. When the device does not need to be operated, the light detection devices below the two contact recognition sub - regions can also be set to the off state. In short, whether the light detection devices below each contact recognition sub - region are on or off can be set according to the user's own preferences.

[0140] As Figure 1 shown, it is a flowchart of a contact recognition method according to an embodiment of the present invention. The method is applied to a contact recognition device, the device includes a first display panel and a second display panel, the first display panel includes a first touch surface, the second display panel includes a second touch surface, the first touch surface and the second touch surface can be folded or unfolded towards each other, a contact recognition area is provided on the first touch surface, a sensing unit is provided below the contact recognition area, and the sensing unit is used to capture the user's contact information; the device includes a contact information preset unit, a processing unit, and a judgment unit; the judgment unit includes a first judgment unit and a second judgment unit.

[0141] The contact information preset unit is used to set the correspondence between the preset contact information and the operation instructions. The preset contact information includes first preset contact information and second preset contact information. The first preset contact information is the contact information input by the first touch part that is previously entered and stored in the storage unit, and the second preset contact information is the contact information input by the second touch part that is previously entered and stored in the storage unit.

[0142] When the first touch surface and the second touch surface are in the folded state and both the first touch surface and the second touch surface are arranged facing outwards, the method further includes:

[0143] First, enter step S101. The first judgment unit determines whether the first touch surface is facing the current user;

[0144] If it is determined that the first touch surface is facing the current user, then enter step S102. The sensing unit obtains the first contact information of the first touch part in the contact recognition area. After step S102, it can enter step S103. The second judgment unit determines whether the obtained first contact information matches the first preset contact information. If it matches, enter step S104. The processing unit executes the operation instruction corresponding to the first preset contact information. If it does not match, enter step S105. The processing unit does not execute the operation instruction corresponding to the first preset contact information;

[0145] If it is determined that the second touch surface is facing the current user, then enter step S106. The processing unit controls the second touch surface to display a virtual second touch part and a virtual contact recognition area. The display position of the virtual contact recognition area on the second touch surface corresponds to the display position of the contact recognition area on the first touch surface, and the display position of the virtual second touch part on the second touch surface corresponds to the position of the current second touch part on the first touch surface;

[0146] After step S106, it can also enter step S107. When the virtual second touch part is located in the virtual contact recognition area, the sensing unit obtains the second contact information of the second touch part in the contact recognition area. After step S107, it can enter step S108. The second judgment unit determines whether the obtained second contact information matches the second preset contact information. If it matches, enter step S109. The processing unit executes the operation instruction corresponding to the second preset contact information. If it does not match, enter step S110. The processing unit does not execute the operation instruction corresponding to the second preset contact information. Through the above solution, on the one hand, the user can directly input contact information on the display screen without additionally setting a contact sensor, effectively reducing the thickness of the device. On the other hand, when the device is in a folded state of use, even if the touch surface without a sensing unit is facing the user and the user does not need to flip the display screen, the user can also complete the input of contact information, effectively reducing the user operation and improving the user experience.

[0147] Such as Figure 2As shown, the device includes an operation instruction receiving unit. The step "the contact information preset unit sets the correspondence between the preset contact information and the operation instruction" includes: First, enter step S201 where the operation instruction receiving unit receives the user setting instruction, and the first display panel displays the contact recognition area; then enter step S202 where the sensing unit acquires the contact information of the user on the contact recognition area and saves it; then enter step S203 where the first display panel or the second display panel displays a list of operation instruction identifiers; the list of operation instruction identifiers contains one or more identifiers corresponding to the operation instructions, and each operation instruction identifier corresponds to an operation instruction; then enter step S204 where the operation instruction receiving unit receives the user's selection instruction for the operation instruction identifier, establishes the correspondence between the operation instruction corresponding to the selected operation instruction identifier and the contact information captured by the sensing unit, and saves it. The user can freely select the operation instruction corresponding to the contact information through the interaction interface to complete the setting of the correspondence between the contact information and the operation instruction, effectively improving the user experience.

[0148] In some embodiments, the step "the first judgment unit judges whether the first touch surface faces the current user" includes: The first judgment unit judges whether the preset biometric information is captured by the current sensing unit. If so, it is determined that the first touch surface faces the current user; otherwise, it is determined that the second touch surface faces the current user. The preset biometric information includes one or more of face feature information, ear feature information, and lip feature information.

[0149] In some other embodiments, the step "the first judgment unit judges whether the first touch surface faces the current user" includes: The first judgment unit judges whether the ambient light intensity sensed by the current sensing unit is lower than the preset light intensity value. If so, it is determined that the second touch surface faces the current user; otherwise, it is determined that the first touch surface faces the current user.

[0150] In some other embodiments, the step "the first judgment unit judges whether the first touch surface faces the current user" includes: The first judgment unit judges whether the number of contacts detected on the current first touch surface is greater than the preset number of contacts. If so, it is determined that the second touch surface faces the current user; otherwise, it is determined that the first touch surface faces the current user. Preferably, the number of contacts on the current first touch surface is detected by the sensing unit or the touch panel of the first display panel.

[0151] In short, there are multiple ways to "judge whether the first touch surface faces the current user", which can be specifically determined according to the actual needs of the user, effectively expanding the applicable scenario range of the device and enhancing the user experience.

[0152] In some embodiments, the first contact information or the second contact information is fingerprint information; the step "the second determination unit determines whether the acquired first contact information matches the first preset contact information" includes: the second determination unit calculates the eigenvalue of the first contact information captured by the sensing unit and compares it with the first preset contact information; when the error is less than the preset error, it is determined to be a match, otherwise it is determined not to be a match. Alternatively, the step "the second determination unit determines whether the acquired second contact information matches the second preset contact information" includes: the second determination unit calculates the eigenvalue of the second contact information captured by the sensing unit and compares it with the second preset contact information; when the error is less than the preset error, it is determined to be a match, otherwise it is determined not to be a match.

[0153] In some embodiments, the method further includes: when the second determination unit determines that the first contact information does not match the first preset contact information, or the second contact information does not match the second preset contact information, the processing unit issues a prompt message. The prompt message includes one or more of a sound prompt message, an image prompt message, a light prompt message, and a video prompt message. In this way, when the contact information does not match the preset contact information, the user can be informed in time so as to input the contact information again, enabling the terminal to execute the corresponding operation instruction as soon as possible.

[0154] In some embodiments, the device includes more than two touch surfaces. When the first touch surface and the second touch surface are in a folded state, one or more other touch surfaces are also folded between the first touch surface and the second touch surface. For example, taking the device further including a third display panel as an example, the third display panel includes a third touch surface. When the device is in a folded state, the third touch surface can be attached to the back surface (non-touch surface) of the first display panel, and the non-touch surface of the third display panel can be attached to the back surface (non-touch surface) of the second display panel, so that only two touch surfaces of the folded display screen are arranged facing outwards. The case where the device includes more than three display panels is similar to the case where it includes three display panels, and will not be elaborated here. Briefly, it is only necessary to ensure that when the device is in a folded state, two touch surfaces are arranged facing outwards.

[0155] In some embodiments, the device further includes an operation instruction receiving unit and a sensing unit control circuit. The method includes: the operation instruction receiving unit receives a start instruction from the user for the contact recognition sub-region, and the sensing unit control circuit turns on the sensing unit below the contact recognition sub-region; or, the operation instruction receiving unit receives a close instruction from the user for the contact recognition sub-region, and the sensing unit control circuit turns off the sensing unit below the contact recognition sub-region. Briefly, the light detection devices below each contact recognition sub-region can be turned on or off according to the user's preference.

[0156] The present invention provides a contact recognition method and device. When the first touch surface and the second touch surface are in a folded state, if it is determined that the first touch surface faces the current user, since a sensing unit is provided below the first touch surface, the first touch surface can directly collect the first contact information of the user. When it is determined that the second touch surface faces the current user, the processing unit projects the touch recognition area and the second touch part currently in contact with the first touch surface onto the second touch surface. The user can move the second touch part so that the virtual second touch part on the second touch surface is within the virtual touch recognition area. In this way, the touch recognition area of the first touch surface with its back facing the user can obtain the second contact information. This solves the problems such as inconvenient multi-finger fingerprint operation after folding of in-screen fingerprint recognition devices, high installation cost caused by full-screen configuration of fingerprint recognition devices in foldable mobile devices, and poor user interaction experience.

[0157] The above are only the embodiments of the present invention, and do not limit the patent scope of the present invention accordingly. Any equivalent structure or equivalent process transformation made by using the content of the specification and drawings of the present invention, or directly or indirectly applied in other related technical fields, shall be equally included in the patent protection scope of the present invention.

Claims

1. A contact recognition device, characterized in that, the device includes a first touch surface, a second touch surface, a first judgment unit, a sensing unit and a processing unit; the first touch surface and the second touch surface are located on the same plane or different planes. A contact recognition area is provided on the first touch surface, and a sensing unit is provided below the contact recognition area. The sensing unit is used to collect contact information of a touch part located in the contact recognition area; the first judgment unit is used for: when the first touch surface and the second touch surface are not on the same plane, judging whether the first touch surface faces the current user; when the first judgment unit determines that the first touch surface faces the current user, the processing unit is used to control the sensing unit to collect first contact information of a first touch part located in the contact recognition area; when the first judgment unit determines that the second touch surface faces the current user, the processing unit is used to control the second touch surface to display a virtual second touch part and a virtual contact recognition area. The display position of the virtual contact recognition area on the second touch surface corresponds to the display position of the contact recognition area on the first touch surface, and the display position of the virtual second touch part on the second touch surface corresponds to the position of the current second touch part on the first touch surface; the processing unit is further used for: when the virtual second touch part is located in the virtual contact recognition area, controlling the sensing unit to collect second contact information of the current second touch part in the contact recognition area.

2. The contact recognition device according to claim 1, characterized in that, it further includes a display panel. The first touch surface and the second touch surface are located in different areas of the display panel. The display panel is suitable for being unfolded or folded along a first folding direction; when the display panel is in an unfolded state, the first touch surface and the second touch surface are located in the same plane; when the display panel is in a folded state along the first folding direction, the first touch surface and the second touch surface face away from each other.

3. The contact recognition device according to claim 1, characterized in that, it further includes: a contact information preset unit for setting the correspondence between preset contact information and operation instructions; a second judgment unit for judging whether the contact information obtained by the sensing unit matches the preset contact information. If it matches, the processing unit is used to execute the operation instruction corresponding to the preset contact information. If it does not match, the processing unit does not execute the operation instruction corresponding to the preset contact information.

4. The contact recognition device according to claim 3, characterized in that, the preset contact information includes preset contact information of different parts of the user.

5. The contact recognition device according to claim 3, characterized in that, the device includes an operation instruction receiving unit. The "contact information preset unit is used to set the correspondence between preset contact information and operation instructions" includes: the operation instruction receiving unit is used to receive a user setting instruction, and the display panel is used to display a contact recognition area on the first touch surface; The sensing unit is configured to obtain and save the contact information of the user part on the contact recognition area; The display panel is configured to display a list of operation instruction identifiers, where the list of operation instruction identifiers includes one or more operation instruction identifiers, and each operation instruction identifier corresponds to an operation instruction; The operation instruction receiving unit is further configured to receive a selection instruction of the user for the operation instruction identifier, and establish and save the correspondence between the operation instruction corresponding to the operation instruction identifier selected by the user and the contact information obtained by the sensing unit.

6. The contact recognition device according to claim 5, wherein, the "displaying the contact recognition area on the first touch surface" includes: increasing the brightness of the contact recognition area or displaying a prompt input box on the contact recognition area.

7. The contact recognition device according to claim 3, wherein, the operation instructions include one or more of a system startup instruction, a text operation instruction, an image operation instruction, a video operation instruction, and an application operation instruction.

8. The contact recognition device according to claim 1, wherein, the "first determination unit is configured to: when the first touch surface and the second touch surface are not in the same plane, determine whether the first touch surface faces the current user" includes: the first determination unit is configured to determine whether the current sensing unit captures user feature information, if so, determine that the first touch surface faces the current user, otherwise determine that the second touch surface faces the current user.

9. The contact recognition device according to claim 8, wherein, the user feature information includes one or more of face feature information, ear feature information, and lip feature information.

10. The contact recognition device according to claim 1, wherein, the "first determination unit is configured to: when the first touch surface and the second touch surface are not in the same plane, determine whether the first touch surface faces the current user" includes: the first determination unit is configured to determine whether the ambient light intensity sensed by the current sensing unit is lower than a preset light intensity value, if so, determine that the second touch surface faces the current user, otherwise determine that the first touch surface faces the current user.

11. The contact recognition device according to claim 1, wherein, the "first determination unit is configured to: when the first touch surface and the second touch surface are not in the same plane, determine whether the first touch surface faces the current user" includes: the first determination unit is configured to determine whether the number of contacts detected on the current first touch surface is greater than a preset number of contacts, if so, determine that the second touch surface faces the current user, otherwise determine that the first touch surface faces the current user.

12. The contact recognition device according to claim 11, wherein, the number of contacts on the current first touch surface is detected by the sensing unit or the touch panel of the display panel.

13. The contact recognition device according to claim 3, wherein, The first contact information or the second contact information is fingerprint information; "the second determination unit is used to determine whether the contact information obtained by the sensing unit matches the preset contact information" includes: the second determination unit is used to calculate the eigenvalue of the contact information obtained by the sensing unit and compare it with the preset contact information; when the error is less than the preset error, it is determined to be a match, otherwise it is determined not to match.

14. The contact recognition device according to claim 13, wherein, the processing unit is further configured to issue a prompt message when the second determination unit determines that the contact information does not match the preset contact information.

15. The contact recognition device according to claim 14, wherein, the prompt message includes one or more of a sound prompt message, an image prompt message, a light prompt message, and a video prompt message.

16. The contact recognition device according to claim 2, wherein, the device includes more than two touch surfaces. When the display panel is in a folded state along the first folding direction, one or more other touch surfaces are also folded or arranged between the first touch surface and the second touch surface.

17. The contact recognition device according to claim 1, wherein, the sensing unit includes a TFT image sensing array film.

18. The contact recognition device according to claim 17, wherein, the TFT image sensing array film includes an infrared sensing layer; the infrared sensing layer is used to receive a first trigger signal, emit an infrared light signal; and is used to receive a second trigger signal and be in a state of detecting infrared light.

19. The contact recognition device according to claim 18, wherein, the infrared sensing layer includes an odd-column pixel point array and an even-column pixel point array; the first trigger signal is a forward bias signal, and the second trigger signal is a zero bias or negative bias signal; the odd-column pixel point array is used to receive the forward bias signal and emit an infrared light signal; the even-column pixel point array is used to receive the zero bias or negative bias signal and be in a state of detecting infrared light; alternatively, the even-column pixel point array is used to receive the forward bias signal and emit an infrared light signal; the odd-column pixel point array is used to receive the zero bias or negative bias signal and be in a state of detecting infrared light.

20. The contact recognition device according to claim 18 or 19, wherein, the first trigger signal and the second trigger signal are alternately switched and conform to a preset frequency.

21. The contact recognition device according to claim 2, wherein, the display panel is a display screen using an active matrix thin film transistor as a scanning driver and data transmitter.

22. The contact recognition device according to claim 2 or 21, wherein, the display panel includes any one of an AMOLED display screen, an LCD liquid crystal display screen, a micro light emitting diode display screen, a quantum dot display screen, or an electronic ink display screen.

23. The contact recognition device according to claim 22, wherein, When the display panel is an LCD liquid crystal display screen or an electronic ink display screen, a backlight unit is further disposed below the sensing unit, and the sensing unit is disposed between the backlight unit and the LCD liquid crystal display screen, or between the backlight unit and the electronic ink display screen.

24. The contact recognition device according to claim 1, characterized in that the contact recognition area includes a plurality of contact recognition sub-areas, and a sensing unit is correspondingly disposed below each contact recognition sub-area.

25. The contact recognition device according to claim 24, characterized in that the device further includes an operation instruction receiving unit and a sensing unit control circuit, the operation instruction receiving unit is configured to receive a start instruction of the user for the contact recognition sub-area, and the sensing unit control circuit is configured to turn on the sensing unit below the contact recognition sub-area; the operation instruction receiving unit is further configured to receive a close instruction of the user for the contact recognition sub-area, and the sensing unit control circuit is configured to turn off the sensing unit below the contact recognition sub-area.

26. The contact recognition device according to claim 1, characterized in that the first contact information or the second contact information includes fingerprint feature information.

27. A contact recognition method, characterized in that the method is applied to a contact recognition device, and the device includes a first touch surface, a second touch surface, a first judgment unit, a sensing unit and a processing unit; the first touch surface and the second touch surface are located on the same plane or different planes, a contact recognition area is disposed on the first touch surface, and a sensing unit is disposed below the contact recognition area, and the sensing unit is configured to collect contact information of a touch part located in the contact recognition area; the method includes the following steps: when the first touch surface and the second touch surface are not on the same plane, the first judgment unit judges whether the first touch surface faces the current user; when the first judgment unit determines that the first touch surface faces the current user, the processing unit controls the sensing unit to collect first contact information of a first touch part located in the contact recognition area; when the first judgment unit determines that the second touch surface faces the current user, the processing unit controls the second touch surface to display a virtual second touch part and a virtual contact recognition area, and a display position of the virtual contact recognition area on the second touch surface corresponds to a display position of the contact recognition area on the first touch surface, and a display position of the virtual second touch part on the second touch surface corresponds to a position of the current second touch part on the first touch surface; when the virtual second touch part is located in the virtual contact recognition area, the processing unit controls the sensing unit to collect second contact information of the current second touch part in the contact recognition area.

28. The contact recognition method according to claim 27, characterized in that the device further includes a contact information preset unit and a second judgment unit; the method further includes the following steps: the contact information preset unit sets a corresponding relationship between preset contact information and operation instructions; The second judgment unit determines whether the contact information acquired by the sensing unit matches the preset contact information. If it matches, the processing unit executes the operation instruction corresponding to the preset contact information. If it does not match, the processing unit does not execute the operation instruction corresponding to the preset contact information.

29. The contact recognition method according to claim 28, wherein, the device includes an operation instruction receiving unit, and the "contact information preset unit sets the correspondence between the preset contact information and the operation instruction" includes: The operation instruction receiving unit receives a user setting instruction, and the display panel displays a contact recognition area on the first touch surface; The sensing unit acquires the contact information of the user part on the contact recognition area and saves it; The display panel displays a list of operation instruction identifiers, and the list of operation instruction identifiers contains one or more operation instruction identifiers, and each operation instruction identifier corresponds to an operation instruction; The operation instruction receiving unit receives a selection instruction of the operation instruction identifier by the user, and establishes and saves the correspondence between the operation instruction corresponding to the operation instruction identifier selected by the user and the contact information acquired by the sensing unit.

30. The contact recognition method according to claim 29, wherein, the "displaying a contact recognition area on the first touch surface" includes: increasing the brightness of the contact recognition area or displaying a prompt input box on the contact recognition area.

31. The contact recognition method according to claim 27, wherein, the "when the first touch surface and the second touch surface are not in the same plane, the first judgment unit determines whether the first touch surface faces the current user" includes: The first judgment unit determines whether the current sensing unit captures the contact information of the user part. If so, it is determined that the first touch surface faces the current user, otherwise it is determined that the second touch surface faces the current user.

32. The contact recognition method according to claim 27, wherein, the "when the first touch surface and the second touch surface are not in the same plane, the first judgment unit determines whether the first touch surface faces the current user" includes: The first judgment unit determines whether the ambient light intensity sensed by the current sensing unit is lower than a preset light intensity value. If so, it is determined that the second touch surface faces the current user, otherwise it is determined that the first touch surface faces the current user.

33. The contact recognition method according to claim 27, wherein, the "first judgment unit determines whether the first touch surface faces the current user" includes: The first judgment unit determines whether the number of contacts on the detected current first touch surface is greater than a preset number of contacts. If so, it is determined that the second touch surface faces the current user, otherwise it is determined that the first touch surface faces the current user.

34. The contact recognition method according to claim 33, wherein, the number of contacts on the current first touch surface is detected by the sensing unit or the touch panel of the display panel.

35. The contact recognition method according to claim 27, wherein, the contact information is fingerprint information; the "second judgment unit determines whether the contact information acquired by the sensing unit matches the preset contact information" includes: The second judgment unit calculates the eigenvalue based on the contact information obtained by the sensing unit and compares it with the preset contact information; When the error is less than the preset error, it is determined to be a match; otherwise, it is determined to be a mismatch.

36. The contact recognition method according to claim 35, wherein, the method further includes: When the second judgment unit determines that the contact information does not match the preset contact information, the processing unit issues a prompt message.

37. The contact recognition method according to claim 27, wherein, the sensing unit includes a TFT image sensing array film.

38. The contact recognition method according to claim 37, wherein, the TFT image sensing array film includes an infrared sensing layer; the method includes: the infrared sensing layer receives the first trigger signal and emits an infrared light signal; and the infrared sensing layer receives the second trigger signal and is in a state of detecting infrared light.

39. The contact recognition method according to claim 38, wherein, the infrared sensing layer includes an odd-numbered pixel point array and an even-numbered pixel point array; the first trigger signal is a forward bias signal, and the second trigger signal is a zero bias or negative bias signal; the method includes: the odd-numbered pixel point array receives the forward bias signal and emits an infrared light signal; the even-numbered pixel point array receives the zero bias or negative bias signal and is in a state of detecting infrared light; or, the even-numbered pixel point array receives the forward bias signal and emits an infrared light signal; the odd-numbered pixel point array receives the zero bias or negative bias signal and is in a state of detecting infrared light.

40. The contact recognition method according to claim 38 or 39, wherein, the first trigger signal and the second trigger signal are alternately switched and conform to a preset frequency.

41. The contact recognition method according to claim 27, wherein, the contact recognition area includes a plurality of contact recognition sub-areas, and a sensing unit is correspondingly arranged below each contact recognition sub-area.

42. The contact recognition method according to claim 41, wherein, the device further includes an operation instruction receiving unit and a sensing unit control circuit, and the method includes the following steps: The operation instruction receiving unit receives a start instruction from the user for a contact recognition sub-area, and the sensing unit control circuit turns on the sensing unit below the contact recognition sub-area; or, the operation instruction receiving unit receives a close instruction from the user for a contact recognition sub-area, and the sensing unit control circuit turns off the sensing unit below the contact recognition sub-area.

Images