Electronic apparatus

Abstract

To provide an electronic apparatus that has a sensing function and a display function.SOLUTION: According to an embodiment, an electronic apparatus comprises: a display panel including a polymer-dispersed liquid crystal in a display area for displaying an image; a light source unit arranged along an edge of the display panel; and a sensor panel superimposed on the display panel. The sensor panel includes a plurality of optical sensors arranged in a sensing area superimposed on the display area, and light blocking layers each arranged between each of the plurality of optical sensors and the display panel.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] FIELD An embodiment of the present invention relates to an electronic device. [Background technology]

[0002] The optical detection device includes, for example, a PIN photodiode as an optical sensor. As an example of a technique for providing such an optical sensor on a substrate, a technique for providing the photodiode so as to overlap with a plurality of transistors is known. On the other hand, a display device that combines a transparent display with a movable scanner is known, which scans an object while observing the object through the transparent display and provides supplementary information. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-190483 [Patent Document 2] US Patent Application Publication No. 2015 / 0371407 Summary of the Invention [Problem to be solved by the invention]

[0004] An object of the embodiments is to provide an electronic device having a sensing function and a display function. [Means for solving the problem]

[0005] According to one embodiment, the electronic device comprises: The display device comprises a display panel having a polymer dispersed liquid crystal in a display area that displays an image, a light source unit arranged along the edge of the display panel, and a sensor panel that overlays the display panel, the sensor panel comprising a plurality of optical sensors arranged in a sensing area that overlays the display area, and a light-shielding layer that is arranged between each of the plurality of optical sensors and the display panel. [Brief explanation of the drawings]

[0006] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of an electronic device 1. As shown in FIG. [Figure 2] FIG. 2 is a diagram showing an example of the configuration of the control unit 400. As shown in FIG. [Figure 3] FIG. 3 is a diagram showing an example of the configuration of the display panel 100 shown in FIG. [Figure 4] FIG. 4 is a diagram showing an example of the configuration of the sensor panel 200 shown in FIG. [Figure 5] FIG. 5 is a diagram showing an example of the circuit configuration of the optical sensor 50. As shown in FIG. [Figure 6] FIG. 6 is a diagram showing an example of the cross section of the sensor panel 200 including the photodiode PD. [Figure 7] FIG. 7 is a cross-sectional view showing an example of the configuration of the electronic device 1 shown in FIG. [Figure 8] FIG. 8 is a diagram for explaining the first mode MODE1 in sensing of the electronic device 1. As shown in FIG. [Figure 9] FIG. 9 is a diagram for explaining the second mode MODE2 in sensing of the electronic device 1. As shown in FIG. [Figure 10] FIG. 10 is a diagram for explaining the third mode MODE3 in sensing of the electronic device 1. As shown in FIG. [Figure 11] FIG. 11 is a flowchart for explaining an example of control of the electronic device 1 by the control unit 400 shown in FIG. [Figure 12] FIG. 12 is a diagram showing an example of an image displayed on the display panel 100 by sensing the print surface PS of the object OJ. [Figure 13] FIG. 13 is a diagram showing an example of an image displayed on the display panel 100 when the electronic device 1 is spaced apart from the object OJ. [Figure 14] FIG. 14 is a diagram showing another example of an image displayed on the display panel 100 by sensing the printing surface PS of the object OJ. DETAILED DESCRIPTION OF THE INVENTION

[0007] An embodiment will be described with reference to the drawings. The disclosure is merely an example, and appropriate modifications that a person skilled in the art can easily make while maintaining the gist of the invention are naturally included within the scope of the present invention. Furthermore, the drawings may be schematic in terms of the width, thickness, shape, etc. of each part compared to the actual embodiment for the sake of clarity, but these are merely examples and are not intended to limit the interpretation of the present invention. Furthermore, in this specification and each drawing, components that perform the same or similar functions as those described above with reference to the previous drawings are designated by the same reference numerals, and redundant detailed descriptions may be omitted as appropriate.

[0008] In addition, to facilitate understanding, the drawings will depict mutually orthogonal X, Y, and Z axes as necessary. The direction along the X axis is referred to as the first direction X, the direction along the Y axis is referred to as the second direction Y, and the direction along the Z axis is referred to as the third direction Z. Viewing various elements parallel to the third direction Z is referred to as a planar view. Terms referring to the relative positions of two or more components, such as "on top," "above," "between," and "opposite," include not only cases where the two or more components are in direct contact with each other, but also cases where they are separated from each other by a gap or another component. The positive direction of the Z axis is referred to as "up" or "above."

[0009] FIG. 1 is a diagram showing an example of the configuration of an electronic device 1. As shown in FIG.

[0010] The electronic device 1 includes a display panel 100, a sensor panel 200, a light source unit 300, and a control unit 400.

[0011] Each of the display panel 100 and the sensor panel 200 is formed in a flat plate shape along an XY plane defined by a first direction X and a second direction Y. The display panel 100 is configured to display an image. The sensor panel 200 overlaps the display panel in a third direction Z. The sensor panel 200 is configured to detect reflected light from an object.

[0012] The light source unit 300 is disposed, for example, along an edge portion of the display panel 100 extending in the first direction X. The light source unit 300 is configured to mainly illuminate the display panel 100. The control unit 400 is configured to control the display panel 100, the sensor panel 200, and the light source unit, and will be described in detail below.

[0013] FIG. 2 is a diagram showing an example of the configuration of the control unit 400. As shown in FIG.

[0014] The control unit 400 includes a main control unit 410, a memory 420, a display panel control unit 430, a sensor panel control unit 440, a light source unit control unit 450, and an audio control unit 460. A power supply unit 470 and an information setting unit 480 are connected to the control unit 400.

[0015] The main control unit 410 is configured to control each unit. The memory 420 is configured to store various programs required for controlling each unit, various information set via the information setting unit 480, various data generated by the main control unit 410, etc.

[0016] The display panel control unit 430 is configured to control the display panel 100. The sensor panel control unit 440 is configured to control the sensor panel 200. The light source unit control unit 450 is configured to control the light source unit 300. The audio control unit 460 is configured to control the speaker 500. Note that the audio control unit 460 and the speaker 500 may be omitted.

[0017] FIG. 3 is a diagram showing an example of the configuration of the display panel 100 shown in FIG.

[0018] In this embodiment, a display panel including a polymer dispersed liquid crystal will be described as an example of the display panel 100.

[0019] The display panel 100 includes a transparent substrate 10, a transparent substrate 20, a liquid crystal layer LC, and a seal SE. The transparent substrate 10 and the transparent substrate 20 are each formed in a flat plate shape parallel to the XY plane and overlap each other in a planar view. The transparent substrate 10 has an extension portion EX that extends further in the second direction Y than the transparent substrate 20 and does not overlap the transparent substrate 20.

[0020] The liquid crystal layer LC is located between the transparent substrate 10 and the transparent substrate 20 and is sealed with a seal SE. As shown enlarged and schematically in FIG. 3, the liquid crystal layer LC includes a polymer-dispersed liquid crystal including a polymer PL and liquid crystal molecules LM. In one example, the polymer PL is a liquid crystal polymer. The polymer PL is formed in stripes extending along the first direction X. The liquid crystal molecules LM are dispersed in the gaps between the polymer PL and are oriented with their major axes aligned along the first direction X. The polymer PL and the liquid crystal molecules LM each have optical anisotropy or refractive index anisotropy. The responsiveness of the polymer PL to an electric field is lower than that of the liquid crystal molecules LM.

[0021] In one example, the alignment direction of the polymer PL hardly changes regardless of whether an electric field is applied or not. On the other hand, the alignment direction of the liquid crystal molecules LM changes in response to an electric field when a high voltage equal to or greater than a threshold value is applied to the liquid crystal layer LC. When no voltage is applied to the liquid crystal layer LC, the optical axes of the polymer PL and the liquid crystal molecules LM are parallel to each other, and light incident on the liquid crystal layer LC is transmitted through the liquid crystal layer LC with almost no scattering within the liquid crystal layer LC (transparent state). When a voltage is applied to the liquid crystal layer LC, the optical axes of the polymer PL and the liquid crystal molecules LM intersect with each other, and light incident on the liquid crystal layer LC is scattered within the liquid crystal layer LC (scattered state).

[0022] The display panel 100 has a display area DA for displaying an image. The display area DA includes a plurality of pixels PX arranged in a matrix in a first direction X and a second direction Y.

[0023] As shown enlarged in FIG. 3, each pixel PX includes a switching element SW, a pixel electrode PE, a common electrode CE, a liquid crystal layer LC, etc. The switching element SW is formed, for example, by a thin film transistor (TFT) and is electrically connected to a scanning line G and a signal line S. The scanning line G extends in a first direction X and is electrically connected to the switching element SW in each of the pixels PX aligned in the first direction X. The signal line S extends in a second direction Y, intersects with the scanning line G, and is electrically connected to the switching element SW in each of the pixels PX aligned in the second direction Y. The pixel electrode PE is electrically connected to the switching element SW. Each pixel electrode PE faces the common electrode CE, and drives the liquid crystal layer LC (particularly, liquid crystal molecules LM) by an electric field generated between the pixel electrode PE and the common electrode CE. The capacitance CS is formed, for example, between an electrode having the same potential as the common electrode CE and an electrode having the same potential as the pixel electrode PE.

[0024] The IC chip CP and a flexible printed circuit board (not shown) are provided on the extending portion EX of the transparent substrate 10. The light source unit 300 overlaps the extending portion EX in a plan view.

[0025] In the plurality of pixels (or pixel electrodes) PX, the pitch in each of the first direction X and the second direction Y is, for example, about 200 μm from the viewpoint of ensuring that the transmittance of the display panel 100 is 85% or more.

[0026] FIG. 4 is a diagram showing an example of the configuration of the sensor panel 200 shown in FIG.

[0027] The sensor panel 200 includes a transparent substrate 30, a transparent substrate 40, and an optical sensor 50. The transparent substrate 30 and the transparent substrate 40 are each formed in the shape of a flat plate parallel to the XY plane, and overlap each other in a plan view.

[0028] The sensor panel 200 has a sensing area SA where sensing is performed. A plurality of optical sensors 50 are arranged in a matrix in the first direction X and the second direction Y in the sensing area SA. The optical sensors 50 have photodiodes PD. The photodiodes PD are, for example, PIN (Positive Intrinsic Negative) photodiodes, and are configured to output electrical signals according to the intensity of received light.

[0029] In order to obtain the resolution required to recognize, for example, a character string on an object, it is desirable that the pitch of the optical sensors 50 in each of the first direction X and the second direction Y be 150 μm or less. On the other hand, as the pitch of the optical sensors 50 becomes smaller, the transmittance of the sensor panel 200 decreases. Therefore, in order to ensure a transmittance of approximately 70% or more in the sensor panel 200, it is desirable that the pitch of the optical sensors 50 in each of the first direction X and the second direction Y be 100 μm or more.

[0030] As described above, the display panel 100 is required to have high transmittance, and the pitch of the pixels PX is approximately 200 μm. On the other hand, the sensor panel 200 is required to have both sufficient resolution and high transmittance, and the pitch of the photosensors 50 is smaller than the pitch of the pixels PX, for example, 100 μm or more, such as 150 μm. Therefore, when the sensor panel 200 is superimposed on the display panel 100, at least one photosensor 50 is superimposed on one pixel electrode PE.

[0031] FIG. 5 is a diagram showing an example of the circuit configuration of the optical sensor 50. As shown in FIG.

[0032] The optical sensor 50 includes a photodiode PD, a first transistor (reset transistor) Mrst, a second transistor (readout transistor) Mrd, and a third transistor (source follower transistor) Msf. The optical sensor 50 also includes a first scanning line (reset control scanning line) GLrst and a second scanning line (readout control scanning line) GLrd as detection drive lines (scanning lines), and a signal line (output signal line) SL as a signal readout wiring. The first scanning line GLrst is a wiring to which a reset control signal RST is supplied, and the second scanning line GLrd is a wiring to which a readout control signal RD is supplied. The signal line SL is connected to a detection circuit DT. The detection circuit DT is included in, for example, the sensor panel control unit 440 shown in FIG. 2.

[0033] A reference potential VCOM is applied to the anode side of the photodiode PD. The cathode side of the photodiode PD is connected to a node N1. The node N1 is connected to a capacitance element Cs, one of the source electrode and drain electrode of the first transistor Mrst, and the gate electrode of the third transistor Msf. In addition, a parasitic capacitance Cp exists at the node N1. When the photodiode PD receives light, the signal (charge) output from the photodiode PD is accumulated in the capacitance element Cs.

[0034] The gate electrode of the first transistor Mrst is connected to the first scan line GLrst. The other of the source electrode and drain electrode of the first transistor Mrst is supplied with a reset potential Vrst. When the first transistor Mrst is turned on (conductive) in response to a reset control signal RST, the potential of the node N1 is reset to the reset potential Vrst. The reference potential VCOM has a potential lower than the reset potential Vrst, and the photodiode PD is reverse-bias driven.

[0035] The third transistor Msf is connected between a terminal to which a power supply potential VDD is supplied and the second transistor Mrd (node ​​N2). The gate electrode of the third transistor Msf is connected to node N1. The gate electrode of the third transistor Msf is supplied with a signal (charge) generated in the photodiode PD. As a result, the third transistor Msf outputs a signal voltage corresponding to the signal (charge) generated in the photodiode PD to the second transistor Mrd.

[0036] The second transistor Mrd is connected between the source electrode (node ​​N2) of the third transistor Msf and the signal line SL (node ​​N3). The gate electrode of the second transistor Mrd is connected to the second scan line GLrd. When the second transistor Mrd is turned on in response to the read control signal RD, the signal output from the third transistor Msf, i.e., a signal voltage corresponding to the signal (charge) generated in the photodiode PD, is output as the detection signal Vdet to the detection circuit DT via the signal line SL.

[0037] FIG. 6 is a diagram showing an example of the cross section of the sensor panel 200 including the photodiode PD.

[0038] The circuit layer 32 is disposed on the transparent substrate 30. The circuit layer 32 includes a plurality of transistors included in the optical sensor 50 shown in FIG. 5, various wirings such as scanning lines and signal lines, and a plurality of insulating layers.

[0039] The lower electrode LE is disposed on the circuit layer 32. The upper electrode UE is disposed to face the lower electrode LE. The photodiode PD is disposed between the lower electrode LE and the upper electrode UE.

[0040] For example, a case will be described in which the lower electrode LE functions as the anode electrode of the photodiode PD and the upper electrode UE functions as the cathode electrode of the photodiode PD. The lower electrode LE is connected to the wiring of the reference potential VCOM shown in Figure 5, and the upper electrode UE is connected to the node N1 shown in Figure 5.

[0041] The photodiode PD has, as semiconductor layers, a p-type semiconductor layer 51, an i-type semiconductor layer 52, and an n-type semiconductor layer 53. The p-type semiconductor layer 51, the i-type semiconductor layer 52, and the n-type semiconductor layer 53 are formed of, for example, amorphous silicon (a-Si). Note that the material of the semiconductor layers is not limited to the above and may be, for example, polycrystalline silicon, microcrystalline silicon, or the like.

[0042] The p-type semiconductor layer 51 is disposed on the lower electrode LE. The i-type semiconductor layer 52 is disposed on the p-type semiconductor layer 51. The n-type semiconductor layer 53 is disposed on the i-type semiconductor layer 52. The upper electrode UE is disposed on the n-type semiconductor layer 53.

[0043] The insulating layer 33 includes, for example, an organic insulating layer, and reduces unevenness caused by the circuit layer 32 and the optical sensor 50 .

[0044] The transparent substrate 40 is adhered to the insulating layer 33 via a transparent adhesive layer 34. The outer surface of the transparent substrate 40 corresponds to the sensing surface 200A of the sensor panel 200 that faces an object. The optical sensor 50 is configured to receive light incident through the sensing surface 200A and output a detection signal.

[0045] Furthermore, in such a sensor panel 200, a light-shielding layer 31 is disposed between the transparent substrate 30 and the optical sensor 50. In the illustrated example, the light-shielding layer 31 is disposed between the transparent substrate 30 and the circuit layer 32. The light-shielding layer 31 is formed to have a width equal to or greater than that of the photodiode PD. Such a light-shielding layer 31 blocks light traveling from the transparent substrate 30 toward the lower electrode LE. This prevents unwanted light from entering the optical sensor 50, thereby reducing noise.

[0046] Fig. 7 is a cross-sectional view showing an example of the configuration of the electronic device 1 shown in Fig. 1. Note that in Fig. 7, the display panel 100, the sensor panel 200, and the light source unit 300 are shown in a simplified manner.

[0047] In the display panel 100, a transparent substrate 10 and a transparent substrate 20 face each other. A liquid crystal layer LC is located between the transparent substrate 10 and the transparent substrate 20. Each pixel electrode PE of the pixel PX is disposed between the transparent substrate 10 and the liquid crystal layer LC and is covered with an alignment film AL1. A common electrode CE facing the plurality of pixel electrodes PE is disposed between the transparent substrate 20 and the liquid crystal layer LC and is covered with an alignment film AL2. The liquid crystal layer LC is in contact with the alignment films AL1 and AL2.

[0048] In the sensor panel 200, the transparent substrate 30 and the transparent substrate 40 face each other. Each of the optical sensors 50 is located between the transparent substrate 30 and the transparent substrate 40, and in the illustrated example, is disposed on the transparent substrate 30. When the sensor panel 200 is superimposed on the display panel 100, the transparent substrate 30 faces the transparent substrate 20. The sensing area SA of the sensor panel 200 overlaps the display area DA of the display panel 100. The light-shielding layer 31 is located between each of the optical sensors 50 and the display panel 100, and is disposed on the transparent substrate 30 in the illustrated example. At least one of the multiple optical sensors 50 overlaps one pixel electrode PE.

[0049] In the illustrated example, the electronic device 1 further includes a transparent light guide plate 600. The light guide plate 600 is located between the transparent substrate 20 of the display panel 100 and the transparent substrate 30 of the sensor panel 200, and is adhered to the transparent substrate 20 via a transparent adhesive layer AD1 and to the transparent substrate 30 via a transparent adhesive layer AD2. The adhesive layer AD1 and the adhesive layer AD2 all have refractive indices equivalent to those of the transparent substrate 20, the transparent substrate 30, and the light guide plate 600. Therefore, undesired interface reflections are suppressed between the transparent substrate 20 and the light guide plate 600 and between the light guide plate 600 and the transparent substrate 30.

[0050] The light source unit 300 faces the side surfaces of the transparent substrate 20 and the light guide plate 600. The light source unit 300 includes a light emitting element LD and a light guide element LG. Although not described in detail, the light emitting element LD includes a red light emitting portion, a green light emitting portion, and a blue light emitting portion. These red light emitting portion, green light emitting portion, and blue light emitting portion may be lit sequentially or all at the same time.

[0051] The transparent substrate 10, the transparent substrate 20, the transparent substrate 30, the transparent substrate 40, and the light guide plate 600 may be glass substrates or resin substrates. When the transparent substrate 30 is a glass substrate, the transparent substrate 30 can function as a light guide plate, and the light guide plate 600 may be omitted.

[0052] In such an electronic device 1, the outer surface of the transparent substrate 40 (the surface opposite to the surface facing the optical sensor 50) corresponds to the sensing surface 200A, and the outer surface of the transparent substrate 10 (the surface opposite to the surface facing the liquid crystal layer LC) corresponds to the incident surface 100A of external light.

[0053] Next, object sensing in the electronic device 1 will be described.

[0054] FIG. 8 is a diagram for explaining the first mode MODE1 in sensing of the electronic device 1. As shown in FIG.

[0055] The first mode MODE1 is sensing using external light L1 around the electronic device 1. Therefore, the light source unit 300 is in an off state, and the light emitting element LD is maintained in a non-illuminated state. Furthermore, in the display panel 100, no voltage is applied to the liquid crystal layer LC in any of the pixels PX, and the entire display area DA is maintained in a transparent state.

[0056] The object OJ to be sensed has a print surface PS on which, for example, a character string is printed. The electronic device 1 is installed so that the sensing surface 200A faces the print surface PS. From the viewpoint of reliably recognizing the character string, it is desirable that the sensing surface 200A be in contact with the print surface PS, as in the illustrated example.

[0057] External light L1 incident from the incident surface 100A of the electronic device 1 passes through the display panel 100, passes through the light guide plate 600, and enters the sensor panel 200. At this time, external light L1 that passes through the transparent substrate 30 and then heads directly toward the optical sensor 50 is blocked by the light-shielding layer 31. After passing through the transparent substrate 30, external light L1 passes between adjacent optical sensors 50, passes through the transparent substrate 40, and is reflected by the printed surface PS of the object OJ. The optical sensor 50 receives a portion of the reflected light RL from the printed surface PS and outputs a detection signal according to the light intensity.

[0058] According to the first mode MODE1, optical sensing can be achieved by utilizing external light L1. This allows for more power saving than sensing with the light source unit 300 turned on. Furthermore, compared to electronic devices equipped with movable scanners, a mechanism for moving the scanner is not required, simplifying the device configuration and enabling thinner and lighter electronic devices. Furthermore, the side of the optical sensor 50 facing the display panel 100 is shielded by a light-shielding layer 31. This prevents unwanted external light L1 from entering the optical sensor 50.

[0059] FIG. 9 is a diagram for explaining the second mode MODE2 in sensing of the electronic device 1. As shown in FIG.

[0060] The second mode MODE2 is sensing using illumination light L2 emitted from the light source unit 300. The second mode MODE2 is performed when the electronic device 1 is used in a dark place and the amount of external light L1 in the first mode MODE1 is insufficient for sensing. Therefore, the light source unit 300 is in an on state, and the light-emitting element LD is lit during sensing. In the second mode MODE2, no voltage is applied to the liquid crystal layer LC in any of the pixels PX of the display panel 100, and the entire display area DA is maintained in a transparent state.

[0061] Illumination light L2 emitted from the light source unit 300 propagates while being totally reflected by the display panel 100 and the light guide plate 600. A portion of the illumination light L2 that does not satisfy the total reflection conditions is incident on the sensor panel 200. At this time, the illumination light L2 that passes through the transparent substrate 30 and then heads directly toward the optical sensor 50 is blocked by the light-shielding layer 31. After passing through the transparent substrate 30, the illumination light L2 passes between adjacent optical sensors 50, then passes through the transparent substrate 40 and is reflected by the printed surface PS of the object OJ. The optical sensor 50 receives a portion of the reflected light RL from the printed surface PS and outputs a detection signal according to the light intensity.

[0062] According to the second mode MODE2, optical sensing can be achieved in a dark place by using the illumination light L2. In the second mode MODE2, in addition to the illumination light L2, external light L1 around the electronic device 1 is also used, although not shown. In the second mode MODE2, the display panel 100 is maintained in a transparent state. Therefore, the object OJ can be observed through the electronic device 1 from the transparent substrate 10 side. In other words, the object OJ can be sensed while being observed.

[0063] FIG. 10 is a diagram for explaining the third mode MODE3 in sensing of the electronic device 1. As shown in FIG.

[0064] The third mode MODE3 is sensing that mainly utilizes scattered light L3 emitted from the light source unit 300 and scattered by the display panel 100. This third mode MODE3 is implemented when the electronic device 1 is used in a dark place and the amount of illumination light L2 in the second mode MODE2 is insufficient for sensing. Therefore, the light source unit 300 is in an on state, and the light-emitting element LD is lit during sensing. In the third mode MODE3, a voltage is applied to the liquid crystal layer LC in all pixels PX of the display panel 100, and the entire display area DA is maintained in a scattering state.

[0065] Illumination light L2 emitted from the light source unit 300 propagates while being totally reflected by the display panel 100 and the light guide plate 600. A portion of illumination light L2 that does not satisfy the total reflection conditions and a portion of scattered light L3 scattered by the display panel 100 are incident on the sensor panel 200. At this time, light that passes through the transparent substrate 30 and then travels directly toward the optical sensor 50 is blocked by the light-shielding layer 31. Light that passes through the transparent substrate 30 and then travels between adjacent optical sensors 50 passes through the transparent substrate 40 and is reflected by the printed surface PS of the object OJ. The optical sensor 50 receives a portion of the reflected light RL from the printed surface PS and outputs a detection signal according to the light intensity.

[0066] According to the third mode MODE3, optical sensing can be achieved in a dark place by using the illumination light L2 and the scattered light L3. In addition to the illumination light L2 and the scattered light L3, the third mode MODE3 also uses external light L1 around the electronic device 1, although this is not shown.

[0067] Furthermore, in the second mode MODE2 and the third mode MODE3, sensing is performed using light from the light source unit 300 that is necessary to display an image on the display panel 100. Therefore, compared to electronic devices that include a light source dedicated to a scanner, the number of components can be reduced, enabling cost reduction of the electronic device 1. Furthermore, the side of the optical sensor 50 that faces the display panel 100 is shielded by the light-shielding layer 31, thereby suppressing incidence of undesired illumination light L2 and scattered light L3 on the optical sensor 50.

[0068] In the second mode MODE2 and the third mode MODE3, the light source unit 300 may emit white light as the illumination light L2, or may emit light with a wavelength suitable for the sensitivity of the optical sensor 50.

[0069] Next, an example of control of the electronic device 1 by the control unit 400 shown in FIG. 2 will be described with reference to FIG.

[0070] Based on a request to start sensing via the information setting unit 480, the main control unit 410 controls the sensor panel control unit 440 to start sensing of the object OJ facing the sensing surface 200A in the first mode MODE1 (step ST1).

[0071] Then, the main control unit 410 controls the sensor panel control unit 440 to recognize the levels of the detection signals output from the multiple optical sensors 50 and determine whether a sufficient amount of light is obtained for sensing in the first mode MODE1 (step ST2).

[0072] Based on the determination that the amount of light in the first mode MODE1 is insufficient (step ST2, NO), the main control unit 410 controls the sensor panel control unit 440 and the light source unit control unit 450 to start sensing of the object OJ facing the sensing surface 200A in the second mode MODE2 (step ST3).

[0073] Then, the main control unit 410 controls the sensor panel control unit 440 to recognize the levels of the detection signals output from the multiple optical sensors 50 and determine whether a sufficient amount of light is obtained for sensing in the second mode MODE2 (step ST4).

[0074] Based on the determination that the amount of light in the second mode MODE2 is insufficient (step ST4, NO), the main control unit 410 controls the display panel control unit 430, the sensor panel control unit 440, and the light source unit control unit 450 to start sensing of the object OJ facing the sensing surface 200A in the third mode MODE3 (step ST5).

[0075] Based on the determination that the amount of light in the first mode MODE1 is sufficient (step ST2, YES), the main control unit 410 controls the sensor panel control unit 440 to acquire detection signals from the optical sensors 50 positioned throughout the sensing area SA and capture an image of the printing surface PS of the object OJ (step ST6). Based on the acquired detection signals, the main control unit 410 generates image data of the printing surface PS and temporarily stores it in the memory 420.

[0076] Similarly, the main control unit 410 captures an image of the printing surface PS when it determines that the amount of light in the second mode MODE2 is sufficient (step ST4, YES). Similarly, the main control unit 410 captures an image of the printing surface PS when sensing is performed in the third mode MODE3.

[0077] The main control unit 410 then executes necessary data processing on the image data stored in the memory 420 (step ST7). The data processing here is executed by a program pre-stored in the memory 420. Examples of data processing that the main control unit 410 can execute include extracting character strings from the stored image data, recognizing the extracted character strings, translating the recognized character strings into a specified language, converting the recognized character strings or the character strings translated into a specified language into audio data, and generating image data corresponding to an image to be displayed on the display panel 100 (e.g., an image of the print surface PS, the recognized character strings, the translated character strings, etc.). The data processing to be executed by the main control unit 410 can be set by the user via the information setting unit 480. For example, the user can select, via the information setting unit 480, a process of translating character strings on the print surface PS into Japanese.

[0078] Then, based on the image data generated by predetermined data processing, main control unit 410 controls light source unit control unit 450 to drive light source unit 300, and controls display panel control unit 430 to drive pixels PX throughout display area DA. As a result, an image corresponding to the image data is displayed on display panel 100, and this displayed state of the image is maintained for a certain period of time (step ST8). Images that can be displayed on display panel 100 include an image (copy) equivalent to the image of print surface PS, an image of character strings extracted from the image of print surface PS (text extraction), an image of character strings translated from the extracted character strings (language conversion), and the like.

[0079] In addition, if the user requests audio output corresponding to a character string at the same time as displaying an image on the display panel 100, the main control unit 410 controls the audio control unit 460 to drive the speaker 500 based on the audio data converted from the character string.

[0080] Then, based on the lapse of a certain time since the image was displayed, the main control unit 410 requests the user to select whether to save or delete the image data generated in step ST7 (step ST9). If the user requests to save the image data, the main control unit 410 saves the image data in the memory 420. Furthermore, if the user requests to delete the image data, the main control unit 410 deletes the image data.

[0081] Then, based on a request to start sensing again (step ST10, YES), main control unit 410 returns to step ST1 again. Based on determining that there is no request to start sensing again (step ST10, NO), main control unit 410 ends sensing.

[0082] FIG. 12 is a diagram showing an example of an image displayed on the display panel 100 by sensing the print surface PS of the object OJ.

[0083] The left side of the figure shows an example of an object OJ. The printing surface PS has a character string in English. The right side of the figure shows the electronic device 1 facing the object OJ. For example, the electronic device 1 recognizes the English character string on the printing surface PS, translates the character string into Japanese, and generates image data corresponding to the translated character string. The display panel 100 displays the character string translated into Japanese based on the generated image data. In the illustrated example, the displayed Japanese character string is superimposed on the English character string on the printing surface PS. In other words, the user can observe the character string (translated character string) displayed on the display panel 100 while observing the character string on the printing surface PS via the electronic device 1.

[0084] FIG. 13 is a diagram showing an example of an image displayed on the display panel 100 when the electronic device 1 is spaced apart from the object OJ.

[0085] As explained in step ST8 above, the state in which the image is displayed on the display panel 100 is maintained for a certain period of time. Therefore, even when the electronic device 1 is separated from the object OJ, the image on the display panel 100 is the same as the image on the display panel 100 shown in Fig. 12. Therefore, the user can observe the character string displayed on the display panel 100 without it overlapping with the object OJ (or the character string on the printing surface PS).

[0086] FIG. 14 is a diagram showing another example of an image displayed on the display panel 100 by sensing the printing surface PS of the object OJ.

[0087] When the electronic device 1 faces the object OJ, the display panel 100 displays a character string translated into Japanese based on the generated image data. In the illustrated example, the displayed Japanese character string is superimposed on the margin area MA of the printing surface PS, but is not superimposed on the English character string on the printing surface PS.

[0088] For example, when the main control unit 410 detects, by sensing the print surface PS, that a region with high reflectivity or a region with substantially the same reflectivity has a predetermined area, it can recognize the margin area MA of the print surface PS. Then, the main control unit 410 controls the display panel control unit 430 to drive the display panel 100 so as to display an image in an area of ​​the display area of ​​the display panel 100 that overlaps the margin area MA. This achieves the display as shown in the figure. While observing the character strings on the print surface PS via the electronic device 1, the user can observe the character string (translated character string) displayed on the display panel 100 without overlapping with the character string on the print surface PS.

[0089] The electronic device 1 described in this embodiment can be used for other purposes in addition to the above-mentioned sensing function and display function. For example, the sensor panel 200 can be used as a touch panel that detects contact of an object with the sensing surface 200A.

[0090] The sensor panel 200 can also be used as a biosensor. For example, the sensor panel 200 can detect information about the living body, such as the unevenness of the finger surface (e.g., fingerprint), blood vessel images such as veins, and pulse rate, by detecting light reflected by a user's finger positioned on the sensing surface 200A.

[0091] In the above-described embodiment, for example, transparent substrate 10 corresponds to the first transparent substrate, transparent substrate 20 corresponds to the second transparent substrate, transparent substrate 30 corresponds to the third transparent substrate, and transparent substrate 40 corresponds to the fourth transparent substrate.

[0092] As described above, according to this embodiment, it is possible to provide an electronic device having a sensing function and a display function.

[0093] All electronic devices that can be implemented by a person skilled in the art by appropriately modifying the design based on the electronic devices described above as embodiments of the present invention also fall within the scope of the present invention as long as they include the gist of the present invention.

[0094] Within the scope of the concept of the present invention, a person skilled in the art may conceive of various modifications, and these modifications are also understood to fall within the scope of the present invention. For example, even if a person skilled in the art appropriately adds or deletes components or modifies the design of the above-described embodiment, or adds or omits steps or modifies conditions, these modifications are also included within the scope of the present invention as long as they maintain the gist of the present invention.

[0095] Furthermore, with regard to other effects brought about by the aspects described in the above embodiments, those that are clear from the description in this specification or that can be appropriately thought of by a person skilled in the art are naturally understood to be brought about by the present invention. [Explanation of symbols]

[0096] 1...Electronic device 100...Display panel 10...Transparent substrate 20...Transparent substrate DA: Display area PE: Pixel electrode CE: Common electrode LC: Liquid crystal layer 200...sensor panel 30...transparent substrate 40...transparent substrate SA: sensing area 31: light-shielding layer 50: optical sensor 300...Light source unit 400...Control unit 410...Main control section 600...Light guide plate

Claims

1. a display panel having a polymer dispersed liquid crystal in a display area for displaying an image; a light source unit disposed along an edge of the display panel; a sensor panel overlaid on the display panel, the sensor panel includes a plurality of optical sensors arranged in a sensing area overlapping the display area, and a light-shielding layer arranged between each of the plurality of optical sensors and the display panel. electronic equipment.

2. the display panel includes a plurality of pixel electrodes and a common electrode facing the plurality of pixel electrodes; At least one of the plurality of photosensors overlaps the pixel electrode. The electronic device according to claim 1 .

3. the sensor panel has a sensing surface facing an object; the plurality of light sensors are configured to detect light transmitted through the display panel and reflected from the object. The electronic device according to claim 1 .

4. the sensor panel has a sensing surface facing an object; The plurality of optical sensors are configured to detect light emitted from the light source unit and reflected from the object. The electronic device according to claim 1 .

5. the sensor panel has a sensing surface facing an object; the plurality of optical sensors are configured to detect light emitted from the light source unit, scattered by the polymer dispersed liquid crystal, and reflected from the object. The electronic device according to claim 1 .

6. Further, a control unit is provided to control the display panel, the light source unit, and the sensor panel, The control unit is configured to recognize a character string on the object based on detection signals output from the plurality of optical sensors. The electronic device according to claim 3 .

7. The control unit is further configured to translate the recognized string of characters into a specified language.

7. The electronic device according to claim 6.

8. the control unit is further configured to generate image data for displaying the translated character string on the display panel.

8. The electronic device according to claim 7.

9. the display panel comprises a first transparent substrate, a second transparent substrate facing the first transparent substrate, a liquid crystal layer located between the first transparent substrate and the second transparent substrate and including the polymer dispersed liquid crystal, pixel electrodes located between the first transparent substrate and the liquid crystal layer, and a common electrode located between the second transparent substrate and the liquid crystal layer, the sensor panel includes a third transparent substrate facing the second transparent substrate, and a fourth transparent substrate facing the third transparent substrate and having a sensing surface; the light-shielding layer and the plurality of light sensors are disposed on the third transparent substrate. The electronic device according to claim 1 .

10. further comprising a light guide plate having a side surface facing the light source unit and positioned between the second transparent substrate and the third transparent substrate; 10. The electronic device according to claim 9.

Images