Display device

Abstract

To provide a display device that enables an operation target object to be specified in a configuration in which different objects can be displayed simultaneously in an identical display area with viewpoints in two directions.SOLUTION: The display device includes: a display panel having a display area in which a first screen which is visible from a first viewpoint and a second screen which is visible from a second viewpoint different from the first viewpoint can be displayed simultaneously; a detection sensor having a detection area overlapped on the display area; and a control circuit having a first detection function for detecting an object adjacent to the display panel and a second detection function for detecting a touch on an object displayed on an operation target screen, either the first screen or the second screen serving as the operation target screen. The control circuit determines the operation target screen based on a coordinate movement amount on a detection area acquired by the first detection function.SELECTED DRAWING: Figure 8

Description

Technical Field

[0001] The present invention relates to a display device.

Background Art

[0002] For example, there is a display device that uses a parallax barrier type display panel to allow users located in two directions to view different screens (for example, Patent Document 1). On the other hand, in recent years, a configuration having a so-called touch detection function for detecting a touch on an object displayed on a display panel has become common.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a display device that allows users located in two directions to view different screens as described above, for example, a configuration in which different image information is provided to a user located on the right side of the display device and a user located on the left side of the display device can be considered. When a touch detection function is installed in a display device having such a configuration, it is necessary to determine whether the touch is on an object on the screen viewed by a user located on the right side of the display device or an object on the screen viewed by a user located on the left side of the display device.

[0005] An object of the present disclosure is to provide a display device capable of specifying an operation target object in a configuration in which different objects can be simultaneously displayed from two viewpoints in the same display area.

Means for Solving the Problems

[0006] A display device according to an aspect of the present disclosure includes a display panel having a display area capable of simultaneously displaying a first screen viewed from a first viewing point and a second screen viewed from a second viewing point different from the first viewing point, a detection sensor having a detection area overlapping the display area, a first detection function for detecting an object approaching the display panel, and a second detection function for detecting a touch on an object displayed on the operation target screen, where either the first screen or the second screen is set as the operation target screen. The control circuit determines the operation target screen based on the amount of movement of the coordinates on the detection area acquired by the first detection function.

[0007] A display device according to an aspect of the present disclosure includes a display panel having a display area capable of simultaneously displaying a first screen viewed from a first viewing point and a second screen viewed from a second viewing point different from the first viewing point, a detection sensor having a detection area overlapping the display area, a first detection function for detecting an object approaching the display panel, and a second detection function for detecting a touch on an object displayed on the operation target screen, where either the first screen or the second screen is set as the operation target screen. The control circuit determines the operation target screen based on the difference value between the first coordinates on the detection area acquired by the first detection function and the second coordinates on the detection area acquired by the second detection function.

[0008] A display device according to an aspect of the present disclosure includes a display panel having a display area capable of simultaneously displaying a first screen viewed from a first viewing point and a second screen viewed from a second viewing point different from the first viewing point, a detection sensor having a detection area overlapping the display area, a first detection function for detecting an object approaching the display panel, and a second detection function for detecting a touch on an object displayed on the operation target screen, where either the first screen or the second screen is set as the operation target screen. In the first detection function, the control circuit divides the detection area into a plurality of areas, generates a heat map weighted by the detection values for each of the plurality of areas based on the detection values acquired for each area, and determines the operation target screen based on the heat map.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3A

Figure 3B

Figure 4

Figure 5

Figure 6

Figure 7A

Figure 7B

Figure 8

Figure 9A

Figure 9B

Figure 10

Figure 11A

Figure 11B

Figure 12

Figure 13A

Figure 13B

Figure 14

Mode for Carrying Out the Invention

[0010] The mode (embodiment) for carrying out the present invention will be described in detail with reference to the drawings. Note that the present invention is not limited by the content described in the following embodiments. In addition, the constituent elements described below include those that can be easily assumed by those skilled in the art and substantially identical ones. Furthermore, the constituent elements described below can be combined as appropriate. Also, the disclosure is merely an example, and for those that can be easily conceived by those skilled in the art with appropriate modifications while maintaining the gist of the invention, they are naturally included in the scope of the present invention. Also, for the purpose of making the explanation clearer, the drawings may schematically represent the width, thickness, shape, etc. of each part compared to the actual aspect, but this is merely an example and does not limit the interpretation of the present invention. Also, in this specification and the claims, when expressing the aspect of arranging another structure on a certain structure, when simply expressed as "on", unless otherwise specified, it includes both the case of arranging another structure directly on a certain structure in contact with it and the case of arranging another structure above a certain structure through yet another structure.

[0011] In this specification and the claims, when expressing the aspect of arranging another structure on a certain structure, when simply expressed as "on", unless otherwise specified, it includes both the case of arranging another structure directly on a certain structure in contact with it and the case of arranging another structure above a certain structure through yet another structure.

[0012] FIG. 1 is a diagram showing an overview of the display device 1 according to the embodiment. In the present disclosure, the display device 1 is configured to be able to simultaneously display different screen information on the same display area AA of the display panel 2, namely, a first screen A viewed from the viewpoint a of the user located on the right side in the figure and a second screen B viewed from the viewpoint b of the user located on the left side in the figure. In the display panel 2 of the present disclosure, as a method of displaying different screens at different viewpoints, for example, a parallax barrier method is exemplified, but it is not limited thereto. Note that the image information displayed on the first screen A and the screen information displayed on the second screen B are not necessarily different and may be the same image information.

[0013] Further, as the display panel 2, for example, a liquid crystal display panel having a backlight is exemplified, but it is not limited thereto. For example, a self-emitting display panel such as an organic EL display panel (OLED: Organic Light Emitting Diode) or an inorganic EL display panel (micro LED, mini LED) may be used.

[0014] In addition, in the present disclosure, the display device 1 has a so-called hover detection (proximity detection) function for detecting an object (for example, a user's finger) close to the display panel 2 and a so-called touch detection function for detecting a touch on an object displayed in the display area AA of the display panel 2.

[0015] FIG. 2 is a cross-sectional view showing an example of the schematic configuration of the display area AA. In the example shown in FIG. 2, the display device 1 exemplifies a so-called on-cell type device in which a detection sensor 3 for realizing the hover detection function and the touch detection function is mounted on the display panel 2. The detection sensor 3 has a detection area DA overlapping the display area AA of the display panel 2.

[0016] Note that the display panel 2 may be a so-called in-cell type or hybrid type device that incorporates the detection sensor 3 and integrates them. Incorporating and integrating the detection sensor 3 into the display panel 2 includes, for example, using some members such as the substrate and electrodes used as the display panel 2 and some members such as the substrate and electrodes used as the detection sensor 3 in common.

[0017] FIG. 3A is a schematic diagram showing an example of the display mode of the first screen A. FIG. 3B is a schematic diagram showing an example of the display mode of the second screen B. Here, the first screen A shown in FIG. 3A and the second screen B shown in FIG. 3B are simultaneously displayed on the display area AA, and an example of a mode in which different screen information is displayed on the first screen A and the second screen B is illustrated. The first screen A shown in FIG. 3A is a screen visible from the viewing point a shown in FIG. 1 and is not visible from the viewing point b shown in FIG. 1. Further, the second screen B shown in FIG. 3B is a screen visible from the viewing point b shown in FIG. 1 and is not visible from the viewing point a shown in FIG. 1.

[0018] BA1, BA2, BA3 shown in FIG. 3A are image images displayed on the first screen A, and are objects that can be selected to realize the functions assigned to the image images by touching the positions on the detection area DA overlapping the image images.

[0019] BB shown in FIG. 3B is an image image displayed on the second screen B, and is an object that can be selected to realize the functions assigned to the image images by touching the positions on the detection area DA overlapping the image images.

[0020] In FIG. 3A, an example in which three buttons BA1, BA2, BA3 are displayed on the first screen A is shown. The display device 1 performs an operation assigned to the touched button when the user touches any of these buttons BA1, BA2, BA3.

[0021] FIG. 3B shows an example in which one button BB is displayed on the second screen B. The display device 1 performs an operation assigned to the button BB when the user touches the button BB.

[0022] In the present disclosure, the mode of the operation target object for realizing the functional operation assumed by the user is not limited to the button-shaped image. In the present disclosure, for example, it includes a mode in which by touching an arbitrary position on the screen, a function corresponding to the touch is realized. That is, in the present disclosure, the operation target object is not limited to the image explicitly displayed on the screen. Specifically, for example, in a display device such as a navigation system, it may include a mode in which an arbitrary point on the map displayed on the screen is used as the operation target object.

[0023] The detection sensor 3 detects a touch at a position on the detection area DA corresponding to each button displayed on the display area AA of the display panel 2 regardless of whether the user is viewing the first screen A or the second screen B. Therefore, the display device 1 according to the embodiment needs to determine on which of the first screen A and the second screen B the user performed the touch operation while viewing. In other words, the display device 1 needs to determine whether the touch operation by the user is a touch on an object on the first screen A viewed by a user located on the right side of the display device 1, or a touch on an object on the second screen B viewed by a user located on the left side of the display device 1.

[0024] Specifically, for example, in the display modes shown in FIGS. 3A and 3B, there is a button BB on the second screen B at a position overlapping the button BA2 on the first screen A. In this case, when the user touches a position on the detection area DA overlapping the button BA2 on the first screen A assuming the functional operation corresponding to the button BA2, there is a possibility of misjudgment as a touch on the button BB on the second screen B and malfunctioning.

[0025] Further, for example, in the display modes shown in FIGS. 3A and 3B, there is no selectable object at the position on the second screen B that overlaps with the button BA1 on the first screen A. In this case, when the user touches a position on the detection area DA that overlaps with the button BA1 on the first screen A assuming a functional operation corresponding to the button BA1, if it is erroneously determined that it is a touch on the second screen B, the operation by the touch operation may not be performed.

[0026] FIG. 4 is a plan view showing an example of division of the detection area DA in the hover detection function. FIG. 5 is a plan view showing an example of division of the detection area DA in the touch detection function. In the present disclosure, as the detection sensor 3, a so-called capacitance type sensor is exemplified.

[0027] A plurality of detection electrodes 31 are provided in the detection area DA of the detection sensor 3. The plurality of detection electrodes 31 are arranged in the X direction (first direction) and the Y direction (second direction) intersecting the X direction within the detection area DA of the detection sensor 3, and are provided in a matrix. In other words, the detection sensor 3 has a detection area DA that overlaps the plurality of detection electrodes 31 arranged in the X direction and the Y direction. In the present disclosure, the X direction (first direction) is a direction extending in the left-right direction relative to the display area AA (detection area DA) of the display device 1, and the Y direction (second direction) is a direction orthogonal to the X direction (first direction). Further, in the present disclosure, the X direction (first direction) has a positive value in the direction from left to right relative to the display area AA (detection area DA) of the display device 1, and the Y direction (second direction) has a positive value in the direction from bottom to top relative to the display area AA (detection area DA) of the display device 1.

[0028] In the hover detection function of the present disclosure, the detection area DA is divided into a plurality of first areas PDA1 arranged in a matrix. In the example shown in FIG. 4, an example is shown in which an area where five detection electrodes 31 are arranged in each of the X direction and the Y direction is taken as one first area PDA1. In other words, in the example shown in FIG. 4, one first area PDA1 is constituted by 25 detection electrodes 31 arranged in five in each of the X direction and the Y direction.

[0029] In addition, in the touch detection function of the present disclosure, the detection area DA is divided into a plurality of second areas PDA2 arranged in a matrix. In the example shown in FIG. 5, an example is shown in which the area corresponding to each detection electrode 31 is defined as one second area PDA2. In other words, in the example shown in FIG. 5, one second area PDA2 is constituted by one detection electrode 31.

[0030] In terms of the capacitance of one detection electrode 31, the level of the signal acquired in hover detection becomes small, so sufficient detection accuracy cannot be ensured. Therefore, as shown in FIGS. 4 and 5, the first area PDA1 in the hover detection function is made larger than the second area PDA2 in the touch detection function. Thereby, the capacitance in the first area PDA1 can be set to a capacitance value capable of acquiring the signal level required in hover detection.

[0031] Note that the mode of the detection area DA in the present disclosure is not limited to the modes shown in FIGS. 4 and 5. For example, in the configuration of the display device 1, the detection sensor 3 may have a configuration in which each has one detection electrode corresponding to the first area PDA1. Alternatively, for example, in the configuration of the display device 1, a configuration may be adopted in which a first detection sensor having a hover detection function and a second detection sensor having a touch detection function are provided. In this case, the first detection sensor may have a configuration in which each has one detection electrode corresponding to the first area PDA1, and the second detection sensor may have a configuration in which each has one detection electrode corresponding to the second area PDA2.

[0032] FIG. 6 is a block diagram showing an example of the schematic configuration of the control circuit 100 according to the embodiment. In the configuration example shown in FIG. 6, the control circuit 100 of the display device 1 according to the embodiment includes a first detection circuit 101, a second detection circuit 102, and a processing circuit 103.

[0033] The first detection circuit 101 is a circuit that performs hover detection based on a signal output from the first region PDA1 of the detection sensor 3. The second detection circuit 102 is a circuit that performs touch detection based on a signal output from the second region PDA2 of the detection sensor 3. In the present disclosure, the first detection circuit 101 and the second detection circuit 102 include, for example, an analog front end circuit (AFE: Analog Front End) and an AD conversion circuit.

[0034] The first detection circuit 101 outputs first sensing data indicating a detection value in the hover detection operation to the processing circuit 103. The second detection circuit 102 outputs second sensing data indicating a detection value in the touch detection operation to the processing circuit 103.

[0035] The processing circuit 103 is a circuit that outputs the touch detection position (coordinates) to the subsequent HOST200. The processing circuit 103 is composed of, for example, an MCU (Micro Control Unit), RAM, EEPROM, ROM, etc. The HOST200 is exemplified by, for example, a navigation system in which the display device 1 is mounted.

[0036] Also, in the present disclosure, in each process according to each embodiment described later, the processing circuit 103 determines whether the touch detection position on the detection area DA corresponds to an object on the first screen (the first screen A viewed from the viewing point a shown in FIG. 1) or an object on the second screen (the second screen B viewed from the viewing point b shown in FIG. 1) based on the first sensing data from the first detection circuit 101 and the second sensing data from the second detection circuit 102, and has a function of outputting the determination result to the HOST200.

[0037] In the configuration of the display device 1, for example, when the detection sensors 3 each have one detection electrode corresponding to the first region PDA1, the second detection circuit 102 is unnecessary. In this case, the first detection circuit 101 outputs first sensing data indicating the detection value in the hover detection operation or the touch detection operation to the processing circuit 103, and the processing circuit 103 determines whether the touch detection position on the detection region DA corresponds to a position of an object on the first screen (the first screen A viewed from the viewing point a shown in FIG. 1) or a position of an object on the second screen (the second screen B viewed from the viewing point b shown in FIG. 1) based on the first sensing data from the first detection circuit 101, and may have a function of outputting the determination result to the HOST200.

[0038] Hereinafter, in the configuration of the control circuit 100 of the display device 1 according to an embodiment capable of displaying different objects from two viewpoints in the same display area, each embodiment capable of specifying an operation target object will be described.

[0039] (Embodiment 1) FIGS. 7A and 7B are schematic diagrams for explaining the concept of the process according to Embodiment 1.

[0040] FIG. 7A shows an example in which a user views the first screen A from the viewing point a on the right side relative to the display area AA (detection area DA) of the display device 1 and tries to operate an object on the first screen A.

[0041] FIG. 7B shows an example in which a user views the second screen B from the viewing point b on the left side relative to the display area AA (detection area DA) of the display device 1 and tries to operate an object on the second screen B.

[0042] In the case where the user is present on the right side relative to the display area AA (detection area DA) of the display device 1, it is assumed that the user's finger moves from right to left when operating an object on the screen.

[0043] On the other hand, in the case where the user is present on the left side relative to the display area AA (detection area DA) of the display device 1, it is assumed that the user's finger moves from left to right when operating an object on the screen.

[0044] Specifically, as shown in FIG. 7A, when the hover detection position in the X direction moves from x1 on the right to x2 on the left on the detection area DA, it is assumed that the user is present on the right side facing the display device 1 and is trying to operate an object on the first screen A viewed from the viewpoint a. Also, as shown in FIG. 7B, when the hover detection position in the X direction moves from x1 on the left to x2 on the right on the detection area DA, it is assumed that the user is present on the left side facing the display device 1 and is trying to operate an object on the second screen B viewed from the viewpoint b.

[0045] Based on the concept of the processing according to the first embodiment described above, in the first embodiment, the moving direction of the user's finger moving on the detection area DA is hover-detected, the moving direction of the user's finger is obtained based on the moving amount in the X direction at the time of the hover detection, and the operation target screen is determined based on the moving direction.

[0046] More specifically, in the first embodiment, in the hover detection operation, the moving amount Δxm (=x1 - x2) in the X direction between the first hover detection position at the first time and the second hover detection position at the second time after the first time is obtained. When the moving amount Δxm is 0 or more (Δxm ≧ 0), the object on the first screen A is determined as the operation target object, and when the moving amount Δxm is less than 0 (Δxm < 0), the object on the second screen B is determined as the operation target object.

[0047] Hereinafter, specific processing in the control circuit 100 of the display device 1 according to the first embodiment will be described with reference to FIG. 8. FIG. 8 is a flowchart showing an example of the processing according to the first embodiment.

[0048] In the process shown in FIG. 8, for example, when the display device 1 according to the embodiment is activated (step S101) with the activation of HOST200 (for example, a navigation system or the like on which the display device 1 is mounted), the control circuit 100 executes a baseline scan for acquiring first sensing data and second sensing data in a state where no detected object is close to the display panel 2 (step S102).

[0049] After the execution of the baseline scan (step S102), the control circuit 100 executes a normal hover detection operation and a touch detection operation.

[0050] Specifically, the control circuit 100 executes a hover detection process based on the difference between the first sensing data acquired by the baseline scan (step S102) and the first sensing data acquired by the normal hover detection operation. Further, the control circuit 100 executes a touch detection process based on the difference between the second sensing data acquired by the baseline scan (step S102) and the second sensing data acquired by the normal touch detection operation.

[0051] In the present disclosure, the normal hover detection operation refers to the hover detection operation executed after the baseline scan (step S102). Further, in the present disclosure, the normal touch detection operation refers to the touch detection operation executed after the baseline scan (step S102).

[0052] Also, in the following description, when an object (for example, a user's finger) close to the display panel 2 is detected in the hover detection operation, it may sometimes be simply referred to as "hover detected". Also, when a touch on the display panel 2 is detected, it may sometimes be simply referred to as "touch detected".

[0053] The processing circuit 103 of the control circuit 100 determines whether or not a hover has been detected in the hover detection operation (step S103). If no hover has been detected (step S103; No), the process of step S103 is repeatedly executed.

[0054] When hovering is detected (step S103; Yes), the processing circuit 103 acquires the detected hovering position as the first hovering detection coordinates (step S104), resets the timer value T for measuring the time Tth until the second time to the time of this hovering detection as the first time and the next hovering detection time as the second time (T = 0, step S105).

[0055] The processing circuit 103 determines whether the timer value T is equal to or greater than Tth (T≥Tth, step S106). If the timer value T is less than Tth (T < Tth, step S106; No), the process of step S106 is repeatedly executed until the timer value T becomes equal to or greater than Tth (T≥Tth, step S106; Yes).

[0056] When the timer value T becomes equal to or greater than Tth (T≥Tth, step S106; Yes), the processing circuit 103 determines again whether hovering has been detected (step S107). If hovering has not been detected (step S107; No), the first hovering detection coordinates at the first time are discarded (step S108), and the processes after step S103 are repeatedly executed.

[0057] If hovering is not detected in step S107 (step S107; No), it is assumed that the hovering detected in the previous step S103 was not caused by an intentional operation by the user. Therefore, if hovering is not detected in the process of step S107 (step S107; No), the first hovering detection coordinates at the first time are discarded (step S108), and the process returns to step S103.

[0058] When hover is detected in step S107 (step S107; Yes), the processing circuit 103 obtains the detected hover position as the second hover detection coordinates at the second time (step S109). Then, the processing circuit 103 calculates a difference value Δxm between the X-direction data x1 of the first hover detection coordinates at the first time and the X-direction data x2 of the second hover detection coordinates at the second time (Δxm = x1 - x2, step S110). This difference value Δxm indicates the movement amount in the X direction between the first hover detection position at the first time and the second hover detection position at the second time. More specifically, it is the value obtained by subtracting the X-direction data x2 of the second hover detection coordinates at the second time from the X-direction data x1 of the first hover detection coordinates at the first time.

[0059] Based on the difference value Δxm calculated in the process of step S110, the processing circuit 103 executes the determination process of the touch operation target screen after the above-mentioned hover detection, and outputs the touch detection position on the touch operation target screen to the HOST200 based on the result of the determination process.

[0060] Specifically, the processing circuit 103 determines whether the difference value Δxm calculated in the process of step S110 is 0 or more (Δxm ≧ 0, step S111).

[0061] When the difference value Δxm is 0 or more (Δxm ≧ 0, step S111; Yes), the processing circuit 103 determines that the touch on the display panel 2 after the above-mentioned hover detection is an operation on the object on the first screen A (step S112). Then, it determines whether a touch has been detected (step S114). If no touch has been detected (step S114; No), it discards the first hover detection coordinates at the first time and the second hover detection coordinates at the second time (step S115), and repeatedly executes the processes after step S103. If a touch has been detected (step S114; Yes), it outputs the detected touch position as the touch detection coordinates on the first screen A to the HOST200 (step S116).

[0062] When the difference value Δxm is less than 0 (Δxm < 0, step S111; No), the processing circuit 103 determines that the touch on the display panel 2 after the hover detection described above is an operation on the object on the second screen B (step S113), and determines whether a touch has been detected (step S114). When no touch has been detected (step S114; No), the first hover detection coordinates at the first time and the second hover detection coordinates at the second time are discarded (step S115), and the processing after step S103 is repeatedly executed. When a touch has been detected (step S114; Yes), the detected touch position is output to the HOST200 as the touch detection coordinates on the second screen B (step S116).

[0063] Then, after the processing circuit 103 outputs the touch detection coordinates on the screen determined as the touch operation target screen in the above-described touch operation target screen determination process to the HOST200 (step S116), the processing after step S103 is repeatedly executed.

[0064] (Embodiment 2) FIGS. 9A and 9B are schematic diagrams for explaining the concept of the processing according to Embodiment 2.

[0065] FIG. 9A shows an example in which a user views the first screen A from the right viewpoint a facing the display area AA (detection area DA) of the display device 1 and attempts to operate an object on the first screen A.

[0066] FIG. 9B shows an example in which a user views the second screen B from the left viewpoint b facing the display area AA (detection area DA) of the display device 1 and attempts to operate an object on the second screen B.

[0067] In the case where the user is present on the right side relative to the display area AA (detection area DA) of the display device 1, when operating an object on the screen, the positional relationship between the hover detection coordinates obtained by the hover detection operation and the touch detection coordinates obtained by the touch detection operation is such that, as shown in FIG. 9A, the X-direction position x2 of the touch detection coordinates is assumed to be located to the left with respect to the X-direction position x1 of the hover detection coordinates.

[0068] On the other hand, in the case where the user is present on the left side relative to the display area AA (detection area DA) of the display device 1, when operating an object on the screen, the positional relationship between the hover detection coordinates obtained by the hover detection operation and the touch detection coordinates obtained by the touch detection operation is such that, as shown in FIG. 9B, the X-direction position x2 of the touch detection coordinates is assumed to be located to the right with respect to the X-direction position x1 of the hover detection coordinates.

[0069] Based on the concept of the processing according to Embodiment 2 described above, in Embodiment 2, the operation target screen is determined based on the difference value between the hover detection position in the X direction obtained by the hover detection operation and the touch detection position in the X direction obtained by the touch detection operation.

[0070] More specifically, in Embodiment 2, the difference value Δxp (=x1 - x2) in the X direction between the hover detection position in the hover detection operation and the touch detection position in the touch detection operation is obtained. When the difference value Δxp is 0 or more (Δxp≧0), the object on the first screen A is determined as the operation target object, and when the difference value Δxp is less than 0 (Δxp < 0), the object on the second screen B is determined as the operation target object.

[0071] Hereinafter, the specific processing in the control circuit 100 of the display device 1 according to Embodiment 2 will be described with reference to FIG. 10. FIG. 10 is a flowchart showing an example of the processing according to Embodiment 2. In the processing shown in FIG. 10, the processing in steps S201 and S202 is the same as the processing in steps S101 and S102 of the processing in Embodiment 1 (see FIG. 8), and thus the detailed description here is omitted.

[0072] The processing circuit 103 of the control circuit 100 determines whether hovering has been detected in the hovering detection operation (step S203). If hovering has not been detected (step S203; No), the process of step S203 is repeatedly executed.

[0073] If hovering has been detected (step S203; Yes), the processing circuit 103 acquires the detected hovering position as hovering detection coordinates (step S204).

[0074] Subsequently, the processing circuit 103 determines whether touch has been detected in the touch detection operation (step S205). If touch has not been detected (step S205; No), the hovering detection coordinates are discarded (step S206), and the processes after step S203 are repeatedly executed.

[0075] When touch is not detected in step S205 (step S205; No), it is assumed that the position of the user's finger attempting a touch operation has been detected as hovering when hovering was detected in the process of step S203. If the process of step S205 is repeatedly executed until touch is detected while holding the hovering detection coordinates at this time, there is a possibility that the position of the hovering detection coordinates and the position of the touch detection coordinates will be substantially the same. Therefore, when touch is not detected in the process of step S205 (step S205; No), the hovering detection coordinates are discarded (step S206), and the process returns to step S203.

[0076] If touch has been detected (step S205; Yes), the processing circuit 103 acquires the detected touch position as touch detection coordinates (step S207). Then, the processing circuit 103 calculates a difference value Δxp between the X-direction data x1 of the hovering detection coordinates and the X-direction data x2 of the touch detection coordinates (Δxp = x1 - x2, step S208). More specifically, this difference value Δxp is the value obtained by subtracting the X-direction data x2 of the touch detection coordinates from the X-direction data x1 of the hovering detection coordinates.

[0077] Based on the difference value Δxp calculated in the process of step S110, the processing circuit 103 executes a determination process of the touch operation target screen at the time of obtaining the touch detection coordinates, and based on the result of the determination process, outputs the touch detection position on the touch operation target screen to HOST200.

[0078] Specifically, the processing circuit 103 determines whether the difference value Δxp calculated in the process of step S208 is 0 or more (Δxp≧0, step S209).

[0079] When the difference value Δxp is 0 or more (Δxp≧0, step S209; Yes), the processing circuit 103 determines that the operation at the time of obtaining the touch detection coordinates is an operation on an object on the first screen A (step S210), and outputs the obtained touch detection coordinates to HOST200 as the position on the first screen A (step S212).

[0080] When the difference value Δxp is less than 0 (Δxp<0, step S209; No), the processing circuit 103 determines that the operation at the time of obtaining the touch detection coordinates is an operation on an object on the second screen B (step S211), and outputs the obtained touch detection coordinates to HOST200 as the position on the second screen B (step S212).

[0081] And after the processing circuit 103 outputs the touch detection coordinates on the screen determined as the touch operation target screen in the above-described determination process of the touch operation target screen to HOST200 (step S212), it repeatedly executes the processes after step S203.

[0082] Note that in the process according to the above-described Embodiment 2, an aspect in which the touch detection operation is executed after the hover detection operation is exemplified, but it is not limited thereto. For example, an aspect in which the hover detection operation is executed after the touch detection operation may be used, or an aspect in which the hover detection operation and the touch detection operation are executed simultaneously may be used.

[0083] (Embodiment 3) FIG. 11A and FIG. 11B are schematic diagrams for explaining the concept of the process according to Embodiment 3.

[0084] FIG. 11A shows the first sensing data for each first region PDA1 acquired by the first detection circuit 101 when a user views the first screen A from the right viewing point a relative to the display area AA (detection area DA) of the display device 1 and attempts to operate an object on the first screen A. Here, a heat map weighted by the first sensing data for each first region PDA1 acquired by the first detection circuit 101 is illustrated. In the present disclosure, a heat map is defined as a visualization of the magnitude relationship of the first sensing data in the light and dark shades of the first region PDA1 corresponding to the first regions PDA1 arranged in a matrix shown in FIG. 4. In FIG. 11A, the larger the first region PDA1 with larger first sensing data, the darker it is, and the smaller the first region PDA1 with smaller first sensing data, the lighter it is.

[0085] FIG. 11B shows the first sensing data for each first region PDA1 acquired by the first detection circuit 101 when a user views the second screen B from the left viewing point b relative to the display area AA (detection area DA) of the display device 1 and attempts to operate an object on the second screen B. Here, a heat map weighted by the first sensing data for each first region PDA1 acquired by the first detection circuit 101 is illustrated. In FIG. 11B, similar to FIG. 11A, the larger the first region PDA1 with larger first sensing data, the darker it is, and the smaller the first region PDA1 with smaller first sensing data, the lighter it is.

[0086] When a user operates an object on the display screen of the display device 1, it is assumed that the shapes appearing on the heat map are different when operating with the right hand and when operating with the left hand, when weighted by the first sensing data for each first region PDA1.

[0087] Specifically, in the case where the user is present on the right side relative to the display area AA (detection area DA) of the display device 1, it is assumed that the object on the display screen of the display device 1 is operated (touched) with the left hand. On the other hand, in the case where the user is present on the left side relative to the display area AA (detection area DA) of the display device 1, it is assumed that the object on the display screen of the display device 1 is operated (touched) with the right hand. The shape that appears on the heat map when weighted by the first sensing data for each of the first regions PDA1 has a high correlation from the perspective of whether the finger trying to operate is the left hand or the right hand.

[0088] Furthermore, the inclination Ti of the center-of-gravity position of the heat map weighted by the first sensing data for each of the first regions PDA1 obtained by the hover detection operation is different between the case where the finger trying to operate is the left hand and the case where it is the right hand.

[0089] Specifically, as shown in FIG. 11A, in the case where the user is present on the right side relative to the display area AA (detection area DA) of the display device 1 and it is assumed that the object on the display screen of the display device 1 is operated (touched) with the left hand, when the Y direction is set to 0 degrees, the inclination to the right direction with respect to the Y direction is defined as a positive inclination, and the inclination to the left direction is defined as a negative inclination, the inclination Ti of the center-of-gravity position of the heat map weighted by the first sensing data for each of the first regions PDA1 becomes a positive value.

[0090] On the other hand, as shown in FIG. 11B, in the case where the user is present on the left side relative to the display area AA (detection area DA) of the display device 1 and it is assumed that the object on the display screen of the display device 1 is operated (touched) with the right hand, the inclination Ti of the center-of-gravity position of the heat map weighted by the first sensing data for each of the first regions PDA1 becomes a negative value.

[0091] Based on the concept of the processing according to the third embodiment described above, in the third embodiment, the operation target screen is determined based on the inclination Ti of the center-of-gravity position of the heat map weighted by the first sensing data for each of the first regions PDA1 obtained by the hover detection operation.

[0092] More specifically, in Embodiment 3, based on the first sensing data for each first region PDA1 obtained by the hover detection operation, a heat map in the form shown in FIG. 11A or FIG. 11B is generated, the inclination Ti of the centroid position of the heat map is calculated, and when the inclination Ti of the centroid position of the heat map is 0 degrees or more (Ti ≧ 0 degrees), the object on the first screen A is determined as the operation target object, and when the inclination Ti of the centroid position of the heat map is less than 0 degrees (Ti < 0 degrees), the object on the second screen B is determined as the operation target object.

[0093] Hereinafter, specific processing in the control circuit 100 of the display device 1 according to Embodiment 3 will be described with reference to FIG. 12. FIG. 12 is a flowchart showing an example of the processing according to Embodiment 3. In the processing shown in FIG. 12, the processing in steps S301 and S302 is the same as the processing in steps S101 and S102 of the processing in Embodiment 1 (see FIG. 8), and thus the detailed description here is omitted.

[0094] Based on the first sensing data obtained by baseline scanning (step S302), the processing circuit 103 of the control circuit 100 sets a threshold Hth in the hover detection operation (step S303).

[0095] In a normal hover detection operation, for example, it is assumed that the position of the finger of the user attempting a touch operation is detected. In this case, in many first regions PDA1, the first sensing data obtained in the normal hover detection operation becomes small, and the determination accuracy may decrease. Therefore, the threshold Hth in the hover detection operation is set (step S303), and in the processing from step S304 to step S309 described later, when there is first sensing data equal to or greater than the threshold Hth among the first sensing data obtained in each first region PDA1 on the detection region DA, a heat map corresponding to the shape of the user's finger is generated.

[0096] Specifically, in the process shown in FIG. 12, the processing circuit 103 of the control circuit 100 first acquires the first sensing data Hn for each first region PDA1(n) (n is an integer from 1 to N, and N is the total number of the first regions PDA1 in the detection region DA) in the same manner as the normal hover detection operation (step S304).

[0097] Subsequently, the processing circuit 103 resets the number n (n is an integer from 0 to N) of the first sensing data Hn (n = 0, step S305), and determines whether the number n is less than N - 1 (n < N - 1, step S306).

[0098] If the number n is less than N - 1 (n < N - 1, step S306; Yes), the number n is incremented (n = n + 1, step S307), and it is determined whether the first sensing data Hn is greater than or equal to the threshold value Hth (Hn ≧ Hth; step S308). If the first sensing data Hn is less than the threshold value Hth (Hn < Hth; step S308; No), the processes after step S306 are repeatedly executed.

[0099] When the number n becomes N - 1 in step S306 (n = N - 1, step S306; No), the first sensing data Hn acquired in the process of step S304 is discarded (step S309), and the processes after step S304 are executed again.

[0100] When the first sensing data Hn becomes greater than or equal to the threshold value Hth (Hn ≧ Hth; step S308; Yes), a heat map in the form shown in FIGS. 11A and 11B is generated using the first sensing data Hn acquired in the process of step S304 (step S310), and the inclination Ti of the center of gravity position of the heat map weighted by the first sensing data is calculated (step S311).

[0101] The processing circuit 103 executes the determination process of the touch operation target screen after obtaining the above-described first sensing data Hn based on the inclination Ti of the center of gravity position of the heat map calculated in the process of step S310, and outputs the touch detection position on the touch operation target screen to the HOST200 based on the result of the determination process.

[0102] Specifically, the processing circuit 103 determines whether or not the inclination Ti of the center of gravity position of the heat map calculated in the process of step S310 is 0 degree or more (Ti≥0 degree, step S312).

[0103] Here, as described above, the Y direction is defined as 0 degree, the inclination to the right with respect to the Y direction is defined as a positive inclination, and the inclination to the left is defined as a negative inclination. That is, when the inclination Ti of the center of gravity position of the heat map is 0 degree or more (Ti≥0 degree, step S312; Yes), the processing circuit 103 determines that the touch on the display panel 2 after obtaining the above-described first sensing data Hn is an operation on an object on the first screen A (step S313). Then, it is determined whether or not a touch has been detected (step S315). If no touch has been detected (step S315; No), the heat map is discarded (step S316), and the processes after step S304 are repeatedly executed. If a touch has been detected (step S315; Yes), the detected position is output to the HOST200 as the touch detection coordinates on the first screen A (step S317).

[0104] When the inclination Ti of the center-of-gravity position of the heat map is less than 0 degrees (Ti < 0 degrees, step S312; No), the processing circuit 103 determines that the touch on the display panel 2 after the acquisition of the first sensing data Hn described above is an operation on an object on the second screen B (step S314). Then, it is determined whether a touch has been detected (step S315). If no touch has been detected (step S315; No), the heat map is discarded (step S316), and the processing from step S304 onward is repeatedly executed. If a touch has been detected (step S315; Yes), the detected touch position is output to the HOST200 as the touch detection coordinates on the second screen B (step S317).

[0105] Then, after the processing circuit 103 outputs the touch detection coordinates on the screen determined as the touch operation target screen in the above-described touch operation target screen determination process to the HOST200 (step S317), the processing from step S304 onward is repeatedly executed.

[0106] (Embodiment 4) FIGS. 13A and 13B are schematic diagrams for explaining the concept of the processing according to Embodiment 4.

[0107] FIG. 13A shows the first screen A being viewed by the user from the right viewing point a relative to the display area AA (detection area DA) of the display device 1, an object on the first screen A being touched, the touch detection coordinates P obtained in the touch detection operation, and the first sensing data for each first area PDA1 obtained by the first detection circuit 101 at the time of touch detection. Here, an example of a heat map weighted by the first sensing data for each first area PDA1 obtained by the first detection circuit 101 is shown. In FIG. 13A, the larger the first area PDA1 with larger first sensing data, the darker it is, and the smaller the first area PDA1 with smaller first sensing data, the lighter it is.

[0108] FIG. 13B shows that the user visually recognizes the second screen B from the left viewing point b facing the display area AA (detection area DA) of the display device 1, touches an object on the second screen B, and the touch detection coordinates P obtained in the touch detection operation, and the first sensing data for each first area PDA1 obtained by the first detection circuit 101 at the time of touch detection. Here, an example of a heat map weighted by the first sensing data for each first area PDA1 obtained by the first detection circuit 101 is illustrated. In FIG. 13B, similar to FIG. 13A, the larger the first area PDA1 with larger first sensing data, the darker it is, and the smaller the first area PDA1 with smaller first sensing data, the lighter it is.

[0109] In Embodiment 4, in advance, the first heat map in the aspect shown in FIG. 13A and the second heat map in the aspect shown in FIG. 13B are held in, for example, the EEPROM, ROM, etc. of the processing circuit 103. Then, a collation process is executed between the heat map obtained in the process according to Embodiment 4 described later and the first heat map and the second heat map held in advance, and the operation target screen is determined.

[0110] More specifically, in Embodiment 4, a heat map is generated based on the first sensing data for each first area PDA1 obtained by the hover detection operation after the touch detection coordinates are obtained, and a collation process is executed between the heat map and the first heat map. When they match, the object on the first screen A is determined as the operation target object. A collation process is executed between the heat map generated based on the first sensing data for each first area PDA1 obtained by the hover detection operation after the touch detection coordinates are obtained and the second heat map. When they match, the object on the second screen B is determined as the operation target object.

[0111] Note that, as the first heatmap, for example, a heatmap obtained in advance with the first screen A as the operation target screen can be used. Also, as the second heatmap, for example, a heatmap obtained in advance with the second screen B as the operation target screen can be used. Further, in the present disclosure, as the determination method in the collation process between the heatmap acquired during the detection period and the first heatmap or the second heatmap held in advance, a known determination method can be adopted. The present disclosure is not limited by the heatmap collation determination method in the present disclosure.

[0112] Hereinafter, specific processing in the control circuit 100 of the display device 1 according to Embodiment 4 will be described with reference to FIG. 14. FIG. 14 is a flowchart showing an example of the processing according to Embodiment 4. Note that, in the present disclosure, the processing shown in FIG. 14 is processing executed during a detection period different from the period for acquiring the first heatmap and the second heatmap. In the processing shown in FIG. 14, the processing in steps S401 and S402 is the same as the processing in steps S101 and S102 of the processing according to Embodiment 1 (see FIG. 8), and thus detailed description thereof will be omitted here.

[0113] The processing circuit 103 of the control circuit 100 determines whether or not touch detection has been performed in the touch detection operation (step S403). If touch detection has not been performed (step S403; No), the processing in step S403 is repeatedly executed.

[0114] If touch detection has been performed (step S403; Yes), the processing circuit 103 acquires the touched position as touch detection coordinates P (step S404).

[0115] Subsequently, the processing circuit 103 executes heatmap generation processing. Specifically, the processing circuit 103 acquires the first sensing data for each first region PDA1 (step S405), and generates a heatmap using the first sensing data Hn (step S406).

[0116] In Embodiment 3, as described above, the threshold value Hth in the hover detection operation is set, and when there is first sensing data greater than or equal to the threshold value Hth among the first sensing data acquired in each first region PDA1 on the detection region DA, a heat map corresponding to the shape of the user's finger is generated. In Embodiment 4, the aspect of acquiring the first sensing data after touch detection is adopted. Therefore, the first sensing data necessary for heat map generation can be acquired by the first sensing data acquisition process in the normal hover detection operation.

[0117] Based on the heat map generated in the process of step S406, the processing circuit 103 executes a determination process of the touch operation target screen at the time of acquiring the touch detection coordinates, and based on the result of the determination process, outputs the touch detection position on the touch operation target screen to the HOST200.

[0118] Specifically, the processing circuit 103 executes a first collation process on the heat map generated in the process of step S406 (step S407). Specifically, the processing circuit 103 collates the heat map generated in the process of step S406 with the first heat map held in advance.

[0119] When a match is determined in the first collation process (step S407; Yes), the processing circuit 103 determines that the operation at the time of acquiring the touch detection coordinates is an operation on an object on the first screen A (step S408), and outputs the touch detection coordinates P acquired in the above-described touch detection operation as a position on the first screen A to the HOST200 (step S412).

[0120] When a non-match is determined in the first collation process (step S407; No), subsequently, the processing circuit 103 executes a second collation process on the heat map generated in the process of step S406 (step S409). Specifically, the processing circuit 103 collates the heat map generated in the process of step S406 with the second heat map held in advance.

[0121] When a match is determined in the second verification process (step S409; Yes), the processing circuit 103 determines that the operation at the time of obtaining the touch detection coordinates is an operation on the object on the first screen A (step S410), and outputs the touch detection coordinates P obtained in the above-described touch detection operation as a position on the first screen A to the HOST200 (step S412).

[0122] Then, after the processing circuit 103 outputs the touch detection coordinates P on the screen determined as the touch operation target screen in the above-described touch operation target screen determination process to the HOST200 (step S412), the processing from step S403 and subsequent steps is repeatedly executed.

[0123] When a non-match is determined in the second verification process (step S409; No), the processing circuit 103 discards the touch detection coordinates P obtained in the above-described touch detection operation and the heat map generated in the above-described heat map generation process (step S411), and repeatedly executes the processing from step S403 and subsequent steps.

[0124] The display device 1 according to the embodiment is configured to be able to simultaneously display different objects from two viewpoints in the same display area, and by executing the processes according to the above-described embodiments, it is possible to determine an operation target screen according to the viewpoint position of the user. Thereby, it is possible to specify an operation target object on the operation target screen according to the viewpoint position of the user.

[0125] As described above, the preferred embodiments of the present invention have been described, but the present invention is not limited to such embodiments. The content disclosed in the embodiments is merely an example, and various modifications are possible without departing from the spirit of the present invention. For example, it is also possible to adopt a combination of the processes according to the above-described embodiments. Appropriate modifications made without departing from the spirit of the present invention also naturally belong to the technical scope of the present invention. At least one of various omissions, substitutions, and changes of components can be made without departing from the gist of the above-described embodiments and each modification example.

Explanation of Symbols

[0126] 1 Display device 2 Display panel 3 Detection sensor 31 Detection electrode 100 Control circuit 101 First detection circuit 102 Second detection circuit 103 Processing circuit A First screen AA Display area B Second screen DA Detection area PDA1 First area PDA2 Second area

Claims

1. A display panel having a display area capable of simultaneously displaying a first screen viewed from a first viewing point and a second screen viewed from a second viewing point different from the first viewing point; A detection sensor having a detection area overlapping the display area; A control circuit having a first detection function for detecting an object approaching the display panel and a second detection function for detecting a touch on an object displayed on one of the first screen and the second screen as an operation target screen; Comprising: The control circuit: Determines the operation target screen based on the amount of movement of the coordinates on the detection area acquired by the first detection function. A display device.

2. The control circuit: Obtains the difference value between the first coordinate acquired by the first detection function at a first time and the second coordinate acquired by the first detection function at a second time after the first time as the amount of movement. The display device according to Claim 1.

3. The first screen is a screen viewed from the first viewing point on the right side relative to the display area; The second screen is a screen viewed from the second viewing point on the left side relative to the display area; The control circuit: Calculates the difference value by subtracting the second coordinate from the first coordinate with the direction from left to right relative to the display area as a positive value; When the difference value is 0 or more, determines the first screen as the operation target screen; When the difference value is less than 0, determines the second screen as the operation target screen. The display device according to Claim 2.

4. A display panel having a display area capable of simultaneously displaying a first screen viewed from a first viewing point and a second screen viewed from a second viewing point different from the first viewing point; A detection sensor having a detection area overlapping the display area; A control circuit having a first detection function for detecting an object approaching the display panel and a second detection function for detecting a touch on an object displayed on one of the first screen and the second screen as an operation target screen; Comprising: The control circuit: Determines the operation target screen based on the difference value between the first coordinate on the detection area acquired by the first detection function and the second coordinate on the detection area acquired by the second detection function. A display device.

5. The first screen is a screen viewed from the first viewing point on the right side relative to the display area; The second screen is a screen viewed from the second viewing point on the left side relative to the display area. The control circuit Taking the direction from left to right relative to the display area as a positive value, subtracts the second coordinate from the first coordinate to calculate the difference value. When the difference value is 0 or more, the first screen is determined as the operation target screen. When the difference value is less than 0, the second screen is determined as the operation target screen. The display device according to claim 4.

6. A display panel having a display area capable of simultaneously displaying a first screen viewed from a first viewing point and a second screen viewed from a second viewing point different from the first viewing point, A detection sensor having a detection area overlapping the display area, A control circuit having a first detection function for detecting an object approaching the display panel, and a second detection function for detecting a touch on an object displayed on the operation target screen with either the first screen or the second screen as the operation target screen. Comprising The control circuit In the first detection function, based on the detection values obtained by dividing the detection area into a plurality of areas, a heat map weighted by the detection values for each of the plurality of areas is generated, and based on the heat map, the operation target screen is determined. Display device.

7. The control circuit Based on the inclination of the center of gravity position of the heat map, the operation target screen is determined. The display device according to claim 6.

8. The first screen is a screen viewed from the first viewing point on the right side relative to the display area. The second screen is a screen viewed from the second viewing point on the left side relative to the display area. The control circuit Taking the direction extending in the left-right direction relative to the display area as the first direction, the direction orthogonal to the first direction as the second direction, the direction from bottom to top in the second direction as 0 degrees, and the direction inclined to the left as a positive value, calculates the inclination of the center of gravity position of the heat map. When the inclination of the center of gravity position of the heat map is 0 degrees or more, the first screen is determined as the operation target screen. When the inclination of the center of gravity position of the heat map is less than 0 degrees, the second screen is determined as the operation target screen. The display device according to claim 7.

9. The control circuit A first heat map obtained with the first screen as the operation target screen, A second heat map obtained with the second screen as the operation target screen, Are held in advance. Execute a matching process between the heatmap obtained during the detection period and the first heatmap. When a match is determined, determine the first screen as the operation target screen. Execute a matching process between the heatmap obtained during the detection period and the second heatmap. When a match is determined, determine the second screen as the operation target screen. The display device according to claim 6.

Images