Driving method of data processing device

Abstract

The present invention provides a method for driving a data processing device with low power consumption. The data processing device includes a flexible position input unit for detecting an object such as a finger or a palm approaching or contacting the flexible position input unit. The flexible position input unit overlaps with a display unit and includes a first area, a second area opposite to the first area, and a third area between the first area and the second area. When a user holds a part of the first area or the second area for a certain period of time, the supply of an image signal to the part is selectively stopped. Alternatively, the detection in the part is selectively stopped.

Description

[0001] This invention application is a divisional application of the invention patent application with international application number PCT / IB2014 / 066147, international application date November 19, 2014, application number 201480061980.4 entering the Chinese national phase, and name “Data processing device and driving method of data processing device”. Technical Field

[0002] The present invention relates to an object, a method or a manufacturing method. In addition, the present invention relates to a process, a machine, a product or a composition of matter. In particular, the present invention relates to, for example, a semiconductor device, a display device, a light-emitting device, a power storage device, a driving method thereof or a manufacturing method thereof. In particular, the present invention relates to, for example, a method and a program for processing and displaying image information; and a device having a recording medium for recording the program. In particular, the present invention relates to, for example, a method for processing and displaying image information including information processed by an information processing device having a display unit; a program for displaying an image including information processed by an information processing device having a display unit; and an information processing device including a recording medium for recording the program. Background Art

[0003] A display device with a large screen can display a large amount of information. Therefore, such a display device has a strong overview and is suitable for an information processing device.

[0004] Social infrastructure related to information transmission methods is becoming increasingly complete. Therefore, by using information processing devices, it is possible to obtain, process or transmit a variety of rich information not only at home or at work but also when going out.

[0005] Under the above background, active development of portable information processing devices has been carried out.

[0006] For example, in many cases, a portable information processing device is used outdoors, so the portable information processing device and the display device therein may be accidentally impacted by external force due to being dropped, etc. As an example of a display device that is not easily damaged, a display device having a structure in which the compactness of a structure separating a light-emitting layer and a second electrode layer is improved is known (Patent Document 1).

[0007] [References]

[0008] [Patent Document 1] Japanese Patent Application Publication No. 2012-190794 Summary of the invention

[0009] One of the purposes of one embodiment of the present invention is to provide a novel human-machine interface with good operability. In addition, one of the purposes of one embodiment of the present invention is to provide a novel data processing device with good operability. One of the purposes of one embodiment of the present invention is to provide a novel processing device or a novel display device, etc. One of the purposes of one embodiment of the present invention is to provide a data processing device or a display device with low power consumption, etc. One of the purposes of one embodiment of the present invention is to provide a data processing device or a display device with good operability. One of the purposes of one embodiment of the present invention is to provide a data processing device or a display device that is easy to hold, etc. One of the purposes of one embodiment of the present invention is to provide a data processing device or a display device that is not easy to drop, etc. One of the purposes of one embodiment of the present invention is to provide a data processing device or a display device with less malfunctions, etc. One of the purposes of one embodiment of the present invention is to provide a data processing device and a display device that are easy to operate with both hands.

[0010] Note that the description of these purposes does not prevent the existence of other purposes. In addition, one mode of the present invention does not need to achieve all of the above purposes. In addition, purposes other than the above can be known and extracted from the description of the specification, drawings, claims, etc.

[0011] One embodiment of the present invention is a data processing device, comprising: an input / output device that supplies position data and is supplied with image data; and a computing device that is supplied with position data and is supplied with image data, wherein the input / output device has a position input unit and a display unit, the position input unit has flexibility that enables it to bend to form a first area, a second area opposite to the first area, and a third area between the first area and the second area, the display unit is configured to overlap with at least a portion of the first area, the second area, and the third area, and the computing device has a computing unit and a storage unit that stores a program executed by the computing unit and supplies image data to the display unit based on the position data.

[0012] In addition, one embodiment of the present invention is a data processing device, comprising: an input device having multiple areas and including a detection unit for detecting objects approaching or contacting the detection unit; a computing unit for judging an approach action or a contact action on the detection unit; and a flexible display device, wherein when a specific approach action or a contact action is performed simultaneously in multiple areas, predetermined processing is performed.

[0013] One embodiment of the present invention is a driving method for a data processing device, which includes: an input unit having a detection unit for detecting an object approaching or in contact with the data processing device; and a display unit having a display unit for displaying an image, wherein the detection unit and the display unit overlap, and the data processing device determines a first area on the detection unit that detects an object approaching or in contact with the data processing device within a predetermined time, and does not supply an image signal to a second area on the display unit that overlaps with the first area.

[0014] In addition, one embodiment of the present invention is a driving method of a data processing device, which includes: an input unit having a detection unit for detecting an object approaching or contacting the detection unit; and a computing unit for judging an approaching motion or a contact motion on the detection unit, wherein by detecting an area on the detection unit that continuously detects objects approaching or contacting the detection unit within a predetermined time, the area is excluded from the object of judging the approaching motion or the contact motion.

[0015] In addition, one embodiment of the present invention is a method for driving a data processing device, wherein it is determined whether the data processing device is operated with one hand or both hands, and an image based on the determination result is displayed.

[0016] According to one embodiment of the present invention, a human-machine interface with good operability can be provided. In addition, a novel data processing device with good operability can be provided. In addition, a novel data processing device or a novel display device can be provided. In addition, a data processing device or a display device with low power consumption can be provided. In addition, a data processing device or a display device with good operability can be provided. In addition, a data processing device or a display device that is easy to hold can be provided. In addition, a data processing device or a display device that is not easy to fall can be provided. In addition, a data processing device or a display device with few malfunctions can be provided. In addition, a data processing device or a display device that is easy to operate with both hands can be provided. Note that the description of these effects does not prevent the existence of other effects. In addition, one embodiment of the present invention does not need to have all of the above-mentioned purposes. In addition, effects other than the above-mentioned can be known and extracted from the description of the specification, drawings, claims, etc. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 is a block diagram illustrating a structure of a data processing apparatus according to an embodiment;

[0018] FIG. 2A to FIG. 2E is a diagram illustrating the configuration of a data processing device and a position input unit according to an embodiment;

[0019] FIG. 3A to FIG. 3C is a diagram illustrating the configuration of a data processing device and a position input unit according to an embodiment;

[0020] 4A to 4H is a diagram illustrating the configuration of a data processing device and a position input unit according to an embodiment;

[0021] Figure 5A and Figure 5B is a schematic diagram illustrating a structure of a data processing device according to an embodiment;

[0022] Fig. 6A and Figure 6B is a schematic diagram illustrating a structure of a data processing device according to an embodiment;

[0023] Fig.7A1 , Fig.7A2 , Figure 7B1 and Figure 7B2 is a schematic diagram illustrating a structure of a data processing device according to an embodiment;

[0024] Fig.8A1 , Figure 8A2 , Figure 8B1 and Figure 8B2 is a schematic diagram illustrating a structure of a data processing device according to an embodiment;

[0025] Fig.9A1 , Fig.9A2 , Fig.9B1 and Figure 9B2 is a schematic diagram illustrating a structure of a data processing device according to an embodiment;

[0026] Fig.10A1 , Fig.10A2 and Fig. 10B is a diagram illustrating a structure of a position input unit according to an embodiment;

[0027] Fig.11 is a block diagram illustrating a structure of a data processing apparatus according to an embodiment;

[0028] Fig. 12A is a diagram illustrating a structure of a data processing device according to an embodiment, Fig. 12B and Fig. 12C is a diagram for explaining a folded state and an unfolded state of a data processing device;

[0029] FIG. 13A to FIG. 13E is a diagram illustrating a structure of a data processing device according to an embodiment;

[0030] Fig.14A1 , Fig.14A2 , Fig.14B1 and Figure 14B2 is a diagram illustrating a state in which a data processing device according to an embodiment is held by a user;

[0031] Fig.15A and Fig. 15B is a diagram illustrating a state in which a data processing device according to an embodiment is held by a user;

[0032] Fig.16A and Fig. 16B is a flowchart illustrating a program executed by a computing unit in a data processing device according to an embodiment;

[0033] 17A to 17C is a diagram illustrating the configuration of a data processing device and a position input unit according to an embodiment;

[0034] 18A to 18D is a diagram illustrating the configuration of a data processing device and a position input unit according to an embodiment;

[0035] Fig.19A and Fig.19B is a diagram for explaining a usage example of a data processing device according to an embodiment;

[0036] Fig. 20 is a flowchart illustrating a program executed by a computing unit in a data processing device according to an embodiment;

[0037] FIG. 21A to FIG. 21C A diagram illustrating an example of an image displayed on a display unit of a data processing device according to an embodiment;

[0038] Fig. 22 is a flowchart illustrating a program executed by a computing unit in a data processing device according to an embodiment;

[0039] Fig.23 is a flowchart illustrating a program executed by a computing unit in a data processing device according to an embodiment;

[0040] Fig.24 is a flowchart illustrating a program executed by a computing unit in a data processing device according to an embodiment;

[0041] Fig.25 is a diagram for explaining a usage example of a data processing device according to an embodiment;

[0042] FIG. 26A to FIG. 26C is a diagram illustrating a structure of a display panel that can be applied to a display device according to an embodiment;

[0043] Fig.27A and Fig.27B is a diagram illustrating a structure of a display panel that can be applied to a display device according to an embodiment;

[0044] Fig.28is a diagram illustrating a structure of a display panel that can be applied to a display device according to an embodiment;

[0045] FIG. 29A to FIG. 29D is a diagram illustrating a method for manufacturing a bendable functional element according to an embodiment;

[0046] FIG. 30A to FIG. 30D is a diagram illustrating a method for manufacturing a bendable functional element according to an embodiment;

[0047] FIG. 31A to FIG. 31D is a diagram illustrating a method for manufacturing a bendable functional element according to an embodiment;

[0048] Fig.32A and Fig.32B It is a diagram for explaining a usage example of the data processing device according to the embodiment. DETAILED DESCRIPTION

[0049] The embodiments are described in detail with reference to the accompanying drawings. Note that the present invention is not limited to the following description, and a person skilled in the art can easily understand that the method and details can be transformed into various forms without departing from the purpose and scope of the present invention. Therefore, the present invention should not be interpreted as being limited to the description of the embodiments shown below. Note that in the structure of the invention described below, the same figure mark is used in different drawings to represent the same part or the part with the same function, and its repeated description is omitted.

[0050] In addition, in order to facilitate understanding of the invention, the position, size, range, etc. of each structure shown in the drawings and the like may not represent the actual position, size, range, etc. Therefore, the disclosed invention is not necessarily limited to the position, size, range, etc. disclosed in the drawings and the like. For example, the position, size, range, etc. may be omitted for convenience.

[0051] Note that in this specification, “above” or “below” is not limited to the case where the positional relationship of the components is “directly above” or “directly below” and in direct contact. For example, “electrode B on insulating layer A” does not necessarily mean that electrode B is formed on insulating layer A in direct contact, but may also include a case where other components are included between insulating layer A and electrode B.

[0052] Note that ordinal numbers such as "first" and "second" in this specification are used to avoid confusion between constituent elements, and do not indicate the order or sequence of process sequence or stacking sequence. Note that in order to avoid confusion between constituent elements, ordinal numbers may be added to terms that are not added to ordinal numbers in this specification, etc. in the claims. In addition, different ordinal numbers may be added to terms that are added to ordinal numbers in this specification, etc. in the claims.

[0053] In addition, in this specification, "touch" refers to the action of contacting the surface of the data processing device with a part of the user's body such as a finger or a tool such as a stylus. In addition, in this specification, "tap" refers to the action of pressing the surface of the data processing device with a part of the user's body such as a finger or a tool such as a stylus. In addition, in this specification, "slide (flick)" refers to the action of sliding on the surface of the data processing device with a part of the user's body or a tool such as a stylus. In addition, in this specification, "drag" refers to selecting a part or the whole of an image displayed on the display unit with a part of the user's body such as a finger or a tool such as a stylus and moving the selected image by sliding. In addition, in this specification, "zoom in" refers to the action of closing two fingers on the surface of the data processing device. In addition, in this specification, "zoom out" refers to the action of opening two fingers on the surface of the data processing device. In addition, in this specification, the proximity action and contact action performed on the detection unit such as touch, tap, slide, drag, zoom in and zoom out are collectively referred to as "touch action".

[0054] Implementation Method 1

[0055] In this embodiment, the configuration of a data processing device according to one embodiment of the present invention will be described with reference to the drawings.

[0056] Figure 1 It is a block diagram for explaining the structure of a data processing device 100 according to one embodiment of the present invention.

[0057] Figure 2A 1 is a schematic diagram illustrating the appearance of a data processing device 100 according to one embodiment of the present invention. Figure 2B It is explained along the Figure 2A The cross-sectional view of the cross-sectional structure along the cut line X1-X2 is shown. Figure 2C and Figure 2D is a schematic diagram for explaining the appearance of a data processing device 100 according to one embodiment of the present invention, and Figure 2E It is explained along the Figure 2C and Figure 2D A cross-sectional view of the cross-sectional structure along the cut line X3 - X4 is shown. Figure 2Cis a schematic diagram illustrating the front side of the data processing device 100, Figure 2D It is a schematic diagram for explaining the back side of the data processing device 100 .

[0058] also, Figure 3A is a schematic diagram for explaining the appearance of a data processing device 100 according to one embodiment of the present invention, and Figure 3B It is explained along the Figure 3A The cross-sectional view of the cross-sectional structure along the cut line X5-X6 is shown. Figure 3C It is a description of Figure 3B A cross-sectional view of an example of a different cross-sectional structure.

[0059] in addition, Figure 4A is a schematic diagram for explaining the appearance of a data processing device 100 according to one embodiment of the present invention, and Figure 4B It is explained along the Figure 4A The cross-sectional view of the cross-sectional structure of the truncation line X7-X8 shown. In addition, FIG. 4C to FIG. 4H It is a description of Figure 4B Cross-sectional views of examples of different cross-sectional structures.

[0060] like Figure 2C , Figure 2D and Figure 3C As shown, the position input unit 140 or the display unit 130 is not only arranged on the front side of the data processing device 100 but also can be arranged on the side or back side thereof. Figure 3A As shown in FIG. 1 , the position input unit 140 or the display unit 130 may be disposed on the top surface of the data processing device 100. In addition, the position input unit 140 or the display unit 130 may also be disposed on the bottom surface of the data processing device 100. Alternatively, as shown in FIG. Figure 4A or its cross-sectional view Figure 4B As shown, the position input unit 140 or the display unit 130 may not be disposed on the side surface, top surface, or back surface of the data processing device 100 .

[0061] For example, you can also use Figure 5A and Figure 5B The structure shown. Figure 5A is a perspective schematic diagram showing the front side of a data processing device, Figure 5B is a perspective diagram showing the back side. Alternatively, Fig. 6A and Figure 6B The structure shown. Fig. 6A is a perspective schematic diagram showing the front side of a data processing device, Figure 6B is a perspective diagram showing the back side. Alternatively, Fig.7A1 and Fig.7A2 The structure shown. Fig.7A1is a perspective schematic diagram showing the front side of a data processing device, Fig.7A2 1 is a perspective view showing the back side. Figure 7B1 and Figure 7B2 The structure shown. Figure 7B1 is a perspective schematic diagram showing the front side of a data processing device, Figure 7B2 1 is a perspective view showing the back side. Fig.8A1 and Figure 8A2 The structure shown. Fig.8A1 is a perspective schematic diagram showing the front side of a data processing device, Figure 8A2 1 is a perspective view showing the back side. Figure 8B1 and Figure 8B2 The structure shown. Figure 8B1 is a perspective schematic diagram showing the front side of a data processing device, Figure 8B2 1 is a perspective view showing the back side. Fig.9A1 and Fig.9A2 The structure shown. Fig.9A1 is a perspective schematic diagram showing the front side of a data processing device, Fig.9A2 1 is a perspective view showing the back side. Fig.9B1 and Figure 9B2 The structure shown. Fig.9B1 is a perspective schematic diagram showing the front side of a data processing device, Figure 9B2 It is a perspective schematic diagram showing the back side thereof.

[0062] Note that the housing 101 may have not only the position input unit 140 but also hardware buttons or external connection terminals or the like on the surface.

[0063] By adopting this structure, it is possible to display on the side of the frame instead of displaying only on the surface parallel to the front of the frame as in the conventional data processing device. In particular, it is preferred that the display area is provided along two or more side surfaces of the frame, because the display diversity can be further improved.

[0064] The display area arranged along the front of the data processing device and each display area arranged along the side thereof can be used as display areas independently and display different images, etc., or one image can be displayed in any two or more display areas, etc. For example, a continuous image can be displayed on the display area arranged along the front of the data processing device and the display area arranged along the side of the data processing device, etc.

[0065] Fig.10A11 is a schematic diagram for explaining the configuration of a position input unit 140 and a display unit 130 of a data processing device 100 that can be applied to one embodiment of the present invention. Fig.10A2 1 is a schematic diagram for explaining the arrangement of the proximity sensor 142 of the position input unit 140 .

[0066] Fig. 10B It is explained along the Fig.10A2 The cross-sectional view of the cross-sectional structure of the position input unit 140 is shown along the cut line X9 - X10 .

[0067] <Configuration Example of Data Processing Device>

[0068] The data processing device 100 described here includes: an input / output device 120 that supplies position data L-INF and is supplied with image data VIDEO; and a computing device 110 (see Figure 1 ).

[0069] The input / output device 120 includes a position input section 140 supplied with position data L-INF and a display section 130 supplied with image data VIDEO.

[0070] The position input unit 140 has flexibility that allows it to be bent, for example, to form a first region 140(1), a second region 140(2) opposite to the first region 140(1), and a third region 140(3) between the first region 140(1) and the second region 140(2) (see Figure 2B ). In addition, as another example, the position input unit 140 has flexibility that enables it to be bent to form a first area 140 (1), a third area 140 (3), and a fourth area 140 (4) opposite to the third area 140 (3) (see Figure 2E ).

[0071] In addition, as another example, the position input unit 140 has flexibility that allows it to be bent to form a third area 140(3), a fifth area 140(5), and a fourth area 140(4) opposite to the third area 140(3) (see Figure 3C ).

[0072] Note that a separate position input unit 140 may be provided for each surface or each region. Figure 4C , Figure 4D ,as well as Figure 4E As shown, a position input unit 140(A), a position input unit 140(B), a position input unit 140(C), a position input unit 140(D) ​​and a position input unit 140(E) are provided in each area. Figure 4FAs shown in FIG. 4G, the position input unit 140(A), the position input unit 140(B), the position input unit 140(C), the position input unit 140(D), and a part of the position input unit 140(E) may not be provided. Figure 4H As shown, the position input unit may be provided so as to surround the entire inner surface of the frame.

[0073] Note that the configuration of the second region 140(2) opposite to the first region 140(1) is not limited to the configuration directly opposite to the first region 140(1), but also includes the configuration directly opposite to the first region 140(1). Note that the configuration of the fourth region 140(4) opposite to the third region 140(3) is not limited to the configuration directly opposite to the third region 140(3), but also includes the configuration directly opposite to the third region 140(3).

[0074] The display unit 130 is supplied with the image data VIDEO and overlaps at least a portion of the first area 140(1), the second area 140(2), the third area 140(3), the fourth area 140(4) or the fifth area 140(5). The computing device 110 includes a computing unit 111 and a storage unit 112 storing a program executed by the computing unit 111 (see Figure 1 ).

[0075] The data processing device 100 includes a flexible position input unit 140 that detects an object approaching or in contact with the position input unit 140. For example, the position input unit 140 can be bent to form a first area 140 (1), a second area 140 (2) opposite to the first area (1), and a third area 140 (3) overlapping the display unit 130 between the first area 140 (1) and the second area 140 (2). Thus, for example, it can be determined whether a palm or a finger approaches or contacts the first area 140 (1) or the second area 140 (2). As a result, a human-machine interface with good operability can be provided. In addition, a novel data processing device with good operability can be provided.

[0076] The following describes the components of the data processing device 100 (see Figure 1 ). Note that the above structures cannot be clearly separated, and sometimes one structure serves as or contains part of other structures.

[0077] For example, a touch screen in which a touch sensor is overlapped on the display portion is provided on the display portion 130 and provided on the position input portion 140 .

[0078] 《Input / Output Devices》

[0079] The input / output device 120 includes a position input unit 140 and a display unit 130. In addition, the input / output device 120 may also include an input / output unit 145, a detection unit 150, and a communication unit 160. In addition, the input / output device 120 is supplied with data and supplies data (see Figure 1 ).

[0080] 《Position Input Department》

[0081] The position input unit 140 supplies the position data L-INF. The user of the data processing device 100 supplies the position data L-INF to the position input unit 140 by touching the position input unit 140 with a finger or a palm, thereby supplying various operation instructions to the data processing device 100. For example, an operation instruction including an end instruction (an instruction to end a program) can be supplied (see Figure 1 ).

[0082] The position input unit 140 includes, for example, a first area 140(1), a second area 140(2), and a third area 140(3) between the first area 140(1) and the second area 140(2) (see Fig.10A1 In each of the first area 140 (1), the second area 140 (2), and the third area 140 (3), the proximity sensors 142 are arranged in a matrix (see Fig.10A2 ).

[0083] The position input unit 140 includes, for example, a flexible substrate 141 and a proximity sensor 142 on the flexible substrate 141 (see Fig. 10B ).

[0084] The position input unit 140 is bent so that the second area 140 (2) and the first area 140 (1) face each other (see Figure 2B ).

[0085] The third area 140 (3) of the position input unit 140 overlaps with the display unit 130 (see FIG. 2B and FIG. 2C ). Fig.10A1 Note that when the third region 140 ( 3 ) is arranged closer to the user than the display unit 130 , the third region 140 ( 3 ) has light-transmitting properties.

[0086] The second area of ​​the position input unit 140 in the bent state is separated from the first area to such an extent that the user of the data processing device 100 can hold it with one hand (see Fig.14A1 ). The separation distance is, for example, less than 17 cm, preferably less than 9 cm, and more preferably less than 7 cm. When the separation distance is short, the position data can be input to a larger range of the third area 140 (3) with the thumb of the holding finger.

[0087] Thus, the user of the data processing device 100 can hold and use the data processing device 100 by bringing the base of the thumb (near the ball of the thumb) close to or in contact with one of the first area 140(1) and the second area 140(2) and bringing fingers other than the thumb close to or in contact with the other of the first area 140(1) and the second area 140(2).

[0088] The shape of the base of the thumb (near the ball of the thumb) that is close to or in contact with one of the first area 140(1) and the second area 140(2) is different from the shape of the fingers other than the thumb that are close to or in contact with the other area, so the first area 140(1) supplies position data different from that of the second area 140(2). Specifically, the shape of the base of the thumb (near the ball of the thumb) that is close to or in contact with one of the first area 140(1) and the second area 140(2) is, for example, larger than the shape of the fingers other than the thumb that are close to or in contact with the other area or is continuous (not divided).

[0089] The proximity sensor 142 may be any sensor that can detect an object (e.g., a finger or a palm) approaching or touching the proximity sensor, and a capacitor or an imaging element may be used as the proximity sensor. Note that a substrate having capacitors arranged in a matrix may be referred to as a capacitive touch sensor, and a substrate having an imaging element may be referred to as an optical touch sensor.

[0090] A resin having a thickness sufficient to provide flexibility can be used as the flexible substrate 141. Examples of the resin include polyester, polyolefin, polyamide, polyimide, aramid resin, epoxy resin, polycarbonate, and acrylic resin.

[0091] In addition, as a general substrate that does not have flexibility, a glass substrate, a quartz substrate, a semiconductor substrate, or the like can be used.

[0092] Note that specific configuration examples that can be applied to the position input unit 140 will be described in Embodiment 6 and Embodiment 7.

[0093] Display Department

[0094] The display unit 130 overlaps at least the third area 140(3) of the position input unit 140. The display unit 130 overlaps not only the third area 140(3) but also the first area 140(1) and / or the second area 140(2).

[0095] The display unit 130 is not particularly limited as long as it can display the supplied image data VIDEO.

[0096] The operation command associated with the portion of the display unit 130 overlapping the first region 140 ( 1 ) and / or the second region 140 ( 2 ) may be different from the operation command associated with the portion of the display unit 130 overlapping the third region 140 ( 3 ).

[0097] Thus, the user can use the display on the display unit to confirm the operation instructions associated with the portion overlapping the first area 140 (1) and / or the second area 140 (2). As a result, multiple operation instructions can be associated. In addition, input errors of operation instructions can be reduced.

[0098] Note that specific structural examples that can be applied to the display portion 130 will be described in Embodiment 6 and Embodiment 7.

[0099] Computing Device

[0100] The computing device 110 includes a computing unit 111, a storage unit 112, an input / output interface 115, and a transmission channel 114 (see Figure 1 ).

[0101] The computing device 110 is supplied with the position data L-INF and with the image data VIDEO.

[0102] For example, the arithmetic device 110 supplies image data VIDEO including images used for the operation of the data processing device 100, and the input / output device 120 supplies image data VIDEO including images used for the operation. The display unit 130 displays images used for the operation.

[0103] The user can provide position data L-INF for selecting an image by touching a portion of the third region 140 ( 3 ) overlapping the display unit 130 displaying an image for operation with a finger.

[0104] 《Operation Department》

[0105] The operation unit 111 executes a program stored in the storage unit 112. For example, when the position data L-INF associated with the position where an image for operation is displayed is supplied, the operation unit 111 executes a program associated with the image.

[0106] Storage Department

[0107] The storage unit 112 stores the program executed by the calculation unit 111 .

[0108] Note that an example of the program executed by the arithmetic device 110 will be described in other embodiments.

[0109] 《Input / output interface, transmission channel》

[0110] The input / output interface 115 supplies data and is supplied with data.

[0111] The transmission channel 114 can be supplied with data, and the computing unit 111, the storage unit 112, and the input / output interface 115 can be supplied with data. In addition, the computing unit 111, the storage unit 112, and the input / output interface 115 can be supplied with data, and the transmission channel 114 can be supplied with data.

[0112] The data processing device 100 includes a computing device 110, an input / output device 120, and a frame 101 (see Figure 1 , Figure 2B ).

[0113] 《Testing Department》

[0114] The detection unit 150 detects the state of the data processing device 100 and its surroundings and supplies detection data SENS (see Figure 1 ).

[0115] Note that the detection unit 150 may detect, for example, acceleration, orientation, pressure, GPS (Global Positioning System) signal, temperature, humidity, or the like and supply the data.

[0116] "Ministry of Communications"

[0117] The communication unit 160 supplies the data COM supplied from the computing device 110 to a device or a communication network external to the data processing device 100. The data COM is acquired from the external device or the communication network and supplied.

[0118] The data COM may include various instructions, etc. For example, the data COM may include a display instruction for causing the calculation unit 111 to generate or delete the image data VIDEO.

[0119] Communication means for connecting to external devices or communication networks, such as a hub, a router, or a modem, can be applied to the communication unit 160. Note that the connection method is not limited to a wired method, and a wireless method (eg, radio waves or infrared rays) may also be used.

[0120] 《Input / Output Department》

[0121] For example, a camera, a microphone, a read-only external storage unit, an external storage unit, a scanner, a speaker, a printer, etc. can be used for the input / output unit 145 (see Figure 1 ).

[0122] Specifically, as the camera, a digital still camera, a digital video camera, or the like can be used.

[0123] As the external storage unit, a hard disk or a removable memory can be used. As the read-only external storage unit, a CDROM, a DVDROM, etc. can be used.

[0124] Frame

[0125] The housing 101 protects the computing device 110 and the like from stress applied from the outside.

[0126] As the frame 101 , metal, plastic, glass, ceramic, or the like can be used.

[0127] Note that this embodiment mode can be combined with other embodiment modes described in this specification as appropriate.

[0128] Implementation Method 2

[0129] In this embodiment, a configuration of a data processing device according to one embodiment of the present invention will be described with reference to the drawings.

[0130] Fig.11 It is a block diagram for explaining the structure of a data processing device 100B according to one embodiment of the present invention.

[0131] FIG. 12A to FIG. 12C 1 is a schematic diagram illustrating the appearance of the data processing device 100B. Fig. 12A , Fig. 12B and Fig. 12C The diagrams respectively illustrate the appearance of the data processing device 100B in an unfolded state, the appearance of the data processing device 100B in a bent state, and the appearance of the data processing device 100B in a folded state.

[0132] FIG. 13A to FIG. 13E 13A to 13B are schematic diagrams for explaining the structure of the data processing device 100B. Fig.13D is a diagram illustrating the structure in an expanded state, Fig.13E It is a diagram illustrating the structure in a folded state.

[0133] Fig.13A , Fig. 13B and Fig. 13C They are respectively a top view of the data processing device 100B, a bottom view of the data processing device 100B, and a side view of the data processing device 100B. Fig.13D It is explained along the Fig.13A The cross-sectional view of the cross-sectional structure of the data processing device 100B taken along the cutting line Y1 - Y2 is shown. Fig.13E It is a side view of the data processing device 100B in the folded state.

[0134] <Configuration Example of Data Processing Device>

[0135] The data processing device 100B described here includes: an input / output device 120B supplied with position data L-INF and detection data SENS including folding data and supplied with image data VIDEO; a computing device 110 (see Fig.11 ).

[0136] The input / output device 120B includes a position input unit 140B, a display unit 130 , and a detection unit 150 .

[0137] The position input unit 140B has flexibility sufficient to be unfolded and folded to form a first region 140B(1), a second region 140B(2) opposite to the first region 140B(1), and a third region 140B(3) between the first region 140B(1) and the second region 140B(2) (see FIG. 12A to FIG. 12C as well as FIG. 13A to FIG. 13E ).

[0138] The detection unit 150 includes a folding sensor 151 capable of detecting the folded state of the position input unit 140B and supplying detection data SENS including folding data.

[0139] The display unit 130 is supplied with the image data VIDEO and is arranged to overlap with the third area 140B (3). The computing device 110 includes a computing unit 111 and a storage unit 112 storing a program executed by the computing unit 111 (see Fig.13D ).

[0140] The data processing device 100B described herein includes: a flexible position input unit 140B capable of detecting a palm or finger approaching a first area 140B(1), a second area 140B(2) facing the first area 140B(1) in a folded state, and a third area 140B(3) overlapping the display unit 130 between the first area 140B(1) and the second area 140B(2); and a detection unit 150 (see FIG. 1 ) including a folding sensor 151 capable of detecting whether the flexible position input unit 140B is in a folded state or an unfolded state. Fig.11 as well as FIG. 13A to FIG. 13E ). Thus, it is possible to determine whether a palm or finger is close to the first area 140B (1) or the second area 140B (2). As a result, a human-machine interface with good operability can be provided. In addition, a novel data processing device with good operability can be provided.

[0141] Hereinafter, each component constituting the data processing device 100B will be described. Note that the above-mentioned components cannot be clearly separated, and one component may also serve as another component or include a part of another component.

[0142] For example, a touch screen in which a touch sensor is superimposed on the display portion is provided on the display portion 130 and is provided on the position input portion 140B.

[0143] The data processing device 100B is different from the data processing device described in Embodiment 1 in that the position input unit 140B has flexibility that allows it to be unfolded or folded, and the detection unit 150 of the input / output device 120B includes a folding sensor 151. The different structures will be described in detail below, and the above description will be used for other similar structures.

[0144] 《Input / Output Devices》

[0145] The input / output device 120B includes a position input unit 140B, a display unit 130, and a detection unit 150 including a folding sensor 151. The input / output device 120B may also include an input / output unit 145, a marker 159, a communication unit 160, etc. The input / output device 120B is supplied with data and can supply data ( Fig.11 ).

[0146] 《Structure for realizing the unfolded state and folded state of a data processing device》

[0147] The data processing device 100B has a housing that alternately includes a highly flexible portion E1 and a less flexible portion E2. In other words, the housing of the data processing device 100B includes a highly flexible portion E1 and a less flexible portion E2 in a strip shape (see Fig.13A and Fig. 13B ).

[0148] Thus, the data processing device 100B (see FIG. 12A to FIG. 12C The data processing device 100B in the folded state is easy to carry. The data processing device 100B may be folded so that a portion of the third area 140B(3) of the position input unit 140B is on the outside, and only a portion of the third area 140B(3) is used (see Fig. 12C ).

[0149] For example, as the shapes of the highly flexible portion E1 and the less flexible portion E2, a shape with both ends parallel to each other, a triangle, a trapezoid, a fan, or the like may be adopted.

[0150] The user of the data processing device 100B folded into a size that can be held in one hand can operate a part of the third area 140B (3) of the position input unit with the thumb of the supporting finger to input position data. Therefore, a data processing device that can be operated with one hand (see Fig.15A ).

[0151] Note that in the state of being folded with the position input unit 140 facing inward, the user cannot operate a part of the third area 140B(3) (see Fig. 12C ). Therefore, in the folded state, the driving of a part of the third area 140B(3) of the position input unit can be stopped. As a result, the power consumption of the data processing device 100B in which the position input unit is in the folded state can be reduced.

[0152] The position input unit 140B in the expanded state has no seams and a large operation area.

[0153] The display unit 130 overlaps with the third area 140B(3) of the position input unit (see Fig.13D ). The position input portion 140B is sandwiched between the connecting member 13a and the connecting member 13b. The connecting member 13a and the connecting member 13b are sandwiched between the supporting member 15a and the supporting member 15b (refer to Fig. 13C ).

[0154] The display unit 130 , the position input unit 140B, the connecting members 13 a , 13 b , the supporting members 15 a , and 15 b are fixed by various methods such as adhesive, screws, or fitting.

[0155] Highly flexible part

[0156] The highly flexible portion E1 can be bent and used as a hinge.

[0157] The highly flexible portion E1 includes a connecting member 13a and a connecting member 13b overlapping the connecting member 13a (see FIG. 13A to FIG. 13C ).

[0158] The less flexible part

[0159] The portion E2 with low flexibility has at least one of the supporting member 15a and the supporting member 15b. For example, the portion E2 with low flexibility has the supporting member 15a and the supporting member 15b overlapping the supporting member 15a. Note that in a structure having only the supporting member 15b, the portion E2 with low flexibility can be lightened and thinned.

[0160] 《Connecting components》

[0161] The connection members 13a and 13b are flexible. For example, flexible plastic, metal, alloy, or / and rubber can be used as the connection members 13a and 13b. Specifically, silicone rubber can be used as the connection members 13a and 13b.

[0162] Supporting structure

[0163] The flexibility of any one of the supporting member 15a and the supporting member 15b is lower than that of the connecting member 13a and the connecting member 13b. The supporting member 15a or the supporting member 15b can improve the mechanical strength of the position input part 140B and protect the position input part 140B from damage.

[0164] For example, plastic, metal, alloy, rubber, etc. can be used as the supporting member 15a or 15b. The connecting member 13a, connecting member 13b, supporting member 15a or 15b made of plastic or rubber can be lightweight or can be made into a member that is not easily damaged.

[0165] Specifically, engineering plastic or silicone rubber can be used. In addition, stainless steel, aluminum, magnesium alloy, etc. can be used as the support member 15a and the support member 15b.

[0166] 《Position Input Department》

[0167] The position input unit 140B may be in an unfolded state or a folded state (see Fig. 12A to Fig. 12C ).

[0168] The third area 140B (3) in the expanded state is arranged on the top surface of the data processing device 100B (see Fig. 13C ), and the third area 140B (3) in the folded state is arranged on the top surface and the side surface of the data processing device 100B (refer to Fig.13E ).

[0169] When the position input portion 140B is unfolded, a larger area can be used than in the folded state.

[0170] By folding the position input unit 140B, an operation instruction different from the operation instruction associated with the portion of the top surface of the data processing device 100B arranged in the third area 140B (3) can be associated with the portion of the side surface of the data processing device 100B arranged in the third area 140B (3). Note that an operation instruction different from the operation instruction associated with the second area 140B (2) can also be associated with the portion of the side surface of the data processing device 100B in the third area 140B (3). Therefore, complex operation instructions can be sent using the position input unit 140B.

[0171] The position input unit 140B supplies the position data L-INF (see Fig.11 ).

[0172] The position input portion 140B is located between the support member 15a and the support member 15b. The connection member 13a and the connection member 13b may also sandwich the position input portion 140B.

[0173] The position input unit 140B includes a first area 140B(1), a second area 140B(2), and a third area 140B(3) between the first area 140B(1) and the second area 140B(2) (see Fig.13D ).

[0174] The position input unit 140B includes a flexible substrate and proximity sensors on the flexible substrate. The proximity sensors are arranged in a matrix in each of the first region 140B(1), the second region 140B(2), and the third region 140B(3).

[0175] Note that specific configuration examples that can be applied to the position input unit 140B will be described in Embodiments 6 and 7.

[0176] 《Testing Department and Marking》

[0177] The data processing device 100B includes a detection unit 150. The detection unit 150 includes a folding sensor 151 (see Fig.11 ).

[0178] The folding sensor 151 and the mark 159 are arranged in the data processing device 100B to detect the folding state of the position input unit 140B (see Fig. 12A , Fig. 12B , Fig.13A , Fig. 13C and Fig.13E ).

[0179] When the position input unit 140B is in the unfolded state, the mark 159 is located at a position far from the folding sensor 151 (see Fig. 12A , Fig.13A and Fig. 13C ).

[0180] When the position input portion 140B is bent at the connection member 13a, the mark 159 is close to the folding sensor 151 (see Fig. 12B ).

[0181] In a state where the position input section 140B is folded at the connection member 13a, the mark 159 faces the folding sensor 151 (see Fig.13E ).

[0182] The detection unit 150 detects the mark 159, determines that the position input unit 140B is in the folded state, and supplies the detection data SENS including the folded data.

[0183] Display Department

[0184] The display unit 130 overlaps at least a portion of the third region 140(3) of the position input unit 140. The display unit 130 can display the supplied image data VIDEO.

[0185] In particular, when the display unit 130 has flexibility, the display unit 130 can be unfolded or folded so as to overlap with the position input unit 140. Therefore, the display unit 130 can provide a seamless display with high visibility.

[0186] Note that specific structural examples that can be applied to the display portion 130 having flexibility will be described in Embodiment 6 and Embodiment 7.

[0187] Computing Device

[0188] The computing device 110 includes a computing unit 111, a storage unit 112, an input / output interface 115, and a transmission channel 114 (see Fig.11 ).

[0189] Note that this embodiment mode can be combined with other embodiment modes described in this specification as appropriate.

[0190] Implementation 3

[0191] In this embodiment, the configuration of a data processing device according to one embodiment of the present invention will be described with reference to the drawings.

[0192] Fig.14A1 , Fig.14A2 , Fig.14B1 and Figure 14B2 This is a diagram for explaining a state in which the data processing device 100 according to one embodiment of the present invention is held by a user. Fig.14A1 1 is a diagram illustrating the appearance of the data processing device 100 when it is held by a user. Fig.14A2 yes Fig.14A1 The distribution diagram of the palm or fingers holding the data processing device 100 detected by the proximity sensor of the position input unit 140 is shown. Note that Fig.17A The case where the position input unit 140 (A), the position input unit 140 (B), and the position input unit 140 (C) are used is shown. This case can be applied to Fig.14A2 The situation shown.

[0193] Fig.14B1 The solid line is a schematic diagram showing the result of edge detection processing of the first position data L-INF(1) detected by the first area 140(1) of the position input unit 140 and the second position data L-INF(2) detected by the second area 140(2) of the position input unit 140. Figure 14B2 FIG. 2 is a schematic diagram showing the result of labeling the first position data L-INF(1) and the second position data L-INF(2) in a hatched pattern.

[0194] Fig.16A and Fig. 16B This is a flowchart for explaining a program executed by the calculation unit 111 in the data processing device according to one embodiment of the present invention.

[0195] <Configuration Example of Data Processing Device>

[0196] The data processing device described herein is the data processing device 100 described in Embodiment 1, in which the first region 140(1) supplies the first position data L-INF(1), the second region 140(2) supplies the second position data L-INF(2) (see FIG. 14A2), and the operation unit 111 generates the image data VIDEO displayed on the display unit 130 overlapping with the third region 140(3) based on the result of comparing the first position data L-INF(1) with the second position data L-INF(2) (see FIG. 14A2). Figure 1 , FIG. 2A to FIG. 2E , Fig.10A1 Figure 10A2 Fig. 10B as well as Fig.14A1 , Fig.14A2 , Fig.14B1 and Figure 14B2 ).

[0197] Hereinafter, description will be given of the components constituting the data processing device 100. Note that the above-mentioned components cannot be clearly separated, and one component may also serve as another component or include a part of another component.

[0198] For example, a touch screen in which a touch sensor is overlapped on the display portion is provided on the display portion 130 and provided on the position input portion 140 .

[0199] The data processing device 100 is different from the data processing device described in Embodiment 1 in that the first area of ​​the position input unit 140 supplies the first position data, and the second area of ​​the position input unit 140 supplies the second position data, and an image displayed on the display unit 130 is generated based on the result of comparing the first position data and the second position data. Here, the different structures are described in detail, and the above description is used for other similar structures.

[0200] 《Position Input Department》

[0201] The position input unit 140 has flexibility sufficient to be bent to form a first region 140(1), a second region 140(2) opposite to the first region 140(1), and a third region 140(3) between the first region 140(1) and the second region 140(2) overlapping the display unit 130 (see Figure 2B ).

[0202] exist Fig.14A1 , the data processing device 100 is shown in a state where it is held by a user. Fig.14A2 2 shows a diagram in which the distribution of the palm or fingers holding the data processing device 100 detected by the proximity sensor of the position input unit 140 is superimposed on the position input unit 140 in the expanded state.

[0203] The first area 140(1) and the second area 140(2) of the data processing device 100 held by the user detect a part of the palm or a part of the finger of the user. For example, the first area 140(1) supplies first position data L-INF(1) including position data of the contact of a part of the index finger, the middle finger, and the ring finger, and the second area 140(2) supplies second position data L-INF(2) including position data of the contact of the base of the thumb (near the ball of the thumb). Note that the third area 140(3) supplies position data of the contact position of the thumb.

[0204] Display Department

[0205] The display unit 130 overlaps with the third area 140 (3) (see Fig.14A1 and Fig.14A2 ). The display unit 130 is supplied with the image data VIDEO and displays the image data VIDEO. For example, the image data VIDEO including an image for operating the data processing device 100 can be displayed. The user of the data processing device 100 can input data for selecting the position of the image by touching the third area 140(3) superimposed on the image with the thumb.

[0206] For example, Fig. 17B As shown in FIG. 1 , when operating with the right hand, a keyboard 131 or icons, etc. are displayed on the right side. Fig. 17C As shown, when operating with the left hand, the keyboard 131 and icons are displayed on the left side. Thus, the operation can be facilitated by using fingers.

[0207] Note that the display screen can be switched by detecting the inclination of the data processing device 100 by detecting the acceleration in the detection unit 150. Fig.18A As shown, when held with the left hand and viewed from the direction of arrow 152, as shown in FIG. Fig. 18C As shown in FIG. 1 , the data processing device 100 is in a state of tilting to the right. Here, by detecting the tilt, as shown in FIG. Fig. 17C As shown in FIG. 1 , a screen for the left hand is displayed, and the keyboard 131 for the left hand is operated. Fig.18B When held in the right hand and viewed from the direction of arrow 152, as shown Fig.18D As shown in FIG. 1 , the data processing device 100 is in a state of being tilted to the left. Here, by detecting the tilt, as shown in FIG. Fig. 17B As shown, the right-hand screen is displayed, and the keyboard 131 for the right hand is operated. In this way, the display position of the keyboard and icons can also be controlled.

[0208] Note that the method of detecting the tilt of the data processing device 100 and the method of detecting the tilt of the data processing device 100 in FIG. 14A1 and FIG. 14B may be combined. Fig.14A2 , Fig.14B1 and Figure 14B2 Alternatively, the user of the data processing device 100 may switch between the right-hand operation screen and the left-hand operation screen without detecting any information.

[0209] 《Operation Department》

[0210] The operation unit 111 is supplied with the first position data L-INF(1) and the second position data L-INF(2), and generates image data VIDEO to be displayed on the display unit 130 based on a result of comparing the first position data L-INF(1) with the second position data L-INF(2).

[0211] <Configuration Example of Data Processing Device>

[0212] The data processing device described here is different from the data processing device in Embodiment 1 or the above description in that the storage unit stores a program including the following seven steps executed by the operation unit 111 (see Fig.16A ) The following describes different processing in detail, and the above description is used as part of other similar processing.

[0213] 《Program Example》

[0214] In the first step, the length of the first line segment is determined based on the first position data L-INF (1) provided by the first area 140 (1). Fig.16A (S1) in.

[0215] In the second step, the length of the second line segment is determined based on the second position data L-INF (2) provided by the second area 140 (2) (refer to Fig.16A (S2) in.

[0216] In the third step, the length of the first line segment and the length of the second line segment are compared with the predetermined length. If only one of them is longer than the predetermined length, the process proceeds to the fourth step. Otherwise, the process proceeds to the first step (see Fig.16A (S3) in the figure). Note that the predetermined length is preferably set to be greater than 2 cm and less than 15 cm, and particularly preferably greater than 5 cm and less than 10 cm.

[0217] In the fourth step, the coordinates of the midpoint of the line segment longer than the predetermined length are determined (refer to Fig.16A (S4) in.

[0218] In the fifth step, it is confirmed whether "tap" or "slide" is performed in the area where the coordinates of the midpoint are not determined in the first area 140 ( 1 ) and the second area 140 ( 2 ) ( FIG. 16A ( S5 )).

[0219] In the sixth step, image data VIDEO (see FIG. 1 ) displayed on the display unit 130 overlapping the third area 140 (3) is generated based on the coordinates of the midpoint or the presence or absence of the tap or slide confirmed in the fifth step. Fig.16A (S6) in.

[0220] In the seventh step, the program ends (see Fig.16A (S7) in.

[0221] The data processing device 100 described herein includes a flexible position input unit 140 capable of supplying position data L-INF by detecting an object approaching or in contact with the flexible position input unit 140, and a computing unit 111. The flexible position input unit 140 can be bent to form a first region 140(1), a second region 140(2) opposite to the first region 140(1), and a third region 140(3) overlapping the display unit 130 between the first region 140(1) and the second region 140(2). The computing unit 111 can generate image data VIDEO to be displayed on the display unit 130 by comparing the first position data L-INF(1) supplied from the first region 140(1) with the second position data L-INF(2) supplied from the second region 140(2).

[0222] Thus, for example, it is possible to determine whether a palm or finger is close to or in contact with the first area 140 (1) or the second area 140 (2), and to determine whether the operation is performed with one hand or both hands, thereby generating image data VIDEO including an image configured in a manner that is easy to operate (e.g., an image for operation). As a result, a human-machine interface with good operability can be provided. In addition, a novel data processing device with good operability can be provided.

[0223] Note that the step of displaying predetermined image data VIDEO (also referred to as an initial image) on the display unit 130 before the first step may be included. Thus, when the length of the first line segment or the second line end is longer or shorter than the predetermined length, the predetermined image data VIDEO can be displayed.

[0224] Hereinafter, each process executed by the calculation unit using the program will be described. Note that the above-mentioned processes cannot be clearly separated, and one process may also serve as another process or include a part of another process.

[0225] 《Method for determining the midpoint of a line segment》

[0226] Hereinafter, a method of determining the length of a first line segment based on first position data L-INF(1) and a method of determining the length of a second line segment based on second position data L-INF(2) will be described. In addition, a method of determining the midpoint of a line segment will be described.

[0227] Specifically, an edge detection method for determining the length of a line segment will be described.

[0228] Note that although the case where an imaging element is used as the proximity sensor is described as an example, a capacitor or the like may also be used as the proximity sensor.

[0229] Set the value of the image pixel at the coordinate (x, y) to f (x,y) In particular, the value detected by the camera pixel minus the background value is used for f (x,y) This is preferable because it can remove noise.

[0230] 《How to extract edges (contours)》

[0231] The sum of the differences Δ between the value obtained by the image pixel at the coordinate (x, y) and the values ​​obtained by the image pixels at the coordinates (x-1, y), (x+1, y), (x, y-1), and (x, y+1) adjacent to the coordinate (x, y) is expressed by the following equation (1): (x,y) .

[0232] [Formula 1]

[0233] Δ (x,y) =4·f (x,y) -{f (x,y-1) +f (x,y+1) +f (x-1,y) +f (x+1,y)}

[0234] Fig.14A2 The values ​​detected by the imaging pixels located in the first region 140 ( 1 ) and the second region 140 ( 2 ) are shown. Fig.14B1 The calculated Δ (x,y) Thus, by using Δ (x,y) , the edge (contour) of the finger or palm that is close to or in contact with the first area 140 (1) and the second area 140 (2) can be extracted to the first area 140 (1) and the second area 140 (2).

[0235] 《How to determine the length of a line segment》

[0236] The coordinates where the contour extracted by the first area 140 (1) intersects with the predetermined line segment W1 are determined, and the predetermined line segment W1 is cut at the intersection to divide it into multiple line segments. The longest line segment among the multiple line segments is regarded as the first line segment. Note that this length is set to the length L1 (refer to Fig.14B1 ).

[0237] The coordinates where the contour extracted by the second area 140 (2) intersects with the predetermined line segment W2 are determined, and the predetermined line segment W2 is cut at the intersection to divide it into multiple line segments. The longest line segment among the multiple line segments is regarded as the second line segment. Note that this length is set as the length L2.

[0238] Method for determining the midpoint

[0239] The length L1 of the first line segment is compared with the length L2 of the second line segment, the longer one is selected, and the coordinates of the midpoint M are calculated. In the present embodiment, the length L2 is longer than the length L1. Therefore, the coordinates of the midpoint M of the second line segment are determined.

[0240] 《Image data generated based on the coordinates of the midpoint》

[0241] The coordinates of the midpoint M can be associated with the position of the base of the thumb (near the ball of the thumb) or the movable range of the thumb, etc. Thus, based on the coordinates of the midpoint M, image data that facilitates the operation of the data processing device 100 can be generated.

[0242] For example, image data VIDEO including an image for operation located in the movable range of the thumb and superimposed on the third area 140 (3) of the display unit 130 may be generated. Specifically, the image for operation (shown as a circle) may be configured in an arc shape centered near the midpoint M (see Fig.14A1 ). In addition, the images used for operation with high frequency can be arranged in an arc shape, and the images with low frequency can be arranged inside or outside the arc. As a result, a human-machine interface with good operability can be provided. In addition, a novel data processing device with good operability can be provided.

[0243] In addition, in the area where the midpoint M is not calculated in the first area 140 (1) and the second area 140 (2), when a tapping, sliding, or other action is detected, it can be determined that the user is using the data processing device 100 with both hands, and a predetermined process such as displaying image data VIDEO different from the above can be performed. For example, when a tapping, sliding, or other action is detected in the second area 140 (2) while the midpoint M is calculated in the first area 140 (1), it can be determined that the user is using the data processing device 100 with both hands, and a predetermined image can be displayed on the display unit 130.

[0244] Furthermore, in the area where the midpoint M is not calculated in the first area 140(1) and the second area 140(2), when an action such as tapping or sliding is detected, it is not necessary to determine that the data processing device is being used with both hands and execute a predetermined process. For example, a predetermined program may be executed, an image may be displayed or not displayed, and a power source may be turned on or off.

[0245] <Structure of Data Processing Device>

[0246] The data processing device described here is different from the data processing device in Embodiment 1 or the above description in that the storage unit has a program including the following six steps to be executed by the operation unit 111, and the six steps use the area of ​​the first figure and the area of ​​the second figure instead of the length of the first line segment and the length of the second line segment (see Fig. 16B ) The following describes different processing in detail, and the above description is used for the same processing.

[0247] 《Program Example》

[0248] In the first step, the area of ​​the first figure is determined based on the first position data L-INF (1) provided by the first area 140 (1). Fig. 16B (T1) in the figure.

[0249] In the second step, the area of ​​the second figure is determined based on the second position data L-INF (2) provided by the second area 140 (2) (refer to Fig. 16B (T2) in the figure.

[0250] In the third step, the area of ​​the first figure and the area of ​​the second figure are compared with the predetermined area. If only the area of ​​the first figure or the second figure is larger than the predetermined area, the program proceeds to the fourth step. Otherwise, the program proceeds to the first step (see Fig. 16B Note that the predetermined area is preferably set to 1 cm 2 Over and 8cm 2 Below, particularly preferably 3cm 2 More than 5cm 2 the following.

[0251] In the fourth step, the centroid coordinates of a figure having a larger area than a predetermined area are determined (see (T4) in FIG. 16B ).

[0252] In the fifth step, it is confirmed whether a tap or a slide is performed in the area where the center of gravity coordinates are not determined in the first area 140 (1) and the second area 140 (2) (refer to Fig.16A (T5)).

[0253] In the sixth step, image data VIDEO (see FIG. 1 ) displayed on the display unit 130 overlapping the third area is generated based on the centroid coordinates or the presence or absence of the tap or slide confirmed in the fifth step. Fig. 16B (T6) in the figure).

[0254] In the seventh step, the program ends (see Fig. 16B (T7) in the figure).

[0255] Hereinafter, each process executed by the calculation unit using the program will be described. Note that the above-mentioned processes cannot be clearly separated, and one process may also serve as another process or include a part of another process.

[0256] 《Method for determining the center of an area》

[0257] Hereinafter, a method of determining the area of ​​a first figure based on the first position data L-INF(1) and a method of determining the area of ​​a second figure based on the second position data L-INF(2) will be described. In addition, a method of determining the center of gravity of a figure will be described.

[0258] Specifically, the labeling process for determining the area of ​​a graphic will be described.

[0259] Note that although the case where an imaging element is used as the proximity sensor is described as an example, a capacitor or the like may also be used as the proximity sensor.

[0260] Assume that the value of the image pixel at the coordinate (x, y) is f (x,y) In particular, the value detected by the camera pixel minus the background value is used for f (x,y) This is preferable because it can remove noise.

[0261] Marking Processing

[0262] When an imaging pixel included in the first area 140 ( 1 ) or the second area 140 ( 2 ) and an imaging pixel adjacent to the imaging pixel have an f value exceeding a predetermined threshold value, (x,y) In the case of , the area occupied by these camera pixels is regarded as a graph. Note that when f (x,y) When the value of may be 256, for example, the predetermined threshold is preferably set to be greater than or equal to 0 and less than or equal to 150, and particularly preferably greater than or equal to 0 and less than or equal to 50.

[0263] The above processing is performed on all the camera pixels located in the first area 140 (1) and the second area 140 (2) and the imaging result is as follows: Fig.14A2 or Figure 14B2 As shown, the area adjacent to the camera image exceeding the predetermined threshold is obtained. The largest figure among the figures in the first area 140 (1) is regarded as the first figure. The largest figure among the figures in the second area 140 (2) is regarded as the second figure.

[0264] Method for determining the center of gravity of a figure

[0265] Compare the area of ​​the first image and the area of ​​the second image, select the larger one, and calculate the center of gravity. The coordinates C of the center of gravity can be calculated using the following formula (2): (X,Y) .

[0266] [Formula 2]

[0267]

[0268] In equation 2, (x, y) represents the coordinates of n imaging pixels constituting one figure. In addition, the area of ​​the second figure is larger than the area of ​​the first figure. Thus, the centroid coordinates C of the second figure are determined.

[0269] 《Image data generated from barycentric coordinates》

[0270] The centroid coordinates C can be associated with the position of the base of the thumb (near the ball of the thumb) or the movable range of the thumb, etc. Thus, based on the centroid coordinates C, image data that facilitates the operation of the data processing device 100 can be generated.

[0271] In addition, in the area where the center of gravity C is not calculated in the first area 140(1) and the second area 140(2), when actions such as tapping and sliding are detected, it can also be determined that the user is using the data processing device 100 with both hands, and image data VIDEO different from the above can be displayed.

[0272] In the area where the center of gravity C is not calculated in the first area 140 (1) and the second area 140 (2), when an action such as tapping or sliding is detected, operations other than displaying the image data VIDEO can be performed. For example, a predetermined program can be executed, an image can be displayed or not displayed, and a power source can be turned on or off.

[0273] In addition, when the data processing device 100 has a position input unit 140 on the front and back sides, by lightly pressing the position input units 140 on the front and back sides simultaneously, for example, a predetermined program can be executed, an image can be displayed or not displayed, and a power supply can be turned on or off (see Fig.19A ). In addition, by sliding the front and back positions of the input unit 140 at the same time, for example, a predetermined program can be executed, an image can be displayed or not displayed, and a power source can be turned on or off (see FIG. 19B ). This can prevent malfunctions in unexpected situations.

[0274] Note that this embodiment mode can be combined with other embodiment modes described in this specification as appropriate.

[0275] Implementation 4

[0276] In this embodiment, the configuration of a data processing device according to one embodiment of the present invention will be described with reference to the drawings.

[0277] Fig.15A and Fig. 15B This is a diagram for explaining a state in which a data processing device 100B according to one embodiment of the present invention is held by a user. Fig.15A 1 is a diagram for explaining a state in which the data processing device 100B is folded and held by a user. Fig. 15B It is explained that Fig.15A The distribution diagram of the palm or fingers detected by the data processing device 100B in the state shown. Note that the range of the palm or fingers is shown together with the expanded position input unit 140B.

[0278] Fig. 20This is a flowchart for explaining a program executed by the calculation unit 111 in the data processing device 100B according to one embodiment of the present invention.

[0279] FIG. 21A to FIG. 21C The following is an explanation of an example of an image displayed on the display unit 130 of the data processing device 100B according to one embodiment of the present invention.

[0280] Fig. 22 This is a flowchart for explaining a program executed by the calculation unit 111 in the data processing device 100B according to one embodiment of the present invention.

[0281] <Configuration Example of Data Processing Device>

[0282] In the data processing device described here, the first area 140B(1) of the position input unit 140B supplies the first position data L-INF(1), and the second area 140B(2) supplies the second position data L-INF(2) (see Fig. 15B The detection unit 150 supplies the detection data SENS including the folding data, and the operation unit 111 generates the image data VIDEO (refer to FIG. 1 ) displayed on the display unit 130 based on the result of comparing the first position data L-INF(1) with the second position data L-INF(2) and the detection data SENS including the folding data. Fig.11 , FIG. 12A to FIG. 12C as well as Fig.15A and Fig. 15B ).

[0283] Hereinafter, each component constituting the data processing device 100B will be described. Note that the above-mentioned components cannot be clearly separated, and one component may also serve as another component or include a part of another component.

[0284] For example, a touch screen in which a touch sensor is overlapped on the display section is provided in the display section 130 and is provided in the position input section 140B.

[0285] The data processing device 100B is different from the data processing device described in Embodiment 2 in that the first area 140B(1) of the position input unit 140B supplies the first position data and the second area 140B(2) of the position input unit 140B supplies the second position data, and an image displayed on the display unit 130 is generated based on the result of comparing the first position data and the second position data. Here, the different structures are described in detail, and the above description is used for other similar structures.

[0286] 《Position Input Department》

[0287] The position input unit 140B has flexibility that enables it to be unfolded or folded to form a first area 140B(1), a second area 140B(2) opposite to the first area 140B(1), and a third area 140B(3) between the first area 140B(1) and the second area 140B(2) and overlapping with the display unit 130B (see FIG. 12A to FIG. 12C ).

[0288] The first area 140B(1) and the second area 140B(2) detect a part of the palm or a part of the finger of the user that is approached or in contact with the palm or finger of the user. For example, the first area 140B(1) supplies first position data L-INF(1) including position data of the contact of a part of the index finger, the middle finger, and the ring finger, and the second area 140B(2) supplies second position data L-INF(2) including position data of the contact of the base of the thumb (near the ball of the thumb). Note that the third area 140B(3) supplies position data of the contact of the thumb.

[0289] Display Department

[0290] The display unit 130 is provided at a position overlapping with the third area 140B(3) (see Fig.15A and Fig. 15B ). The display unit 130 is supplied with image data VIDEO, and can display, for example, an image for operating the data processing device 100B. The user of the data processing device 100B can input position data for selecting the image by touching the third area 140B(3) superimposed on the image with his thumb.

[0291] 《Operation Department》

[0292] The operation unit 111 is supplied with the first position data L-INF(1) and the second position data L-INF(2), and generates image data VIDEO to be displayed on the display unit 130 based on a result of comparing the first position data L-INF(1) with the second position data L-INF(2).

[0293] <Configuration Example of Data Processing Device>

[0294] The data processing device described here is different from the data processing device in Embodiment 2 or the above description in that the storage unit stores a program including the following nine steps executed by the operation unit 111 (see Fig. 20 ) The following describes different processing in detail, and the above description is used as part of other similar processing.

[0295] 《Program Example》

[0296] In the first step, the length of the first line segment is determined according to the first position data provided by the first area ( Fig. 20 (U1) in the figure.

[0297] In the second step, the length of the second line segment is determined according to the second position data provided by the second area ( Fig. 20 (U2) in the figure.

[0298] In the third step, the length of the first line segment and the length of the second line segment are compared with the predetermined length. If only one of the first line segment and the second line segment is longer than the predetermined length, the program proceeds to the fourth step. Otherwise, the program proceeds to the first step ( Fig. 20 (U3) in the figure). Note that the predetermined length is preferably set to be greater than or equal to 2 cm and less than or equal to 15 cm, and particularly preferably greater than or equal to 5 cm and less than or equal to 10 cm.

[0299] In the fourth step, the coordinates of the midpoint of the line segment longer than the predetermined length are determined ( Fig. 20 (U4) in the figure.

[0300] In the fifth step, it is confirmed whether a “tap” or “slide” is performed in the area where the coordinates of the midpoint are not determined in the first area 140 (1) and the second area 140 (2) (refer to Fig. 20 (U5) in the figure.

[0301] In the sixth step, the folding data of the data processing device 100B is obtained, and when the folding data shows the folded state, the seventh step ( Fig. 20 (U6) in the figure.

[0302] In the seventh step, first image data displayed on the display unit 130 overlapping the third area is generated based on the coordinates of the midpoint or the presence or absence of the tap or slide confirmed in the fifth step ((U7) in FIG. 20).

[0303] In the sixth step, the folding data of the data processing device 100B is obtained, and when the folding data shows the folded state, the eighth step ( Fig. 20 (U5) in the figure.

[0304] In the eighth step, second image data (i) displayed on the display portion overlapping the third area is generated based on the coordinates of the midpoint or the presence or absence of the tap or slide confirmed in the fifth step. Fig. 20 (U8) in the.

[0305] In the ninth step, the program is terminated (see Fig. 20 (U9) in the figure.

[0306] The data processing device 100B described here includes a flexible position input unit 140B capable of supplying position data L-INF by detecting an object approaching or in contact with the flexible position input unit 140B, a detection unit 150 including a folding sensor 151 capable of detecting whether the flexible position input unit 140B is in a folded state or an unfolded state, and a computing unit 111 (see Fig.11 The flexible position input unit 140B may be bent to form a first region 140B(1), a second region 140B(2) in a folded state and opposite to the first region 140B(1), and a third region 140B(3) overlapping the display unit 130 between the first region 140B(1) and the second region 140B(2), and the operation unit 111 may generate image data VIDEO displayed on the display unit 130 according to the folded state by comparing the first position data L-INF(1) supplied from the first region 140B(1) with the second position data L-INF(2) supplied from the second region 140B(2).

[0307] Thus, for example, it is possible to determine whether a palm or finger is close to or in contact with the first area 140B (1) or the second area 140B (2) and whether the data processing device is operated with one hand or two hands, and generate image data VIDEO, which includes a first image (for example, an image configured for operation) configured in a manner that is easy to operate when the position input unit 140B is in a folded state or a second image configured in a manner that is easy to operate when the position input unit 140B is in an unfolded state. As a result, a human-machine interface with good operability can be provided. In addition, a novel data processing device with good operability can be provided.

[0308] The data processing device 100B described here may include a step of causing the calculation unit 111 to generate predetermined image data VIDEO and display it on the display unit 130 before executing the first step. Thus, in the third step, when the length of the first line segment or the second line segment is longer or shorter than the predetermined length, the predetermined image data VIDEO can be displayed.

[0309] Hereinafter, each process executed by the calculation unit using the program will be described. Note that the above-mentioned processes cannot be clearly separated, and one process may also serve as another process or include a part of another process.

[0310] The program executed by the computing unit 111 of the data processing device 100B is different from the program executed by the computing unit of the data processing device described in Embodiment 3 in that, in the fifth step, the processing thereof diverges according to the folding state of the position input unit 140B. Here, the different processing is described in detail, and the above description is cited for other similar processing.

[0311] <<Processing for Generating First Image Data>>

[0312] When the acquired folded data indicates the folded state, the operation unit 111 generates the first image data. For example, similar to the fifth step in the program executed by the operation unit 111 of the data processing device 100 described in Embodiment 3, the first image data VIDEO displayed on the display unit 130 overlapping the third area 140B (3) in the folded state is generated based on the coordinates of the midpoint or the presence or absence of the tap or slide confirmed in the fifth step.

[0313] The coordinates of the midpoint M can be associated with the position of the base of the thumb (near the ball of the thumb) or the movable range of the thumb. In the area where the midpoint M is not calculated in the first area 140(1) and the second area 140(2), if no tapping, sliding, or other actions are detected, it can be determined that the user is using the data processing device 100 with one hand, and image data that facilitates the operation of the folded data processing device 100B can be generated based on the coordinates of the midpoint M.

[0314] For example, the first image data VIDEO for one-hand operation can be generated, in which the image for operation is located in the movable range of the thumb and overlaps the display unit 130 in the third area 140B (3). Specifically, the image for operation (shown as a circle) can be arranged in an arc shape centered near the midpoint M (see Fig.21A ). In addition, the images used for operation with high frequency can be arranged in an arc shape, and the images with low frequency of use can be arranged inside or outside the arc. As a result, a human-machine interface with good operability can be provided in the folded data processing device 100B. In addition, a novel data processing device with good operability can be provided.

[0315] Furthermore, in the area where the midpoint M is not calculated in the first area 140(1) and the second area 140(2), when an action such as tapping or sliding is detected, it can be determined that the user is using the data processing device 100 with both hands, and the first image data VIDEO for two-hand operation is displayed. Note that the first image data VIDEO for one-hand operation and the first image data VIDEO for two-hand operation may be the same image data VIDEO.

[0316] Furthermore, in the area where the midpoint M is not calculated in the first area 140(1) and the second area 140(2), when an action such as tapping or sliding is detected, operations other than displaying the image data VIDEO may be performed. For example, a predetermined program may be executed, an image may be displayed or not displayed, and a power source may be turned on or off.

[0317] <<Processing for Generating Second Image Data>>

[0318] When the acquired folded data shows the unfolded state, the computing unit 111 generates the second image data. For example, similar to the fifth step in the program executed by the computing unit 111 of the data processing device 100 described in Embodiment 3, the first image data VIDEO displayed on the display unit 130 overlapping the third area 140B (3) in the folded state is generated based on the coordinates of the midpoint or the presence or absence of the tap or slide confirmed in the fifth step. The coordinates of the midpoint M can be associated with the position of the base of the thumb (near the ball of the thumb) or the movable range of the thumb.

[0319] For example, the second image data VIDEO including an image for operation that is not arranged in an area overlapping with the movable range of the thumb can be generated. For example, in the area where the midpoint M is not calculated in the first area 140(1) and the second area 140(2), if no action such as tapping or sliding is detected, it can be determined that the user is using the data processing device 100 with one hand, and the image for operation (shown as a circle) can be arranged outside the arc centered near the midpoint M (see FIG. 1 ). Figures 21A to 21C ). In addition, the data processing device 100B may be driven in such a manner that the position input unit 140B detects an area outside the arc or an object close to or in contact with the arc and supplies position data.

[0320] Thus, the data processing device 100B can be supported by holding the arc of the position input unit 140B in the unfolded state and the area inside it with one hand. In addition, the image for operation displayed outside the arc can be operated with the other hand. As a result, in the unfolded data processing device 100B, a human-machine interface with good operability can be provided. In addition, a novel data processing device with good operability can be provided.

[0321] In addition, in the area where the midpoint M is not calculated in the first area 140 (1) and the second area 140 (2), when an action such as tapping or sliding is detected (see Fig.21A and Fig.21B ), it can be determined that the user uses the data processing device 100 with both hands, and the second image data VIDEO for two-hand operation is displayed. Note that the first image data VIDEO for one-hand operation and the second image data VIDEO for two-hand operation can also be the same image data VIDEO.

[0322] Furthermore, in the area where the midpoint M is not calculated in the first area 140(1) and the second area 140(2), when an action such as tapping or sliding is detected, operations other than displaying the image data VIDEO may be performed. For example, a predetermined program may be executed, an image may be displayed or not displayed, and a power source may be turned on or off.

[0323] <Configuration Example of Data Processing Device>

[0324] The data processing device described here is different from the data processing device in Embodiment 2 or the above description in that the storage unit stores a program including the following seven steps executed by the operation unit 111, and the seven steps use the area of ​​the first figure and the area of ​​the second figure instead of the length of the first line segment and the length of the second line segment (see Fig. 22 ). The following describes the different processes in detail, and the above description is used for other similar processes.

[0325] 《Program Example》

[0326] In the first step, the area of ​​the first figure is determined based on the first position data supplied from the first area 140B (1) (refer to Fig. 22 (V1) in the figure.

[0327] In the second step, the area of ​​the second figure is determined based on the second position data supplied from the second area 140B(2) (refer to Fig. 22 (V2) in.

[0328] In the third step, the area of ​​the first figure and the area of ​​the second figure are compared with the predetermined area. If only the area of ​​the first figure or the second figure is larger than the predetermined area, the program proceeds to the fourth step. Otherwise, the program proceeds to the first step (see Fig. 22 Note that the predetermined area is preferably set to 1 cm 2 Over and 8cm 2 Below, particularly preferably 3cm 2 More than 5cm 2 the following.

[0329] In the fourth step, the centroid coordinates of an area larger than a predetermined area are determined (see (V4) in FIG. 22 ).

[0330] In the fifth step, the folding data of the data processing device 100B is obtained, and when the folding data shows the folded state, the sixth step is entered (see Fig. 22 (V5) in.

[0331] In the sixth step, it is confirmed whether a tap or slide is performed in the area where the coordinates of the midpoint are not determined in the first area 140 (1) and the second area 140 (2) (refer to Fig. 22 (V6) in.

[0332] In the seventh step, first image data (see FIG. 1 ) displayed on the display unit 130 overlapping the third area is generated based on the centroid coordinates or the presence or absence of the tap or slide confirmed in the sixth step. Fig. 22 (V7) in.

[0333] In the fifth step, the folding data of the data processing device 100B is obtained, and when the folding data shows the folded state, the eighth step is entered (see Fig. 22 (V5) in the.

[0334] In the eighth step, second image data (see FIG. 1 ) displayed on the display portion overlapping the third region is generated based on the barycentric coordinates. Fig. 22 in (V8).

[0335] In the ninth step, the program is terminated (see Fig. 22 (V9) in.

[0336] Note that this embodiment mode can be combined with other embodiment modes described in this specification as appropriate.

[0337] Implementation method 5

[0338] In this embodiment, an operation example of a data processing device that can be applied to one embodiment of the present invention is described with reference to the drawings.

[0339] When the user holds the data processing device 100, a specific area of ​​the position input unit 140 is continuously touched for a long time. In the display unit 130, by not displaying the area overlapping with the touched area, or not rewriting the area overlapping with the touched area, the power consumption of the data processing device 100 can be suppressed. Note that since the touched area becomes a blind spot, the visibility of the displayed image does not decrease even if the display of the area overlapping with the area is stopped. Here, for example, the area that stops displaying can also be smaller than the touched area. By making the area smaller than the touched area, it looks like the display is still being performed even if the finger holding the data processing device moves slightly.

[0340] In addition to the touched area, a non-display area and a non-rewrite area may be provided in the display unit 130. For example, when the user holds the data processing device 100, there may be an area near the touched area where the user cannot read the display even if the area is not actually touched. In such an area, a non-display area and a non-rewrite area may also be provided.

[0341] As an example of this case, a case where the display unit 130 is touched with a palm can be cited. When the display unit 130 is touched with a palm, the entire palm is not necessarily touched. However, even if there is an area that is not touched with the palm, the user may not be able to browse the area due to the obstruction of the palm. Therefore, it is not necessary to display or rewrite in such an area.

[0342] Here, "not displaying" and "not rewriting" mean that new image signals and charges are not supplied to the pixels possessed by the display unit 130. Furthermore, it means that light is not supplied from an illumination device such as a backlight or a frontlight. For example, when a light-emitting element is used for a pixel, an area where an image signal is not supplied sometimes displays black. In addition, when a display element (such as a liquid crystal element) that is not a light-emitting element is used for a pixel, white or black is displayed depending on the pixel structure. In addition, when a liquid crystal element is used for a pixel, an image before the supply of the image signal is stopped is sometimes continuously displayed. For example, when a transistor having an oxide semiconductor is used for a channel portion, the same display is sometimes continuously displayed because the off-state current of the transistor is extremely small. In addition, when a liquid crystal element is used for a pixel, an area where illumination light from the backlight is not supplied is sometimes displayed black.

[0343] When the user holds data processing device 100 with a hand or the like, it is possible to determine which area is being held by the hand by various methods.

[0344] For example, as described in the above embodiment, edge detection processing is performed based on the first position data L-INF(1) detected by the first area 140(1) of the position input unit 140 and the second position data L-INF(2) detected by the second area 140(2). When the operation unit 111 determines that the area and the centroid coordinates of the area surrounded by the edge have not changed for a certain period of time, the display of the display unit 130 overlapping with the area is stopped. Alternatively, the rewriting of the display image of the part of the display unit 130 overlapping with the area is stopped. In addition, the third position data L-INF(3) detected by the third area 140(3) can also be used to perform the same processing. In addition, when the data processing device 100 has a fourth area 140(4) and a fifth area 140(5), etc., the fourth position data L-INF(4) detected by the fourth area 140(4) or the fifth position data L-INF(5) detected by the fifth area 140(5) can also be used to perform the same processing.

[0345] Alternatively, all touched areas may be simply detected, or an area that is judged to be continuously touched for a certain period of time or longer may be judged as an area held by a hand, etc. Alternatively, it may be judged by using other sensors, such as an acceleration sensor, a light sensor, and an infrared sensor, etc. In this way, the area held by a hand may be judged by using various methods or by combining various methods.

[0346] For example, Fig.32A As shown in FIG. 1 , area A that has been touched by hand or the like for a certain period of time does not react. Also, area B does not react because it is not in contact with any object. Next, as shown in FIG. Fig.32B As shown, when a finger or the like contacts area B, area B reacts but area A does not react. In this way, the data processing device 100 can be operated.

[0347] 《Program Example》

[0348] Reference Fig.23 An example of a program that causes the operation unit 111 to execute a process of not displaying an area that overlaps with an area that has been touched for a certain period of time will be described. The data processing device described here includes a storage unit that stores a program that causes the operation unit 111 to execute the following eight steps. Note that the data processing device can appropriately use the data processing device described in the above embodiment, etc.

[0349] In the first step, based on the first position data L-INF(1) to the fourth position data L-INF(4), etc., the touched area a1 (refer to Fig.23 (R1)).

[0350] In the second step, the area and centroid coordinates of region a1 are calculated (refer to Fig.23 (R2)).

[0351] In the third step, the data processing device is in a standby state for a certain period of time (refer to Fig.23 (R3)). Note that the standby time is preferably 1 second or longer and shorter than 30 seconds, and more preferably 1 second or longer and shorter than 15 seconds. When the standby time is too long, the display unit 130 overlapping with the area a1 may not be displayed even after the gripping position is changed or gripping is stopped, which may easily reduce the display quality of the data processing device 100.

[0352] In the fourth step, the touched area a2 (see FIG. 1 ) on the designated position input unit 140 is determined based on the first position data L-INF(1) to the fourth position data L-INF(4). Fig.23 (R4)).

[0353] In the fifth step, the area and centroid coordinates of region a2 are calculated (refer to Fig.23 (R5)).

[0354] In the sixth step, it is determined whether the area and the centroid coordinates of the region a1 and the region a2 are greatly different (refer to Fig.23 (R6)).

[0355] If at least one of the area and the centroid coordinates of the region a1 and the region a2 is not much different, the seventh step (see Fig.23 (R7)).

[0356] In the seventh step, the display of the display unit 130 overlapping the area a1 is stopped. Alternatively, the rewriting of the display image of the display unit 130 overlapping the area a1 is stopped. Then, the process returns to the third step, and the data processing device waits for a certain period of time.

[0357] In the sixth step, when at least one of the area and the centroid coordinates of the region a1 and the region a2 is greatly different, the execution of the program is terminated in the eighth step.

[0358] As described above, the power consumption of the data processing device 100 can be suppressed.

[0359] Note that in the seventh step, although the display of the display unit 130 overlapping with the area a1 or the rewriting of the display image of the display unit 130 overlapping with the area a1 is stopped, one embodiment of the present invention is not limited to this. For example, in the seventh step, when the display of the display unit 130 is stopped or the rewriting of the display image of the display unit 130 is stopped, in addition to the area that has been continuously touched for a certain period of time, the display of the display unit 130 or the rewriting of the display image of the display unit 130 may be stopped in the area near the area. Alternatively, the display of the display unit 130 or the rewriting of the display image of the display unit 130 may be stopped in an area slightly smaller than the area that has been continuously touched for a certain period of time.

[0360] For example, in Figure 2C , Figure 2D ,as well as Figure 2E In the case where any part of the fourth area 140 (4) is touched for a certain period of time, the display of the display unit 130 overlapping with the entire first area 140 (4) is stopped, or the rewriting of the display image is stopped. Similarly, as an example, when any part of the first area 140 (1) is touched for a certain period of time, the display of the area of ​​the display unit 130 overlapping with the entire first area 140 (1) is stopped, or the rewriting of the display image is stopped. For example, the fourth area 140 (4) corresponds to the back side of the data processing device 100, so when the data processing device is held, the fourth area 140 (4) is located in a place that is not easily visible to the user. Therefore, when the user is not looking at the display unit 130, the display or rewriting of the display image in the entire area can be temporarily stopped. However, when the third area 140 (3) is not touched for a certain period of time, for example, the display is resumed. Therefore, the display can be performed only when the user is browsing, and power consumption can be reduced.

[0361] Note that when the user is looking at the fourth area 140(4), the third area 140(3) actually corresponds to the back side of the data processing device 100. Therefore, in this case, for example, as in the case of the fourth area 140(4), the display of the display unit 130 may be stopped or the rewriting of the display image of the display unit 130 may be stopped in the entire third area 140(3).

[0362] Note that at least one of the area for judging whether the touch is continued for a long time, the area for judging whether the user touches the data processing device to hold it, the area for stopping the display of the display unit 130, and the area for stopping the rewriting of the display image of the display unit 130 may be set as a part of the display unit 130. Furthermore, the position of the above-mentioned area, the judgment action or display action performed in the area, etc. may be changed according to the situation. In addition, the user may set and change the position of the above-mentioned area, the judgment action or display action performed in the area, etc.

[0363] For example, in the area corresponding to the front of the data processing device 100, such as the third area 140(3), it is not necessary to determine whether the area is being touched for a long time or whether the user is touching the area to hold the data processing device. In addition, in the above-mentioned area, it is not necessary to stop the display of the display unit 130 or rewrite the display image of the display unit 130. Therefore, even if the user quickly changes the grip of the data processing device 100, the display image can be viewed.

[0364] Furthermore, when determining whether the user is looking at the back or the front of the data processing device 100, an acceleration sensor or a magnetic sensor may be used. By using the data of these sensors, the situation can be determined more accurately.

[0365] In addition, when the user holds the data processing device 100, if the area held is included in the area for determining touch actions, the data processing device 100 cannot correctly determine the touch actions, which causes erroneous operations and reduced operability. In addition, when the user holds the data processing device 100 in an area other than the area for determining touch actions, there is a risk of accidentally dropping the data processing device 100.

[0366] Here, for example, in the position input unit 140, the area that the user touches without intention is excluded from the area for judging the touch action. Also, for example, the area that the user touches in the position input unit 140 in order to hold the data processing device 100 is excluded from the area for judging the touch action. Or, for example, the area that the user cannot touch even if he wants to touch is excluded from the area for judging the touch action. For example, in the position input unit 140, the area that is continuously touched for a certain period of time is excluded from the area for judging the touch action. Thus, good detection accuracy of the touch action can be achieved. And good operability of the data processing device 100 can be achieved.

[0367] As an example of an area that cannot be touched even if the user wants to touch it, the case of touching it with the palm can be cited. When touching it with the palm, it is not limited to touching it with the entire palm. Even if the palm does not touch it, the area cannot be touched by the other hand due to the obstacle of the palm.

[0368] As an example of an area that cannot be touched even if the user wants to touch, there can be cited a case where the intervals between fingers are narrow and the other hand cannot touch the area when multiple fingers are used to touch. Therefore, the area that cannot be touched even if the user wants to touch is excluded from the area for judging the touch action.

[0369] When the user holds the data processing device 100 with a hand or the like, it is possible to determine which area is being held with the hand by various methods.

[0370] For example, as described in the above embodiment, edge detection processing is performed based on the first position data L-INF(1) detected by the first area 140(1) of the position input unit 140 and the second position data L-INF(2) detected by the second area 140(2). When the operation unit 111 determines that the area and the center of gravity coordinates of the area surrounded by the edge have not changed for more than a certain period of time, the area is excluded from the area for determining the touch action. In addition, the third position data L-INF(3) detected by the third area 140(3) can also be used to perform the same processing. In addition, when the data processing device 100 has a fourth area 140(4) and a fifth area 140(5), etc., the fourth position data L-INF(4) detected by the fourth area 140(4) or the fifth position data L-INF(5) detected by the fifth area 140(5) can also be used to perform the same processing.

[0371] Alternatively, all touched areas may be simply detected, or an area that is judged to be continuously touched for a certain period of time or longer may be judged as an area held by a hand, etc. Alternatively, it may be judged by using other sensors such as an acceleration sensor, a light sensor, and an infrared sensor, etc. In this way, it may be judged by using various methods or by combining various methods.

[0372] 《Program Example》

[0373] Reference Fig.24 An example of a program that causes the operation unit 111 to execute a process of excluding an area that has been touched for a certain period of time from an area for determining a touch action is described below. The data processing device described here includes a storage unit that stores a program that causes the operation unit 111 to execute the following eight steps. Note that the data processing device can appropriately use the data processing device described in the above embodiment, etc.

[0374] In the first step, based on the first position data L-INF(1) to the fourth position data L-INF(4), etc., the touched area a1 (refer to Fig.24 (W1)).

[0375] In the second step, the area and centroid coordinates of region a1 are calculated (refer to Fig.24 (W2)).

[0376] In the third step, the data processing device waits for a certain period of time (refer to Fig.24 (W3)). In addition, the standby time is preferably 1 second or longer and shorter than 30 seconds, and more preferably 1 second or longer and shorter than 15 seconds. When the standby time is too long, the display unit 130 overlapping with the area a1 may not be displayed even after the gripping position is changed or gripping is stopped, which may easily reduce the display quality of the data processing device 100.

[0377] In the fourth step, the touched area a2 (see FIG. 1 ) on the designated position input unit 140 is determined based on the first position data L-INF(1) to the fourth position data L-INF(4). Fig.24 (W4)).

[0378] In the fifth step, the area and centroid coordinates of region a2 are calculated (refer to Fig.24 (W5)).

[0379] In the sixth step, it is determined whether the area and the centroid coordinates of the region a1 and the region a2 are greatly different (refer to Fig.24 (W6)).

[0380] If at least one of the area and the centroid coordinates of the region a1 and the region a2 is not much different, the seventh step (see Fig.24 (W7)).

[0381] In the seventh step, the area that is continuously touched for a certain period of time is excluded from the area in the position input unit 140 where the touch action is to be determined.

[0382] In the sixth step, when at least one of the area and the centroid coordinates of the region a1 and the region a2 is greatly different, the execution of the program is terminated in the eighth step.

[0383] As described above, it is possible to achieve good detection accuracy of the touch action of the data processing device 100. In addition, it is possible to achieve good operability of the data processing device 100. In addition, it is not necessary to be careful not to touch the area for determining the touch action, so it is easy to hold the data processing device 100. In addition, it is easy to hold the data processing device 100 with one hand while operating the data processing device 100 with the other hand, so it is easy to operate the data processing device 100 with both hands.

[0384] Note that in the seventh step, although the area that is continuously touched for a certain period of time is excluded from the area for determining touch actions in the position input unit 140, one aspect of the present invention is not limited to this. For example, in the seventh step, when the area that is continuously touched for a certain period of time is excluded from the area for determining touch actions in the position input unit 140, the area near the area that is continuously touched for a certain period of time is also excluded from the area for determining touch actions.

[0385] For example, in Figure 2A and Figure 2B In the case where a portion of the second area 140(2) is touched for a certain period of time, the entire second area 140(2) is excluded from the area for judging the touch action. Similarly, as an example, if a portion of the first area 140(1) is touched for a certain period of time, the entire first area 140(1) is excluded from the area for judging the touch action. The first area 140(1) and the second area 140(2) correspond to the side surfaces of the data processing device 100, and therefore the first area 140(1) and the second area 140(2) are easily touched. Therefore, such areas can be temporarily excluded from the area for judging the touch action. Note that when the first area 140(1) and the second area 140(2) are not touched for a certain period of time, they are restored to the area for judging the touch action. Therefore, the touch action can be used only when the user wants to perform a certain operation.

[0386] In addition, at least one of the area for judging whether the touch is continued for a long time, the area for judging whether the user touches the data processing device to hold it, and the area for judging the touch action may be set as a part of the display unit 130. Furthermore, the position of the above-mentioned area, the judgment action or display action performed in the area, etc. may be changed according to the situation. Furthermore, the user may also set and change the position of the above-mentioned area, the judgment action or display action performed in the area, etc.

[0387] For example, in an area corresponding to the front of the data processing device 100, such as the third area 140(3), it is not necessary to determine whether the area is being touched for a long time or whether the user is touching the area to hold the data processing device. In addition, in such an area, it is not necessary to exclude the area for determining the touch action. Therefore, the user can sometimes use the data processing device 100 smoothly.

[0388] Note that the user can also set it by himself and only exclude a specific area from the area for judging the touch action instead of judging whether the area is touched for a certain period of time. For example, in normal use, only the front of the third area 140 (3) is set as the area for judging the touch action. And the areas outside these areas are excluded from the area for judging the touch action. The above settings can be changed at any time according to the usage. In this way, the user can easily operate the data processing device 100.

[0389] Furthermore, when determining whether the user is looking at the back or the front of the data processing device 100, an acceleration sensor or a magnetic sensor may be used. By using the data of these sensors, the situation can be determined more accurately.

[0390] Note that the above-described program is not limited to being used in the data processing device 100 , and can be used in data processing devices exemplified in other embodiments. Fig.25 The figure is a diagram in which the unfolded data processing device 100B is held with the left hand, and a touch action is performed with the right hand on the position input unit 140 overlapping the display unit 130. By using the above program in the data processing device 100B, the display of the area held with the left hand can be stopped, thereby reducing power consumption. Alternatively, by using the above program in the data processing device 100B, the area held with the left hand can be excluded from the area for determining the touch action, thereby improving the detection accuracy of the touch action of the data processing device 100B. Alternatively, good operability of the data processing device 100B can be achieved.

[0391] When the user holds the data processing device 100, the following operations may be combined and executed in the area overlapping with the touched area of ​​the display unit 130, that is, the operation of not displaying the area or not rewriting the area and the operation of excluding the area from the area for determining the touch action. For example, the area touched by the user in order to hold the data processing device 100 may not be displayed and the touch action may not be determined.

[0392] This embodiment mode can be combined with other embodiment modes described in this specification as appropriate.

[0393] Implementation 6

[0394] In this embodiment, reference will be made to FIG. 26A to FIG. 26C The structure of a position input unit of a data processing device and a display panel of a display device that can be used in one embodiment of the present invention is described. Note that since the display panel described in this embodiment has a touch sensor (touch detection device) overlapping the display unit, the display panel can be referred to as a touch panel (input / output device).

[0395] Fig.26A It is a plan view for explaining the structure of a position input unit of a data processing device and a display panel of a display device which can be used in one embodiment of the present invention.

[0396] Fig.26B It is along Fig.26A Cross-sectional view of cutting line AB and cutting line CD.

[0397] Fig.26C It is along Fig.26A Cross-sectional view along cutting line EF.

[0398] <Top view>

[0399] The input / output device 300 described as an example in this embodiment includes a display portion 301 (see FIG. 26A ).

[0400] The display unit 301 includes a plurality of pixels 302 and a plurality of imaging pixels 308. The imaging pixels 308 can detect a touch of a finger or the like on the display unit 301. Therefore, a touch sensor can be formed by using the imaging pixels 308.

[0401] Each pixel 302 includes a plurality of sub-pixels (eg, sub-pixel 302R) each including a light-emitting element and a pixel circuit capable of supplying power for driving the light-emitting element.

[0402] The pixel circuit is electrically connected to a wiring capable of supplying a selection signal and a wiring capable of supplying an image signal.

[0403] The input / output device 300 includes a scanning line driving circuit 303g(1) capable of supplying a selection signal to the pixel 302 and an image signal line driving circuit 303s(1) capable of supplying an image signal to the pixel 302. Note that if the image signal line driving circuit 303s(1) is arranged to avoid a bendable portion, the occurrence of defects can be reduced.

[0404] The imaging pixel 308 includes a photoelectric conversion element and an imaging pixel circuit for driving the photoelectric conversion element.

[0405] The imaging pixel circuit is electrically connected to a wiring capable of supplying a control signal and a wiring capable of supplying a power supply potential.

[0406] Examples of the control signal include a signal that can select an imaging pixel circuit that reads out a stored imaging signal, a signal that can initialize an imaging pixel circuit, and a signal that can determine the timing for an imaging pixel circuit to detect light.

[0407] The input / output device 300 includes an imaging pixel driving circuit 303g (2) capable of supplying a control signal to the imaging pixel 308 and an imaging signal line driving circuit 303s (2) for reading an imaging signal. Note that if the imaging signal line driving circuit 303s (2) is arranged to avoid the bendable portion, the occurrence of defects can be reduced.

[0408] <Cross-sectional view>

[0409] The input / output device 300 includes a substrate 310 and an opposing substrate 370 opposing the substrate 310 (see Fig.26B ).

[0410] The substrate 310 is a laminated body including a flexible substrate 310 b , a barrier film 310 a for preventing impurities from being unintentionally diffused into the light emitting element, and an adhesive layer 310 c for bonding the substrate 310 b and the barrier film 310 a .

[0411] The counter substrate 370 is a laminated body including a flexible substrate 370b, a barrier film 370a for preventing impurities from unintentionally diffusing into the light emitting element, and an adhesive layer 370c for bonding the substrate 370b and the barrier film 370a (see FIG. Fig.26B ).

[0412] The counter substrate 370 and the substrate 310 are bonded together using a sealant 360. The sealant 360 has a higher refractive index than the atmosphere and also serves as an optical adhesive layer. The pixel circuit and the light-emitting element (for example, the first light-emitting element 350R) and the imaging pixel circuit and the photoelectric conversion element (for example, the photoelectric conversion element 308p) are located between the substrate 310 and the counter substrate 370.

[0413] Pixel Structure

[0414] Each pixel 302 has a sub-pixel 302R, a sub-pixel 302G, and a sub-pixel 302B (see Fig.26C ). In addition, the sub-pixel 302R includes a light-emitting module 380R, the sub-pixel 302G includes a light-emitting module 380G, and the sub-pixel 302B includes a light-emitting module 380B.

[0415] For example, the sub-pixel 302R includes a first light-emitting element 350R and a pixel circuit including a transistor 302t capable of supplying power to the first light-emitting element 350R (see Fig.26B). In addition, the light emitting module 380R includes a first light emitting element 350R and an optical element (eg, a coloring layer 367R).

[0416] The transistor 302t includes a semiconductor layer. Any semiconductor layer can be used as the semiconductor layer. For example, semiconductors such as silicon, germanium, etc.; compound semiconductors such as gallium arsenide, etc.; oxide semiconductors such as indium oxide, zinc oxide, indium gallium zinc oxide, etc.; and organic semiconductors can be used. In addition, the semiconductor layer can also have single crystal, polycrystalline, or microcrystalline crystallinity. In addition, the semiconductor layer can also be amorphous. Even if the shape of the oxide semiconductor is deformed such as bending, its characteristics are not easily changed. Therefore, as a semiconductor layer of a transistor formed on a flexible substrate, it is preferable to use an oxide semiconductor.

[0417] In this embodiment, a channel-etched transistor, which is a type of bottom-gate transistor, is exemplified as the transistor 302t, but a channel-protective transistor may also be used. Alternatively, a top-gate transistor may be used as the transistor 302t.

[0418] Alternatively, the transistor 302t may have a single-gate structure in which one channel formation region is formed in a semiconductor layer, a dual-gate structure in which two channel formation regions are formed, or a triple-gate structure in which three channel formation regions are formed.

[0419] In addition, the transistor 302 t may also include a back gate electrode, and the back gate electrode may be used to control the threshold of the transistor 302 t.

[0420] The light-emitting element 350R includes a lower electrode 351R, an upper electrode 352, and a layer 353 containing a light-emitting organic compound between the first lower electrode 351R and the upper electrode 352 (see Fig.26C ).

[0421] The layer 353 containing a light-emitting organic compound includes a light-emitting unit 353 a , a light-emitting unit 353 b , and an intermediate layer 354 between the light-emitting unit 353 a and the light-emitting unit 353 b .

[0422] The light emitting module 380R includes a first coloring layer 367R on a substrate 370. The coloring layer only needs to transmit light having a specific wavelength, and for example, a coloring layer that selectively transmits red, green, or blue light can be used. In addition, a region that directly transmits light emitted by a light emitting element can also be provided.

[0423] For example, the light emitting module 380R includes a sealant 360 in contact with the first light emitting element 350R and the first coloring layer 367R.

[0424] The first coloring layer 367R overlaps with the first light emitting element 350R. Therefore, part of the light emitted by the first light emitting element 350R passes through the sealant 360 also serving as the optical adhesive layer and the first coloring layer 367R. Fig.26B and Fig.26C As shown by the arrow in , the light is emitted to the outside of the light emitting module 380R.

[0425] 《Structure of input / output device》

[0426] The input / output device 300 includes a light shielding layer 367BM on a counter substrate 370. The light shielding layer 367BM is provided so as to surround a coloring layer (for example, the first coloring layer 367R).

[0427] In the input / output device 300, the antireflection layer 367p is provided in a region overlapping with the display portion 301. As the antireflection layer 367p, for example, a circular polarizing plate can be used.

[0428] The input / output device 300 includes an insulating film 321. The insulating film 321 covers the transistor 302t. Note that the insulating film 321 can be used as a layer for flattening the unevenness generated by the pixel circuit. In addition, an insulating film formed by stacking layers that can suppress the diffusion of impurities into the transistor 302t and the like can be used for the insulating film 321.

[0429] The input / output device 300 includes a light emitting element (eg, a first light emitting element 350R) on an insulating film 321 .

[0430] The input / output device 300 includes a partition wall 328 (see FIG. 1 ) overlapping with the end of the first lower electrode 351R on the insulating film 321. Fig.26C ). In addition, a spacer 329 for controlling the distance between the substrate 310 and the counter substrate 370 is provided on the partition wall 328.

[0431] 《Structure of image signal line drive circuit》

[0432] The image signal line driver circuit 303s(1) includes a transistor 303t and a capacitor 303c. Note that the image signal line driver circuit 303s(1) can be formed on the same substrate as the pixel circuit by the same process as the pixel circuit. The transistor 303t can have the same structure as the transistor 302t. Note that the transistor 303t may have a different structure from the transistor 302t.

[0433] The structure of camera pixels

[0434] Each of the imaging pixels 308 includes a photoelectric conversion element 308p and an imaging pixel circuit for detecting light irradiated to the photoelectric conversion element 308p. In addition, the imaging pixel circuit includes a transistor 308t. The transistor 308t may have the same structure as the transistor 302t. Note that the transistor 308t may also have a structure different from that of the transistor 302t.

[0435] For example, a PIN type photodiode can be used for the photoelectric conversion element 308p.

[0436] Other structures

[0437] The input / output device 300 includes a wiring 311 capable of supplying signals, and a terminal 319 is provided in the wiring 311. Note that the FPC 309 (1) capable of supplying signals such as image signals and synchronization signals is electrically connected to the terminal 319. It is preferable to arrange the FPC 309 (1) away from the bendable portion of the input / output device 300. It is preferable to arrange the FPC 309 (1) on one side selected from the region surrounding the display unit 301, especially on the foldable side ( Fig.26A FPC 309 (1) is arranged approximately in the middle of the input / output device 300 (the longer side). This can shorten the distance between the input / output device 300 and the external circuit that drives the input / output device 300, making the connection easier. It can also make the center of gravity of the external circuit roughly coincide with the center of gravity of the input / output device 300. As a result, the operation of the data processing device becomes easier, and accidents such as accidentally dropping the device can be prevented.

[0438] Note that the FPC 309 ( 1 ) may also be mounted with a printed wiring board (PWB).

[0439] Note that although an example in which a light-emitting element is used as a display element is described here, one embodiment of the present invention is not limited to this.

[0440] For example, in this specification and the like, a display element, a display device which is a device having a display element, a light emitting element, and a light emitting device which is a device having a light emitting element may adopt various forms or various elements. Examples of display elements, display devices, light-emitting elements, or light-emitting devices include EL (electroluminescent) elements (EL elements including organic materials and inorganic materials, organic EL elements, or inorganic EL elements, etc.), LEDs (white LEDs, red LEDs, green LEDs, or blue LEDs, etc.), transistors (transistors that emit light in response to current), electron-emitting elements, liquid crystal elements, electronic ink, electrophoretic elements, grating light valves (GLVs), plasma display panels (PDPs), display elements using microelectromechanical systems (MEMS), digital micromirror devices (DMDs), digital microshutters (DMSs), MIRASOL (registered trademark), interferometric modulator display (IMOD) elements, shutter-type MEMS display elements, optical interference-type MEMS display elements, electrowetting elements, piezoelectric ceramic displays, or carbon nanotubes, which are display media whose contrast, brightness, reflectivity, transmittance, etc., change due to electromagnetic action. Note that examples of display devices using EL elements include EL displays, etc. Examples of display devices using electron emission elements include field emission displays (FED) or SED flat-panel displays (SED: Surface-conduction Electron-emitter Display). Examples of display devices using liquid crystal elements include liquid crystal displays (e.g., transmissive liquid crystal displays, semi-transmissive liquid crystal displays, reflective liquid crystal displays, direct-view liquid crystal displays, and projection liquid crystal displays). Examples of display devices using electronic ink or electrophoretic elements include electronic paper. When a transflective liquid crystal display or a reflective liquid crystal display is implemented, part or all of the pixel electrode may function as a reflective electrode. For example, part or all of the pixel electrode may have aluminum, silver, or the like. Furthermore, at this time, a storage circuit such as SRAM may also be disposed under the reflective electrode. Thus, power consumption is further reduced.

[0441] For example, in this specification, etc., transistors of various structures can be used as transistors. Therefore, the type of transistor used is not limited. As an example of a transistor, a transistor having single crystal silicon or a transistor having a non-single crystal semiconductor film represented by amorphous silicon, polycrystalline silicon or microcrystalline (also called microcrystalline, nanocrystalline, semi-amorphous) silicon, etc. can be used. Alternatively, a thin film transistor (TFT) that makes these semiconductors thin films can be used. When using TFT, there are various advantages. For example, because it can be manufactured at a lower temperature than when single crystal silicon is used, it is possible to reduce manufacturing costs or make the manufacturing device larger. Since the manufacturing device can be made larger, it can be manufactured on a large substrate. Thus, many display devices can be manufactured at the same time, so that they can be manufactured at low cost. In addition, since the manufacturing temperature is low, a substrate with low heat resistance can be used. Thus, a transistor can be manufactured using a substrate with light transmittance. Alternatively, a transistor formed by a light transmittance substrate can be used to control the transmission of light in a display element. Alternatively, because the thickness of the transistor is thin, a part of the film forming the transistor can allow light to pass through. Thus, the aperture ratio can be increased.

[0442] Note that when manufacturing polysilicon, the crystallinity can be further improved by using a catalyst (nickel, etc.), so that a transistor with good electrical characteristics can be manufactured. As a result, the same substrate can be used to form a gate driver circuit (scan line driver circuit, etc.), a source driver circuit (signal line driver circuit, etc.), and a signal processing circuit (signal generation circuit, gamma correction circuit, DA conversion circuit, etc.).

[0443] Note that when microcrystalline silicon is manufactured, the crystallinity can be further improved by using a catalyst (nickel, etc.), thereby manufacturing a transistor with good electrical characteristics. At this time, the crystallinity can be improved only by heat treatment without laser irradiation. As a result, a part of the source driver circuit (analog switch, etc.) and the gate driver circuit (scan line driver circuit) can be formed on the same substrate. Note that when laser irradiation is not performed to achieve crystallization, the unevenness of silicon crystallinity can be suppressed. Therefore, an image with improved image quality can be displayed. Note that polycrystalline silicon or microcrystalline silicon can also be manufactured without using a catalyst (nickel, etc.).

[0444] Note that although it is preferred to improve the crystallinity of silicon to polycrystalline or microcrystalline in the entire panel, it is not limited to this. The crystallinity of silicon can also be improved only in a part of the panel. By selectively irradiating a laser, etc., the crystallinity can be selectively improved. For example, it is also possible to irradiate the laser only to the peripheral drive circuit area that is the area outside the pixel. Alternatively, it is also possible to irradiate the laser only to the area of ​​the gate drive circuit, the source drive circuit, etc. Alternatively, it is also possible to irradiate the laser only to a part of the source drive circuit (such as an analog switch). As a result, the crystallinity of silicon can be improved only in the area where the circuit needs to work at high speed. Since the pixel area does not particularly need to work at high speed, the pixel circuit can work normally even if the crystallinity is not improved. As a result, there are fewer areas to improve the crystallinity, so the manufacturing process can also be reduced, thereby improving production capacity and reducing manufacturing costs. Alternatively, since the number of required manufacturing devices is small, the manufacturing cost can be reduced.

[0445] Note that as an example of a transistor, a transistor including a compound semiconductor (e.g., SiGe, GaAs, etc.) or an oxide semiconductor (e.g., ZnO, InGaZnO, IZO (indium zinc oxide) (registered trademark), ITO (indium tin oxide), SnO, TiO, AlZnSnO (AZTO)), ITZO (In-Sn-Zn-O) (registered trademark), etc. can be used. Alternatively, a thin film transistor or the like can be used by thin-filming these compound semiconductors or oxide semiconductors. As a result, the manufacturing temperature can be lowered, so that, for example, the transistor can be manufactured at room temperature. As a result, a transistor can be directly formed on a substrate with low heat resistance, such as a plastic substrate or a thin film substrate. Note that these compound semiconductors or oxide semiconductors can be used not only for the channel portion of the transistor, but also for other purposes. For example, they can be used as wiring, a resistor element, a pixel electrode, an electrode with light transmittance, etc. Since these elements can be formed at the same time as the transistor, the cost can be reduced.

[0446] Note that as an example of a transistor, a transistor formed by an inkjet method or a printing method can be used. Thus, the transistor can be formed at room temperature, formed with a low vacuum degree, or formed using a large substrate. In this way, a transistor can be formed without using a mask (reticle), so the layout of the transistor can be changed more easily. Alternatively, since a resist is not required, material costs can be reduced and the number of processes can be reduced. In addition, since a film can be formed only on the required portion, compared with a manufacturing method in which a film is formed on the entire surface and then etched, no material is wasted, thereby reducing costs.

[0447] Note that as an example of a transistor, a transistor including an organic semiconductor or a carbon nanotube can be used. Thus, a transistor can be formed using a substrate that can be bent. A device using a transistor including an organic semiconductor or a carbon nanotube can withstand impact.

[0448] Note that as a transistor, transistors of various structures can also be used. For example, as a transistor, a MOS transistor, a junction transistor, a bipolar transistor, etc. can be used. By using a MOS transistor as a transistor, the transistor size can be reduced. Therefore, multiple transistors can be installed. By using a bipolar transistor as a transistor, a large current can flow. Therefore, the circuit can operate at high speed. Note that a MOS transistor and a bipolar transistor can also be formed on a single substrate. By adopting this structure, low power consumption, miniaturization, high-speed operation, etc. can be achieved.

[0449] Note that, for example, in this specification, a multi-gate structure transistor having more than two gate electrodes can be used as an example of a transistor. When a multi-gate structure is used, since the channel regions are connected in series, a structure in which multiple transistors are connected in series is formed. Therefore, by adopting a multi-gate structure, the off-state current can be reduced and the voltage resistance of the transistor can be improved (reliability can be improved). Alternatively, by utilizing a multi-gate structure, when the transistor operates in the saturation region, even if the voltage between the drain and the source changes, the change in the current between the drain and the source is not too large, so that a voltage-current characteristic with a flat tilt angle can be obtained. When utilizing a voltage-current characteristic with a flat tilt angle, an ideal current source circuit or an active load with an extremely high resistance value can be realized. As a result, a differential circuit or a current mirror circuit with good characteristics can be realized.

[0450] Note that as an example of a transistor, a transistor having a structure in which gate electrodes are arranged above and below a channel can be used. By adopting a structure in which gate electrodes are arranged above and below a channel, a plurality of transistors are connected in parallel. Therefore, the channel area increases, so the current value can be increased. Alternatively, by adopting a structure in which gate electrodes are arranged above and below a channel, a depletion layer is easily generated, so the subthreshold swing value can be improved.

[0451] Note that as an example of a transistor, a structure in which a gate electrode is arranged on a channel region, a structure in which a gate electrode is arranged below a channel region, a staggered structure, an anti-staggered structure, a structure in which a channel region is divided into a plurality of regions, a structure in which channel regions are connected in parallel, or a structure in which channel regions are connected in series, etc. Alternatively, as a transistor, a transistor having various structures such as a planar type, a FIN (fin) type, a TRI-GATE (tri-gate) type, a top gate type, a bottom gate type, and a dual gate type (a gate is arranged above and below the channel) can be used.

[0452] Note that, for example, in this specification, etc., various substrates can be used to form transistors. There is no particular restriction on the type of substrate. As an example of the substrate, for example, a semiconductor substrate (for example, a single crystal substrate or a silicon substrate), an SOI substrate, a glass substrate, a quartz substrate, a plastic substrate, a metal substrate, a stainless steel substrate, a substrate with a stainless steel foil, a tungsten substrate, a substrate with a tungsten foil, a flexible substrate, a laminated film, a paper containing a fibrous material, or a substrate film can be used. As an example of a glass substrate, there are barium borosilicate glass substrates, aluminum borosilicate glass substrates, soda-lime glass substrates, etc. As flexible substrates, flexible substrates, laminated films, substrate films, etc., the following examples can be cited. For example, plastics represented by polyethylene terephthalate (PET), polyethylene naphthalate (PEN), and polyether sulfone (PES), synthetic resins such as acrylic resins, polypropylene, polyester, polyvinyl fluoride, polyvinyl chloride, polyester, polyamide, polyimide, aromatic polyamide, epoxy resin, inorganic vapor-deposited film, paper, etc. can be cited. In particular, by manufacturing transistors using semiconductor substrates, single crystal substrates, or SOI substrates, transistors with small characteristics, small size, high current capability, and small size can be manufactured. When circuits are constructed using the above transistors, low power consumption or high integration of circuits can be achieved.

[0453] Note that a transistor can also be formed using one substrate and then transferred to another substrate. As the substrate to which the transistor is transferred, not only the above-mentioned substrates that can form transistors can be used, but also paper substrates, cellophane substrates, aramid film substrates, polyimide film substrates, stone substrates, wood substrates, cloth substrates (including natural fibers (silk, cotton, linen, etc.), synthetic fibers (nylon, polyurethane, polyester, etc.) or regenerated fibers (acetate, cuprammonium, rayon, regenerated polyester, etc.), leather substrates, rubber substrates, etc. can be used. By using the above-mentioned substrates, it is possible to form transistors with good characteristics, form transistors with low power consumption, manufacture devices that are not easily damaged, improve heat resistance, and reduce weight or thickness.

[0454] Note that all circuits required to implement a specified function can be formed on the same substrate (e.g., a glass substrate, a plastic substrate, a single crystal substrate, or an SOI substrate, etc.) In this way, costs can be reduced by reducing the number of components, or reliability can be improved by reducing the number of connections between circuit components.

[0455] Note that all circuits required to realize a specified function may not be formed on the same substrate. In other words, a part of the circuit required to realize a specified function may be formed on a certain substrate, and another part of the circuit required to realize a specified function may be formed on another substrate. For example, a part of the circuit required to realize a specified function may be formed on a glass substrate, and another part of the circuit required to realize a specified function may be formed on a single crystal substrate (or SOI substrate). In addition, a single crystal substrate (also called an IC chip) forming a part of the circuit required to realize a specified function may be connected to a glass substrate by COG (Chip On Glass), thereby configuring the IC chip on a glass substrate. Alternatively, the IC chip and the glass substrate may be connected using TAB (Tape Automated Bonding), COF (Chip On Film), SMT (Surface Mount Technology) or a printed circuit board. In this way, by using the same substrate to form a part of the circuit and the pixel portion, the cost can be reduced by reducing the number of components, or the reliability can be improved by reducing the number of connections between the circuit components. In particular, in many cases, the power consumption of the circuit of the part with high driving voltage or the circuit of the part with high driving frequency is high. Therefore, such a circuit is formed on a different substrate (for example, a single crystal substrate) from the pixel part to form an IC chip. By using this IC chip, the increase of power consumption can be prevented.

[0456] For example, in this specification and the like, an active matrix method in which an active element is included in a pixel or a passive matrix method in which an active element is not included in a pixel may be adopted.

[0457] In the active matrix method, various active elements (non-linear elements) can be used as active elements (non-linear elements) in addition to transistors. For example, MIM (Metal Insulator Metal) or TFD (Thin Film Diode) can also be used. Since these elements have fewer manufacturing steps, the manufacturing cost can be reduced or the yield rate can be improved. Alternatively, since the size of these elements is small, the aperture ratio can be increased, thereby achieving low power consumption or high brightness.

[0458] In addition, in addition to the active matrix method, a passive matrix method without active elements (non-linear elements) can also be used. Since no active elements (non-linear elements) are used, the manufacturing process is small, thereby reducing manufacturing costs or improving yields. Alternatively, since no active elements (non-linear elements) are used, the aperture ratio can be increased, thereby achieving low power consumption or high brightness, etc.

[0459] This embodiment mode can be combined with other embodiment modes described in this specification as appropriate.

[0460] Implementation 7

[0461] In this embodiment, reference will be made to Fig.27A , Fig.27B and Fig.28 The structure of a position input unit of a data processing device and a display panel of a display device that can be used in one embodiment of the present invention is described. Note that since the display panel described in this embodiment has a touch sensor (touch detection device) overlapping the display unit, the display panel can be referred to as a touch panel (input / output device).

[0462] Fig.27A is a perspective schematic diagram of a touch panel 500 illustrated in this embodiment. Note that for the sake of clarity, Fig.27A and Fig.27B Only the main components are shown. Fig.27B 1 is a perspective schematic diagram of the unfolded touch panel 500 .

[0463] Fig.28 It is along Fig.27A The touch panel 500 is shown in a cross-sectional view taken along line X1 - X2 .

[0464] The touch panel 500 includes a display unit 501 and a touch sensor 595 (see Fig.27B ). The touch panel 500 further includes a substrate 510, a substrate 570, and a substrate 590. Note that, as an example, the substrate 510, the substrate 570, and the substrate 590 are all flexible.

[0465] Note that, for example, in this specification, etc., various substrates can be used to form transistors. There is no particular restriction on the type of substrate. As the substrate, for example, a semiconductor substrate (for example, a single crystal substrate or a silicon substrate), an SOI substrate, a glass substrate, a quartz substrate, a plastic substrate, a metal substrate, a stainless steel substrate, a substrate with a stainless steel foil, a tungsten substrate, a substrate with a tungsten foil, a flexible substrate, a bonding film, a paper containing a fibrous material, or a substrate film can be used. As an example of a glass substrate, there are barium borosilicate glass substrates, aluminum borosilicate glass substrates, soda-lime glass substrates, etc. As a flexible substrate, for example, plastics represented by polyethylene terephthalate (PET), polyethylene naphthalate (PEN), and polyether sulfone (PES), synthetic resins such as acrylic resins, etc. can be cited. Alternatively, as a bonding film, for example, polypropylene, polyester, polyvinyl fluoride, or polyvinyl chloride can be cited. Alternatively, as a substrate film, for example, polyamide, polyimide, epoxy resin, inorganic vapor-deposited film, paper, etc. can be cited. In particular, by using a semiconductor substrate, a single crystal substrate, or an SOI substrate, it is possible to manufacture transistors with small characteristics, size, shape, etc., high current capacity, and small size. When such transistors are used to form a circuit, low power consumption or high integration of the circuit can be achieved.

[0466] The display unit 501 includes a substrate 510, a plurality of pixels on the substrate 510, and a plurality of wirings 511 capable of supplying signals to the pixels. The plurality of wirings 511 extend to the periphery of the substrate 510, and a portion thereof constitutes a terminal 519. The terminal 519 is electrically connected to the FPC 509 (1).

[0467] <Touch Sensor>

[0468] The substrate 590 includes a touch sensor 595 and a plurality of wirings 598 electrically connected to the touch sensor 595. The plurality of wirings 598 extend to the outer periphery of the substrate 590, and a portion of the wirings 598 constitutes a terminal for electrically connecting to the FPC 509 (2). Fig.27B In the figure, electrodes, wiring, etc. of the touch sensor 595 provided on the back side of the substrate 590 (the back side in the drawing) are shown by solid lines.

[0469] It is preferable to use an electrostatic capacitance touch sensor as the touch sensor used as the touch sensor 595. As electrostatic capacitance touch sensors, there are surface electrostatic capacitance, projection electrostatic capacitance, etc., and as projection electrostatic capacitance touch sensors, they are mainly divided into self-capacitance touch sensors, mutual capacitance touch sensors, etc. according to different driving methods. When using a mutual capacitance touch sensor, multiple points can be detected at the same time, so it is preferable.

[0470] Below, refer to Fig.27B The case of using a projected electrostatic capacitive touch sensor is described, but it is noted that various sensors capable of detecting the approach or contact of a detection target such as a finger may also be used.

[0471] The projected electrostatic capacitive touch sensor 595 includes an electrode 591 and an electrode 592 . The electrode 591 is electrically connected to one of a plurality of wirings 598 , and the electrode 592 is electrically connected to another one of the plurality of wirings 598 .

[0472] like Fig.27A and Fig.27B As shown, the electrode 592 has a shape in which a plurality of quadrilaterals are continuous in the same direction. In addition, the electrodes 591 are all quadrilaterals. The wiring 594 electrically connects the two electrodes 591 arranged in a direction intersecting the direction in which the electrode 592 extends. At this time, it is preferred to make the area where the electrode 592 and the wiring 594 intersect as small as possible. Thus, the area of ​​the region where the electrode is not provided can be reduced, so the unevenness of the transmittance can be reduced. As a result, the unevenness of the brightness of the light passing through the touch sensor 595 can be reduced.

[0473] Note that the shapes of the electrodes 591 and 592 are not limited thereto, and may have various shapes. For example, the plurality of electrodes 591 may be arranged so as to minimize the gaps, and the plurality of electrodes 592 may be arranged so as to be separated from the electrodes 591 via an insulating layer so as to form a region that does not overlap with the electrodes 591. In this case, by providing a dummy electrode electrically insulated from two adjacent electrodes 592, the area of ​​the region with different transmittances can be reduced, which is preferred.

[0474] Reference Fig.28 The structure of touch panel 500 will be described.

[0475] The touch sensor 595 includes a substrate 590 , electrodes 591 and electrodes 592 arranged in a staggered pattern on the substrate 590 , an insulating layer 593 covering the electrodes 591 and the electrodes 592 , and wirings 594 that electrically connect adjacent electrodes 591 .

[0476] The substrate 590 and the substrate 570 are bonded together using an adhesive layer 597 so that the touch sensor 595 and the display portion 501 overlap.

[0477] The electrode 591 and the electrode 592 are formed using a light-transmitting conductive material. As the light-transmitting conductive material, a conductive oxide such as indium oxide, indium tin oxide, indium zinc oxide, zinc oxide, or zinc oxide to which gallium is added can be used.

[0478] After a light-transmitting conductive material is formed on the substrate 590 by sputtering, unnecessary portions may be removed by various patterning techniques such as photolithography to form the electrodes 591 and 592 .

[0479] In addition, the insulating layer 593 covers the electrode 591 and the electrode 592. Examples of the material of the insulating layer 593 include resins such as acrylic resins and epoxy resins, resins having a siloxane bond, and inorganic insulating materials such as silicon oxide, silicon oxynitride, and aluminum oxide.

[0480] The openings reaching the electrodes 591 are provided in the insulating layer 593, and the wirings 594 electrically connect the adjacent electrodes 591. It is preferable that the wirings 594 be formed of a light-transmitting conductive material because the aperture ratio of the touch panel can be increased. In addition, it is preferable that the wirings 594 be made of a material having a higher conductivity than the electrodes 591 and 592.

[0481] One electrode 592 extends in one direction, and a plurality of electrodes 592 are arranged in a stripe shape.

[0482] The wiring 594 is provided so as to intersect the electrode 592 .

[0483] A pair of electrodes 591 is provided so as to sandwich one electrode 592 , and is electrically connected by a wiring 594 .

[0484] Note that the plurality of electrodes 591 are not necessarily orthogonal to the single electrode 592 and may be arranged such that the angle between them is less than 90°.

[0485] One wiring 598 is electrically connected to the electrode 591 or the electrode 592. A part of the wiring 598 functions as a terminal. The wiring 598 can be made of, for example, a metal material such as aluminum, gold, platinum, silver, nickel, titanium, tungsten, chromium, molybdenum, iron, cobalt, copper, or palladium, or an alloy material containing the above metal materials.

[0486] Note that by providing an insulating layer that covers the insulating layer 593 and the wiring 594, the touch sensor 595 can be protected.

[0487] The connection layer 599 electrically connects the wiring 598 and the FPC 509 ( 2 ).

[0488] The connection layer 599 may be made of various anisotropic conductive films (ACF: Anisotropic Conductive Film) or anisotropic conductive paste (ACP: Anisotropic Conductive Paste) or the like.

[0489] The adhesive layer 597 has light-transmitting properties and can be made of, for example, a thermosetting resin or an ultraviolet curing resin, and specifically, a resin such as an acrylic resin, a urethane resin, an epoxy resin, or a resin having a siloxane bond can be used.

[0490] <Display>

[0491] Touch panel 500 includes a plurality of pixels arranged in a matrix. Each pixel includes a display element and a pixel circuit for driving the display element.

[0492] In this embodiment, a case where an organic electroluminescent element that emits white light is used as a display element is described; however, the display element is not limited to this.

[0493] For example, as a display element, in addition to an organic electroluminescent element, a display element that uses an electrophoretic method or an electronic powder fluid method (also called an electronic ink), a shutter method MEMS display element, an optical interference method MEMS display element, a liquid crystal element, and other various display elements can be used. Note that a structure suitable for the display element used can be selected from the structures of various pixel circuits.

[0494] The substrate 510 is a laminated body including a flexible substrate 510b, a barrier film 510a for preventing impurities from unintentionally diffusing into the light emitting element, and an adhesive layer 510c for bonding the substrate 510b and the barrier film 510a.

[0495] The substrate 570 is a laminated body including a flexible substrate 570b, a barrier film 570a for preventing impurities from unintentionally diffusing into the light emitting element, and an adhesive layer 570c for bonding the substrate 570b and the barrier film 570a.

[0496] The substrate 570 and the substrate 510 are bonded together using a sealant 560. The sealant 560 has a higher refractive index than the atmosphere and also serves as an optical adhesive layer. The pixel circuit and the light emitting element (for example, the first light emitting element 550R) are provided between the substrate 510 and the substrate 570.

[0497] The Structure of Pixels

[0498] The pixel includes a sub-pixel 502R, and the sub-pixel 502R includes a light emitting module 580R.

[0499] The sub-pixel 502R includes a first light-emitting element 550R and a pixel circuit including a transistor 502t capable of supplying power to the first light-emitting element 550R. In addition, the light-emitting module 580R includes the first light-emitting element 550R and an optical element (eg, a colored layer 567R).

[0500] The first light-emitting element 550R includes a lower electrode, an upper electrode, and a layer containing a light-emitting organic compound between the lower electrode and the upper electrode.

[0501] The light emitting module 580R has a first coloring layer 567R on a substrate 570. The coloring layer may transmit light having a specific wavelength, for example, a layer that selectively transmits red, green, or blue light may be used. Alternatively, a region that directly transmits light emitted by a light emitting element may be provided.

[0502] The light emitting module 580R includes a sealant 560 in contact with the first light emitting element 550R and the first coloring layer 567R.

[0503] The first coloring layer 567R overlaps with the first light emitting element 550R. Therefore, part of the light emitted by the first light emitting element 550R passes through the sealant 560 also serving as the optical adhesive layer and the first coloring layer 567R. Fig.28 As shown by the arrow in FIG. , the light is emitted to the outside of the light emitting module 580R.

[0504] 《Structure of the display unit》

[0505] The display portion 501 includes a light-shielding layer 567BM over a substrate 570. The light-shielding layer 567BM is provided so as to surround a coloring layer (for example, the first coloring layer 567R).

[0506] An antireflection layer 567p is provided in a region overlapping with pixels in the display portion 501. As the antireflection layer 567p, for example, a circular polarizing plate can be used.

[0507] The display portion 501 includes an insulating film 521 that covers the transistor 502t. Note that the insulating film 521 can be used as a layer for flattening unevenness generated by the pixel circuit. In addition, an insulating film formed by stacking layers that can suppress diffusion of impurities into the transistor 502t and the like can be used for the insulating film 521.

[0508] The display portion 501 includes a light-emitting element (eg, a first light-emitting element 550R) over the insulating film 521 .

[0509] The display portion 501 includes a partition wall 528 that overlaps with an end portion of the first lower electrode over the insulating film 521. In addition, a spacer for controlling the distance between the substrate 510 and the substrate 570 is provided over the partition wall 528.

[0510] 《Structure of image signal line drive circuit》

[0511] The image signal line driver circuit 503s(1) includes a transistor 503t and a capacitor 503c. Note that the image signal line driver circuit 503s(1) can be formed over the same substrate as the pixel circuit by the same process as the pixel circuit.

[0512] Other structures

[0513] The display portion 501 includes a wiring 511 that can supply signals, and the wiring 511 is provided with a terminal 519. Note that the terminal 519 is electrically connected to an FPC 509 (1) that can supply signals such as image signals and synchronization signals.

[0514] Note that the FPC 509 ( 1 ) may also be mounted with a printed wiring board (PWB).

[0515] This embodiment mode can be combined with other embodiment modes described in this specification as appropriate.

[0516] Implementation 8

[0517] In this embodiment, refer to FIG. 29A to FIG. 29D , FIG. 30A to FIG. 30D and Figures 31A to Fig.31D A method for manufacturing a foldable device such as a data processing device and an electronic device that can be applied to one embodiment of the present invention is described. Examples of foldable devices include display devices, light-emitting devices, and input devices. Examples of input devices include touch sensors and touch screens. Examples of light-emitting devices include organic EL panels and lighting devices. Examples of display devices include light-emitting devices, organic EL panels, and liquid crystal display devices. Note that sometimes the function of an input device such as a touch sensor is provided inside a display device and / or a light-emitting device. For example, sometimes a touch sensor is provided on an opposing substrate (e.g., a substrate without transistors) included in a display device or a light-emitting device. Alternatively, sometimes a touch sensor is provided on an element substrate (e.g., a substrate with transistors) included in a display device or a light-emitting device. Alternatively, sometimes a touch sensor is provided on an opposing substrate included in a display device or a light-emitting device and an element substrate included in the display device or the light-emitting device.

[0518] First, a peeling layer 703 is formed on a formation substrate 701, and a peeled layer 705 is formed on the peeling layer 703. Fig.29A ). In addition, a peeling layer 723 is formed on the formation substrate 721, and a peeled layer 725 is formed on the peeling layer 723 ( Fig.29B ).

[0519] In addition, when a tungsten film is used as the stripping layer, a tungsten oxide film may be formed on the surface of the tungsten film by plasma treatment with a gas containing oxygen such as N2O or by annealing the tungsten film in a gas atmosphere containing oxygen. Alternatively, the tungsten oxide film may be formed by sputtering in a gas atmosphere containing oxygen. Thus, a tungsten oxide film may be formed between the stripping layer and the stripped layer.

[0520] When the lift-off transfer step of the tungsten oxide film is performed, the tungsten oxide film is preferably mainly WO x (x is less than 3). When WO x W of the same series n O (3n-1) , W n O (3n-2) When WO is heated, there is a shear plane in the crystal optics. x Shearing is easy to occur. By forming a tungsten oxide film, the peeled layer can be peeled off from the substrate with a small force.

[0521] Alternatively, only a tungsten oxide film may be formed as a peeling layer without forming a tungsten film. For example, a tungsten oxide film may be formed by plasma treatment of a sufficiently thin tungsten film using a gas containing oxygen or annealing in a gas atmosphere containing oxygen. Alternatively, a tungsten oxide film may be formed by sputtering in a gas atmosphere containing oxygen.

[0522] At this time, due to the separation at the interface between the peeled layer and the tungsten oxide film, sometimes the tungsten oxide film remains on the side of the peeled layer. Furthermore, due to the remaining tungsten oxide film, sometimes the characteristics of the transistor are adversely affected. Therefore, after the separation step of the peeling layer and the peeled layer, it is preferred to perform a step of removing the tungsten oxide film. In the above-mentioned method of peeling from the substrate, it is not necessary to perform N2O plasma treatment, and the step of removing the tungsten oxide film can be omitted. In this case, the device can be manufactured more simply.

[0523] In one embodiment of the present invention, a tungsten film having a thickness of 0.1 nm or more and less than 200 nm is formed on a substrate.

[0524] As the peeling layer, in addition to the tungsten film, a film containing molybdenum, titanium, vanadium, tantalum, silicon, aluminum, and their alloys can also be used. In addition, a laminated structure of the film and an oxide film can also be used. The peeling layer is not limited to an inorganic film, and an organic film such as polyimide can also be used.

[0525] When an organic resin is used as a peeling layer, if polycrystalline silicon is used as an active layer of a transistor, a processing step below 350°C is required. Therefore, dehydrogenation baking for crystallizing silicon, hydrogenation for terminating defects in silicon, activation of doped regions, etc. cannot be performed sufficiently, and the performance of the transistor is limited. On the other hand, when an inorganic film is used as a peeling layer, the processing step can be performed at a temperature higher than 350°C, and good transistor characteristics can be exhibited.

[0526] When an organic resin is used for the release layer, the organic resin or the functional element may be damaged by laser irradiation during crystallization. However, when an inorganic film is used for the release layer, such a problem does not occur, which is preferred.

[0527] When an organic resin is used for the peeling layer, the organic resin may shrink due to laser irradiation for peeling the resin, resulting in poor contact at the contact portion of the terminal of the FPC, etc., so it is sometimes difficult to peel and transfer a functional component with a large number of terminals such as a high-definition display of the FPC with a high yield. When an inorganic film is used for the peeling layer, there is no such limitation, and even a functional component with a large number of terminals such as a high-definition display can be peeled and transferred with a high yield.

[0528] In a method of peeling off and transposing a functional element from a substrate in one embodiment of the present invention, an insulating layer or a transistor can be formed on a forming substrate at a temperature below 600°C. In this case, high-temperature polysilicon or CG silicon (registered trademark) can be used for the semiconductor layer. In this case, semiconductor devices with high batch operation speed, high gas barrier properties, and high reliability can be produced by utilizing an existing production line of high-temperature polysilicon or CG silicon (registered trademark). At this time, by using an insulating layer and a transistor formed by a process below 600°C, an insulating layer with high gas barrier properties formed under film forming conditions below 600°C can be arranged above and below the organic EL element. As a result, impurities such as moisture can be suppressed from entering the organic EL element or the semiconductor layer, and a light-emitting device with much higher reliability can be realized than when an organic resin or the like is used for the peeling layer.

[0529] Alternatively, an insulating layer or transistor can be formed on a substrate for formation at a temperature below 500°C. In this case, low-temperature polysilicon or an oxide semiconductor can be used for the semiconductor layer, and mass production can be performed by utilizing an existing low-temperature polysilicon production line. At this time, by using an insulating layer and a transistor formed by a process below 500°C, an insulating layer with high gas barrier properties formed under film forming conditions below 500°C can also be arranged above and below the organic EL element. In this way, impurities such as moisture can be suppressed from entering the inorganic EL element or the semiconductor layer, and a light-emitting device with much higher reliability can be realized compared to when an organic resin is used for the peeling layer.

[0530] Alternatively, an insulating layer or a transistor can be formed on a substrate for formation at a temperature below 400°C. In this case, amorphous silicon or an oxide semiconductor can be used for the semiconductor layer, and mass production can be performed by utilizing an existing amorphous silicon production line. At this time, by using an insulating layer and a transistor formed by a process below 400°C, an insulating layer with high gas barrier properties formed under film forming conditions below 400°C can also be arranged above and below the organic EL element. In this way, impurities such as moisture can be suppressed from entering the organic EL element or the semiconductor layer, and a light-emitting device with higher reliability can be realized compared to when an organic resin or the like is used for the peeling layer.

[0531] Next, the formation substrate 701 and the formation substrate 721 are bonded together using the bonding layer 707 and the frame-shaped bonding layer 711 so that the surfaces of the respective peeled layers face each other, and the bonding layer 707 and the frame-shaped bonding layer 711 are cured ( Fig.29C Here, after providing a frame-shaped bonding layer 711 and a bonding layer 707 located in a region surrounded by the frame-shaped bonding layer 711 on the peeled layer 725, the formation substrate 701 and the formation substrate 721 are made to face each other and bonded together.

[0532] Note that the formation substrate 701 and the formation substrate 721 are preferably bonded together in a reduced pressure atmosphere.

[0533] Note that Fig.29C Although the peeling layer 703 and the peeling layer 723 are shown to have different sizes, they may also be different in size. Fig.29D Use peel layers of equal size as shown.

[0534] The bonding layer 707 is arranged so as to overlap the peeling layer 703, the peeling layer 705, the peeling layer 725, and the peeling layer 723. In addition, the end of the bonding layer 707 is preferably located inside the end of at least one of the peeling layer 703 and the peeling layer 723 (the peeling layer to be peeled off from the substrate first). Thus, the formation substrate 701 and the formation substrate 721 can be prevented from being tightly adhered to each other, thereby preventing a decrease in the yield of the subsequent peeling process.

[0535] Next, by irradiating laser light, a first peeling starting point 741 for peeling off from the substrate is formed ( Fig. 30A and Fig. 30B ).

[0536] Either the formation substrate 701 or the formation substrate 721 may be peeled off first. When the peeling layers are different in size, the substrate with the larger peeling layer may be peeled off first, or the substrate with the smaller peeling layer may be peeled off first. When a semiconductor element, a light emitting element, a display element, or the like is formed on only one substrate, the substrate on the side where the element is formed may be peeled off first, or the substrate on the other side may be peeled off first. Here, an example in which the formation substrate 701 is peeled off first is shown.

[0537] The laser is irradiated to the region where the solidified bonding layer 707 or the solidified frame-shaped bonding layer 711 overlaps with the peeled layer 705 and the peeling layer 703. Here, the case where the bonding layer 707 is solidified and the frame-shaped bonding layer 711 is unsolidified is exemplified, and the solidified bonding layer 707 is irradiated with the laser (see Fig. 30A arrow P3).

[0538] By forming a crack (forming a film crack or a fissure) in at least the first layer (a layer between the peeling layer 705 and the peeling layer 703, such as a tungsten oxide film), a first peeling starting point 741 (see Fig. 30B At this time, in addition to the first layer, other layers in the peeled layer 705, the peeling layer 703, or a portion of the bonding layer 707 may be removed.

[0539] It is preferred to irradiate the laser from the side of the substrate on which the peeling layer to be peeled is provided. When the laser is irradiated to the region where the peeling layer 703 and the peeling layer 723 overlap, a crack is formed only in the peeling layer 705 between the peeling layer 705 and the peeling layer 725, so that the forming substrate 701 and the peeling layer 703 can be selectively peeled off (see Fig. 30B The area surrounded by the dotted line in the figure).

[0540] When the laser is irradiated to the overlapping area of ​​the peeling layer 703 and the peeling layer 723, if the starting point for peeling from the substrate is formed on both the peeling layer 705 on the peeling layer 703 side and the peeling layer 725 on the peeling layer 723 side, it may be difficult to selectively peel off one of the formation substrates. Therefore, in order to form cracks only in one of the peeling layers, the irradiation conditions of the laser are sometimes limited. The method of forming the first peeling starting point 741 for peeling from the substrate is not limited to laser irradiation, and can also be formed using a sharp tool such as a cutter.

[0541] Next, the peeled layer 705 is separated from the formation substrate 701 from the formed first peeling starting point 741 ( Fig. 30C , Fig.30D ). Thus, the peeled layer 705 can be transferred from the formation substrate 701 to the formation substrate 721.

[0542] Using the bonding layer 733 will Fig.30D In the process shown in FIG. 1 , the peeled layer 705 separated from the forming substrate 701 is bonded to the substrate 731, and the bonding layer 733 is cured ( Fig.31A ).

[0543] Next, a sharp cutter such as a cutter is used to form a second peeling starting point ( Fig.31B , Fig.31C ) The method for forming the second peeling starting point 743 for peeling off from the substrate is not limited to a sharp tool such as a cutter, and can also be formed by laser irradiation or the like.

[0544] When the substrate 731 on the side where the peeling layer 723 is not provided can be cut using a cutter or the like, a cutout can be formed in the substrate 731, the bonding layer 733, and the peeling layer 725 (see Fig.31B Thus, a portion of the first layer can be removed to form a second peeling starting point 743 for peeling from the substrate (see arrow P5). Fig.31C The area surrounded by the dotted line in the figure).

[0545] like Fig.31B and Fig.31C As shown in FIG. 1 , when the formation substrate 721 and the substrate 731 are bonded together using the bonding layer 733 in the region not overlapping the peeling layer 723, the yield rate of the subsequent peeling process from the substrate may be reduced depending on the degree of closeness between the formation substrate 721 and the substrate 731. Therefore, it is preferred to form a frame-shaped cutout in the region where the cured bonding layer 733 overlaps the peeling layer 723 to form a second peeling starting point 743 from the substrate in a solid line shape. Thus, the yield rate of the peeling process from the substrate can be improved.

[0546] Next, the peeled layer 725 is separated from the formation substrate 721 from the formed second peeling starting point 743 for peeling from the substrate ( Fig.31D ). Thus, the peeled layer 725 can be transferred from the formation substrate 721 to the substrate 731.

[0547] For example, when a tungsten oxide film that is tightly fixed using N2O plasma or the like is formed on an inorganic film such as a tungsten film, the tightness during film formation can be made relatively high. When a peeling starting point is formed later, cleavage occurs from the starting point, and the peeled layer can be easily peeled off and transferred from the forming substrate to another substrate.

[0548] Alternatively, the formation substrate 721 and the peeled layer 725 may be separated by allowing a liquid such as water to penetrate the interface between the peeling layer 723 and the peeled layer 725. The liquid penetrates between the peeling layer 723 and the peeled layer 725 due to a capillary phenomenon, thereby suppressing the negative effects on the functional elements such as FETs included in the peeled layer 725 caused by static electricity generated when peeling from the substrate (such as the phenomenon that the semiconductor element is damaged by static electricity).

[0549] Furthermore, when a physical force is applied to a MOW bond (M is an arbitrary element) to break the bond, liquid penetrates into the gap and the bond becomes an M-OH HO-W bond, thereby promoting separation.

[0550] Note that the liquid may be sprayed in the form of mist or vapor. As the liquid, pure water or an organic solvent may be used, or a neutral, alkaline or acidic aqueous solution or an aqueous solution in which a salt is dissolved may be used.

[0551] In addition, the temperature of the liquid and the substrate during mechanical peeling is set to between room temperature and 120°C, preferably between 60°C and 90°C.

[0552] In the above-mentioned method for peeling from a substrate according to one embodiment of the present invention, a sharp cutter or the like is used to form a second peeling starting point 743 for peeling from the substrate, so that the peeling layer and the peeled layer are in a state that is easy to peel off, and then the forming substrate is peeled off. Thus, the yield rate of the peeling process from the substrate can be improved.

[0553] In addition, after a pair of forming substrates each provided with a peelable layer are bonded together in advance, the forming substrates are peeled off respectively, so that the substrates constituting the device to be manufactured can be bonded together. Therefore, when bonding the peelable layer, the forming substrates with low flexibility can be bonded together, and the positional alignment accuracy during bonding can be improved compared to bonding flexible substrates together.

[0554] Note that this embodiment mode can be combined with other embodiment modes and examples described in this specification as appropriate.

[0555] Explanation of symbols

[0556] 100: data processing device, 101: housing, 110: computing device, 111: computing unit, 112: storage unit, 114: transmission channel, 115: input / output interface, 120: input / output device, 130: display unit, 131: keyboard, 140: position input unit, 141: substrate, 142: proximity sensor, 145: input / output unit, 150: detection unit, 151: sensor, 152: arrow, 159: mark, 160: communication unit, 300: input / output device, 301: display unit, 302: pixel, 308: imaging pixel, 309: FPC, 310: substrate, 311: wiring, 319: Terminal, 321: Insulating film, 328: Partition wall, 329: Spacer, 352: Upper electrode, 353: Layer, 354: Intermediate layer, 360: Sealing agent, 370: Counter substrate, 500: Touch panel, 501: Display unit, 509: FPC, 510: Substrate, 511: Wiring, 519: Terminal, 521: Insulating film, 528: Partition wall, 560: Sealing agent, 570: Substrate, 590: Substrate, 591: Electrode, 592: Electrode, 593: Insulating layer, 594: Wiring, 595: Touch sensor, 597: Adhesive layer, 598: Wiring, 599: Connecting layer, 100B: Data processing device, 120B: Input / output device, 130B: Display unit, 13a: Connecting member, 13b: Connecting member, 140 (1): area, 140(2): area, 140(3): area, 140(4): area, 140(5): area, 140B: position input unit, 140B(1): area, 140B(2): area, 140B(3): area, 15a: supporting member, 15b: supporting member, 302B: sub-pixel, 302G: sub-pixel, 302R: sub-pixel, 302t: transistor, 303c: capacitor, 303g (1): scanning line driving circuit, 303g(2): imaging pixel driving circuit, 303s(1): image signal line driving circuit, 303s(2): imaging signal line driving circuit, 303t: transistor, 308p: photoelectric conversion element, 308t: transistor, 310a: blocking film, 310b: substrate, 310c: adhesive layer, 350R: light-emitting element, 351R: lower electrode, 353a: light-emitting unit, 353b: light-emitting unit, 367BM: light-shielding layer, 367p: anti-reflection layer, 367R: coloring layer, 370a: blocking film, 370b: substrate, 370c: adhesive layer, 380B: light-emitting module, 380G: light-emitting module, 380R: light-emitting module, 502R: sub-pixel, 502t: transistor, 503c: capacitor, 503s: image signal line driving circuit, 503t: transistor, 510a: blocking film, 510b: substrate, 510c: adhesive layer,550R: light emitting element, 567BM: light shielding layer, 567p: anti-reflection layer, 567R: coloring layer, 570a: barrier film, 570b: substrate, 570c: adhesive layer, 580R: light emitting module, 701: formation substrate, 703: peeling layer, 705: peeled layer, 707: bonding layer, 711: frame-shaped bonding layer, 721: formation substrate, 723: peeling layer, 725: peeled layer, 731: substrate, 733: bonding layer, 741: first peeling starting point, 743: second peeling starting point,

[0557] This application is based on Japanese Patent Application No. 2013-248392 filed with Japan Patent Office on November 29, 2013, the entire contents of which are incorporated herein by reference.

Claims

1. A method for driving a data processing device, the data processing device comprising a touch sensor, the touch sensor comprising a first area located on a first side surface of the data processing device, a second area located on a second side surface opposite to the first side surface of the data processing device, and a third area overlapping a display unit located on a front surface of the data processing device, The driving method comprises the following steps: determining a finger of a user operating the data processing device by detecting a touch of the finger at the first side surface or the second side surface of the data processing device; and The display unit displays images for operating the data processing device such that images for operation with high frequency of use are displayed closer to the movable range of the finger than images for operation with low frequency of use.

2. A method for driving a data processing device, the data processing device comprising a touch sensor, the touch sensor comprising a first area located on a first side surface of the data processing device, a second area located on a second side surface opposite to the first side surface of the data processing device, and a third area overlapping a display unit located on a front surface of the data processing device, The driving method comprises the following steps: determining a finger of a user for operating the data processing device by detecting a touch of the finger on the first area or the second area; Displaying images for operating the data processing device on the display unit so that images for operation with high frequency of use are displayed closer to the movable range of the finger than images for operation with low frequency of use; and When the finger slides in the first area or the second area, a program is executed, in, The data processing device is configured to exclude an area that is continuously touched for a certain period of time from an area for determining a touch action.

3. The driving method according to claim 1 or 2, wherein: The first side surface and the second side surface are configured to display an image.

4. The driving method according to claim 1 or 2, in, The second side surface is opposite to the first side surface, the display portion is located between the second side surface and the first side surface, and Wherein, the display portion contacts the first side surface and the second side surface.

5. The driving method according to claim 1 or 2, wherein: The determining step comprises: Define the shape as the contact area; and The center coordinates of the figure having an area larger than a predetermined area are determined.

6. The driving method according to claim 1 or 2, wherein: The determining step comprises: Define the line segment as the length of the contact area; and The coordinates of the midpoint of the line segment whose length is longer than a predetermined length are determined.

Images